2023-10-18T13:42:01.949 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-18T13:42:01.950 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896 --verbose --owner scheduled_pdonnell@teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896/orig.config.yaml 2023-10-18T13:42:02.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T13:42:02.131 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896 branch: wip-batrick-testing-20231016.203825 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} email: pdonnell@redhat.com first_in_suite: false job_id: '7430896' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-batrick-testing-20231016.203825 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: f7420d7f8e55ceea786dcbf536c338ce920c21eb subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: f7420d7f8e55ceea786dcbf536c338ce920c21eb kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - nowsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231016.203825 sha1: f7420d7f8e55ceea786dcbf536c338ce920c21eb owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7703 sha1: f7420d7f8e55ceea786dcbf536c338ce920c21eb sleep_before_teardown: 0 subset: 153/256 suite: fs suite_branch: wip-batrick-testing-20231016.203825 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f7420d7f8e55ceea786dcbf536c338ce920c21eb syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi158.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_23:59:58 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-18T13:42:02.132 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa; will attempt to use it 2023-10-18T13:42:02.133 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks 2023-10-18T13:42:02.133 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-18T13:42:02.135 INFO:teuthology.task.internal:Checking packages... 2023-10-18T13:42:02.158 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'f7420d7f8e55ceea786dcbf536c338ce920c21eb' 2023-10-18T13:42:02.159 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T13:42:02.159 INFO:teuthology.packaging:ref: None 2023-10-18T13:42:02.160 INFO:teuthology.packaging:tag: None 2023-10-18T13:42:02.160 INFO:teuthology.packaging:branch: wip-batrick-testing-20231016.203825 2023-10-18T13:42:02.160 INFO:teuthology.packaging:sha1: f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-18T13:42:02.161 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20231016.203825 2023-10-18T13:42:02.378 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6786.gf7420d7f 2023-10-18T13:42:02.378 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-18T13:42:02.384 INFO:teuthology.task.internal:no buildpackages task found 2023-10-18T13:42:02.384 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-18T13:42:02.437 INFO:teuthology.task.internal:Saving configuration 2023-10-18T13:42:02.459 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-18T13:42:02.465 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T13:42:02.491 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 13:36:14.617366', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-18T13:42:02.514 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 13:36:14.620786', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-18T13:42:02.535 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 13:36:14.619330', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-18T13:42:02.535 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-18T13:42:02.543 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-18T13:42:02.543 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-18T13:42:02.544 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-18T13:42:02.544 INFO:teuthology.run_tasks:Running task console_log... 2023-10-18T13:42:02.655 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fccb42d6ca0>, signals=[15]) 2023-10-18T13:42:02.656 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-18T13:42:02.663 INFO:teuthology.task.internal:Opening connections... 2023-10-18T13:42:02.663 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T13:42:02.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T13:42:02.733 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T13:42:02.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T13:42:02.806 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T13:42:02.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T13:42:02.874 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-18T13:42:02.881 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2023-10-18T13:42:02.902 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-10-18T13:42:02.903 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-10-18T13:42:02.962 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux" 2023-10-18T13:42:02.963 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)" 2023-10-18T13:42:02.963 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel" 2023-10-18T13:42:02.963 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora" 2023-10-18T13:42:02.963 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6" 2023-10-18T13:42:02.964 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-10-18T13:42:02.964 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-18T13:42:02.964 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-10-18T13:42:02.964 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-18T13:42:02.964 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/" 2023-10-18T13:42:02.965 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-18T13:42:02.965 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T13:42:02.965 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:42:02.965 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T13:42:02.965 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-18T13:42:02.966 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-18T13:42:02.966 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-18T13:42:02.967 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-10-18T13:42:02.987 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-10-18T13:42:03.007 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-10-18T13:42:03.008 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-10-18T13:42:03.070 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux" 2023-10-18T13:42:03.070 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.6 (Ootpa)" 2023-10-18T13:42:03.071 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel" 2023-10-18T13:42:03.071 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora" 2023-10-18T13:42:03.071 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.6" 2023-10-18T13:42:03.071 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-10-18T13:42:03.071 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-18T13:42:03.072 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-10-18T13:42:03.072 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-18T13:42:03.072 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/" 2023-10-18T13:42:03.072 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-18T13:42:03.072 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T13:42:03.073 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T13:42:03.073 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T13:42:03.073 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-18T13:42:03.073 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-18T13:42:03.073 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-18T13:42:03.074 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-10-18T13:42:03.095 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-10-18T13:42:03.117 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-10-18T13:42:03.117 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-10-18T13:42:03.177 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-10-18T13:42:03.178 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-10-18T13:42:03.178 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-10-18T13:42:03.178 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-10-18T13:42:03.178 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-10-18T13:42:03.179 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-10-18T13:42:03.179 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-18T13:42:03.179 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-10-18T13:42:03.179 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-18T13:42:03.179 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-10-18T13:42:03.180 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-18T13:42:03.180 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T13:42:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:42:03.180 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T13:42:03.180 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-18T13:42:03.181 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-18T13:42:03.181 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-18T13:42:03.181 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-10-18T13:42:03.204 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-18T13:42:03.215 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-18T13:42:03.254 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-18T13:42:03.254 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2023-10-18T13:42:03.257 DEBUG:teuthology.orchestra.run.smithi158:> test '!' -e /home/ubuntu/cephtest 2023-10-18T13:42:03.259 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2023-10-18T13:42:03.278 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-18T13:42:03.284 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-18T13:42:03.284 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2023-10-18T13:42:03.316 DEBUG:teuthology.orchestra.run.smithi158:> test -z $(ls -A /var/lib/ceph) 2023-10-18T13:42:03.322 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2023-10-18T13:42:03.354 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-18T13:42:03.432 INFO:teuthology.run_tasks:Running task kernel... 2023-10-18T13:42:03.446 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-18T13:42:03.447 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-10-18T13:42:03.447 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-10-18T13:42:03.448 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T13:42:03.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T13:42:03.467 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2023-10-18T13:42:03.526 INFO:teuthology.orchestra.run.smithi114.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-18T13:42:03.526 INFO:teuthology.task.kernel:Running kernel on smithi114: 4.18.0-372.9.1.el8.x86_64 2023-10-18T13:42:03.527 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum install -y kernel 2023-10-18T13:42:04.672 INFO:teuthology.orchestra.run.smithi114.stdout:Updating Subscription Management repositories. 2023-10-18T13:42:04.673 INFO:teuthology.orchestra.run.smithi114.stdout:Unable to read consumer identity 2023-10-18T13:42:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:Copr repo for python3-asyncssh owned by ceph 2.6 kB/s | 3.5 kB 00:01 2023-10-18T13:42:08.232 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-10-18T13:42:11.657 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 531 kB/s | 24 kB 00:00 2023-10-18T13:42:12.345 INFO:teuthology.orchestra.run.smithi114.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-18T13:42:12.407 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2023-10-18T13:42:12.408 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2023-10-18T13:42:12.409 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2023-10-18T13:42:12.523 DEBUG:teuthology.orchestra.run.smithi114:> echo no | sudo yum reinstall kernel || true 2023-10-18T13:42:12.852 INFO:teuthology.orchestra.run.smithi114.stdout:Updating Subscription Management repositories. 2023-10-18T13:42:12.852 INFO:teuthology.orchestra.run.smithi114.stdout:Unable to read consumer identity 2023-10-18T13:42:13.123 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:00:02 ago on Wed 18 Oct 2023 01:42:11 PM UTC. 2023-10-18T13:42:13.166 INFO:teuthology.orchestra.run.smithi114.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-18T13:42:13.201 INFO:teuthology.orchestra.run.smithi114.stderr:Error: No packages marked for reinstall. 2023-10-18T13:42:13.247 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum reinstall -y kernel || true 2023-10-18T13:42:13.577 INFO:teuthology.orchestra.run.smithi114.stdout:Updating Subscription Management repositories. 2023-10-18T13:42:13.578 INFO:teuthology.orchestra.run.smithi114.stdout:Unable to read consumer identity 2023-10-18T13:42:13.848 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:00:02 ago on Wed 18 Oct 2023 01:42:11 PM UTC. 2023-10-18T13:42:13.888 INFO:teuthology.orchestra.run.smithi114.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-18T13:42:13.907 INFO:teuthology.orchestra.run.smithi114.stderr:Error: No packages marked for reinstall. 2023-10-18T13:42:13.955 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q kernel | sort -rV | head -n 1 2023-10-18T13:42:14.036 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-18T13:42:14.036 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-18T13:42:14.036 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-18T13:42:14.037 DEBUG:teuthology.parallel:result is None 2023-10-18T13:42:14.037 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-18T13:42:14.044 INFO:teuthology.task.internal:Creating test directory... 2023-10-18T13:42:14.044 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T13:42:14.046 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T13:42:14.049 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T13:42:14.069 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-18T13:42:14.087 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-18T13:42:14.120 INFO:teuthology.task.internal:Creating archive directory... 2023-10-18T13:42:14.121 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T13:42:14.123 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T13:42:14.126 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T13:42:14.170 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-18T13:42:14.177 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-18T13:42:14.177 DEBUG:teuthology.orchestra.run.smithi158:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T13:42:14.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T13:42:14.223 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T13:42:14.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T13:42:14.242 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T13:42:14.244 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T13:42:14.266 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T13:42:14.281 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T13:42:14.292 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T13:42:14.310 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T13:42:14.316 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T13:42:14.329 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T13:42:14.332 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T13:42:14.334 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-18T13:42:14.341 INFO:teuthology.task.internal:Configuring sudo... 2023-10-18T13:42:14.341 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T13:42:14.344 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T13:42:14.346 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T13:42:14.402 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-18T13:42:14.411 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-18T13:42:14.411 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T13:42:14.414 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T13:42:14.416 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T13:42:14.460 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T13:42:14.510 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T13:42:14.560 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T13:42:14.640 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T13:42:14.685 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:42:14.685 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T13:42:14.751 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T13:42:14.800 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T13:42:14.852 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T13:42:14.941 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T13:42:14.984 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T13:42:14.984 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T13:42:15.054 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T13:42:15.099 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T13:42:15.158 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T13:42:15.247 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T13:42:15.289 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T13:42:15.289 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T13:42:15.359 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2023-10-18T13:42:15.362 DEBUG:teuthology.orchestra.run.smithi158:> sudo service rsyslog restart 2023-10-18T13:42:15.364 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2023-10-18T13:42:15.426 INFO:teuthology.orchestra.run.smithi158.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T13:42:15.433 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T13:42:15.460 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T13:42:15.852 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-18T13:42:15.861 INFO:teuthology.task.internal:Starting timer... 2023-10-18T13:42:15.861 INFO:teuthology.run_tasks:Running task pcp... 2023-10-18T13:42:15.882 INFO:teuthology.run_tasks:Running task selinux... 2023-10-18T13:42:15.915 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-18T13:42:15.915 DEBUG:teuthology.orchestra.run.smithi114:> sudo service auditd rotate 2023-10-18T13:42:15.978 INFO:teuthology.orchestra.run.smithi114.stdout:Rotating logs: 2023-10-18T13:42:15.980 DEBUG:teuthology.orchestra.run.smithi158:> sudo service auditd rotate 2023-10-18T13:42:16.030 INFO:teuthology.orchestra.run.smithi158.stdout:Rotating logs: 2023-10-18T13:42:16.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2023-10-18T13:42:16.085 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2023-10-18T13:42:16.087 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-18T13:42:16.087 DEBUG:teuthology.orchestra.run.smithi114:> /usr/sbin/getenforce 2023-10-18T13:42:16.109 INFO:teuthology.orchestra.run.smithi114.stdout:Permissive 2023-10-18T13:42:16.110 DEBUG:teuthology.orchestra.run.smithi158:> /usr/sbin/getenforce 2023-10-18T13:42:16.141 INFO:teuthology.orchestra.run.smithi158.stdout:Permissive 2023-10-18T13:42:16.142 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2023-10-18T13:42:16.168 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2023-10-18T13:42:16.168 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi114.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi158.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2023-10-18T13:42:16.168 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T13:42:16.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T13:42:16.197 DEBUG:teuthology.orchestra.run.smithi158:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T13:42:16.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T13:42:16.225 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T13:42:16.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T13:42:16.254 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-18T13:42:16.254 DEBUG:teuthology.orchestra.run.smithi114:> sudo /usr/sbin/setenforce permissive 2023-10-18T13:42:16.283 DEBUG:teuthology.orchestra.run.smithi158:> sudo /usr/sbin/setenforce permissive 2023-10-18T13:42:16.319 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2023-10-18T13:42:16.346 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-18T13:42:16.357 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-18T13:42:16.363 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-18T13:42:16.513 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-18T13:42:16.530 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-18T13:42:16.532 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi114.front.sepia.ceph.com,smithi158.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-18T13:51:39.481 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi114.front.sepia.ceph.com'), Remote(name='ubuntu@smithi158.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2023-10-18T13:51:39.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-18T13:51:39.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T13:51:39.552 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-10-18T13:51:39.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-18T13:51:39.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-18T13:51:39.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T13:51:39.689 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-10-18T13:51:39.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-18T13:51:39.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-18T13:51:39.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T13:51:39.829 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-10-18T13:51:39.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-18T13:51:39.900 INFO:teuthology.run_tasks:Running task clock... 2023-10-18T13:51:39.911 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-18T13:51:39.911 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T13:51:39.912 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T13:51:39.914 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T13:51:39.914 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T13:51:39.917 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T13:51:39.917 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T13:51:39.945 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-18T13:51:39.947 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-18T13:51:39.960 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-18T13:51:39.962 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-18T13:51:39.973 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-18T13:51:39.987 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-18T13:51:40.026 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: ntpd: command not found 2023-10-18T13:51:40.029 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: ntpd: command not found 2023-10-18T13:51:40.038 INFO:teuthology.orchestra.run.smithi158.stdout:506 Cannot talk to daemon 2023-10-18T13:51:40.041 INFO:teuthology.orchestra.run.smithi114.stdout:506 Cannot talk to daemon 2023-10-18T13:51:40.052 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-18T13:51:40.053 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2023-10-18T13:51:40.055 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-18T13:51:40.064 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2023-10-18T13:51:40.066 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-18T13:51:40.069 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-18T13:51:40.079 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-18T13:51:40.092 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-18T13:51:40.132 INFO:teuthology.orchestra.run.smithi158.stderr:bash: ntpq: command not found 2023-10-18T13:51:40.136 INFO:teuthology.orchestra.run.smithi158.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T13:51:40.136 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================== 2023-10-18T13:51:40.137 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T13:51:40.137 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T13:51:40.137 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T13:51:40.137 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T13:51:40.139 INFO:teuthology.orchestra.run.smithi114.stderr:bash: ntpq: command not found 2023-10-18T13:51:40.143 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T13:51:40.143 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2023-10-18T13:51:40.143 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T13:51:40.143 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T13:51:40.144 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T13:51:40.144 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T13:51:40.156 INFO:teuthology.orchestra.run.smithi172.stderr:bash: ntpq: command not found 2023-10-18T13:51:40.160 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T13:51:40.160 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2023-10-18T13:51:40.160 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T13:51:40.161 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T13:51:40.161 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T13:51:40.161 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T13:51:40.161 INFO:teuthology.run_tasks:Running task pexec... 2023-10-18T13:51:40.171 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-18T13:51:40.171 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T13:51:40.172 DEBUG:teuthology.orchestra.run.smithi114:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-18T13:51:40.172 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T13:51:40.172 DEBUG:teuthology.orchestra.run.smithi158:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-18T13:51:40.173 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T13:51:40.173 DEBUG:teuthology.orchestra.run.smithi172:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-18T13:51:40.550 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-18T13:51:40.557 INFO:teuthology.orchestra.run.smithi114.stdout:Updating Subscription Management repositories. 2023-10-18T13:51:40.573 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-10-18T13:51:41.368 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Oct 2023 01:50:08 PM UTC. 2023-10-18T13:51:41.375 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:33 ago on Wed 18 Oct 2023 01:50:07 PM UTC. 2023-10-18T13:51:41.376 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Oct 2023 01:50:02 PM UTC. 2023-10-18T13:51:43.098 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-18T13:51:43.099 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-18T13:51:43.099 INFO:teuthology.orchestra.run.smithi158.stdout: Package Architecture Version Repository Size 2023-10-18T13:51:43.099 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-18T13:51:43.099 INFO:teuthology.orchestra.run.smithi158.stdout:Resetting modules: 2023-10-18T13:51:43.100 INFO:teuthology.orchestra.run.smithi158.stdout: container-tools 2023-10-18T13:51:43.100 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T13:51:43.100 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-18T13:51:43.100 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-18T13:51:43.101 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T13:51:43.114 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2023-10-18T13:51:43.116 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2023-10-18T13:51:43.116 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2023-10-18T13:51:43.116 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2023-10-18T13:51:43.116 INFO:teuthology.orchestra.run.smithi114.stdout:Resetting modules: 2023-10-18T13:51:43.116 INFO:teuthology.orchestra.run.smithi114.stdout: container-tools 2023-10-18T13:51:43.117 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:51:43.117 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2023-10-18T13:51:43.117 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2023-10-18T13:51:43.117 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:51:43.255 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2023-10-18T13:51:43.256 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2023-10-18T13:51:43.256 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2023-10-18T13:51:43.257 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2023-10-18T13:51:43.257 INFO:teuthology.orchestra.run.smithi172.stdout:Resetting modules: 2023-10-18T13:51:43.257 INFO:teuthology.orchestra.run.smithi172.stdout: container-tools 2023-10-18T13:51:43.257 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:51:43.257 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2023-10-18T13:51:43.258 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2023-10-18T13:51:43.258 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:51:44.084 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Oct 2023 01:50:02 PM UTC. 2023-10-18T13:51:44.097 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Oct 2023 01:50:08 PM UTC. 2023-10-18T13:51:44.215 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Oct 2023 01:50:07 PM UTC. 2023-10-18T13:51:46.545 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-18T13:51:47.030 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-18T13:51:47.071 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2023-10-18T13:51:47.112 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2023-10-18T13:51:47.542 INFO:teuthology.orchestra.run.smithi114.stdout:Updating Subscription Management repositories. 2023-10-18T13:51:47.581 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-10-18T13:51:47.828 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Oct 2023 01:50:08 PM UTC. 2023-10-18T13:51:48.443 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Oct 2023 01:50:07 PM UTC. 2023-10-18T13:51:48.448 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:45 ago on Wed 18 Oct 2023 01:50:02 PM UTC. 2023-10-18T13:51:49.534 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-18T13:51:49.628 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================================================ 2023-10-18T13:51:49.628 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-18T13:51:49.628 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================================================ 2023-10-18T13:51:49.628 INFO:teuthology.orchestra.run.smithi158.stdout:Installing group/module packages: 2023-10-18T13:51:49.629 INFO:teuthology.orchestra.run.smithi158.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-18T13:51:49.629 INFO:teuthology.orchestra.run.smithi158.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-18T13:51:49.629 INFO:teuthology.orchestra.run.smithi158.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-18T13:51:49.629 INFO:teuthology.orchestra.run.smithi158.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-18T13:51:49.629 INFO:teuthology.orchestra.run.smithi158.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-18T13:51:49.630 INFO:teuthology.orchestra.run.smithi158.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-18T13:51:49.630 INFO:teuthology.orchestra.run.smithi158.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-18T13:51:49.630 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-10-18T13:51:49.630 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-18T13:51:49.630 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-18T13:51:49.631 INFO:teuthology.orchestra.run.smithi158.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-18T13:51:49.631 INFO:teuthology.orchestra.run.smithi158.stdout:Installing module profiles: 2023-10-18T13:51:49.631 INFO:teuthology.orchestra.run.smithi158.stdout: container-tools/common 2023-10-18T13:51:49.631 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T13:51:49.631 INFO:teuthology.orchestra.run.smithi158.stdout:Enabling module streams: 2023-10-18T13:51:49.632 INFO:teuthology.orchestra.run.smithi158.stdout: container-tools rhel8 2023-10-18T13:51:49.632 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T13:51:49.632 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-18T13:51:49.632 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================================================ 2023-10-18T13:51:49.632 INFO:teuthology.orchestra.run.smithi158.stdout:Install 10 Packages 2023-10-18T13:51:49.632 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T13:51:49.633 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 18 M 2023-10-18T13:51:49.633 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 65 M 2023-10-18T13:51:49.634 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-18T13:51:49.693 INFO:teuthology.orchestra.run.smithi158.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 397 kB/s | 25 kB 00:00 2023-10-18T13:51:49.718 INFO:teuthology.orchestra.run.smithi158.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 463 kB/s | 41 kB 00:00 2023-10-18T13:51:49.743 INFO:teuthology.orchestra.run.smithi158.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 828 kB/s | 94 kB 00:00 2023-10-18T13:51:49.769 INFO:teuthology.orchestra.run.smithi158.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 654 kB/s | 49 kB 00:00 2023-10-18T13:51:49.802 INFO:teuthology.orchestra.run.smithi158.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-10-18T13:51:49.828 INFO:teuthology.orchestra.run.smithi158.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-10-18T13:51:49.853 INFO:teuthology.orchestra.run.smithi158.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-10-18T13:51:49.937 INFO:teuthology.orchestra.run.smithi158.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 26 MB/s | 2.2 MB 00:00 2023-10-18T13:51:50.054 INFO:teuthology.orchestra.run.smithi158.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 31 MB/s | 7.0 MB 00:00 2023-10-18T13:51:50.137 INFO:teuthology.orchestra.run.smithi158.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 20 MB/s | 8.0 MB 00:00 2023-10-18T13:51:50.138 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-18T13:51:50.138 INFO:teuthology.orchestra.run.smithi158.stdout:Total 36 MB/s | 18 MB 00:00 2023-10-18T13:51:50.153 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2023-10-18T13:51:50.169 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2023-10-18T13:51:50.249 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================================================ 2023-10-18T13:51:50.250 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2023-10-18T13:51:50.250 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================================================ 2023-10-18T13:51:50.250 INFO:teuthology.orchestra.run.smithi172.stdout:Installing group/module packages: 2023-10-18T13:51:50.250 INFO:teuthology.orchestra.run.smithi172.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-18T13:51:50.251 INFO:teuthology.orchestra.run.smithi172.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-18T13:51:50.251 INFO:teuthology.orchestra.run.smithi172.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-18T13:51:50.251 INFO:teuthology.orchestra.run.smithi172.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-18T13:51:50.251 INFO:teuthology.orchestra.run.smithi172.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-18T13:51:50.251 INFO:teuthology.orchestra.run.smithi172.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-18T13:51:50.252 INFO:teuthology.orchestra.run.smithi172.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-18T13:51:50.252 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2023-10-18T13:51:50.252 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-18T13:51:50.252 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-18T13:51:50.252 INFO:teuthology.orchestra.run.smithi172.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-18T13:51:50.252 INFO:teuthology.orchestra.run.smithi172.stdout:Installing module profiles: 2023-10-18T13:51:50.253 INFO:teuthology.orchestra.run.smithi172.stdout: container-tools/common 2023-10-18T13:51:50.253 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:51:50.253 INFO:teuthology.orchestra.run.smithi172.stdout:Enabling module streams: 2023-10-18T13:51:50.253 INFO:teuthology.orchestra.run.smithi172.stdout: container-tools rhel8 2023-10-18T13:51:50.253 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:51:50.254 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2023-10-18T13:51:50.254 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================================================ 2023-10-18T13:51:50.254 INFO:teuthology.orchestra.run.smithi172.stdout:Install 10 Packages 2023-10-18T13:51:50.254 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:51:50.255 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 18 M 2023-10-18T13:51:50.255 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 65 M 2023-10-18T13:51:50.255 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2023-10-18T13:51:50.266 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================================================ 2023-10-18T13:51:50.266 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2023-10-18T13:51:50.267 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================================================ 2023-10-18T13:51:50.267 INFO:teuthology.orchestra.run.smithi114.stdout:Installing group/module packages: 2023-10-18T13:51:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-18T13:51:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-18T13:51:50.267 INFO:teuthology.orchestra.run.smithi114.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-18T13:51:50.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-18T13:51:50.268 INFO:teuthology.orchestra.run.smithi114.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-18T13:51:50.268 INFO:teuthology.orchestra.run.smithi114.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-18T13:51:50.268 INFO:teuthology.orchestra.run.smithi114.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-18T13:51:50.268 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2023-10-18T13:51:50.268 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-18T13:51:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-18T13:51:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-18T13:51:50.269 INFO:teuthology.orchestra.run.smithi114.stdout:Installing module profiles: 2023-10-18T13:51:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: container-tools/common 2023-10-18T13:51:50.269 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:51:50.269 INFO:teuthology.orchestra.run.smithi114.stdout:Enabling module streams: 2023-10-18T13:51:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: container-tools rhel8 2023-10-18T13:51:50.270 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:51:50.270 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2023-10-18T13:51:50.270 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================================================ 2023-10-18T13:51:50.271 INFO:teuthology.orchestra.run.smithi114.stdout:Install 10 Packages 2023-10-18T13:51:50.271 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:51:50.271 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 18 M 2023-10-18T13:51:50.272 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 65 M 2023-10-18T13:51:50.272 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2023-10-18T13:51:50.333 INFO:teuthology.orchestra.run.smithi172.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 310 kB/s | 25 kB 00:00 2023-10-18T13:51:50.339 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-18T13:51:50.343 INFO:teuthology.orchestra.run.smithi114.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.2 MB/s | 94 kB 00:00 2023-10-18T13:51:50.357 INFO:teuthology.orchestra.run.smithi172.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 386 kB/s | 41 kB 00:00 2023-10-18T13:51:50.358 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-18T13:51:50.358 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-18T13:51:50.369 INFO:teuthology.orchestra.run.smithi114.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 249 kB/s | 25 kB 00:00 2023-10-18T13:51:50.383 INFO:teuthology.orchestra.run.smithi172.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 717 kB/s | 94 kB 00:00 2023-10-18T13:51:50.394 INFO:teuthology.orchestra.run.smithi114.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 327 kB/s | 41 kB 00:00 2023-10-18T13:51:50.408 INFO:teuthology.orchestra.run.smithi172.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 656 kB/s | 49 kB 00:00 2023-10-18T13:51:50.419 INFO:teuthology.orchestra.run.smithi114.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 654 kB/s | 49 kB 00:00 2023-10-18T13:51:50.442 INFO:teuthology.orchestra.run.smithi172.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-10-18T13:51:50.453 INFO:teuthology.orchestra.run.smithi114.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-10-18T13:51:50.467 INFO:teuthology.orchestra.run.smithi172.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-10-18T13:51:50.478 INFO:teuthology.orchestra.run.smithi114.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-10-18T13:51:50.492 INFO:teuthology.orchestra.run.smithi172.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-10-18T13:51:50.503 INFO:teuthology.orchestra.run.smithi114.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-10-18T13:51:50.540 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-18T13:51:50.544 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-18T13:51:50.584 INFO:teuthology.orchestra.run.smithi172.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 24 MB/s | 2.2 MB 00:00 2023-10-18T13:51:50.595 INFO:teuthology.orchestra.run.smithi114.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 24 MB/s | 2.2 MB 00:00 2023-10-18T13:51:50.729 INFO:teuthology.orchestra.run.smithi114.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 28 MB/s | 7.0 MB 00:00 2023-10-18T13:51:50.734 INFO:teuthology.orchestra.run.smithi172.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 26 MB/s | 7.0 MB 00:00 2023-10-18T13:51:50.818 INFO:teuthology.orchestra.run.smithi172.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 18 MB/s | 8.0 MB 00:00 2023-10-18T13:51:50.819 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2023-10-18T13:51:50.819 INFO:teuthology.orchestra.run.smithi172.stdout:Total 32 MB/s | 18 MB 00:00 2023-10-18T13:51:50.820 INFO:teuthology.orchestra.run.smithi114.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 19 MB/s | 8.0 MB 00:00 2023-10-18T13:51:50.821 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2023-10-18T13:51:50.821 INFO:teuthology.orchestra.run.smithi114.stdout:Total 33 MB/s | 18 MB 00:00 2023-10-18T13:51:51.018 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2023-10-18T13:51:51.021 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2023-10-18T13:51:51.036 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2023-10-18T13:51:51.037 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2023-10-18T13:51:51.039 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2023-10-18T13:51:51.040 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2023-10-18T13:51:51.087 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-18T13:51:51.218 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2023-10-18T13:51:51.222 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2023-10-18T13:51:51.222 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2023-10-18T13:51:51.226 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2023-10-18T13:51:51.288 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-18T13:51:51.473 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-18T13:51:51.650 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-18T13:51:51.723 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2023-10-18T13:51:51.733 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2023-10-18T13:51:51.851 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-18T13:51:51.904 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-18T13:51:51.942 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-18T13:51:52.068 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-18T13:51:52.105 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-18T13:51:52.210 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-18T13:51:52.255 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-18T13:51:52.298 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-18T13:51:52.475 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-18T13:51:52.526 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-18T13:51:52.832 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-18T13:51:52.883 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-18T13:51:52.967 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-18T13:51:53.616 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-18T13:51:53.671 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-18T13:51:53.870 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-18T13:51:54.097 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-18T13:51:54.272 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-18T13:51:54.465 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-18T13:51:54.519 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-18T13:51:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-18T13:51:54.733 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-18T13:51:54.734 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-18T13:51:54.734 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-18T13:51:54.734 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-18T13:51:54.735 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-18T13:51:54.735 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-18T13:51:54.735 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-18T13:51:54.735 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-18T13:51:54.736 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-18T13:51:54.736 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-18T13:51:54.737 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-18T13:51:54.775 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-18T13:51:54.936 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-18T13:51:54.942 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-18T13:51:55.111 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-18T13:51:55.130 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-18T13:51:55.373 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-18T13:51:55.374 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-18T13:51:55.374 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-18T13:51:55.374 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-18T13:51:55.374 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-18T13:51:55.375 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-18T13:51:55.375 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-18T13:51:55.375 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-18T13:51:55.375 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-18T13:51:55.375 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-18T13:51:55.398 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-18T13:51:55.398 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-18T13:51:55.399 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-18T13:51:55.399 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-18T13:51:55.399 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-18T13:51:55.399 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-18T13:51:55.399 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-18T13:51:55.400 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-18T13:51:55.400 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-18T13:51:55.400 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-18T13:51:55.961 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-18T13:51:55.961 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:01:47 ago on Wed 18 Oct 2023 01:50:08 PM UTC. 2023-10-18T13:51:56.502 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-18T13:51:56.502 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:49 ago on Wed 18 Oct 2023 01:50:07 PM UTC. 2023-10-18T13:51:56.507 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-18T13:51:56.508 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:54 ago on Wed 18 Oct 2023 01:50:02 PM UTC. 2023-10-18T13:51:58.593 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-18T13:51:58.793 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T13:51:58.793 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-18T13:51:58.793 INFO:teuthology.orchestra.run.smithi158.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-18T13:51:58.793 INFO:teuthology.orchestra.run.smithi158.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-18T13:51:58.793 INFO:teuthology.orchestra.run.smithi158.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-18T13:51:58.794 INFO:teuthology.orchestra.run.smithi158.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-18T13:51:58.794 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-18T13:51:58.794 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-18T13:51:58.794 INFO:teuthology.orchestra.run.smithi158.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-18T13:51:58.795 INFO:teuthology.orchestra.run.smithi158.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-18T13:51:58.795 INFO:teuthology.orchestra.run.smithi158.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-18T13:51:58.795 INFO:teuthology.orchestra.run.smithi158.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-18T13:51:58.795 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T13:51:58.795 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-18T13:51:58.959 DEBUG:teuthology.parallel:result is None 2023-10-18T13:51:59.418 INFO:teuthology.orchestra.run.smithi114.stdout:Installed products updated. 2023-10-18T13:51:59.542 INFO:teuthology.orchestra.run.smithi172.stdout:Installed products updated. 2023-10-18T13:51:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:51:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2023-10-18T13:51:59.612 INFO:teuthology.orchestra.run.smithi114.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-18T13:51:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-18T13:51:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-18T13:51:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-18T13:51:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-18T13:51:59.613 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-18T13:51:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-18T13:51:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-18T13:51:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-18T13:51:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-18T13:51:59.614 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:51:59.615 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2023-10-18T13:51:59.740 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:51:59.740 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2023-10-18T13:51:59.741 INFO:teuthology.orchestra.run.smithi172.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-18T13:51:59.741 INFO:teuthology.orchestra.run.smithi172.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-18T13:51:59.741 INFO:teuthology.orchestra.run.smithi172.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-18T13:51:59.741 INFO:teuthology.orchestra.run.smithi172.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-18T13:51:59.742 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-18T13:51:59.742 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-18T13:51:59.742 INFO:teuthology.orchestra.run.smithi172.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-18T13:51:59.742 INFO:teuthology.orchestra.run.smithi172.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-18T13:51:59.742 INFO:teuthology.orchestra.run.smithi172.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-18T13:51:59.743 INFO:teuthology.orchestra.run.smithi172.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-18T13:51:59.743 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:51:59.743 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2023-10-18T13:51:59.744 DEBUG:teuthology.parallel:result is None 2023-10-18T13:51:59.890 DEBUG:teuthology.parallel:result is None 2023-10-18T13:51:59.891 INFO:teuthology.run_tasks:Running task install... 2023-10-18T13:51:59.900 DEBUG:teuthology.task.install:project ceph 2023-10-18T13:51:59.901 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb'}} 2023-10-18T13:51:59.901 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb'} 2023-10-18T13:51:59.901 INFO:teuthology.task.install:Using flavor: default 2023-10-18T13:51:59.907 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-18T13:51:59.908 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-18T13:51:59.908 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'tag': None, 'wait_for_package': False} 2023-10-18T13:51:59.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-18T13:51:59.911 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'tag': None, 'wait_for_package': False} 2023-10-18T13:51:59.912 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-18T13:51:59.913 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'tag': None, 'wait_for_package': False} 2023-10-18T13:51:59.913 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-18T13:52:00.061 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/ 2023-10-18T13:52:00.061 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6786.gf7420d7f 2023-10-18T13:52:00.074 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/ 2023-10-18T13:52:00.075 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6786.gf7420d7f 2023-10-18T13:52:00.145 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/ 2023-10-18T13:52:00.146 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6786.gf7420d7f 2023-10-18T13:52:00.184 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-18T13:52:00.184 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:52:00.185 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-18T13:52:00.213 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-18T13:52:00.213 DEBUG:teuthology.orchestra.run.smithi114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f7420d7f8e55ceea786dcbf536c338ce920c21eb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-18T13:52:00.254 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-18T13:52:00.254 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T13:52:00.255 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-18T13:52:00.257 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-18T13:52:00.258 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T13:52:00.258 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-18T13:52:00.283 DEBUG:teuthology.orchestra.run.smithi114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-18T13:52:00.286 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-18T13:52:00.286 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f7420d7f8e55ceea786dcbf536c338ce920c21eb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-18T13:52:00.292 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-18T13:52:00.292 DEBUG:teuthology.orchestra.run.smithi158:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f7420d7f8e55ceea786dcbf536c338ce920c21eb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-18T13:52:00.354 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-18T13:52:00.360 DEBUG:teuthology.orchestra.run.smithi114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-18T13:52:00.363 DEBUG:teuthology.orchestra.run.smithi158:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-18T13:52:00.426 INFO:teuthology.orchestra.run.smithi114.stdout:check_obsoletes = 1 2023-10-18T13:52:00.427 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum clean all 2023-10-18T13:52:00.431 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-18T13:52:00.443 DEBUG:teuthology.orchestra.run.smithi158:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-18T13:52:00.497 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2023-10-18T13:52:00.498 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2023-10-18T13:52:00.510 INFO:teuthology.orchestra.run.smithi158.stdout:check_obsoletes = 1 2023-10-18T13:52:00.512 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum clean all 2023-10-18T13:52:00.798 INFO:teuthology.orchestra.run.smithi114.stdout:Updating Subscription Management repositories. 2023-10-18T13:52:00.874 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-10-18T13:52:00.883 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-18T13:52:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:44 files removed 2023-10-18T13:52:01.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-18T13:52:01.212 INFO:teuthology.orchestra.run.smithi158.stdout:44 files removed 2023-10-18T13:52:01.237 INFO:teuthology.orchestra.run.smithi172.stdout:44 files removed 2023-10-18T13:52:01.258 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-18T13:52:01.283 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-18T13:52:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:Updating Subscription Management repositories. 2023-10-18T13:52:01.591 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-18T13:52:01.618 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-10-18T13:52:02.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph packages for x86_64 203 kB/s | 81 kB 00:00 2023-10-18T13:52:02.566 INFO:teuthology.orchestra.run.smithi158.stdout:ceph packages for x86_64 181 kB/s | 81 kB 00:00 2023-10-18T13:52:02.654 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 183 kB/s | 81 kB 00:00 2023-10-18T13:52:02.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-10-18T13:52:02.875 INFO:teuthology.orchestra.run.smithi158.stdout:ceph noarch packages 34 kB/s | 9.4 kB 00:00 2023-10-18T13:52:02.972 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 33 kB/s | 9.4 kB 00:00 2023-10-18T13:52:03.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph source packages 4.1 kB/s | 1.5 kB 00:00 2023-10-18T13:52:03.167 INFO:teuthology.orchestra.run.smithi158.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2023-10-18T13:52:03.214 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 6.8 kB/s | 1.5 kB 00:00 2023-10-18T13:52:03.317 INFO:teuthology.orchestra.run.smithi114.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-18T13:52:03.334 INFO:teuthology.orchestra.run.smithi158.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-18T13:52:03.373 INFO:teuthology.orchestra.run.smithi172.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-18T13:52:04.224 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-10-18T13:52:05.135 INFO:teuthology.orchestra.run.smithi158.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 16 MB 00:01 2023-10-18T13:52:05.296 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 8.1 MB/s | 16 MB 00:01 2023-10-18T13:52:07.707 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 420 kB/s | 24 kB 00:00 2023-10-18T13:52:08.669 INFO:teuthology.orchestra.run.smithi158.stdout:lab-extras 379 kB/s | 24 kB 00:00 2023-10-18T13:52:08.692 INFO:teuthology.orchestra.run.smithi172.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 MB/s | 53 MB 00:00 2023-10-18T13:52:08.752 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 434 kB/s | 24 kB 00:00 2023-10-18T13:52:09.546 INFO:teuthology.orchestra.run.smithi158.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-10-18T13:52:09.612 INFO:teuthology.orchestra.run.smithi114.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 MB/s | 47 MB 00:00 2023-10-18T13:52:16.827 INFO:teuthology.orchestra.run.smithi172.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 53 MB/s | 47 MB 00:00 2023-10-18T13:52:17.438 INFO:teuthology.orchestra.run.smithi114.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 MB/s | 53 MB 00:00 2023-10-18T13:52:17.447 INFO:teuthology.orchestra.run.smithi158.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-10-18T13:52:27.758 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-18T13:52:27.759 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-18T13:52:27.774 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-18T13:52:27.775 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-18T13:52:27.776 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-18T13:52:27.777 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-18T13:52:27.780 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-18T13:52:27.783 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-18T13:52:27.784 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-18T13:52:27.913 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2023-10-18T13:52:27.925 INFO:teuthology.orchestra.run.smithi172.stdout:=========================================================================================================================== 2023-10-18T13:52:27.925 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2023-10-18T13:52:27.925 INFO:teuthology.orchestra.run.smithi172.stdout:=========================================================================================================================== 2023-10-18T13:52:27.926 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2023-10-18T13:52:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-18T13:52:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-18T13:52:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 6.4 k 2023-10-18T13:52:27.926 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 5.4 M 2023-10-18T13:52:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 919 k 2023-10-18T13:52:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 167 k 2023-10-18T13:52:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 1.6 M 2023-10-18T13:52:27.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 132 k 2023-10-18T13:52:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 1.8 M 2023-10-18T13:52:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 7.4 M 2023-10-18T13:52:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 47 k 2023-10-18T13:52:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 14 M 2023-10-18T13:52:27.930 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 49 M 2023-10-18T13:52:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 261 k 2023-10-18T13:52:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 192 k 2023-10-18T13:52:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 261 k 2023-10-18T13:52:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 18 k 2023-10-18T13:52:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-18T13:52:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-18T13:52:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-18T13:52:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 31 k 2023-10-18T13:52:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 840 k 2023-10-18T13:52:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 139 k 2023-10-18T13:52:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-18T13:52:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-18T13:52:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-18T13:52:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-18T13:52:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-18T13:52:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-18T13:52:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 196 k 2023-10-18T13:52:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 370 k 2023-10-18T13:52:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 364 k 2023-10-18T13:52:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 107 k 2023-10-18T13:52:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 94 k 2023-10-18T13:52:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.6 M 2023-10-18T13:52:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 178 k 2023-10-18T13:52:27.935 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-18T13:52:27.935 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2023-10-18T13:52:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-18T13:52:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.7 M 2023-10-18T13:52:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.7 M 2023-10-18T13:52:27.936 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2023-10-18T13:52:27.936 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-18T13:52:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 23 M 2023-10-18T13:52:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 23 k 2023-10-18T13:52:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 2.3 M 2023-10-18T13:52:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 242 k 2023-10-18T13:52:27.937 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 4.6 M 2023-10-18T13:52:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 18 M 2023-10-18T13:52:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 15 k 2023-10-18T13:52:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 24 k 2023-10-18T13:52:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-18T13:52:27.938 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-18T13:52:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-18T13:52:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-18T13:52:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-18T13:52:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 185 k 2023-10-18T13:52:27.939 INFO:teuthology.orchestra.run.smithi172.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-18T13:52:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-18T13:52:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-18T13:52:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-18T13:52:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-18T13:52:27.940 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-18T13:52:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 518 k 2023-10-18T13:52:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-18T13:52:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 6.9 M 2023-10-18T13:52:27.941 INFO:teuthology.orchestra.run.smithi172.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-18T13:52:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-18T13:52:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-18T13:52:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-18T13:52:27.942 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-18T13:52:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-18T13:52:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-18T13:52:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-18T13:52:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-18T13:52:27.943 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-18T13:52:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-18T13:52:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-18T13:52:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-18T13:52:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-18T13:52:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-18T13:52:27.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-18T13:52:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 45 k 2023-10-18T13:52:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 125 k 2023-10-18T13:52:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-18T13:52:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-18T13:52:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-18T13:52:27.945 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-18T13:52:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-18T13:52:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-18T13:52:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-18T13:52:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-18T13:52:27.946 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-18T13:52:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-18T13:52:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-18T13:52:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-18T13:52:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-18T13:52:27.947 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-18T13:52:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-18T13:52:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-18T13:52:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-18T13:52:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-18T13:52:27.948 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-18T13:52:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-18T13:52:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-18T13:52:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-18T13:52:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-18T13:52:27.949 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-18T13:52:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-18T13:52:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-18T13:52:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-18T13:52:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-18T13:52:27.950 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-18T13:52:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-18T13:52:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-18T13:52:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-18T13:52:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-18T13:52:27.951 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-18T13:52:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-18T13:52:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-18T13:52:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-18T13:52:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-18T13:52:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-18T13:52:27.952 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-18T13:52:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-18T13:52:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-18T13:52:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-18T13:52:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-18T13:52:27.953 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-18T13:52:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-18T13:52:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-18T13:52:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-18T13:52:27.954 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-18T13:52:27.954 INFO:teuthology.orchestra.run.smithi172.stdout:Enabling module streams: 2023-10-18T13:52:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql 10 2023-10-18T13:52:27.955 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:52:27.955 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2023-10-18T13:52:27.955 INFO:teuthology.orchestra.run.smithi172.stdout:=========================================================================================================================== 2023-10-18T13:52:27.955 INFO:teuthology.orchestra.run.smithi172.stdout:Install 128 Packages 2023-10-18T13:52:27.956 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 3 Packages 2023-10-18T13:52:27.956 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:52:27.956 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 209 M 2023-10-18T13:52:27.957 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2023-10-18T13:52:28.419 INFO:teuthology.orchestra.run.smithi172.stdout:(1/131): ceph-18.0.0-6786.gf7420d7f.el8.x86_64. 51 kB/s | 6.4 kB 00:00 2023-10-18T13:52:28.562 INFO:teuthology.orchestra.run.smithi114.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-18T13:52:28.563 INFO:teuthology.orchestra.run.smithi114.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-18T13:52:28.569 INFO:teuthology.orchestra.run.smithi158.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-18T13:52:28.571 INFO:teuthology.orchestra.run.smithi158.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-18T13:52:28.578 INFO:teuthology.orchestra.run.smithi114.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-18T13:52:28.579 INFO:teuthology.orchestra.run.smithi114.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-18T13:52:28.580 INFO:teuthology.orchestra.run.smithi114.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-18T13:52:28.581 INFO:teuthology.orchestra.run.smithi114.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-18T13:52:28.583 INFO:teuthology.orchestra.run.smithi114.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-18T13:52:28.584 INFO:teuthology.orchestra.run.smithi158.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-18T13:52:28.585 INFO:teuthology.orchestra.run.smithi158.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-18T13:52:28.587 INFO:teuthology.orchestra.run.smithi158.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-18T13:52:28.587 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-18T13:52:28.588 INFO:teuthology.orchestra.run.smithi158.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-18T13:52:28.588 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-18T13:52:28.590 INFO:teuthology.orchestra.run.smithi158.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-18T13:52:28.593 INFO:teuthology.orchestra.run.smithi158.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-18T13:52:28.594 INFO:teuthology.orchestra.run.smithi158.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-18T13:52:28.636 INFO:teuthology.orchestra.run.smithi172.stdout:(2/131): ceph-fuse-18.0.0-6786.gf7420d7f.el8.x8 4.1 MB/s | 919 kB 00:00 2023-10-18T13:52:28.711 INFO:teuthology.orchestra.run.smithi172.stdout:(3/131): ceph-immutable-object-cache-18.0.0-678 2.2 MB/s | 167 kB 00:00 2023-10-18T13:52:28.718 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2023-10-18T13:52:28.724 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-18T13:52:28.730 INFO:teuthology.orchestra.run.smithi114.stdout:=========================================================================================================================== 2023-10-18T13:52:28.731 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2023-10-18T13:52:28.731 INFO:teuthology.orchestra.run.smithi114.stdout:=========================================================================================================================== 2023-10-18T13:52:28.731 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2023-10-18T13:52:28.731 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-18T13:52:28.732 INFO:teuthology.orchestra.run.smithi114.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-18T13:52:28.732 INFO:teuthology.orchestra.run.smithi114.stdout: ceph x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 6.4 k 2023-10-18T13:52:28.732 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 5.4 M 2023-10-18T13:52:28.732 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 919 k 2023-10-18T13:52:28.732 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 167 k 2023-10-18T13:52:28.733 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 1.6 M 2023-10-18T13:52:28.733 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 132 k 2023-10-18T13:52:28.733 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 1.8 M 2023-10-18T13:52:28.733 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 7.4 M 2023-10-18T13:52:28.733 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 47 k 2023-10-18T13:52:28.734 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 14 M 2023-10-18T13:52:28.734 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 49 M 2023-10-18T13:52:28.734 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 261 k 2023-10-18T13:52:28.734 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 192 k 2023-10-18T13:52:28.735 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 261 k 2023-10-18T13:52:28.735 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 18 k 2023-10-18T13:52:28.735 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-18T13:52:28.735 INFO:teuthology.orchestra.run.smithi114.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-18T13:52:28.735 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-18T13:52:28.736 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 31 k 2023-10-18T13:52:28.736 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 840 k 2023-10-18T13:52:28.736 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 139 k 2023-10-18T13:52:28.736 INFO:teuthology.orchestra.run.smithi114.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-18T13:52:28.737 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-18T13:52:28.737 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-18T13:52:28.737 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-18T13:52:28.737 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-18T13:52:28.738 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-18T13:52:28.738 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 196 k 2023-10-18T13:52:28.738 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 370 k 2023-10-18T13:52:28.738 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 364 k 2023-10-18T13:52:28.739 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 107 k 2023-10-18T13:52:28.739 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 94 k 2023-10-18T13:52:28.739 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.6 M 2023-10-18T13:52:28.739 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 178 k 2023-10-18T13:52:28.739 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-18T13:52:28.740 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrading: 2023-10-18T13:52:28.740 INFO:teuthology.orchestra.run.smithi114.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-18T13:52:28.740 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.7 M 2023-10-18T13:52:28.740 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.7 M 2023-10-18T13:52:28.740 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2023-10-18T13:52:28.741 INFO:teuthology.orchestra.run.smithi114.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-18T13:52:28.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 23 M 2023-10-18T13:52:28.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 23 k 2023-10-18T13:52:28.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 2.3 M 2023-10-18T13:52:28.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 242 k 2023-10-18T13:52:28.742 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 4.6 M 2023-10-18T13:52:28.742 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 18 M 2023-10-18T13:52:28.742 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 15 k 2023-10-18T13:52:28.742 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 24 k 2023-10-18T13:52:28.742 INFO:teuthology.orchestra.run.smithi114.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-18T13:52:28.743 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-18T13:52:28.743 INFO:teuthology.orchestra.run.smithi114.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-18T13:52:28.743 INFO:teuthology.orchestra.run.smithi114.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-18T13:52:28.743 INFO:teuthology.orchestra.run.smithi114.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-18T13:52:28.743 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 185 k 2023-10-18T13:52:28.744 INFO:teuthology.orchestra.run.smithi114.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-18T13:52:28.744 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-18T13:52:28.746 INFO:teuthology.orchestra.run.smithi114.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-18T13:52:28.746 INFO:teuthology.orchestra.run.smithi114.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-18T13:52:28.746 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-18T13:52:28.747 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-18T13:52:28.747 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 518 k 2023-10-18T13:52:28.747 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-18T13:52:28.747 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 6.9 M 2023-10-18T13:52:28.749 INFO:teuthology.orchestra.run.smithi114.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-18T13:52:28.749 INFO:teuthology.orchestra.run.smithi114.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-18T13:52:28.749 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-18T13:52:28.750 INFO:teuthology.orchestra.run.smithi114.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-18T13:52:28.750 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-18T13:52:28.750 INFO:teuthology.orchestra.run.smithi114.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-18T13:52:28.750 INFO:teuthology.orchestra.run.smithi114.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-18T13:52:28.750 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-18T13:52:28.751 INFO:teuthology.orchestra.run.smithi114.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-18T13:52:28.751 INFO:teuthology.orchestra.run.smithi114.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-18T13:52:28.751 INFO:teuthology.orchestra.run.smithi114.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-18T13:52:28.751 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-18T13:52:28.752 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-18T13:52:28.752 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-18T13:52:28.752 INFO:teuthology.orchestra.run.smithi114.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-18T13:52:28.753 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-18T13:52:28.753 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 45 k 2023-10-18T13:52:28.754 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 125 k 2023-10-18T13:52:28.754 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-18T13:52:28.754 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-18T13:52:28.754 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-18T13:52:28.755 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-18T13:52:28.755 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-18T13:52:28.755 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-18T13:52:28.755 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-18T13:52:28.755 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-18T13:52:28.756 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-18T13:52:28.756 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-18T13:52:28.756 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-18T13:52:28.756 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-18T13:52:28.756 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-18T13:52:28.757 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-18T13:52:28.757 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-18T13:52:28.757 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-18T13:52:28.757 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-18T13:52:28.757 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-18T13:52:28.758 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-18T13:52:28.758 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-18T13:52:28.758 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-18T13:52:28.758 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-18T13:52:28.758 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-18T13:52:28.759 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-18T13:52:28.759 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-18T13:52:28.759 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-18T13:52:28.759 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-18T13:52:28.759 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-18T13:52:28.760 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-18T13:52:28.760 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-18T13:52:28.760 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-18T13:52:28.760 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-18T13:52:28.761 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-18T13:52:28.761 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-18T13:52:28.761 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-18T13:52:28.761 INFO:teuthology.orchestra.run.smithi114.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-18T13:52:28.762 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-18T13:52:28.762 INFO:teuthology.orchestra.run.smithi114.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-18T13:52:28.762 INFO:teuthology.orchestra.run.smithi114.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-18T13:52:28.762 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-18T13:52:28.763 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-18T13:52:28.763 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-18T13:52:28.763 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-18T13:52:28.763 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-18T13:52:28.763 INFO:teuthology.orchestra.run.smithi114.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-18T13:52:28.764 INFO:teuthology.orchestra.run.smithi114.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-18T13:52:28.764 INFO:teuthology.orchestra.run.smithi114.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-18T13:52:28.764 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-18T13:52:28.765 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-18T13:52:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:Enabling module streams: 2023-10-18T13:52:28.765 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql 10 2023-10-18T13:52:28.765 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:52:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2023-10-18T13:52:28.766 INFO:teuthology.orchestra.run.smithi114.stdout:=========================================================================================================================== 2023-10-18T13:52:28.766 INFO:teuthology.orchestra.run.smithi114.stdout:Install 128 Packages 2023-10-18T13:52:28.766 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrade 3 Packages 2023-10-18T13:52:28.766 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:52:28.768 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 209 M 2023-10-18T13:52:28.768 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2023-10-18T13:52:28.769 INFO:teuthology.orchestra.run.smithi158.stdout:=========================================================================================================================== 2023-10-18T13:52:28.769 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-18T13:52:28.769 INFO:teuthology.orchestra.run.smithi158.stdout:=========================================================================================================================== 2023-10-18T13:52:28.770 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-18T13:52:28.770 INFO:teuthology.orchestra.run.smithi158.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-18T13:52:28.770 INFO:teuthology.orchestra.run.smithi158.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-18T13:52:28.770 INFO:teuthology.orchestra.run.smithi158.stdout: ceph x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 6.4 k 2023-10-18T13:52:28.771 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 5.4 M 2023-10-18T13:52:28.771 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 919 k 2023-10-18T13:52:28.771 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 167 k 2023-10-18T13:52:28.772 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 1.6 M 2023-10-18T13:52:28.772 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 132 k 2023-10-18T13:52:28.772 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 1.8 M 2023-10-18T13:52:28.772 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 7.4 M 2023-10-18T13:52:28.773 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 47 k 2023-10-18T13:52:28.773 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 14 M 2023-10-18T13:52:28.773 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 49 M 2023-10-18T13:52:28.773 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-volume noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 261 k 2023-10-18T13:52:28.773 INFO:teuthology.orchestra.run.smithi158.stdout: cephadm noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 192 k 2023-10-18T13:52:28.774 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-mirror x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 261 k 2023-10-18T13:52:28.774 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-top noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 18 k 2023-10-18T13:52:28.774 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-18T13:52:28.774 INFO:teuthology.orchestra.run.smithi158.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-18T13:52:28.774 INFO:teuthology.orchestra.run.smithi158.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-18T13:52:28.775 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 31 k 2023-10-18T13:52:28.775 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 840 k 2023-10-18T13:52:28.775 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 139 k 2023-10-18T13:52:28.775 INFO:teuthology.orchestra.run.smithi158.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-18T13:52:28.775 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-18T13:52:28.776 INFO:teuthology.orchestra.run.smithi158.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-18T13:52:28.776 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-18T13:52:28.776 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-18T13:52:28.776 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-18T13:52:28.776 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 196 k 2023-10-18T13:52:28.777 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 370 k 2023-10-18T13:52:28.777 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 364 k 2023-10-18T13:52:28.777 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 107 k 2023-10-18T13:52:28.777 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 94 k 2023-10-18T13:52:28.777 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.6 M 2023-10-18T13:52:28.778 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 178 k 2023-10-18T13:52:28.778 INFO:teuthology.orchestra.run.smithi158.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-18T13:52:28.778 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrading: 2023-10-18T13:52:28.778 INFO:teuthology.orchestra.run.smithi158.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-18T13:52:28.778 INFO:teuthology.orchestra.run.smithi158.stdout: librados2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.7 M 2023-10-18T13:52:28.779 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.7 M 2023-10-18T13:52:28.779 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-10-18T13:52:28.779 INFO:teuthology.orchestra.run.smithi158.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-18T13:52:28.779 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 23 M 2023-10-18T13:52:28.779 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 23 k 2023-10-18T13:52:28.780 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 2.3 M 2023-10-18T13:52:28.780 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 242 k 2023-10-18T13:52:28.780 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 4.6 M 2023-10-18T13:52:28.780 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 18 M 2023-10-18T13:52:28.781 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 15 k 2023-10-18T13:52:28.781 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 24 k 2023-10-18T13:52:28.781 INFO:teuthology.orchestra.run.smithi158.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-18T13:52:28.781 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-18T13:52:28.781 INFO:teuthology.orchestra.run.smithi158.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-18T13:52:28.782 INFO:teuthology.orchestra.run.smithi158.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-18T13:52:28.782 INFO:teuthology.orchestra.run.smithi158.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-18T13:52:28.782 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 185 k 2023-10-18T13:52:28.782 INFO:teuthology.orchestra.run.smithi158.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-18T13:52:28.782 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-18T13:52:28.783 INFO:teuthology.orchestra.run.smithi158.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-18T13:52:28.783 INFO:teuthology.orchestra.run.smithi158.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-18T13:52:28.783 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-18T13:52:28.783 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-18T13:52:28.783 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 518 k 2023-10-18T13:52:28.784 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-18T13:52:28.784 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 6.9 M 2023-10-18T13:52:28.784 INFO:teuthology.orchestra.run.smithi158.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-18T13:52:28.784 INFO:teuthology.orchestra.run.smithi158.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-18T13:52:28.784 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-18T13:52:28.785 INFO:teuthology.orchestra.run.smithi158.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-18T13:52:28.785 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-18T13:52:28.785 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-18T13:52:28.785 INFO:teuthology.orchestra.run.smithi158.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-18T13:52:28.785 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-18T13:52:28.785 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-18T13:52:28.786 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-18T13:52:28.786 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-18T13:52:28.786 INFO:teuthology.orchestra.run.smithi158.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-18T13:52:28.786 INFO:teuthology.orchestra.run.smithi158.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-18T13:52:28.786 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-18T13:52:28.787 INFO:teuthology.orchestra.run.smithi158.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-18T13:52:28.787 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-18T13:52:28.787 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 45 k 2023-10-18T13:52:28.787 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 125 k 2023-10-18T13:52:28.787 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-18T13:52:28.788 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-18T13:52:28.788 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-18T13:52:28.788 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-18T13:52:28.788 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-18T13:52:28.789 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-18T13:52:28.789 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-18T13:52:28.789 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-18T13:52:28.789 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-18T13:52:28.789 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-18T13:52:28.789 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-18T13:52:28.790 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-18T13:52:28.790 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-18T13:52:28.790 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-18T13:52:28.790 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-18T13:52:28.790 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-18T13:52:28.791 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-18T13:52:28.791 INFO:teuthology.orchestra.run.smithi158.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-18T13:52:28.791 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-18T13:52:28.791 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-18T13:52:28.791 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-18T13:52:28.792 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-18T13:52:28.792 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-18T13:52:28.792 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-18T13:52:28.792 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-18T13:52:28.792 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-18T13:52:28.793 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-18T13:52:28.793 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-18T13:52:28.793 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-18T13:52:28.794 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-18T13:52:28.794 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-18T13:52:28.794 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-18T13:52:28.794 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-18T13:52:28.794 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-18T13:52:28.795 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-18T13:52:28.795 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-18T13:52:28.795 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-18T13:52:28.795 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-18T13:52:28.796 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-18T13:52:28.796 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-18T13:52:28.796 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-18T13:52:28.796 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-18T13:52:28.797 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-18T13:52:28.797 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-18T13:52:28.797 INFO:teuthology.orchestra.run.smithi158.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-18T13:52:28.797 INFO:teuthology.orchestra.run.smithi158.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-18T13:52:28.797 INFO:teuthology.orchestra.run.smithi158.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-18T13:52:28.798 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-18T13:52:28.798 INFO:teuthology.orchestra.run.smithi158.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-18T13:52:28.798 INFO:teuthology.orchestra.run.smithi158.stdout:Enabling module streams: 2023-10-18T13:52:28.798 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql 10 2023-10-18T13:52:28.799 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T13:52:28.799 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-18T13:52:28.799 INFO:teuthology.orchestra.run.smithi158.stdout:=========================================================================================================================== 2023-10-18T13:52:28.799 INFO:teuthology.orchestra.run.smithi158.stdout:Install 128 Packages 2023-10-18T13:52:28.799 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrade 3 Packages 2023-10-18T13:52:28.800 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T13:52:28.800 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 209 M 2023-10-18T13:52:28.800 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-18T13:52:29.036 INFO:teuthology.orchestra.run.smithi172.stdout:(4/131): ceph-mds-18.0.0-6786.gf7420d7f.el8.x86 7.1 MB/s | 2.3 MB 00:00 2023-10-18T13:52:29.055 INFO:teuthology.orchestra.run.smithi114.stdout:(1/131): ceph-18.0.0-6786.gf7420d7f.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2023-10-18T13:52:29.264 INFO:teuthology.orchestra.run.smithi158.stdout:(1/131): ceph-18.0.0-6786.gf7420d7f.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2023-10-18T13:52:29.287 INFO:teuthology.orchestra.run.smithi172.stdout:(5/131): ceph-mgr-18.0.0-6786.gf7420d7f.el8.x86 6.5 MB/s | 1.6 MB 00:00 2023-10-18T13:52:29.928 INFO:teuthology.orchestra.run.smithi172.stdout:(6/131): ceph-mon-18.0.0-6786.gf7420d7f.el8.x86 7.2 MB/s | 4.6 MB 00:00 2023-10-18T13:52:29.982 INFO:teuthology.orchestra.run.smithi114.stdout:(2/131): ceph-fuse-18.0.0-6786.gf7420d7f.el8.x8 994 kB/s | 919 kB 00:00 2023-10-18T13:52:30.012 INFO:teuthology.orchestra.run.smithi172.stdout:(7/131): ceph-base-18.0.0-6786.gf7420d7f.el8.x8 3.1 MB/s | 5.4 MB 00:01 2023-10-18T13:52:30.048 INFO:teuthology.orchestra.run.smithi114.stdout:(3/131): ceph-immutable-object-cache-18.0.0-678 2.5 MB/s | 167 kB 00:00 2023-10-18T13:52:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:(8/131): ceph-common-18.0.0-6786.gf7420d7f.el8. 11 MB/s | 23 MB 00:02 2023-10-18T13:52:30.421 INFO:teuthology.orchestra.run.smithi172.stdout:(9/131): ceph-selinux-18.0.0-6786.gf7420d7f.el8 286 kB/s | 24 kB 00:00 2023-10-18T13:52:30.690 INFO:teuthology.orchestra.run.smithi158.stdout:(2/131): ceph-fuse-18.0.0-6786.gf7420d7f.el8.x8 645 kB/s | 919 kB 00:01 2023-10-18T13:52:30.690 INFO:teuthology.orchestra.run.smithi114.stdout:(4/131): ceph-base-18.0.0-6786.gf7420d7f.el8.x8 2.8 MB/s | 5.4 MB 00:01 2023-10-18T13:52:30.965 INFO:teuthology.orchestra.run.smithi158.stdout:(3/131): ceph-immutable-object-cache-18.0.0-678 608 kB/s | 167 kB 00:00 2023-10-18T13:52:31.140 INFO:teuthology.orchestra.run.smithi114.stdout:(5/131): ceph-mds-18.0.0-6786.gf7420d7f.el8.x86 2.1 MB/s | 2.3 MB 00:01 2023-10-18T13:52:31.182 INFO:teuthology.orchestra.run.smithi114.stdout:(6/131): ceph-mgr-18.0.0-6786.gf7420d7f.el8.x86 3.3 MB/s | 1.6 MB 00:00 2023-10-18T13:52:31.390 INFO:teuthology.orchestra.run.smithi158.stdout:(4/131): ceph-base-18.0.0-6786.gf7420d7f.el8.x8 2.2 MB/s | 5.4 MB 00:02 2023-10-18T13:52:31.832 INFO:teuthology.orchestra.run.smithi158.stdout:(5/131): ceph-mgr-18.0.0-6786.gf7420d7f.el8.x86 3.7 MB/s | 1.6 MB 00:00 2023-10-18T13:52:32.607 INFO:teuthology.orchestra.run.smithi158.stdout:(6/131): ceph-mon-18.0.0-6786.gf7420d7f.el8.x86 6.0 MB/s | 4.6 MB 00:00 2023-10-18T13:52:32.979 INFO:teuthology.orchestra.run.smithi172.stdout:(10/131): ceph-radosgw-18.0.0-6786.gf7420d7f.el 4.7 MB/s | 14 MB 00:02 2023-10-18T13:52:33.146 INFO:teuthology.orchestra.run.smithi172.stdout:(11/131): ceph-osd-18.0.0-6786.gf7420d7f.el8.x8 5.6 MB/s | 18 MB 00:03 2023-10-18T13:52:33.171 INFO:teuthology.orchestra.run.smithi172.stdout:(12/131): cephfs-mirror-18.0.0-6786.gf7420d7f.e 1.3 MB/s | 261 kB 00:00 2023-10-18T13:52:33.182 INFO:teuthology.orchestra.run.smithi114.stdout:(7/131): ceph-mon-18.0.0-6786.gf7420d7f.el8.x86 2.3 MB/s | 4.6 MB 00:02 2023-10-18T13:52:33.213 INFO:teuthology.orchestra.run.smithi172.stdout:(13/131): libcephfs-devel-18.0.0-6786.gf7420d7f 466 kB/s | 31 kB 00:00 2023-10-18T13:52:33.380 INFO:teuthology.orchestra.run.smithi172.stdout:(14/131): libcephsqlite-18.0.0-6786.gf7420d7f.e 1.1 MB/s | 185 kB 00:00 2023-10-18T13:52:33.439 INFO:teuthology.orchestra.run.smithi172.stdout:(15/131): libcephfs2-18.0.0-6786.gf7420d7f.el8. 3.1 MB/s | 840 kB 00:00 2023-10-18T13:52:33.456 INFO:teuthology.orchestra.run.smithi172.stdout:(16/131): librados-devel-18.0.0-6786.gf7420d7f. 1.8 MB/s | 139 kB 00:00 2023-10-18T13:52:33.631 INFO:teuthology.orchestra.run.smithi172.stdout:(17/131): libradosstriper1-18.0.0-6786.gf7420d7 2.6 MB/s | 518 kB 00:00 2023-10-18T13:52:33.740 INFO:teuthology.orchestra.run.smithi172.stdout:(18/131): python3-ceph-argparse-18.0.0-6786.gf7 413 kB/s | 45 kB 00:00 2023-10-18T13:52:33.807 INFO:teuthology.orchestra.run.smithi158.stdout:(7/131): ceph-mds-18.0.0-6786.gf7420d7f.el8.x86 834 kB/s | 2.3 MB 00:02 2023-10-18T13:52:33.849 INFO:teuthology.orchestra.run.smithi172.stdout:(19/131): python3-ceph-common-18.0.0-6786.gf742 1.1 MB/s | 125 kB 00:00 2023-10-18T13:52:33.965 INFO:teuthology.orchestra.run.smithi172.stdout:(20/131): python3-cephfs-18.0.0-6786.gf7420d7f. 1.6 MB/s | 196 kB 00:00 2023-10-18T13:52:34.099 INFO:teuthology.orchestra.run.smithi172.stdout:(21/131): python3-rados-18.0.0-6786.gf7420d7f.e 2.7 MB/s | 370 kB 00:00 2023-10-18T13:52:34.225 INFO:teuthology.orchestra.run.smithi172.stdout:(22/131): python3-rbd-18.0.0-6786.gf7420d7f.el8 2.8 MB/s | 364 kB 00:00 2023-10-18T13:52:34.325 INFO:teuthology.orchestra.run.smithi172.stdout:(23/131): python3-rgw-18.0.0-6786.gf7420d7f.el8 1.0 MB/s | 107 kB 00:00 2023-10-18T13:52:34.433 INFO:teuthology.orchestra.run.smithi172.stdout:(24/131): rbd-fuse-18.0.0-6786.gf7420d7f.el8.x8 872 kB/s | 94 kB 00:00 2023-10-18T13:52:34.942 INFO:teuthology.orchestra.run.smithi172.stdout:(25/131): librgw2-18.0.0-6786.gf7420d7f.el8.x86 4.7 MB/s | 6.9 MB 00:01 2023-10-18T13:52:34.966 INFO:teuthology.orchestra.run.smithi158.stdout:(8/131): ceph-osd-18.0.0-6786.gf7420d7f.el8.x86 7.6 MB/s | 18 MB 00:02 2023-10-18T13:52:35.009 INFO:teuthology.orchestra.run.smithi172.stdout:(26/131): rbd-nbd-18.0.0-6786.gf7420d7f.el8.x86 2.6 MB/s | 178 kB 00:00 2023-10-18T13:52:35.033 INFO:teuthology.orchestra.run.smithi158.stdout:(9/131): ceph-selinux-18.0.0-6786.gf7420d7f.el8 367 kB/s | 24 kB 00:00 2023-10-18T13:52:35.076 INFO:teuthology.orchestra.run.smithi172.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6786.g 346 kB/s | 23 kB 00:00 2023-10-18T13:52:35.176 INFO:teuthology.orchestra.run.smithi172.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6786.gf7420d7 1.3 MB/s | 132 kB 00:00 2023-10-18T13:52:35.268 INFO:teuthology.orchestra.run.smithi172.stdout:(29/131): rbd-mirror-18.0.0-6786.gf7420d7f.el8. 4.3 MB/s | 3.6 MB 00:00 2023-10-18T13:52:35.593 INFO:teuthology.orchestra.run.smithi172.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6786.gf7420 4.2 MB/s | 1.8 MB 00:00 2023-10-18T13:52:35.685 INFO:teuthology.orchestra.run.smithi172.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6786.gf7 2.6 MB/s | 242 kB 00:00 2023-10-18T13:52:35.769 INFO:teuthology.orchestra.run.smithi172.stdout:(32/131): ceph-mgr-rook-18.0.0-6786.gf7420d7f.e 570 kB/s | 47 kB 00:00 2023-10-18T13:52:35.886 INFO:teuthology.orchestra.run.smithi172.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6786.gf 128 kB/s | 15 kB 00:00 2023-10-18T13:52:35.978 INFO:teuthology.orchestra.run.smithi172.stdout:(34/131): ceph-volume-18.0.0-6786.gf7420d7f.el8 2.8 MB/s | 261 kB 00:00 2023-10-18T13:52:36.062 INFO:teuthology.orchestra.run.smithi172.stdout:(35/131): cephadm-18.0.0-6786.gf7420d7f.el8.noa 2.3 MB/s | 192 kB 00:00 2023-10-18T13:52:36.137 INFO:teuthology.orchestra.run.smithi172.stdout:(36/131): cephfs-top-18.0.0-6786.gf7420d7f.el8. 242 kB/s | 18 kB 00:00 2023-10-18T13:52:36.437 INFO:teuthology.orchestra.run.smithi172.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2023-10-18T13:52:36.496 INFO:teuthology.orchestra.run.smithi172.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-10-18T13:52:36.563 INFO:teuthology.orchestra.run.smithi172.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2023-10-18T13:52:36.696 INFO:teuthology.orchestra.run.smithi172.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.5 MB/s | 476 kB 00:00 2023-10-18T13:52:36.763 INFO:teuthology.orchestra.run.smithi172.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 653 kB/s | 44 kB 00:00 2023-10-18T13:52:36.839 INFO:teuthology.orchestra.run.smithi172.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2023-10-18T13:52:36.887 INFO:teuthology.orchestra.run.smithi114.stdout:(8/131): ceph-osd-18.0.0-6786.gf7420d7f.el8.x86 3.1 MB/s | 18 MB 00:05 2023-10-18T13:52:36.914 INFO:teuthology.orchestra.run.smithi172.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 441 kB/s | 33 kB 00:00 2023-10-18T13:52:36.965 INFO:teuthology.orchestra.run.smithi114.stdout:(9/131): ceph-selinux-18.0.0-6786.gf7420d7f.el8 313 kB/s | 24 kB 00:00 2023-10-18T13:52:36.981 INFO:teuthology.orchestra.run.smithi172.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 245 kB/s | 16 kB 00:00 2023-10-18T13:52:37.059 INFO:teuthology.orchestra.run.smithi172.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-10-18T13:52:37.134 INFO:teuthology.orchestra.run.smithi172.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 5.0 MB/s | 384 kB 00:00 2023-10-18T13:52:37.201 INFO:teuthology.orchestra.run.smithi172.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-10-18T13:52:37.309 INFO:teuthology.orchestra.run.smithi172.stdout:(48/131): ceph-mgr-diskprediction-local-18.0.0- 3.6 MB/s | 7.4 MB 00:02 2023-10-18T13:52:37.334 INFO:teuthology.orchestra.run.smithi172.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 83 kB/s | 11 kB 00:00 2023-10-18T13:52:37.376 INFO:teuthology.orchestra.run.smithi172.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 263 kB/s | 18 kB 00:00 2023-10-18T13:52:37.477 INFO:teuthology.orchestra.run.smithi172.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 487 kB/s | 49 kB 00:00 2023-10-18T13:52:37.544 INFO:teuthology.orchestra.run.smithi172.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 881 kB/s | 59 kB 00:00 2023-10-18T13:52:37.619 INFO:teuthology.orchestra.run.smithi172.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 807 kB/s | 60 kB 00:00 2023-10-18T13:52:37.694 INFO:teuthology.orchestra.run.smithi172.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-10-18T13:52:37.762 INFO:teuthology.orchestra.run.smithi172.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2023-10-18T13:52:37.795 INFO:teuthology.orchestra.run.smithi172.stdout:(56/131): python3-kubernetes-11.0.0-6.el8.noarc 2.5 MB/s | 1.2 MB 00:00 2023-10-18T13:52:37.829 INFO:teuthology.orchestra.run.smithi172.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 503 kB/s | 34 kB 00:00 2023-10-18T13:52:37.871 INFO:teuthology.orchestra.run.smithi172.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.6 MB/s | 196 kB 00:00 2023-10-18T13:52:37.896 INFO:teuthology.orchestra.run.smithi172.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 961 kB/s | 64 kB 00:00 2023-10-18T13:52:37.946 INFO:teuthology.orchestra.run.smithi172.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2023-10-18T13:52:37.963 INFO:teuthology.orchestra.run.smithi172.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 358 kB/s | 24 kB 00:00 2023-10-18T13:52:38.039 INFO:teuthology.orchestra.run.smithi172.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 318 kB/s | 29 kB 00:00 2023-10-18T13:52:38.056 INFO:teuthology.orchestra.run.smithi172.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 299 kB/s | 27 kB 00:00 2023-10-18T13:52:38.114 INFO:teuthology.orchestra.run.smithi172.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2023-10-18T13:52:38.139 INFO:teuthology.orchestra.run.smithi172.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-10-18T13:52:38.173 INFO:teuthology.orchestra.run.smithi172.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-10-18T13:52:38.198 INFO:teuthology.orchestra.run.smithi172.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-10-18T13:52:38.232 INFO:teuthology.orchestra.run.smithi172.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 393 kB/s | 23 kB 00:00 2023-10-18T13:52:38.249 INFO:teuthology.orchestra.run.smithi172.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2023-10-18T13:52:38.299 INFO:teuthology.orchestra.run.smithi172.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 942 kB/s | 47 kB 00:00 2023-10-18T13:52:38.341 INFO:teuthology.orchestra.run.smithi172.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2023-10-18T13:52:38.358 INFO:teuthology.orchestra.run.smithi172.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2023-10-18T13:52:38.401 INFO:teuthology.orchestra.run.smithi172.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 725 kB/s | 43 kB 00:00 2023-10-18T13:52:38.434 INFO:teuthology.orchestra.run.smithi172.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.1 MB/s | 220 kB 00:00 2023-10-18T13:52:38.459 INFO:teuthology.orchestra.run.smithi172.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 824 kB/s | 48 kB 00:00 2023-10-18T13:52:38.485 INFO:teuthology.orchestra.run.smithi172.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-18T13:52:38.510 INFO:teuthology.orchestra.run.smithi172.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 848 kB/s | 43 kB 00:00 2023-10-18T13:52:38.532 INFO:teuthology.orchestra.run.smithi114.stdout:(10/131): ceph-radosgw-18.0.0-6786.gf7420d7f.el 2.6 MB/s | 14 MB 00:05 2023-10-18T13:52:38.535 INFO:teuthology.orchestra.run.smithi172.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-10-18T13:52:38.552 INFO:teuthology.orchestra.run.smithi172.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.3 MB/s | 229 kB 00:00 2023-10-18T13:52:38.615 INFO:teuthology.orchestra.run.smithi172.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 6.9 MB/s | 560 kB 00:00 2023-10-18T13:52:38.645 INFO:teuthology.orchestra.run.smithi172.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 203 kB/s | 19 kB 00:00 2023-10-18T13:52:38.666 INFO:teuthology.orchestra.run.smithi114.stdout:(11/131): cephfs-mirror-18.0.0-6786.gf7420d7f.e 1.9 MB/s | 261 kB 00:00 2023-10-18T13:52:38.670 INFO:teuthology.orchestra.run.smithi172.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 2.8 MB/s | 155 kB 00:00 2023-10-18T13:52:38.703 INFO:teuthology.orchestra.run.smithi172.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.4 MB/s | 559 kB 00:00 2023-10-18T13:52:38.729 INFO:teuthology.orchestra.run.smithi172.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 305 kB/s | 18 kB 00:00 2023-10-18T13:52:38.741 INFO:teuthology.orchestra.run.smithi114.stdout:(12/131): libcephfs-devel-18.0.0-6786.gf7420d7f 414 kB/s | 31 kB 00:00 2023-10-18T13:52:38.762 INFO:teuthology.orchestra.run.smithi172.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-10-18T13:52:38.787 INFO:teuthology.orchestra.run.smithi172.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-10-18T13:52:38.830 INFO:teuthology.orchestra.run.smithi172.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-10-18T13:52:38.880 INFO:teuthology.orchestra.run.smithi172.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 20 MB/s | 2.3 MB 00:00 2023-10-18T13:52:38.905 INFO:teuthology.orchestra.run.smithi172.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-10-18T13:52:38.930 INFO:teuthology.orchestra.run.smithi172.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-18T13:52:38.956 INFO:teuthology.orchestra.run.smithi172.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-10-18T13:52:38.981 INFO:teuthology.orchestra.run.smithi172.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-18T13:52:39.006 INFO:teuthology.orchestra.run.smithi172.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 770 kB/s | 39 kB 00:00 2023-10-18T13:52:39.048 INFO:teuthology.orchestra.run.smithi172.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-10-18T13:52:39.066 INFO:teuthology.orchestra.run.smithi114.stdout:(13/131): libcephfs2-18.0.0-6786.gf7420d7f.el8. 2.5 MB/s | 840 kB 00:00 2023-10-18T13:52:39.073 INFO:teuthology.orchestra.run.smithi172.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-10-18T13:52:39.099 INFO:teuthology.orchestra.run.smithi172.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-10-18T13:52:39.141 INFO:teuthology.orchestra.run.smithi172.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-10-18T13:52:39.183 INFO:teuthology.orchestra.run.smithi172.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-10-18T13:52:39.209 INFO:teuthology.orchestra.run.smithi114.stdout:(14/131): libcephsqlite-18.0.0-6786.gf7420d7f.e 1.3 MB/s | 185 kB 00:00 2023-10-18T13:52:39.225 INFO:teuthology.orchestra.run.smithi172.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-10-18T13:52:39.275 INFO:teuthology.orchestra.run.smithi172.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-10-18T13:52:39.292 INFO:teuthology.orchestra.run.smithi114.stdout:(15/131): librados-devel-18.0.0-6786.gf7420d7f. 1.6 MB/s | 139 kB 00:00 2023-10-18T13:52:39.301 INFO:teuthology.orchestra.run.smithi172.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.5 MB/s | 39 kB 00:00 2023-10-18T13:52:39.351 INFO:teuthology.orchestra.run.smithi172.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 14 MB/s | 688 kB 00:00 2023-10-18T13:52:39.393 INFO:teuthology.orchestra.run.smithi172.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 13 MB/s | 538 kB 00:00 2023-10-18T13:52:39.417 INFO:teuthology.orchestra.run.smithi114.stdout:(16/131): libradosstriper1-18.0.0-6786.gf7420d7 4.0 MB/s | 518 kB 00:00 2023-10-18T13:52:39.435 INFO:teuthology.orchestra.run.smithi172.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-10-18T13:52:39.477 INFO:teuthology.orchestra.run.smithi172.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-10-18T13:52:39.627 INFO:teuthology.orchestra.run.smithi172.stdout:(106/131): python3-scipy-1.0.0-21.module+el8.5. 25 MB/s | 14 MB 00:00 2023-10-18T13:52:39.669 INFO:teuthology.orchestra.run.smithi172.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 3.6 MB/s | 713 kB 00:00 2023-10-18T13:52:39.699 INFO:teuthology.orchestra.run.smithi158.stdout:(10/131): ceph-test-18.0.0-6786.gf7420d7f.el8.x 10 MB/s | 49 MB 00:04 2023-10-18T13:52:39.703 INFO:teuthology.orchestra.run.smithi172.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 800 kB/s | 27 kB 00:00 2023-10-18T13:52:39.762 INFO:teuthology.orchestra.run.smithi172.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 5.3 MB/s | 320 kB 00:00 2023-10-18T13:52:39.766 INFO:teuthology.orchestra.run.smithi158.stdout:(11/131): cephfs-mirror-18.0.0-6786.gf7420d7f.e 3.8 MB/s | 261 kB 00:00 2023-10-18T13:52:39.795 INFO:teuthology.orchestra.run.smithi172.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-10-18T13:52:39.825 INFO:teuthology.orchestra.run.smithi158.stdout:(12/131): libcephfs-devel-18.0.0-6786.gf7420d7f 534 kB/s | 31 kB 00:00 2023-10-18T13:52:39.862 INFO:teuthology.orchestra.run.smithi172.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-10-18T13:52:39.904 INFO:teuthology.orchestra.run.smithi172.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-10-18T13:52:39.946 INFO:teuthology.orchestra.run.smithi172.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-10-18T13:52:39.975 INFO:teuthology.orchestra.run.smithi158.stdout:(13/131): libcephfs2-18.0.0-6786.gf7420d7f.el8. 5.5 MB/s | 840 kB 00:00 2023-10-18T13:52:40.005 INFO:teuthology.orchestra.run.smithi172.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 18 MB/s | 3.7 MB 00:00 2023-10-18T13:52:40.030 INFO:teuthology.orchestra.run.smithi172.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 768 kB/s | 64 kB 00:00 2023-10-18T13:52:40.042 INFO:teuthology.orchestra.run.smithi158.stdout:(14/131): libcephsqlite-18.0.0-6786.gf7420d7f.e 2.7 MB/s | 185 kB 00:00 2023-10-18T13:52:40.055 INFO:teuthology.orchestra.run.smithi172.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-10-18T13:52:40.080 INFO:teuthology.orchestra.run.smithi172.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 396 kB/s | 20 kB 00:00 2023-10-18T13:52:40.101 INFO:teuthology.orchestra.run.smithi158.stdout:(15/131): librados-devel-18.0.0-6786.gf7420d7f. 2.3 MB/s | 139 kB 00:00 2023-10-18T13:52:40.106 INFO:teuthology.orchestra.run.smithi172.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-10-18T13:52:40.193 INFO:teuthology.orchestra.run.smithi158.stdout:(16/131): libradosstriper1-18.0.0-6786.gf7420d7 5.5 MB/s | 518 kB 00:00 2023-10-18T13:52:40.234 INFO:teuthology.orchestra.run.smithi114.stdout:(17/131): ceph-common-18.0.0-6786.gf7420d7f.el8 2.0 MB/s | 23 MB 00:11 2023-10-18T13:52:40.310 INFO:teuthology.orchestra.run.smithi114.stdout:(18/131): python3-ceph-argparse-18.0.0-6786.gf7 598 kB/s | 45 kB 00:00 2023-10-18T13:52:40.443 INFO:teuthology.orchestra.run.smithi114.stdout:(19/131): python3-ceph-common-18.0.0-6786.gf742 942 kB/s | 125 kB 00:00 2023-10-18T13:52:40.556 INFO:teuthology.orchestra.run.smithi172.stdout:(119/131): ceph-test-18.0.0-6786.gf7420d7f.el8. 4.8 MB/s | 49 MB 00:10 2023-10-18T13:52:40.594 INFO:teuthology.orchestra.run.smithi114.stdout:(20/131): python3-cephfs-18.0.0-6786.gf7420d7f. 1.3 MB/s | 196 kB 00:00 2023-10-18T13:52:40.598 INFO:teuthology.orchestra.run.smithi172.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 1.3 MB/s | 709 kB 00:00 2023-10-18T13:52:40.648 INFO:teuthology.orchestra.run.smithi172.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 2.1 MB/s | 198 kB 00:00 2023-10-18T13:52:40.690 INFO:teuthology.orchestra.run.smithi172.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-10-18T13:52:40.732 INFO:teuthology.orchestra.run.smithi172.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-18T13:52:40.777 INFO:teuthology.orchestra.run.smithi114.stdout:(21/131): python3-rados-18.0.0-6786.gf7420d7f.e 2.0 MB/s | 370 kB 00:00 2023-10-18T13:52:40.799 INFO:teuthology.orchestra.run.smithi172.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 7.0 MB/s | 4.9 MB 00:00 2023-10-18T13:52:40.877 INFO:teuthology.orchestra.run.smithi114.stdout:(22/131): python3-rbd-18.0.0-6786.gf7420d7f.el8 3.6 MB/s | 364 kB 00:00 2023-10-18T13:52:40.899 INFO:teuthology.orchestra.run.smithi172.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-10-18T13:52:40.928 INFO:teuthology.orchestra.run.smithi114.stdout:(23/131): python3-rgw-18.0.0-6786.gf7420d7f.el8 2.1 MB/s | 107 kB 00:00 2023-10-18T13:52:40.941 INFO:teuthology.orchestra.run.smithi172.stdout:(126/131): postgresql-contrib-10.21-2.module+el 5.6 MB/s | 808 kB 00:00 2023-10-18T13:52:40.960 INFO:teuthology.orchestra.run.smithi158.stdout:(17/131): ceph-common-18.0.0-6786.gf7420d7f.el8 1.9 MB/s | 23 MB 00:12 2023-10-18T13:52:41.003 INFO:teuthology.orchestra.run.smithi114.stdout:(24/131): rbd-fuse-18.0.0-6786.gf7420d7f.el8.x8 1.2 MB/s | 94 kB 00:00 2023-10-18T13:52:41.044 INFO:teuthology.orchestra.run.smithi158.stdout:(18/131): librgw2-18.0.0-6786.gf7420d7f.el8.x86 8.1 MB/s | 6.9 MB 00:00 2023-10-18T13:52:41.069 INFO:teuthology.orchestra.run.smithi158.stdout:(19/131): python3-ceph-argparse-18.0.0-6786.gf7 412 kB/s | 45 kB 00:00 2023-10-18T13:52:41.092 INFO:teuthology.orchestra.run.smithi172.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 7.8 MB/s | 1.5 MB 00:00 2023-10-18T13:52:41.094 INFO:teuthology.orchestra.run.smithi158.stdout:(20/131): python3-ceph-common-18.0.0-6786.gf742 2.5 MB/s | 125 kB 00:00 2023-10-18T13:52:41.095 INFO:teuthology.orchestra.run.smithi114.stdout:(25/131): librgw2-18.0.0-6786.gf7420d7f.el8.x86 4.1 MB/s | 6.9 MB 00:01 2023-10-18T13:52:41.162 INFO:teuthology.orchestra.run.smithi114.stdout:(26/131): rbd-nbd-18.0.0-6786.gf7420d7f.el8.x86 2.6 MB/s | 178 kB 00:00 2023-10-18T13:52:41.173 INFO:teuthology.orchestra.run.smithi158.stdout:(21/131): python3-cephfs-18.0.0-6786.gf7420d7f. 1.9 MB/s | 196 kB 00:00 2023-10-18T13:52:41.203 INFO:teuthology.orchestra.run.smithi158.stdout:(22/131): python3-rados-18.0.0-6786.gf7420d7f.e 3.3 MB/s | 370 kB 00:00 2023-10-18T13:52:41.212 INFO:teuthology.orchestra.run.smithi114.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6786.g 462 kB/s | 23 kB 00:00 2023-10-18T13:52:41.243 INFO:teuthology.orchestra.run.smithi172.stdout:(128/131): postgresql-server-10.21-2.module+el8 9.9 MB/s | 5.1 MB 00:00 2023-10-18T13:52:41.253 INFO:teuthology.orchestra.run.smithi158.stdout:(23/131): python3-rbd-18.0.0-6786.gf7420d7f.el8 4.4 MB/s | 364 kB 00:00 2023-10-18T13:52:41.270 INFO:teuthology.orchestra.run.smithi158.stdout:(24/131): python3-rgw-18.0.0-6786.gf7420d7f.el8 1.6 MB/s | 107 kB 00:00 2023-10-18T13:52:41.271 INFO:teuthology.orchestra.run.smithi114.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6786.gf7420d7 2.2 MB/s | 132 kB 00:00 2023-10-18T13:52:41.293 INFO:teuthology.orchestra.run.smithi172.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-18T13:52:41.304 INFO:teuthology.orchestra.run.smithi158.stdout:(25/131): rbd-fuse-18.0.0-6786.gf7420d7f.el8.x8 1.8 MB/s | 94 kB 00:00 2023-10-18T13:52:41.413 INFO:teuthology.orchestra.run.smithi158.stdout:(26/131): rbd-nbd-18.0.0-6786.gf7420d7f.el8.x86 1.6 MB/s | 178 kB 00:00 2023-10-18T13:52:41.521 INFO:teuthology.orchestra.run.smithi158.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6786.g 213 kB/s | 23 kB 00:00 2023-10-18T13:52:41.622 INFO:teuthology.orchestra.run.smithi158.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6786.gf7420d7 1.3 MB/s | 132 kB 00:00 2023-10-18T13:52:41.722 INFO:teuthology.orchestra.run.smithi158.stdout:(29/131): rbd-mirror-18.0.0-6786.gf7420d7f.el8. 7.9 MB/s | 3.6 MB 00:00 2023-10-18T13:52:41.793 INFO:teuthology.orchestra.run.smithi172.stdout:(130/131): librados2-18.0.0-6786.gf7420d7f.el8. 4.4 MB/s | 3.7 MB 00:00 2023-10-18T13:52:41.921 INFO:teuthology.orchestra.run.smithi114.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6786.gf7420 2.7 MB/s | 1.8 MB 00:00 2023-10-18T13:52:41.997 INFO:teuthology.orchestra.run.smithi158.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6786.gf7420 4.7 MB/s | 1.8 MB 00:00 2023-10-18T13:52:42.089 INFO:teuthology.orchestra.run.smithi158.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6786.gf7 2.6 MB/s | 242 kB 00:00 2023-10-18T13:52:42.173 INFO:teuthology.orchestra.run.smithi158.stdout:(32/131): ceph-mgr-rook-18.0.0-6786.gf7420d7f.e 568 kB/s | 47 kB 00:00 2023-10-18T13:52:42.238 INFO:teuthology.orchestra.run.smithi114.stdout:(30/131): rbd-mirror-18.0.0-6786.gf7420d7f.el8. 2.9 MB/s | 3.6 MB 00:01 2023-10-18T13:52:42.248 INFO:teuthology.orchestra.run.smithi158.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6786.gf 201 kB/s | 15 kB 00:00 2023-10-18T13:52:42.268 INFO:teuthology.orchestra.run.smithi172.stdout:(131/131): librbd1-18.0.0-6786.gf7420d7f.el8.x8 3.2 MB/s | 3.7 MB 00:01 2023-10-18T13:52:42.270 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2023-10-18T13:52:42.271 INFO:teuthology.orchestra.run.smithi172.stdout:Total 15 MB/s | 209 MB 00:14 2023-10-18T13:52:42.364 INFO:teuthology.orchestra.run.smithi114.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6786.gf7 1.9 MB/s | 242 kB 00:00 2023-10-18T13:52:42.414 INFO:teuthology.orchestra.run.smithi114.stdout:(32/131): ceph-mgr-rook-18.0.0-6786.gf7420d7f.e 953 kB/s | 47 kB 00:00 2023-10-18T13:52:42.464 INFO:teuthology.orchestra.run.smithi114.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6786.gf 300 kB/s | 15 kB 00:00 2023-10-18T13:52:42.538 INFO:teuthology.orchestra.run.smithi158.stdout:(34/131): ceph-volume-18.0.0-6786.gf7420d7f.el8 903 kB/s | 261 kB 00:00 2023-10-18T13:52:42.539 INFO:teuthology.orchestra.run.smithi114.stdout:(34/131): ceph-volume-18.0.0-6786.gf7420d7f.el8 3.4 MB/s | 261 kB 00:00 2023-10-18T13:52:42.615 INFO:teuthology.orchestra.run.smithi114.stdout:(35/131): cephadm-18.0.0-6786.gf7420d7f.el8.noa 2.5 MB/s | 192 kB 00:00 2023-10-18T13:52:42.666 INFO:teuthology.orchestra.run.smithi114.stdout:(36/131): cephfs-top-18.0.0-6786.gf7420d7f.el8. 362 kB/s | 18 kB 00:00 2023-10-18T13:52:42.691 INFO:teuthology.orchestra.run.smithi158.stdout:(35/131): ceph-mgr-diskprediction-local-18.0.0- 7.6 MB/s | 7.4 MB 00:00 2023-10-18T13:52:42.721 INFO:teuthology.orchestra.run.smithi158.stdout:(36/131): cephadm-18.0.0-6786.gf7420d7f.el8.noa 1.1 MB/s | 192 kB 00:00 2023-10-18T13:52:42.742 INFO:teuthology.orchestra.run.smithi158.stdout:(37/131): cephfs-top-18.0.0-6786.gf7420d7f.el8. 362 kB/s | 18 kB 00:00 2023-10-18T13:52:43.104 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2023-10-18T13:52:43.124 INFO:teuthology.orchestra.run.smithi114.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 6.2 MB/s | 7.4 MB 00:01 2023-10-18T13:52:43.225 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2023-10-18T13:52:43.226 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2023-10-18T13:52:43.258 INFO:teuthology.orchestra.run.smithi158.stdout:(38/131): ceph-radosgw-18.0.0-6786.gf7420d7f.el 1.5 MB/s | 14 MB 00:09 2023-10-18T13:52:43.383 INFO:teuthology.orchestra.run.smithi114.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 427 kB/s | 306 kB 00:00 2023-10-18T13:52:43.516 INFO:teuthology.orchestra.run.smithi114.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 564 kB/s | 75 kB 00:00 2023-10-18T13:52:43.641 INFO:teuthology.orchestra.run.smithi114.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 114 kB/s | 59 kB 00:00 2023-10-18T13:52:43.741 INFO:teuthology.orchestra.run.smithi114.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-10-18T13:52:43.792 INFO:teuthology.orchestra.run.smithi114.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 290 kB/s | 44 kB 00:00 2023-10-18T13:52:43.875 INFO:teuthology.orchestra.run.smithi114.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-10-18T13:52:43.892 INFO:teuthology.orchestra.run.smithi158.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 51 kB/s | 59 kB 00:01 2023-10-18T13:52:43.934 INFO:teuthology.orchestra.run.smithi114.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 232 kB/s | 33 kB 00:00 2023-10-18T13:52:43.984 INFO:teuthology.orchestra.run.smithi114.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-10-18T13:52:44.160 INFO:teuthology.orchestra.run.smithi114.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.1 MB/s | 384 kB 00:00 2023-10-18T13:52:44.202 INFO:teuthology.orchestra.run.smithi114.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 646 kB/s | 173 kB 00:00 2023-10-18T13:52:44.294 INFO:teuthology.orchestra.run.smithi114.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 609 kB/s | 81 kB 00:00 2023-10-18T13:52:44.327 INFO:teuthology.orchestra.run.smithi114.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2023-10-18T13:52:44.357 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2023-10-18T13:52:44.361 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2023-10-18T13:52:44.367 INFO:teuthology.orchestra.run.smithi158.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 185 kB/s | 306 kB 00:01 2023-10-18T13:52:44.393 INFO:teuthology.orchestra.run.smithi158.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 66 kB/s | 75 kB 00:01 2023-10-18T13:52:44.411 INFO:teuthology.orchestra.run.smithi114.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 150 kB/s | 18 kB 00:00 2023-10-18T13:52:44.536 INFO:teuthology.orchestra.run.smithi114.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 390 kB/s | 49 kB 00:00 2023-10-18T13:52:44.643 INFO:teuthology.orchestra.run.smithi158.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 158 kB/s | 44 kB 00:00 2023-10-18T13:52:44.661 INFO:teuthology.orchestra.run.smithi114.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 470 kB/s | 59 kB 00:00 2023-10-18T13:52:44.737 INFO:teuthology.orchestra.run.smithi114.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 2.8 MB/s | 1.2 MB 00:00 2023-10-18T13:52:44.743 INFO:teuthology.orchestra.run.smithi158.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 559 kB/s | 476 kB 00:00 2023-10-18T13:52:44.787 INFO:teuthology.orchestra.run.smithi114.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 480 kB/s | 60 kB 00:00 2023-10-18T13:52:44.871 INFO:teuthology.orchestra.run.smithi114.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-10-18T13:52:44.894 INFO:teuthology.orchestra.run.smithi158.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 132 kB/s | 33 kB 00:00 2023-10-18T13:52:44.904 INFO:teuthology.orchestra.run.smithi114.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-10-18T13:52:44.977 INFO:teuthology.orchestra.run.smithi158.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 70 kB/s | 16 kB 00:00 2023-10-18T13:52:44.994 INFO:teuthology.orchestra.run.smithi158.stdout:(46/131): python3-beautifulsoup4-4.6.3-2.el8.1. 308 kB/s | 185 kB 00:00 2023-10-18T13:52:45.211 INFO:teuthology.orchestra.run.smithi158.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 544 kB/s | 173 kB 00:00 2023-10-18T13:52:45.278 INFO:teuthology.orchestra.run.smithi158.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 286 kB/s | 81 kB 00:00 2023-10-18T13:52:45.430 INFO:teuthology.orchestra.run.smithi114.stdout:(57/131): ceph-test-18.0.0-6786.gf7420d7f.el8.x 5.8 MB/s | 49 MB 00:08 2023-10-18T13:52:45.445 INFO:teuthology.orchestra.run.smithi158.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 47 kB/s | 11 kB 00:00 2023-10-18T13:52:45.455 INFO:teuthology.orchestra.run.smithi114.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 58 kB/s | 34 kB 00:00 2023-10-18T13:52:45.480 INFO:teuthology.orchestra.run.smithi114.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 341 kB/s | 196 kB 00:00 2023-10-18T13:52:45.512 INFO:teuthology.orchestra.run.smithi158.stdout:(50/131): python3-cherrypy-18.4.0-1.el8.noarch. 719 kB/s | 384 kB 00:00 2023-10-18T13:52:45.537 INFO:teuthology.orchestra.run.smithi158.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 68 kB/s | 18 kB 00:00 2023-10-18T13:52:45.580 INFO:teuthology.orchestra.run.smithi114.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 149 kB/s | 19 kB 00:00 2023-10-18T13:52:45.606 INFO:teuthology.orchestra.run.smithi114.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 191 kB/s | 24 kB 00:00 2023-10-18T13:52:45.706 INFO:teuthology.orchestra.run.smithi114.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 234 kB/s | 29 kB 00:00 2023-10-18T13:52:45.754 INFO:teuthology.orchestra.run.smithi158.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 201 kB/s | 49 kB 00:00 2023-10-18T13:52:45.765 INFO:teuthology.orchestra.run.smithi114.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 173 kB/s | 27 kB 00:00 2023-10-18T13:52:45.804 INFO:teuthology.orchestra.run.smithi158.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 220 kB/s | 59 kB 00:00 2023-10-18T13:52:45.840 INFO:teuthology.orchestra.run.smithi114.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 1.9 MB/s | 255 kB 00:00 2023-10-18T13:52:45.907 INFO:teuthology.orchestra.run.smithi114.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2023-10-18T13:52:45.940 INFO:teuthology.orchestra.run.smithi114.stdout:(66/131): python3-rsa-4.9-2.el8.noarch.rpm 126 kB/s | 64 kB 00:00 2023-10-18T13:52:45.966 INFO:teuthology.orchestra.run.smithi114.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 488 kB/s | 61 kB 00:00 2023-10-18T13:52:45.996 INFO:teuthology.orchestra.run.smithi158.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 249 kB/s | 60 kB 00:00 2023-10-18T13:52:46.033 INFO:teuthology.orchestra.run.smithi114.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 680 kB/s | 85 kB 00:00 2023-10-18T13:52:46.058 INFO:teuthology.orchestra.run.smithi114.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-18T13:52:46.083 INFO:teuthology.orchestra.run.smithi114.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 161 kB/s | 23 kB 00:00 2023-10-18T13:52:46.138 INFO:teuthology.orchestra.run.smithi158.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 1.7 MB/s | 1.2 MB 00:00 2023-10-18T13:52:46.150 INFO:teuthology.orchestra.run.smithi114.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-10-18T13:52:46.192 INFO:teuthology.orchestra.run.smithi114.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 7.7 MB/s | 1.7 MB 00:00 2023-10-18T13:52:46.217 INFO:teuthology.orchestra.run.smithi114.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 810 kB/s | 54 kB 00:00 2023-10-18T13:52:46.222 INFO:teuthology.orchestra.run.smithi158.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 69 kB/s | 16 kB 00:00 2023-10-18T13:52:46.247 INFO:teuthology.orchestra.run.smithi158.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 639 kB/s | 283 kB 00:00 2023-10-18T13:52:46.293 INFO:teuthology.orchestra.run.smithi114.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2023-10-18T13:52:46.318 INFO:teuthology.orchestra.run.smithi114.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.3 MB/s | 323 kB 00:00 2023-10-18T13:52:46.344 INFO:teuthology.orchestra.run.smithi114.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 768 kB/s | 39 kB 00:00 2023-10-18T13:52:46.373 INFO:teuthology.orchestra.run.smithi158.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 144 kB/s | 34 kB 00:00 2023-10-18T13:52:46.386 INFO:teuthology.orchestra.run.smithi114.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-10-18T13:52:46.428 INFO:teuthology.orchestra.run.smithi114.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 6.3 MB/s | 538 kB 00:00 2023-10-18T13:52:46.453 INFO:teuthology.orchestra.run.smithi114.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-10-18T13:52:46.478 INFO:teuthology.orchestra.run.smithi114.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-10-18T13:52:46.498 INFO:teuthology.orchestra.run.smithi158.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 257 kB/s | 64 kB 00:00 2023-10-18T13:52:46.512 INFO:teuthology.orchestra.run.smithi114.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-18T13:52:46.545 INFO:teuthology.orchestra.run.smithi114.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 800 kB/s | 27 kB 00:00 2023-10-18T13:52:46.587 INFO:teuthology.orchestra.run.smithi114.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-18T13:52:46.606 INFO:teuthology.orchestra.run.smithi158.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 80 kB/s | 19 kB 00:00 2023-10-18T13:52:46.621 INFO:teuthology.orchestra.run.smithi114.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-10-18T13:52:46.665 INFO:teuthology.orchestra.run.smithi158.stdout:(61/131): python3-routes-2.4.1-12.el8.noarch.rp 444 kB/s | 196 kB 00:00 2023-10-18T13:52:46.705 INFO:teuthology.orchestra.run.smithi114.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-10-18T13:52:46.732 INFO:teuthology.orchestra.run.smithi158.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 102 kB/s | 24 kB 00:00 2023-10-18T13:52:46.755 INFO:teuthology.orchestra.run.smithi114.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-10-18T13:52:46.813 INFO:teuthology.orchestra.run.smithi114.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2023-10-18T13:52:46.841 INFO:teuthology.orchestra.run.smithi158.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 125 kB/s | 29 kB 00:00 2023-10-18T13:52:46.889 INFO:teuthology.orchestra.run.smithi114.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-10-18T13:52:46.899 INFO:teuthology.orchestra.run.smithi158.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 118 kB/s | 27 kB 00:00 2023-10-18T13:52:46.914 INFO:teuthology.orchestra.run.smithi114.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 638 kB/s | 64 kB 00:00 2023-10-18T13:52:47.025 INFO:teuthology.orchestra.run.smithi158.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 874 kB/s | 255 kB 00:00 2023-10-18T13:52:47.100 INFO:teuthology.orchestra.run.smithi158.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 969 kB/s | 251 kB 00:00 2023-10-18T13:52:47.134 INFO:teuthology.orchestra.run.smithi158.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 261 kB/s | 61 kB 00:00 2023-10-18T13:52:47.139 INFO:teuthology.orchestra.run.smithi114.stdout:(90/131): python3-scipy-1.0.0-21.module+el8.5.0 13 MB/s | 14 MB 00:01 2023-10-18T13:52:47.334 INFO:teuthology.orchestra.run.smithi158.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 98 kB/s | 23 kB 00:00 2023-10-18T13:52:47.351 INFO:teuthology.orchestra.run.smithi158.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2023-10-18T13:52:47.443 INFO:teuthology.orchestra.run.smithi114.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 38 kB/s | 20 kB 00:00 2023-10-18T13:52:47.476 INFO:teuthology.orchestra.run.smithi158.stdout:(70/131): python3-webtest-2.0.33-1.el8.noarch.r 189 kB/s | 85 kB 00:00 2023-10-18T13:52:47.482 INFO:teuthology.orchestra.run.smithi114.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 213 kB/s | 126 kB 00:00 2023-10-18T13:52:47.507 INFO:teuthology.orchestra.run.smithi114.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 282 kB/s | 103 kB 00:00 2023-10-18T13:52:47.557 INFO:teuthology.orchestra.run.smithi158.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-10-18T13:52:47.558 INFO:teuthology.orchestra.run.smithi114.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 6.1 MB/s | 709 kB 00:00 2023-10-18T13:52:47.582 INFO:teuthology.orchestra.run.smithi114.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2023-10-18T13:52:47.602 INFO:teuthology.orchestra.run.smithi158.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.2 MB/s | 54 kB 00:00 2023-10-18T13:52:47.624 INFO:teuthology.orchestra.run.smithi114.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-18T13:52:47.652 INFO:teuthology.orchestra.run.smithi158.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-10-18T13:52:47.666 INFO:teuthology.orchestra.run.smithi114.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-18T13:52:47.694 INFO:teuthology.orchestra.run.smithi158.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-10-18T13:52:47.750 INFO:teuthology.orchestra.run.smithi114.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 18 MB/s | 4.9 MB 00:00 2023-10-18T13:52:47.825 INFO:teuthology.orchestra.run.smithi114.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-10-18T13:52:47.844 INFO:teuthology.orchestra.run.smithi158.stdout:(75/131): python3-scipy-1.0.0-21.module+el8.5.0 28 MB/s | 14 MB 00:00 2023-10-18T13:52:47.867 INFO:teuthology.orchestra.run.smithi114.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-10-18T13:52:47.869 INFO:teuthology.orchestra.run.smithi158.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 221 kB/s | 39 kB 00:00 2023-10-18T13:52:47.942 INFO:teuthology.orchestra.run.smithi114.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 626 kB/s | 47 kB 00:00 2023-10-18T13:52:47.984 INFO:teuthology.orchestra.run.smithi114.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 9.5 MB/s | 1.5 MB 00:00 2023-10-18T13:52:47.995 INFO:teuthology.orchestra.run.smithi158.stdout:(77/131): thrift-0.13.0-2.el8.x86_64.rpm 2.0 MB/s | 1.7 MB 00:00 2023-10-18T13:52:48.010 INFO:teuthology.orchestra.run.smithi114.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-10-18T13:52:48.035 INFO:teuthology.orchestra.run.smithi114.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 845 kB/s | 43 kB 00:00 2023-10-18T13:52:48.060 INFO:teuthology.orchestra.run.smithi114.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-18T13:52:48.086 INFO:teuthology.orchestra.run.smithi114.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 955 kB/s | 48 kB 00:00 2023-10-18T13:52:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-18T13:52:48.136 INFO:teuthology.orchestra.run.smithi114.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 850 kB/s | 43 kB 00:00 2023-10-18T13:52:48.162 INFO:teuthology.orchestra.run.smithi114.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-10-18T13:52:48.187 INFO:teuthology.orchestra.run.smithi114.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-10-18T13:52:48.187 INFO:teuthology.orchestra.run.smithi158.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 2.0 MB/s | 688 kB 00:00 2023-10-18T13:52:48.221 INFO:teuthology.orchestra.run.smithi114.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-10-18T13:52:48.246 INFO:teuthology.orchestra.run.smithi114.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-10-18T13:52:48.271 INFO:teuthology.orchestra.run.smithi114.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-10-18T13:52:48.312 INFO:teuthology.orchestra.run.smithi158.stdout:(79/131): python3-jinja2-2.10.1-3.el8.noarch.rp 1.2 MB/s | 538 kB 00:00 2023-10-18T13:52:48.329 INFO:teuthology.orchestra.run.smithi158.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 470 kB/s | 157 kB 00:00 2023-10-18T13:52:48.338 INFO:teuthology.orchestra.run.smithi114.stdout:(114/131): postgresql-server-10.21-2.module+el8 7.5 MB/s | 5.1 MB 00:00 2023-10-18T13:52:48.346 INFO:teuthology.orchestra.run.smithi158.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-10-18T13:52:48.355 INFO:teuthology.orchestra.run.smithi114.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 214 kB/s | 18 kB 00:00 2023-10-18T13:52:48.388 INFO:teuthology.orchestra.run.smithi158.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 9.2 MB/s | 713 kB 00:00 2023-10-18T13:52:48.389 INFO:teuthology.orchestra.run.smithi114.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.8 MB/s | 559 kB 00:00 2023-10-18T13:52:48.414 INFO:teuthology.orchestra.run.smithi158.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 396 kB/s | 27 kB 00:00 2023-10-18T13:52:48.432 INFO:teuthology.orchestra.run.smithi114.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.0 MB/s | 238 kB 00:00 2023-10-18T13:52:48.439 INFO:teuthology.orchestra.run.smithi158.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 6.2 MB/s | 320 kB 00:00 2023-10-18T13:52:48.456 INFO:teuthology.orchestra.run.smithi158.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-10-18T13:52:48.464 INFO:teuthology.orchestra.run.smithi114.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-10-18T13:52:48.481 INFO:teuthology.orchestra.run.smithi114.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-10-18T13:52:48.506 INFO:teuthology.orchestra.run.smithi114.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-10-18T13:52:48.507 INFO:teuthology.orchestra.run.smithi158.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-10-18T13:52:48.532 INFO:teuthology.orchestra.run.smithi114.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-18T13:52:48.548 INFO:teuthology.orchestra.run.smithi158.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-18T13:52:48.557 INFO:teuthology.orchestra.run.smithi114.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-18T13:52:48.582 INFO:teuthology.orchestra.run.smithi114.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-18T13:52:48.608 INFO:teuthology.orchestra.run.smithi114.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 771 kB/s | 39 kB 00:00 2023-10-18T13:52:48.640 INFO:teuthology.orchestra.run.smithi158.stdout:(88/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-10-18T13:52:48.650 INFO:teuthology.orchestra.run.smithi114.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-10-18T13:52:48.675 INFO:teuthology.orchestra.run.smithi114.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-10-18T13:52:48.699 INFO:teuthology.orchestra.run.smithi158.stdout:(89/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-10-18T13:52:48.700 INFO:teuthology.orchestra.run.smithi114.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-18T13:52:48.716 INFO:teuthology.orchestra.run.smithi158.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 383 kB/s | 64 kB 00:00 2023-10-18T13:52:48.733 INFO:teuthology.orchestra.run.smithi158.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 594 kB/s | 20 kB 00:00 2023-10-18T13:52:48.758 INFO:teuthology.orchestra.run.smithi158.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-10-18T13:52:48.759 INFO:teuthology.orchestra.run.smithi114.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.3 MB/s | 2.3 MB 00:00 2023-10-18T13:52:48.784 INFO:teuthology.orchestra.run.smithi158.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.5 MB/s | 103 kB 00:00 2023-10-18T13:52:48.809 INFO:teuthology.orchestra.run.smithi114.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-18T13:52:48.817 INFO:teuthology.orchestra.run.smithi158.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 8.2 MB/s | 709 kB 00:00 2023-10-18T13:52:48.842 INFO:teuthology.orchestra.run.smithi158.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-10-18T13:52:48.885 INFO:teuthology.orchestra.run.smithi158.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-10-18T13:52:48.935 INFO:teuthology.orchestra.run.smithi158.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-10-18T13:52:49.010 INFO:teuthology.orchestra.run.smithi158.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 19 MB/s | 4.9 MB 00:00 2023-10-18T13:52:49.102 INFO:teuthology.orchestra.run.smithi158.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-18T13:52:49.118 INFO:teuthology.orchestra.run.smithi114.stdout:(130/131): librbd1-18.0.0-6786.gf7420d7f.el8.x8 8.9 MB/s | 3.7 MB 00:00 2023-10-18T13:52:49.144 INFO:teuthology.orchestra.run.smithi158.stdout:(100/131): postgresql-contrib-10.21-2.module+el 5.9 MB/s | 808 kB 00:00 2023-10-18T13:52:49.186 INFO:teuthology.orchestra.run.smithi158.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-10-18T13:52:49.218 INFO:teuthology.orchestra.run.smithi114.stdout:(131/131): librados2-18.0.0-6786.gf7420d7f.el8. 6.9 MB/s | 3.7 MB 00:00 2023-10-18T13:52:49.221 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2023-10-18T13:52:49.221 INFO:teuthology.orchestra.run.smithi114.stdout:Total 10 MB/s | 209 MB 00:20 2023-10-18T13:52:49.228 INFO:teuthology.orchestra.run.smithi158.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-10-18T13:52:49.254 INFO:teuthology.orchestra.run.smithi158.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-10-18T13:52:49.279 INFO:teuthology.orchestra.run.smithi158.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 846 kB/s | 43 kB 00:00 2023-10-18T13:52:49.304 INFO:teuthology.orchestra.run.smithi158.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-18T13:52:49.321 INFO:teuthology.orchestra.run.smithi158.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.1 MB/s | 48 kB 00:00 2023-10-18T13:52:49.346 INFO:teuthology.orchestra.run.smithi158.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-10-18T13:52:49.371 INFO:teuthology.orchestra.run.smithi158.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 848 kB/s | 43 kB 00:00 2023-10-18T13:52:49.397 INFO:teuthology.orchestra.run.smithi158.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-10-18T13:52:49.422 INFO:teuthology.orchestra.run.smithi158.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-10-18T13:52:49.456 INFO:teuthology.orchestra.run.smithi158.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-10-18T13:52:49.481 INFO:teuthology.orchestra.run.smithi158.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-10-18T13:52:49.498 INFO:teuthology.orchestra.run.smithi158.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-10-18T13:52:49.505 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2023-10-18T13:52:49.598 INFO:teuthology.orchestra.run.smithi158.stdout:(114/131): postgresql-server-10.21-2.module+el8 7.6 MB/s | 5.1 MB 00:00 2023-10-18T13:52:49.623 INFO:teuthology.orchestra.run.smithi158.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 143 kB/s | 18 kB 00:00 2023-10-18T13:52:49.666 INFO:teuthology.orchestra.run.smithi158.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.0 MB/s | 559 kB 00:00 2023-10-18T13:52:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-18T13:52:49.691 INFO:teuthology.orchestra.run.smithi158.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-10-18T13:52:49.716 INFO:teuthology.orchestra.run.smithi158.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-10-18T13:52:49.750 INFO:teuthology.orchestra.run.smithi158.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-10-18T13:52:49.767 INFO:teuthology.orchestra.run.smithi158.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-18T13:52:49.792 INFO:teuthology.orchestra.run.smithi158.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-10-18T13:52:49.817 INFO:teuthology.orchestra.run.smithi158.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-18T13:52:49.843 INFO:teuthology.orchestra.run.smithi158.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-18T13:52:49.868 INFO:teuthology.orchestra.run.smithi158.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 766 kB/s | 39 kB 00:00 2023-10-18T13:52:49.904 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-18T13:52:49.910 INFO:teuthology.orchestra.run.smithi158.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-10-18T13:52:49.935 INFO:teuthology.orchestra.run.smithi158.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-10-18T13:52:49.961 INFO:teuthology.orchestra.run.smithi158.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-18T13:52:50.011 INFO:teuthology.orchestra.run.smithi158.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.7 MB/s | 2.3 MB 00:00 2023-10-18T13:52:50.031 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2023-10-18T13:52:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-18T13:52:50.094 INFO:teuthology.orchestra.run.smithi158.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 9.4 MB/s | 798 kB 00:00 2023-10-18T13:52:50.150 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2023-10-18T13:52:50.151 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2023-10-18T13:52:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-18T13:52:50.295 INFO:teuthology.orchestra.run.smithi158.stdout:(130/131): librbd1-18.0.0-6786.gf7420d7f.el8.x8 11 MB/s | 3.7 MB 00:00 2023-10-18T13:52:50.440 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-18T13:52:50.829 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-18T13:52:51.081 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 5/134 2023-10-18T13:52:51.237 INFO:teuthology.orchestra.run.smithi158.stdout:(131/131): librados2-18.0.0-6786.gf7420d7f.el8. 2.9 MB/s | 3.7 MB 00:01 2023-10-18T13:52:51.241 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-18T13:52:51.242 INFO:teuthology.orchestra.run.smithi158.stdout:Total 9.3 MB/s | 209 MB 00:22 2023-10-18T13:52:51.281 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2023-10-18T13:52:51.285 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2023-10-18T13:52:51.490 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 5/134 2023-10-18T13:52:51.739 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-18T13:52:51.872 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-18T13:52:52.056 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-18T13:52:52.082 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-18T13:52:52.185 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-18T13:52:52.202 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-18T13:52:52.202 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-18T13:52:52.428 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-18T13:52:52.606 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-18T13:52:52.877 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-18T13:52:53.067 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-18T13:52:53.349 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-18T13:52:53.351 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-18T13:52:53.485 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-18T13:52:53.729 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-18T13:52:53.897 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 14/134 2023-10-18T13:52:54.007 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 14/134 2023-10-18T13:52:54.164 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 15/134 2023-10-18T13:52:54.315 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 15/134 2023-10-18T13:52:54.551 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-18T13:52:54.747 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-18T13:52:54.928 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-18T13:52:55.088 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-18T13:52:55.221 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-18T13:52:55.355 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-18T13:52:55.953 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-18T13:52:56.147 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-18T13:52:56.246 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2023-10-18T13:52:56.428 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-18T13:52:56.595 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-18T13:52:56.736 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-18T13:52:56.829 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-18T13:52:56.930 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-18T13:52:56.980 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-18T13:52:57.075 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-18T13:52:57.356 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-18T13:52:57.628 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-18T13:52:57.770 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-18T13:52:57.886 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-18T13:52:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-18T13:52:58.172 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-18T13:52:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-18T13:52:58.416 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-18T13:52:58.494 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8. 26/134 2023-10-18T13:52:58.588 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-18T13:52:58.607 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el 27/134 2023-10-18T13:52:58.617 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-18T13:52:58.809 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_6 28/134 2023-10-18T13:52:58.838 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-18T13:52:58.949 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-18T13:52:59.015 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-18T13:52:59.021 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-18T13:52:59.130 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-18T13:52:59.215 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-18T13:52:59.216 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-18T13:52:59.374 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-18T13:52:59.406 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 9/134 2023-10-18T13:52:59.514 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-18T13:52:59.633 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-18T13:52:59.782 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-18T13:52:59.883 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-18T13:53:00.178 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-18T13:53:00.290 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-18T13:53:00.373 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-18T13:53:00.512 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-18T13:53:00.646 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 14/134 2023-10-18T13:53:00.759 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 14/134 2023-10-18T13:53:00.785 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-18T13:53:00.821 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-18T13:53:00.938 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 15/134 2023-10-18T13:53:01.011 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 15/134 2023-10-18T13:53:01.031 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-18T13:53:01.159 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-18T13:53:01.163 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-18T13:53:01.296 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-18T13:53:01.332 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-18T13:53:01.436 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-18T13:53:01.496 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-18T13:53:01.632 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 9/134 2023-10-18T13:53:01.796 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-18T13:53:01.861 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-18T13:53:02.077 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-18T13:53:02.110 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-18T13:53:02.120 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-18T13:53:02.305 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-18T13:53:02.373 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-18T13:53:02.463 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-18T13:53:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-18T13:53:02.689 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-18T13:53:02.798 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 14/134 2023-10-18T13:53:02.816 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-18T13:53:02.911 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 14/134 2023-10-18T13:53:02.936 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-18T13:53:03.056 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 15/134 2023-10-18T13:53:03.129 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-18T13:53:03.132 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 15/134 2023-10-18T13:53:03.140 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-18T13:53:03.273 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-18T13:53:03.419 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-18T13:53:03.451 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 36/134 2023-10-18T13:53:03.573 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-18T13:53:03.636 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_6 37/134 2023-10-18T13:53:03.803 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-18T13:53:03.828 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-18T13:53:03.956 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-18T13:53:04.119 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-18T13:53:04.128 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-18T13:53:04.169 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-18T13:53:04.221 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-18T13:53:04.356 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-18T13:53:04.363 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-18T13:53:04.449 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-18T13:53:04.633 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-18T13:53:04.649 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-18T13:53:04.820 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-18T13:53:04.835 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-18T13:53:04.899 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-18T13:53:04.961 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-18T13:53:05.085 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-18T13:53:05.092 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-18T13:53:05.123 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-18T13:53:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-18T13:53:05.322 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-18T13:53:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-18T13:53:05.527 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8. 26/134 2023-10-18T13:53:05.656 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-18T13:53:05.665 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el 27/134 2023-10-18T13:53:05.825 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-18T13:53:05.839 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-18T13:53:06.024 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-18T13:53:06.096 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-18T13:53:06.228 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-18T13:53:06.306 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-18T13:53:06.443 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-18T13:53:06.551 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-18T13:53:06.553 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_6 28/134 2023-10-18T13:53:06.737 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-18T13:53:06.838 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-18T13:53:06.868 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-18T13:53:06.978 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-18T13:53:07.171 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-18T13:53:07.180 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-18T13:53:07.215 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-18T13:53:07.405 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-18T13:53:07.420 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8. 26/134 2023-10-18T13:53:07.443 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-18T13:53:07.533 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el 27/134 2023-10-18T13:53:07.623 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-18T13:53:07.687 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-18T13:53:07.858 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-18T13:53:08.171 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-18T13:53:08.403 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-18T13:53:08.427 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_6 28/134 2023-10-18T13:53:08.579 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-18T13:53:08.719 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-18T13:53:08.791 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-18T13:53:08.974 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-18T13:53:09.033 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-18T13:53:09.148 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-18T13:53:09.283 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-18T13:53:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-18T13:53:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-18T13:53:09.514 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-18T13:53:09.699 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-18T13:53:09.763 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-18T13:53:09.924 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-18T13:53:09.974 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-18T13:53:10.164 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-18T13:53:10.187 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-18T13:53:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-18T13:53:10.334 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 36/134 2023-10-18T13:53:10.488 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-18T13:53:10.490 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_6 37/134 2023-10-18T13:53:10.677 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-18T13:53:10.753 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-18T13:53:10.871 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-18T13:53:10.992 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-18T13:53:11.047 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-18T13:53:11.165 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-18T13:53:11.231 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-18T13:53:11.276 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-18T13:53:11.321 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-18T13:53:11.457 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-18T13:53:11.518 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-18T13:53:11.622 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-18T13:53:11.663 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-18T13:53:11.755 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-18T13:53:11.825 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-18T13:53:11.938 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-18T13:53:12.034 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-18T13:53:12.039 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-18T13:53:12.097 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-18T13:53:12.219 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 36/134 2023-10-18T13:53:12.233 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-18T13:53:12.331 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-18T13:53:12.401 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_6 37/134 2023-10-18T13:53:12.473 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-18T13:53:12.521 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-18T13:53:12.545 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-18T13:53:12.682 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-18T13:53:12.697 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-18T13:53:12.721 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-18T13:53:12.883 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-18T13:53:12.916 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-18T13:53:12.974 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-18T13:53:13.058 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-18T13:53:13.108 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-18T13:53:13.262 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-18T13:53:13.302 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-18T13:53:13.327 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-18T13:53:13.494 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-18T13:53:13.510 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-18T13:53:13.536 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-18T13:53:13.728 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-18T13:53:13.777 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-18T13:53:13.861 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-18T13:53:13.983 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-18T13:53:14.157 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-18T13:53:14.174 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-18T13:53:14.348 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-18T13:53:14.398 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-18T13:53:14.609 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-18T13:53:14.638 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-18T13:53:14.867 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-18T13:53:14.886 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-18T13:53:14.941 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-18T13:53:15.163 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-18T13:53:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-18T13:53:15.190 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-18T13:53:15.404 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-18T13:53:15.418 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-18T13:53:15.442 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-18T13:53:15.564 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-18T13:53:15.626 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-18T13:53:15.755 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-18T13:53:15.768 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-18T13:53:15.773 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-18T13:53:15.959 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-18T13:53:15.961 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-18T13:53:16.026 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-18T13:53:16.041 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-18T13:53:16.116 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-18T13:53:16.256 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-18T13:53:16.271 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-18T13:53:16.428 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-18T13:53:16.506 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-18T13:53:16.653 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-18T13:53:16.669 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-18T13:53:16.730 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-18T13:53:16.917 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-18T13:53:16.973 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-18T13:53:17.073 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-18T13:53:17.136 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-18T13:53:17.161 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-18T13:53:17.218 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 92/134 2023-10-18T13:53:17.273 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 92/134 2023-10-18T13:53:17.328 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-18T13:53:17.360 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-18T13:53:17.489 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-18T13:53:17.501 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 93/134 2023-10-18T13:53:17.546 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-18T13:53:17.654 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-18T13:53:17.722 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-18T13:53:17.819 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-18T13:53:17.986 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-18T13:53:18.059 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-18T13:53:18.174 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-18T13:53:18.206 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-18T13:53:18.337 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-18T13:53:18.387 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-18T13:53:18.416 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-18T13:53:18.576 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-18T13:53:18.633 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-18T13:53:18.771 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-18T13:53:18.830 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-18T13:53:18.978 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-18T13:53:19.132 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-18T13:53:19.290 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-18T13:53:19.398 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-18T13:53:19.489 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-18T13:53:19.627 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-18T13:53:19.633 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-18T13:53:19.791 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-18T13:53:19.872 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-18T13:53:19.931 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-18T13:53:20.112 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-18T13:53:20.139 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-18T13:53:20.332 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-18T13:53:20.333 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-18T13:53:20.488 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-18T13:53:20.640 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-18T13:53:20.648 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-18T13:53:20.810 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-18T13:53:20.860 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-18T13:53:21.035 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-18T13:53:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-18T13:53:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-18T13:53:21.270 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-18T13:53:21.282 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-18T13:53:21.468 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-18T13:53:21.517 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-18T13:53:21.700 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-18T13:53:21.953 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-18T13:53:22.119 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-18T13:53:22.128 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-18T13:53:22.354 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-18T13:53:22.374 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-18T13:53:22.380 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 95/134 2023-10-18T13:53:22.457 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 95/134 2023-10-18T13:53:22.600 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 96/134 2023-10-18T13:53:22.664 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-18T13:53:22.901 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-18T13:53:23.234 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-18T13:53:23.445 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-18T13:53:23.523 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-18T13:53:23.739 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-18T13:53:23.756 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-18T13:53:23.977 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-18T13:53:24.253 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-18T13:53:24.509 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-18T13:53:24.566 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-18T13:53:24.747 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-18T13:53:24.751 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 92/134 2023-10-18T13:53:24.825 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 92/134 2023-10-18T13:53:25.027 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 93/134 2023-10-18T13:53:25.560 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-18T13:53:25.769 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 92/134 2023-10-18T13:53:25.852 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 92/134 2023-10-18T13:53:26.045 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 93/134 2023-10-18T13:53:28.757 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-18T13:53:28.993 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-18T13:53:29.582 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-18T13:53:29.803 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-18T13:53:30.212 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 95/134 2023-10-18T13:53:30.300 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 95/134 2023-10-18T13:53:30.467 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 96/134 2023-10-18T13:53:30.877 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-18T13:53:31.485 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-18T13:53:31.776 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 95/134 2023-10-18T13:53:31.858 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 95/134 2023-10-18T13:53:31.976 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 96/134 2023-10-18T13:53:41.483 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 96/134 2023-10-18T13:53:41.484 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2023-10-18T13:53:41.484 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2023-10-18T13:53:41.484 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /dev 2023-10-18T13:53:41.485 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /run 2023-10-18T13:53:41.485 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2023-10-18T13:53:41.485 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2023-10-18T13:53:41.485 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2023-10-18T13:53:41.485 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2023-10-18T13:53:41.485 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /dev 2023-10-18T13:53:41.486 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:53:41.831 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 97/134 2023-10-18T13:53:43.425 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 97/134 2023-10-18T13:53:43.576 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 98/134 2023-10-18T13:53:43.797 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 98/134 2023-10-18T13:53:43.989 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 99/134 2023-10-18T13:53:44.453 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 99/134 2023-10-18T13:53:44.638 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 100/134 2023-10-18T13:53:44.656 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 100/134 2023-10-18T13:53:46.385 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 101/134 2023-10-18T13:53:46.570 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 101/134 2023-10-18T13:53:46.686 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.e 102/134 2023-10-18T13:53:46.896 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f. 103/134 2023-10-18T13:53:47.062 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 104/134 2023-10-18T13:53:47.286 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 104/134 2023-10-18T13:53:47.600 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 105/134 2023-10-18T13:53:48.563 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 105/134 2023-10-18T13:53:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 106/134 2023-10-18T13:53:48.863 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 106/134 2023-10-18T13:53:49.192 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el 107/134 2023-10-18T13:53:49.319 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 96/134 2023-10-18T13:53:49.319 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /sys 2023-10-18T13:53:49.319 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /proc 2023-10-18T13:53:49.320 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /dev 2023-10-18T13:53:49.320 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /run 2023-10-18T13:53:49.320 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /mnt 2023-10-18T13:53:49.320 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /var/tmp 2023-10-18T13:53:49.321 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /home 2023-10-18T13:53:49.321 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /tmp 2023-10-18T13:53:49.321 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /dev 2023-10-18T13:53:49.321 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:53:49.401 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 108/134 2023-10-18T13:53:49.437 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 108/134 2023-10-18T13:53:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 109/134 2023-10-18T13:53:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 109/134 2023-10-18T13:53:49.690 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 97/134 2023-10-18T13:53:50.927 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 110/134 2023-10-18T13:53:51.109 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 111/134 2023-10-18T13:53:51.143 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 111/134 2023-10-18T13:53:51.160 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 96/134 2023-10-18T13:53:51.160 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /sys 2023-10-18T13:53:51.160 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /proc 2023-10-18T13:53:51.160 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-10-18T13:53:51.161 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /run 2023-10-18T13:53:51.161 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /mnt 2023-10-18T13:53:51.161 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /var/tmp 2023-10-18T13:53:51.161 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /home 2023-10-18T13:53:51.161 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /tmp 2023-10-18T13:53:51.162 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-10-18T13:53:51.162 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T13:53:51.279 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6786.gf7420 112/134 2023-10-18T13:53:51.290 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 97/134 2023-10-18T13:53:51.321 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6786.gf7420 112/134 2023-10-18T13:53:51.475 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 98/134 2023-10-18T13:53:51.504 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 113/134 2023-10-18T13:53:51.532 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 97/134 2023-10-18T13:53:51.694 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 98/134 2023-10-18T13:53:51.862 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 113/134 2023-10-18T13:53:51.915 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 99/134 2023-10-18T13:53:52.004 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 114/134 2023-10-18T13:53:52.377 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 99/134 2023-10-18T13:53:52.515 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 100/134 2023-10-18T13:53:52.531 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 100/134 2023-10-18T13:53:53.120 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 97/134 2023-10-18T13:53:53.280 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 98/134 2023-10-18T13:53:53.499 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 98/134 2023-10-18T13:53:53.673 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 99/134 2023-10-18T13:53:54.127 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 99/134 2023-10-18T13:53:54.251 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 101/134 2023-10-18T13:53:54.281 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 100/134 2023-10-18T13:53:54.298 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 100/134 2023-10-18T13:53:54.477 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 101/134 2023-10-18T13:53:54.629 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.e 102/134 2023-10-18T13:53:54.854 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f. 103/134 2023-10-18T13:53:55.047 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 104/134 2023-10-18T13:53:55.262 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 104/134 2023-10-18T13:53:55.524 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 105/134 2023-10-18T13:53:56.017 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 101/134 2023-10-18T13:53:56.201 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 101/134 2023-10-18T13:53:56.337 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.e 102/134 2023-10-18T13:53:56.482 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 105/134 2023-10-18T13:53:56.563 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f. 103/134 2023-10-18T13:53:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 114/134 2023-10-18T13:53:56.680 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 106/134 2023-10-18T13:53:56.730 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 104/134 2023-10-18T13:53:56.772 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 106/134 2023-10-18T13:53:56.951 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 104/134 2023-10-18T13:53:57.158 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el 107/134 2023-10-18T13:53:57.246 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 105/134 2023-10-18T13:53:57.353 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 108/134 2023-10-18T13:53:57.387 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 108/134 2023-10-18T13:53:57.539 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 109/134 2023-10-18T13:53:57.549 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 109/134 2023-10-18T13:53:57.566 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 115/134 2023-10-18T13:53:57.856 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-18T13:53:58.055 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 117/134 2023-10-18T13:53:58.211 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 105/134 2023-10-18T13:53:58.289 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-18T13:53:58.430 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 106/134 2023-10-18T13:53:58.452 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-18T13:53:58.521 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 106/134 2023-10-18T13:53:58.652 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-18T13:53:58.871 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el 107/134 2023-10-18T13:53:58.881 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-18T13:53:58.887 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 110/134 2023-10-18T13:53:59.055 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 108/134 2023-10-18T13:53:59.081 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_ 121/134 2023-10-18T13:53:59.090 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 108/134 2023-10-18T13:53:59.108 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 111/134 2023-10-18T13:53:59.141 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 111/134 2023-10-18T13:53:59.220 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-18T13:53:59.230 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 109/134 2023-10-18T13:53:59.242 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 109/134 2023-10-18T13:53:59.288 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6786.gf7420 112/134 2023-10-18T13:53:59.330 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6786.gf7420 112/134 2023-10-18T13:53:59.514 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 113/134 2023-10-18T13:53:59.871 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 113/134 2023-10-18T13:54:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 114/134 2023-10-18T13:54:00.589 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 110/134 2023-10-18T13:54:00.945 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 111/134 2023-10-18T13:54:00.978 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 111/134 2023-10-18T13:54:01.114 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6786.gf7420 112/134 2023-10-18T13:54:01.156 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6786.gf7420 112/134 2023-10-18T13:54:01.330 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 113/134 2023-10-18T13:54:01.415 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-18T13:54:01.685 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-18T13:54:01.688 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 113/134 2023-10-18T13:54:01.705 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-18T13:54:01.888 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 114/134 2023-10-18T13:54:01.913 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 124/134 2023-10-18T13:54:02.185 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 125/134 2023-10-18T13:54:02.514 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 126/134 2023-10-18T13:54:02.851 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-18T13:54:03.060 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-18T13:54:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-18T13:54:03.368 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-18T13:54:03.381 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-18T13:54:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-18T13:54:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-18T13:54:03.720 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-18T13:54:03.721 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-18T13:54:03.921 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-18T13:54:03.922 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-18T13:54:04.198 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-18T13:54:04.409 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-18T13:54:04.710 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 114/134 2023-10-18T13:54:04.905 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-18T13:54:04.906 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 1/134 2023-10-18T13:54:04.906 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 2/134 2023-10-18T13:54:04.906 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 3/134 2023-10-18T13:54:04.906 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 4/134 2023-10-18T13:54:04.906 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6786.gf7420 5/134 2023-10-18T13:54:04.907 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-18T13:54:04.907 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-18T13:54:04.907 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-18T13:54:04.907 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 9/134 2023-10-18T13:54:04.907 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 10/134 2023-10-18T13:54:04.908 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 11/134 2023-10-18T13:54:04.908 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 12/134 2023-10-18T13:54:04.908 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 13/134 2023-10-18T13:54:04.908 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_ 14/134 2023-10-18T13:54:04.908 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 15/134 2023-10-18T13:54:04.909 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 16/134 2023-10-18T13:54:04.909 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_6 17/134 2023-10-18T13:54:04.909 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 18/134 2023-10-18T13:54:04.909 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 19/134 2023-10-18T13:54:04.909 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el 20/134 2023-10-18T13:54:04.910 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8. 21/134 2023-10-18T13:54:04.910 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_6 22/134 2023-10-18T13:54:04.910 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 23/134 2023-10-18T13:54:04.910 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 24/134 2023-10-18T13:54:04.910 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 25/134 2023-10-18T13:54:04.911 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 26/134 2023-10-18T13:54:04.911 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 27/134 2023-10-18T13:54:04.920 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 28/134 2023-10-18T13:54:04.921 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f. 29/134 2023-10-18T13:54:04.921 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 30/134 2023-10-18T13:54:04.921 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 31/134 2023-10-18T13:54:04.921 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 32/134 2023-10-18T13:54:04.922 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el 33/134 2023-10-18T13:54:04.922 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 34/134 2023-10-18T13:54:04.922 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.e 35/134 2023-10-18T13:54:04.922 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 36/134 2023-10-18T13:54:04.923 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 37/134 2023-10-18T13:54:04.923 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 38/134 2023-10-18T13:54:04.923 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-18T13:54:04.923 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-18T13:54:04.923 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-18T13:54:04.924 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-18T13:54:04.924 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-18T13:54:04.924 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-18T13:54:04.924 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-18T13:54:04.925 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-18T13:54:04.925 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-18T13:54:04.925 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-18T13:54:04.925 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-18T13:54:04.925 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-18T13:54:04.926 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-18T13:54:04.926 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-18T13:54:04.926 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-18T13:54:04.926 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-18T13:54:04.926 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-18T13:54:04.927 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-18T13:54:04.927 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-18T13:54:04.927 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-18T13:54:04.927 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-18T13:54:04.927 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-18T13:54:04.928 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-18T13:54:04.928 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-18T13:54:04.928 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-18T13:54:04.928 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-18T13:54:04.928 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-18T13:54:04.929 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-18T13:54:04.929 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-18T13:54:04.929 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-18T13:54:04.929 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-18T13:54:04.929 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-18T13:54:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-18T13:54:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-18T13:54:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-18T13:54:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-18T13:54:04.930 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-18T13:54:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-18T13:54:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-18T13:54:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-18T13:54:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-18T13:54:04.931 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-18T13:54:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-18T13:54:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-18T13:54:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-18T13:54:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-18T13:54:04.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-18T13:54:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-18T13:54:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-18T13:54:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-18T13:54:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-18T13:54:04.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-18T13:54:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-18T13:54:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-18T13:54:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-18T13:54:04.934 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-18T13:54:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-18T13:54:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-18T13:54:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-18T13:54:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-18T13:54:04.935 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-18T13:54:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-18T13:54:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-18T13:54:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-18T13:54:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-18T13:54:04.936 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-18T13:54:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-18T13:54:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-18T13:54:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-18T13:54:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-18T13:54:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-18T13:54:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-18T13:54:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-18T13:54:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-18T13:54:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-18T13:54:04.938 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-18T13:54:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-18T13:54:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-18T13:54:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-18T13:54:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-18T13:54:04.939 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-18T13:54:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-18T13:54:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-18T13:54:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-18T13:54:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-18T13:54:04.940 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-18T13:54:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-18T13:54:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-18T13:54:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-18T13:54:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-18T13:54:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 129/134 2023-10-18T13:54:04.941 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-18T13:54:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 131/134 2023-10-18T13:54:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-18T13:54:04.942 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-18T13:54:04.974 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 115/134 2023-10-18T13:54:05.146 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-18T13:54:05.335 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-18T13:54:06.192 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-18T13:54:06.516 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-18T13:54:06.531 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 114/134 2023-10-18T13:54:06.732 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 119/134 2023-10-18T13:54:06.852 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 115/134 2023-10-18T13:54:06.917 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-18T13:54:07.012 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-18T13:54:07.084 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_ 121/134 2023-10-18T13:54:07.203 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-18T13:54:07.263 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-18T13:54:07.391 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-18T13:54:07.391 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:51 ago on Wed 18 Oct 2023 01:52:16 PM UTC. 2023-10-18T13:54:08.072 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-18T13:54:08.399 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-18T13:54:08.590 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 119/134 2023-10-18T13:54:08.808 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-18T13:54:08.974 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_ 121/134 2023-10-18T13:54:09.105 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-18T13:54:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-18T13:54:09.621 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-18T13:54:09.638 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-18T13:54:09.812 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 124/134 2023-10-18T13:54:09.990 INFO:teuthology.orchestra.run.smithi172.stdout:Installed products updated. 2023-10-18T13:54:10.087 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 125/134 2023-10-18T13:54:10.198 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:54:10.199 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2023-10-18T13:54:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-18T13:54:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.199 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2023-10-18T13:54:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-18T13:54:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.1-7.el8.noarch 2023-10-18T13:54:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.0.4-10.el8.x86_64 2023-10-18T13:54:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.200 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.201 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:10.202 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:10.203 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-18T13:54:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.1-9.el8.x86_64 2023-10-18T13:54:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-18T13:54:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-18T13:54:10.205 INFO:teuthology.orchestra.run.smithi172.stdout: jq-1.6-3.el8.x86_64 2023-10-18T13:54:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-18T13:54:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-18T13:54:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-18T13:54:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.206 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-18T13:54:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-18T13:54:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-18T13:54:10.207 INFO:teuthology.orchestra.run.smithi172.stdout: libpq-13.5-1.el8.x86_64 2023-10-18T13:54:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-18T13:54:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-18T13:54:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-18T13:54:10.208 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-18T13:54:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-18T13:54:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-18T13:54:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-18T13:54:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-18T13:54:10.209 INFO:teuthology.orchestra.run.smithi172.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-18T13:54:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-18T13:54:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-18T13:54:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-18T13:54:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-18T13:54:10.210 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-18T13:54:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-18T13:54:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-18T13:54:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-18T13:54:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-18T13:54:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-18T13:54:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-18T13:54:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-18T13:54:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-18T13:54:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-18T13:54:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-18T13:54:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-18T13:54:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-18T13:54:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-18T13:54:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-18T13:54:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-18T13:54:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-18T13:54:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-18T13:54:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-18T13:54:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-18T13:54:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-18T13:54:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-18T13:54:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-18T13:54:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-18T13:54:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-18T13:54:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-18T13:54:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-18T13:54:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-18T13:54:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-18T13:54:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-18T13:54:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-18T13:54:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-18T13:54:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-18T13:54:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-18T13:54:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-2.6-1.el8.noarch 2023-10-18T13:54:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-18T13:54:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-18T13:54:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-18T13:54:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-18T13:54:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-18T13:54:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-18T13:54:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-18T13:54:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-18T13:54:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-18T13:54:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-18T13:54:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-18T13:54:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-18T13:54:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-18T13:54:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-18T13:54:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-18T13:54:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-18T13:54:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-18T13:54:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-18T13:54:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-18T13:54:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-18T13:54:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-18T13:54:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-18T13:54:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-18T13:54:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-18T13:54:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-18T13:54:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-18T13:54:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-18T13:54:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:54:10.224 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2023-10-18T13:54:10.399 DEBUG:teuthology.parallel:result is None 2023-10-18T13:54:10.407 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 126/134 2023-10-18T13:54:10.697 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-18T13:54:10.870 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-18T13:54:10.878 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-18T13:54:11.079 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-18T13:54:11.303 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-18T13:54:11.385 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-18T13:54:11.385 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-18T13:54:11.587 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-18T13:54:11.600 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-18T13:54:11.600 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-18T13:54:11.662 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-18T13:54:11.679 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-18T13:54:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-18T13:54:11.773 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-18T13:54:11.812 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 124/134 2023-10-18T13:54:12.009 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-18T13:54:12.128 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 125/134 2023-10-18T13:54:12.219 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-18T13:54:12.427 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 126/134 2023-10-18T13:54:12.713 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-18T13:54:12.764 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-18T13:54:12.765 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 1/134 2023-10-18T13:54:12.765 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 2/134 2023-10-18T13:54:12.765 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 3/134 2023-10-18T13:54:12.765 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 4/134 2023-10-18T13:54:12.765 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6786.gf7420 5/134 2023-10-18T13:54:12.766 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-18T13:54:12.766 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-18T13:54:12.766 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-18T13:54:12.766 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 9/134 2023-10-18T13:54:12.769 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 10/134 2023-10-18T13:54:12.770 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 11/134 2023-10-18T13:54:12.770 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 12/134 2023-10-18T13:54:12.770 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 13/134 2023-10-18T13:54:12.770 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_ 14/134 2023-10-18T13:54:12.770 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 15/134 2023-10-18T13:54:12.771 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 16/134 2023-10-18T13:54:12.771 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_6 17/134 2023-10-18T13:54:12.771 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 18/134 2023-10-18T13:54:12.771 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 19/134 2023-10-18T13:54:12.771 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el 20/134 2023-10-18T13:54:12.772 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8. 21/134 2023-10-18T13:54:12.772 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_6 22/134 2023-10-18T13:54:12.772 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 23/134 2023-10-18T13:54:12.772 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 24/134 2023-10-18T13:54:12.772 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 25/134 2023-10-18T13:54:12.773 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 26/134 2023-10-18T13:54:12.773 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 27/134 2023-10-18T13:54:12.773 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 28/134 2023-10-18T13:54:12.773 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f. 29/134 2023-10-18T13:54:12.774 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 30/134 2023-10-18T13:54:12.782 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 31/134 2023-10-18T13:54:12.783 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 32/134 2023-10-18T13:54:12.783 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el 33/134 2023-10-18T13:54:12.783 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 34/134 2023-10-18T13:54:12.783 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.e 35/134 2023-10-18T13:54:12.783 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 36/134 2023-10-18T13:54:12.784 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 37/134 2023-10-18T13:54:12.784 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 38/134 2023-10-18T13:54:12.784 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-18T13:54:12.784 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-18T13:54:12.784 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-18T13:54:12.785 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-18T13:54:12.785 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-18T13:54:12.785 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-18T13:54:12.785 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-18T13:54:12.785 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-18T13:54:12.786 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-18T13:54:12.786 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-18T13:54:12.786 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-18T13:54:12.786 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-18T13:54:12.786 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-18T13:54:12.787 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-18T13:54:12.787 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-18T13:54:12.787 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-18T13:54:12.787 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-18T13:54:12.787 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-18T13:54:12.787 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-18T13:54:12.788 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-18T13:54:12.788 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-18T13:54:12.788 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-18T13:54:12.788 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-18T13:54:12.788 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-18T13:54:12.789 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-18T13:54:12.789 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-18T13:54:12.789 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-18T13:54:12.789 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-18T13:54:12.789 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-18T13:54:12.789 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-18T13:54:12.790 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-18T13:54:12.790 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-18T13:54:12.790 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-18T13:54:12.790 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-18T13:54:12.790 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-18T13:54:12.791 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-18T13:54:12.791 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-18T13:54:12.791 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-18T13:54:12.791 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-18T13:54:12.791 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-18T13:54:12.792 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-18T13:54:12.792 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-18T13:54:12.792 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-18T13:54:12.792 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-18T13:54:12.792 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-18T13:54:12.792 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-18T13:54:12.793 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-18T13:54:12.793 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-18T13:54:12.793 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-18T13:54:12.793 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-18T13:54:12.793 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-18T13:54:12.794 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-18T13:54:12.794 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-18T13:54:12.794 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-18T13:54:12.794 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-18T13:54:12.795 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-18T13:54:12.795 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-18T13:54:12.795 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-18T13:54:12.795 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-18T13:54:12.795 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-18T13:54:12.796 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-18T13:54:12.796 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-18T13:54:12.796 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-18T13:54:12.796 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-18T13:54:12.796 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-18T13:54:12.797 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-18T13:54:12.797 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-18T13:54:12.797 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-18T13:54:12.797 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-18T13:54:12.797 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-18T13:54:12.797 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-18T13:54:12.798 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-18T13:54:12.798 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-18T13:54:12.798 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-18T13:54:12.798 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-18T13:54:12.798 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-18T13:54:12.798 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-18T13:54:12.799 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-18T13:54:12.799 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-18T13:54:12.799 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-18T13:54:12.799 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-18T13:54:12.799 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-18T13:54:12.799 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-18T13:54:12.800 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-18T13:54:12.800 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-18T13:54:12.800 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-18T13:54:12.800 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-18T13:54:12.800 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-18T13:54:12.800 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-18T13:54:12.801 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-18T13:54:12.801 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 129/134 2023-10-18T13:54:12.801 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-18T13:54:12.801 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 131/134 2023-10-18T13:54:12.801 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-18T13:54:12.802 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-18T13:54:12.861 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-18T13:54:12.870 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-18T13:54:13.047 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-18T13:54:13.253 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-18T13:54:13.337 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-18T13:54:13.544 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-18T13:54:13.557 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-18T13:54:13.557 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-18T13:54:13.781 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-18T13:54:13.781 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-18T13:54:14.000 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-18T13:54:14.218 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-18T13:54:14.721 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-18T13:54:14.721 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 1/134 2023-10-18T13:54:14.721 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 2/134 2023-10-18T13:54:14.722 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 3/134 2023-10-18T13:54:14.722 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 4/134 2023-10-18T13:54:14.722 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6786.gf7420 5/134 2023-10-18T13:54:14.722 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-18T13:54:14.723 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-18T13:54:14.723 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-18T13:54:14.723 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 9/134 2023-10-18T13:54:14.723 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 10/134 2023-10-18T13:54:14.724 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 11/134 2023-10-18T13:54:14.724 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 12/134 2023-10-18T13:54:14.724 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 13/134 2023-10-18T13:54:14.724 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_ 14/134 2023-10-18T13:54:14.725 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 15/134 2023-10-18T13:54:14.725 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 16/134 2023-10-18T13:54:14.725 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_6 17/134 2023-10-18T13:54:14.725 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 18/134 2023-10-18T13:54:14.726 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 19/134 2023-10-18T13:54:14.726 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el 20/134 2023-10-18T13:54:14.726 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8. 21/134 2023-10-18T13:54:14.726 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_6 22/134 2023-10-18T13:54:14.727 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 23/134 2023-10-18T13:54:14.727 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 24/134 2023-10-18T13:54:14.727 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 25/134 2023-10-18T13:54:14.727 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 26/134 2023-10-18T13:54:14.727 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 27/134 2023-10-18T13:54:14.738 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 28/134 2023-10-18T13:54:14.738 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f. 29/134 2023-10-18T13:54:14.738 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 30/134 2023-10-18T13:54:14.738 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 31/134 2023-10-18T13:54:14.738 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 32/134 2023-10-18T13:54:14.739 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el 33/134 2023-10-18T13:54:14.739 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 34/134 2023-10-18T13:54:14.739 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.e 35/134 2023-10-18T13:54:14.739 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 36/134 2023-10-18T13:54:14.740 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 37/134 2023-10-18T13:54:14.740 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 38/134 2023-10-18T13:54:14.740 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-18T13:54:14.740 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-18T13:54:14.741 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-18T13:54:14.741 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-18T13:54:14.741 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-18T13:54:14.741 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-18T13:54:14.741 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-18T13:54:14.742 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-18T13:54:14.742 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-18T13:54:14.742 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-18T13:54:14.742 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-18T13:54:14.743 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-18T13:54:14.743 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-18T13:54:14.743 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-18T13:54:14.743 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-18T13:54:14.743 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-18T13:54:14.744 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-18T13:54:14.744 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-18T13:54:14.744 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-18T13:54:14.744 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-18T13:54:14.745 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-18T13:54:14.745 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-18T13:54:14.745 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-18T13:54:14.745 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-18T13:54:14.745 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-18T13:54:14.746 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-18T13:54:14.746 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-18T13:54:14.746 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-18T13:54:14.746 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-18T13:54:14.747 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-18T13:54:14.747 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-18T13:54:14.747 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-18T13:54:14.747 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-18T13:54:14.747 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-18T13:54:14.748 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-18T13:54:14.748 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-18T13:54:14.748 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-18T13:54:14.748 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-18T13:54:14.748 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-18T13:54:14.749 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-18T13:54:14.749 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-18T13:54:14.749 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-18T13:54:14.749 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-18T13:54:14.749 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-18T13:54:14.750 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-18T13:54:14.750 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-18T13:54:14.750 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-18T13:54:14.750 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-18T13:54:14.751 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-18T13:54:14.751 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-18T13:54:14.751 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-18T13:54:14.751 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-18T13:54:14.751 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-18T13:54:14.752 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-18T13:54:14.752 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-18T13:54:14.752 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-18T13:54:14.752 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-18T13:54:14.752 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-18T13:54:14.753 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-18T13:54:14.753 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-18T13:54:14.753 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-18T13:54:14.753 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-18T13:54:14.754 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-18T13:54:14.754 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-18T13:54:14.754 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-18T13:54:14.754 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-18T13:54:14.754 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-18T13:54:14.755 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-18T13:54:14.755 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-18T13:54:14.755 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-18T13:54:14.755 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-18T13:54:14.756 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-18T13:54:14.756 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-18T13:54:14.756 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-18T13:54:14.756 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-18T13:54:14.756 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-18T13:54:14.756 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-18T13:54:14.757 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-18T13:54:14.757 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-18T13:54:14.757 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-18T13:54:14.757 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-18T13:54:14.757 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-18T13:54:14.758 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-18T13:54:14.758 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-18T13:54:14.758 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-18T13:54:14.758 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-18T13:54:14.759 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-18T13:54:14.759 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-18T13:54:14.759 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-18T13:54:14.759 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-18T13:54:14.760 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 129/134 2023-10-18T13:54:14.760 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-18T13:54:14.760 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 131/134 2023-10-18T13:54:14.761 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-18T13:54:14.761 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-18T13:54:15.252 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-18T13:54:15.252 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:58 ago on Wed 18 Oct 2023 01:52:17 PM UTC. 2023-10-18T13:54:17.349 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-18T13:54:17.349 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:02:00 ago on Wed 18 Oct 2023 01:52:17 PM UTC. 2023-10-18T13:54:17.939 INFO:teuthology.orchestra.run.smithi114.stdout:Installed products updated. 2023-10-18T13:54:18.151 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:54:18.152 INFO:teuthology.orchestra.run.smithi114.stdout:Upgraded: 2023-10-18T13:54:18.152 INFO:teuthology.orchestra.run.smithi114.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-18T13:54:18.152 INFO:teuthology.orchestra.run.smithi114.stdout: librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.152 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.153 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2023-10-18T13:54:18.153 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-18T13:54:18.153 INFO:teuthology.orchestra.run.smithi114.stdout: automake-1.16.1-7.el8.noarch 2023-10-18T13:54:18.153 INFO:teuthology.orchestra.run.smithi114.stdout: bison-3.0.4-10.el8.x86_64 2023-10-18T13:54:18.154 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.154 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.154 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.154 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.154 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:18.155 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.155 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.155 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.155 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:18.155 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:18.156 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:18.156 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:18.156 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:18.156 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.156 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.157 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:18.157 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.157 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.157 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.157 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:18.158 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:18.158 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.158 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:18.158 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-18T13:54:18.159 INFO:teuthology.orchestra.run.smithi114.stdout: flex-2.6.1-9.el8.x86_64 2023-10-18T13:54:18.159 INFO:teuthology.orchestra.run.smithi114.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-18T13:54:18.159 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-18T13:54:18.159 INFO:teuthology.orchestra.run.smithi114.stdout: jq-1.6-3.el8.x86_64 2023-10-18T13:54:18.159 INFO:teuthology.orchestra.run.smithi114.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-18T13:54:18.160 INFO:teuthology.orchestra.run.smithi114.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-18T13:54:18.160 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-18T13:54:18.160 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.160 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.160 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.161 INFO:teuthology.orchestra.run.smithi114.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-18T13:54:18.161 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-18T13:54:18.161 INFO:teuthology.orchestra.run.smithi114.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-18T13:54:18.161 INFO:teuthology.orchestra.run.smithi114.stdout: libpq-13.5-1.el8.x86_64 2023-10-18T13:54:18.161 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-18T13:54:18.162 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-18T13:54:18.162 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.162 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.162 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-18T13:54:18.162 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.163 INFO:teuthology.orchestra.run.smithi114.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-18T13:54:18.163 INFO:teuthology.orchestra.run.smithi114.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-18T13:54:18.164 INFO:teuthology.orchestra.run.smithi114.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-18T13:54:18.164 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-18T13:54:18.164 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-18T13:54:18.165 INFO:teuthology.orchestra.run.smithi114.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-18T13:54:18.168 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-18T13:54:18.168 INFO:teuthology.orchestra.run.smithi114.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-18T13:54:18.168 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-18T13:54:18.169 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-18T13:54:18.169 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-18T13:54:18.170 INFO:teuthology.orchestra.run.smithi114.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-18T13:54:18.170 INFO:teuthology.orchestra.run.smithi114.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-18T13:54:18.171 INFO:teuthology.orchestra.run.smithi114.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-18T13:54:18.171 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-18T13:54:18.171 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-18T13:54:18.171 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-18T13:54:18.172 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-18T13:54:18.172 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-18T13:54:18.172 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-18T13:54:18.174 INFO:teuthology.orchestra.run.smithi114.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-18T13:54:18.174 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-18T13:54:18.174 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.174 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.175 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.175 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-18T13:54:18.175 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-18T13:54:18.175 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-18T13:54:18.175 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-18T13:54:18.176 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-18T13:54:18.176 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-18T13:54:18.176 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-18T13:54:18.176 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-18T13:54:18.176 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-18T13:54:18.177 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-18T13:54:18.177 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-18T13:54:18.177 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-18T13:54:18.177 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-18T13:54:18.177 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-18T13:54:18.178 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-18T13:54:18.178 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-18T13:54:18.178 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-18T13:54:18.178 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-18T13:54:18.178 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-18T13:54:18.179 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-18T13:54:18.179 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-18T13:54:18.179 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-18T13:54:18.179 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend-2.6-1.el8.noarch 2023-10-18T13:54:18.179 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-18T13:54:18.179 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-18T13:54:18.180 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-18T13:54:18.180 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-18T13:54:18.180 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-18T13:54:18.180 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-18T13:54:18.180 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.181 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.181 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-18T13:54:18.181 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-18T13:54:18.181 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.181 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-18T13:54:18.182 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-18T13:54:18.182 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-18T13:54:18.182 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-18T13:54:18.182 INFO:teuthology.orchestra.run.smithi114.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-18T13:54:18.182 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-18T13:54:18.183 INFO:teuthology.orchestra.run.smithi114.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-18T13:54:18.183 INFO:teuthology.orchestra.run.smithi114.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-18T13:54:18.183 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-18T13:54:18.183 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-18T13:54:18.183 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-18T13:54:18.184 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-18T13:54:18.184 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-18T13:54:18.184 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.184 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.184 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:18.184 INFO:teuthology.orchestra.run.smithi114.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-18T13:54:18.185 INFO:teuthology.orchestra.run.smithi114.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-18T13:54:18.185 INFO:teuthology.orchestra.run.smithi114.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-18T13:54:18.185 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-18T13:54:18.185 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-18T13:54:18.186 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-18T13:54:18.186 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:54:18.186 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2023-10-18T13:54:18.346 DEBUG:teuthology.parallel:result is None 2023-10-18T13:54:19.966 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-18T13:54:20.181 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T13:54:20.181 INFO:teuthology.orchestra.run.smithi158.stdout:Upgraded: 2023-10-18T13:54:20.181 INFO:teuthology.orchestra.run.smithi158.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-18T13:54:20.181 INFO:teuthology.orchestra.run.smithi158.stdout: librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.182 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.182 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-18T13:54:20.182 INFO:teuthology.orchestra.run.smithi158.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-18T13:54:20.182 INFO:teuthology.orchestra.run.smithi158.stdout: automake-1.16.1-7.el8.noarch 2023-10-18T13:54:20.182 INFO:teuthology.orchestra.run.smithi158.stdout: bison-3.0.4-10.el8.x86_64 2023-10-18T13:54:20.183 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.183 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.183 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.183 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.183 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:20.184 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-immutable-object-cache-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.184 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.184 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.184 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:20.184 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:20.185 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:20.185 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:20.185 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:20.185 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.185 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.186 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:20.186 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.186 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.186 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.186 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:20.187 INFO:teuthology.orchestra.run.smithi158.stdout: cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:20.187 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.187 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-18T13:54:20.187 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-18T13:54:20.188 INFO:teuthology.orchestra.run.smithi158.stdout: flex-2.6.1-9.el8.x86_64 2023-10-18T13:54:20.188 INFO:teuthology.orchestra.run.smithi158.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-18T13:54:20.188 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-18T13:54:20.188 INFO:teuthology.orchestra.run.smithi158.stdout: jq-1.6-3.el8.x86_64 2023-10-18T13:54:20.188 INFO:teuthology.orchestra.run.smithi158.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-18T13:54:20.188 INFO:teuthology.orchestra.run.smithi158.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-18T13:54:20.189 INFO:teuthology.orchestra.run.smithi158.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-18T13:54:20.189 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.189 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.189 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.189 INFO:teuthology.orchestra.run.smithi158.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-18T13:54:20.190 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-18T13:54:20.190 INFO:teuthology.orchestra.run.smithi158.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-18T13:54:20.190 INFO:teuthology.orchestra.run.smithi158.stdout: libpq-13.5-1.el8.x86_64 2023-10-18T13:54:20.190 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-18T13:54:20.190 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-18T13:54:20.191 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.191 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.191 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-18T13:54:20.191 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.191 INFO:teuthology.orchestra.run.smithi158.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-18T13:54:20.192 INFO:teuthology.orchestra.run.smithi158.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-18T13:54:20.192 INFO:teuthology.orchestra.run.smithi158.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-18T13:54:20.192 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-18T13:54:20.192 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-18T13:54:20.192 INFO:teuthology.orchestra.run.smithi158.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-18T13:54:20.192 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-18T13:54:20.193 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-18T13:54:20.193 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-18T13:54:20.193 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-18T13:54:20.193 INFO:teuthology.orchestra.run.smithi158.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-18T13:54:20.193 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-18T13:54:20.194 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-18T13:54:20.194 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-18T13:54:20.194 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-18T13:54:20.194 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-18T13:54:20.194 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-18T13:54:20.195 INFO:teuthology.orchestra.run.smithi158.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-18T13:54:20.195 INFO:teuthology.orchestra.run.smithi158.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-18T13:54:20.195 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-18T13:54:20.195 INFO:teuthology.orchestra.run.smithi158.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-18T13:54:20.195 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-18T13:54:20.196 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.196 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.196 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.196 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-18T13:54:20.196 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-18T13:54:20.196 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-18T13:54:20.197 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-18T13:54:20.197 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-18T13:54:20.197 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-18T13:54:20.197 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-18T13:54:20.197 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-18T13:54:20.198 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-18T13:54:20.198 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-18T13:54:20.198 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-18T13:54:20.198 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-18T13:54:20.198 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-18T13:54:20.199 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-18T13:54:20.199 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-18T13:54:20.199 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-18T13:54:20.199 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-18T13:54:20.199 INFO:teuthology.orchestra.run.smithi158.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-18T13:54:20.200 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-18T13:54:20.200 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-18T13:54:20.200 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-18T13:54:20.200 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-18T13:54:20.200 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend-2.6-1.el8.noarch 2023-10-18T13:54:20.200 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-18T13:54:20.201 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-18T13:54:20.201 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-18T13:54:20.201 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-18T13:54:20.202 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-18T13:54:20.202 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-18T13:54:20.202 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.202 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.202 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-18T13:54:20.203 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-18T13:54:20.203 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.203 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-18T13:54:20.203 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-18T13:54:20.203 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-18T13:54:20.204 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-18T13:54:20.204 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-18T13:54:20.204 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-18T13:54:20.204 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-18T13:54:20.204 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-18T13:54:20.205 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-18T13:54:20.205 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-18T13:54:20.205 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-18T13:54:20.205 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-18T13:54:20.205 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-18T13:54:20.206 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.206 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.206 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-18T13:54:20.206 INFO:teuthology.orchestra.run.smithi158.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-18T13:54:20.206 INFO:teuthology.orchestra.run.smithi158.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-18T13:54:20.206 INFO:teuthology.orchestra.run.smithi158.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-18T13:54:20.207 INFO:teuthology.orchestra.run.smithi158.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-18T13:54:20.207 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-18T13:54:20.207 INFO:teuthology.orchestra.run.smithi158.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-18T13:54:20.208 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-18T13:54:20.208 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-18T13:54:20.370 DEBUG:teuthology.parallel:result is None 2023-10-18T13:54:20.371 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-18T13:54:20.603 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-18T13:54:20.632 INFO:teuthology.orchestra.run.smithi114.stdout:18.0.0-6786.gf7420d7f.el8 2023-10-18T13:54:20.633 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6786.gf7420d7f.el8 2023-10-18T13:54:20.633 INFO:teuthology.task.install:The correct ceph version 18.0.0-6786.gf7420d7f is installed. 2023-10-18T13:54:20.633 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-18T13:54:20.863 DEBUG:teuthology.orchestra.run.smithi158:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-18T13:54:20.888 INFO:teuthology.orchestra.run.smithi158.stdout:18.0.0-6786.gf7420d7f.el8 2023-10-18T13:54:20.888 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6786.gf7420d7f.el8 2023-10-18T13:54:20.889 INFO:teuthology.task.install:The correct ceph version 18.0.0-6786.gf7420d7f is installed. 2023-10-18T13:54:20.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-18T13:54:21.029 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-18T13:54:21.058 INFO:teuthology.orchestra.run.smithi172.stdout:18.0.0-6786.gf7420d7f.el8 2023-10-18T13:54:21.058 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6786.gf7420d7f.el8 2023-10-18T13:54:21.058 INFO:teuthology.task.install:The correct ceph version 18.0.0-6786.gf7420d7f is installed. 2023-10-18T13:54:21.059 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-18T13:54:21.059 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:54:21.060 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T13:54:21.107 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T13:54:21.107 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T13:54:21.150 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T13:54:21.150 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T13:54:21.197 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-18T13:54:21.198 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:54:21.198 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T13:54:21.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T13:54:21.297 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T13:54:21.298 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T13:54:21.327 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T13:54:21.395 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T13:54:21.395 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T13:54:21.427 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T13:54:21.496 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-18T13:54:21.497 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:54:21.497 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T13:54:21.527 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T13:54:21.596 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T13:54:21.596 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T13:54:21.625 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T13:54:21.693 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T13:54:21.693 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T13:54:21.723 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T13:54:21.793 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-18T13:54:21.793 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:54:21.794 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T13:54:21.824 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T13:54:21.895 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T13:54:21.895 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T13:54:21.923 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T13:54:21.990 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T13:54:21.991 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T13:54:22.022 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T13:54:22.093 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-18T13:54:22.185 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2023-10-18T13:54:22.185 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-18T13:54:22.186 INFO:tasks.cephadm:Cluster fsid is d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:54:22.187 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-18T13:54:22.187 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.114', 'mon.b': '172.21.15.158', 'mon.c': '172.21.15.172'} 2023-10-18T13:54:22.187 INFO:tasks.cephadm:First mon is mon.a on smithi114 2023-10-18T13:54:22.188 INFO:tasks.cephadm:First mgr is x 2023-10-18T13:54:22.188 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-18T13:54:22.188 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname $(hostname -s) 2023-10-18T13:54:22.221 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname $(hostname -s) 2023-10-18T13:54:22.250 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2023-10-18T13:54:22.284 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-18T13:54:22.284 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-18T13:54:22.498 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73406/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6786-gf7420d7f', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6786.gf7420d7f'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-16 23:26:05.686958', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20231016.203825', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2023-10-18T13:54:22.711 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-batrick-testing-20231016.203825, sha1 f7420d7f8e55ceea786dcbf536c338ce920c21eb from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-18T13:54:22.712 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/x86_64/flavors/default/cephadm 2023-10-18T13:54:22.712 DEBUG:teuthology.orchestra.run.smithi114:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-18T13:54:23.396 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-rw-r--. 1 ubuntu ubuntu 793356 Oct 18 13:54 /home/ubuntu/cephtest/cephadm 2023-10-18T13:54:23.396 DEBUG:teuthology.orchestra.run.smithi158:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-18T13:54:23.824 INFO:teuthology.orchestra.run.smithi158.stdout:-rw-rw-r--. 1 ubuntu ubuntu 793356 Oct 18 13:54 /home/ubuntu/cephtest/cephadm 2023-10-18T13:54:23.824 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-18T13:54:24.615 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-rw-r--. 1 ubuntu ubuntu 793356 Oct 18 13:54 /home/ubuntu/cephtest/cephadm 2023-10-18T13:54:24.615 DEBUG:teuthology.orchestra.run.smithi114:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-18T13:54:24.637 DEBUG:teuthology.orchestra.run.smithi158:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-18T13:54:24.659 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-18T13:54:24.694 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb on all hosts... 2023-10-18T13:54:24.694 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb pull 2023-10-18T13:54:24.697 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb pull 2023-10-18T13:54:24.700 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb pull 2023-10-18T13:54:27.644 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb... 2023-10-18T13:54:30.433 INFO:teuthology.orchestra.run.smithi114.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb... 2023-10-18T13:54:30.800 INFO:teuthology.orchestra.run.smithi158.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb... 2023-10-18T13:54:57.235 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-10-18T13:54:57.236 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev)", 2023-10-18T13:54:57.236 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "34f3475ed6c6b39cd122896e26d95104b6c809dcc4158afee48f92e1da145120", 2023-10-18T13:54:57.236 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2023-10-18T13:54:57.236 INFO:teuthology.orchestra.run.smithi172.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b60cde6693b3225f0a93b57dd34fe281c6ae755adca32bcc00f7ca131ec348" 2023-10-18T13:54:57.237 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2023-10-18T13:54:57.237 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-10-18T13:54:59.682 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2023-10-18T13:54:59.682 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev)", 2023-10-18T13:54:59.682 INFO:teuthology.orchestra.run.smithi158.stdout: "image_id": "34f3475ed6c6b39cd122896e26d95104b6c809dcc4158afee48f92e1da145120", 2023-10-18T13:54:59.682 INFO:teuthology.orchestra.run.smithi158.stdout: "repo_digests": [ 2023-10-18T13:54:59.683 INFO:teuthology.orchestra.run.smithi158.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b60cde6693b3225f0a93b57dd34fe281c6ae755adca32bcc00f7ca131ec348" 2023-10-18T13:54:59.683 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2023-10-18T13:54:59.683 INFO:teuthology.orchestra.run.smithi158.stdout:} 2023-10-18T13:54:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T13:54:59.718 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev)", 2023-10-18T13:54:59.719 INFO:teuthology.orchestra.run.smithi114.stdout: "image_id": "34f3475ed6c6b39cd122896e26d95104b6c809dcc4158afee48f92e1da145120", 2023-10-18T13:54:59.719 INFO:teuthology.orchestra.run.smithi114.stdout: "repo_digests": [ 2023-10-18T13:54:59.719 INFO:teuthology.orchestra.run.smithi114.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b60cde6693b3225f0a93b57dd34fe281c6ae755adca32bcc00f7ca131ec348" 2023-10-18T13:54:59.719 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-10-18T13:54:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T13:54:59.741 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph 2023-10-18T13:54:59.771 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph 2023-10-18T13:54:59.800 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2023-10-18T13:54:59.837 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /etc/ceph 2023-10-18T13:54:59.864 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 777 /etc/ceph 2023-10-18T13:54:59.890 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2023-10-18T13:54:59.923 INFO:tasks.cephadm:Writing seed config... 2023-10-18T13:54:59.924 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-10-18T13:54:59.924 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-10-18T13:54:59.925 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-18T13:54:59.925 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-18T13:54:59.925 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-18T13:54:59.925 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-18T13:54:59.926 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-18T13:54:59.926 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-18T13:54:59.926 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-18T13:54:59.927 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-10-18T13:54:59.927 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-18T13:54:59.927 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-10-18T13:54:59.928 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-10-18T13:54:59.928 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-18T13:54:59.928 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-18T13:54:59.928 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-10-18T13:54:59.929 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-18T13:54:59.929 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-18T13:54:59.929 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-18T13:54:59.930 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-18T13:54:59.930 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-18T13:54:59.930 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-18T13:54:59.931 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-10-18T13:54:59.932 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:54:59.932 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-18T13:54:59.949 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d734b050-6dbd-11ee-8db6-212e2dc638e7 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2023-10-18T13:54:59.950 DEBUG:teuthology.orchestra.run.smithi114:mon.a> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.a.service 2023-10-18T13:54:59.992 DEBUG:teuthology.orchestra.run.smithi114:mgr.x> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.x.service 2023-10-18T13:55:00.017 INFO:journalctl@ceph.mon.a.smithi114.stdout:-- Logs begin at Wed 2023-10-18 13:40:26 UTC. -- 2023-10-18T13:55:00.018 INFO:tasks.cephadm:Bootstrapping... 2023-10-18T13:55:00.018 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb -v bootstrap --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.114 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-18T13:55:00.043 INFO:journalctl@ceph.mgr.x.smithi114.stdout:-- Logs begin at Wed 2023-10-18 13:40:26 UTC. -- 2023-10-18T13:55:00.181 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2023-10-18T13:55:00.181 INFO:teuthology.orchestra.run.smithi114.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', '-v', 'bootstrap', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.114', '--skip-admin-label'] 2023-10-18T13:55:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:/bin/podman: stdout 4.1.1 2023-10-18T13:55:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-18T13:55:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:Verifying podman|docker is present... 2023-10-18T13:55:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:/bin/podman: stdout 4.1.1 2023-10-18T13:55:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:Verifying lvm2 is present... 2023-10-18T13:55:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:Verifying time synchronization is in place... 2023-10-18T13:55:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-18T13:55:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-18T13:55:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-18T13:55:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout inactive 2023-10-18T13:55:00.497 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout enabled 2023-10-18T13:55:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout active 2023-10-18T13:55:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:Unit chronyd.service is enabled and running 2023-10-18T13:55:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:Repeating the final host check... 2023-10-18T13:55:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:/bin/podman: stdout 4.1.1 2023-10-18T13:55:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-18T13:55:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl is present 2023-10-18T13:55:00.649 INFO:teuthology.orchestra.run.smithi114.stdout:lvcreate is present 2023-10-18T13:55:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-18T13:55:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-18T13:55:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-18T13:55:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout inactive 2023-10-18T13:55:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout enabled 2023-10-18T13:55:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout active 2023-10-18T13:55:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:Unit chronyd.service is enabled and running 2023-10-18T13:55:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:Host looks OK 2023-10-18T13:55:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:Cluster fsid: d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:55:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:Acquiring lock 140643026736184 on /run/cephadm/d734b050-6dbd-11ee-8db6-212e2dc638e7.lock 2023-10-18T13:55:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:Lock 140643026736184 acquired on /run/cephadm/d734b050-6dbd-11ee-8db6-212e2dc638e7.lock 2023-10-18T13:55:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:Verifying IP 172.21.15.114 port 3300 ... 2023-10-18T13:55:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:Verifying IP 172.21.15.114 port 6789 ... 2023-10-18T13:55:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:Base mon IP(s) is [172.21.15.114:3300, 172.21.15.114:6789], mon addrv is [v2:172.21.15.114:3300,v1:172.21.15.114:6789] 2023-10-18T13:55:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2023-10-18T13:55:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.114 metric 100 2023-10-18T13:55:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-18T13:55:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2023-10-18T13:55:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2023-10-18T13:55:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-18T13:55:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-18T13:55:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-18T13:55:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-10-18T13:55:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:/sbin/ip: stdout inet6 fe80::c9aa:5699:aa3d:ecf4/64 scope link noprefixroute 2023-10-18T13:55:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-18T13:55:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:Mon IP `172.21.15.114` is in CIDR network `172.21.0.0/20` 2023-10-18T13:55:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:Mon IP `172.21.15.114` is in CIDR network `172.21.0.0/20` 2023-10-18T13:55:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-18T13:55:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-18T13:55:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb... 2023-10-18T13:55:01.129 INFO:teuthology.orchestra.run.smithi114.stdout:/bin/podman: stdout 34f3475ed6c6b39cd122896e26d95104b6c809dcc4158afee48f92e1da145120 2023-10-18T13:55:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb... 2023-10-18T13:55:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:/bin/podman: stderr Getting image source signatures 2023-10-18T13:55:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:/bin/podman: stderr Copying blob sha256:bde102e0dc1fccb96f1164f2fe1ba9d3f5d7242e22d2b672b1db3aedff4d056f 2023-10-18T13:55:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:/bin/podman: stderr Copying blob sha256:8ed15414cb45b8b895a21f106743ceee45272cee0d9e7e5b1f49bd1e877e4a11 2023-10-18T13:55:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:/bin/podman: stderr Copying config sha256:34f3475ed6c6b39cd122896e26d95104b6c809dcc4158afee48f92e1da145120 2023-10-18T13:55:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-18T13:55:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:/bin/podman: stderr Storing signatures 2023-10-18T13:55:02.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph: stdout ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev) 2023-10-18T13:55:02.386 INFO:teuthology.orchestra.run.smithi114.stdout:Ceph version: ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev) 2023-10-18T13:55:02.386 INFO:teuthology.orchestra.run.smithi114.stdout:Extracting ceph user uid/gid from container image... 2023-10-18T13:55:03.135 INFO:teuthology.orchestra.run.smithi114.stdout:stat: stdout 167 167 2023-10-18T13:55:03.135 INFO:teuthology.orchestra.run.smithi114.stdout:Creating initial keys... 2023-10-18T13:55:03.881 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph-authtool: stdout AQC34y9ly+uSHhAAOwbzOG9RFFeVYqLIQWVRtQ== 2023-10-18T13:55:04.629 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph-authtool: stdout AQC44y9lqGDtDxAAVr0AFJ9bPPCxcikHLSn0gA== 2023-10-18T13:55:05.377 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph-authtool: stdout AQC54y9l3r+WABAAOqFeeJlBww9r6z10X2sarg== 2023-10-18T13:55:05.377 INFO:teuthology.orchestra.run.smithi114.stdout:Creating initial monmap... 2023-10-18T13:55:06.223 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-18T13:55:06.224 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-18T13:55:06.224 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:55:06.224 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-18T13:55:06.225 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool for a [v2:172.21.15.114:3300,v1:172.21.15.114:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-18T13:55:06.225 INFO:teuthology.orchestra.run.smithi114.stdout:setting min_mon_release = pacific 2023-10-18T13:55:06.225 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/monmaptool: set fsid to d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:55:06.225 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-18T13:55:06.225 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:55:06.225 INFO:teuthology.orchestra.run.smithi114.stdout:Creating mon... 2023-10-18T13:55:06.973 INFO:teuthology.orchestra.run.smithi114.stdout:create mon.a on 2023-10-18T13:55:07.118 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-18T13:55:07.205 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-18T13:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7.target → /etc/systemd/system/ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7.target. 2023-10-18T13:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7.target → /etc/systemd/system/ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7.target. 2023-10-18T13:55:07.495 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.a 2023-10-18T13:55:07.495 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.a.service: Unit ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.a.service not loaded. 2023-10-18T13:55:07.578 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7.target.wants/ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@.service. 2023-10-18T13:55:07.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:07 smithi114 systemd[1]: Starting Ceph mon.a for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T13:55:08.094 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:07 smithi114 podman[98957]: 2023-10-18T13:55:08.094 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:08 smithi114 bash[98957]: 67d959bacf606d882f7430486b600a4dbf5a2677b00e4c0925090cf5a537ec39 2023-10-18T13:55:08.095 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:08 smithi114 ceph-mon[98997]: mkfs d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:55:08.095 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:08 smithi114 ceph-mon[98997]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-18T13:55:08.180 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-18T13:55:08.180 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout disabled 2023-10-18T13:55:08.187 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-18T13:55:08.187 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout inactive 2023-10-18T13:55:08.187 INFO:teuthology.orchestra.run.smithi114.stdout:firewalld.service is not enabled 2023-10-18T13:55:08.187 INFO:teuthology.orchestra.run.smithi114.stdout:Not possible to enable service . firewalld.service is not available 2023-10-18T13:55:08.188 INFO:teuthology.orchestra.run.smithi114.stdout:Waiting for mon to start... 2023-10-18T13:55:08.188 INFO:teuthology.orchestra.run.smithi114.stdout:Waiting for mon... 2023-10-18T13:55:08.416 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:08 smithi114 systemd[1]: Started Ceph mon.a for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T13:55:09.133 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout cluster: 2023-10-18T13:55:09.135 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout id: d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:55:09.135 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-18T13:55:09.135 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 2023-10-18T13:55:09.135 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout services: 2023-10-18T13:55:09.136 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.666927s) 2023-10-18T13:55:09.136 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-18T13:55:09.136 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-18T13:55:09.136 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 2023-10-18T13:55:09.136 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout data: 2023-10-18T13:55:09.137 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-18T13:55:09.137 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-18T13:55:09.137 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-18T13:55:09.137 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout pgs: 2023-10-18T13:55:09.137 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 2023-10-18T13:55:09.137 INFO:teuthology.orchestra.run.smithi114.stdout:mon is available 2023-10-18T13:55:09.138 INFO:teuthology.orchestra.run.smithi114.stdout:Assimilating anything we can from ceph.conf... 2023-10-18T13:55:09.366 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:09 smithi114 ceph-mon[98997]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-18T13:55:09.366 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:09 smithi114 ceph-mon[98997]: monmap e1: 1 mons at {a=[v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-18T13:55:09.366 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:09 smithi114 ceph-mon[98997]: fsmap 2023-10-18T13:55:09.367 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:09 smithi114 ceph-mon[98997]: osdmap e1: 0 total, 0 up, 0 in 2023-10-18T13:55:09.367 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:09 smithi114 ceph-mon[98997]: mgrmap e1: no daemons active 2023-10-18T13:55:09.367 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:09 smithi114 ceph-mon[98997]: from='client.? 172.21.15.114:0/527785884' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-18T13:55:09.977 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 2023-10-18T13:55:09.977 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout [global] 2023-10-18T13:55:09.977 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout fsid = d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:55:09.977 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.114:3300,v1:172.21.15.114:6789] 2023-10-18T13:55:09.978 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-18T13:55:09.978 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-18T13:55:09.978 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-18T13:55:09.978 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-18T13:55:09.978 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 2023-10-18T13:55:09.979 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-18T13:55:09.979 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-18T13:55:09.979 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 2023-10-18T13:55:09.979 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout [osd] 2023-10-18T13:55:09.979 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-18T13:55:09.980 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-18T13:55:09.980 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-18T13:55:09.980 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-18T13:55:09.980 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-18T13:55:09.980 INFO:teuthology.orchestra.run.smithi114.stdout:Generating new minimal ceph.conf... 2023-10-18T13:55:10.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:10 smithi114 ceph-mon[98997]: from='client.? 172.21.15.114:0/2490478962' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-18T13:55:10.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:10 smithi114 ceph-mon[98997]: from='client.? 172.21.15.114:0/2490478962' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-18T13:55:10.917 INFO:teuthology.orchestra.run.smithi114.stdout:Restarting the monitor... 2023-10-18T13:55:11.252 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:10 smithi114 systemd[1]: Stopping Ceph mon.a for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T13:55:11.252 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:11 smithi114 ceph-mon[98997]: from='client.? 172.21.15.114:0/3547224517' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:55:11.511 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:11 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a[98973]: 2023-10-18T13:55:11.247+0000 7f97b9417700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T13:55:11.511 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:11 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a[98973]: 2023-10-18T13:55:11.247+0000 7f97b9417700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-18T13:55:11.511 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:11 smithi114 bash[99331]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a 2023-10-18T13:55:11.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:11 smithi114 systemd[1]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.a.service: Succeeded. 2023-10-18T13:55:11.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:11 smithi114 systemd[1]: Stopped Ceph mon.a for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T13:55:11.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:11 smithi114 systemd[1]: Starting Ceph mon.a for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T13:55:12.575 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:12 smithi114 podman[99455]: 2023-10-18T13:55:13.275 INFO:teuthology.orchestra.run.smithi114.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-18T13:55:13.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: set uid:gid to 167:167 (ceph:ceph) 2023-10-18T13:55:13.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev), process ceph-mon, pid 7 2023-10-18T13:55:13.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: pidfile_write: ignore empty --pid-file 2023-10-18T13:55:13.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: load: jerasure load: lrc 2023-10-18T13:55:13.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: RocksDB version: 7.9.2 2023-10-18T13:55:13.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Git sha 0 2023-10-18T13:55:13.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Compile date 2023-10-16 22:08:19 2023-10-18T13:55:13.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: DB SUMMARY 2023-10-18T13:55:13.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: DB Session ID: 8EYD2VJY9EF2D3ES892J 2023-10-18T13:55:13.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: CURRENT file: CURRENT 2023-10-18T13:55:13.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: IDENTITY file: IDENTITY 2023-10-18T13:55:13.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-18T13:55:13.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-18T13:55:13.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 89320 ; 2023-10-18T13:55:13.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.error_if_exists: 0 2023-10-18T13:55:13.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.create_if_missing: 0 2023-10-18T13:55:13.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.paranoid_checks: 1 2023-10-18T13:55:13.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-18T13:55:13.593 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-18T13:55:13.593 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-18T13:55:13.593 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.env: 0x55fad7eb7da0 2023-10-18T13:55:13.594 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.fs: PosixFileSystem 2023-10-18T13:55:13.594 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.info_log: 0x55fad9faf660 2023-10-18T13:55:13.594 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_file_opening_threads: 16 2023-10-18T13:55:13.594 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.statistics: (nil) 2023-10-18T13:55:13.595 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.use_fsync: 0 2023-10-18T13:55:13.595 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_log_file_size: 0 2023-10-18T13:55:13.595 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-18T13:55:13.595 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-18T13:55:13.595 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.keep_log_file_num: 1000 2023-10-18T13:55:13.596 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.recycle_log_file_num: 0 2023-10-18T13:55:13.596 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.allow_fallocate: 1 2023-10-18T13:55:13.596 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.allow_mmap_reads: 0 2023-10-18T13:55:13.596 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.allow_mmap_writes: 0 2023-10-18T13:55:13.596 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.use_direct_reads: 0 2023-10-18T13:55:13.597 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-18T13:55:13.597 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.create_missing_column_families: 0 2023-10-18T13:55:13.597 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.db_log_dir: 2023-10-18T13:55:13.597 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.wal_dir: 2023-10-18T13:55:13.597 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-18T13:55:13.598 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-18T13:55:13.598 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-18T13:55:13.598 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-18T13:55:13.598 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-18T13:55:13.599 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-18T13:55:13.599 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.advise_random_on_open: 1 2023-10-18T13:55:13.599 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.db_write_buffer_size: 0 2023-10-18T13:55:13.599 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.write_buffer_manager: 0x55fad9f67360 2023-10-18T13:55:13.599 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-18T13:55:13.600 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-18T13:55:13.600 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-18T13:55:13.600 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.rate_limiter: (nil) 2023-10-18T13:55:13.600 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-18T13:55:13.600 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.wal_recovery_mode: 2 2023-10-18T13:55:13.601 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.enable_thread_tracking: 0 2023-10-18T13:55:13.601 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.enable_pipelined_write: 0 2023-10-18T13:55:13.601 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.unordered_write: 0 2023-10-18T13:55:13.601 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-18T13:55:13.601 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-18T13:55:13.602 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-18T13:55:13.602 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-18T13:55:13.602 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.row_cache: None 2023-10-18T13:55:13.602 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.wal_filter: None 2023-10-18T13:55:13.602 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-18T13:55:13.603 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.allow_ingest_behind: 0 2023-10-18T13:55:13.603 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.two_write_queues: 0 2023-10-18T13:55:13.603 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.manual_wal_flush: 0 2023-10-18T13:55:13.603 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.wal_compression: 0 2023-10-18T13:55:13.603 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.atomic_flush: 0 2023-10-18T13:55:13.603 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-18T13:55:13.604 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-18T13:55:13.604 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-18T13:55:13.604 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.log_readahead_size: 0 2023-10-18T13:55:13.604 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-18T13:55:13.604 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.best_efforts_recovery: 0 2023-10-18T13:55:13.605 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-18T13:55:13.605 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-18T13:55:13.605 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.allow_data_in_errors: 0 2023-10-18T13:55:13.605 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.db_host_id: __hostname__ 2023-10-18T13:55:13.605 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-18T13:55:13.606 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_background_jobs: 2 2023-10-18T13:55:13.606 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_background_compactions: -1 2023-10-18T13:55:13.606 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_subcompactions: 1 2023-10-18T13:55:13.606 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-18T13:55:13.606 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-18T13:55:13.607 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-18T13:55:13.607 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_total_wal_size: 0 2023-10-18T13:55:13.607 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-18T13:55:13.607 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-18T13:55:13.607 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-18T13:55:13.607 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-18T13:55:13.608 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_open_files: -1 2023-10-18T13:55:13.608 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.bytes_per_sync: 0 2023-10-18T13:55:13.608 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-18T13:55:13.608 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-18T13:55:13.608 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compaction_readahead_size: 0 2023-10-18T13:55:13.609 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_background_flushes: -1 2023-10-18T13:55:13.609 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Compression algorithms supported: 2023-10-18T13:55:13.609 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-18T13:55:13.609 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: kZSTD supported: 0 2023-10-18T13:55:13.609 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: kXpressCompression supported: 0 2023-10-18T13:55:13.609 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: kLZ4HCCompression supported: 1 2023-10-18T13:55:13.610 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: kZlibCompression supported: 1 2023-10-18T13:55:13.610 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: kSnappyCompression supported: 1 2023-10-18T13:55:13.610 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: kLZ4Compression supported: 1 2023-10-18T13:55:13.610 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: kBZip2Compression supported: 0 2023-10-18T13:55:13.610 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-18T13:55:13.611 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-18T13:55:13.611 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-18T13:55:13.611 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-18T13:55:13.611 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-18T13:55:13.611 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.merge_operator: 2023-10-18T13:55:13.611 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compaction_filter: None 2023-10-18T13:55:13.612 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compaction_filter_factory: None 2023-10-18T13:55:13.612 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.sst_partitioner_factory: None 2023-10-18T13:55:13.612 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-18T13:55:13.612 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-18T13:55:13.612 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fad9faf760) 2023-10-18T13:55:13.613 INFO:journalctl@ceph.mon.a.smithi114.stdout: cache_index_and_filter_blocks: 1 2023-10-18T13:55:13.613 INFO:journalctl@ceph.mon.a.smithi114.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-18T13:55:13.613 INFO:journalctl@ceph.mon.a.smithi114.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-18T13:55:13.613 INFO:journalctl@ceph.mon.a.smithi114.stdout: pin_top_level_index_and_filter: 1 2023-10-18T13:55:13.614 INFO:journalctl@ceph.mon.a.smithi114.stdout: index_type: 0 2023-10-18T13:55:13.614 INFO:journalctl@ceph.mon.a.smithi114.stdout: data_block_index_type: 0 2023-10-18T13:55:13.614 INFO:journalctl@ceph.mon.a.smithi114.stdout: index_shortening: 1 2023-10-18T13:55:13.614 INFO:journalctl@ceph.mon.a.smithi114.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-18T13:55:13.614 INFO:journalctl@ceph.mon.a.smithi114.stdout: checksum: 4 2023-10-18T13:55:13.615 INFO:journalctl@ceph.mon.a.smithi114.stdout: no_block_cache: 0 2023-10-18T13:55:13.615 INFO:journalctl@ceph.mon.a.smithi114.stdout: block_cache: 0x55fada0051f0 2023-10-18T13:55:13.615 INFO:journalctl@ceph.mon.a.smithi114.stdout: block_cache_name: BinnedLRUCache 2023-10-18T13:55:13.615 INFO:journalctl@ceph.mon.a.smithi114.stdout: block_cache_options: 2023-10-18T13:55:13.615 INFO:journalctl@ceph.mon.a.smithi114.stdout: capacity : 536870912 2023-10-18T13:55:13.616 INFO:journalctl@ceph.mon.a.smithi114.stdout: num_shard_bits : 4 2023-10-18T13:55:13.616 INFO:journalctl@ceph.mon.a.smithi114.stdout: strict_capacity_limit : 0 2023-10-18T13:55:13.616 INFO:journalctl@ceph.mon.a.smithi114.stdout: high_pri_pool_ratio: 0.000 2023-10-18T13:55:13.616 INFO:journalctl@ceph.mon.a.smithi114.stdout: block_cache_compressed: (nil) 2023-10-18T13:55:13.616 INFO:journalctl@ceph.mon.a.smithi114.stdout: persistent_cache: (nil) 2023-10-18T13:55:13.617 INFO:journalctl@ceph.mon.a.smithi114.stdout: block_size: 4096 2023-10-18T13:55:13.617 INFO:journalctl@ceph.mon.a.smithi114.stdout: block_size_deviation: 10 2023-10-18T13:55:13.617 INFO:journalctl@ceph.mon.a.smithi114.stdout: block_restart_interval: 16 2023-10-18T13:55:13.617 INFO:journalctl@ceph.mon.a.smithi114.stdout: index_block_restart_interval: 1 2023-10-18T13:55:13.617 INFO:journalctl@ceph.mon.a.smithi114.stdout: metadata_block_size: 4096 2023-10-18T13:55:13.618 INFO:journalctl@ceph.mon.a.smithi114.stdout: partition_filters: 0 2023-10-18T13:55:13.618 INFO:journalctl@ceph.mon.a.smithi114.stdout: use_delta_encoding: 1 2023-10-18T13:55:13.618 INFO:journalctl@ceph.mon.a.smithi114.stdout: filter_policy: bloomfilter 2023-10-18T13:55:13.618 INFO:journalctl@ceph.mon.a.smithi114.stdout: whole_key_filtering: 1 2023-10-18T13:55:13.618 INFO:journalctl@ceph.mon.a.smithi114.stdout: verify_compression: 0 2023-10-18T13:55:13.618 INFO:journalctl@ceph.mon.a.smithi114.stdout: read_amp_bytes_per_bit: 0 2023-10-18T13:55:13.619 INFO:journalctl@ceph.mon.a.smithi114.stdout: format_version: 5 2023-10-18T13:55:13.619 INFO:journalctl@ceph.mon.a.smithi114.stdout: enable_index_compression: 1 2023-10-18T13:55:13.619 INFO:journalctl@ceph.mon.a.smithi114.stdout: block_align: 0 2023-10-18T13:55:13.619 INFO:journalctl@ceph.mon.a.smithi114.stdout: max_auto_readahead_size: 262144 2023-10-18T13:55:13.619 INFO:journalctl@ceph.mon.a.smithi114.stdout: prepopulate_block_cache: 0 2023-10-18T13:55:13.620 INFO:journalctl@ceph.mon.a.smithi114.stdout: initial_auto_readahead_size: 8192 2023-10-18T13:55:13.620 INFO:journalctl@ceph.mon.a.smithi114.stdout: num_file_reads_for_auto_readahead: 2 2023-10-18T13:55:13.620 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.write_buffer_size: 33554432 2023-10-18T13:55:13.620 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_write_buffer_number: 2 2023-10-18T13:55:13.620 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compression: NoCompression 2023-10-18T13:55:13.620 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.bottommost_compression: Disabled 2023-10-18T13:55:13.621 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.prefix_extractor: nullptr 2023-10-18T13:55:13.621 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-18T13:55:13.621 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.num_levels: 7 2023-10-18T13:55:13.621 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-18T13:55:13.621 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-18T13:55:13.622 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-18T13:55:13.622 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-18T13:55:13.622 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-18T13:55:13.622 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-18T13:55:13.622 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-18T13:55:13.623 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-18T13:55:13.624 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-18T13:55:13.624 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-18T13:55:13.624 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-18T13:55:13.625 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-18T13:55:13.625 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-18T13:55:13.625 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compression_opts.level: 32767 2023-10-18T13:55:13.625 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compression_opts.strategy: 0 2023-10-18T13:55:13.626 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-18T13:55:13.626 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-18T13:55:13.626 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-18T13:55:13.626 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-18T13:55:13.626 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compression_opts.enabled: false 2023-10-18T13:55:13.627 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-18T13:55:13.627 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-18T13:55:13.627 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-18T13:55:13.627 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-18T13:55:13.627 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.target_file_size_base: 67108864 2023-10-18T13:55:13.627 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-18T13:55:13.628 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-18T13:55:13.628 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-18T13:55:13.628 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-18T13:55:13.628 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-18T13:55:13.628 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-18T13:55:13.628 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-18T13:55:13.629 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-18T13:55:13.629 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-18T13:55:13.629 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-18T13:55:13.629 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-18T13:55:13.630 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-18T13:55:13.630 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-18T13:55:13.630 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-18T13:55:13.630 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.arena_block_size: 1048576 2023-10-18T13:55:13.630 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-18T13:55:13.631 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-18T13:55:13.631 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.disable_auto_compactions: 0 2023-10-18T13:55:13.631 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-18T13:55:13.631 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-18T13:55:13.631 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-18T13:55:13.632 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-18T13:55:13.632 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-18T13:55:13.632 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-18T13:55:13.632 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-18T13:55:13.632 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-18T13:55:13.633 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-18T13:55:13.633 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-18T13:55:13.633 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.table_properties_collectors: 2023-10-18T13:55:13.633 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.inplace_update_support: 0 2023-10-18T13:55:13.633 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-18T13:55:13.633 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-18T13:55:13.634 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-18T13:55:13.634 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-18T13:55:13.634 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.bloom_locality: 0 2023-10-18T13:55:13.634 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.max_successive_merges: 0 2023-10-18T13:55:13.634 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-18T13:55:13.635 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.paranoid_file_checks: 0 2023-10-18T13:55:13.635 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.force_consistency_checks: 1 2023-10-18T13:55:13.635 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.report_bg_io_stats: 0 2023-10-18T13:55:13.635 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.ttl: 2592000 2023-10-18T13:55:13.635 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-18T13:55:13.636 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-18T13:55:13.636 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-18T13:55:13.636 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.enable_blob_files: false 2023-10-18T13:55:13.636 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.min_blob_size: 0 2023-10-18T13:55:13.636 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.blob_file_size: 268435456 2023-10-18T13:55:13.637 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-18T13:55:13.637 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-18T13:55:13.637 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-18T13:55:13.637 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-18T13:55:13.637 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-18T13:55:13.637 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.blob_file_starting_level: 0 2023-10-18T13:55:13.638 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-18T13:55:13.638 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-18T13:55:13.638 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-18T13:55:13.638 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7100a6fb-3d16-4bd7-960b-e6494b3b6b36 2023-10-18T13:55:13.638 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697637313140334, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-18T13:55:13.639 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-18T13:55:13.639 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697637313141350, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 85545, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 272, "table_properties": {"data_size": 83648, "index_size": 243, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11231, "raw_average_key_size": 48, "raw_value_size": 77337, "raw_average_value_size": 334, "num_data_blocks": 10, "num_entries": 231, "num_filter_entries": 231, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1697637313, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7100a6fb-3d16-4bd7-960b-e6494b3b6b36", "db_session_id": "8EYD2VJY9EF2D3ES892J", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-18T13:55:13.639 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697637313141428, "job": 1, "event": "recovery_finished"} 2023-10-18T13:55:13.639 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-18T13:55:13.639 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-18T13:55:13.640 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fada0a2000 2023-10-18T13:55:13.640 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: DB pointer 0x55fada08e000 2023-10-18T13:55:13.640 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-18T13:55:13.640 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-18T13:55:13.640 INFO:journalctl@ceph.mon.a.smithi114.stdout: ** DB Stats ** 2023-10-18T13:55:13.641 INFO:journalctl@ceph.mon.a.smithi114.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T13:55:13.641 INFO:journalctl@ceph.mon.a.smithi114.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-18T13:55:13.641 INFO:journalctl@ceph.mon.a.smithi114.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-18T13:55:13.641 INFO:journalctl@ceph.mon.a.smithi114.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T13:55:13.641 INFO:journalctl@ceph.mon.a.smithi114.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-18T13:55:13.642 INFO:journalctl@ceph.mon.a.smithi114.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-18T13:55:13.642 INFO:journalctl@ceph.mon.a.smithi114.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T13:55:13.642 INFO:journalctl@ceph.mon.a.smithi114.stdout: 2023-10-18T13:55:13.642 INFO:journalctl@ceph.mon.a.smithi114.stdout: ** Compaction Stats [default] ** 2023-10-18T13:55:13.642 INFO:journalctl@ceph.mon.a.smithi114.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-18T13:55:13.643 INFO:journalctl@ceph.mon.a.smithi114.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-18T13:55:13.643 INFO:journalctl@ceph.mon.a.smithi114.stdout: L0 2/0 85.38 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-18T13:55:13.643 INFO:journalctl@ceph.mon.a.smithi114.stdout: Sum 2/0 85.38 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-18T13:55:13.643 INFO:journalctl@ceph.mon.a.smithi114.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-18T13:55:13.643 INFO:journalctl@ceph.mon.a.smithi114.stdout: 2023-10-18T13:55:13.644 INFO:journalctl@ceph.mon.a.smithi114.stdout: ** Compaction Stats [default] ** 2023-10-18T13:55:13.644 INFO:journalctl@ceph.mon.a.smithi114.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-18T13:55:13.644 INFO:journalctl@ceph.mon.a.smithi114.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T13:55:13.644 INFO:journalctl@ceph.mon.a.smithi114.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 118.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-18T13:55:13.644 INFO:journalctl@ceph.mon.a.smithi114.stdout: 2023-10-18T13:55:13.644 INFO:journalctl@ceph.mon.a.smithi114.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-18T13:55:13.645 INFO:journalctl@ceph.mon.a.smithi114.stdout: 2023-10-18T13:55:13.645 INFO:journalctl@ceph.mon.a.smithi114.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T13:55:13.645 INFO:journalctl@ceph.mon.a.smithi114.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-18T13:55:13.645 INFO:journalctl@ceph.mon.a.smithi114.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-18T13:55:13.645 INFO:journalctl@ceph.mon.a.smithi114.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-18T13:55:13.646 INFO:journalctl@ceph.mon.a.smithi114.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-18T13:55:13.646 INFO:journalctl@ceph.mon.a.smithi114.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-18T13:55:13.646 INFO:journalctl@ceph.mon.a.smithi114.stdout: Cumulative compaction: 0.00 GB write, 14.07 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T13:55:13.646 INFO:journalctl@ceph.mon.a.smithi114.stdout: Interval compaction: 0.00 GB write, 14.07 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T13:55:13.647 INFO:journalctl@ceph.mon.a.smithi114.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-18T13:55:13.647 INFO:journalctl@ceph.mon.a.smithi114.stdout: Block cache BinnedLRUCache@0x55fada0051f0#7 capacity: 512.00 MB usage: 1.27 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-10-18T13:55:13.647 INFO:journalctl@ceph.mon.a.smithi114.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2023-10-18T13:55:13.647 INFO:journalctl@ceph.mon.a.smithi114.stdout: 2023-10-18T13:55:13.647 INFO:journalctl@ceph.mon.a.smithi114.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-18T13:55:13.648 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: starting mon.a rank 0 at public addrs [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] at bind addrs [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:55:13.648 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: mon.a@-1(???) e1 preinit fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:55:13.648 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: mon.a@-1(???).mds e1 new map 2023-10-18T13:55:13.648 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: mon.a@-1(???).mds e1 print_map 2023-10-18T13:55:13.648 INFO:journalctl@ceph.mon.a.smithi114.stdout: e1 2023-10-18T13:55:13.648 INFO:journalctl@ceph.mon.a.smithi114.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T13:55:13.649 INFO:journalctl@ceph.mon.a.smithi114.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-18T13:55:13.649 INFO:journalctl@ceph.mon.a.smithi114.stdout: legacy client fscid: -1 2023-10-18T13:55:13.649 INFO:journalctl@ceph.mon.a.smithi114.stdout: 2023-10-18T13:55:13.649 INFO:journalctl@ceph.mon.a.smithi114.stdout: No filesystems configured 2023-10-18T13:55:13.649 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-18T13:55:13.650 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T13:55:13.650 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T13:55:13.650 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T13:55:13.650 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-18T13:55:13.650 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-18T13:55:13.651 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: monmap e1: 1 mons at {a=[v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-18T13:55:13.651 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: fsmap 2023-10-18T13:55:13.651 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: osdmap e1: 0 total, 0 up, 0 in 2023-10-18T13:55:13.651 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 ceph-mon[99494]: mgrmap e1: no daemons active 2023-10-18T13:55:13.651 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 bash[99455]: 834e592ee78183fe81c5c031e4c50cb94fedc4acaefcb525cca09ba5737ebea5 2023-10-18T13:55:13.652 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:13 smithi114 systemd[1]: Started Ceph mon.a for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T13:55:15.128 INFO:teuthology.orchestra.run.smithi114.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-18T13:55:15.158 INFO:teuthology.orchestra.run.smithi114.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-18T13:55:15.158 INFO:teuthology.orchestra.run.smithi114.stdout:Creating mgr... 2023-10-18T13:55:15.159 INFO:teuthology.orchestra.run.smithi114.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-18T13:55:15.159 INFO:teuthology.orchestra.run.smithi114.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-18T13:55:15.351 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.x 2023-10-18T13:55:15.351 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.x.service: Unit ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.x.service not loaded. 2023-10-18T13:55:15.440 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7.target.wants/ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@.service. 2023-10-18T13:55:15.736 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:15 smithi114 systemd[1]: Starting Ceph mgr.x for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T13:55:15.990 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:15 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3864638648' entity='client.admin' 2023-10-18T13:55:15.991 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:15 smithi114 podman[99721]: 2023-10-18T13:55:16.046 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-18T13:55:16.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout disabled 2023-10-18T13:55:16.053 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-18T13:55:16.053 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout inactive 2023-10-18T13:55:16.053 INFO:teuthology.orchestra.run.smithi114.stdout:firewalld.service is not enabled 2023-10-18T13:55:16.053 INFO:teuthology.orchestra.run.smithi114.stdout:Not possible to enable service . firewalld.service is not available 2023-10-18T13:55:16.061 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-18T13:55:16.061 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout disabled 2023-10-18T13:55:16.068 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-18T13:55:16.069 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout inactive 2023-10-18T13:55:16.069 INFO:teuthology.orchestra.run.smithi114.stdout:firewalld.service is not enabled 2023-10-18T13:55:16.069 INFO:teuthology.orchestra.run.smithi114.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-18T13:55:16.069 INFO:teuthology.orchestra.run.smithi114.stdout:Waiting for mgr to start... 2023-10-18T13:55:16.070 INFO:teuthology.orchestra.run.smithi114.stdout:Waiting for mgr... 2023-10-18T13:55:16.285 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:15 smithi114 bash[99721]: 001ab3146b0b25fe01e5b33accd07d32b02f7d3c8e461c2e15a9e3f9090c2eb3 2023-10-18T13:55:16.286 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:16 smithi114 systemd[1]: Started Ceph mgr.x for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T13:55:16.286 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:16 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:16.116+0000 7f676ab99200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-18T13:55:16.286 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:16 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:16.198+0000 7f676ab99200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T13:55:16.577 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:16 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:16.295+0000 7f676ab99200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T13:55:16.578 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:16 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:16.394+0000 7f676ab99200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T13:55:16.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:16 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/712251794' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-18T13:55:16.839 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:16 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:16.573+0000 7f676ab99200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T13:55:17.017 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 2023-10-18T13:55:17.018 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout { 2023-10-18T13:55:17.018 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T13:55:17.018 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "health": { 2023-10-18T13:55:17.018 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-18T13:55:17.019 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-18T13:55:17.019 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-18T13:55:17.019 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:17.019 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-18T13:55:17.019 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-18T13:55:17.019 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 0 2023-10-18T13:55:17.020 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout ], 2023-10-18T13:55:17.020 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-18T13:55:17.020 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "a" 2023-10-18T13:55:17.020 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout ], 2023-10-18T13:55:17.020 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-10-18T13:55:17.021 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-18T13:55:17.021 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:17.021 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-18T13:55:17.021 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-18T13:55:17.021 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:17.022 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-18T13:55:17.022 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:17.022 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-18T13:55:17.022 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-18T13:55:17.022 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-18T13:55:17.023 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-18T13:55:17.026 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-18T13:55:17.026 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-18T13:55:17.026 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:17.026 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-18T13:55:17.027 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-18T13:55:17.027 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-18T13:55:17.027 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-18T13:55:17.027 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-18T13:55:17.027 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-18T13:55:17.028 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-18T13:55:17.028 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-18T13:55:17.028 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-18T13:55:17.028 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:17.028 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-18T13:55:17.029 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:17.029 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-18T13:55:17.029 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-18T13:55:17.029 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:17.029 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-18T13:55:17.030 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-18T13:55:17.030 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-18T13:55:17.030 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-18T13:55:17.030 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-18T13:55:17.030 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-18T13:55:17.031 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "restful" 2023-10-18T13:55:17.031 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout ], 2023-10-18T13:55:17.031 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-18T13:55:17.031 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:17.031 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-18T13:55:17.032 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:17.032 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "modified": "2023-10-18T13:55:08.087162+0000", 2023-10-18T13:55:17.032 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-18T13:55:17.032 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:17.032 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-18T13:55:17.033 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout } 2023-10-18T13:55:17.033 INFO:teuthology.orchestra.run.smithi114.stdout:mgr not available, waiting (1/15)... 2023-10-18T13:55:17.270 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:16 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:16.953+0000 7f676ab99200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T13:55:17.270 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:17 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:17.085+0000 7f676ab99200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T13:55:17.271 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:17 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:17.173+0000 7f676ab99200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T13:55:17.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:17 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:17.266+0000 7f676ab99200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T13:55:18.088 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:17 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:17.691+0000 7f676ab99200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T13:55:18.838 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:18 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:18.347+0000 7f676ab99200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-18T13:55:18.838 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:18 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:18.427+0000 7f676ab99200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T13:55:19.500 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:19 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:19.205+0000 7f676ab99200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T13:55:19.500 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:19 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:19.308+0000 7f676ab99200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-18T13:55:19.804 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:19 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/373008929' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-18T13:55:19.805 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:19 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:19.496+0000 7f676ab99200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T13:55:20.078 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 2023-10-18T13:55:20.078 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout { 2023-10-18T13:55:20.079 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T13:55:20.079 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "health": { 2023-10-18T13:55:20.079 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-18T13:55:20.079 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-18T13:55:20.079 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-18T13:55:20.080 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:20.080 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-18T13:55:20.080 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-18T13:55:20.080 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 0 2023-10-18T13:55:20.080 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout ], 2023-10-18T13:55:20.081 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-18T13:55:20.081 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "a" 2023-10-18T13:55:20.081 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout ], 2023-10-18T13:55:20.081 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2023-10-18T13:55:20.081 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-18T13:55:20.082 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:20.082 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-18T13:55:20.082 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-18T13:55:20.082 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:20.083 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-18T13:55:20.083 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:20.083 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-18T13:55:20.083 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-18T13:55:20.083 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-18T13:55:20.084 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-18T13:55:20.084 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-18T13:55:20.084 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-18T13:55:20.084 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:20.084 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-18T13:55:20.085 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-18T13:55:20.085 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-18T13:55:20.085 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-18T13:55:20.085 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-18T13:55:20.085 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-18T13:55:20.086 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-18T13:55:20.086 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-18T13:55:20.086 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-18T13:55:20.086 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:20.086 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-18T13:55:20.087 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:20.089 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-18T13:55:20.089 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-18T13:55:20.090 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:20.090 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-18T13:55:20.090 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-18T13:55:20.090 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-18T13:55:20.090 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-18T13:55:20.091 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-18T13:55:20.091 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-18T13:55:20.091 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "restful" 2023-10-18T13:55:20.091 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout ], 2023-10-18T13:55:20.091 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-18T13:55:20.092 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:20.092 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-18T13:55:20.092 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:20.092 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "modified": "2023-10-18T13:55:08.087162+0000", 2023-10-18T13:55:20.092 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-18T13:55:20.093 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:20.093 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-18T13:55:20.093 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout } 2023-10-18T13:55:20.093 INFO:teuthology.orchestra.run.smithi114.stdout:mgr not available, waiting (2/15)... 2023-10-18T13:55:20.094 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:19 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:19.800+0000 7f676ab99200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-18T13:55:20.094 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:20 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:20.030+0000 7f676ab99200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T13:55:20.338 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:20 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:20.178+0000 7f676ab99200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T13:55:20.838 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:20 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:20.439+0000 7f676ab99200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T13:55:21.458 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:21 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:21.132+0000 7f676ab99200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T13:55:21.458 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:21 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:21.262+0000 7f676ab99200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-18T13:55:21.789 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:21 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:21.454+0000 7f676ab99200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T13:55:21.789 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:21 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:21.568+0000 7f676ab99200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T13:55:22.088 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:21 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:21.785+0000 7f676ab99200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T13:55:22.887 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:22 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3956839637' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-18T13:55:22.888 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:22 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:22.679+0000 7f676ab99200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T13:55:22.921 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 2023-10-18T13:55:22.921 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout { 2023-10-18T13:55:22.921 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T13:55:22.922 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "health": { 2023-10-18T13:55:22.922 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-18T13:55:22.922 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-18T13:55:22.922 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-18T13:55:22.922 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:22.923 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-18T13:55:22.923 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-18T13:55:22.923 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 0 2023-10-18T13:55:22.923 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout ], 2023-10-18T13:55:22.923 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-18T13:55:22.924 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "a" 2023-10-18T13:55:22.924 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout ], 2023-10-18T13:55:22.924 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2023-10-18T13:55:22.924 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-18T13:55:22.924 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:22.925 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-18T13:55:22.925 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-18T13:55:22.925 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:22.925 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-18T13:55:22.925 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:22.925 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-18T13:55:22.926 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-18T13:55:22.926 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-18T13:55:22.926 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-18T13:55:22.930 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-18T13:55:22.930 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-18T13:55:22.930 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:22.930 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-18T13:55:22.931 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-18T13:55:22.931 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-18T13:55:22.931 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-18T13:55:22.931 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-18T13:55:22.931 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-18T13:55:22.932 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-18T13:55:22.932 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-18T13:55:22.932 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-18T13:55:22.932 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:22.932 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-18T13:55:22.933 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:22.933 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-18T13:55:22.933 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-18T13:55:22.933 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:22.933 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-18T13:55:22.934 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-18T13:55:22.934 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-18T13:55:22.936 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-18T13:55:22.936 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-18T13:55:22.936 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-18T13:55:22.936 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "restful" 2023-10-18T13:55:22.936 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout ], 2023-10-18T13:55:22.937 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-18T13:55:22.937 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:22.937 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-18T13:55:22.937 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:22.937 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "modified": "2023-10-18T13:55:08.087162+0000", 2023-10-18T13:55:22.938 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-18T13:55:22.938 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:22.938 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-18T13:55:22.938 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout } 2023-10-18T13:55:22.938 INFO:teuthology.orchestra.run.smithi114.stdout:mgr not available, waiting (3/15)... 2023-10-18T13:55:24.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:23 smithi114 ceph-mon[99494]: Activating manager daemon x 2023-10-18T13:55:24.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:23 smithi114 ceph-mon[99494]: mgrmap e2: x(active, starting, since 0.00289257s) 2023-10-18T13:55:24.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:23 smithi114 ceph-mon[99494]: from='mgr.14100 172.21.15.114:0/440534484' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T13:55:24.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:23 smithi114 ceph-mon[99494]: from='mgr.14100 172.21.15.114:0/440534484' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T13:55:24.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:23 smithi114 ceph-mon[99494]: from='mgr.14100 172.21.15.114:0/440534484' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T13:55:24.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:23 smithi114 ceph-mon[99494]: from='mgr.14100 172.21.15.114:0/440534484' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:55:24.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:23 smithi114 ceph-mon[99494]: from='mgr.14100 172.21.15.114:0/440534484' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-18T13:55:24.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:23 smithi114 ceph-mon[99494]: Manager daemon x is now available 2023-10-18T13:55:24.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:23 smithi114 ceph-mon[99494]: from='mgr.14100 172.21.15.114:0/440534484' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-18T13:55:24.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:23 smithi114 ceph-mon[99494]: from='mgr.14100 172.21.15.114:0/440534484' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-18T13:55:24.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:23 smithi114 ceph-mon[99494]: from='mgr.14100 172.21.15.114:0/440534484' entity='mgr.x' 2023-10-18T13:55:24.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:23 smithi114 ceph-mon[99494]: from='mgr.14100 172.21.15.114:0/440534484' entity='mgr.x' 2023-10-18T13:55:24.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:23 smithi114 ceph-mon[99494]: from='mgr.14100 172.21.15.114:0/440534484' entity='mgr.x' 2023-10-18T13:55:25.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:24 smithi114 ceph-mon[99494]: mgrmap e3: x(active, since 1.00662s) 2023-10-18T13:55:27.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:26 smithi114 ceph-mon[99494]: mgrmap e4: x(active, since 3s) 2023-10-18T13:55:28.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:27 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1033574930' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-18T13:55:30.689 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 2023-10-18T13:55:30.689 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout { 2023-10-18T13:55:30.689 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T13:55:30.690 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "health": { 2023-10-18T13:55:30.690 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-18T13:55:30.690 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-18T13:55:30.690 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-18T13:55:30.691 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:30.691 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-18T13:55:30.691 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-18T13:55:30.691 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 0 2023-10-18T13:55:30.691 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout ], 2023-10-18T13:55:30.692 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-18T13:55:30.692 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "a" 2023-10-18T13:55:30.692 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout ], 2023-10-18T13:55:30.692 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2023-10-18T13:55:30.692 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-18T13:55:30.693 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:30.693 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-18T13:55:30.693 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-18T13:55:30.693 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:30.693 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-18T13:55:30.694 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:30.694 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-18T13:55:30.694 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-18T13:55:30.694 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-18T13:55:30.694 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-18T13:55:30.698 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-18T13:55:30.698 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-18T13:55:30.698 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:30.698 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-18T13:55:30.699 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-18T13:55:30.699 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-18T13:55:30.699 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-18T13:55:30.699 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-18T13:55:30.699 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-18T13:55:30.700 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-18T13:55:30.700 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-18T13:55:30.700 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-18T13:55:30.700 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:30.700 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-18T13:55:30.700 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:30.701 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-18T13:55:30.701 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-18T13:55:30.701 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:30.701 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-18T13:55:30.702 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-18T13:55:30.702 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-18T13:55:30.702 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-18T13:55:30.702 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-18T13:55:30.702 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-18T13:55:30.703 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "restful" 2023-10-18T13:55:30.703 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout ], 2023-10-18T13:55:30.703 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-18T13:55:30.703 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:30.703 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-18T13:55:30.704 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-18T13:55:30.704 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "modified": "2023-10-18T13:55:08.087162+0000", 2023-10-18T13:55:30.704 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-18T13:55:30.704 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout }, 2023-10-18T13:55:30.704 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-18T13:55:30.705 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout } 2023-10-18T13:55:30.705 INFO:teuthology.orchestra.run.smithi114.stdout:mgr is available 2023-10-18T13:55:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:32 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2328202189' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-18T13:55:34.946 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 2023-10-18T13:55:34.947 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout [global] 2023-10-18T13:55:34.947 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout fsid = d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:55:34.947 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-18T13:55:34.947 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-18T13:55:34.948 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-18T13:55:34.948 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-18T13:55:34.948 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 2023-10-18T13:55:34.948 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-18T13:55:34.948 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-18T13:55:34.949 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 2023-10-18T13:55:34.949 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout [osd] 2023-10-18T13:55:34.949 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-18T13:55:34.949 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-18T13:55:34.949 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-18T13:55:34.950 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-18T13:55:34.950 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-18T13:55:34.950 INFO:teuthology.orchestra.run.smithi114.stdout:Enabling cephadm module... 2023-10-18T13:55:36.199 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:35 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: ignoring --setuser ceph since I am not root 2023-10-18T13:55:36.200 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:35 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: ignoring --setgroup ceph since I am not root 2023-10-18T13:55:36.200 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:36 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:36.028+0000 7fbbaac97200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-18T13:55:36.200 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:36 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:36.108+0000 7fbbaac97200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T13:55:36.200 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:35 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2884312952' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-18T13:55:36.453 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:36 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:36.200+0000 7fbbaac97200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T13:55:36.453 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:36 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:36.300+0000 7fbbaac97200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T13:55:36.838 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:36 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:36.479+0000 7fbbaac97200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T13:55:37.197 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:36 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2884312952' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-18T13:55:37.197 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:36 smithi114 ceph-mon[99494]: mgrmap e5: x(active, since 13s) 2023-10-18T13:55:37.198 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:36 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:36.862+0000 7fbbaac97200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T13:55:37.198 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:37 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:37.002+0000 7fbbaac97200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T13:55:37.198 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:37 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:37.097+0000 7fbbaac97200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T13:55:37.336 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout { 2023-10-18T13:55:37.336 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-18T13:55:37.336 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-18T13:55:37.336 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-18T13:55:37.337 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-18T13:55:37.337 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout } 2023-10-18T13:55:37.337 INFO:teuthology.orchestra.run.smithi114.stdout:Waiting for the mgr to restart... 2023-10-18T13:55:37.337 INFO:teuthology.orchestra.run.smithi114.stdout:Waiting for mgr epoch 5... 2023-10-18T13:55:37.519 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:37 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:37.194+0000 7fbbaac97200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T13:55:37.838 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:37 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:37.633+0000 7fbbaac97200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T13:55:38.296 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:37 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2031639774' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-18T13:55:38.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:38 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:38.292+0000 7fbbaac97200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-18T13:55:38.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:38 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:38.374+0000 7fbbaac97200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T13:55:39.403 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:39 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:39.138+0000 7fbbaac97200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T13:55:39.404 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:39 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:39.228+0000 7fbbaac97200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-18T13:55:39.680 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:39 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:39.400+0000 7fbbaac97200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T13:55:40.049 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:39 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:39.676+0000 7fbbaac97200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-18T13:55:40.050 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:39 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:39.900+0000 7fbbaac97200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T13:55:40.310 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:40 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:40.045+0000 7fbbaac97200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T13:55:40.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:40 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:40.306+0000 7fbbaac97200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T13:55:41.325 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:41 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:40.999+0000 7fbbaac97200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T13:55:41.325 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:41 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:41.128+0000 7fbbaac97200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-18T13:55:41.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:41 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:41.321+0000 7fbbaac97200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T13:55:41.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:41 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:41.434+0000 7fbbaac97200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T13:55:42.088 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:41 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:41.650+0000 7fbbaac97200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T13:55:42.838 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:42.507+0000 7fbbaac97200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T13:55:42.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: Active manager daemon x restarted 2023-10-18T13:55:42.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: Activating manager daemon x 2023-10-18T13:55:42.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: osdmap e2: 0 total, 0 up, 0 in 2023-10-18T13:55:42.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: mgrmap e6: x(active, starting, since 0.00327139s) 2023-10-18T13:55:42.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:55:42.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-18T13:55:42.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T13:55:42.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T13:55:42.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T13:55:42.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: Manager daemon x is now available 2023-10-18T13:55:42.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:42.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:42.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:55:42.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:55:42.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:42 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:55:43.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:43 smithi114 ceph-mon[99494]: Found migration_current of "None". Setting to last migration. 2023-10-18T13:55:43.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:43 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-18T13:55:43.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:43 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-18T13:55:43.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:43 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:43.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:43 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:43.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:43 smithi114 ceph-mon[99494]: mgrmap e7: x(active, since 1.00556s) 2023-10-18T13:55:43.889 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout { 2023-10-18T13:55:43.889 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-18T13:55:43.890 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-18T13:55:43.890 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout } 2023-10-18T13:55:43.890 INFO:teuthology.orchestra.run.smithi114.stdout:mgr epoch 5 is available 2023-10-18T13:55:43.890 INFO:teuthology.orchestra.run.smithi114.stdout:Setting orchestrator backend to cephadm... 2023-10-18T13:55:44.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:44 smithi114 ceph-mon[99494]: [18/Oct/2023:13:55:43] ENGINE Bus STARTING 2023-10-18T13:55:44.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:44 smithi114 ceph-mon[99494]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-18T13:55:44.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:44 smithi114 ceph-mon[99494]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-18T13:55:44.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:44 smithi114 ceph-mon[99494]: [18/Oct/2023:13:55:43] ENGINE Serving on https://172.21.15.114:7150 2023-10-18T13:55:44.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:44 smithi114 ceph-mon[99494]: [18/Oct/2023:13:55:43] ENGINE Serving on http://172.21.15.114:8765 2023-10-18T13:55:44.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:44 smithi114 ceph-mon[99494]: [18/Oct/2023:13:55:43] ENGINE Bus STARTED 2023-10-18T13:55:44.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:44 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:55:44.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:44 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:45.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:45 smithi114 ceph-mon[99494]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:55:45.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:45 smithi114 ceph-mon[99494]: mgrmap e8: x(active, since 2s) 2023-10-18T13:55:45.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:45 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:55:46.168 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-18T13:55:46.169 INFO:teuthology.orchestra.run.smithi114.stdout:Generating ssh key... 2023-10-18T13:55:46.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-mon[99494]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:55:47.238 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: Generating public/private rsa key pair. 2023-10-18T13:55:47.239 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: Your identification has been saved in /tmp/tmpl2tu12v0/key. 2023-10-18T13:55:47.239 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: Your public key has been saved in /tmp/tmpl2tu12v0/key.pub. 2023-10-18T13:55:47.239 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: The key fingerprint is: 2023-10-18T13:55:47.240 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: SHA256:07ZubJHRlginRHKew5o2DDAguUsIrZ8t6pIIKGb3Y2s ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:55:47.240 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: The key's randomart image is: 2023-10-18T13:55:47.240 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: +---[RSA 3072]----+ 2023-10-18T13:55:47.240 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: |o+o ..o | 2023-10-18T13:55:47.240 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: |+ .o =o.. | 2023-10-18T13:55:47.241 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: |oo . .=+ o . | 2023-10-18T13:55:47.241 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: |+. o o.oo + | 2023-10-18T13:55:47.241 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: |oo o * S o+ | 2023-10-18T13:55:47.241 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: |=o+... . oo. | 2023-10-18T13:55:47.241 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: |*o... ... | 2023-10-18T13:55:47.241 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: |= E .+ | 2023-10-18T13:55:47.242 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: |o. o.o o. | 2023-10-18T13:55:47.242 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: +----[SHA256]-----+ 2023-10-18T13:55:48.232 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:47 smithi114 ceph-mon[99494]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:55:48.233 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:47 smithi114 ceph-mon[99494]: Generating ssh key... 2023-10-18T13:55:48.233 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:47 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:48.233 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:47 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:48.249 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAl1192p16S22r77qE/iAbdpyiOHoGHZB5rMNfxmZ+5JjP8IAz2syV4De8BEpUuV9aWKH/OrYCvmpyxatznnhEKqcK0jbcLstDQyxhERJAczCHC8dAtYJlRWBnh5GWooyNyELJkIZulHzu3cjlFGWK0fXpgpfxvZ/bwEMKVZfvuB+0xgs2+B7uRTP5VJW7Q/7yNrMJG7egRJTEIwLM+u/mGNupashkfPO6gILeTqPPEF1KcVMUvugqqED0T4zW3IdE67WlZ4mtZL3FxRFXLcuizCj5hFkRKDz5lt3XkRy+0nhzgKbu6sBeS0i5FvMiQdPu8EYz/RdfXQa2zIafya115/LsU50g/ZKEMK7DSdFkhdFHQa4Eutb79iUQHv+8AREf6XCgMjbrHFrZyVXomC1ALZWaXrWezYTWLMiVsw2FY/fw6iPIB7d7WevXxJUOElof4KoI6EPXYCw+WyFgbIS8ZoQygpyPTj1Mw9nYTWOg5aXPPo2rw//oCk2V7yLyzWs= ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:55:48.249 INFO:teuthology.orchestra.run.smithi114.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-18T13:55:48.250 INFO:teuthology.orchestra.run.smithi114.stdout:Adding key to root@localhost authorized_keys... 2023-10-18T13:55:48.251 INFO:teuthology.orchestra.run.smithi114.stdout:Adding host smithi114... 2023-10-18T13:55:49.145 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:48 smithi114 ceph-mon[99494]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:55:50.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:49 smithi114 ceph-mon[99494]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi114", "addr": "172.21.15.114", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:55:51.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:50 smithi114 ceph-mon[99494]: Deploying cephadm binary to smithi114 2023-10-18T13:55:51.597 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout Added host 'smithi114' with addr '172.21.15.114' 2023-10-18T13:55:51.597 INFO:teuthology.orchestra.run.smithi114.stdout:Deploying unmanaged mon service... 2023-10-18T13:55:52.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:52 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:52.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:52 smithi114 ceph-mon[99494]: Added host smithi114 2023-10-18T13:55:52.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:52 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:55:52.737 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-18T13:55:52.738 INFO:teuthology.orchestra.run.smithi114.stdout:Deploying unmanaged mgr service... 2023-10-18T13:55:53.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:53 smithi114 ceph-mon[99494]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:55:53.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:53 smithi114 ceph-mon[99494]: Saving service mon spec with placement count:5 2023-10-18T13:55:53.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:53 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:54.081 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-18T13:55:54.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:54 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:54.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:54 smithi114 ceph-mon[99494]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:55:54.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:54 smithi114 ceph-mon[99494]: Saving service mgr spec with placement count:2 2023-10-18T13:55:54.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:54 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:54.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:54 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:56.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:55 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2216399920' entity='client.admin' 2023-10-18T13:55:56.512 INFO:teuthology.orchestra.run.smithi114.stdout:Enabling the dashboard module... 2023-10-18T13:55:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:56 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:56 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3423278833' entity='client.admin' 2023-10-18T13:55:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:56 smithi114 ceph-mon[99494]: from='mgr.14120 172.21.15.114:0/3310069954' entity='mgr.x' 2023-10-18T13:55:58.169 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:57 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1160750089' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-18T13:55:58.170 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:57 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: ignoring --setuser ceph since I am not root 2023-10-18T13:55:58.170 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:57 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: ignoring --setgroup ceph since I am not root 2023-10-18T13:55:58.170 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:58 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:58.085+0000 7fe057f17200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-18T13:55:58.447 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:58 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:58.167+0000 7fe057f17200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T13:55:58.448 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:58 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:58.259+0000 7fe057f17200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T13:55:58.448 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:58 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:58.356+0000 7fe057f17200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T13:55:58.712 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:58 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:58.534+0000 7fe057f17200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T13:55:59.068 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:58 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1160750089' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-18T13:55:59.068 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:58 smithi114 ceph-mon[99494]: mgrmap e9: x(active, since 15s) 2023-10-18T13:55:59.069 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:58 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:58.928+0000 7fe057f17200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T13:55:59.336 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:59 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:59.063+0000 7fe057f17200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T13:55:59.336 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:59 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:59.154+0000 7fe057f17200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T13:55:59.336 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:59 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:59.254+0000 7fe057f17200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T13:55:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout { 2023-10-18T13:55:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-18T13:55:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-18T13:55:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-18T13:55:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-18T13:55:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout } 2023-10-18T13:55:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:Waiting for the mgr to restart... 2023-10-18T13:55:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:Waiting for mgr epoch 9... 2023-10-18T13:55:59.914 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:55:59 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:55:59.691+0000 7fe057f17200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T13:56:00.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:55:59 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1210699102' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-18T13:56:00.838 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:00.362+0000 7fe057f17200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-18T13:56:00.838 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:00.443+0000 7fe057f17200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T13:56:01.478 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:01.208+0000 7fe057f17200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T13:56:01.478 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:01.299+0000 7fe057f17200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-18T13:56:01.755 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:01.474+0000 7fe057f17200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T13:56:02.088 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:01.752+0000 7fe057f17200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-18T13:56:02.088 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:01.975+0000 7fe057f17200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T13:56:02.390 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:02 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:02.122+0000 7fe057f17200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T13:56:02.838 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:02 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:02.386+0000 7fe057f17200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T13:56:03.338 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:03.080+0000 7fe057f17200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T13:56:03.338 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:03.210+0000 7fe057f17200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-18T13:56:03.740 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:03.404+0000 7fe057f17200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T13:56:03.741 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:03.518+0000 7fe057f17200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T13:56:04.088 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:03.736+0000 7fe057f17200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T13:56:05.088 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:56:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:56:04.597+0000 7fe057f17200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T13:56:05.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:04 smithi114 ceph-mon[99494]: Active manager daemon x restarted 2023-10-18T13:56:05.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:04 smithi114 ceph-mon[99494]: Activating manager daemon x 2023-10-18T13:56:05.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:04 smithi114 ceph-mon[99494]: osdmap e3: 0 total, 0 up, 0 in 2023-10-18T13:56:05.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:04 smithi114 ceph-mon[99494]: mgrmap e10: x(active, starting, since 0.00329685s) 2023-10-18T13:56:05.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:04 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:56:05.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:04 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-18T13:56:05.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:04 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T13:56:05.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:04 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T13:56:05.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:04 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T13:56:05.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:04 smithi114 ceph-mon[99494]: Manager daemon x is now available 2023-10-18T13:56:05.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:04 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:05.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:04 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:06.022 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:05 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-18T13:56:06.022 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:05 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-18T13:56:06.023 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:05 smithi114 ceph-mon[99494]: mgrmap e11: x(active, since 1.0056s) 2023-10-18T13:56:06.058 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout { 2023-10-18T13:56:06.059 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-18T13:56:06.059 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-18T13:56:06.059 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout } 2023-10-18T13:56:06.059 INFO:teuthology.orchestra.run.smithi114.stdout:mgr epoch 9 is available 2023-10-18T13:56:06.060 INFO:teuthology.orchestra.run.smithi114.stdout:Generating a dashboard self-signed certificate... 2023-10-18T13:56:07.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:06 smithi114 ceph-mon[99494]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-18T13:56:07.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:06 smithi114 ceph-mon[99494]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-18T13:56:07.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:06 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:07.702 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-18T13:56:07.702 INFO:teuthology.orchestra.run.smithi114.stdout:Creating initial admin user... 2023-10-18T13:56:07.954 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:07 smithi114 ceph-mon[99494]: [18/Oct/2023:13:56:06] ENGINE Bus STARTING 2023-10-18T13:56:07.954 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:07 smithi114 ceph-mon[99494]: [18/Oct/2023:13:56:06] ENGINE Serving on https://172.21.15.114:7150 2023-10-18T13:56:07.955 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:07 smithi114 ceph-mon[99494]: [18/Oct/2023:13:56:06] ENGINE Serving on http://172.21.15.114:8765 2023-10-18T13:56:07.955 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:07 smithi114 ceph-mon[99494]: [18/Oct/2023:13:56:06] ENGINE Bus STARTED 2023-10-18T13:56:07.955 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:07 smithi114 ceph-mon[99494]: mgrmap e12: x(active, since 2s) 2023-10-18T13:56:07.955 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:07 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:07.955 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:07 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:07.955 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:07 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:08.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:08 smithi114 ceph-mon[99494]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:56:08.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:08 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:09.442 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$13/wPH08WcmMnhDZFlbxuO1X8r5ghv8koU.kHG26P1bx7jUSN00fy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1697637368, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-18T13:56:09.442 INFO:teuthology.orchestra.run.smithi114.stdout:Fetching dashboard port number... 2023-10-18T13:56:10.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:09 smithi114 ceph-mon[99494]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:56:10.484 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stdout 8443 2023-10-18T13:56:10.494 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-18T13:56:10.494 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout disabled 2023-10-18T13:56:10.501 INFO:teuthology.orchestra.run.smithi114.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-18T13:56:10.501 INFO:teuthology.orchestra.run.smithi114.stdout:systemctl: stdout inactive 2023-10-18T13:56:10.501 INFO:teuthology.orchestra.run.smithi114.stdout:firewalld.service is not enabled 2023-10-18T13:56:10.501 INFO:teuthology.orchestra.run.smithi114.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-18T13:56:10.503 INFO:teuthology.orchestra.run.smithi114.stdout:Ceph Dashboard is now available at: 2023-10-18T13:56:10.503 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:56:10.503 INFO:teuthology.orchestra.run.smithi114.stdout: URL: https://smithi114.front.sepia.ceph.com:8443/ 2023-10-18T13:56:10.503 INFO:teuthology.orchestra.run.smithi114.stdout: User: admin 2023-10-18T13:56:10.503 INFO:teuthology.orchestra.run.smithi114.stdout: Password: ghjsutcpx5 2023-10-18T13:56:10.504 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:56:10.504 INFO:teuthology.orchestra.run.smithi114.stdout:Saving cluster configuration to /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config directory 2023-10-18T13:56:10.504 INFO:teuthology.orchestra.run.smithi114.stdout:Enabling autotune for osd_memory_target 2023-10-18T13:56:10.755 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:10 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1687152570' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-18T13:56:11.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:11 smithi114 ceph-mon[99494]: mgrmap e13: x(active, since 6s) 2023-10-18T13:56:12.683 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-18T13:56:12.683 INFO:teuthology.orchestra.run.smithi114.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-18T13:56:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:56:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-18T13:56:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:56:12.684 INFO:teuthology.orchestra.run.smithi114.stdout:Or, if you are only running a single cluster on this host: 2023-10-18T13:56:12.684 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:56:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-18T13:56:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:56:12.685 INFO:teuthology.orchestra.run.smithi114.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-18T13:56:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:56:12.685 INFO:teuthology.orchestra.run.smithi114.stdout: ceph telemetry on 2023-10-18T13:56:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:56:12.686 INFO:teuthology.orchestra.run.smithi114.stdout:For more information see: 2023-10-18T13:56:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:56:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-18T13:56:12.686 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:56:12.686 INFO:teuthology.orchestra.run.smithi114.stdout:Bootstrap complete. 2023-10-18T13:56:12.719 INFO:tasks.cephadm:Fetching config... 2023-10-18T13:56:12.719 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:56:12.720 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-18T13:56:12.736 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-18T13:56:12.736 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:56:12.737 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-18T13:56:12.794 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-18T13:56:12.795 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:56:12.795 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-18T13:56:12.861 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-18T13:56:12.862 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:56:12.862 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-18T13:56:12.918 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-18T13:56:12.918 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAl1192p16S22r77qE/iAbdpyiOHoGHZB5rMNfxmZ+5JjP8IAz2syV4De8BEpUuV9aWKH/OrYCvmpyxatznnhEKqcK0jbcLstDQyxhERJAczCHC8dAtYJlRWBnh5GWooyNyELJkIZulHzu3cjlFGWK0fXpgpfxvZ/bwEMKVZfvuB+0xgs2+B7uRTP5VJW7Q/7yNrMJG7egRJTEIwLM+u/mGNupashkfPO6gILeTqPPEF1KcVMUvugqqED0T4zW3IdE67WlZ4mtZL3FxRFXLcuizCj5hFkRKDz5lt3XkRy+0nhzgKbu6sBeS0i5FvMiQdPu8EYz/RdfXQa2zIafya115/LsU50g/ZKEMK7DSdFkhdFHQa4Eutb79iUQHv+8AREf6XCgMjbrHFrZyVXomC1ALZWaXrWezYTWLMiVsw2FY/fw6iPIB7d7WevXxJUOElof4KoI6EPXYCw+WyFgbIS8ZoQygpyPTj1Mw9nYTWOg5aXPPo2rw//oCk2V7yLyzWs= ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-18T13:56:13.004 INFO:teuthology.orchestra.run.smithi114.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAl1192p16S22r77qE/iAbdpyiOHoGHZB5rMNfxmZ+5JjP8IAz2syV4De8BEpUuV9aWKH/OrYCvmpyxatznnhEKqcK0jbcLstDQyxhERJAczCHC8dAtYJlRWBnh5GWooyNyELJkIZulHzu3cjlFGWK0fXpgpfxvZ/bwEMKVZfvuB+0xgs2+B7uRTP5VJW7Q/7yNrMJG7egRJTEIwLM+u/mGNupashkfPO6gILeTqPPEF1KcVMUvugqqED0T4zW3IdE67WlZ4mtZL3FxRFXLcuizCj5hFkRKDz5lt3XkRy+0nhzgKbu6sBeS0i5FvMiQdPu8EYz/RdfXQa2zIafya115/LsU50g/ZKEMK7DSdFkhdFHQa4Eutb79iUQHv+8AREf6XCgMjbrHFrZyVXomC1ALZWaXrWezYTWLMiVsw2FY/fw6iPIB7d7WevXxJUOElof4KoI6EPXYCw+WyFgbIS8ZoQygpyPTj1Mw9nYTWOg5aXPPo2rw//oCk2V7yLyzWs= ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:56:13.017 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAl1192p16S22r77qE/iAbdpyiOHoGHZB5rMNfxmZ+5JjP8IAz2syV4De8BEpUuV9aWKH/OrYCvmpyxatznnhEKqcK0jbcLstDQyxhERJAczCHC8dAtYJlRWBnh5GWooyNyELJkIZulHzu3cjlFGWK0fXpgpfxvZ/bwEMKVZfvuB+0xgs2+B7uRTP5VJW7Q/7yNrMJG7egRJTEIwLM+u/mGNupashkfPO6gILeTqPPEF1KcVMUvugqqED0T4zW3IdE67WlZ4mtZL3FxRFXLcuizCj5hFkRKDz5lt3XkRy+0nhzgKbu6sBeS0i5FvMiQdPu8EYz/RdfXQa2zIafya115/LsU50g/ZKEMK7DSdFkhdFHQa4Eutb79iUQHv+8AREf6XCgMjbrHFrZyVXomC1ALZWaXrWezYTWLMiVsw2FY/fw6iPIB7d7WevXxJUOElof4KoI6EPXYCw+WyFgbIS8ZoQygpyPTj1Mw9nYTWOg5aXPPo2rw//oCk2V7yLyzWs= ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-18T13:56:13.065 INFO:teuthology.orchestra.run.smithi158.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAl1192p16S22r77qE/iAbdpyiOHoGHZB5rMNfxmZ+5JjP8IAz2syV4De8BEpUuV9aWKH/OrYCvmpyxatznnhEKqcK0jbcLstDQyxhERJAczCHC8dAtYJlRWBnh5GWooyNyELJkIZulHzu3cjlFGWK0fXpgpfxvZ/bwEMKVZfvuB+0xgs2+B7uRTP5VJW7Q/7yNrMJG7egRJTEIwLM+u/mGNupashkfPO6gILeTqPPEF1KcVMUvugqqED0T4zW3IdE67WlZ4mtZL3FxRFXLcuizCj5hFkRKDz5lt3XkRy+0nhzgKbu6sBeS0i5FvMiQdPu8EYz/RdfXQa2zIafya115/LsU50g/ZKEMK7DSdFkhdFHQa4Eutb79iUQHv+8AREf6XCgMjbrHFrZyVXomC1ALZWaXrWezYTWLMiVsw2FY/fw6iPIB7d7WevXxJUOElof4KoI6EPXYCw+WyFgbIS8ZoQygpyPTj1Mw9nYTWOg5aXPPo2rw//oCk2V7yLyzWs= ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:56:13.079 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAl1192p16S22r77qE/iAbdpyiOHoGHZB5rMNfxmZ+5JjP8IAz2syV4De8BEpUuV9aWKH/OrYCvmpyxatznnhEKqcK0jbcLstDQyxhERJAczCHC8dAtYJlRWBnh5GWooyNyELJkIZulHzu3cjlFGWK0fXpgpfxvZ/bwEMKVZfvuB+0xgs2+B7uRTP5VJW7Q/7yNrMJG7egRJTEIwLM+u/mGNupashkfPO6gILeTqPPEF1KcVMUvugqqED0T4zW3IdE67WlZ4mtZL3FxRFXLcuizCj5hFkRKDz5lt3XkRy+0nhzgKbu6sBeS0i5FvMiQdPu8EYz/RdfXQa2zIafya115/LsU50g/ZKEMK7DSdFkhdFHQa4Eutb79iUQHv+8AREf6XCgMjbrHFrZyVXomC1ALZWaXrWezYTWLMiVsw2FY/fw6iPIB7d7WevXxJUOElof4KoI6EPXYCw+WyFgbIS8ZoQygpyPTj1Mw9nYTWOg5aXPPo2rw//oCk2V7yLyzWs= ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-18T13:56:13.127 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAl1192p16S22r77qE/iAbdpyiOHoGHZB5rMNfxmZ+5JjP8IAz2syV4De8BEpUuV9aWKH/OrYCvmpyxatznnhEKqcK0jbcLstDQyxhERJAczCHC8dAtYJlRWBnh5GWooyNyELJkIZulHzu3cjlFGWK0fXpgpfxvZ/bwEMKVZfvuB+0xgs2+B7uRTP5VJW7Q/7yNrMJG7egRJTEIwLM+u/mGNupashkfPO6gILeTqPPEF1KcVMUvugqqED0T4zW3IdE67WlZ4mtZL3FxRFXLcuizCj5hFkRKDz5lt3XkRy+0nhzgKbu6sBeS0i5FvMiQdPu8EYz/RdfXQa2zIafya115/LsU50g/ZKEMK7DSdFkhdFHQa4Eutb79iUQHv+8AREf6XCgMjbrHFrZyVXomC1ALZWaXrWezYTWLMiVsw2FY/fw6iPIB7d7WevXxJUOElof4KoI6EPXYCw+WyFgbIS8ZoQygpyPTj1Mw9nYTWOg5aXPPo2rw//oCk2V7yLyzWs= ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:56:13.139 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-18T13:56:13.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:13 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/945851861' entity='client.admin' 2023-10-18T13:56:13.705 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:56:16.165 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-18T13:56:16.166 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-18T13:56:16.731 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:56:16.917 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:16 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2589587936' entity='client.admin' 2023-10-18T13:56:16.917 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:16 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:16.917 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:16 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:16.917 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:16 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi114", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:56:16.918 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:16 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:16.918 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:16 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:16.918 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:16 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:18.477 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi158 2023-10-18T13:56:18.477 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T13:56:18.478 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/etc/ceph/ceph.conf 2023-10-18T13:56:18.501 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T13:56:18.501 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:56:18.558 INFO:tasks.cephadm:Adding host smithi158 to orchestrator... 2023-10-18T13:56:18.559 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch host add smithi158 2023-10-18T13:56:19.127 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:56:19.481 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:19 smithi114 ceph-mon[99494]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:56:19.481 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:19 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:19.482 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:19 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:19.482 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:19 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:19.482 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:19 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:56:19.482 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:19 smithi114 ceph-mon[99494]: Updating smithi114:/etc/ceph/ceph.conf 2023-10-18T13:56:19.483 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:19 smithi114 ceph-mon[99494]: Updating smithi114:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:19.483 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:19 smithi114 ceph-mon[99494]: Updating smithi114:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:56:19.483 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:19 smithi114 ceph-mon[99494]: Updating smithi114:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:56:19.483 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:19 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:19.483 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:19 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:19.484 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:19 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:21.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:21 smithi114 ceph-mon[99494]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi158", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:56:22.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:22 smithi114 ceph-mon[99494]: Deploying cephadm binary to smithi158 2023-10-18T13:56:22.964 INFO:teuthology.orchestra.run.smithi114.stdout:Added host 'smithi158' with addr '172.21.15.158' 2023-10-18T13:56:23.389 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-18T13:56:23.944 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:56:24.228 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:23 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:24.228 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:23 smithi114 ceph-mon[99494]: Added host smithi158 2023-10-18T13:56:24.228 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:23 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:24.229 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:23 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:25.337 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:56:25.338 INFO:teuthology.orchestra.run.smithi114.stdout:[{"addr": "172.21.15.114", "hostname": "smithi114", "labels": [], "status": ""}, {"addr": "172.21.15.158", "hostname": "smithi158", "labels": [], "status": ""}] 2023-10-18T13:56:25.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:25 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:25.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:25 smithi114 ceph-mon[99494]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:25.785 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2023-10-18T13:56:25.786 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T13:56:25.786 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2023-10-18T13:56:25.807 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T13:56:25.807 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:56:25.867 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2023-10-18T13:56:25.867 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch host add smithi172 2023-10-18T13:56:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:56:26.629 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:26 smithi114 ceph-mon[99494]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T13:56:26.629 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:26 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:27.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:27 smithi114 ceph-mon[99494]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:28.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:28 smithi114 ceph-mon[99494]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:56:28.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:28 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:28.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:28 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:28.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:28 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:28.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:28 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:28.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:28 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi158", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:56:28.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:28 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:28.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:28 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:56:29.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:29 smithi114 ceph-mon[99494]: Updating smithi158:/etc/ceph/ceph.conf 2023-10-18T13:56:29.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:29 smithi114 ceph-mon[99494]: Deploying cephadm binary to smithi172 2023-10-18T13:56:29.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:29 smithi114 ceph-mon[99494]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:29.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:29 smithi114 ceph-mon[99494]: Updating smithi158:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:56:29.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:29 smithi114 ceph-mon[99494]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:29.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:29 smithi114 ceph-mon[99494]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:56:30.150 INFO:teuthology.orchestra.run.smithi114.stdout:Added host 'smithi172' with addr '172.21.15.172' 2023-10-18T13:56:30.573 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-18T13:56:30.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:30 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:30.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:30 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:30.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:30 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:30.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:30 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:30.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:30 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:30.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:30 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:31.131 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:56:31.919 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:31 smithi114 ceph-mon[99494]: Added host smithi172 2023-10-18T13:56:31.920 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:31 smithi114 ceph-mon[99494]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:31.920 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:31 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:32.488 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T13:56:32.488 INFO:teuthology.orchestra.run.smithi114.stdout:[{"addr": "172.21.15.114", "hostname": "smithi114", "labels": [], "status": ""}, {"addr": "172.21.15.158", "hostname": "smithi158", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2023-10-18T13:56:32.884 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-18T13:56:32.884 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd crush tunables default 2023-10-18T13:56:33.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:33 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:33.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:33 smithi114 ceph-mon[99494]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T13:56:33.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:33 smithi114 ceph-mon[99494]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:33.438 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:56:35.683 INFO:teuthology.orchestra.run.smithi114.stderr:adjusted tunables profile to default 2023-10-18T13:56:36.067 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:35 smithi114 ceph-mon[99494]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:36.067 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:35 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/4105950346' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-18T13:56:36.067 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:35 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:36.068 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:35 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:36.068 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:35 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:36.068 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:35 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:36.068 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:35 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:56:36.068 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:35 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:36.069 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:35 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:56:36.087 INFO:tasks.cephadm:Adding mon.a on smithi114 2023-10-18T13:56:36.088 INFO:tasks.cephadm:Adding mon.b on smithi158 2023-10-18T13:56:36.088 INFO:tasks.cephadm:Adding mon.c on smithi172 2023-10-18T13:56:36.088 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch apply mon '3;smithi114:172.21.15.114=a;smithi158:172.21.15.158=b;smithi172:172.21.15.172=c' 2023-10-18T13:56:36.663 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:37.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:36 smithi114 ceph-mon[99494]: Updating smithi172:/etc/ceph/ceph.conf 2023-10-18T13:56:37.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:36 smithi114 ceph-mon[99494]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:37.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:36 smithi114 ceph-mon[99494]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:56:37.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:36 smithi114 ceph-mon[99494]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:56:37.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:36 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/4105950346' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-18T13:56:37.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:36 smithi114 ceph-mon[99494]: osdmap e4: 0 total, 0 up, 0 in 2023-10-18T13:56:37.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:36 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:37.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:36 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:37.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:36 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:38.102 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mon update... 2023-10-18T13:56:38.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:37 smithi114 ceph-mon[99494]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:38.541 DEBUG:teuthology.orchestra.run.smithi158:mon.b> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.b.service 2023-10-18T13:56:38.544 DEBUG:teuthology.orchestra.run.smithi172:mon.c> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.c.service 2023-10-18T13:56:38.547 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-18T13:56:38.547 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T13:56:38.576 INFO:journalctl@ceph.mon.c.smithi172.stdout:-- Logs begin at Wed 2023-10-18 13:40:49 UTC. -- 2023-10-18T13:56:38.579 INFO:journalctl@ceph.mon.b.smithi158.stdout:-- Logs begin at Wed 2023-10-18 13:41:14 UTC. -- 2023-10-18T13:56:39.176 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:39.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:39 smithi114 ceph-mon[99494]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi114:172.21.15.114=a;smithi158:172.21.15.158=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:56:39.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:39 smithi114 ceph-mon[99494]: Saving service mon spec with placement smithi114:172.21.15.114=a;smithi158:172.21.15.158=b;smithi172:172.21.15.172=c;count:3 2023-10-18T13:56:39.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:39 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:39.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:39 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:39.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:39 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:39.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:39 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:56:39.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:39 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:39.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:39 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:56:39.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:39 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:39.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:39 smithi114 ceph-mon[99494]: Deploying daemon mon.c on smithi172 2023-10-18T13:56:39.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:39 smithi114 ceph-mon[99494]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:41.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 systemd[1]: Starting Ceph mon.c for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T13:56:41.546 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:56:41.546 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","modified":"2023-10-18T13:55:05.776394Z","created":"2023-10-18T13:55:05.776394Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:3300","nonce":0},{"type":"v1","addr":"172.21.15.114:6789","nonce":0}]},"addr":"172.21.15.114:6789/0","public_addr":"172.21.15.114:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-18T13:56:41.549 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2023-10-18T13:56:41.679 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 podman[103504]: 2023-10-18T13:56:42.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 bash[103504]: 5de49e101408c4362c4c4bb923c7278f48c362f5292e9a4ae3c6eefa41bad74f 2023-10-18T13:56:42.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: set uid:gid to 167:167 (ceph:ceph) 2023-10-18T13:56:42.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev), process ceph-mon, pid 7 2023-10-18T13:56:42.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: pidfile_write: ignore empty --pid-file 2023-10-18T13:56:42.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: load: jerasure load: lrc 2023-10-18T13:56:42.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: RocksDB version: 7.9.2 2023-10-18T13:56:42.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Git sha 0 2023-10-18T13:56:42.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Compile date 2023-10-16 22:08:19 2023-10-18T13:56:42.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: DB SUMMARY 2023-10-18T13:56:42.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: DB Session ID: VU6SGS2FX25YT9GU8K5W 2023-10-18T13:56:42.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: CURRENT file: CURRENT 2023-10-18T13:56:42.063 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: IDENTITY file: IDENTITY 2023-10-18T13:56:42.063 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-18T13:56:42.063 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-10-18T13:56:42.063 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-10-18T13:56:42.063 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.error_if_exists: 0 2023-10-18T13:56:42.064 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.create_if_missing: 0 2023-10-18T13:56:42.064 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.paranoid_checks: 1 2023-10-18T13:56:42.064 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-18T13:56:42.064 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-18T13:56:42.065 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-18T13:56:42.065 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.env: 0x55a562387da0 2023-10-18T13:56:42.065 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.fs: PosixFileSystem 2023-10-18T13:56:42.065 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.info_log: 0x55a5644e9660 2023-10-18T13:56:42.065 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_file_opening_threads: 16 2023-10-18T13:56:42.066 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.statistics: (nil) 2023-10-18T13:56:42.066 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.use_fsync: 0 2023-10-18T13:56:42.066 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_log_file_size: 0 2023-10-18T13:56:42.066 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-18T13:56:42.066 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-18T13:56:42.067 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.keep_log_file_num: 1000 2023-10-18T13:56:42.067 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.recycle_log_file_num: 0 2023-10-18T13:56:42.067 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.allow_fallocate: 1 2023-10-18T13:56:42.067 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.allow_mmap_reads: 0 2023-10-18T13:56:42.067 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.allow_mmap_writes: 0 2023-10-18T13:56:42.067 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.use_direct_reads: 0 2023-10-18T13:56:42.068 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-18T13:56:42.068 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.create_missing_column_families: 0 2023-10-18T13:56:42.068 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.db_log_dir: 2023-10-18T13:56:42.068 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.wal_dir: 2023-10-18T13:56:42.070 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-18T13:56:42.070 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-18T13:56:42.070 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-18T13:56:42.070 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-18T13:56:42.071 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-18T13:56:42.071 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-18T13:56:42.071 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.advise_random_on_open: 1 2023-10-18T13:56:42.071 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.db_write_buffer_size: 0 2023-10-18T13:56:42.071 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.write_buffer_manager: 0x55a5644a1360 2023-10-18T13:56:42.072 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-18T13:56:42.072 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-18T13:56:42.072 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-18T13:56:42.072 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.rate_limiter: (nil) 2023-10-18T13:56:42.072 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-18T13:56:42.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.wal_recovery_mode: 2 2023-10-18T13:56:42.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.enable_thread_tracking: 0 2023-10-18T13:56:42.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.enable_pipelined_write: 0 2023-10-18T13:56:42.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.unordered_write: 0 2023-10-18T13:56:42.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-18T13:56:42.074 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-18T13:56:42.074 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-18T13:56:42.074 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-18T13:56:42.074 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.row_cache: None 2023-10-18T13:56:42.074 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.wal_filter: None 2023-10-18T13:56:42.075 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-18T13:56:42.075 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.allow_ingest_behind: 0 2023-10-18T13:56:42.075 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.two_write_queues: 0 2023-10-18T13:56:42.075 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.manual_wal_flush: 0 2023-10-18T13:56:42.075 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.wal_compression: 0 2023-10-18T13:56:42.075 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.atomic_flush: 0 2023-10-18T13:56:42.076 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-18T13:56:42.076 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-18T13:56:42.076 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-18T13:56:42.076 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.log_readahead_size: 0 2023-10-18T13:56:42.076 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-18T13:56:42.077 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.best_efforts_recovery: 0 2023-10-18T13:56:42.077 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-18T13:56:42.077 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-18T13:56:42.077 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.allow_data_in_errors: 0 2023-10-18T13:56:42.077 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.db_host_id: __hostname__ 2023-10-18T13:56:42.078 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-18T13:56:42.078 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_background_jobs: 2 2023-10-18T13:56:42.078 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_background_compactions: -1 2023-10-18T13:56:42.078 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_subcompactions: 1 2023-10-18T13:56:42.078 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-18T13:56:42.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-18T13:56:42.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-18T13:56:42.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_total_wal_size: 0 2023-10-18T13:56:42.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-18T13:56:42.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-18T13:56:42.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-18T13:56:42.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-18T13:56:42.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_open_files: -1 2023-10-18T13:56:42.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.bytes_per_sync: 0 2023-10-18T13:56:42.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-18T13:56:42.080 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-18T13:56:42.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compaction_readahead_size: 0 2023-10-18T13:56:42.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_background_flushes: -1 2023-10-18T13:56:42.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Compression algorithms supported: 2023-10-18T13:56:42.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-18T13:56:42.081 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: kZSTD supported: 0 2023-10-18T13:56:42.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: kXpressCompression supported: 0 2023-10-18T13:56:42.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: kLZ4HCCompression supported: 1 2023-10-18T13:56:42.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: kZlibCompression supported: 1 2023-10-18T13:56:42.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: kSnappyCompression supported: 1 2023-10-18T13:56:42.082 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: kLZ4Compression supported: 1 2023-10-18T13:56:42.083 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: kBZip2Compression supported: 0 2023-10-18T13:56:42.083 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-18T13:56:42.083 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-18T13:56:42.083 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-10-18T13:56:42.083 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-18T13:56:42.084 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-18T13:56:42.084 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.merge_operator: 2023-10-18T13:56:42.084 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compaction_filter: None 2023-10-18T13:56:42.084 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compaction_filter_factory: None 2023-10-18T13:56:42.084 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.sst_partitioner_factory: None 2023-10-18T13:56:42.084 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-18T13:56:42.085 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-18T13:56:42.085 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a5644e9760) 2023-10-18T13:56:42.085 INFO:journalctl@ceph.mon.c.smithi172.stdout: cache_index_and_filter_blocks: 1 2023-10-18T13:56:42.085 INFO:journalctl@ceph.mon.c.smithi172.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-18T13:56:42.085 INFO:journalctl@ceph.mon.c.smithi172.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-18T13:56:42.086 INFO:journalctl@ceph.mon.c.smithi172.stdout: pin_top_level_index_and_filter: 1 2023-10-18T13:56:42.086 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_type: 0 2023-10-18T13:56:42.086 INFO:journalctl@ceph.mon.c.smithi172.stdout: data_block_index_type: 0 2023-10-18T13:56:42.086 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_shortening: 1 2023-10-18T13:56:42.086 INFO:journalctl@ceph.mon.c.smithi172.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-18T13:56:42.087 INFO:journalctl@ceph.mon.c.smithi172.stdout: checksum: 4 2023-10-18T13:56:42.087 INFO:journalctl@ceph.mon.c.smithi172.stdout: no_block_cache: 0 2023-10-18T13:56:42.087 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache: 0x55a56453f1f0 2023-10-18T13:56:42.087 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_name: BinnedLRUCache 2023-10-18T13:56:42.087 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_options: 2023-10-18T13:56:42.088 INFO:journalctl@ceph.mon.c.smithi172.stdout: capacity : 536870912 2023-10-18T13:56:42.088 INFO:journalctl@ceph.mon.c.smithi172.stdout: num_shard_bits : 4 2023-10-18T13:56:42.088 INFO:journalctl@ceph.mon.c.smithi172.stdout: strict_capacity_limit : 0 2023-10-18T13:56:42.088 INFO:journalctl@ceph.mon.c.smithi172.stdout: high_pri_pool_ratio: 0.000 2023-10-18T13:56:42.088 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_compressed: (nil) 2023-10-18T13:56:42.089 INFO:journalctl@ceph.mon.c.smithi172.stdout: persistent_cache: (nil) 2023-10-18T13:56:42.089 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_size: 4096 2023-10-18T13:56:42.089 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_size_deviation: 10 2023-10-18T13:56:42.089 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_restart_interval: 16 2023-10-18T13:56:42.089 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_block_restart_interval: 1 2023-10-18T13:56:42.090 INFO:journalctl@ceph.mon.c.smithi172.stdout: metadata_block_size: 4096 2023-10-18T13:56:42.090 INFO:journalctl@ceph.mon.c.smithi172.stdout: partition_filters: 0 2023-10-18T13:56:42.090 INFO:journalctl@ceph.mon.c.smithi172.stdout: use_delta_encoding: 1 2023-10-18T13:56:42.090 INFO:journalctl@ceph.mon.c.smithi172.stdout: filter_policy: bloomfilter 2023-10-18T13:56:42.090 INFO:journalctl@ceph.mon.c.smithi172.stdout: whole_key_filtering: 1 2023-10-18T13:56:42.091 INFO:journalctl@ceph.mon.c.smithi172.stdout: verify_compression: 0 2023-10-18T13:56:42.091 INFO:journalctl@ceph.mon.c.smithi172.stdout: read_amp_bytes_per_bit: 0 2023-10-18T13:56:42.091 INFO:journalctl@ceph.mon.c.smithi172.stdout: format_version: 5 2023-10-18T13:56:42.091 INFO:journalctl@ceph.mon.c.smithi172.stdout: enable_index_compression: 1 2023-10-18T13:56:42.091 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_align: 0 2023-10-18T13:56:42.092 INFO:journalctl@ceph.mon.c.smithi172.stdout: max_auto_readahead_size: 262144 2023-10-18T13:56:42.092 INFO:journalctl@ceph.mon.c.smithi172.stdout: prepopulate_block_cache: 0 2023-10-18T13:56:42.092 INFO:journalctl@ceph.mon.c.smithi172.stdout: initial_auto_readahead_size: 8192 2023-10-18T13:56:42.092 INFO:journalctl@ceph.mon.c.smithi172.stdout: num_file_reads_for_auto_readahead: 2 2023-10-18T13:56:42.092 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.write_buffer_size: 33554432 2023-10-18T13:56:42.093 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_write_buffer_number: 2 2023-10-18T13:56:42.093 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compression: NoCompression 2023-10-18T13:56:42.093 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.bottommost_compression: Disabled 2023-10-18T13:56:42.093 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.prefix_extractor: nullptr 2023-10-18T13:56:42.093 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-18T13:56:42.093 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.num_levels: 7 2023-10-18T13:56:42.094 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-18T13:56:42.094 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-18T13:56:42.094 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-18T13:56:42.094 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-18T13:56:42.094 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-18T13:56:42.095 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-18T13:56:42.095 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-18T13:56:42.095 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-18T13:56:42.095 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-18T13:56:42.095 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-18T13:56:42.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-18T13:56:42.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-18T13:56:42.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-18T13:56:42.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compression_opts.level: 32767 2023-10-18T13:56:42.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compression_opts.strategy: 0 2023-10-18T13:56:42.097 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-18T13:56:42.097 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-18T13:56:42.097 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-18T13:56:42.097 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-18T13:56:42.097 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compression_opts.enabled: false 2023-10-18T13:56:42.098 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-18T13:56:42.098 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-18T13:56:42.098 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-18T13:56:42.098 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-18T13:56:42.098 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.target_file_size_base: 67108864 2023-10-18T13:56:42.099 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-18T13:56:42.099 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-18T13:56:42.099 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-18T13:56:42.099 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-18T13:56:42.099 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-18T13:56:42.100 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-18T13:56:42.100 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-18T13:56:42.100 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-18T13:56:42.100 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-18T13:56:42.100 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-18T13:56:42.100 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-18T13:56:42.101 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-18T13:56:42.101 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-18T13:56:42.101 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-18T13:56:42.101 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.arena_block_size: 1048576 2023-10-18T13:56:42.101 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-18T13:56:42.102 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-18T13:56:42.102 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.disable_auto_compactions: 0 2023-10-18T13:56:42.102 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-18T13:56:42.102 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-18T13:56:42.102 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-18T13:56:42.103 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-18T13:56:42.103 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-18T13:56:42.103 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-18T13:56:42.103 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-18T13:56:42.103 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-18T13:56:42.104 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-18T13:56:42.104 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-18T13:56:42.104 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.table_properties_collectors: 2023-10-18T13:56:42.104 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.inplace_update_support: 0 2023-10-18T13:56:42.104 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-18T13:56:42.105 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-18T13:56:42.105 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-18T13:56:42.105 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-18T13:56:42.105 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.bloom_locality: 0 2023-10-18T13:56:42.105 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.max_successive_merges: 0 2023-10-18T13:56:42.106 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-18T13:56:42.106 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.paranoid_file_checks: 0 2023-10-18T13:56:42.106 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.force_consistency_checks: 1 2023-10-18T13:56:42.106 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.report_bg_io_stats: 0 2023-10-18T13:56:42.106 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.ttl: 2592000 2023-10-18T13:56:42.107 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-18T13:56:42.107 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-18T13:56:42.107 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-18T13:56:42.107 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.enable_blob_files: false 2023-10-18T13:56:42.107 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.min_blob_size: 0 2023-10-18T13:56:42.108 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.blob_file_size: 268435456 2023-10-18T13:56:42.108 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-18T13:56:42.108 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-18T13:56:42.108 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-18T13:56:42.108 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-18T13:56:42.108 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-18T13:56:42.109 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.blob_file_starting_level: 0 2023-10-18T13:56:42.109 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-18T13:56:42.109 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-18T13:56:42.109 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-18T13:56:42.109 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8dab154c-9490-4966-af02-f0aa24621f07 2023-10-18T13:56:42.110 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697637401693254, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-18T13:56:42.110 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-18T13:56:42.110 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697637401693675, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1697637401, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8dab154c-9490-4966-af02-f0aa24621f07", "db_session_id": "VU6SGS2FX25YT9GU8K5W", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-18T13:56:42.110 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697637401693742, "job": 1, "event": "recovery_finished"} 2023-10-18T13:56:42.110 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-18T13:56:42.111 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 systemd[1]: Started Ceph mon.c for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T13:56:42.111 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-18T13:56:42.111 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a5645dc000 2023-10-18T13:56:42.111 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: DB pointer 0x55a5645c8000 2023-10-18T13:56:42.111 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-10-18T13:56:42.111 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-18T13:56:42.112 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-18T13:56:42.112 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** DB Stats ** 2023-10-18T13:56:42.112 INFO:journalctl@ceph.mon.c.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T13:56:42.112 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-18T13:56:42.112 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-18T13:56:42.113 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T13:56:42.113 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-18T13:56:42.113 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-18T13:56:42.113 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T13:56:42.113 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2023-10-18T13:56:42.114 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** Compaction Stats [default] ** 2023-10-18T13:56:42.114 INFO:journalctl@ceph.mon.c.smithi172.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-18T13:56:42.114 INFO:journalctl@ceph.mon.c.smithi172.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-18T13:56:42.114 INFO:journalctl@ceph.mon.c.smithi172.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-18T13:56:42.114 INFO:journalctl@ceph.mon.c.smithi172.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-18T13:56:42.115 INFO:journalctl@ceph.mon.c.smithi172.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-18T13:56:42.115 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2023-10-18T13:56:42.115 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** Compaction Stats [default] ** 2023-10-18T13:56:42.115 INFO:journalctl@ceph.mon.c.smithi172.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-18T13:56:42.115 INFO:journalctl@ceph.mon.c.smithi172.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T13:56:42.116 INFO:journalctl@ceph.mon.c.smithi172.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-18T13:56:42.116 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2023-10-18T13:56:42.116 INFO:journalctl@ceph.mon.c.smithi172.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-18T13:56:42.116 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2023-10-18T13:56:42.116 INFO:journalctl@ceph.mon.c.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T13:56:42.116 INFO:journalctl@ceph.mon.c.smithi172.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-18T13:56:42.117 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-18T13:56:42.117 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-18T13:56:42.117 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-18T13:56:42.117 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-18T13:56:42.117 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T13:56:42.118 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T13:56:42.118 INFO:journalctl@ceph.mon.c.smithi172.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-18T13:56:42.118 INFO:journalctl@ceph.mon.c.smithi172.stdout: Block cache BinnedLRUCache@0x55a56453f1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2023-10-18T13:56:42.118 INFO:journalctl@ceph.mon.c.smithi172.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-18T13:56:42.118 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2023-10-18T13:56:42.119 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-18T13:56:42.119 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: using public_addr v2:172.21.15.172:0/0 -> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2023-10-18T13:56:42.119 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: starting mon.c rank -1 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:56:42.119 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(???) e0 preinit fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:56:42.119 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(synchronizing).mds e1 new map 2023-10-18T13:56:42.119 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(synchronizing).mds e1 print_map 2023-10-18T13:56:42.120 INFO:journalctl@ceph.mon.c.smithi172.stdout: e1 2023-10-18T13:56:42.120 INFO:journalctl@ceph.mon.c.smithi172.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T13:56:42.120 INFO:journalctl@ceph.mon.c.smithi172.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-18T13:56:42.120 INFO:journalctl@ceph.mon.c.smithi172.stdout: legacy client fscid: -1 2023-10-18T13:56:42.120 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2023-10-18T13:56:42.121 INFO:journalctl@ceph.mon.c.smithi172.stdout: No filesystems configured 2023-10-18T13:56:42.121 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-18T13:56:42.121 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-18T13:56:42.121 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-18T13:56:42.122 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-18T13:56:42.122 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-18T13:56:42.122 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-18T13:56:42.122 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-18T13:56:42.122 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T13:56:42.122 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T13:56:42.123 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T13:56:42.123 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:42.123 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:56:42.123 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.123 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.124 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.124 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.124 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi158", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:56:42.124 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:42.125 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:56:42.125 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: Updating smithi158:/etc/ceph/ceph.conf 2023-10-18T13:56:42.125 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: Deploying cephadm binary to smithi172 2023-10-18T13:56:42.125 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:42.126 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: Updating smithi158:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:56:42.126 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:42.126 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:56:42.126 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.126 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.127 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.127 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.127 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:42.127 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.127 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: Added host smithi172 2023-10-18T13:56:42.127 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:42.128 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.128 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.128 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T13:56:42.128 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:42.128 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:42.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/4105950346' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-18T13:56:42.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:56:42.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:42.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:56:42.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: Updating smithi172:/etc/ceph/ceph.conf 2023-10-18T13:56:42.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:42.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:56:42.131 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:56:42.131 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/4105950346' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-18T13:56:42.131 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: osdmap e4: 0 total, 0 up, 0 in 2023-10-18T13:56:42.131 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.131 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.132 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.132 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:42.132 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi114:172.21.15.114=a;smithi158:172.21.15.158=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:56:42.132 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: Saving service mon spec with placement smithi114:172.21.15.114=a;smithi158:172.21.15.158=b;smithi172:172.21.15.172=c;count:3 2023-10-18T13:56:42.132 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:42.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:42.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:56:42.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:42.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:56:42.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:42.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: Deploying daemon mon.c on smithi172 2023-10-18T13:56:42.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:42.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: from='client.? 172.21.15.172:0/2477412730' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T13:56:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:41 smithi172 ceph-mon[103574]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-18T13:56:42.135 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:41 smithi114 ceph-mon[99494]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:42.136 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:41 smithi114 ceph-mon[99494]: from='client.? 172.21.15.172:0/2477412730' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T13:56:43.137 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-18T13:56:43.138 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T13:56:43.706 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T13:56:47.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:56:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: mon.a calling monitor election 2023-10-18T13:56:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:47.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: mon.c calling monitor election 2023-10-18T13:56:47.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:47.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:47.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:47.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:47.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-18T13:56:47.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: monmap e2: 2 mons at {a=[v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0],c=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-18T13:56:47.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: fsmap 2023-10-18T13:56:47.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: osdmap e4: 0 total, 0 up, 0 in 2023-10-18T13:56:47.092 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: mgrmap e13: x(active, since 42s) 2023-10-18T13:56:47.092 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: overall HEALTH_OK 2023-10-18T13:56:47.092 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:47.092 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:47.092 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:47.092 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:56:47.093 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:46 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:47.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:56:47.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: mon.a calling monitor election 2023-10-18T13:56:47.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:47.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:47.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:47.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:47.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: mon.c calling monitor election 2023-10-18T13:56:47.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:47.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:47.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:47.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:47.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-18T13:56:47.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: monmap e2: 2 mons at {a=[v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0],c=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-18T13:56:47.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: fsmap 2023-10-18T13:56:47.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: osdmap e4: 0 total, 0 up, 0 in 2023-10-18T13:56:47.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: mgrmap e13: x(active, since 42s) 2023-10-18T13:56:47.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: overall HEALTH_OK 2023-10-18T13:56:47.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:47.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:47.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:47.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:56:47.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:46 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:48.166 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:56:48.166 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","modified":"2023-10-18T13:56:41.731717Z","created":"2023-10-18T13:55:05.776394Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:3300","nonce":0},{"type":"v1","addr":"172.21.15.114:6789","nonce":0}]},"addr":"172.21.15.114:6789/0","public_addr":"172.21.15.114:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-18T13:56:48.168 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2023-10-18T13:56:48.194 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:47 smithi172 ceph-mon[103574]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:48.195 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:47 smithi172 ceph-mon[103574]: Deploying daemon mon.b on smithi158 2023-10-18T13:56:48.195 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:47 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:48.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:47 smithi114 ceph-mon[99494]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:48.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:47 smithi114 ceph-mon[99494]: Deploying daemon mon.b on smithi158 2023-10-18T13:56:48.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:47 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:49.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:48 smithi172 ceph-mon[103574]: from='client.? 172.21.15.172:0/4080503121' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T13:56:49.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:48 smithi114 ceph-mon[99494]: from='client.? 172.21.15.172:0/4080503121' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T13:56:49.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 systemd[1]: Starting Ceph mon.b for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T13:56:49.567 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-18T13:56:49.568 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-18T13:56:50.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 podman[103277]: 2023-10-18T13:56:50.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 bash[103277]: 6623d8e169123cd53e9d75e598b8b387f0097bff43f2cb61ba385e46e3f79401 2023-10-18T13:56:50.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: set uid:gid to 167:167 (ceph:ceph) 2023-10-18T13:56:50.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev), process ceph-mon, pid 7 2023-10-18T13:56:50.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: pidfile_write: ignore empty --pid-file 2023-10-18T13:56:50.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 systemd[1]: Started Ceph mon.b for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T13:56:50.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: load: jerasure load: lrc 2023-10-18T13:56:50.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: RocksDB version: 7.9.2 2023-10-18T13:56:50.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Git sha 0 2023-10-18T13:56:50.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Compile date 2023-10-16 22:08:19 2023-10-18T13:56:50.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: DB SUMMARY 2023-10-18T13:56:50.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: DB Session ID: 7KA2UOX8DL7EK0MA8YI3 2023-10-18T13:56:50.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: CURRENT file: CURRENT 2023-10-18T13:56:50.025 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: IDENTITY file: IDENTITY 2023-10-18T13:56:50.025 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-18T13:56:50.025 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-18T13:56:50.025 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-18T13:56:50.025 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.error_if_exists: 0 2023-10-18T13:56:50.026 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.create_if_missing: 0 2023-10-18T13:56:50.026 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.paranoid_checks: 1 2023-10-18T13:56:50.026 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-18T13:56:50.026 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-18T13:56:50.026 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-18T13:56:50.027 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.env: 0x55b9b2716da0 2023-10-18T13:56:50.027 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.fs: PosixFileSystem 2023-10-18T13:56:50.027 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.info_log: 0x55b9b40c7660 2023-10-18T13:56:50.027 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_file_opening_threads: 16 2023-10-18T13:56:50.027 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.statistics: (nil) 2023-10-18T13:56:50.027 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.use_fsync: 0 2023-10-18T13:56:50.028 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_log_file_size: 0 2023-10-18T13:56:50.028 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-18T13:56:50.028 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-18T13:56:50.028 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.keep_log_file_num: 1000 2023-10-18T13:56:50.028 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.recycle_log_file_num: 0 2023-10-18T13:56:50.029 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.allow_fallocate: 1 2023-10-18T13:56:50.029 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.allow_mmap_reads: 0 2023-10-18T13:56:50.029 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.allow_mmap_writes: 0 2023-10-18T13:56:50.029 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.use_direct_reads: 0 2023-10-18T13:56:50.029 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-18T13:56:50.029 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.create_missing_column_families: 0 2023-10-18T13:56:50.030 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.db_log_dir: 2023-10-18T13:56:50.030 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.wal_dir: 2023-10-18T13:56:50.030 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-18T13:56:50.030 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-18T13:56:50.030 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-18T13:56:50.031 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-18T13:56:50.031 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-18T13:56:50.031 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-18T13:56:50.031 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.advise_random_on_open: 1 2023-10-18T13:56:50.031 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.db_write_buffer_size: 0 2023-10-18T13:56:50.032 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.write_buffer_manager: 0x55b9b407f360 2023-10-18T13:56:50.032 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-18T13:56:50.032 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-18T13:56:50.032 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-18T13:56:50.032 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.rate_limiter: (nil) 2023-10-18T13:56:50.032 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-18T13:56:50.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.wal_recovery_mode: 2 2023-10-18T13:56:50.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.enable_thread_tracking: 0 2023-10-18T13:56:50.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.enable_pipelined_write: 0 2023-10-18T13:56:50.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.unordered_write: 0 2023-10-18T13:56:50.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-18T13:56:50.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-18T13:56:50.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-18T13:56:50.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-18T13:56:50.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.row_cache: None 2023-10-18T13:56:50.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.wal_filter: None 2023-10-18T13:56:50.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-18T13:56:50.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.allow_ingest_behind: 0 2023-10-18T13:56:50.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.two_write_queues: 0 2023-10-18T13:56:50.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.manual_wal_flush: 0 2023-10-18T13:56:50.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.wal_compression: 0 2023-10-18T13:56:50.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.atomic_flush: 0 2023-10-18T13:56:50.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-18T13:56:50.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-18T13:56:50.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-18T13:56:50.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.log_readahead_size: 0 2023-10-18T13:56:50.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-18T13:56:50.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.best_efforts_recovery: 0 2023-10-18T13:56:50.037 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-18T13:56:50.038 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-18T13:56:50.038 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.allow_data_in_errors: 0 2023-10-18T13:56:50.038 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.db_host_id: __hostname__ 2023-10-18T13:56:50.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-18T13:56:50.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_background_jobs: 2 2023-10-18T13:56:50.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_background_compactions: -1 2023-10-18T13:56:50.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_subcompactions: 1 2023-10-18T13:56:50.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-18T13:56:50.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-18T13:56:50.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-18T13:56:50.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_total_wal_size: 0 2023-10-18T13:56:50.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-18T13:56:50.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-18T13:56:50.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-18T13:56:50.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-18T13:56:50.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_open_files: -1 2023-10-18T13:56:50.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.bytes_per_sync: 0 2023-10-18T13:56:50.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-18T13:56:50.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-18T13:56:50.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compaction_readahead_size: 0 2023-10-18T13:56:50.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_background_flushes: -1 2023-10-18T13:56:50.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Compression algorithms supported: 2023-10-18T13:56:50.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-18T13:56:50.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: kZSTD supported: 0 2023-10-18T13:56:50.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: kXpressCompression supported: 0 2023-10-18T13:56:50.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: kLZ4HCCompression supported: 1 2023-10-18T13:56:50.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: kZlibCompression supported: 1 2023-10-18T13:56:50.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: kSnappyCompression supported: 1 2023-10-18T13:56:50.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: kLZ4Compression supported: 1 2023-10-18T13:56:50.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: kBZip2Compression supported: 0 2023-10-18T13:56:50.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-18T13:56:50.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-18T13:56:50.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-18T13:56:50.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-18T13:56:50.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-18T13:56:50.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.merge_operator: 2023-10-18T13:56:50.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compaction_filter: None 2023-10-18T13:56:50.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compaction_filter_factory: None 2023-10-18T13:56:50.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.sst_partitioner_factory: None 2023-10-18T13:56:50.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-18T13:56:50.046 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-18T13:56:50.046 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b9b40c7760) 2023-10-18T13:56:50.046 INFO:journalctl@ceph.mon.b.smithi158.stdout: cache_index_and_filter_blocks: 1 2023-10-18T13:56:50.046 INFO:journalctl@ceph.mon.b.smithi158.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-18T13:56:50.046 INFO:journalctl@ceph.mon.b.smithi158.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-18T13:56:50.047 INFO:journalctl@ceph.mon.b.smithi158.stdout: pin_top_level_index_and_filter: 1 2023-10-18T13:56:50.047 INFO:journalctl@ceph.mon.b.smithi158.stdout: index_type: 0 2023-10-18T13:56:50.047 INFO:journalctl@ceph.mon.b.smithi158.stdout: data_block_index_type: 0 2023-10-18T13:56:50.047 INFO:journalctl@ceph.mon.b.smithi158.stdout: index_shortening: 1 2023-10-18T13:56:50.047 INFO:journalctl@ceph.mon.b.smithi158.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-18T13:56:50.047 INFO:journalctl@ceph.mon.b.smithi158.stdout: checksum: 4 2023-10-18T13:56:50.048 INFO:journalctl@ceph.mon.b.smithi158.stdout: no_block_cache: 0 2023-10-18T13:56:50.048 INFO:journalctl@ceph.mon.b.smithi158.stdout: block_cache: 0x55b9b411d1f0 2023-10-18T13:56:50.048 INFO:journalctl@ceph.mon.b.smithi158.stdout: block_cache_name: BinnedLRUCache 2023-10-18T13:56:50.048 INFO:journalctl@ceph.mon.b.smithi158.stdout: block_cache_options: 2023-10-18T13:56:50.048 INFO:journalctl@ceph.mon.b.smithi158.stdout: capacity : 536870912 2023-10-18T13:56:50.049 INFO:journalctl@ceph.mon.b.smithi158.stdout: num_shard_bits : 4 2023-10-18T13:56:50.049 INFO:journalctl@ceph.mon.b.smithi158.stdout: strict_capacity_limit : 0 2023-10-18T13:56:50.049 INFO:journalctl@ceph.mon.b.smithi158.stdout: high_pri_pool_ratio: 0.000 2023-10-18T13:56:50.049 INFO:journalctl@ceph.mon.b.smithi158.stdout: block_cache_compressed: (nil) 2023-10-18T13:56:50.049 INFO:journalctl@ceph.mon.b.smithi158.stdout: persistent_cache: (nil) 2023-10-18T13:56:50.049 INFO:journalctl@ceph.mon.b.smithi158.stdout: block_size: 4096 2023-10-18T13:56:50.050 INFO:journalctl@ceph.mon.b.smithi158.stdout: block_size_deviation: 10 2023-10-18T13:56:50.050 INFO:journalctl@ceph.mon.b.smithi158.stdout: block_restart_interval: 16 2023-10-18T13:56:50.050 INFO:journalctl@ceph.mon.b.smithi158.stdout: index_block_restart_interval: 1 2023-10-18T13:56:50.050 INFO:journalctl@ceph.mon.b.smithi158.stdout: metadata_block_size: 4096 2023-10-18T13:56:50.050 INFO:journalctl@ceph.mon.b.smithi158.stdout: partition_filters: 0 2023-10-18T13:56:50.051 INFO:journalctl@ceph.mon.b.smithi158.stdout: use_delta_encoding: 1 2023-10-18T13:56:50.051 INFO:journalctl@ceph.mon.b.smithi158.stdout: filter_policy: bloomfilter 2023-10-18T13:56:50.051 INFO:journalctl@ceph.mon.b.smithi158.stdout: whole_key_filtering: 1 2023-10-18T13:56:50.051 INFO:journalctl@ceph.mon.b.smithi158.stdout: verify_compression: 0 2023-10-18T13:56:50.051 INFO:journalctl@ceph.mon.b.smithi158.stdout: read_amp_bytes_per_bit: 0 2023-10-18T13:56:50.051 INFO:journalctl@ceph.mon.b.smithi158.stdout: format_version: 5 2023-10-18T13:56:50.052 INFO:journalctl@ceph.mon.b.smithi158.stdout: enable_index_compression: 1 2023-10-18T13:56:50.052 INFO:journalctl@ceph.mon.b.smithi158.stdout: block_align: 0 2023-10-18T13:56:50.052 INFO:journalctl@ceph.mon.b.smithi158.stdout: max_auto_readahead_size: 262144 2023-10-18T13:56:50.052 INFO:journalctl@ceph.mon.b.smithi158.stdout: prepopulate_block_cache: 0 2023-10-18T13:56:50.052 INFO:journalctl@ceph.mon.b.smithi158.stdout: initial_auto_readahead_size: 8192 2023-10-18T13:56:50.053 INFO:journalctl@ceph.mon.b.smithi158.stdout: num_file_reads_for_auto_readahead: 2 2023-10-18T13:56:50.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.write_buffer_size: 33554432 2023-10-18T13:56:50.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_write_buffer_number: 2 2023-10-18T13:56:50.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compression: NoCompression 2023-10-18T13:56:50.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.bottommost_compression: Disabled 2023-10-18T13:56:50.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.prefix_extractor: nullptr 2023-10-18T13:56:50.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-18T13:56:50.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.num_levels: 7 2023-10-18T13:56:50.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-18T13:56:50.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-18T13:56:50.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-18T13:56:50.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-18T13:56:50.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-18T13:56:50.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-18T13:56:50.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-18T13:56:50.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-18T13:56:50.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-18T13:56:50.056 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-18T13:56:50.056 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-18T13:56:50.056 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-18T13:56:50.056 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-18T13:56:50.056 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compression_opts.level: 32767 2023-10-18T13:56:50.057 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compression_opts.strategy: 0 2023-10-18T13:56:50.057 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-18T13:56:50.057 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-18T13:56:50.057 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-18T13:56:50.057 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-18T13:56:50.058 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compression_opts.enabled: false 2023-10-18T13:56:50.058 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-18T13:56:50.058 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-18T13:56:50.058 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-18T13:56:50.058 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-18T13:56:50.058 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.target_file_size_base: 67108864 2023-10-18T13:56:50.059 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-18T13:56:50.059 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-18T13:56:50.059 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-18T13:56:50.059 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-18T13:56:50.059 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-18T13:56:50.059 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-18T13:56:50.060 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-18T13:56:50.060 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-18T13:56:50.060 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-18T13:56:50.060 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-18T13:56:50.060 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-18T13:56:50.061 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-18T13:56:50.061 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-18T13:56:50.061 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-18T13:56:50.061 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.arena_block_size: 1048576 2023-10-18T13:56:50.061 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-18T13:56:50.061 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-18T13:56:50.062 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.disable_auto_compactions: 0 2023-10-18T13:56:50.062 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-18T13:56:50.062 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-18T13:56:50.062 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-18T13:56:50.062 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-18T13:56:50.062 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-18T13:56:50.063 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-18T13:56:50.063 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-18T13:56:50.063 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-18T13:56:50.063 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-18T13:56:50.063 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-18T13:56:50.064 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.table_properties_collectors: 2023-10-18T13:56:50.064 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.inplace_update_support: 0 2023-10-18T13:56:50.064 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-18T13:56:50.064 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-18T13:56:50.064 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-18T13:56:50.064 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-18T13:56:50.065 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.bloom_locality: 0 2023-10-18T13:56:50.065 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.max_successive_merges: 0 2023-10-18T13:56:50.065 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-18T13:56:50.065 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.paranoid_file_checks: 0 2023-10-18T13:56:50.065 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.force_consistency_checks: 1 2023-10-18T13:56:50.065 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.report_bg_io_stats: 0 2023-10-18T13:56:50.066 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.ttl: 2592000 2023-10-18T13:56:50.066 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-18T13:56:50.066 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-18T13:56:50.066 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-18T13:56:50.066 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.enable_blob_files: false 2023-10-18T13:56:50.067 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.min_blob_size: 0 2023-10-18T13:56:50.067 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.blob_file_size: 268435456 2023-10-18T13:56:50.067 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-18T13:56:50.067 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-18T13:56:50.067 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-18T13:56:50.067 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-18T13:56:50.068 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-18T13:56:50.068 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.blob_file_starting_level: 0 2023-10-18T13:56:50.068 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-18T13:56:50.068 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-18T13:56:50.068 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-18T13:56:50.069 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: debaad81-df77-4ba9-b6a7-2fda2d67feb0 2023-10-18T13:56:50.069 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697637409754868, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-18T13:56:50.069 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-18T13:56:50.069 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697637409755268, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1697637409, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "debaad81-df77-4ba9-b6a7-2fda2d67feb0", "db_session_id": "7KA2UOX8DL7EK0MA8YI3", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-18T13:56:50.069 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697637409755346, "job": 1, "event": "recovery_finished"} 2023-10-18T13:56:50.069 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-18T13:56:50.070 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-18T13:56:50.070 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b9b41ba000 2023-10-18T13:56:50.070 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: DB pointer 0x55b9b41a6000 2023-10-18T13:56:50.070 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-18T13:56:50.070 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-18T13:56:50.071 INFO:journalctl@ceph.mon.b.smithi158.stdout: ** DB Stats ** 2023-10-18T13:56:50.071 INFO:journalctl@ceph.mon.b.smithi158.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T13:56:50.071 INFO:journalctl@ceph.mon.b.smithi158.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-18T13:56:50.071 INFO:journalctl@ceph.mon.b.smithi158.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-18T13:56:50.071 INFO:journalctl@ceph.mon.b.smithi158.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T13:56:50.071 INFO:journalctl@ceph.mon.b.smithi158.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-18T13:56:50.072 INFO:journalctl@ceph.mon.b.smithi158.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-18T13:56:50.072 INFO:journalctl@ceph.mon.b.smithi158.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-18T13:56:50.072 INFO:journalctl@ceph.mon.b.smithi158.stdout: 2023-10-18T13:56:50.072 INFO:journalctl@ceph.mon.b.smithi158.stdout: ** Compaction Stats [default] ** 2023-10-18T13:56:50.072 INFO:journalctl@ceph.mon.b.smithi158.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-18T13:56:50.072 INFO:journalctl@ceph.mon.b.smithi158.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-18T13:56:50.073 INFO:journalctl@ceph.mon.b.smithi158.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-18T13:56:50.073 INFO:journalctl@ceph.mon.b.smithi158.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-18T13:56:50.073 INFO:journalctl@ceph.mon.b.smithi158.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-18T13:56:50.073 INFO:journalctl@ceph.mon.b.smithi158.stdout: 2023-10-18T13:56:50.073 INFO:journalctl@ceph.mon.b.smithi158.stdout: ** Compaction Stats [default] ** 2023-10-18T13:56:50.074 INFO:journalctl@ceph.mon.b.smithi158.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-18T13:56:50.074 INFO:journalctl@ceph.mon.b.smithi158.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-18T13:56:50.074 INFO:journalctl@ceph.mon.b.smithi158.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-18T13:56:50.074 INFO:journalctl@ceph.mon.b.smithi158.stdout: 2023-10-18T13:56:50.074 INFO:journalctl@ceph.mon.b.smithi158.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-18T13:56:50.075 INFO:journalctl@ceph.mon.b.smithi158.stdout: 2023-10-18T13:56:50.075 INFO:journalctl@ceph.mon.b.smithi158.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-18T13:56:50.075 INFO:journalctl@ceph.mon.b.smithi158.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-18T13:56:50.075 INFO:journalctl@ceph.mon.b.smithi158.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-18T13:56:50.075 INFO:journalctl@ceph.mon.b.smithi158.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-18T13:56:50.075 INFO:journalctl@ceph.mon.b.smithi158.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-18T13:56:50.076 INFO:journalctl@ceph.mon.b.smithi158.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-18T13:56:50.076 INFO:journalctl@ceph.mon.b.smithi158.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T13:56:50.076 INFO:journalctl@ceph.mon.b.smithi158.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-18T13:56:50.076 INFO:journalctl@ceph.mon.b.smithi158.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-18T13:56:50.076 INFO:journalctl@ceph.mon.b.smithi158.stdout: Block cache BinnedLRUCache@0x55b9b411d1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-10-18T13:56:50.077 INFO:journalctl@ceph.mon.b.smithi158.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-18T13:56:50.077 INFO:journalctl@ceph.mon.b.smithi158.stdout: 2023-10-18T13:56:50.077 INFO:journalctl@ceph.mon.b.smithi158.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-18T13:56:50.077 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-18T13:56:50.077 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: using public_addr v2:172.21.15.158:0/0 -> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] 2023-10-18T13:56:50.077 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: starting mon.b rank -1 at public addrs [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] at bind addrs [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:56:50.078 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(???) e0 preinit fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:56:50.078 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(synchronizing).mds e1 new map 2023-10-18T13:56:50.078 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-18T13:56:50.078 INFO:journalctl@ceph.mon.b.smithi158.stdout: e1 2023-10-18T13:56:50.078 INFO:journalctl@ceph.mon.b.smithi158.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T13:56:50.079 INFO:journalctl@ceph.mon.b.smithi158.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-18T13:56:50.079 INFO:journalctl@ceph.mon.b.smithi158.stdout: legacy client fscid: -1 2023-10-18T13:56:50.079 INFO:journalctl@ceph.mon.b.smithi158.stdout: 2023-10-18T13:56:50.079 INFO:journalctl@ceph.mon.b.smithi158.stdout: No filesystems configured 2023-10-18T13:56:50.079 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-18T13:56:50.079 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-18T13:56:50.080 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-18T13:56:50.080 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-18T13:56:50.080 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-18T13:56:50.080 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-18T13:56:50.080 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-18T13:56:50.081 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T13:56:50.081 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T13:56:50.081 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-18T13:56:50.081 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:50.081 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:56:50.081 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.082 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.082 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.082 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.082 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi158", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:56:50.082 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:50.083 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:56:50.083 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: Updating smithi158:/etc/ceph/ceph.conf 2023-10-18T13:56:50.083 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: Deploying cephadm binary to smithi172 2023-10-18T13:56:50.083 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:50.083 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: Updating smithi158:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:56:50.083 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:50.084 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:56:50.084 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.084 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.084 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.084 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.085 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:50.085 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.085 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: Added host smithi172 2023-10-18T13:56:50.085 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:50.085 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.085 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.086 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T13:56:50.086 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:50.086 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:50.086 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/4105950346' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-18T13:56:50.086 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.087 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.087 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.087 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.087 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:56:50.087 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:50.088 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:56:50.088 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: Updating smithi172:/etc/ceph/ceph.conf 2023-10-18T13:56:50.088 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:50.088 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:56:50.088 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:56:50.089 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/4105950346' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-18T13:56:50.089 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: osdmap e4: 0 total, 0 up, 0 in 2023-10-18T13:56:50.089 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.089 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.089 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.089 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:50.090 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi114:172.21.15.114=a;smithi158:172.21.15.158=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:56:50.090 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: Saving service mon spec with placement smithi114:172.21.15.114=a;smithi158:172.21.15.158=b;smithi172:172.21.15.172=c;count:3 2023-10-18T13:56:50.090 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.090 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:50.090 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:50.091 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:56:50.091 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.091 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:56:50.091 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:50.091 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: Deploying daemon mon.c on smithi172 2023-10-18T13:56:50.091 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:50.092 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:50.092 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='client.? 172.21.15.172:0/2477412730' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T13:56:50.092 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:56:50.092 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.a calling monitor election 2023-10-18T13:56:50.092 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:50.092 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:50.093 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:50.093 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:50.093 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.c calling monitor election 2023-10-18T13:56:50.093 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:50.093 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:50.094 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:50.094 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:50.094 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-18T13:56:50.094 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: monmap e2: 2 mons at {a=[v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0],c=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-18T13:56:50.094 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: fsmap 2023-10-18T13:56:50.094 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: osdmap e4: 0 total, 0 up, 0 in 2023-10-18T13:56:50.095 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mgrmap e13: x(active, since 42s) 2023-10-18T13:56:50.095 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: overall HEALTH_OK 2023-10-18T13:56:50.095 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.095 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.095 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:50.096 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:56:50.096 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:50.096 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:50.096 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: Deploying daemon mon.b on smithi158 2023-10-18T13:56:50.096 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:50.096 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: from='client.? 172.21.15.172:0/4080503121' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T13:56:50.097 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:49 smithi158 ceph-mon[103317]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-18T13:56:50.139 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T13:56:55.202 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T13:56:55.203 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":3,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","modified":"2023-10-18T13:56:49.781309Z","created":"2023-10-18T13:55:05.776394Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:3300","nonce":0},{"type":"v1","addr":"172.21.15.114:6789","nonce":0}]},"addr":"172.21.15.114:6789/0","public_addr":"172.21.15.114:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:3300","nonce":0},{"type":"v1","addr":"172.21.15.158:6789","nonce":0}]},"addr":"172.21.15.158:6789/0","public_addr":"172.21.15.158:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-10-18T13:56:55.205 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 3 2023-10-18T13:56:55.227 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:56:55.227 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: mon.a calling monitor election 2023-10-18T13:56:55.227 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: mon.c calling monitor election 2023-10-18T13:56:55.228 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.228 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:55.228 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:55.228 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.228 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.229 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: mon.b calling monitor election 2023-10-18T13:56:55.229 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:55.229 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.229 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.229 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.229 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-18T13:56:55.230 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: monmap e3: 3 mons at {a=[v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0],b=[v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0],c=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-18T13:56:55.230 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: fsmap 2023-10-18T13:56:55.230 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: osdmap e4: 0 total, 0 up, 0 in 2023-10-18T13:56:55.230 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: mgrmap e13: x(active, since 50s) 2023-10-18T13:56:55.230 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: overall HEALTH_OK 2023-10-18T13:56:55.230 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:55.231 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:55.231 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:55.231 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:54 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:55.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:56:55.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: mon.a calling monitor election 2023-10-18T13:56:55.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: mon.c calling monitor election 2023-10-18T13:56:55.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:55.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:55.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: mon.b calling monitor election 2023-10-18T13:56:55.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:55.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-18T13:56:55.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: monmap e3: 3 mons at {a=[v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0],b=[v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0],c=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-18T13:56:55.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: fsmap 2023-10-18T13:56:55.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: osdmap e4: 0 total, 0 up, 0 in 2023-10-18T13:56:55.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: mgrmap e13: x(active, since 50s) 2023-10-18T13:56:55.275 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: overall HEALTH_OK 2023-10-18T13:56:55.275 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:55.275 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:55.275 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:55.275 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:54 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:55.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:56:55.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: mon.a calling monitor election 2023-10-18T13:56:55.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: mon.c calling monitor election 2023-10-18T13:56:55.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:56:55.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:55.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: mon.b calling monitor election 2023-10-18T13:56:55.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:55.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:55.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-18T13:56:55.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: monmap e3: 3 mons at {a=[v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0],b=[v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0],c=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-18T13:56:55.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: fsmap 2023-10-18T13:56:55.342 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: osdmap e4: 0 total, 0 up, 0 in 2023-10-18T13:56:55.342 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: mgrmap e13: x(active, since 50s) 2023-10-18T13:56:55.342 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: overall HEALTH_OK 2023-10-18T13:56:55.342 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:55.342 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:55.343 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:55.343 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:54 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:55.589 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-18T13:56:55.589 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-18T13:56:56.159 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:56:56.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:55 smithi158 ceph-mon[103317]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:56.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:55 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:56.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:55 smithi158 ceph-mon[103317]: from='client.? 172.21.15.172:0/4253045348' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T13:56:56.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:55 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:56.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:55 smithi172 ceph-mon[103574]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:56.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:55 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:56.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:55 smithi172 ceph-mon[103574]: from='client.? 172.21.15.172:0/4253045348' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T13:56:56.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:55 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:56.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:55 smithi114 ceph-mon[99494]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:56.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:55 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:56:56.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:55 smithi114 ceph-mon[99494]: from='client.? 172.21.15.172:0/4253045348' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-18T13:56:56.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:55 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:56:57.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:57.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:57.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:56:57.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: Updating smithi114:/etc/ceph/ceph.conf 2023-10-18T13:56:57.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: Updating smithi158:/etc/ceph/ceph.conf 2023-10-18T13:56:57.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: Updating smithi172:/etc/ceph/ceph.conf 2023-10-18T13:56:57.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: Updating smithi114:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:57.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:57.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:57.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:57 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.601 INFO:teuthology.orchestra.run.smithi114.stdout:# minimal ceph.conf for d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:56:57.601 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2023-10-18T13:56:57.601 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T13:56:57.602 INFO:teuthology.orchestra.run.smithi114.stdout: mon_host = [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2023-10-18T13:56:57.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:57.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:57.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:56:57.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: Updating smithi114:/etc/ceph/ceph.conf 2023-10-18T13:56:57.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: Updating smithi158:/etc/ceph/ceph.conf 2023-10-18T13:56:57.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: Updating smithi172:/etc/ceph/ceph.conf 2023-10-18T13:56:57.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: Updating smithi114:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:57.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:57.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:57.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:57 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:57.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:57.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:56:57.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: Updating smithi114:/etc/ceph/ceph.conf 2023-10-18T13:56:57.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: Updating smithi158:/etc/ceph/ceph.conf 2023-10-18T13:56:57.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: Updating smithi172:/etc/ceph/ceph.conf 2023-10-18T13:56:57.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: Updating smithi114:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:57.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:57.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:56:57.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:57.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:57 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:58.068 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-18T13:56:58.068 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:56:58.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.conf 2023-10-18T13:56:58.099 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:56:58.099 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:56:58.176 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T13:56:58.176 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/ceph/ceph.conf 2023-10-18T13:56:58.209 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T13:56:58.210 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:56:58.278 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T13:56:58.278 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2023-10-18T13:56:58.313 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T13:56:58.314 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:56:58.383 INFO:tasks.cephadm:enabling module snap_schedule 2023-10-18T13:56:58.383 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2023-10-18T13:56:58.452 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:58 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:58.452 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:58 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:58.453 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:58 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:58.453 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:58 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:58.453 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:58 smithi114 ceph-mon[99494]: Reconfiguring mon.a (unknown last config time)... 2023-10-18T13:56:58.453 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:58 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:56:58.453 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:58 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T13:56:58.454 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:58 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:58.454 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:58 smithi114 ceph-mon[99494]: Reconfiguring daemon mon.a on smithi114 2023-10-18T13:56:58.454 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:58 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/635262909' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:58.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:58 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:58.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:58 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:58.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:58 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:58.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:58 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:58.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:58 smithi158 ceph-mon[103317]: Reconfiguring mon.a (unknown last config time)... 2023-10-18T13:56:58.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:58 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:56:58.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:58 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T13:56:58.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:58 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:58.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:58 smithi158 ceph-mon[103317]: Reconfiguring daemon mon.a on smithi114 2023-10-18T13:56:58.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:58 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/635262909' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:58.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:58 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:58.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:58 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:58.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:58 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:58.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:58 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:58.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:58 smithi172 ceph-mon[103574]: Reconfiguring mon.a (unknown last config time)... 2023-10-18T13:56:58.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:58 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:56:58.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:58 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T13:56:58.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:58 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:58.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:58 smithi172 ceph-mon[103574]: Reconfiguring daemon mon.a on smithi114 2023-10-18T13:56:58.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:58 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/635262909' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:59.017 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:56:59.741 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:59 smithi114 ceph-mon[99494]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:56:59.741 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:59 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:59.741 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:59 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:56:59.742 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:59 smithi114 ceph-mon[99494]: Reconfiguring mon.b (monmap changed)... 2023-10-18T13:56:59.742 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:59 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:56:59.742 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:59 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T13:56:59.742 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:59 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:56:59.743 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:59 smithi114 ceph-mon[99494]: Reconfiguring daemon mon.b on smithi158 2023-10-18T13:56:59.743 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:56:59 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:57:00.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:59 smithi158 ceph-mon[103317]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:00.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:59 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:57:00.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:59 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:57:00.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:59 smithi158 ceph-mon[103317]: Reconfiguring mon.b (monmap changed)... 2023-10-18T13:57:00.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:59 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:57:00.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:59 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T13:57:00.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:59 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:00.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:59 smithi158 ceph-mon[103317]: Reconfiguring daemon mon.b on smithi158 2023-10-18T13:57:00.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:56:59 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:57:00.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:59 smithi172 ceph-mon[103574]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:00.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:59 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:57:00.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:59 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:57:00.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:59 smithi172 ceph-mon[103574]: Reconfiguring mon.b (monmap changed)... 2023-10-18T13:57:00.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:59 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:57:00.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:59 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T13:57:00.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:59 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:00.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:59 smithi172 ceph-mon[103574]: Reconfiguring daemon mon.b on smithi158 2023-10-18T13:57:00.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:56:59 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:57:01.047 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:00 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:57:01.048 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:00 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:57:01.048 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:00 smithi172 ceph-mon[103574]: Reconfiguring mon.c (monmap changed)... 2023-10-18T13:57:01.048 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:00 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:57:01.048 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:00 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T13:57:01.049 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:00 smithi172 ceph-mon[103574]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:01.049 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:00 smithi172 ceph-mon[103574]: Reconfiguring daemon mon.c on smithi172 2023-10-18T13:57:01.049 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:00 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/259446603' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-18T13:57:01.149 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:00 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:57:01.150 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:00 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:57:01.150 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:00 smithi114 ceph-mon[99494]: Reconfiguring mon.c (monmap changed)... 2023-10-18T13:57:01.150 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:00 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:57:01.150 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:00 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T13:57:01.150 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:00 smithi114 ceph-mon[99494]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:01.151 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:00 smithi114 ceph-mon[99494]: Reconfiguring daemon mon.c on smithi172 2023-10-18T13:57:01.151 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:00 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/259446603' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-18T13:57:01.151 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: ignoring --setuser ceph since I am not root 2023-10-18T13:57:01.151 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: ignoring --setgroup ceph since I am not root 2023-10-18T13:57:01.152 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:01.064+0000 7f3c3b778200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-18T13:57:01.152 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:01.145+0000 7f3c3b778200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T13:57:01.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:00 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:57:01.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:00 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' 2023-10-18T13:57:01.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:00 smithi158 ceph-mon[103317]: Reconfiguring mon.c (monmap changed)... 2023-10-18T13:57:01.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:00 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:57:01.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:00 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T13:57:01.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:00 smithi158 ceph-mon[103317]: from='mgr.14152 172.21.15.114:0/4124583768' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:01.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:00 smithi158 ceph-mon[103317]: Reconfiguring daemon mon.c on smithi172 2023-10-18T13:57:01.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:00 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/259446603' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-18T13:57:01.275 INFO:tasks.cephadm:Adding mgr.x on smithi114 2023-10-18T13:57:01.275 INFO:tasks.cephadm:Adding mgr.y on smithi158 2023-10-18T13:57:01.275 INFO:tasks.cephadm:Adding mgr.z on smithi172 2023-10-18T13:57:01.276 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch apply mgr '3;smithi114=x;smithi158=y;smithi172=z' 2023-10-18T13:57:01.510 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:01.236+0000 7f3c3b778200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T13:57:01.511 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:01.337+0000 7f3c3b778200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T13:57:01.834 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T13:57:01.838 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:01.507+0000 7f3c3b778200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T13:57:02.178 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:01 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/259446603' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-18T13:57:02.178 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:01 smithi114 ceph-mon[99494]: mgrmap e14: x(active, since 56s) 2023-10-18T13:57:02.178 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:01.863+0000 7f3c3b778200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T13:57:02.179 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:01.994+0000 7f3c3b778200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T13:57:02.179 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:02 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:02.081+0000 7f3c3b778200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T13:57:02.179 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:02 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:02.175+0000 7f3c3b778200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T13:57:02.215 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:01 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/259446603' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-18T13:57:02.215 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:01 smithi172 ceph-mon[103574]: mgrmap e14: x(active, since 56s) 2023-10-18T13:57:02.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:01 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/259446603' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-18T13:57:02.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:01 smithi158 ceph-mon[103317]: mgrmap e14: x(active, since 56s) 2023-10-18T13:57:03.088 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:02 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:02.591+0000 7f3c3b778200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T13:57:03.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:03.241+0000 7f3c3b778200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-18T13:57:03.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:03.322+0000 7f3c3b778200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T13:57:04.354 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:04.089+0000 7f3c3b778200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T13:57:04.355 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:04.180+0000 7f3c3b778200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-18T13:57:04.635 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:04.352+0000 7f3c3b778200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T13:57:05.007 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:04.632+0000 7f3c3b778200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-18T13:57:05.007 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:04.857+0000 7f3c3b778200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T13:57:05.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:05 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:05.004+0000 7f3c3b778200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T13:57:05.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:05 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:05.268+0000 7f3c3b778200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T13:57:06.291 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:05 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:05.963+0000 7f3c3b778200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T13:57:06.291 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:06 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:06.093+0000 7f3c3b778200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-18T13:57:06.291 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:06 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:06.288+0000 7f3c3b778200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T13:57:06.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:06 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:06.402+0000 7f3c3b778200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T13:57:07.088 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:06 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:06.619+0000 7f3c3b778200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T13:57:07.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: Active manager daemon x restarted 2023-10-18T13:57:07.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: Activating manager daemon x 2023-10-18T13:57:07.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: osdmap e5: 0 total, 0 up, 0 in 2023-10-18T13:57:07.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: mgrmap e15: x(active, starting, since 0.00666245s) 2023-10-18T13:57:07.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:57:07.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:57:07.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:57:07.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-18T13:57:07.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T13:57:07.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T13:57:07.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T13:57:07.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: Manager daemon x is now available 2023-10-18T13:57:07.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:07.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:07.838 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T13:57:07.473+0000 7f3c3b778200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T13:57:07.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: Active manager daemon x restarted 2023-10-18T13:57:07.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: Activating manager daemon x 2023-10-18T13:57:07.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: osdmap e5: 0 total, 0 up, 0 in 2023-10-18T13:57:07.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: mgrmap e15: x(active, starting, since 0.00666245s) 2023-10-18T13:57:07.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:57:07.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:57:07.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:57:07.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-18T13:57:07.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T13:57:07.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T13:57:07.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T13:57:07.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: Manager daemon x is now available 2023-10-18T13:57:07.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:07.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:08.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: Active manager daemon x restarted 2023-10-18T13:57:08.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: Activating manager daemon x 2023-10-18T13:57:08.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: osdmap e5: 0 total, 0 up, 0 in 2023-10-18T13:57:08.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: mgrmap e15: x(active, starting, since 0.00666245s) 2023-10-18T13:57:08.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:57:08.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:57:08.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:57:08.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-18T13:57:08.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-18T13:57:08.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-18T13:57:08.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-18T13:57:08.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: Manager daemon x is now available 2023-10-18T13:57:08.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:08.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:08.504 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mgr update... 2023-10-18T13:57:08.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-18T13:57:08.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-18T13:57:08.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:08 smithi172 ceph-mon[103574]: [18/Oct/2023:13:57:07] ENGINE Bus STARTING 2023-10-18T13:57:08.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:08 smithi172 ceph-mon[103574]: mgrmap e16: x(active, since 1.00778s) 2023-10-18T13:57:08.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:08.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-18T13:57:08.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-18T13:57:08.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:08 smithi114 ceph-mon[99494]: [18/Oct/2023:13:57:07] ENGINE Bus STARTING 2023-10-18T13:57:08.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:08 smithi114 ceph-mon[99494]: mgrmap e16: x(active, since 1.00778s) 2023-10-18T13:57:08.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:08.903 DEBUG:teuthology.orchestra.run.smithi158:mgr.y> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.y.service 2023-10-18T13:57:08.906 DEBUG:teuthology.orchestra.run.smithi172:mgr.z> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.z.service 2023-10-18T13:57:08.908 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2023-10-18T13:57:08.909 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set client client_mount_timeout 600 2023-10-18T13:57:08.911 INFO:tasks.cephadm:setting config [client] debug_client = 20 2023-10-18T13:57:08.911 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set client debug_client 20 2023-10-18T13:57:08.931 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-18T13:57:08.932 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-18T13:57:08.932 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:08 smithi158 ceph-mon[103317]: [18/Oct/2023:13:57:07] ENGINE Bus STARTING 2023-10-18T13:57:08.932 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:08 smithi158 ceph-mon[103317]: mgrmap e16: x(active, since 1.00778s) 2023-10-18T13:57:08.932 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:08.937 INFO:journalctl@ceph.mgr.y.smithi158.stdout:-- Logs begin at Wed 2023-10-18 13:41:14 UTC. -- 2023-10-18T13:57:08.939 INFO:journalctl@ceph.mgr.z.smithi172.stdout:-- Logs begin at Wed 2023-10-18 13:40:49 UTC. -- 2023-10-18T13:57:08.955 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2023-10-18T13:57:08.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set client debug_ms 1 2023-10-18T13:57:08.998 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2023-10-18T13:57:08.999 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set client rados_mon_op_timeout 900 2023-10-18T13:57:09.041 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2023-10-18T13:57:09.041 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set client rados_osd_op_timeout 900 2023-10-18T13:57:09.084 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2023-10-18T13:57:09.085 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds debug_mds 20 2023-10-18T13:57:09.128 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2023-10-18T13:57:09.129 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds debug_mds_balancer 20 2023-10-18T13:57:09.172 INFO:tasks.cephadm:setting config [mds] debug_ms = 1 2023-10-18T13:57:09.173 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds debug_ms 1 2023-10-18T13:57:09.222 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2023-10-18T13:57:09.222 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_bal_fragment_size_max 10000 2023-10-18T13:57:09.269 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2023-10-18T13:57:09.270 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_bal_merge_size 5 2023-10-18T13:57:09.313 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2023-10-18T13:57:09.314 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_bal_split_bits 3 2023-10-18T13:57:09.386 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2023-10-18T13:57:09.386 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_bal_split_size 100 2023-10-18T13:57:09.434 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2023-10-18T13:57:09.435 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_debug_frag True 2023-10-18T13:57:09.460 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:09.469 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2023-10-18T13:57:09.470 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_debug_scatterstat True 2023-10-18T13:57:09.513 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2023-10-18T13:57:09.514 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_op_complaint_time 180 2023-10-18T13:57:09.563 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2023-10-18T13:57:09.563 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_verify_scatter True 2023-10-18T13:57:09.626 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2023-10-18T13:57:09.626 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds osd_op_complaint_time 180 2023-10-18T13:57:09.677 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2023-10-18T13:57:09.677 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds rados_mon_op_timeout 900 2023-10-18T13:57:09.722 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2023-10-18T13:57:09.723 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mds rados_osd_op_timeout 900 2023-10-18T13:57:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:09.776 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2023-10-18T13:57:09.777 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mgr debug_cephsqlite 20 2023-10-18T13:57:09.778 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:09 smithi114 ceph-mon[99494]: [18/Oct/2023:13:57:07] ENGINE Serving on https://172.21.15.114:7150 2023-10-18T13:57:09.778 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:09 smithi114 ceph-mon[99494]: [18/Oct/2023:13:57:08] ENGINE Serving on http://172.21.15.114:8765 2023-10-18T13:57:09.778 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:09 smithi114 ceph-mon[99494]: [18/Oct/2023:13:57:08] ENGINE Bus STARTED 2023-10-18T13:57:09.778 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:09 smithi114 ceph-mon[99494]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi114=x;smithi158=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:57:09.779 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:09 smithi114 ceph-mon[99494]: Saving service mgr spec with placement smithi114=x;smithi158=y;smithi172=z;count:3 2023-10-18T13:57:09.779 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:09.779 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:09.779 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:09.779 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:09.780 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:09.780 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:09.801 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:09.813 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2023-10-18T13:57:09.814 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-18T13:57:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:09.881 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2023-10-18T13:57:09.881 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-18T13:57:09.955 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2023-10-18T13:57:09.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set mon mon_op_complaint_time 120 2023-10-18T13:57:10.000 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2023-10-18T13:57:10.000 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config set osd osd_op_complaint_time 180 2023-10-18T13:57:10.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:09 smithi158 ceph-mon[103317]: [18/Oct/2023:13:57:07] ENGINE Serving on https://172.21.15.114:7150 2023-10-18T13:57:10.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:09 smithi158 ceph-mon[103317]: [18/Oct/2023:13:57:08] ENGINE Serving on http://172.21.15.114:8765 2023-10-18T13:57:10.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:09 smithi158 ceph-mon[103317]: [18/Oct/2023:13:57:08] ENGINE Bus STARTED 2023-10-18T13:57:10.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:09 smithi158 ceph-mon[103317]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi114=x;smithi158=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:57:10.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:09 smithi158 ceph-mon[103317]: Saving service mgr spec with placement smithi114=x;smithi158=y;smithi172=z;count:3 2023-10-18T13:57:10.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:10.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:10.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:10.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:10.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:10.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:10.059 DEBUG:tasks.cephadm:set 24 configs 2023-10-18T13:57:10.059 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi114') 2023-10-18T13:57:10.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:09 smithi172 ceph-mon[103574]: [18/Oct/2023:13:57:07] ENGINE Serving on https://172.21.15.114:7150 2023-10-18T13:57:10.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:09 smithi172 ceph-mon[103574]: [18/Oct/2023:13:57:08] ENGINE Serving on http://172.21.15.114:8765 2023-10-18T13:57:10.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:09 smithi172 ceph-mon[103574]: [18/Oct/2023:13:57:08] ENGINE Bus STARTED 2023-10-18T13:57:10.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:09 smithi172 ceph-mon[103574]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi114=x;smithi158=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:57:10.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:09 smithi172 ceph-mon[103574]: Saving service mgr spec with placement smithi114=x;smithi158=y;smithi172=z;count:3 2023-10-18T13:57:10.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:10.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:10.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:10.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:10.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:10.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:10.535 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:11.322 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:11 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:11.322 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:11 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:11.322 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:11 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi158", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:57:11.323 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:11 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:11.323 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:11 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:11.323 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:11 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:57:11.323 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:11 smithi114 ceph-mon[99494]: mgrmap e17: x(active, since 2s) 2023-10-18T13:57:11.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:11 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:11.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:11 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:11.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:11 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi158", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:57:11.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:11 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:11.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:11 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:11.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:11 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:57:11.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:11 smithi158 ceph-mon[103317]: mgrmap e17: x(active, since 2s) 2023-10-18T13:57:11.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:11 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:11.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:11 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:11.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:11 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi158", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:57:11.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:11 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:11.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:11 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:11.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:11 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:57:11.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:11 smithi172 ceph-mon[103574]: mgrmap e17: x(active, since 2s) 2023-10-18T13:57:11.575 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:11.644 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:11.655 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:13.247 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:13.247 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:13.248 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi114", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:57:13.248 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:13.248 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:13.248 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: Updating smithi114:/etc/ceph/ceph.conf 2023-10-18T13:57:13.248 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: Updating smithi158:/etc/ceph/ceph.conf 2023-10-18T13:57:13.249 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: Updating smithi172:/etc/ceph/ceph.conf 2023-10-18T13:57:13.249 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:57:13.249 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: Updating smithi114:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:57:13.249 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:57:13.250 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: Updating smithi114:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:57:13.250 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: Updating smithi158:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:57:13.250 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:57:13.250 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:57:13.250 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:57:13.251 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:12 smithi114 ceph-mon[99494]: Updating smithi114:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:57:13.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:13.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:13.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi114", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:57:13.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:13.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:13.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: Updating smithi114:/etc/ceph/ceph.conf 2023-10-18T13:57:13.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: Updating smithi158:/etc/ceph/ceph.conf 2023-10-18T13:57:13.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: Updating smithi172:/etc/ceph/ceph.conf 2023-10-18T13:57:13.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:57:13.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: Updating smithi114:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:57:13.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:57:13.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: Updating smithi114:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:57:13.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: Updating smithi158:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:57:13.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:57:13.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:57:13.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:57:13.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:12 smithi158 ceph-mon[103317]: Updating smithi114:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:57:13.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:13.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:13.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi114", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:57:13.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:13.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:13.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: Updating smithi114:/etc/ceph/ceph.conf 2023-10-18T13:57:13.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: Updating smithi158:/etc/ceph/ceph.conf 2023-10-18T13:57:13.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: Updating smithi172:/etc/ceph/ceph.conf 2023-10-18T13:57:13.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:57:13.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: Updating smithi114:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:57:13.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-18T13:57:13.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: Updating smithi114:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:57:13.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: Updating smithi158:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:57:13.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2023-10-18T13:57:13.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: Updating smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:57:13.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: Updating smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:57:13.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:12 smithi172 ceph-mon[103574]: Updating smithi114:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-18T13:57:14.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3100697434' entity='client.admin' 2023-10-18T13:57:14.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T13:57:14.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-18T13:57:14.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T13:57:14.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:14.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: Deploying daemon mgr.z on smithi172 2023-10-18T13:57:14.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:14 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1255923299' entity='client.admin' 2023-10-18T13:57:14.368 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.368 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.368 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3100697434' entity='client.admin' 2023-10-18T13:57:14.369 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.369 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.369 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.369 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.369 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.370 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T13:57:14.370 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-18T13:57:14.370 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T13:57:14.370 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:14.371 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: Deploying daemon mgr.z on smithi172 2023-10-18T13:57:14.371 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:14 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1255923299' entity='client.admin' 2023-10-18T13:57:14.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3100697434' entity='client.admin' 2023-10-18T13:57:14.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:14.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T13:57:14.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-18T13:57:14.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T13:57:14.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:14.524 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: Deploying daemon mgr.z on smithi172 2023-10-18T13:57:14.524 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:14 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1255923299' entity='client.admin' 2023-10-18T13:57:14.626 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:14 smithi172 systemd[1]: Starting Ceph mgr.z for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T13:57:14.862 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:15.094 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:15.223 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:14 smithi172 podman[106595]: 2023-10-18T13:57:15.350 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:15.522 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:15 smithi172 bash[106595]: 0e4a25f59a0fedb3d9e7a96f361c125626af4255e53de43f435e59730efc0b23 2023-10-18T13:57:15.522 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:15 smithi172 ceph-mgr[106635]: -- 172.21.15.172:0/2208509120 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bba124d1e0 con 0x55bba1223000 2023-10-18T13:57:15.523 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:15 smithi172 systemd[1]: Started Ceph mgr.z for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T13:57:15.523 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:15 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:15.341+0000 7f3ab3a98200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-18T13:57:15.523 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:15 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:15.428+0000 7f3ab3a98200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T13:57:15.523 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:15 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:15.518+0000 7f3ab3a98200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T13:57:15.656 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:15.691 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:15.785 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:15 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:15.612+0000 7f3ab3a98200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T13:57:16.059 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:15 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:15.782+0000 7f3ab3a98200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T13:57:16.119 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:16.463 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:16 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:16.144+0000 7f3ab3a98200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T13:57:16.464 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:16 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:16.275+0000 7f3ab3a98200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T13:57:16.464 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:16 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:16.363+0000 7f3ab3a98200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T13:57:16.464 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:16 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:16.465 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:16 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:16.465 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:16 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:16.465 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:16 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T13:57:16.465 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:16 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-18T13:57:16.465 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:16 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T13:57:16.466 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:16 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:16.466 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:16 smithi172 ceph-mon[103574]: Deploying daemon mgr.y on smithi158 2023-10-18T13:57:16.597 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:16 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:16.597 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:16 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:16.598 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:16 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:16.598 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:16 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T13:57:16.598 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:16 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-18T13:57:16.598 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:16 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T13:57:16.598 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:16 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:16.599 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:16 smithi158 ceph-mon[103317]: Deploying daemon mgr.y on smithi158 2023-10-18T13:57:16.706 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:16 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:16.706 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:16 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:16.706 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:16 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:16.707 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:16 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T13:57:16.707 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:16 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-18T13:57:16.707 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:16 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T13:57:16.707 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:16 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:16.707 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:16 smithi114 ceph-mon[99494]: Deploying daemon mgr.y on smithi158 2023-10-18T13:57:16.853 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:16.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:16.980+0000 7f6bef31e700 1 -- 172.21.15.114:0/3008981973 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6bd4038b40 msgr2=0x7f6bd403b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:16.980+0000 7f6bef31e700 1 --2- 172.21.15.114:0/3008981973 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6bd4038b40 0x7f6bd403b000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6be4005950 tx=0x7f6be400b410 comp rx=0 tx=0).stop 2023-10-18T13:57:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:16.980+0000 7f6bef31e700 1 -- 172.21.15.114:0/3008981973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6be8104720 msgr2=0x7f6be8195790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:16.980+0000 7f6bef31e700 1 --2- 172.21.15.114:0/3008981973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6be8104720 0x7f6be8195790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6be000ef30 tx=0x7f6be000c3a0 comp rx=0 tx=0).stop 2023-10-18T13:57:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:16.980+0000 7f6bef31e700 1 -- 172.21.15.114:0/3008981973 shutdown_connections 2023-10-18T13:57:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:16.980+0000 7f6bef31e700 1 --2- 172.21.15.114:0/3008981973 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6bd4038b40 0x7f6bd403b000 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:16.980+0000 7f6bef31e700 1 --2- 172.21.15.114:0/3008981973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6be8104720 0x7f6be8195790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:16.980+0000 7f6bef31e700 1 --2- 172.21.15.114:0/3008981973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6be81002a0 0x7f6be819b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:16.980+0000 7f6bef31e700 1 --2- 172.21.15.114:0/3008981973 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6be8100c60 0x7f6be819bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:16.980+0000 7f6bef31e700 1 -- 172.21.15.114:0/3008981973 >> 172.21.15.114:0/3008981973 conn(0x7f6be8074a10 msgr2=0x7f6be80fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:16.980+0000 7f6bef31e700 1 -- 172.21.15.114:0/3008981973 shutdown_connections 2023-10-18T13:57:16.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:16.980+0000 7f6bef31e700 1 -- 172.21.15.114:0/3008981973 wait complete. 2023-10-18T13:57:17.162 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:16 smithi158 systemd[1]: Starting Ceph mgr.y for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T13:57:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:17.239 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:17.309 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:16 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:16.460+0000 7f3ab3a98200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T13:57:17.309 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:16 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:16.886+0000 7f3ab3a98200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T13:57:17.420 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:17 smithi158 podman[105651]: 2023-10-18T13:57:17.673 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:17 smithi158 bash[105651]: fc0b81b40260dfadc72d7384232cf0cd92b37ab8dbfe3159aa60b33cac6f9d4e 2023-10-18T13:57:17.673 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-mgr[105691]: -- 172.21.15.158:0/52364135 <== mon.2 v2:172.21.15.158:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557425d831e0 con 0x557425d59000 2023-10-18T13:57:17.673 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:17 smithi158 systemd[1]: Started Ceph mgr.y for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T13:57:17.673 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:17.545+0000 7f9163627200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-18T13:57:17.674 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:17.626+0000 7f9163627200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T13:57:17.924 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:17 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2738910117' entity='client.admin' 2023-10-18T13:57:17.925 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:17 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1699187794' entity='client.admin' 2023-10-18T13:57:17.925 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:17 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3008981973' entity='client.admin' 2023-10-18T13:57:17.925 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:17.925 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:17.926 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:17 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1680667344' entity='client.admin' 2023-10-18T13:57:17.926 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:17.926 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:17.926 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:17.926 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:18.018 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:17.722+0000 7f9163627200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T13:57:18.018 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:17.821+0000 7f9163627200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T13:57:18.018 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:18 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:18.014+0000 7f9163627200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T13:57:18.019 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2738910117' entity='client.admin' 2023-10-18T13:57:18.019 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1699187794' entity='client.admin' 2023-10-18T13:57:18.019 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3008981973' entity='client.admin' 2023-10-18T13:57:18.019 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:18.020 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:18.020 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1680667344' entity='client.admin' 2023-10-18T13:57:18.020 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:18.020 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:18.020 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:18.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:18.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.301+0000 7fc015e97700 1 -- 172.21.15.114:0/3334812371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0101056b0 msgr2=0x7fc010105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.301+0000 7fc015e97700 1 --2- 172.21.15.114:0/3334812371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0101056b0 0x7fc010105a90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc000009990 tx=0x7fc000009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.301+0000 7fc015e97700 1 -- 172.21.15.114:0/3334812371 shutdown_connections 2023-10-18T13:57:18.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.301+0000 7fc015e97700 1 --2- 172.21.15.114:0/3334812371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc010100110 0x7fc01010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.301+0000 7fc015e97700 1 --2- 172.21.15.114:0/3334812371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0101056b0 0x7fc010105a90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.301+0000 7fc015e97700 1 --2- 172.21.15.114:0/3334812371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0100ff750 0x7fc0100ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.301+0000 7fc015e97700 1 -- 172.21.15.114:0/3334812371 >> 172.21.15.114:0/3334812371 conn(0x7fc010075790 msgr2=0x7fc010075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:18.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.301+0000 7fc015e97700 1 -- 172.21.15.114:0/3334812371 shutdown_connections 2023-10-18T13:57:18.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.301+0000 7fc015e97700 1 -- 172.21.15.114:0/3334812371 wait complete. 2023-10-18T13:57:18.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc015e97700 1 Processor -- start 2023-10-18T13:57:18.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc015e97700 1 -- start start 2023-10-18T13:57:18.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc015e97700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0100ff750 0x7fc01019c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:18.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc015e97700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc010100110 0x7fc01019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:18.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc015e97700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0101056b0 0x7fc0101969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:18.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc015e97700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc010197040 con 0x7fc0100ff750 2023-10-18T13:57:18.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc015e97700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0101971b0 con 0x7fc010100110 2023-10-18T13:57:18.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc015e97700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc010197370 con 0x7fc0101056b0 2023-10-18T13:57:18.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc00f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0100ff750 0x7fc01019c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:18.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc00f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0100ff750 0x7fc01019c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41236/0 (socket says 172.21.15.114:41236) 2023-10-18T13:57:18.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc00f7fe700 1 -- 172.21.15.114:0/1680667344 learned_addr learned my addr 172.21.15.114:0/1680667344 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:18.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc00ffff700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0101056b0 0x7fc0101969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:18.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc00effd700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc010100110 0x7fc01019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:18.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc00f7fe700 1 -- 172.21.15.114:0/1680667344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0101056b0 msgr2=0x7fc0101969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc00f7fe700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0101056b0 0x7fc0101969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc00f7fe700 1 -- 172.21.15.114:0/1680667344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc010100110 msgr2=0x7fc01019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc00f7fe700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc010100110 0x7fc01019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.302+0000 7fc00f7fe700 1 -- 172.21.15.114:0/1680667344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0000095f0 con 0x7fc0100ff750 2023-10-18T13:57:18.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.303+0000 7fc00f7fe700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0100ff750 0x7fc01019c8a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc000005910 tx=0x7fc000004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:18.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.303+0000 7fc00cff9700 1 -- 172.21.15.114:0/1680667344 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00001d070 con 0x7fc0100ff750 2023-10-18T13:57:18.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.303+0000 7fc015e97700 1 -- 172.21.15.114:0/1680667344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0101975f0 con 0x7fc0100ff750 2023-10-18T13:57:18.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.303+0000 7fc00cff9700 1 -- 172.21.15.114:0/1680667344 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc000022470 con 0x7fc0100ff750 2023-10-18T13:57:18.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.303+0000 7fc00cff9700 1 -- 172.21.15.114:0/1680667344 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000017650 con 0x7fc0100ff750 2023-10-18T13:57:18.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.303+0000 7fc015e97700 1 -- 172.21.15.114:0/1680667344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0101a3890 con 0x7fc0100ff750 2023-10-18T13:57:18.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.303+0000 7fc00cff9700 1 -- 172.21.15.114:0/1680667344 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) v1 ==== 45653+0+0 (secure 0 0 0) 0x7fc0000177b0 con 0x7fc0100ff750 2023-10-18T13:57:18.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.304+0000 7fc015e97700 1 -- 172.21.15.114:0/1680667344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc010108cc0 con 0x7fc0100ff750 2023-10-18T13:57:18.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.304+0000 7fc00cff9700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbff8038b40 0x7fbff803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:18.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.304+0000 7fc00cff9700 1 -- 172.21.15.114:0/1680667344 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fc00004ca00 con 0x7fc0100ff750 2023-10-18T13:57:18.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.304+0000 7fc00effd700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbff8038b40 0x7fbff803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:18.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.304+0000 7fc00effd700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbff8038b40 0x7fbff803b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc010197ba0 tx=0x7fc004009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:18.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.309+0000 7fc00cff9700 1 -- 172.21.15.114:0/1680667344 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc00002a360 con 0x7fc0100ff750 2023-10-18T13:57:18.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.522+0000 7fc015e97700 1 -- 172.21.15.114:0/1680667344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) v1 -- 0x7fc01004e4c0 con 0x7fc0100ff750 2023-10-18T13:57:18.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.524+0000 7fc00cff9700 1 -- 172.21.15.114:0/1680667344 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v15)=0 v15) v1 ==== 117+0+0 (secure 0 0 0) 0x7fc000027070 con 0x7fc0100ff750 2023-10-18T13:57:18.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.527+0000 7fc015e97700 1 -- 172.21.15.114:0/1680667344 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbff8038b40 msgr2=0x7fbff803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.527+0000 7fc015e97700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbff8038b40 0x7fbff803b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc010197ba0 tx=0x7fc004009260 comp rx=0 tx=0).stop 2023-10-18T13:57:18.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.527+0000 7fc015e97700 1 -- 172.21.15.114:0/1680667344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0100ff750 msgr2=0x7fc01019c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.527+0000 7fc015e97700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0100ff750 0x7fc01019c8a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc000005910 tx=0x7fc000004730 comp rx=0 tx=0).stop 2023-10-18T13:57:18.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.527+0000 7fc015e97700 1 -- 172.21.15.114:0/1680667344 shutdown_connections 2023-10-18T13:57:18.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.527+0000 7fc015e97700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbff8038b40 0x7fbff803b000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.527+0000 7fc015e97700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0101056b0 0x7fc0101969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.527+0000 7fc015e97700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0100ff750 0x7fc01019c8a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.527+0000 7fc015e97700 1 --2- 172.21.15.114:0/1680667344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc010100110 0x7fc01019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.527+0000 7fc015e97700 1 -- 172.21.15.114:0/1680667344 >> 172.21.15.114:0/1680667344 conn(0x7fc010075790 msgr2=0x7fc0100684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:18.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.527+0000 7fc015e97700 1 -- 172.21.15.114:0/1680667344 shutdown_connections 2023-10-18T13:57:18.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.527+0000 7fc015e97700 1 -- 172.21.15.114:0/1680667344 wait complete. 2023-10-18T13:57:18.059 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:17 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:17.560+0000 7f3ab3a98200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-18T13:57:18.060 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:17 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:17.644+0000 7f3ab3a98200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T13:57:18.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:17 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2738910117' entity='client.admin' 2023-10-18T13:57:18.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:17 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1699187794' entity='client.admin' 2023-10-18T13:57:18.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:17 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3008981973' entity='client.admin' 2023-10-18T13:57:18.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:18.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:18.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:17 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1680667344' entity='client.admin' 2023-10-18T13:57:18.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:18.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:18.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:18.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:18.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.363+0000 7f52b54d1700 1 -- 172.21.15.114:0/1786119612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52b00ff750 msgr2=0x7f52b00ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.363+0000 7f52b54d1700 1 --2- 172.21.15.114:0/1786119612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52b00ff750 0x7f52b00ffbd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009990 tx=0x7f52a4009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.363+0000 7f52b54d1700 1 -- 172.21.15.114:0/1786119612 shutdown_connections 2023-10-18T13:57:18.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.363+0000 7f52b54d1700 1 --2- 172.21.15.114:0/1786119612 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52b0100110 0x7f52b010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.363+0000 7f52b54d1700 1 --2- 172.21.15.114:0/1786119612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52b01056b0 0x7f52b0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.363+0000 7f52b54d1700 1 --2- 172.21.15.114:0/1786119612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52b00ff750 0x7f52b00ffbd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.363+0000 7f52b54d1700 1 -- 172.21.15.114:0/1786119612 >> 172.21.15.114:0/1786119612 conn(0x7f52b0075790 msgr2=0x7f52b0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:18.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.363+0000 7f52b54d1700 1 -- 172.21.15.114:0/1786119612 shutdown_connections 2023-10-18T13:57:18.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.363+0000 7f52b54d1700 1 -- 172.21.15.114:0/1786119612 wait complete. 2023-10-18T13:57:18.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.364+0000 7f52b54d1700 1 Processor -- start 2023-10-18T13:57:18.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.364+0000 7f52b54d1700 1 -- start start 2023-10-18T13:57:18.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.364+0000 7f52b54d1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52b00ff750 0x7f52b0197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:18.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.364+0000 7f52b54d1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52b0100110 0x7f52b0197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:18.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.364+0000 7f52b54d1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52b01056b0 0x7f52b0198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:18.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.364+0000 7f52b54d1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b01a2d90 con 0x7f52b00ff750 2023-10-18T13:57:18.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.364+0000 7f52b54d1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b01a2f00 con 0x7f52b01056b0 2023-10-18T13:57:18.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.364+0000 7f52b54d1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b01a30c0 con 0x7f52b0100110 2023-10-18T13:57:18.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.364+0000 7f52aeffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52b00ff750 0x7f52b0197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:18.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.364+0000 7f52aeffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52b00ff750 0x7f52b0197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41262/0 (socket says 172.21.15.114:41262) 2023-10-18T13:57:18.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.364+0000 7f52aeffd700 1 -- 172.21.15.114:0/3419801559 learned_addr learned my addr 172.21.15.114:0/3419801559 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:18.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.364+0000 7f52ae7fc700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52b0100110 0x7f52b0197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:18.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.364+0000 7f52af7fe700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52b01056b0 0x7f52b0198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:18.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.365+0000 7f52aeffd700 1 -- 172.21.15.114:0/3419801559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52b0100110 msgr2=0x7f52b0197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.365+0000 7f52aeffd700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52b0100110 0x7f52b0197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.365+0000 7f52aeffd700 1 -- 172.21.15.114:0/3419801559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52b01056b0 msgr2=0x7f52b0198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.365+0000 7f52aeffd700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52b01056b0 0x7f52b0198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.365+0000 7f52aeffd700 1 -- 172.21.15.114:0/3419801559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40095f0 con 0x7f52b00ff750 2023-10-18T13:57:18.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.365+0000 7f52af7fe700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52b01056b0 0x7f52b0198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T13:57:18.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.365+0000 7f52aeffd700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52b00ff750 0x7f52b0197a80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f52a800ef10 tx=0x7f52a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:18.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.365+0000 7f5297fff700 1 -- 172.21.15.114:0/3419801559 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a800c9c0 con 0x7f52b00ff750 2023-10-18T13:57:18.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.365+0000 7f5297fff700 1 -- 172.21.15.114:0/3419801559 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52a800f040 con 0x7f52b00ff750 2023-10-18T13:57:18.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.365+0000 7f5297fff700 1 -- 172.21.15.114:0/3419801559 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a8014480 con 0x7f52b00ff750 2023-10-18T13:57:18.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.365+0000 7f52b54d1700 1 -- 172.21.15.114:0/3419801559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b01a3340 con 0x7f52b00ff750 2023-10-18T13:57:18.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.365+0000 7f52b54d1700 1 -- 172.21.15.114:0/3419801559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b01a37c0 con 0x7f52b00ff750 2023-10-18T13:57:18.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.366+0000 7f5297fff700 1 -- 172.21.15.114:0/3419801559 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) v1 ==== 45653+0+0 (secure 0 0 0) 0x7f52a80145e0 con 0x7f52b00ff750 2023-10-18T13:57:18.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.366+0000 7f5297fff700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5298038b40 0x7f529803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:18.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.366+0000 7f52b54d1700 1 -- 172.21.15.114:0/3419801559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b0107c40 con 0x7f52b00ff750 2023-10-18T13:57:18.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.366+0000 7f5297fff700 1 -- 172.21.15.114:0/3419801559 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f52a804b840 con 0x7f52b00ff750 2023-10-18T13:57:18.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.366+0000 7f52ae7fc700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5298038b40 0x7f529803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:18.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.367+0000 7f52ae7fc700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5298038b40 0x7f529803b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f52a400b2e0 tx=0x7f52a4005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:18.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.371+0000 7f5297fff700 1 -- 172.21.15.114:0/3419801559 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f52a8014980 con 0x7f52b00ff750 2023-10-18T13:57:18.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.573+0000 7f52b54d1700 1 -- 172.21.15.114:0/3419801559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7f52b0100df0 con 0x7f52b00ff750 2023-10-18T13:57:18.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.576+0000 7f5297fff700 1 -- 172.21.15.114:0/3419801559 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v17)=0 v17) v1 ==== 108+0+0 (secure 0 0 0) 0x7f52a803e020 con 0x7f52b00ff750 2023-10-18T13:57:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.578+0000 7f52b54d1700 1 -- 172.21.15.114:0/3419801559 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5298038b40 msgr2=0x7f529803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.578+0000 7f52b54d1700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5298038b40 0x7f529803b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f52a400b2e0 tx=0x7f52a4005960 comp rx=0 tx=0).stop 2023-10-18T13:57:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.578+0000 7f52b54d1700 1 -- 172.21.15.114:0/3419801559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52b00ff750 msgr2=0x7f52b0197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.578+0000 7f52b54d1700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52b00ff750 0x7f52b0197a80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f52a800ef10 tx=0x7f52a800c3a0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.578+0000 7f52b54d1700 1 -- 172.21.15.114:0/3419801559 shutdown_connections 2023-10-18T13:57:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.578+0000 7f52b54d1700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5298038b40 0x7f529803b000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.578+0000 7f52b54d1700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52b01056b0 0x7f52b0198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.578+0000 7f52b54d1700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52b00ff750 0x7f52b0197a80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.578+0000 7f52b54d1700 1 --2- 172.21.15.114:0/3419801559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52b0100110 0x7f52b0197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.578+0000 7f52b54d1700 1 -- 172.21.15.114:0/3419801559 >> 172.21.15.114:0/3419801559 conn(0x7f52b0075790 msgr2=0x7f52b00fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.578+0000 7f52b54d1700 1 -- 172.21.15.114:0/3419801559 shutdown_connections 2023-10-18T13:57:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.578+0000 7f52b54d1700 1 -- 172.21.15.114:0/3419801559 wait complete. 2023-10-18T13:57:18.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.948+0000 7f6cb1afe700 1 -- 172.21.15.114:0/2195302754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cac0ffb30 msgr2=0x7f6cac10d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.948+0000 7f6cb1afe700 1 --2- 172.21.15.114:0/2195302754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cac0ffb30 0x7f6cac10d5c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400b0a0 tx=0x7f6ca400b3b0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.949+0000 7f6cb1afe700 1 -- 172.21.15.114:0/2195302754 shutdown_connections 2023-10-18T13:57:18.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.949+0000 7f6cb1afe700 1 --2- 172.21.15.114:0/2195302754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cac0ffb30 0x7f6cac10d5c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.949+0000 7f6cb1afe700 1 --2- 172.21.15.114:0/2195302754 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cac1058d0 0x7f6cac105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.949+0000 7f6cb1afe700 1 --2- 172.21.15.114:0/2195302754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cac0ff190 0x7f6cac0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.949+0000 7f6cb1afe700 1 -- 172.21.15.114:0/2195302754 >> 172.21.15.114:0/2195302754 conn(0x7f6cac074a10 msgr2=0x7f6cac074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:18.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.949+0000 7f6cb1afe700 1 -- 172.21.15.114:0/2195302754 shutdown_connections 2023-10-18T13:57:18.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.949+0000 7f6cb1afe700 1 -- 172.21.15.114:0/2195302754 wait complete. 2023-10-18T13:57:18.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.949+0000 7f6cb1afe700 1 Processor -- start 2023-10-18T13:57:18.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.949+0000 7f6cb1afe700 1 -- start start 2023-10-18T13:57:18.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6cb1afe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cac0ff190 0x7f6cac19c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:18.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6cb1afe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cac0ffb30 0x7f6cac19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:18.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6cb1afe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cac1058d0 0x7f6cac196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:18.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6cb1afe700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac1971c0 con 0x7f6cac0ffb30 2023-10-18T13:57:18.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6cb1afe700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac197330 con 0x7f6cac1058d0 2023-10-18T13:57:18.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6cb1afe700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac1974f0 con 0x7f6cac0ff190 2023-10-18T13:57:18.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6caaffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cac0ffb30 0x7f6cac19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:18.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6caaffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cac0ffb30 0x7f6cac19cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41252/0 (socket says 172.21.15.114:41252) 2023-10-18T13:57:18.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6caaffd700 1 -- 172.21.15.114:0/468541937 learned_addr learned my addr 172.21.15.114:0/468541937 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:18.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6cabfff700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cac1058d0 0x7f6cac196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:18.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6cab7fe700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cac0ff190 0x7f6cac19c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:18.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6caaffd700 1 -- 172.21.15.114:0/468541937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cac0ff190 msgr2=0x7f6cac19c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6caaffd700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cac0ff190 0x7f6cac19c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6caaffd700 1 -- 172.21.15.114:0/468541937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cac1058d0 msgr2=0x7f6cac196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6caaffd700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cac1058d0 0x7f6cac196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6caaffd700 1 -- 172.21.15.114:0/468541937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca4009d00 con 0x7f6cac0ffb30 2023-10-18T13:57:18.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6cab7fe700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cac0ff190 0x7f6cac19c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T13:57:18.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6caaffd700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cac0ffb30 0x7f6cac19cf10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000d950 tx=0x7f6ca000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:18.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6ca8ff9700 1 -- 172.21.15.114:0/468541937 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0009940 con 0x7f6cac0ffb30 2023-10-18T13:57:18.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6ca8ff9700 1 -- 172.21.15.114:0/468541937 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ca0010460 con 0x7f6cac0ffb30 2023-10-18T13:57:18.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6cb1afe700 1 -- 172.21.15.114:0/468541937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cac1977d0 con 0x7f6cac0ffb30 2023-10-18T13:57:18.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6ca8ff9700 1 -- 172.21.15.114:0/468541937 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca000f620 con 0x7f6cac0ffb30 2023-10-18T13:57:18.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.950+0000 7f6cb1afe700 1 -- 172.21.15.114:0/468541937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cac1a39c0 con 0x7f6cac0ffb30 2023-10-18T13:57:18.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.952+0000 7f6cb1afe700 1 -- 172.21.15.114:0/468541937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cac108d30 con 0x7f6cac0ffb30 2023-10-18T13:57:18.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.952+0000 7f6ca8ff9700 1 -- 172.21.15.114:0/468541937 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) v1 ==== 45653+0+0 (secure 0 0 0) 0x7f6ca00108d0 con 0x7f6cac0ffb30 2023-10-18T13:57:18.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.952+0000 7f6ca8ff9700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6c94038b40 0x7f6c9403b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:18.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.952+0000 7f6ca8ff9700 1 -- 172.21.15.114:0/468541937 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f6ca004b1d0 con 0x7f6cac0ffb30 2023-10-18T13:57:18.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.952+0000 7f6cab7fe700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6c94038b40 0x7f6c9403b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:18.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.953+0000 7f6cab7fe700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6c94038b40 0x7f6c9403b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6cac068160 tx=0x7f6c9c00b5f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:18.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:17.957+0000 7f6ca8ff9700 1 -- 172.21.15.114:0/468541937 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6ca000e530 con 0x7f6cac0ffb30 2023-10-18T13:57:18.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.167+0000 7f6cb1afe700 1 -- 172.21.15.114:0/468541937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7f6cac067c30 con 0x7f6cac0ffb30 2023-10-18T13:57:18.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.171+0000 7f6ca8ff9700 1 -- 172.21.15.114:0/468541937 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) v1 ==== 106+0+0 (secure 0 0 0) 0x7f6ca0016030 con 0x7f6cac0ffb30 2023-10-18T13:57:18.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.173+0000 7f6cb1afe700 1 -- 172.21.15.114:0/468541937 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6c94038b40 msgr2=0x7f6c9403b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.173+0000 7f6cb1afe700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6c94038b40 0x7f6c9403b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6cac068160 tx=0x7f6c9c00b5f0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.173+0000 7f6cb1afe700 1 -- 172.21.15.114:0/468541937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cac0ffb30 msgr2=0x7f6cac19cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:18.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.173+0000 7f6cb1afe700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cac0ffb30 0x7f6cac19cf10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000d950 tx=0x7f6ca000dc60 comp rx=0 tx=0).stop 2023-10-18T13:57:18.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.173+0000 7f6cb1afe700 1 -- 172.21.15.114:0/468541937 shutdown_connections 2023-10-18T13:57:18.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.173+0000 7f6cb1afe700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6c94038b40 0x7f6c9403b000 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.173+0000 7f6cb1afe700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6cac1058d0 0x7f6cac196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.173+0000 7f6cb1afe700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cac0ff190 0x7f6cac19c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.173+0000 7f6cb1afe700 1 --2- 172.21.15.114:0/468541937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cac0ffb30 0x7f6cac19cf10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:18.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.173+0000 7f6cb1afe700 1 -- 172.21.15.114:0/468541937 >> 172.21.15.114:0/468541937 conn(0x7f6cac074a10 msgr2=0x7f6cac0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:18.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.174+0000 7f6cb1afe700 1 -- 172.21.15.114:0/468541937 shutdown_connections 2023-10-18T13:57:18.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:18.174+0000 7f6cb1afe700 1 -- 172.21.15.114:0/468541937 wait complete. 2023-10-18T13:57:18.740 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:18 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:18.459+0000 7f3ab3a98200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T13:57:18.741 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:18 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:18.552+0000 7f3ab3a98200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-18T13:57:18.747 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:18 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:18.397+0000 7f9163627200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T13:57:18.747 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:18 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:18.541+0000 7f9163627200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T13:57:18.747 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:18 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:18.636+0000 7f9163627200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T13:57:18.748 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:18 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:18.743+0000 7f9163627200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T13:57:18.780 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:18.781 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:18.781 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:19.041 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:18 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:18.737+0000 7f3ab3a98200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T13:57:19.042 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:19 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:19.037+0000 7f3ab3a98200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-18T13:57:19.309 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:19 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:19.269+0000 7f3ab3a98200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T13:57:19.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:19 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/468541937' entity='client.admin' 2023-10-18T13:57:19.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:19 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3419801559' entity='client.admin' 2023-10-18T13:57:19.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:19 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:19.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:19 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:19.406 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:19 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/468541937' entity='client.admin' 2023-10-18T13:57:19.407 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:19 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3419801559' entity='client.admin' 2023-10-18T13:57:19.407 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:19 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:19.407 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:19 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:19.521 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:19 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:19.195+0000 7f9163627200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T13:57:19.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:19 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/468541937' entity='client.admin' 2023-10-18T13:57:19.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:19 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3419801559' entity='client.admin' 2023-10-18T13:57:19.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:19 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:19.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:19 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:19.686 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:19 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:19.420+0000 7f3ab3a98200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T13:57:20.214 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:19 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:19.866+0000 7f9163627200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-18T13:57:20.215 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:19 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:19.946+0000 7f9163627200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T13:57:20.506 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:20 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:20.507 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:20 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:20.507 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:20 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:20.507 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:20 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:20.507 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:20 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:20.507 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:20 smithi114 ceph-mon[99494]: Reconfiguring mgr.x (unknown last config time)... 2023-10-18T13:57:20.508 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:20 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T13:57:20.508 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:20 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T13:57:20.508 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:20 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:20.508 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:20 smithi114 ceph-mon[99494]: Reconfiguring daemon mgr.x on smithi114 2023-10-18T13:57:20.520 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:19 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:19.682+0000 7f3ab3a98200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T13:57:20.520 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:20.386+0000 7f3ab3a98200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T13:57:20.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:20.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:20.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:20.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:20.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:20.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-mon[103574]: Reconfiguring mgr.x (unknown last config time)... 2023-10-18T13:57:20.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T13:57:20.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T13:57:20.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:20.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-mon[103574]: Reconfiguring daemon mgr.x on smithi114 2023-10-18T13:57:20.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:20 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:20.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:20 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:20.524 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:20 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:20.524 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:20 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:20.524 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:20 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:20.524 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:20 smithi158 ceph-mon[103317]: Reconfiguring mgr.x (unknown last config time)... 2023-10-18T13:57:20.524 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:20 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-18T13:57:20.525 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:20 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-18T13:57:20.525 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:20 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:20.525 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:20 smithi158 ceph-mon[103317]: Reconfiguring daemon mgr.x on smithi114 2023-10-18T13:57:20.809 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:20.516+0000 7f3ab3a98200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-18T13:57:20.810 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:20.709+0000 7f3ab3a98200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T13:57:20.983 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:20 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:20.717+0000 7f9163627200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T13:57:20.984 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:20 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:20.808+0000 7f9163627200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-18T13:57:21.009 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi114') 2023-10-18T13:57:21.261 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:20 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:20.979+0000 7f9163627200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T13:57:21.309 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:20 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:20.823+0000 7f3ab3a98200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T13:57:21.310 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:21 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:21.039+0000 7f3ab3a98200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T13:57:21.521 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:21 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:21.257+0000 7f9163627200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-18T13:57:21.522 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:21 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:21.486+0000 7f9163627200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T13:57:21.807 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:21.808 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:21.838 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi114') 2023-10-18T13:57:21.839 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi114') 2023-10-18T13:57:21.839 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi114') 2023-10-18T13:57:21.839 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi114') 2023-10-18T13:57:21.840 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi114') 2023-10-18T13:57:21.840 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi114') 2023-10-18T13:57:21.840 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi114') 2023-10-18T13:57:21.902 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:21 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:21.636+0000 7f9163627200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T13:57:22.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:21 smithi114 ceph-mon[99494]: Standby manager daemon z started 2023-10-18T13:57:22.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:21 smithi114 ceph-mon[99494]: from='mgr.? 172.21.15.172:0/1453972408' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-18T13:57:22.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:21 smithi114 ceph-mon[99494]: from='mgr.? 172.21.15.172:0/1453972408' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T13:57:22.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:21 smithi114 ceph-mon[99494]: from='mgr.? 172.21.15.172:0/1453972408' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-18T13:57:22.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:21 smithi114 ceph-mon[99494]: from='mgr.? 172.21.15.172:0/1453972408' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T13:57:22.271 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:21 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:21.898+0000 7f9163627200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T13:57:22.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:21 smithi158 ceph-mon[103317]: Standby manager daemon z started 2023-10-18T13:57:22.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:21 smithi158 ceph-mon[103317]: from='mgr.? 172.21.15.172:0/1453972408' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-18T13:57:22.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:21 smithi158 ceph-mon[103317]: from='mgr.? 172.21.15.172:0/1453972408' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T13:57:22.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:21 smithi158 ceph-mon[103317]: from='mgr.? 172.21.15.172:0/1453972408' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-18T13:57:22.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:21 smithi158 ceph-mon[103317]: from='mgr.? 172.21.15.172:0/1453972408' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T13:57:22.309 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 13:57:21 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z[106611]: 2023-10-18T13:57:21.903+0000 7f3ab3a98200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T13:57:22.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:21 smithi172 ceph-mon[103574]: Standby manager daemon z started 2023-10-18T13:57:22.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:21 smithi172 ceph-mon[103574]: from='mgr.? 172.21.15.172:0/1453972408' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-18T13:57:22.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:21 smithi172 ceph-mon[103574]: from='mgr.? 172.21.15.172:0/1453972408' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T13:57:22.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:21 smithi172 ceph-mon[103574]: from='mgr.? 172.21.15.172:0/1453972408' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-18T13:57:22.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:21 smithi172 ceph-mon[103574]: from='mgr.? 172.21.15.172:0/1453972408' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T13:57:22.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.637+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3922708210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c80ffb30 msgr2=0x7fc6c810d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:22.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.637+0000 7fc6ccb8b700 1 --2- 172.21.15.114:0/3922708210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c80ffb30 0x7fc6c810d5c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000b0a0 tx=0x7fc6c000b3b0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.637+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3922708210 shutdown_connections 2023-10-18T13:57:22.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.637+0000 7fc6ccb8b700 1 --2- 172.21.15.114:0/3922708210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c80ffb30 0x7fc6c810d5c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.637+0000 7fc6ccb8b700 1 --2- 172.21.15.114:0/3922708210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c81058d0 0x7fc6c8105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.637+0000 7fc6ccb8b700 1 --2- 172.21.15.114:0/3922708210 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6c80ff190 0x7fc6c80ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.637+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3922708210 >> 172.21.15.114:0/3922708210 conn(0x7fc6c8074a10 msgr2=0x7fc6c8074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:22.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.637+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3922708210 shutdown_connections 2023-10-18T13:57:22.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.637+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3922708210 wait complete. 2023-10-18T13:57:22.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6ccb8b700 1 Processor -- start 2023-10-18T13:57:22.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6ccb8b700 1 -- start start 2023-10-18T13:57:22.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6ccb8b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6c80ff190 0x7fc6c819c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:22.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6ccb8b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c80ffb30 0x7fc6c819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:22.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6ccb8b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c81058d0 0x7fc6c8196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:22.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6ccb8b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c81971c0 con 0x7fc6c81058d0 2023-10-18T13:57:22.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6ccb8b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8197330 con 0x7fc6c80ff190 2023-10-18T13:57:22.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6ccb8b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c81974f0 con 0x7fc6c80ffb30 2023-10-18T13:57:22.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6c6d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c81058d0 0x7fc6c8196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:22.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6c6d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c81058d0 0x7fc6c8196b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41294/0 (socket says 172.21.15.114:41294) 2023-10-18T13:57:22.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6c659c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6c80ff190 0x7fc6c819c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:22.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6c6d9d700 1 -- 172.21.15.114:0/3398378953 learned_addr learned my addr 172.21.15.114:0/3398378953 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:22.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6c5d9b700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c80ffb30 0x7fc6c819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:22.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6c6d9d700 1 -- 172.21.15.114:0/3398378953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c80ffb30 msgr2=0x7fc6c819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:22.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6c6d9d700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c80ffb30 0x7fc6c819cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6c6d9d700 1 -- 172.21.15.114:0/3398378953 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6c80ff190 msgr2=0x7fc6c819c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:22.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6c6d9d700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6c80ff190 0x7fc6c819c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6c6d9d700 1 -- 172.21.15.114:0/3398378953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0009d00 con 0x7fc6c81058d0 2023-10-18T13:57:22.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.638+0000 7fc6c659c700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6c80ff190 0x7fc6c819c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T13:57:22.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.639+0000 7fc6c6d9d700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c81058d0 0x7fc6c8196b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000b070 tx=0x7fc6c0007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:22.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.639+0000 7fc6b77fe700 1 -- 172.21.15.114:0/3398378953 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000e040 con 0x7fc6c81058d0 2023-10-18T13:57:22.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.639+0000 7fc6b77fe700 1 -- 172.21.15.114:0/3398378953 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6c000be40 con 0x7fc6c81058d0 2023-10-18T13:57:22.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.639+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3398378953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c8197770 con 0x7fc6c81058d0 2023-10-18T13:57:22.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.639+0000 7fc6b77fe700 1 -- 172.21.15.114:0/3398378953 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c00052a0 con 0x7fc6c81058d0 2023-10-18T13:57:22.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.639+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3398378953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c81a39c0 con 0x7fc6c81058d0 2023-10-18T13:57:22.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.640+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3398378953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c8108d30 con 0x7fc6c81058d0 2023-10-18T13:57:22.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.640+0000 7fc6b77fe700 1 -- 172.21.15.114:0/3398378953 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 18) v1 ==== 90809+0+0 (secure 0 0 0) 0x7fc6c001d470 con 0x7fc6c81058d0 2023-10-18T13:57:22.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.641+0000 7fc6b77fe700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc6b006cfc0 0x7fc6b006f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:22.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.641+0000 7fc6c659c700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc6b006cfc0 0x7fc6b006f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:22.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.641+0000 7fc6b77fe700 1 -- 172.21.15.114:0/3398378953 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fc6c008c790 con 0x7fc6c81058d0 2023-10-18T13:57:22.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.641+0000 7fc6c659c700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc6b006cfc0 0x7fc6b006f480 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8068160 tx=0x7fc6b8007400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:22.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.645+0000 7fc6b77fe700 1 -- 172.21.15.114:0/3398378953 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc6c0057b10 con 0x7fc6c81058d0 2023-10-18T13:57:22.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.874+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3398378953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) v1 -- 0x7fc6c804e4c0 con 0x7fc6c81058d0 2023-10-18T13:57:22.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.877+0000 7fc6b77fe700 1 -- 172.21.15.114:0/3398378953 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v19)=0 v19) v1 ==== 115+0+0 (secure 0 0 0) 0x7fc6c005b130 con 0x7fc6c81058d0 2023-10-18T13:57:22.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.880+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3398378953 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc6b006cfc0 msgr2=0x7fc6b006f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:22.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.880+0000 7fc6ccb8b700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc6b006cfc0 0x7fc6b006f480 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8068160 tx=0x7fc6b8007400 comp rx=0 tx=0).stop 2023-10-18T13:57:22.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.880+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3398378953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c81058d0 msgr2=0x7fc6c8196b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:22.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.880+0000 7fc6ccb8b700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c81058d0 0x7fc6c8196b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000b070 tx=0x7fc6c0007930 comp rx=0 tx=0).stop 2023-10-18T13:57:22.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.880+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3398378953 shutdown_connections 2023-10-18T13:57:22.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.880+0000 7fc6ccb8b700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc6b006cfc0 0x7fc6b006f480 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.880+0000 7fc6ccb8b700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6c81058d0 0x7fc6c8196b60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.880+0000 7fc6ccb8b700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc6c80ff190 0x7fc6c819c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.880+0000 7fc6ccb8b700 1 --2- 172.21.15.114:0/3398378953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c80ffb30 0x7fc6c819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.880+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3398378953 >> 172.21.15.114:0/3398378953 conn(0x7fc6c8074a10 msgr2=0x7fc6c80fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:22.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.880+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3398378953 shutdown_connections 2023-10-18T13:57:22.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:22.880+0000 7fc6ccb8b700 1 -- 172.21.15.114:0/3398378953 wait complete. 2023-10-18T13:57:22.927 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:22 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:22.599+0000 7f9163627200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T13:57:22.927 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:22 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:22.730+0000 7f9163627200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-18T13:57:22.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.756+0000 7f17d0c48700 1 -- 172.21.15.114:0/395186673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0ff690 msgr2=0x7f17cc0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:22.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.756+0000 7f17d0c48700 1 --2- 172.21.15.114:0/395186673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0ff690 0x7f17cc0ffb10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009990 tx=0x7f17b4009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.757+0000 7f17d0c48700 1 -- 172.21.15.114:0/395186673 shutdown_connections 2023-10-18T13:57:22.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.757+0000 7f17d0c48700 1 --2- 172.21.15.114:0/395186673 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17cc100050 0x7f17cc10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.757+0000 7f17d0c48700 1 --2- 172.21.15.114:0/395186673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc104550 0x7f17cc104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.757+0000 7f17d0c48700 1 --2- 172.21.15.114:0/395186673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0ff690 0x7f17cc0ffb10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:22.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.757+0000 7f17d0c48700 1 -- 172.21.15.114:0/395186673 >> 172.21.15.114:0/395186673 conn(0x7f17cc076720 msgr2=0x7f17cc076b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:22.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.757+0000 7f17d0c48700 1 -- 172.21.15.114:0/395186673 shutdown_connections 2023-10-18T13:57:23.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.757+0000 7f17d0c48700 1 -- 172.21.15.114:0/395186673 wait complete. 2023-10-18T13:57:23.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.757+0000 7f17d0c48700 1 Processor -- start 2023-10-18T13:57:23.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.757+0000 7f17d0c48700 1 -- start start 2023-10-18T13:57:23.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17d0c48700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0ff690 0x7f17cc19c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:23.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17d0c48700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17cc100050 0x7f17cc19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:23.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17d0c48700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc104550 0x7f17cc196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:23.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17d0c48700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc1970c0 con 0x7f17cc0ff690 2023-10-18T13:57:23.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17d0c48700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc197230 con 0x7f17cc100050 2023-10-18T13:57:23.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17d0c48700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc1973f0 con 0x7f17cc104550 2023-10-18T13:57:23.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17ca59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0ff690 0x7f17cc19c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:23.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17ca59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0ff690 0x7f17cc19c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41276/0 (socket says 172.21.15.114:41276) 2023-10-18T13:57:23.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17ca59c700 1 -- 172.21.15.114:0/97213162 learned_addr learned my addr 172.21.15.114:0/97213162 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:23.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17c9d9b700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17cc100050 0x7f17cc19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:23.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17cad9d700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc104550 0x7f17cc196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:23.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17ca59c700 1 -- 172.21.15.114:0/97213162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc104550 msgr2=0x7f17cc196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17ca59c700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc104550 0x7f17cc196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17ca59c700 1 -- 172.21.15.114:0/97213162 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17cc100050 msgr2=0x7f17cc19ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17ca59c700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17cc100050 0x7f17cc19ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17ca59c700 1 -- 172.21.15.114:0/97213162 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b40095f0 con 0x7f17cc0ff690 2023-10-18T13:57:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17ca59c700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0ff690 0x7f17cc19c920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00d950 tx=0x7f17bc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17c37fe700 1 -- 172.21.15.114:0/97213162 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc00f890 con 0x7f17cc0ff690 2023-10-18T13:57:23.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17c37fe700 1 -- 172.21.15.114:0/97213162 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17bc010460 con 0x7f17cc0ff690 2023-10-18T13:57:23.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17c37fe700 1 -- 172.21.15.114:0/97213162 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc00e610 con 0x7f17cc0ff690 2023-10-18T13:57:23.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17d0c48700 1 -- 172.21.15.114:0/97213162 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc1976d0 con 0x7f17cc0ff690 2023-10-18T13:57:23.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.758+0000 7f17d0c48700 1 -- 172.21.15.114:0/97213162 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc1a3910 con 0x7f17cc0ff690 2023-10-18T13:57:23.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.759+0000 7f17c37fe700 1 -- 172.21.15.114:0/97213162 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) v1 ==== 45653+0+0 (secure 0 0 0) 0x7f17bc00e770 con 0x7f17cc0ff690 2023-10-18T13:57:23.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.759+0000 7f17c37fe700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f17b8038b40 0x7f17b803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:23.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.759+0000 7f17c37fe700 1 -- 172.21.15.114:0/97213162 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f17bc04b320 con 0x7f17cc0ff690 2023-10-18T13:57:23.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.760+0000 7f17c9d9b700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f17b8038b40 0x7f17b803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:23.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.759+0000 7f17d0c48700 1 -- 172.21.15.114:0/97213162 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17cc107ba0 con 0x7f17cc0ff690 2023-10-18T13:57:23.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.760+0000 7f17c9d9b700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f17b8038b40 0x7f17b803b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f17cc197c20 tx=0x7f17b4005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:23.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.764+0000 7f17c37fe700 1 -- 172.21.15.114:0/97213162 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f17bc0228f0 con 0x7f17cc0ff690 2023-10-18T13:57:23.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.974+0000 7f17c37fe700 1 -- 172.21.15.114:0/97213162 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 18) v1 ==== 90809+0+0 (secure 0 0 0) 0x7f17bc0108d0 con 0x7f17cc0ff690 2023-10-18T13:57:23.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.985+0000 7f17d0c48700 1 -- 172.21.15.114:0/97213162 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f17cc04e4c0 con 0x7f17cc0ff690 2023-10-18T13:57:23.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.987+0000 7f17c37fe700 1 -- 172.21.15.114:0/97213162 <== mon.0 v2:172.21.15.114:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v18)=0 v18) v1 ==== 120+0+0 (secure 0 0 0) 0x7f17bc05bd00 con 0x7f17cc0ff690 2023-10-18T13:57:23.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.989+0000 7f17d0c48700 1 -- 172.21.15.114:0/97213162 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f17b8038b40 msgr2=0x7f17b803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:23.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.989+0000 7f17d0c48700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f17b8038b40 0x7f17b803b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f17cc197c20 tx=0x7f17b4005fd0 comp rx=0 tx=0).stop 2023-10-18T13:57:23.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.989+0000 7f17d0c48700 1 -- 172.21.15.114:0/97213162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0ff690 msgr2=0x7f17cc19c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:23.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.989+0000 7f17d0c48700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0ff690 0x7f17cc19c920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00d950 tx=0x7f17bc00dc60 comp rx=0 tx=0).stop 2023-10-18T13:57:23.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.990+0000 7f17d0c48700 1 -- 172.21.15.114:0/97213162 shutdown_connections 2023-10-18T13:57:23.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.990+0000 7f17d0c48700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f17b8038b40 0x7f17b803b000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:23.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.990+0000 7f17d0c48700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc104550 0x7f17cc196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:23.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.990+0000 7f17d0c48700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0ff690 0x7f17cc19c920 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:23.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.990+0000 7f17d0c48700 1 --2- 172.21.15.114:0/97213162 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f17cc100050 0x7f17cc19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:23.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.990+0000 7f17d0c48700 1 -- 172.21.15.114:0/97213162 >> 172.21.15.114:0/97213162 conn(0x7f17cc076720 msgr2=0x7f17cc0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:23.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.990+0000 7f17d0c48700 1 -- 172.21.15.114:0/97213162 shutdown_connections 2023-10-18T13:57:23.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:21.990+0000 7f17d0c48700 1 -- 172.21.15.114:0/97213162 wait complete. 2023-10-18T13:57:23.257 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:22 smithi158 ceph-mon[103317]: mgrmap e18: x(active, since 14s), standbys: z 2023-10-18T13:57:23.257 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:22 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-18T13:57:23.258 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:22 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/97213162' entity='client.admin' 2023-10-18T13:57:23.258 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:22 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3398378953' entity='client.admin' 2023-10-18T13:57:23.258 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:22 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:22.923+0000 7f9163627200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T13:57:23.258 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:23 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:23.037+0000 7f9163627200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T13:57:23.259 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:23 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:23.253+0000 7f9163627200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T13:57:23.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:22 smithi172 ceph-mon[103574]: mgrmap e18: x(active, since 14s), standbys: z 2023-10-18T13:57:23.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:22 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-18T13:57:23.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:22 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/97213162' entity='client.admin' 2023-10-18T13:57:23.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:22 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3398378953' entity='client.admin' 2023-10-18T13:57:23.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:22 smithi114 ceph-mon[99494]: mgrmap e18: x(active, since 14s), standbys: z 2023-10-18T13:57:23.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:22 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-18T13:57:23.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:22 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/97213162' entity='client.admin' 2023-10-18T13:57:23.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:22 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3398378953' entity='client.admin' 2023-10-18T13:57:24.521 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 13:57:24 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y[105667]: 2023-10-18T13:57:24.110+0000 7f9163627200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T13:57:24.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:24 smithi158 ceph-mon[103317]: Standby manager daemon y started 2023-10-18T13:57:24.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:24 smithi158 ceph-mon[103317]: from='mgr.? 172.21.15.158:0/1115971470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-18T13:57:24.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:24 smithi158 ceph-mon[103317]: from='mgr.? 172.21.15.158:0/1115971470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T13:57:24.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:24 smithi158 ceph-mon[103317]: from='mgr.? 172.21.15.158:0/1115971470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-18T13:57:24.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:24 smithi158 ceph-mon[103317]: from='mgr.? 172.21.15.158:0/1115971470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T13:57:24.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:24 smithi172 ceph-mon[103574]: Standby manager daemon y started 2023-10-18T13:57:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:24 smithi172 ceph-mon[103574]: from='mgr.? 172.21.15.158:0/1115971470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-18T13:57:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:24 smithi172 ceph-mon[103574]: from='mgr.? 172.21.15.158:0/1115971470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T13:57:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:24 smithi172 ceph-mon[103574]: from='mgr.? 172.21.15.158:0/1115971470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-18T13:57:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:24 smithi172 ceph-mon[103574]: from='mgr.? 172.21.15.158:0/1115971470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T13:57:24.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:24 smithi114 ceph-mon[99494]: Standby manager daemon y started 2023-10-18T13:57:24.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:24 smithi114 ceph-mon[99494]: from='mgr.? 172.21.15.158:0/1115971470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-18T13:57:24.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:24 smithi114 ceph-mon[99494]: from='mgr.? 172.21.15.158:0/1115971470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-18T13:57:24.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:24 smithi114 ceph-mon[99494]: from='mgr.? 172.21.15.158:0/1115971470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-18T13:57:24.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:24 smithi114 ceph-mon[99494]: from='mgr.? 172.21.15.158:0/1115971470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-18T13:57:25.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:25 smithi158 ceph-mon[103317]: mgrmap e19: x(active, since 16s), standbys: z, y 2023-10-18T13:57:25.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-18T13:57:25.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:25 smithi172 ceph-mon[103574]: mgrmap e19: x(active, since 16s), standbys: z, y 2023-10-18T13:57:25.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-18T13:57:25.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:25 smithi114 ceph-mon[99494]: mgrmap e19: x(active, since 16s), standbys: z, y 2023-10-18T13:57:25.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-18T13:57:25.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.822+0000 7f6ab07cd700 1 -- 172.21.15.114:0/1343775717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6aa80ff750 msgr2=0x7f6aa80ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:25.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.822+0000 7f6ab07cd700 1 --2- 172.21.15.114:0/1343775717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6aa80ff750 0x7f6aa80ffbd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009990 tx=0x7f6aa4009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:25.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.822+0000 7f6ab07cd700 1 -- 172.21.15.114:0/1343775717 shutdown_connections 2023-10-18T13:57:25.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.822+0000 7f6ab07cd700 1 --2- 172.21.15.114:0/1343775717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa8100110 0x7f6aa810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:25.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.822+0000 7f6ab07cd700 1 --2- 172.21.15.114:0/1343775717 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aa81056b0 0x7f6aa8105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:25.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.822+0000 7f6ab07cd700 1 --2- 172.21.15.114:0/1343775717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6aa80ff750 0x7f6aa80ffbd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:25.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.822+0000 7f6ab07cd700 1 -- 172.21.15.114:0/1343775717 >> 172.21.15.114:0/1343775717 conn(0x7f6aa8075790 msgr2=0x7f6aa8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:25.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.822+0000 7f6ab07cd700 1 -- 172.21.15.114:0/1343775717 shutdown_connections 2023-10-18T13:57:25.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.822+0000 7f6ab07cd700 1 -- 172.21.15.114:0/1343775717 wait complete. 2023-10-18T13:57:25.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6ab07cd700 1 Processor -- start 2023-10-18T13:57:25.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6ab07cd700 1 -- start start 2023-10-18T13:57:25.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6ab07cd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa80ff750 0x7f6aa819c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:25.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6ab07cd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6aa8100110 0x7f6aa819cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:25.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6ab07cd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aa81056b0 0x7f6aa8196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:25.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6ab07cd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa81971d0 con 0x7f6aa8100110 2023-10-18T13:57:25.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6ab07cd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa8197340 con 0x7f6aa81056b0 2023-10-18T13:57:25.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6ab07cd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa8197500 con 0x7f6aa80ff750 2023-10-18T13:57:25.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6aadd68700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6aa8100110 0x7f6aa819cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:25.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6aadd68700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6aa8100110 0x7f6aa819cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41302/0 (socket says 172.21.15.114:41302) 2023-10-18T13:57:25.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6aadd68700 1 -- 172.21.15.114:0/670894369 learned_addr learned my addr 172.21.15.114:0/670894369 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:25.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6aae569700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa80ff750 0x7f6aa819c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:25.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6aaed6a700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aa81056b0 0x7f6aa8196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:25.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6aadd68700 1 -- 172.21.15.114:0/670894369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa80ff750 msgr2=0x7f6aa819c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:25.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6aadd68700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa80ff750 0x7f6aa819c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:25.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6aadd68700 1 -- 172.21.15.114:0/670894369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aa81056b0 msgr2=0x7f6aa8196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:25.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6aadd68700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aa81056b0 0x7f6aa8196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:25.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6aadd68700 1 -- 172.21.15.114:0/670894369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa40095f0 con 0x7f6aa8100110 2023-10-18T13:57:25.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.823+0000 7f6aae569700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa80ff750 0x7f6aa819c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T13:57:25.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.824+0000 7f6aadd68700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6aa8100110 0x7f6aa819cf20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4000c00 tx=0x7f6aa400f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:25.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.824+0000 7f6a9f7fe700 1 -- 172.21.15.114:0/670894369 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa401d070 con 0x7f6aa8100110 2023-10-18T13:57:25.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.824+0000 7f6a9f7fe700 1 -- 172.21.15.114:0/670894369 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6aa400fde0 con 0x7f6aa8100110 2023-10-18T13:57:25.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.824+0000 7f6a9f7fe700 1 -- 172.21.15.114:0/670894369 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4017770 con 0x7f6aa8100110 2023-10-18T13:57:25.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.824+0000 7f6ab07cd700 1 -- 172.21.15.114:0/670894369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa8197780 con 0x7f6aa8100110 2023-10-18T13:57:25.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.824+0000 7f6ab07cd700 1 -- 172.21.15.114:0/670894369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa81a39d0 con 0x7f6aa8100110 2023-10-18T13:57:25.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.825+0000 7f6ab07cd700 1 -- 172.21.15.114:0/670894369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa8100df0 con 0x7f6aa8100110 2023-10-18T13:57:25.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.826+0000 7f6a9f7fe700 1 -- 172.21.15.114:0/670894369 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f6aa4022aa0 con 0x7f6aa8100110 2023-10-18T13:57:25.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.826+0000 7f6a9f7fe700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6a940a14c0 0x7f6a940a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:25.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.826+0000 7f6aae569700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6a940a14c0 0x7f6a940a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:25.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.826+0000 7f6a9f7fe700 1 -- 172.21.15.114:0/670894369 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f6aa40cc590 con 0x7f6aa8100110 2023-10-18T13:57:25.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.827+0000 7f6aae569700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6a940a14c0 0x7f6a940a3980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6a980099d0 tx=0x7f6a98008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:25.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:25.830+0000 7f6a9f7fe700 1 -- 172.21.15.114:0/670894369 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6aa405d100 con 0x7f6aa8100110 2023-10-18T13:57:26.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.035+0000 7f6ab07cd700 1 -- 172.21.15.114:0/670894369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7f6aa8198010 con 0x7f6aa8100110 2023-10-18T13:57:26.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.039+0000 7f6a9f7fe700 1 -- 172.21.15.114:0/670894369 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v20)=0 v20) v1 ==== 119+0+0 (secure 0 0 0) 0x7f6aa40270b0 con 0x7f6aa8100110 2023-10-18T13:57:26.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.042+0000 7f6ab07cd700 1 -- 172.21.15.114:0/670894369 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6a940a14c0 msgr2=0x7f6a940a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:26.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.042+0000 7f6ab07cd700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6a940a14c0 0x7f6a940a3980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6a980099d0 tx=0x7f6a98008040 comp rx=0 tx=0).stop 2023-10-18T13:57:26.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.042+0000 7f6ab07cd700 1 -- 172.21.15.114:0/670894369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6aa8100110 msgr2=0x7f6aa819cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:26.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.042+0000 7f6ab07cd700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6aa8100110 0x7f6aa819cf20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4000c00 tx=0x7f6aa400f880 comp rx=0 tx=0).stop 2023-10-18T13:57:26.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.042+0000 7f6ab07cd700 1 -- 172.21.15.114:0/670894369 shutdown_connections 2023-10-18T13:57:26.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.042+0000 7f6ab07cd700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6a940a14c0 0x7f6a940a3980 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.042+0000 7f6ab07cd700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6aa81056b0 0x7f6aa8196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.042+0000 7f6ab07cd700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6aa80ff750 0x7f6aa819c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.042+0000 7f6ab07cd700 1 --2- 172.21.15.114:0/670894369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6aa8100110 0x7f6aa819cf20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.042+0000 7f6ab07cd700 1 -- 172.21.15.114:0/670894369 >> 172.21.15.114:0/670894369 conn(0x7f6aa8075790 msgr2=0x7f6aa8103500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.042+0000 7f6ab07cd700 1 -- 172.21.15.114:0/670894369 shutdown_connections 2023-10-18T13:57:26.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.042+0000 7f6ab07cd700 1 -- 172.21.15.114:0/670894369 wait complete. 2023-10-18T13:57:26.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.134+0000 7f59ff55b700 1 -- 172.21.15.114:0/2686298285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f80ff720 msgr2=0x7f59f80ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:26.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.134+0000 7f59ff55b700 1 --2- 172.21.15.114:0/2686298285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f80ff720 0x7f59f80ffba0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009990 tx=0x7f59e8009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.134+0000 7f59ff55b700 1 -- 172.21.15.114:0/2686298285 shutdown_connections 2023-10-18T13:57:26.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.134+0000 7f59ff55b700 1 --2- 172.21.15.114:0/2686298285 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59f81000e0 0x7f59f810c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.134+0000 7f59ff55b700 1 --2- 172.21.15.114:0/2686298285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59f8105690 0x7f59f8105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.134+0000 7f59ff55b700 1 --2- 172.21.15.114:0/2686298285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f80ff720 0x7f59f80ffba0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.134+0000 7f59ff55b700 1 -- 172.21.15.114:0/2686298285 >> 172.21.15.114:0/2686298285 conn(0x7f59f80757a0 msgr2=0x7f59f8075bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:26.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.134+0000 7f59ff55b700 1 -- 172.21.15.114:0/2686298285 shutdown_connections 2023-10-18T13:57:26.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.134+0000 7f59ff55b700 1 -- 172.21.15.114:0/2686298285 wait complete. 2023-10-18T13:57:26.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.135+0000 7f59ff55b700 1 Processor -- start 2023-10-18T13:57:26.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.135+0000 7f59ff55b700 1 -- start start 2023-10-18T13:57:26.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.135+0000 7f59ff55b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f80ff720 0x7f59f8196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:26.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.135+0000 7f59ff55b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59f81000e0 0x7f59f8197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:26.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.135+0000 7f59ff55b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59f8105690 0x7f59f819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:26.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.135+0000 7f59ff55b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f819ab30 con 0x7f59f80ff720 2023-10-18T13:57:26.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.135+0000 7f59ff55b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f819aca0 con 0x7f59f8105690 2023-10-18T13:57:26.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.135+0000 7f59ff55b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f819ae60 con 0x7f59f81000e0 2023-10-18T13:57:26.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.135+0000 7f59fd2f7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f80ff720 0x7f59f8196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:26.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.135+0000 7f59fd2f7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f80ff720 0x7f59f8196cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41314/0 (socket says 172.21.15.114:41314) 2023-10-18T13:57:26.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.135+0000 7f59fd2f7700 1 -- 172.21.15.114:0/3944553042 learned_addr learned my addr 172.21.15.114:0/3944553042 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:26.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.135+0000 7f59fcaf6700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59f81000e0 0x7f59f8197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:26.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.135+0000 7f59fdaf8700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59f8105690 0x7f59f819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.136+0000 7f59fd2f7700 1 -- 172.21.15.114:0/3944553042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59f81000e0 msgr2=0x7f59f8197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.136+0000 7f59fd2f7700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59f81000e0 0x7f59f8197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.136+0000 7f59fd2f7700 1 -- 172.21.15.114:0/3944553042 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59f8105690 msgr2=0x7f59f819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.136+0000 7f59fd2f7700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59f8105690 0x7f59f819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.136+0000 7f59fd2f7700 1 -- 172.21.15.114:0/3944553042 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e80095f0 con 0x7f59f80ff720 2023-10-18T13:57:26.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.136+0000 7f59fd2f7700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f80ff720 0x7f59f8196cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f59f400b530 tx=0x7f59f400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:26.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.136+0000 7f59ee7fc700 1 -- 172.21.15.114:0/3944553042 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4011830 con 0x7f59f80ff720 2023-10-18T13:57:26.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.136+0000 7f59ee7fc700 1 -- 172.21.15.114:0/3944553042 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59f4011e50 con 0x7f59f80ff720 2023-10-18T13:57:26.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.136+0000 7f59ff55b700 1 -- 172.21.15.114:0/3944553042 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f819b140 con 0x7f59f80ff720 2023-10-18T13:57:26.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.136+0000 7f59ee7fc700 1 -- 172.21.15.114:0/3944553042 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f400f2e0 con 0x7f59f80ff720 2023-10-18T13:57:26.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.136+0000 7f59ff55b700 1 -- 172.21.15.114:0/3944553042 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f81a3a90 con 0x7f59f80ff720 2023-10-18T13:57:26.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.137+0000 7f59ff55b700 1 -- 172.21.15.114:0/3944553042 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f8108cc0 con 0x7f59f80ff720 2023-10-18T13:57:26.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.138+0000 7f59ee7fc700 1 -- 172.21.15.114:0/3944553042 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f59f4010580 con 0x7f59f80ff720 2023-10-18T13:57:26.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.139+0000 7f59ee7fc700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f59e40a14c0 0x7f59e40a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:26.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.139+0000 7f59fcaf6700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f59e40a14c0 0x7f59e40a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:26.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.140+0000 7f59ee7fc700 1 -- 172.21.15.114:0/3944553042 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f59f40cb170 con 0x7f59f80ff720 2023-10-18T13:57:26.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.140+0000 7f59fcaf6700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f59e40a14c0 0x7f59e40a3980 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f59e800b5c0 tx=0x7f59e8005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:26.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.143+0000 7f59ee7fc700 1 -- 172.21.15.114:0/3944553042 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f59f40963d0 con 0x7f59f80ff720 2023-10-18T13:57:26.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.352+0000 7f59ff55b700 1 -- 172.21.15.114:0/3944553042 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) v1 -- 0x7f59f804e4c0 con 0x7f59f80ff720 2023-10-18T13:57:26.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.355+0000 7f59ee7fc700 1 -- 172.21.15.114:0/3944553042 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v21)=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7f59f804e4c0 con 0x7f59f80ff720 2023-10-18T13:57:26.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.358+0000 7f59ff55b700 1 -- 172.21.15.114:0/3944553042 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f59e40a14c0 msgr2=0x7f59e40a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:26.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.358+0000 7f59ff55b700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f59e40a14c0 0x7f59e40a3980 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f59e800b5c0 tx=0x7f59e8005fd0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.358+0000 7f59ff55b700 1 -- 172.21.15.114:0/3944553042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f80ff720 msgr2=0x7f59f8196cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:26.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.358+0000 7f59ff55b700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f80ff720 0x7f59f8196cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f59f400b530 tx=0x7f59f400b8f0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.359+0000 7f59ff55b700 1 -- 172.21.15.114:0/3944553042 shutdown_connections 2023-10-18T13:57:26.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.359+0000 7f59ff55b700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f59e40a14c0 0x7f59e40a3980 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f59e800b5c0 tx=0x7f59e8005fd0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.359+0000 7f59ff55b700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f59f8105690 0x7f59f819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.359+0000 7f59ff55b700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59f80ff720 0x7f59f8196cf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.359+0000 7f59ff55b700 1 --2- 172.21.15.114:0/3944553042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59f81000e0 0x7f59f8197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.359+0000 7f59ff55b700 1 -- 172.21.15.114:0/3944553042 >> 172.21.15.114:0/3944553042 conn(0x7f59f80757a0 msgr2=0x7f59f80691e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.361+0000 7f59ff55b700 1 -- 172.21.15.114:0/3944553042 shutdown_connections 2023-10-18T13:57:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:26.361+0000 7f59ff55b700 1 -- 172.21.15.114:0/3944553042 wait complete. 2023-10-18T13:57:27.304 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:27 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/670894369' entity='client.admin' 2023-10-18T13:57:27.305 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:27 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3944553042' entity='client.admin' 2023-10-18T13:57:27.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:27 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/670894369' entity='client.admin' 2023-10-18T13:57:27.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:27 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3944553042' entity='client.admin' 2023-10-18T13:57:27.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:27 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/670894369' entity='client.admin' 2023-10-18T13:57:27.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:27 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3944553042' entity='client.admin' 2023-10-18T13:57:27.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.400+0000 7fa0a5382700 1 -- 172.21.15.114:0/2316148517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a01045b0 msgr2=0x7fa0a0104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:27.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.400+0000 7fa0a5382700 1 --2- 172.21.15.114:0/2316148517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a01045b0 0x7fa0a0104990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa090009990 tx=0x7fa090009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.400+0000 7fa0a5382700 1 -- 172.21.15.114:0/2316148517 shutdown_connections 2023-10-18T13:57:27.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.400+0000 7fa0a5382700 1 --2- 172.21.15.114:0/2316148517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a01000a0 0x7fa0a010c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.400+0000 7fa0a5382700 1 --2- 172.21.15.114:0/2316148517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a01045b0 0x7fa0a0104990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.400+0000 7fa0a5382700 1 --2- 172.21.15.114:0/2316148517 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa0a00ff6e0 0x7fa0a00ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.400+0000 7fa0a5382700 1 -- 172.21.15.114:0/2316148517 >> 172.21.15.114:0/2316148517 conn(0x7fa0a00766c0 msgr2=0x7fa0a0076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:27.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.400+0000 7fa0a5382700 1 -- 172.21.15.114:0/2316148517 shutdown_connections 2023-10-18T13:57:27.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.400+0000 7fa0a5382700 1 -- 172.21.15.114:0/2316148517 wait complete. 2023-10-18T13:57:27.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.401+0000 7fa0a5382700 1 Processor -- start 2023-10-18T13:57:27.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.401+0000 7fa0a5382700 1 -- start start 2023-10-18T13:57:27.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.401+0000 7fa0a5382700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa0a00ff6e0 0x7fa0a0198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:27.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.401+0000 7fa0a5382700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a01000a0 0x7fa0a0199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:27.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.401+0000 7fa0a5382700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a01045b0 0x7fa0a019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.401+0000 7fa0a5382700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a019dd00 con 0x7fa0a01000a0 2023-10-18T13:57:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.401+0000 7fa0a5382700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a019de70 con 0x7fa0a00ff6e0 2023-10-18T13:57:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.401+0000 7fa0a5382700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a019e030 con 0x7fa0a01045b0 2023-10-18T13:57:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa09e7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a01000a0 0x7fa0a0199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa09e7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a01000a0 0x7fa0a0199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41330/0 (socket says 172.21.15.114:41330) 2023-10-18T13:57:27.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa09e7fc700 1 -- 172.21.15.114:0/1896829736 learned_addr learned my addr 172.21.15.114:0/1896829736 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:27.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa09f7fe700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a01045b0 0x7fa0a019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:27.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa09effd700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa0a00ff6e0 0x7fa0a0198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:27.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa09e7fc700 1 -- 172.21.15.114:0/1896829736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a01045b0 msgr2=0x7fa0a019d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:27.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa09e7fc700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a01045b0 0x7fa0a019d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa09e7fc700 1 -- 172.21.15.114:0/1896829736 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa0a00ff6e0 msgr2=0x7fa0a0198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:27.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa09e7fc700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa0a00ff6e0 0x7fa0a0198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa09e7fc700 1 -- 172.21.15.114:0/1896829736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0900095f0 con 0x7fa0a01000a0 2023-10-18T13:57:27.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa09e7fc700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a01000a0 0x7fa0a0199340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c920 tx=0x7fa09400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:27.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa087fff700 1 -- 172.21.15.114:0/1896829736 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094004a30 con 0x7fa0a01000a0 2023-10-18T13:57:27.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa087fff700 1 -- 172.21.15.114:0/1896829736 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa0940054e0 con 0x7fa0a01000a0 2023-10-18T13:57:27.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa0a5382700 1 -- 172.21.15.114:0/1896829736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a019e310 con 0x7fa0a01000a0 2023-10-18T13:57:27.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa087fff700 1 -- 172.21.15.114:0/1896829736 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094007bd0 con 0x7fa0a01000a0 2023-10-18T13:57:27.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.402+0000 7fa0a5382700 1 -- 172.21.15.114:0/1896829736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a01a5b70 con 0x7fa0a01000a0 2023-10-18T13:57:27.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.404+0000 7fa0a5382700 1 -- 172.21.15.114:0/1896829736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a0107c20 con 0x7fa0a01000a0 2023-10-18T13:57:27.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.404+0000 7fa087fff700 1 -- 172.21.15.114:0/1896829736 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fa094005000 con 0x7fa0a01000a0 2023-10-18T13:57:27.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.405+0000 7fa087fff700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa0880a1420 0x7fa0880a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:27.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.405+0000 7fa09effd700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa0880a1420 0x7fa0880a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:27.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.405+0000 7fa087fff700 1 -- 172.21.15.114:0/1896829736 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa0940cac50 con 0x7fa0a01000a0 2023-10-18T13:57:27.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.406+0000 7fa09effd700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa0880a1420 0x7fa0880a38e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa09000b5c0 tx=0x7fa090005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:27.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.410+0000 7fa087fff700 1 -- 172.21.15.114:0/1896829736 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa094095eb0 con 0x7fa0a01000a0 2023-10-18T13:57:27.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.603+0000 7fade271a700 1 -- 172.21.15.114:0/1218915234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faddc069740 msgr2=0x7faddc10cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:27.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.603+0000 7fade271a700 1 --2- 172.21.15.114:0/1218915234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faddc069740 0x7faddc10cdc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009990 tx=0x7fadd0009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.604+0000 7fade271a700 1 -- 172.21.15.114:0/1218915234 shutdown_connections 2023-10-18T13:57:27.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.604+0000 7fade271a700 1 --2- 172.21.15.114:0/1218915234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faddc10d300 0x7faddc10f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.604+0000 7fade271a700 1 --2- 172.21.15.114:0/1218915234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faddc068e20 0x7faddc069200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.604+0000 7fade271a700 1 --2- 172.21.15.114:0/1218915234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faddc069740 0x7faddc10cdc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.604+0000 7fade271a700 1 -- 172.21.15.114:0/1218915234 >> 172.21.15.114:0/1218915234 conn(0x7faddc0757d0 msgr2=0x7faddc075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.604+0000 7fade271a700 1 -- 172.21.15.114:0/1218915234 shutdown_connections 2023-10-18T13:57:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.604+0000 7fade271a700 1 -- 172.21.15.114:0/1218915234 wait complete. 2023-10-18T13:57:27.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.604+0000 7fade271a700 1 Processor -- start 2023-10-18T13:57:27.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.604+0000 7fade271a700 1 -- start start 2023-10-18T13:57:27.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7fade271a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faddc068e20 0x7faddc198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:27.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7fade271a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faddc069740 0x7faddc1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:27.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7fade271a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faddc10d300 0x7faddc19d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:27.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7fade271a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc19dd90 con 0x7faddc068e20 2023-10-18T13:57:27.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7fade271a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc19df00 con 0x7faddc10d300 2023-10-18T13:57:27.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7fade271a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc19e0c0 con 0x7faddc069740 2023-10-18T13:57:27.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7faddbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faddc068e20 0x7faddc198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7faddbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faddc068e20 0x7faddc198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41354/0 (socket says 172.21.15.114:41354) 2023-10-18T13:57:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7faddbfff700 1 -- 172.21.15.114:0/3920804929 learned_addr learned my addr 172.21.15.114:0/3920804929 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7faddb7fe700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faddc069740 0x7faddc1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7fade0cb7700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faddc10d300 0x7faddc19d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7faddbfff700 1 -- 172.21.15.114:0/3920804929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faddc069740 msgr2=0x7faddc1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7faddbfff700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faddc069740 0x7faddc1993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7faddbfff700 1 -- 172.21.15.114:0/3920804929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faddc10d300 msgr2=0x7faddc19d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7faddbfff700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faddc10d300 0x7faddc19d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.605+0000 7faddbfff700 1 -- 172.21.15.114:0/3920804929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd00095f0 con 0x7faddc068e20 2023-10-18T13:57:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.606+0000 7faddbfff700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faddc068e20 0x7faddc198e90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00d980 tx=0x7fadcc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:27.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.606+0000 7fadd97fa700 1 -- 172.21.15.114:0/3920804929 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc009b40 con 0x7faddc068e20 2023-10-18T13:57:27.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.606+0000 7fadd97fa700 1 -- 172.21.15.114:0/3920804929 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadcc00de60 con 0x7faddc068e20 2023-10-18T13:57:27.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.606+0000 7fade271a700 1 -- 172.21.15.114:0/3920804929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc19e3a0 con 0x7faddc068e20 2023-10-18T13:57:27.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.606+0000 7fadd97fa700 1 -- 172.21.15.114:0/3920804929 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc005580 con 0x7faddc068e20 2023-10-18T13:57:27.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.606+0000 7fade271a700 1 -- 172.21.15.114:0/3920804929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc1a5c00 con 0x7faddc068e20 2023-10-18T13:57:27.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.607+0000 7fade271a700 1 -- 172.21.15.114:0/3920804929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc108520 con 0x7faddc068e20 2023-10-18T13:57:27.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.608+0000 7fadd97fa700 1 -- 172.21.15.114:0/3920804929 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fadcc004750 con 0x7faddc068e20 2023-10-18T13:57:27.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.609+0000 7fadd97fa700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fadc40a14c0 0x7fadc40a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:27.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.609+0000 7faddb7fe700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fadc40a14c0 0x7fadc40a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:27.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.609+0000 7fadd97fa700 1 -- 172.21.15.114:0/3920804929 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fadcc0cb0a0 con 0x7faddc068e20 2023-10-18T13:57:27.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.609+0000 7faddb7fe700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fadc40a14c0 0x7fadc40a3980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fadd000b5c0 tx=0x7fadd001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:27.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.617+0000 7fadd97fa700 1 -- 172.21.15.114:0/3920804929 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fadcc096300 con 0x7faddc068e20 2023-10-18T13:57:27.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.637+0000 7fa0a5382700 1 -- 172.21.15.114:0/1896829736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fa0a019a110 con 0x7fa0a01000a0 2023-10-18T13:57:27.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.640+0000 7fa087fff700 1 -- 172.21.15.114:0/1896829736 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) v1 ==== 121+0+0 (secure 0 0 0) 0x7fa09401d0c0 con 0x7fa0a01000a0 2023-10-18T13:57:27.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.643+0000 7fa0a5382700 1 -- 172.21.15.114:0/1896829736 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa0880a1420 msgr2=0x7fa0880a38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:27.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.643+0000 7fa0a5382700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa0880a1420 0x7fa0880a38e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa09000b5c0 tx=0x7fa090005960 comp rx=0 tx=0).stop 2023-10-18T13:57:27.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.643+0000 7fa0a5382700 1 -- 172.21.15.114:0/1896829736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a01000a0 msgr2=0x7fa0a0199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:27.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.643+0000 7fa0a5382700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a01000a0 0x7fa0a0199340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c920 tx=0x7fa09400cc30 comp rx=0 tx=0).stop 2023-10-18T13:57:27.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.643+0000 7fa0a5382700 1 -- 172.21.15.114:0/1896829736 shutdown_connections 2023-10-18T13:57:27.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.643+0000 7fa0a5382700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa0880a1420 0x7fa0880a38e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.643+0000 7fa0a5382700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a01045b0 0x7fa0a019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.643+0000 7fa0a5382700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa0a00ff6e0 0x7fa0a0198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.643+0000 7fa0a5382700 1 --2- 172.21.15.114:0/1896829736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a01000a0 0x7fa0a0199340 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.643+0000 7fa0a5382700 1 -- 172.21.15.114:0/1896829736 >> 172.21.15.114:0/1896829736 conn(0x7fa0a00766c0 msgr2=0x7fa0a00fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:27.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.643+0000 7fa0a5382700 1 -- 172.21.15.114:0/1896829736 shutdown_connections 2023-10-18T13:57:27.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.643+0000 7fa0a5382700 1 -- 172.21.15.114:0/1896829736 wait complete. 2023-10-18T13:57:27.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.822+0000 7fade271a700 1 -- 172.21.15.114:0/3920804929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7faddc04e4c0 con 0x7faddc068e20 2023-10-18T13:57:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.826+0000 7fadd97fa700 1 -- 172.21.15.114:0/3920804929 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v24)=0 v24) v1 ==== 121+0+0 (secure 0 0 0) 0x7fadcc0170c0 con 0x7faddc068e20 2023-10-18T13:57:27.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.830+0000 7fade271a700 1 -- 172.21.15.114:0/3920804929 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fadc40a14c0 msgr2=0x7fadc40a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:27.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.830+0000 7fade271a700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fadc40a14c0 0x7fadc40a3980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fadd000b5c0 tx=0x7fadd001a040 comp rx=0 tx=0).stop 2023-10-18T13:57:27.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.830+0000 7fade271a700 1 -- 172.21.15.114:0/3920804929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faddc068e20 msgr2=0x7faddc198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:27.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.830+0000 7fade271a700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faddc068e20 0x7faddc198e90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00d980 tx=0x7fadcc00dd40 comp rx=0 tx=0).stop 2023-10-18T13:57:27.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.830+0000 7fade271a700 1 -- 172.21.15.114:0/3920804929 shutdown_connections 2023-10-18T13:57:27.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.830+0000 7fade271a700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fadc40a14c0 0x7fadc40a3980 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.830+0000 7fade271a700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faddc10d300 0x7faddc19d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.830+0000 7fade271a700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faddc068e20 0x7faddc198e90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.830+0000 7fade271a700 1 --2- 172.21.15.114:0/3920804929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faddc069740 0x7faddc1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:27.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.830+0000 7fade271a700 1 -- 172.21.15.114:0/3920804929 >> 172.21.15.114:0/3920804929 conn(0x7faddc0757d0 msgr2=0x7faddc10e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:27.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.830+0000 7fade271a700 1 -- 172.21.15.114:0/3920804929 shutdown_connections 2023-10-18T13:57:27.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.830+0000 7fade271a700 1 -- 172.21.15.114:0/3920804929 wait complete. 2023-10-18T13:57:28.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.899+0000 7fd1e33fe700 1 -- 172.21.15.114:0/2101162920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1dc1008a0 msgr2=0x7fd1dc100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.899+0000 7fd1e33fe700 1 --2- 172.21.15.114:0/2101162920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1dc1008a0 0x7fd1dc100d20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009990 tx=0x7fd1cc009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.899+0000 7fd1e33fe700 1 -- 172.21.15.114:0/2101162920 shutdown_connections 2023-10-18T13:57:28.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.899+0000 7fd1e33fe700 1 --2- 172.21.15.114:0/2101162920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1dc101260 0x7fd1dc10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.899+0000 7fd1e33fe700 1 --2- 172.21.15.114:0/2101162920 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1dc1057c0 0x7fd1dc105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.899+0000 7fd1e33fe700 1 --2- 172.21.15.114:0/2101162920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1dc1008a0 0x7fd1dc100d20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.899+0000 7fd1e33fe700 1 -- 172.21.15.114:0/2101162920 >> 172.21.15.114:0/2101162920 conn(0x7fd1dc0779e0 msgr2=0x7fd1dc077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:28.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.899+0000 7fd1e33fe700 1 -- 172.21.15.114:0/2101162920 shutdown_connections 2023-10-18T13:57:28.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.899+0000 7fd1e33fe700 1 -- 172.21.15.114:0/2101162920 wait complete. 2023-10-18T13:57:28.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.900+0000 7fd1e33fe700 1 Processor -- start 2023-10-18T13:57:28.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.900+0000 7fd1e33fe700 1 -- start start 2023-10-18T13:57:28.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.900+0000 7fd1e33fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1dc1008a0 0x7fd1dc19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:28.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.900+0000 7fd1e33fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1dc101260 0x7fd1dc19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:28.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.900+0000 7fd1e33fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1dc1057c0 0x7fd1dc196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:28.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.900+0000 7fd1e33fe700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc1971e0 con 0x7fd1dc101260 2023-10-18T13:57:28.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.900+0000 7fd1e33fe700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc197350 con 0x7fd1dc1057c0 2023-10-18T13:57:28.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.900+0000 7fd1e33fe700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc197510 con 0x7fd1dc1008a0 2023-10-18T13:57:28.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.900+0000 7fd1e0999700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1dc101260 0x7fd1dc19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:28.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.900+0000 7fd1e0999700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1dc101260 0x7fd1dc19cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41368/0 (socket says 172.21.15.114:41368) 2023-10-18T13:57:28.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.900+0000 7fd1e0999700 1 -- 172.21.15.114:0/3997797599 learned_addr learned my addr 172.21.15.114:0/3997797599 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:28.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.900+0000 7fd1e119a700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1dc1008a0 0x7fd1dc19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:28.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.901+0000 7fd1e199b700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1dc1057c0 0x7fd1dc196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:28.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.901+0000 7fd1e0999700 1 -- 172.21.15.114:0/3997797599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1dc1008a0 msgr2=0x7fd1dc19c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.901+0000 7fd1e0999700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1dc1008a0 0x7fd1dc19c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.901+0000 7fd1e0999700 1 -- 172.21.15.114:0/3997797599 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1dc1057c0 msgr2=0x7fd1dc196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.901+0000 7fd1e0999700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1dc1057c0 0x7fd1dc196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.901+0000 7fd1e0999700 1 -- 172.21.15.114:0/3997797599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc0095f0 con 0x7fd1dc101260 2023-10-18T13:57:28.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.901+0000 7fd1e199b700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1dc1057c0 0x7fd1dc196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T13:57:28.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.901+0000 7fd1e0999700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1dc101260 0x7fd1dc19cec0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00f6a0 tx=0x7fd1cc00f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:28.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.901+0000 7fd1d27fc700 1 -- 172.21.15.114:0/3997797599 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc01d070 con 0x7fd1dc101260 2023-10-18T13:57:28.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.901+0000 7fd1d27fc700 1 -- 172.21.15.114:0/3997797599 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1cc00fca0 con 0x7fd1dc101260 2023-10-18T13:57:28.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.901+0000 7fd1e33fe700 1 -- 172.21.15.114:0/3997797599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc197790 con 0x7fd1dc101260 2023-10-18T13:57:28.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.901+0000 7fd1d27fc700 1 -- 172.21.15.114:0/3997797599 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc017650 con 0x7fd1dc101260 2023-10-18T13:57:28.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.901+0000 7fd1e33fe700 1 -- 172.21.15.114:0/3997797599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc1a3900 con 0x7fd1dc101260 2023-10-18T13:57:28.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.902+0000 7fd1e33fe700 1 -- 172.21.15.114:0/3997797599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc108da0 con 0x7fd1dc101260 2023-10-18T13:57:28.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.903+0000 7fd1d27fc700 1 -- 172.21.15.114:0/3997797599 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fd1cc022470 con 0x7fd1dc101260 2023-10-18T13:57:28.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.904+0000 7fd1d27fc700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd1c80a1440 0x7fd1c80a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:28.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.904+0000 7fd1d27fc700 1 -- 172.21.15.114:0/3997797599 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd1cc0cc4f0 con 0x7fd1dc101260 2023-10-18T13:57:28.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.904+0000 7fd1e119a700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd1c80a1440 0x7fd1c80a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:28.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.904+0000 7fd1e119a700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd1c80a1440 0x7fd1c80a3900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8005fd0 tx=0x7fd1d800a4c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:28.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.908+0000 7fd1d27fc700 1 -- 172.21.15.114:0/3997797599 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd1cc0977e0 con 0x7fd1dc101260 2023-10-18T13:57:28.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.117+0000 7fd1e33fe700 1 -- 172.21.15.114:0/3997797599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) v1 -- 0x7fd1dc04e4c0 con 0x7fd1dc101260 2023-10-18T13:57:28.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.121+0000 7fd1d27fc700 1 -- 172.21.15.114:0/3997797599 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v25)=0 v25) v1 ==== 116+0+0 (secure 0 0 0) 0x7fd1cc09ae00 con 0x7fd1dc101260 2023-10-18T13:57:28.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.124+0000 7fd1e33fe700 1 -- 172.21.15.114:0/3997797599 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd1c80a1440 msgr2=0x7fd1c80a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.124+0000 7fd1e33fe700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd1c80a1440 0x7fd1c80a3900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8005fd0 tx=0x7fd1d800a4c0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.124+0000 7fd1e33fe700 1 -- 172.21.15.114:0/3997797599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1dc101260 msgr2=0x7fd1dc19cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.124+0000 7fd1e33fe700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1dc101260 0x7fd1dc19cec0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00f6a0 tx=0x7fd1cc00f780 comp rx=0 tx=0).stop 2023-10-18T13:57:28.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.124+0000 7fd1e33fe700 1 -- 172.21.15.114:0/3997797599 shutdown_connections 2023-10-18T13:57:28.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.124+0000 7fd1e33fe700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd1c80a1440 0x7fd1c80a3900 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.124+0000 7fd1e33fe700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd1dc1057c0 0x7fd1dc196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.124+0000 7fd1e33fe700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1dc1008a0 0x7fd1dc19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.124+0000 7fd1e33fe700 1 --2- 172.21.15.114:0/3997797599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1dc101260 0x7fd1dc19cec0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.124+0000 7fd1e33fe700 1 -- 172.21.15.114:0/3997797599 >> 172.21.15.114:0/3997797599 conn(0x7fd1dc0779e0 msgr2=0x7fd1dc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:28.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.124+0000 7fd1e33fe700 1 -- 172.21.15.114:0/3997797599 shutdown_connections 2023-10-18T13:57:28.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.124+0000 7fd1e33fe700 1 -- 172.21.15.114:0/3997797599 wait complete. 2023-10-18T13:57:28.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.494+0000 7fb970633700 1 -- 172.21.15.114:0/4088593380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9680ff750 msgr2=0x7fb9680ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.494+0000 7fb970633700 1 --2- 172.21.15.114:0/4088593380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9680ff750 0x7fb9680ffbd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb958009990 tx=0x7fb958009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.494+0000 7fb970633700 1 -- 172.21.15.114:0/4088593380 shutdown_connections 2023-10-18T13:57:28.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.494+0000 7fb970633700 1 --2- 172.21.15.114:0/4088593380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb968100110 0x7fb96810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.494+0000 7fb970633700 1 --2- 172.21.15.114:0/4088593380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9681056b0 0x7fb968105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.494+0000 7fb970633700 1 --2- 172.21.15.114:0/4088593380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9680ff750 0x7fb9680ffbd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.494+0000 7fb970633700 1 -- 172.21.15.114:0/4088593380 >> 172.21.15.114:0/4088593380 conn(0x7fb968075790 msgr2=0x7fb968075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:28.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.495+0000 7fb970633700 1 -- 172.21.15.114:0/4088593380 shutdown_connections 2023-10-18T13:57:28.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.495+0000 7fb970633700 1 -- 172.21.15.114:0/4088593380 wait complete. 2023-10-18T13:57:28.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.495+0000 7fb970633700 1 Processor -- start 2023-10-18T13:57:28.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.495+0000 7fb970633700 1 -- start start 2023-10-18T13:57:28.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.495+0000 7fb970633700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9680ff750 0x7fb968197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:28.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.495+0000 7fb970633700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb968100110 0x7fb968198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:28.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.495+0000 7fb970633700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9681056b0 0x7fb9681a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:28.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.495+0000 7fb970633700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb968198860 con 0x7fb9680ff750 2023-10-18T13:57:28.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.495+0000 7fb970633700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681a3090 con 0x7fb968100110 2023-10-18T13:57:28.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.495+0000 7fb970633700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681a31d0 con 0x7fb9681056b0 2023-10-18T13:57:28.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.495+0000 7fb96e3cf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9680ff750 0x7fb968197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:28.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.495+0000 7fb96e3cf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9680ff750 0x7fb968197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41378/0 (socket says 172.21.15.114:41378) 2023-10-18T13:57:28.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.495+0000 7fb96e3cf700 1 -- 172.21.15.114:0/278517400 learned_addr learned my addr 172.21.15.114:0/278517400 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:28.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb96dbce700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb968100110 0x7fb968198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:28.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb96ebd0700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9681056b0 0x7fb9681a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:28.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb96e3cf700 1 -- 172.21.15.114:0/278517400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9681056b0 msgr2=0x7fb9681a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb96e3cf700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9681056b0 0x7fb9681a2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb96e3cf700 1 -- 172.21.15.114:0/278517400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb968100110 msgr2=0x7fb968198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb96e3cf700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb968100110 0x7fb968198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb96e3cf700 1 -- 172.21.15.114:0/278517400 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9580095f0 con 0x7fb9680ff750 2023-10-18T13:57:28.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb96dbce700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb968100110 0x7fb968198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T13:57:28.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb96e3cf700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9680ff750 0x7fb968197ad0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c9e0 tx=0x7fb96400cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:28.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb95f7fe700 1 -- 172.21.15.114:0/278517400 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964007ac0 con 0x7fb9680ff750 2023-10-18T13:57:28.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb95f7fe700 1 -- 172.21.15.114:0/278517400 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb964007c20 con 0x7fb9680ff750 2023-10-18T13:57:28.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb970633700 1 -- 172.21.15.114:0/278517400 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9681a3430 con 0x7fb9680ff750 2023-10-18T13:57:28.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb95f7fe700 1 -- 172.21.15.114:0/278517400 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964018660 con 0x7fb9680ff750 2023-10-18T13:57:28.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.496+0000 7fb970633700 1 -- 172.21.15.114:0/278517400 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9681a3980 con 0x7fb9680ff750 2023-10-18T13:57:28.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.497+0000 7fb970633700 1 -- 172.21.15.114:0/278517400 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb968107cd0 con 0x7fb9680ff750 2023-10-18T13:57:28.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.498+0000 7fb95f7fe700 1 -- 172.21.15.114:0/278517400 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fb96400f450 con 0x7fb9680ff750 2023-10-18T13:57:28.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.499+0000 7fb95f7fe700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb9540a14c0 0x7fb9540a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:28.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.499+0000 7fb96dbce700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb9540a14c0 0x7fb9540a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:28.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.499+0000 7fb95f7fe700 1 -- 172.21.15.114:0/278517400 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb9640cb170 con 0x7fb9680ff750 2023-10-18T13:57:28.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.499+0000 7fb96dbce700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb9540a14c0 0x7fb9540a3980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb958006010 tx=0x7fb95801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:28.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.503+0000 7fb95f7fe700 1 -- 172.21.15.114:0/278517400 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb964096330 con 0x7fb9680ff750 2023-10-18T13:57:28.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.702+0000 7fb970633700 1 -- 172.21.15.114:0/278517400 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7fb968100df0 con 0x7fb9680ff750 2023-10-18T13:57:28.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.706+0000 7fb95f7fe700 1 -- 172.21.15.114:0/278517400 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb964099950 con 0x7fb9680ff750 2023-10-18T13:57:28.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.708+0000 7fb970633700 1 -- 172.21.15.114:0/278517400 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb9540a14c0 msgr2=0x7fb9540a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.708+0000 7fb970633700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb9540a14c0 0x7fb9540a3980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb958006010 tx=0x7fb95801a040 comp rx=0 tx=0).stop 2023-10-18T13:57:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.708+0000 7fb970633700 1 -- 172.21.15.114:0/278517400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9680ff750 msgr2=0x7fb968197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.708+0000 7fb970633700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9680ff750 0x7fb968197ad0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c9e0 tx=0x7fb96400cda0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.708+0000 7fb970633700 1 -- 172.21.15.114:0/278517400 shutdown_connections 2023-10-18T13:57:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.708+0000 7fb970633700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb9540a14c0 0x7fb9540a3980 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb958006010 tx=0x7fb95801a040 comp rx=0 tx=0).stop 2023-10-18T13:57:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.708+0000 7fb970633700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9681056b0 0x7fb9681a2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.708+0000 7fb970633700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9680ff750 0x7fb968197ad0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.708+0000 7fb970633700 1 --2- 172.21.15.114:0/278517400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb968100110 0x7fb968198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.708+0000 7fb970633700 1 -- 172.21.15.114:0/278517400 >> 172.21.15.114:0/278517400 conn(0x7fb968075790 msgr2=0x7fb9680fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.708+0000 7fb970633700 1 -- 172.21.15.114:0/278517400 shutdown_connections 2023-10-18T13:57:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.709+0000 7fb970633700 1 -- 172.21.15.114:0/278517400 wait complete. 2023-10-18T13:57:28.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.760+0000 7fa8bf279700 1 -- 172.21.15.114:0/3331063454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b81057c0 msgr2=0x7fa8b8105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.760+0000 7fa8bf279700 1 --2- 172.21.15.114:0/3331063454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b81057c0 0x7fa8b8105ba0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009990 tx=0x7fa8a8009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.760+0000 7fa8bf279700 1 -- 172.21.15.114:0/3331063454 shutdown_connections 2023-10-18T13:57:28.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.760+0000 7fa8bf279700 1 --2- 172.21.15.114:0/3331063454 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8b8101260 0x7fa8b810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.760+0000 7fa8bf279700 1 --2- 172.21.15.114:0/3331063454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b81057c0 0x7fa8b8105ba0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.760+0000 7fa8bf279700 1 --2- 172.21.15.114:0/3331063454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b81008a0 0x7fa8b8100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.760+0000 7fa8bf279700 1 -- 172.21.15.114:0/3331063454 >> 172.21.15.114:0/3331063454 conn(0x7fa8b80779e0 msgr2=0x7fa8b8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:28.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.760+0000 7fa8bf279700 1 -- 172.21.15.114:0/3331063454 shutdown_connections 2023-10-18T13:57:28.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.760+0000 7fa8bf279700 1 -- 172.21.15.114:0/3331063454 wait complete. 2023-10-18T13:57:28.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.760+0000 7fa8bf279700 1 Processor -- start 2023-10-18T13:57:28.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.760+0000 7fa8bf279700 1 -- start start 2023-10-18T13:57:28.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bf279700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b81008a0 0x7fa8b819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:28.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bf279700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8b8101260 0x7fa8b819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:28.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bf279700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b81057c0 0x7fa8b8196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:28.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bf279700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b81970d0 con 0x7fa8b81008a0 2023-10-18T13:57:28.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bf279700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b8197240 con 0x7fa8b8101260 2023-10-18T13:57:28.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bf279700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b8197400 con 0x7fa8b81057c0 2023-10-18T13:57:28.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bd015700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b81008a0 0x7fa8b819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:28.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bd015700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b81008a0 0x7fa8b819c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41390/0 (socket says 172.21.15.114:41390) 2023-10-18T13:57:28.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bd015700 1 -- 172.21.15.114:0/214988242 learned_addr learned my addr 172.21.15.114:0/214988242 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:28.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bc814700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8b8101260 0x7fa8b819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:28.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bd816700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b81057c0 0x7fa8b8196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:28.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bd015700 1 -- 172.21.15.114:0/214988242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b81057c0 msgr2=0x7fa8b8196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bd015700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b81057c0 0x7fa8b8196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bd015700 1 -- 172.21.15.114:0/214988242 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8b8101260 msgr2=0x7fa8b819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bd015700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8b8101260 0x7fa8b819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bd015700 1 -- 172.21.15.114:0/214988242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a80095f0 con 0x7fa8b81008a0 2023-10-18T13:57:28.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bd816700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b81057c0 0x7fa8b8196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T13:57:28.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bc814700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8b8101260 0x7fa8b819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T13:57:28.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bd015700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b81008a0 0x7fa8b819c930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80098e0 tx=0x7fa8a800f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:28.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8ae7fc700 1 -- 172.21.15.114:0/214988242 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a801d070 con 0x7fa8b81008a0 2023-10-18T13:57:28.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8ae7fc700 1 -- 172.21.15.114:0/214988242 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8a800fb90 con 0x7fa8b81008a0 2023-10-18T13:57:28.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8bf279700 1 -- 172.21.15.114:0/214988242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b8197680 con 0x7fa8b81008a0 2023-10-18T13:57:28.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.761+0000 7fa8ae7fc700 1 -- 172.21.15.114:0/214988242 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8017650 con 0x7fa8b81008a0 2023-10-18T13:57:28.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.762+0000 7fa8bf279700 1 -- 172.21.15.114:0/214988242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b81a3920 con 0x7fa8b81008a0 2023-10-18T13:57:28.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.763+0000 7fa8bf279700 1 -- 172.21.15.114:0/214988242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b8108d80 con 0x7fa8b81008a0 2023-10-18T13:57:28.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.763+0000 7fa8ae7fc700 1 -- 172.21.15.114:0/214988242 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fa8a800fd00 con 0x7fa8b81008a0 2023-10-18T13:57:28.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.764+0000 7fa8ae7fc700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa8a40a1440 0x7fa8a40a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:28.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.764+0000 7fa8bc814700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa8a40a1440 0x7fa8a40a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:28.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.764+0000 7fa8ae7fc700 1 -- 172.21.15.114:0/214988242 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa8a80cc200 con 0x7fa8b81008a0 2023-10-18T13:57:28.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.764+0000 7fa8bc814700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa8a40a1440 0x7fa8a40a3900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4005950 tx=0x7fa8b40058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:28.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.768+0000 7fa8ae7fc700 1 -- 172.21.15.114:0/214988242 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa8a80974f0 con 0x7fa8b81008a0 2023-10-18T13:57:28.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:28 smithi114 ceph-mon[99494]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:28.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:28 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1896829736' entity='client.admin' 2023-10-18T13:57:28.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:28 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/994325531' entity='client.admin' 2023-10-18T13:57:28.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:28 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3920804929' entity='client.admin' 2023-10-18T13:57:28.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:28 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3997797599' entity='client.admin' 2023-10-18T13:57:28.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.987+0000 7fa8bf279700 1 -- 172.21.15.114:0/214988242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fa8b8101f30 con 0x7fa8b81008a0 2023-10-18T13:57:28.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.990+0000 7fa8ae7fc700 1 -- 172.21.15.114:0/214988242 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v27)=0 v27) v1 ==== 121+0+0 (secure 0 0 0) 0x7fa8a809ab10 con 0x7fa8b81008a0 2023-10-18T13:57:28.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.993+0000 7fa8bf279700 1 -- 172.21.15.114:0/214988242 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa8a40a1440 msgr2=0x7fa8a40a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.993+0000 7fa8bf279700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa8a40a1440 0x7fa8a40a3900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4005950 tx=0x7fa8b40058e0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.993+0000 7fa8bf279700 1 -- 172.21.15.114:0/214988242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b81008a0 msgr2=0x7fa8b819c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:28.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.993+0000 7fa8bf279700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b81008a0 0x7fa8b819c930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80098e0 tx=0x7fa8a800f720 comp rx=0 tx=0).stop 2023-10-18T13:57:28.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.993+0000 7fa8bf279700 1 -- 172.21.15.114:0/214988242 shutdown_connections 2023-10-18T13:57:28.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.993+0000 7fa8bf279700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa8a40a1440 0x7fa8a40a3900 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.993+0000 7fa8bf279700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b81057c0 0x7fa8b8196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.993+0000 7fa8bf279700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b81008a0 0x7fa8b819c930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.993+0000 7fa8bf279700 1 --2- 172.21.15.114:0/214988242 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa8b8101260 0x7fa8b819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:28.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.993+0000 7fa8bf279700 1 -- 172.21.15.114:0/214988242 >> 172.21.15.114:0/214988242 conn(0x7fa8b80779e0 msgr2=0x7fa8b80fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:28.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.993+0000 7fa8bf279700 1 -- 172.21.15.114:0/214988242 shutdown_connections 2023-10-18T13:57:29.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:28.993+0000 7fa8bf279700 1 -- 172.21.15.114:0/214988242 wait complete. 2023-10-18T13:57:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:28 smithi158 ceph-mon[103317]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:28 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1896829736' entity='client.admin' 2023-10-18T13:57:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:28 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/994325531' entity='client.admin' 2023-10-18T13:57:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:28 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3920804929' entity='client.admin' 2023-10-18T13:57:29.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:28 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3997797599' entity='client.admin' 2023-10-18T13:57:29.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:28 smithi172 ceph-mon[103574]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:29.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:28 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1896829736' entity='client.admin' 2023-10-18T13:57:29.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:28 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/994325531' entity='client.admin' 2023-10-18T13:57:29.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:28 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3920804929' entity='client.admin' 2023-10-18T13:57:29.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:28 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3997797599' entity='client.admin' 2023-10-18T13:57:29.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.575+0000 7f969b737700 1 -- 172.21.15.114:0/1221188360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96941057c0 msgr2=0x7f9694105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:29.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.575+0000 7f969b737700 1 --2- 172.21.15.114:0/1221188360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96941057c0 0x7f9694105ba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9690009990 tx=0x7f9690009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:29.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.575+0000 7f969b737700 1 -- 172.21.15.114:0/1221188360 shutdown_connections 2023-10-18T13:57:29.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.575+0000 7f969b737700 1 --2- 172.21.15.114:0/1221188360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9694101260 0x7f969410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:29.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.575+0000 7f969b737700 1 --2- 172.21.15.114:0/1221188360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96941057c0 0x7f9694105ba0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:29.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.575+0000 7f969b737700 1 --2- 172.21.15.114:0/1221188360 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96941008a0 0x7f9694100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:29.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.575+0000 7f969b737700 1 -- 172.21.15.114:0/1221188360 >> 172.21.15.114:0/1221188360 conn(0x7f96940779e0 msgr2=0x7f9694077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:29.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.575+0000 7f969b737700 1 -- 172.21.15.114:0/1221188360 shutdown_connections 2023-10-18T13:57:29.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.575+0000 7f969b737700 1 -- 172.21.15.114:0/1221188360 wait complete. 2023-10-18T13:57:29.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.576+0000 7f969b737700 1 Processor -- start 2023-10-18T13:57:29.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.576+0000 7f969b737700 1 -- start start 2023-10-18T13:57:29.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.576+0000 7f969b737700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96941008a0 0x7f969419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:29.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.576+0000 7f969b737700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9694101260 0x7f969419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:29.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.576+0000 7f969b737700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96941057c0 0x7f9694196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:29.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.576+0000 7f969b737700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9694197140 con 0x7f96941008a0 2023-10-18T13:57:29.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.576+0000 7f969b737700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96941972b0 con 0x7f96941057c0 2023-10-18T13:57:29.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.576+0000 7f969b737700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9694197470 con 0x7f9694101260 2023-10-18T13:57:29.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.576+0000 7f96994d3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96941008a0 0x7f969419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:29.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.576+0000 7f96994d3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96941008a0 0x7f969419c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41340/0 (socket says 172.21.15.114:41340) 2023-10-18T13:57:29.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.576+0000 7f96994d3700 1 -- 172.21.15.114:0/994325531 learned_addr learned my addr 172.21.15.114:0/994325531 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:29.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.576+0000 7f9699cd4700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96941057c0 0x7f9694196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:29.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.577+0000 7f9698cd2700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9694101260 0x7f969419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:29.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.577+0000 7f96994d3700 1 -- 172.21.15.114:0/994325531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9694101260 msgr2=0x7f969419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:29.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.577+0000 7f96994d3700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9694101260 0x7f969419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:29.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.577+0000 7f96994d3700 1 -- 172.21.15.114:0/994325531 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96941057c0 msgr2=0x7f9694196ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:29.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.577+0000 7f96994d3700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96941057c0 0x7f9694196ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:29.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.577+0000 7f96994d3700 1 -- 172.21.15.114:0/994325531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900095f0 con 0x7f96941008a0 2023-10-18T13:57:29.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.577+0000 7f96994d3700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96941008a0 0x7f969419c950 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f96900095c0 tx=0x7f969000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:29.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.577+0000 7f968a7fc700 1 -- 172.21.15.114:0/994325531 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969001d070 con 0x7f96941008a0 2023-10-18T13:57:29.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.577+0000 7f968a7fc700 1 -- 172.21.15.114:0/994325531 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9690005050 con 0x7f96941008a0 2023-10-18T13:57:29.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.577+0000 7f969b737700 1 -- 172.21.15.114:0/994325531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96941976f0 con 0x7f96941008a0 2023-10-18T13:57:29.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.577+0000 7f968a7fc700 1 -- 172.21.15.114:0/994325531 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690004b10 con 0x7f96941008a0 2023-10-18T13:57:29.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.577+0000 7f969b737700 1 -- 172.21.15.114:0/994325531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96941a3940 con 0x7f96941008a0 2023-10-18T13:57:29.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.578+0000 7f969b737700 1 -- 172.21.15.114:0/994325531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9694108d80 con 0x7f96941008a0 2023-10-18T13:57:29.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.580+0000 7f968a7fc700 1 -- 172.21.15.114:0/994325531 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f96900051c0 con 0x7f96941008a0 2023-10-18T13:57:29.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.581+0000 7f968a7fc700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f96800a1440 0x7f96800a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:29.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.581+0000 7f9698cd2700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f96800a1440 0x7f96800a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:29.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.581+0000 7f968a7fc700 1 -- 172.21.15.114:0/994325531 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f96900cc2e0 con 0x7f96941008a0 2023-10-18T13:57:29.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.582+0000 7f9698cd2700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f96800a1440 0x7f96800a3900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9684005950 tx=0x7f96840058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:29.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.585+0000 7f968a7fc700 1 -- 172.21.15.114:0/994325531 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f96900975d0 con 0x7f96941008a0 2023-10-18T13:57:29.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.798+0000 7f969b737700 1 -- 172.21.15.114:0/994325531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7f969404e4f0 con 0x7f96941008a0 2023-10-18T13:57:29.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.803+0000 7f968a7fc700 1 -- 172.21.15.114:0/994325531 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v23)=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7f969009abf0 con 0x7f96941008a0 2023-10-18T13:57:29.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.805+0000 7f969b737700 1 -- 172.21.15.114:0/994325531 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f96800a1440 msgr2=0x7f96800a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:29.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.805+0000 7f969b737700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f96800a1440 0x7f96800a3900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9684005950 tx=0x7f96840058e0 comp rx=0 tx=0).stop 2023-10-18T13:57:29.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.805+0000 7f969b737700 1 -- 172.21.15.114:0/994325531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96941008a0 msgr2=0x7f969419c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:29.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.805+0000 7f969b737700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96941008a0 0x7f969419c950 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f96900095c0 tx=0x7f969000f690 comp rx=0 tx=0).stop 2023-10-18T13:57:29.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.805+0000 7f969b737700 1 -- 172.21.15.114:0/994325531 shutdown_connections 2023-10-18T13:57:29.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.805+0000 7f969b737700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f96800a1440 0x7f96800a3900 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:29.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.805+0000 7f969b737700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f96941057c0 0x7f9694196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:29.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.805+0000 7f969b737700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96941008a0 0x7f969419c950 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:29.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.805+0000 7f969b737700 1 --2- 172.21.15.114:0/994325531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9694101260 0x7f969419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:29.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.805+0000 7f969b737700 1 -- 172.21.15.114:0/994325531 >> 172.21.15.114:0/994325531 conn(0x7f96940779e0 msgr2=0x7f96940fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:29.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.805+0000 7f969b737700 1 -- 172.21.15.114:0/994325531 shutdown_connections 2023-10-18T13:57:29.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:27.805+0000 7f969b737700 1 -- 172.21.15.114:0/994325531 wait complete. 2023-10-18T13:57:30.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:29 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/278517400' entity='client.admin' 2023-10-18T13:57:30.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:29 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/214988242' entity='client.admin' 2023-10-18T13:57:30.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:29 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/278517400' entity='client.admin' 2023-10-18T13:57:30.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:29 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/214988242' entity='client.admin' 2023-10-18T13:57:30.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.046+0000 7fc78480e700 1 -- 172.21.15.114:0/1283648793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7801057c0 msgr2=0x7fc780105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:30.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.046+0000 7fc78480e700 1 --2- 172.21.15.114:0/1283648793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7801057c0 0x7fc780105ba0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc770009990 tx=0x7fc770009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.046+0000 7fc78480e700 1 -- 172.21.15.114:0/1283648793 shutdown_connections 2023-10-18T13:57:30.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.046+0000 7fc78480e700 1 --2- 172.21.15.114:0/1283648793 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc780101260 0x7fc78010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.046+0000 7fc78480e700 1 --2- 172.21.15.114:0/1283648793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7801057c0 0x7fc780105ba0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.046+0000 7fc78480e700 1 --2- 172.21.15.114:0/1283648793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7801008a0 0x7fc780100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.046+0000 7fc78480e700 1 -- 172.21.15.114:0/1283648793 >> 172.21.15.114:0/1283648793 conn(0x7fc7800779e0 msgr2=0x7fc780077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:30.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.047+0000 7fc78480e700 1 -- 172.21.15.114:0/1283648793 shutdown_connections 2023-10-18T13:57:30.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.047+0000 7fc78480e700 1 -- 172.21.15.114:0/1283648793 wait complete. 2023-10-18T13:57:30.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.047+0000 7fc78480e700 1 Processor -- start 2023-10-18T13:57:30.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc78480e700 1 -- start start 2023-10-18T13:57:30.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc78480e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7801008a0 0x7fc78019c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:30.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc78480e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc780101260 0x7fc78019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:30.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc78480e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7801057c0 0x7fc780196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:30.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc78480e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7801970d0 con 0x7fc7801057c0 2023-10-18T13:57:30.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc78480e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc780197240 con 0x7fc780101260 2023-10-18T13:57:30.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc78480e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc780197400 con 0x7fc7801008a0 2023-10-18T13:57:30.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc77ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7801057c0 0x7fc780196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:30.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc77ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7801057c0 0x7fc780196a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41408/0 (socket says 172.21.15.114:41408) 2023-10-18T13:57:30.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc77ed9d700 1 -- 172.21.15.114:0/1091720502 learned_addr learned my addr 172.21.15.114:0/1091720502 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:30.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc77dd9b700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc780101260 0x7fc78019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:30.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc77e59c700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7801008a0 0x7fc78019c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:30.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc77ed9d700 1 -- 172.21.15.114:0/1091720502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7801008a0 msgr2=0x7fc78019c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:30.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc77ed9d700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7801008a0 0x7fc78019c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc77ed9d700 1 -- 172.21.15.114:0/1091720502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc780101260 msgr2=0x7fc78019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc77ed9d700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc780101260 0x7fc78019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc77ed9d700 1 -- 172.21.15.114:0/1091720502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7700095f0 con 0x7fc7801057c0 2023-10-18T13:57:30.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc77dd9b700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc780101260 0x7fc78019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T13:57:30.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc77e59c700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7801008a0 0x7fc78019c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T13:57:30.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc77ed9d700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7801057c0 0x7fc780196a70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc77800ab50 tx=0x7fc77800af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.048+0000 7fc76f7fe700 1 -- 172.21.15.114:0/1091720502 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77800f070 con 0x7fc7801057c0 2023-10-18T13:57:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.049+0000 7fc76f7fe700 1 -- 172.21.15.114:0/1091720502 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc778007a80 con 0x7fc7801057c0 2023-10-18T13:57:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.049+0000 7fc78480e700 1 -- 172.21.15.114:0/1091720502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7801976e0 con 0x7fc7801057c0 2023-10-18T13:57:30.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.049+0000 7fc76f7fe700 1 -- 172.21.15.114:0/1091720502 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778005310 con 0x7fc7801057c0 2023-10-18T13:57:30.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.049+0000 7fc78480e700 1 -- 172.21.15.114:0/1091720502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7801a3920 con 0x7fc7801057c0 2023-10-18T13:57:30.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.050+0000 7fc78480e700 1 -- 172.21.15.114:0/1091720502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc780108da0 con 0x7fc7801057c0 2023-10-18T13:57:30.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.051+0000 7fc76f7fe700 1 -- 172.21.15.114:0/1091720502 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fc778004ad0 con 0x7fc7801057c0 2023-10-18T13:57:30.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.051+0000 7fc76f7fe700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc7680a14c0 0x7fc7680a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:30.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.051+0000 7fc77e59c700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc7680a14c0 0x7fc7680a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:30.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.051+0000 7fc76f7fe700 1 -- 172.21.15.114:0/1091720502 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fc7780ca710 con 0x7fc7801057c0 2023-10-18T13:57:30.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.051+0000 7fc77e59c700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc7680a14c0 0x7fc7680a3980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc77000b5c0 tx=0x7fc770005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:30.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.055+0000 7fc76f7fe700 1 -- 172.21.15.114:0/1091720502 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc778095960 con 0x7fc7801057c0 2023-10-18T13:57:30.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:29 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/278517400' entity='client.admin' 2023-10-18T13:57:30.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:29 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/214988242' entity='client.admin' 2023-10-18T13:57:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.251+0000 7fc78480e700 1 -- 172.21.15.114:0/1091720502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7fc780197f30 con 0x7fc7801057c0 2023-10-18T13:57:30.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.255+0000 7fc76f7fe700 1 -- 172.21.15.114:0/1091720502 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v28)=0 v28) v1 ==== 121+0+0 (secure 0 0 0) 0x7fc778098f80 con 0x7fc7801057c0 2023-10-18T13:57:30.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.257+0000 7fc78480e700 1 -- 172.21.15.114:0/1091720502 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc7680a14c0 msgr2=0x7fc7680a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:30.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.257+0000 7fc78480e700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc7680a14c0 0x7fc7680a3980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc77000b5c0 tx=0x7fc770005fb0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.257+0000 7fc78480e700 1 -- 172.21.15.114:0/1091720502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7801057c0 msgr2=0x7fc780196a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:30.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.257+0000 7fc78480e700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7801057c0 0x7fc780196a70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc77800ab50 tx=0x7fc77800af10 comp rx=0 tx=0).stop 2023-10-18T13:57:30.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.257+0000 7fc78480e700 1 -- 172.21.15.114:0/1091720502 shutdown_connections 2023-10-18T13:57:30.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.257+0000 7fc78480e700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc7680a14c0 0x7fc7680a3980 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.257+0000 7fc78480e700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7801057c0 0x7fc780196a70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.257+0000 7fc78480e700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7801008a0 0x7fc78019c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.257+0000 7fc78480e700 1 --2- 172.21.15.114:0/1091720502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc780101260 0x7fc78019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.257+0000 7fc78480e700 1 -- 172.21.15.114:0/1091720502 >> 172.21.15.114:0/1091720502 conn(0x7fc7800779e0 msgr2=0x7fc7800fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:30.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.257+0000 7fc78480e700 1 -- 172.21.15.114:0/1091720502 shutdown_connections 2023-10-18T13:57:30.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.257+0000 7fc78480e700 1 -- 172.21.15.114:0/1091720502 wait complete. 2023-10-18T13:57:30.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.457+0000 7f9c84465700 1 -- 172.21.15.114:0/756765288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c7c104ae0 msgr2=0x7f9c7c10c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.457+0000 7f9c84465700 1 --2- 172.21.15.114:0/756765288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c7c104ae0 0x7f9c7c10c660 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400b0a0 tx=0x7f9c7400b3b0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.457+0000 7f9c84465700 1 -- 172.21.15.114:0/756765288 shutdown_connections 2023-10-18T13:57:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.457+0000 7f9c84465700 1 --2- 172.21.15.114:0/756765288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c7c104ae0 0x7f9c7c10c660 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.457+0000 7f9c84465700 1 --2- 172.21.15.114:0/756765288 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c7c1004c0 0x7f9c7c1008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.457+0000 7f9c84465700 1 --2- 172.21.15.114:0/756765288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c7c100e70 0x7f9c7c1043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.457+0000 7f9c84465700 1 -- 172.21.15.114:0/756765288 >> 172.21.15.114:0/756765288 conn(0x7f9c7c074aa0 msgr2=0x7f9c7c074eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:30.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.458+0000 7f9c84465700 1 -- 172.21.15.114:0/756765288 shutdown_connections 2023-10-18T13:57:30.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.458+0000 7f9c84465700 1 -- 172.21.15.114:0/756765288 wait complete. 2023-10-18T13:57:30.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.458+0000 7f9c84465700 1 Processor -- start 2023-10-18T13:57:30.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.458+0000 7f9c84465700 1 -- start start 2023-10-18T13:57:30.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.458+0000 7f9c84465700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c7c1004c0 0x7f9c7c197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:30.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.458+0000 7f9c84465700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c7c100e70 0x7f9c7c198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:30.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.458+0000 7f9c84465700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c7c104ae0 0x7f9c7c1a2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:30.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.458+0000 7f9c84465700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c198970 con 0x7f9c7c104ae0 2023-10-18T13:57:30.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.458+0000 7f9c84465700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c1a31a0 con 0x7f9c7c100e70 2023-10-18T13:57:30.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.458+0000 7f9c84465700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c1a32e0 con 0x7f9c7c1004c0 2023-10-18T13:57:30.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.458+0000 7f9c82a02700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c7c104ae0 0x7f9c7c1a2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:30.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.458+0000 7f9c82a02700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c7c104ae0 0x7f9c7c1a2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41422/0 (socket says 172.21.15.114:41422) 2023-10-18T13:57:30.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.458+0000 7f9c82a02700 1 -- 172.21.15.114:0/1046319549 learned_addr learned my addr 172.21.15.114:0/1046319549 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:30.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.459+0000 7f9c82201700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c7c1004c0 0x7f9c7c197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:30.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.459+0000 7f9c81a00700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c7c100e70 0x7f9c7c198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:30.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.459+0000 7f9c82a02700 1 -- 172.21.15.114:0/1046319549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c7c1004c0 msgr2=0x7f9c7c197be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:30.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.459+0000 7f9c82a02700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c7c1004c0 0x7f9c7c197be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.459+0000 7f9c82a02700 1 -- 172.21.15.114:0/1046319549 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c7c100e70 msgr2=0x7f9c7c198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:30.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.459+0000 7f9c82a02700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c7c100e70 0x7f9c7c198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.459+0000 7f9c82a02700 1 -- 172.21.15.114:0/1046319549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74009d00 con 0x7f9c7c104ae0 2023-10-18T13:57:30.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.459+0000 7f9c82a02700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c7c104ae0 0x7f9c7c1a2c60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9c74007870 tx=0x7f9c74007950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:30.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.459+0000 7f9c737fe700 1 -- 172.21.15.114:0/1046319549 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400e040 con 0x7f9c7c104ae0 2023-10-18T13:57:30.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.459+0000 7f9c737fe700 1 -- 172.21.15.114:0/1046319549 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c74009440 con 0x7f9c7c104ae0 2023-10-18T13:57:30.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.459+0000 7f9c84465700 1 -- 172.21.15.114:0/1046319549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c1a34e0 con 0x7f9c7c104ae0 2023-10-18T13:57:30.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.459+0000 7f9c737fe700 1 -- 172.21.15.114:0/1046319549 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7401b6b0 con 0x7f9c7c104ae0 2023-10-18T13:57:30.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.459+0000 7f9c84465700 1 -- 172.21.15.114:0/1046319549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c1a39a0 con 0x7f9c7c104ae0 2023-10-18T13:57:30.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.460+0000 7f9c84465700 1 -- 172.21.15.114:0/1046319549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7c107d20 con 0x7f9c7c104ae0 2023-10-18T13:57:30.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.461+0000 7f9c737fe700 1 -- 172.21.15.114:0/1046319549 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f9c7401d480 con 0x7f9c7c104ae0 2023-10-18T13:57:30.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.462+0000 7f9c737fe700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9c680a14c0 0x7f9c680a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:30.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.462+0000 7f9c82201700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9c680a14c0 0x7f9c680a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:30.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.462+0000 7f9c737fe700 1 -- 172.21.15.114:0/1046319549 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f9c740cc6a0 con 0x7f9c7c104ae0 2023-10-18T13:57:30.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.462+0000 7f9c82201700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9c680a14c0 0x7f9c680a3980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9c78005fd0 tx=0x7f9c78005f60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:30.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.466+0000 7f9c737fe700 1 -- 172.21.15.114:0/1046319549 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9c74097990 con 0x7f9c7c104ae0 2023-10-18T13:57:30.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.660+0000 7f9c84465700 1 -- 172.21.15.114:0/1046319549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) v1 -- 0x7f9c7c068a40 con 0x7f9c7c104ae0 2023-10-18T13:57:30.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.664+0000 7f9c737fe700 1 -- 172.21.15.114:0/1046319549 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v29)=0 v29) v1 ==== 116+0+0 (secure 0 0 0) 0x7f9c7409afb0 con 0x7f9c7c104ae0 2023-10-18T13:57:30.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.666+0000 7f9c84465700 1 -- 172.21.15.114:0/1046319549 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9c680a14c0 msgr2=0x7f9c680a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:30.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.666+0000 7f9c84465700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9c680a14c0 0x7f9c680a3980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9c78005fd0 tx=0x7f9c78005f60 comp rx=0 tx=0).stop 2023-10-18T13:57:30.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.666+0000 7f9c84465700 1 -- 172.21.15.114:0/1046319549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c7c104ae0 msgr2=0x7f9c7c1a2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:30.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.666+0000 7f9c84465700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c7c104ae0 0x7f9c7c1a2c60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9c74007870 tx=0x7f9c74007950 comp rx=0 tx=0).stop 2023-10-18T13:57:30.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.666+0000 7f9c84465700 1 -- 172.21.15.114:0/1046319549 shutdown_connections 2023-10-18T13:57:30.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.666+0000 7f9c84465700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9c680a14c0 0x7f9c680a3980 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.666+0000 7f9c84465700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c7c104ae0 0x7f9c7c1a2c60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.666+0000 7f9c84465700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c7c1004c0 0x7f9c7c197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.666+0000 7f9c84465700 1 --2- 172.21.15.114:0/1046319549 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c7c100e70 0x7f9c7c198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:30.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.666+0000 7f9c84465700 1 -- 172.21.15.114:0/1046319549 >> 172.21.15.114:0/1046319549 conn(0x7f9c7c074aa0 msgr2=0x7f9c7c105c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:30.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.666+0000 7f9c84465700 1 -- 172.21.15.114:0/1046319549 shutdown_connections 2023-10-18T13:57:30.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:30.666+0000 7f9c84465700 1 -- 172.21.15.114:0/1046319549 wait complete. 2023-10-18T13:57:30.947 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:30 smithi114 ceph-mon[99494]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:30.947 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:30 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1091720502' entity='client.admin' 2023-10-18T13:57:30.947 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:30 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1046319549' entity='client.admin' 2023-10-18T13:57:31.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:30 smithi158 ceph-mon[103317]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:31.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:30 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1091720502' entity='client.admin' 2023-10-18T13:57:31.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:30 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1046319549' entity='client.admin' 2023-10-18T13:57:31.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:30 smithi172 ceph-mon[103574]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:31.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:30 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1091720502' entity='client.admin' 2023-10-18T13:57:31.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:30 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1046319549' entity='client.admin' 2023-10-18T13:57:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.092+0000 7f6f398a4700 1 -- 172.21.15.114:0/3656396442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341045b0 msgr2=0x7f6f34104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.092+0000 7f6f398a4700 1 --2- 172.21.15.114:0/3656396442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341045b0 0x7f6f34104990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009990 tx=0x7f6f24009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.092+0000 7f6f398a4700 1 -- 172.21.15.114:0/3656396442 shutdown_connections 2023-10-18T13:57:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.092+0000 7f6f398a4700 1 --2- 172.21.15.114:0/3656396442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f341000a0 0x7f6f3410c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.092+0000 7f6f398a4700 1 --2- 172.21.15.114:0/3656396442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341045b0 0x7f6f34104990 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.092+0000 7f6f398a4700 1 --2- 172.21.15.114:0/3656396442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f340ff6e0 0x7f6f340ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.092+0000 7f6f398a4700 1 -- 172.21.15.114:0/3656396442 >> 172.21.15.114:0/3656396442 conn(0x7f6f340766c0 msgr2=0x7f6f34076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.092+0000 7f6f398a4700 1 -- 172.21.15.114:0/3656396442 shutdown_connections 2023-10-18T13:57:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.092+0000 7f6f398a4700 1 -- 172.21.15.114:0/3656396442 wait complete. 2023-10-18T13:57:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.093+0000 7f6f398a4700 1 Processor -- start 2023-10-18T13:57:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.093+0000 7f6f398a4700 1 -- start start 2023-10-18T13:57:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f398a4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f340ff6e0 0x7f6f34197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f398a4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341000a0 0x7f6f34198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f398a4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f341045b0 0x7f6f341a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f398a4700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f34198900 con 0x7f6f341000a0 2023-10-18T13:57:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f398a4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f341a30c0 con 0x7f6f341045b0 2023-10-18T13:57:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f398a4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f341a3200 con 0x7f6f340ff6e0 2023-10-18T13:57:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f327fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341000a0 0x7f6f34198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f327fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341000a0 0x7f6f34198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41434/0 (socket says 172.21.15.114:41434) 2023-10-18T13:57:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f327fc700 1 -- 172.21.15.114:0/2879659327 learned_addr learned my addr 172.21.15.114:0/2879659327 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f32ffd700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f340ff6e0 0x7f6f34197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f337fe700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f341045b0 0x7f6f341a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f327fc700 1 -- 172.21.15.114:0/2879659327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f340ff6e0 msgr2=0x7f6f34197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f327fc700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f340ff6e0 0x7f6f34197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f327fc700 1 -- 172.21.15.114:0/2879659327 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f341045b0 msgr2=0x7f6f341a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f327fc700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f341045b0 0x7f6f341a2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f327fc700 1 -- 172.21.15.114:0/2879659327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f240095f0 con 0x7f6f341000a0 2023-10-18T13:57:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f337fe700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f341045b0 0x7f6f341a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T13:57:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f32ffd700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f340ff6e0 0x7f6f34197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T13:57:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f327fc700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341000a0 0x7f6f34198040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800c920 tx=0x7f6f2800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f388a2700 1 -- 172.21.15.114:0/2879659327 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28007b00 con 0x7f6f341000a0 2023-10-18T13:57:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f388a2700 1 -- 172.21.15.114:0/2879659327 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f28004cf0 con 0x7f6f341000a0 2023-10-18T13:57:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f398a4700 1 -- 172.21.15.114:0/2879659327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f341a3480 con 0x7f6f341000a0 2023-10-18T13:57:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f388a2700 1 -- 172.21.15.114:0/2879659327 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28005610 con 0x7f6f341000a0 2023-10-18T13:57:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.094+0000 7f6f398a4700 1 -- 172.21.15.114:0/2879659327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f341a39d0 con 0x7f6f341000a0 2023-10-18T13:57:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.095+0000 7f6f398a4700 1 -- 172.21.15.114:0/2879659327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f34107c20 con 0x7f6f341000a0 2023-10-18T13:57:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.096+0000 7f6f388a2700 1 -- 172.21.15.114:0/2879659327 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f6f28004750 con 0x7f6f341000a0 2023-10-18T13:57:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.097+0000 7f6f388a2700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6f1c0a14c0 0x7f6f1c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.097+0000 7f6f32ffd700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6f1c0a14c0 0x7f6f1c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.097+0000 7f6f388a2700 1 -- 172.21.15.114:0/2879659327 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f6f280cb070 con 0x7f6f341000a0 2023-10-18T13:57:31.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.097+0000 7f6f32ffd700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6f1c0a14c0 0x7f6f1c0a3980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6f24006010 tx=0x7f6f2401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:31.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.100+0000 7f6f388a2700 1 -- 172.21.15.114:0/2879659327 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6f28096350 con 0x7f6f341000a0 2023-10-18T13:57:31.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.318+0000 7f6f398a4700 1 -- 172.21.15.114:0/2879659327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f6f34069020 con 0x7f6f341000a0 2023-10-18T13:57:31.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.322+0000 7f6f388a2700 1 -- 172.21.15.114:0/2879659327 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v30)=0 v30) v1 ==== 120+0+0 (secure 0 0 0) 0x7f6f2801d020 con 0x7f6f341000a0 2023-10-18T13:57:31.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.324+0000 7f6f398a4700 1 -- 172.21.15.114:0/2879659327 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6f1c0a14c0 msgr2=0x7f6f1c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.324+0000 7f6f398a4700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6f1c0a14c0 0x7f6f1c0a3980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6f24006010 tx=0x7f6f2401a040 comp rx=0 tx=0).stop 2023-10-18T13:57:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.324+0000 7f6f398a4700 1 -- 172.21.15.114:0/2879659327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341000a0 msgr2=0x7f6f34198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.324+0000 7f6f398a4700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341000a0 0x7f6f34198040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800c920 tx=0x7f6f2800cce0 comp rx=0 tx=0).stop 2023-10-18T13:57:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.324+0000 7f6f398a4700 1 -- 172.21.15.114:0/2879659327 shutdown_connections 2023-10-18T13:57:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.324+0000 7f6f398a4700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6f1c0a14c0 0x7f6f1c0a3980 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.324+0000 7f6f398a4700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f341045b0 0x7f6f341a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.324+0000 7f6f398a4700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f340ff6e0 0x7f6f34197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.324+0000 7f6f398a4700 1 --2- 172.21.15.114:0/2879659327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341000a0 0x7f6f34198040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.324+0000 7f6f398a4700 1 -- 172.21.15.114:0/2879659327 >> 172.21.15.114:0/2879659327 conn(0x7f6f340766c0 msgr2=0x7f6f340fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.324+0000 7f6f398a4700 1 -- 172.21.15.114:0/2879659327 shutdown_connections 2023-10-18T13:57:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.324+0000 7f6f398a4700 1 -- 172.21.15.114:0/2879659327 wait complete. 2023-10-18T13:57:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.832+0000 7fa2201c1700 1 -- 172.21.15.114:0/3095891978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2180ffe50 msgr2=0x7fa2181002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.832+0000 7fa2201c1700 1 --2- 172.21.15.114:0/3095891978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2180ffe50 0x7fa2181002d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa214009990 tx=0x7fa214009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.832+0000 7fa2201c1700 1 -- 172.21.15.114:0/3095891978 shutdown_connections 2023-10-18T13:57:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.832+0000 7fa2201c1700 1 --2- 172.21.15.114:0/3095891978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa218100810 0x7fa21810c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.832+0000 7fa2201c1700 1 --2- 172.21.15.114:0/3095891978 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2181056c0 0x7fa218105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.832+0000 7fa2201c1700 1 --2- 172.21.15.114:0/3095891978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2180ffe50 0x7fa2181002d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.832+0000 7fa2201c1700 1 -- 172.21.15.114:0/3095891978 >> 172.21.15.114:0/3095891978 conn(0x7fa218075cf0 msgr2=0x7fa2180fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.833+0000 7fa2201c1700 1 -- 172.21.15.114:0/3095891978 shutdown_connections 2023-10-18T13:57:32.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.833+0000 7fa2201c1700 1 -- 172.21.15.114:0/3095891978 wait complete. 2023-10-18T13:57:32.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.833+0000 7fa2201c1700 1 Processor -- start 2023-10-18T13:57:32.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.833+0000 7fa2201c1700 1 -- start start 2023-10-18T13:57:32.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.833+0000 7fa2201c1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2180ffe50 0x7fa218197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:32.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.833+0000 7fa2201c1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa218100810 0x7fa218197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:32.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.833+0000 7fa2201c1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2181056c0 0x7fa2181a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.833+0000 7fa2201c1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa218198830 con 0x7fa2181056c0 2023-10-18T13:57:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.833+0000 7fa2201c1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2181a2ff0 con 0x7fa218100810 2023-10-18T13:57:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.833+0000 7fa2201c1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2181a3130 con 0x7fa2180ffe50 2023-10-18T13:57:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.833+0000 7fa21e75e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2181056c0 0x7fa2181a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:32.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa21e75e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2181056c0 0x7fa2181a2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41450/0 (socket says 172.21.15.114:41450) 2023-10-18T13:57:32.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa21e75e700 1 -- 172.21.15.114:0/442489387 learned_addr learned my addr 172.21.15.114:0/442489387 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:32.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa21df5d700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2180ffe50 0x7fa218197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:32.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa21d75c700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa218100810 0x7fa218197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:32.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa21e75e700 1 -- 172.21.15.114:0/442489387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2180ffe50 msgr2=0x7fa218197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:32.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa21e75e700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2180ffe50 0x7fa218197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa21e75e700 1 -- 172.21.15.114:0/442489387 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa218100810 msgr2=0x7fa218197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:32.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa21e75e700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa218100810 0x7fa218197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa21e75e700 1 -- 172.21.15.114:0/442489387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2140095f0 con 0x7fa2181056c0 2023-10-18T13:57:32.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa21e75e700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2181056c0 0x7fa2181a2ab0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa210007ee0 tx=0x7fa21000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa20effd700 1 -- 172.21.15.114:0/442489387 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210017070 con 0x7fa2181056c0 2023-10-18T13:57:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa2201c1700 1 -- 172.21.15.114:0/442489387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2181a33b0 con 0x7fa2181056c0 2023-10-18T13:57:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa20effd700 1 -- 172.21.15.114:0/442489387 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa21000f040 con 0x7fa2181056c0 2023-10-18T13:57:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa20effd700 1 -- 172.21.15.114:0/442489387 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210005580 con 0x7fa2181056c0 2023-10-18T13:57:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.834+0000 7fa2201c1700 1 -- 172.21.15.114:0/442489387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2181a3880 con 0x7fa2181056c0 2023-10-18T13:57:32.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.835+0000 7fa2201c1700 1 -- 172.21.15.114:0/442489387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa218107c50 con 0x7fa2181056c0 2023-10-18T13:57:32.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.837+0000 7fa20effd700 1 -- 172.21.15.114:0/442489387 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fa21000db20 con 0x7fa2181056c0 2023-10-18T13:57:32.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.837+0000 7fa20effd700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa2040a1440 0x7fa2040a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:32.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.837+0000 7fa21df5d700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa2040a1440 0x7fa2040a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:32.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.838+0000 7fa20effd700 1 -- 172.21.15.114:0/442489387 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa2100cae90 con 0x7fa2181056c0 2023-10-18T13:57:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.838+0000 7fa21df5d700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa2040a1440 0x7fa2040a3900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa208005950 tx=0x7fa20800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:31.841+0000 7fa20effd700 1 -- 172.21.15.114:0/442489387 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa2100960f0 con 0x7fa2181056c0 2023-10-18T13:57:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.052+0000 7fa2201c1700 1 -- 172.21.15.114:0/442489387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7fa218100e60 con 0x7fa2181056c0 2023-10-18T13:57:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.056+0000 7fa20effd700 1 -- 172.21.15.114:0/442489387 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v31)=0 v31) v1 ==== 127+0+0 (secure 0 0 0) 0x7fa210099710 con 0x7fa2181056c0 2023-10-18T13:57:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.059+0000 7fa2201c1700 1 -- 172.21.15.114:0/442489387 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa2040a1440 msgr2=0x7fa2040a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.059+0000 7fa2201c1700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa2040a1440 0x7fa2040a3900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa208005950 tx=0x7fa20800b410 comp rx=0 tx=0).stop 2023-10-18T13:57:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.059+0000 7fa2201c1700 1 -- 172.21.15.114:0/442489387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2181056c0 msgr2=0x7fa2181a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.059+0000 7fa2201c1700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2181056c0 0x7fa2181a2ab0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa210007ee0 tx=0x7fa21000d3b0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.059+0000 7fa2201c1700 1 -- 172.21.15.114:0/442489387 shutdown_connections 2023-10-18T13:57:32.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.059+0000 7fa2201c1700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa2040a1440 0x7fa2040a3900 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa208005950 tx=0x7fa20800b410 comp rx=0 tx=0).stop 2023-10-18T13:57:32.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.059+0000 7fa2201c1700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2181056c0 0x7fa2181a2ab0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.059+0000 7fa2201c1700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2180ffe50 0x7fa218197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.059+0000 7fa2201c1700 1 --2- 172.21.15.114:0/442489387 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa218100810 0x7fa218197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.059+0000 7fa2201c1700 1 -- 172.21.15.114:0/442489387 >> 172.21.15.114:0/442489387 conn(0x7fa218075cf0 msgr2=0x7fa218102590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:32.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.059+0000 7fa2201c1700 1 -- 172.21.15.114:0/442489387 shutdown_connections 2023-10-18T13:57:32.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.059+0000 7fa2201c1700 1 -- 172.21.15.114:0/442489387 wait complete. 2023-10-18T13:57:32.431 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:32 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:32.431 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:32 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:32.431 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:32 smithi172 ceph-mon[103574]: Reconfiguring mon.c (monmap changed)... 2023-10-18T13:57:32.432 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:32 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:57:32.432 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:32 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T13:57:32.432 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:32 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:32.432 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:32 smithi172 ceph-mon[103574]: Reconfiguring daemon mon.c on smithi172 2023-10-18T13:57:32.432 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:32 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2879659327' entity='client.admin' 2023-10-18T13:57:32.433 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:32 smithi172 ceph-mon[103574]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:32.433 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:32 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/442489387' entity='client.admin' 2023-10-18T13:57:32.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:32 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:32.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:32 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:32.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:32 smithi158 ceph-mon[103317]: Reconfiguring mon.c (monmap changed)... 2023-10-18T13:57:32.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:32 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:57:32.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:32 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T13:57:32.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:32 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:32.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:32 smithi158 ceph-mon[103317]: Reconfiguring daemon mon.c on smithi172 2023-10-18T13:57:32.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:32 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2879659327' entity='client.admin' 2023-10-18T13:57:32.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:32 smithi158 ceph-mon[103317]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:32.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:32 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/442489387' entity='client.admin' 2023-10-18T13:57:32.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:32 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:32.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:32 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:32.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:32 smithi114 ceph-mon[99494]: Reconfiguring mon.c (monmap changed)... 2023-10-18T13:57:32.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:32 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-18T13:57:32.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:32 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-18T13:57:32.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:32 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:32.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:32 smithi114 ceph-mon[99494]: Reconfiguring daemon mon.c on smithi172 2023-10-18T13:57:32.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:32 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2879659327' entity='client.admin' 2023-10-18T13:57:32.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:32 smithi114 ceph-mon[99494]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:32.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:32 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/442489387' entity='client.admin' 2023-10-18T13:57:32.811 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi114') 2023-10-18T13:57:32.812 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi114') 2023-10-18T13:57:32.812 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi114') 2023-10-18T13:57:32.812 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi114') 2023-10-18T13:57:32.813 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi114') 2023-10-18T13:57:32.813 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi114') 2023-10-18T13:57:32.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.845+0000 7effdccf9700 1 -- 172.21.15.114:0/4183218275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effd8068190 msgr2=0x7effd80685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:32.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.845+0000 7effdccf9700 1 --2- 172.21.15.114:0/4183218275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effd8068190 0x7effd80685f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7effc8009990 tx=0x7effc8009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.845+0000 7effdccf9700 1 -- 172.21.15.114:0/4183218275 shutdown_connections 2023-10-18T13:57:32.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.845+0000 7effdccf9700 1 --2- 172.21.15.114:0/4183218275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effd8068b30 0x7effd810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.845+0000 7effdccf9700 1 --2- 172.21.15.114:0/4183218275 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7effd81067a0 0x7effd8106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.845+0000 7effdccf9700 1 --2- 172.21.15.114:0/4183218275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effd8068190 0x7effd80685f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.845+0000 7effdccf9700 1 -- 172.21.15.114:0/4183218275 >> 172.21.15.114:0/4183218275 conn(0x7effd8075790 msgr2=0x7effd8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:32.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.845+0000 7effdccf9700 1 -- 172.21.15.114:0/4183218275 shutdown_connections 2023-10-18T13:57:32.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.845+0000 7effdccf9700 1 -- 172.21.15.114:0/4183218275 wait complete. 2023-10-18T13:57:32.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effdccf9700 1 Processor -- start 2023-10-18T13:57:32.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effdccf9700 1 -- start start 2023-10-18T13:57:32.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effdccf9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effd8068190 0x7effd819c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:32.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effdccf9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7effd8068b30 0x7effd819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:32.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effdccf9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effd81067a0 0x7effd81969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:32.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effdccf9700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd8197040 con 0x7effd8068190 2023-10-18T13:57:32.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effdccf9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd81971b0 con 0x7effd8068b30 2023-10-18T13:57:32.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effdccf9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd8197370 con 0x7effd81067a0 2023-10-18T13:57:32.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effd659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effd8068190 0x7effd819c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:32.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effd659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effd8068190 0x7effd819c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41460/0 (socket says 172.21.15.114:41460) 2023-10-18T13:57:32.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effd659c700 1 -- 172.21.15.114:0/438706980 learned_addr learned my addr 172.21.15.114:0/438706980 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:32.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effd6d9d700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effd81067a0 0x7effd81969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:32.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effd5d9b700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7effd8068b30 0x7effd819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:32.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effd659c700 1 -- 172.21.15.114:0/438706980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effd81067a0 msgr2=0x7effd81969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:32.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effd659c700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effd81067a0 0x7effd81969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effd659c700 1 -- 172.21.15.114:0/438706980 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7effd8068b30 msgr2=0x7effd819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effd659c700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7effd8068b30 0x7effd819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effd659c700 1 -- 172.21.15.114:0/438706980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80095f0 con 0x7effd8068190 2023-10-18T13:57:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effd6d9d700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effd81067a0 0x7effd81969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T13:57:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.846+0000 7effd5d9b700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7effd8068b30 0x7effd819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T13:57:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.847+0000 7effd659c700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effd8068190 0x7effd819c850 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7effc000c9b0 tx=0x7effc000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.847+0000 7effcf7fe700 1 -- 172.21.15.114:0/438706980 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0007b00 con 0x7effd8068190 2023-10-18T13:57:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.847+0000 7effcf7fe700 1 -- 172.21.15.114:0/438706980 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7effc0007c60 con 0x7effd8068190 2023-10-18T13:57:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.847+0000 7effcf7fe700 1 -- 172.21.15.114:0/438706980 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0018660 con 0x7effd8068190 2023-10-18T13:57:32.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.847+0000 7effdccf9700 1 -- 172.21.15.114:0/438706980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd8197650 con 0x7effd8068190 2023-10-18T13:57:32.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.847+0000 7effdccf9700 1 -- 172.21.15.114:0/438706980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd81a3840 con 0x7effd8068190 2023-10-18T13:57:32.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.848+0000 7effdccf9700 1 -- 172.21.15.114:0/438706980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd8108d50 con 0x7effd8068190 2023-10-18T13:57:32.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.849+0000 7effcf7fe700 1 -- 172.21.15.114:0/438706980 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7effc0018880 con 0x7effd8068190 2023-10-18T13:57:32.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.849+0000 7effcf7fe700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7effc40a1440 0x7effc40a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:32.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.849+0000 7effd5d9b700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7effc40a1440 0x7effc40a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:32.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.849+0000 7effcf7fe700 1 -- 172.21.15.114:0/438706980 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7effc00cb130 con 0x7effd8068190 2023-10-18T13:57:32.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.850+0000 7effd5d9b700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7effc40a1440 0x7effc40a3900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7effc800b5c0 tx=0x7effc8005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:32.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:32.854+0000 7effcf7fe700 1 -- 172.21.15.114:0/438706980 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7effc0096390 con 0x7effd8068190 2023-10-18T13:57:33.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.048+0000 7effdccf9700 1 -- 172.21.15.114:0/438706980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7effd8101ee0 con 0x7effd8068190 2023-10-18T13:57:33.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.052+0000 7effcf7fe700 1 -- 172.21.15.114:0/438706980 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v32)=0 v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7effc00999b0 con 0x7effd8068190 2023-10-18T13:57:33.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.054+0000 7effdccf9700 1 -- 172.21.15.114:0/438706980 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7effc40a1440 msgr2=0x7effc40a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:33.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.054+0000 7effdccf9700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7effc40a1440 0x7effc40a3900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7effc800b5c0 tx=0x7effc8005fb0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.054+0000 7effdccf9700 1 -- 172.21.15.114:0/438706980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effd8068190 msgr2=0x7effd819c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:33.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.054+0000 7effdccf9700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effd8068190 0x7effd819c850 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7effc000c9b0 tx=0x7effc000cd70 comp rx=0 tx=0).stop 2023-10-18T13:57:33.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.054+0000 7effdccf9700 1 -- 172.21.15.114:0/438706980 shutdown_connections 2023-10-18T13:57:33.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.054+0000 7effdccf9700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7effc40a1440 0x7effc40a3900 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.054+0000 7effdccf9700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effd81067a0 0x7effd81969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.054+0000 7effdccf9700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effd8068190 0x7effd819c850 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.054+0000 7effdccf9700 1 --2- 172.21.15.114:0/438706980 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7effd8068b30 0x7effd819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.054+0000 7effdccf9700 1 -- 172.21.15.114:0/438706980 >> 172.21.15.114:0/438706980 conn(0x7effd8075790 msgr2=0x7effd80fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:33.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.054+0000 7effdccf9700 1 -- 172.21.15.114:0/438706980 shutdown_connections 2023-10-18T13:57:33.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.054+0000 7effdccf9700 1 -- 172.21.15.114:0/438706980 wait complete. 2023-10-18T13:57:33.169 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi114') 2023-10-18T13:57:33.170 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi114') 2023-10-18T13:57:33.170 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi114') 2023-10-18T13:57:33.171 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi114') 2023-10-18T13:57:33.316 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi114') 2023-10-18T13:57:33.316 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi114') 2023-10-18T13:57:33.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.679+0000 7fb4383d2700 1 -- 172.21.15.114:0/4009124736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb430100110 msgr2=0x7fb43010c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:33.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.679+0000 7fb4383d2700 1 --2- 172.21.15.114:0/4009124736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb430100110 0x7fb43010c580 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb42800b0a0 tx=0x7fb42800b3b0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.679+0000 7fb4383d2700 1 -- 172.21.15.114:0/4009124736 shutdown_connections 2023-10-18T13:57:33.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.679+0000 7fb4383d2700 1 --2- 172.21.15.114:0/4009124736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb430100110 0x7fb43010c580 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.679+0000 7fb4383d2700 1 --2- 172.21.15.114:0/4009124736 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4301056b0 0x7fb430105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.679+0000 7fb4383d2700 1 --2- 172.21.15.114:0/4009124736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4300ff750 0x7fb4300ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.679+0000 7fb4383d2700 1 -- 172.21.15.114:0/4009124736 >> 172.21.15.114:0/4009124736 conn(0x7fb430075790 msgr2=0x7fb430075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:33.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.679+0000 7fb4383d2700 1 -- 172.21.15.114:0/4009124736 shutdown_connections 2023-10-18T13:57:33.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.680+0000 7fb4383d2700 1 -- 172.21.15.114:0/4009124736 wait complete. 2023-10-18T13:57:33.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.680+0000 7fb4383d2700 1 Processor -- start 2023-10-18T13:57:33.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.680+0000 7fb4383d2700 1 -- start start 2023-10-18T13:57:33.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.680+0000 7fb4383d2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4300ff750 0x7fb430101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:33.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.680+0000 7fb4383d2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb430100110 0x7fb4301017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:33.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.680+0000 7fb4383d2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4301056b0 0x7fb430101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:33.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.680+0000 7fb4383d2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4301a5150 con 0x7fb4301056b0 2023-10-18T13:57:33.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.680+0000 7fb4383d2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4301a52c0 con 0x7fb4300ff750 2023-10-18T13:57:33.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.680+0000 7fb4383d2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4301a5480 con 0x7fb430100110 2023-10-18T13:57:33.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.680+0000 7fb43696f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4301056b0 0x7fb430101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:33.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.680+0000 7fb43696f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4301056b0 0x7fb430101d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41474/0 (socket says 172.21.15.114:41474) 2023-10-18T13:57:33.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.680+0000 7fb43696f700 1 -- 172.21.15.114:0/3288393818 learned_addr learned my addr 172.21.15.114:0/3288393818 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:33.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.681+0000 7fb43596d700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb430100110 0x7fb4301017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:33.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.681+0000 7fb43696f700 1 -- 172.21.15.114:0/3288393818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb430100110 msgr2=0x7fb4301017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:33.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.681+0000 7fb43696f700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb430100110 0x7fb4301017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.681+0000 7fb43696f700 1 -- 172.21.15.114:0/3288393818 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4300ff750 msgr2=0x7fb430101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:33.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.681+0000 7fb43616e700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4300ff750 0x7fb430101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:33.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.681+0000 7fb43696f700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4300ff750 0x7fb430101280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.681+0000 7fb43696f700 1 -- 172.21.15.114:0/3288393818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb428009d00 con 0x7fb4301056b0 2023-10-18T13:57:33.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.681+0000 7fb43696f700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4301056b0 0x7fb430101d00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb4280077f0 tx=0x7fb4280078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:33.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.681+0000 7fb4237fe700 1 -- 172.21.15.114:0/3288393818 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42800e040 con 0x7fb4301056b0 2023-10-18T13:57:33.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.681+0000 7fb4237fe700 1 -- 172.21.15.114:0/3288393818 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb428004c60 con 0x7fb4301056b0 2023-10-18T13:57:33.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.681+0000 7fb4383d2700 1 -- 172.21.15.114:0/3288393818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4301a5700 con 0x7fb4301056b0 2023-10-18T13:57:33.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.681+0000 7fb4237fe700 1 -- 172.21.15.114:0/3288393818 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428005370 con 0x7fb4301056b0 2023-10-18T13:57:33.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.681+0000 7fb4383d2700 1 -- 172.21.15.114:0/3288393818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4301a5b70 con 0x7fb4301056b0 2023-10-18T13:57:33.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.682+0000 7fb4383d2700 1 -- 172.21.15.114:0/3288393818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb430100df0 con 0x7fb4301056b0 2023-10-18T13:57:33.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.683+0000 7fb4237fe700 1 -- 172.21.15.114:0/3288393818 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fb42801ba10 con 0x7fb4301056b0 2023-10-18T13:57:33.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.683+0000 7fb4237fe700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb41c0a14c0 0x7fb41c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:33.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.684+0000 7fb43616e700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb41c0a14c0 0x7fb41c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:33.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.684+0000 7fb4237fe700 1 -- 172.21.15.114:0/3288393818 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb4280ccd60 con 0x7fb4301056b0 2023-10-18T13:57:33.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.684+0000 7fb43616e700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb41c0a14c0 0x7fb41c0a3980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb424006fd0 tx=0x7fb424008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:33.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.687+0000 7fb4237fe700 1 -- 172.21.15.114:0/3288393818 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb428098050 con 0x7fb4301056b0 2023-10-18T13:57:33.712 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:33 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:33.712 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:33 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:33.712 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:33 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:33.713 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:33 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:33.713 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:33 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:33.713 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:33 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:33.713 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:33 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/438706980' entity='client.admin' 2023-10-18T13:57:33.713 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:33 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:33.713 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:33 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:33.714 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:33 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:33.714 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:33 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:33.715 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi114') 2023-10-18T13:57:33.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:33 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:33.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:33 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:33.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:33 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:33.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:33 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:33.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:33 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:33.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:33 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:33.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:33 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/438706980' entity='client.admin' 2023-10-18T13:57:33.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:33 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:33.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:33 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:33.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:33 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:33.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:33 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:33.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:33 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:33.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:33 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:33.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:33 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:33.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:33 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:33.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:33 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:33.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:33 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:33.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:33 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/438706980' entity='client.admin' 2023-10-18T13:57:33.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:33 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:33.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:33 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:33.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:33 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:33.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:33 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:33.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.877+0000 7fb4383d2700 1 -- 172.21.15.114:0/3288393818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fb43004e4c0 con 0x7fb4301056b0 2023-10-18T13:57:33.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.881+0000 7fb4237fe700 1 -- 172.21.15.114:0/3288393818 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v33)=0 v33) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb42809b670 con 0x7fb4301056b0 2023-10-18T13:57:33.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.883+0000 7fb4383d2700 1 -- 172.21.15.114:0/3288393818 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb41c0a14c0 msgr2=0x7fb41c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:33.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.883+0000 7fb4383d2700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb41c0a14c0 0x7fb41c0a3980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb424006fd0 tx=0x7fb424008040 comp rx=0 tx=0).stop 2023-10-18T13:57:33.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.883+0000 7fb4383d2700 1 -- 172.21.15.114:0/3288393818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4301056b0 msgr2=0x7fb430101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:33.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.883+0000 7fb4383d2700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4301056b0 0x7fb430101d00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb4280077f0 tx=0x7fb4280078d0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.883+0000 7fb4383d2700 1 -- 172.21.15.114:0/3288393818 shutdown_connections 2023-10-18T13:57:33.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.883+0000 7fb4383d2700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb41c0a14c0 0x7fb41c0a3980 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.883+0000 7fb4383d2700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4301056b0 0x7fb430101d00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.883+0000 7fb4383d2700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4300ff750 0x7fb430101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.883+0000 7fb4383d2700 1 --2- 172.21.15.114:0/3288393818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb430100110 0x7fb4301017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:33.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.883+0000 7fb4383d2700 1 -- 172.21.15.114:0/3288393818 >> 172.21.15.114:0/3288393818 conn(0x7fb430075790 msgr2=0x7fb4301034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:33.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.884+0000 7fb4383d2700 1 -- 172.21.15.114:0/3288393818 shutdown_connections 2023-10-18T13:57:33.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:33.884+0000 7fb4383d2700 1 -- 172.21.15.114:0/3288393818 wait complete. 2023-10-18T13:57:34.266 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi114') 2023-10-18T13:57:34.266 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd734b050-6dbd-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi114') 2023-10-18T13:57:34.266 INFO:tasks.cephadm:Deploying OSDs... 2023-10-18T13:57:34.267 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T13:57:34.267 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2023-10-18T13:57:34.284 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-18T13:57:34.285 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2023-10-18T13:57:34.342 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-18T13:57:34.342 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T13:57:34.343 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 394248 Links: 1 2023-10-18T13:57:34.343 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T13:57:34.343 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T13:57:34.343 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-10-18 13:56:15.225227910 +0000 2023-10-18T13:57:34.343 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-10-18 13:50:59.875769722 +0000 2023-10-18T13:57:34.344 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-10-18 13:50:59.875769722 +0000 2023-10-18T13:57:34.344 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2023-10-18T13:57:34.344 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-18T13:57:34.411 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-10-18T13:57:34.411 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-10-18T13:57:34.411 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000272302 s, 1.9 MB/s 2023-10-18T13:57:34.412 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-18T13:57:34.471 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2023-10-18T13:57:34.532 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-18T13:57:34.533 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T13:57:34.533 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 394280 Links: 1 2023-10-18T13:57:34.533 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T13:57:34.534 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T13:57:34.534 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-10-18 13:56:15.270226990 +0000 2023-10-18T13:57:34.534 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-10-18 13:51:00.378759325 +0000 2023-10-18T13:57:34.535 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-10-18 13:51:00.378759325 +0000 2023-10-18T13:57:34.535 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2023-10-18T13:57:34.536 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-18T13:57:34.601 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-10-18T13:57:34.602 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-10-18T13:57:34.602 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000225881 s, 2.3 MB/s 2023-10-18T13:57:34.604 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-18T13:57:34.663 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2023-10-18T13:57:34.723 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-18T13:57:34.724 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T13:57:34.724 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 387804 Links: 1 2023-10-18T13:57:34.724 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T13:57:34.725 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T13:57:34.725 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-10-18 13:56:15.309226193 +0000 2023-10-18T13:57:34.725 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-10-18 13:51:00.883748887 +0000 2023-10-18T13:57:34.726 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-10-18 13:51:00.883748887 +0000 2023-10-18T13:57:34.726 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2023-10-18T13:57:34.726 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-18T13:57:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-10-18T13:57:34.792 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-10-18T13:57:34.792 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000212867 s, 2.4 MB/s 2023-10-18T13:57:34.793 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-18T13:57:34.851 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2023-10-18T13:57:34.909 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-18T13:57:34.910 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T13:57:34.910 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 394565 Links: 1 2023-10-18T13:57:34.910 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T13:57:34.910 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T13:57:34.911 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-10-18 13:56:15.350225355 +0000 2023-10-18T13:57:34.911 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-10-18 13:51:01.380738613 +0000 2023-10-18T13:57:34.911 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-10-18 13:51:01.380738613 +0000 2023-10-18T13:57:34.911 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2023-10-18T13:57:34.912 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-18T13:57:34.974 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-10-18T13:57:34.974 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-10-18T13:57:34.975 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000225942 s, 2.3 MB/s 2023-10-18T13:57:34.975 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-18T13:57:35.033 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-18T13:57:35.033 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/scratch_devs of=/dev/stdout 2023-10-18T13:57:35.055 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-18T13:57:35.055 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_1 2023-10-18T13:57:35.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:34 smithi114 ceph-mon[99494]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:35.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:34 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3288393818' entity='client.admin' 2023-10-18T13:57:35.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:35.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:35.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:35.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:35.116 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-18T13:57:35.116 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T13:57:35.117 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 392290 Links: 1 2023-10-18T13:57:35.117 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T13:57:35.117 INFO:teuthology.orchestra.run.smithi158.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T13:57:35.117 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-18 13:57:16.821642691 +0000 2023-10-18T13:57:35.117 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-18 13:51:10.067005454 +0000 2023-10-18T13:57:35.118 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-18 13:51:10.067005454 +0000 2023-10-18T13:57:35.118 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2023-10-18T13:57:35.118 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-18T13:57:35.186 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:34 smithi158 ceph-mon[103317]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:35.186 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:34 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3288393818' entity='client.admin' 2023-10-18T13:57:35.187 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:35.187 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:35.187 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:35.187 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:35.190 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-18T13:57:35.190 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-18T13:57:35.190 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000151506 s, 3.4 MB/s 2023-10-18T13:57:35.191 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-18T13:57:35.251 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_2 2023-10-18T13:57:35.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:34 smithi172 ceph-mon[103574]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:35.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:34 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3288393818' entity='client.admin' 2023-10-18T13:57:35.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:35.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:35.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:35.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:35.311 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-18T13:57:35.312 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T13:57:35.312 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 394622 Links: 1 2023-10-18T13:57:35.312 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T13:57:35.312 INFO:teuthology.orchestra.run.smithi158.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T13:57:35.313 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-18 13:57:16.822642680 +0000 2023-10-18T13:57:35.313 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-18 13:51:10.583999862 +0000 2023-10-18T13:57:35.313 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-18 13:51:10.583999862 +0000 2023-10-18T13:57:35.313 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2023-10-18T13:57:35.313 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-18T13:57:35.379 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-18T13:57:35.379 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-18T13:57:35.380 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000132572 s, 3.9 MB/s 2023-10-18T13:57:35.381 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-18T13:57:35.439 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_3 2023-10-18T13:57:35.497 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-18T13:57:35.497 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T13:57:35.498 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 392402 Links: 1 2023-10-18T13:57:35.498 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T13:57:35.498 INFO:teuthology.orchestra.run.smithi158.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T13:57:35.498 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-18 13:57:16.822642680 +0000 2023-10-18T13:57:35.498 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-18 13:51:11.081994475 +0000 2023-10-18T13:57:35.499 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-18 13:51:11.081994475 +0000 2023-10-18T13:57:35.499 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2023-10-18T13:57:35.499 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-18T13:57:35.563 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-18T13:57:35.563 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-18T13:57:35.564 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 9.708e-05 s, 5.3 MB/s 2023-10-18T13:57:35.565 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-18T13:57:35.623 DEBUG:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_4 2023-10-18T13:57:35.681 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-18T13:57:35.682 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T13:57:35.682 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 392502 Links: 1 2023-10-18T13:57:35.682 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T13:57:35.683 INFO:teuthology.orchestra.run.smithi158.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T13:57:35.683 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2023-10-18 13:57:16.822642680 +0000 2023-10-18T13:57:35.683 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-18 13:51:11.589988980 +0000 2023-10-18T13:57:35.683 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-18 13:51:11.589988980 +0000 2023-10-18T13:57:35.683 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2023-10-18T13:57:35.684 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-18T13:57:35.747 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2023-10-18T13:57:35.748 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2023-10-18T13:57:35.748 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000140659 s, 3.6 MB/s 2023-10-18T13:57:35.749 DEBUG:teuthology.orchestra.run.smithi158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-18T13:57:35.808 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T13:57:35.808 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2023-10-18T13:57:35.829 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-18T13:57:35.829 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2023-10-18T13:57:35.889 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-18T13:57:35.889 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T13:57:35.890 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 385849 Links: 1 2023-10-18T13:57:35.890 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T13:57:35.890 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T13:57:35.890 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-10-18 13:57:14.578392294 +0000 2023-10-18T13:57:35.890 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-10-18 13:51:09.637090230 +0000 2023-10-18T13:57:35.891 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-10-18 13:51:09.637090230 +0000 2023-10-18T13:57:35.891 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-10-18T13:57:35.891 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-18T13:57:35.962 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-10-18T13:57:35.962 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-10-18T13:57:35.962 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000281536 s, 1.8 MB/s 2023-10-18T13:57:35.963 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-18T13:57:36.023 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2023-10-18T13:57:36.081 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-18T13:57:36.082 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T13:57:36.082 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 392136 Links: 1 2023-10-18T13:57:36.082 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T13:57:36.082 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T13:57:36.083 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-10-18 13:57:14.578392294 +0000 2023-10-18T13:57:36.083 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-10-18 13:51:10.130077523 +0000 2023-10-18T13:57:36.083 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-10-18 13:51:10.130077523 +0000 2023-10-18T13:57:36.083 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-10-18T13:57:36.084 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-18T13:57:36.148 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-10-18T13:57:36.148 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-10-18T13:57:36.149 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000234425 s, 2.2 MB/s 2023-10-18T13:57:36.149 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-18T13:57:36.207 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2023-10-18T13:57:36.265 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-18T13:57:36.265 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T13:57:36.265 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 390752 Links: 1 2023-10-18T13:57:36.266 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T13:57:36.266 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T13:57:36.266 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-10-18 13:57:14.578392294 +0000 2023-10-18T13:57:36.266 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-10-18 13:51:10.617064970 +0000 2023-10-18T13:57:36.266 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-10-18 13:51:10.617064970 +0000 2023-10-18T13:57:36.267 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-10-18T13:57:36.267 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-18T13:57:36.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-10-18T13:57:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-10-18T13:57:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000233329 s, 2.2 MB/s 2023-10-18T13:57:36.333 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-18T13:57:36.391 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2023-10-18T13:57:36.449 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-18T13:57:36.449 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T13:57:36.449 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 393338 Links: 1 2023-10-18T13:57:36.450 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T13:57:36.450 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T13:57:36.450 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-10-18 13:57:14.578392294 +0000 2023-10-18T13:57:36.450 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-10-18 13:51:11.105052391 +0000 2023-10-18T13:57:36.450 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-10-18 13:51:11.105052391 +0000 2023-10-18T13:57:36.451 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-10-18T13:57:36.451 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-18T13:57:36.515 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-10-18T13:57:36.516 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-10-18T13:57:36.516 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000200742 s, 2.6 MB/s 2023-10-18T13:57:36.517 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-18T13:57:36.576 INFO:tasks.cephadm:Deploying osd.0 on smithi114 with /dev/vg_nvme/lv_4... 2023-10-18T13:57:36.576 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-18T13:57:37.145 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:37.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:36 smithi158 ceph-mon[103317]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:37.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:36 smithi172 ceph-mon[103574]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:37.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:36 smithi114 ceph-mon[99494]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:38.744 INFO:teuthology.orchestra.run.smithi114.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-18T13:57:38.744 INFO:teuthology.orchestra.run.smithi114.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-18T13:57:38.744 INFO:teuthology.orchestra.run.smithi114.stderr: stderr: 10+0 records in 2023-10-18T13:57:38.745 INFO:teuthology.orchestra.run.smithi114.stderr:10+0 records out 2023-10-18T13:57:38.745 INFO:teuthology.orchestra.run.smithi114.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0149865 s, 700 MB/s 2023-10-18T13:57:38.745 INFO:teuthology.orchestra.run.smithi114.stderr:--> Zapping successful for: 2023-10-18T13:57:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:38 smithi114 ceph-mon[99494]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:39.186 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi114:vg_nvme/lv_4 2023-10-18T13:57:39.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:38 smithi158 ceph-mon[103317]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:39.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:38 smithi172 ceph-mon[103574]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:39.742 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:57:41.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.015+0000 7f20ab64c700 1 -- 172.21.15.114:0/2472472424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a4068ed0 msgr2=0x7f20a4069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:41.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.015+0000 7f20ab64c700 1 --2- 172.21.15.114:0/2472472424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a4068ed0 0x7f20a4069350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009990 tx=0x7f20a0009ca0 comp rx=0 tx=0).stop 2023-10-18T13:57:41.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.015+0000 7f20ab64c700 1 -- 172.21.15.114:0/2472472424 shutdown_connections 2023-10-18T13:57:41.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.015+0000 7f20ab64c700 1 --2- 172.21.15.114:0/2472472424 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20a4069890 0x7f20a410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:41.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.015+0000 7f20ab64c700 1 --2- 172.21.15.114:0/2472472424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20a41067f0 0x7f20a4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:41.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.015+0000 7f20ab64c700 1 --2- 172.21.15.114:0/2472472424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a4068ed0 0x7f20a4069350 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:41.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.015+0000 7f20ab64c700 1 -- 172.21.15.114:0/2472472424 >> 172.21.15.114:0/2472472424 conn(0x7f20a4075a40 msgr2=0x7f20a4075e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.015+0000 7f20ab64c700 1 -- 172.21.15.114:0/2472472424 shutdown_connections 2023-10-18T13:57:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.015+0000 7f20ab64c700 1 -- 172.21.15.114:0/2472472424 wait complete. 2023-10-18T13:57:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.016+0000 7f20ab64c700 1 Processor -- start 2023-10-18T13:57:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.016+0000 7f20ab64c700 1 -- start start 2023-10-18T13:57:41.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.016+0000 7f20ab64c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20a4068ed0 0x7f20a419c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:41.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.016+0000 7f20ab64c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a4069890 0x7f20a419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:41.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.016+0000 7f20ab64c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20a41067f0 0x7f20a4196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:41.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.016+0000 7f20ab64c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a41971e0 con 0x7f20a4069890 2023-10-18T13:57:41.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.016+0000 7f20ab64c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a4197350 con 0x7f20a41067f0 2023-10-18T13:57:41.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.016+0000 7f20ab64c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a4197510 con 0x7f20a4068ed0 2023-10-18T13:57:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.016+0000 7f20a8be7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a4069890 0x7f20a419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.016+0000 7f20a8be7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a4069890 0x7f20a419cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41484/0 (socket says 172.21.15.114:41484) 2023-10-18T13:57:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.016+0000 7f20a8be7700 1 -- 172.21.15.114:0/2096760715 learned_addr learned my addr 172.21.15.114:0/2096760715 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:57:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f20a93e8700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20a4068ed0 0x7f20a419c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:41.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f20a9be9700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20a41067f0 0x7f20a4196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f20a8be7700 1 -- 172.21.15.114:0/2096760715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20a4068ed0 msgr2=0x7f20a419c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f20a8be7700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20a4068ed0 0x7f20a419c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f20a8be7700 1 -- 172.21.15.114:0/2096760715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20a41067f0 msgr2=0x7f20a4196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f20a8be7700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20a41067f0 0x7f20a4196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:41.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f20a8be7700 1 -- 172.21.15.114:0/2096760715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a00095f0 con 0x7f20a4069890 2023-10-18T13:57:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f20a93e8700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20a4068ed0 0x7f20a419c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T13:57:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f20a9be9700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20a41067f0 0x7f20a4196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T13:57:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f20a8be7700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a4069890 0x7f20a419cec0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f20a00098e0 tx=0x7f20a000f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f209a7fc700 1 -- 172.21.15.114:0/2096760715 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a001d070 con 0x7f20a4069890 2023-10-18T13:57:41.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f20ab64c700 1 -- 172.21.15.114:0/2096760715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a4197790 con 0x7f20a4069890 2023-10-18T13:57:41.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f209a7fc700 1 -- 172.21.15.114:0/2096760715 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20a000fb90 con 0x7f20a4069890 2023-10-18T13:57:41.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f209a7fc700 1 -- 172.21.15.114:0/2096760715 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0017650 con 0x7f20a4069890 2023-10-18T13:57:41.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.017+0000 7f20ab64c700 1 -- 172.21.15.114:0/2096760715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a41a3900 con 0x7f20a4069890 2023-10-18T13:57:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.018+0000 7f20ab64c700 1 -- 172.21.15.114:0/2096760715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a4108d60 con 0x7f20a4069890 2023-10-18T13:57:41.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.019+0000 7f209a7fc700 1 -- 172.21.15.114:0/2096760715 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f20a000fd00 con 0x7f20a4069890 2023-10-18T13:57:41.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.020+0000 7f209a7fc700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f20900a14c0 0x7f20900a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:57:41.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.020+0000 7f20a93e8700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f20900a14c0 0x7f20900a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:57:41.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.020+0000 7f209a7fc700 1 -- 172.21.15.114:0/2096760715 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f20a00cc570 con 0x7f20a4069890 2023-10-18T13:57:41.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.020+0000 7f20a93e8700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f20900a14c0 0x7f20900a3980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20940099d0 tx=0x7f2094008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:57:41.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.023+0000 7f209a7fc700 1 -- 172.21.15.114:0/2096760715 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f20a00977c0 con 0x7f20a4069890 2023-10-18T13:57:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:41.222+0000 7f20ab64c700 1 -- 172.21.15.114:0/2096760715 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f20a4101e80 con 0x7f20900a14c0 2023-10-18T13:57:41.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:40 smithi158 ceph-mon[103317]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:41.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:40 smithi172 ceph-mon[103574]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:41.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:40 smithi114 ceph-mon[99494]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:42.248 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:41 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:57:42.248 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:41 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:57:42.248 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:41 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:42.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:41 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:57:42.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:41 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:57:42.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:41 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:42.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:41 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:57:42.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:41 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:57:42.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:41 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:43.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:42 smithi158 ceph-mon[103317]: from='client.14403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:57:43.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:42 smithi158 ceph-mon[103317]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:43.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:42 smithi172 ceph-mon[103574]: from='client.14403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:57:43.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:42 smithi172 ceph-mon[103574]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:43.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:42 smithi114 ceph-mon[99494]: from='client.14403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:57:43.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:42 smithi114 ceph-mon[99494]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:44.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:44 smithi158 ceph-mon[103317]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:44.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:44 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/4154120490' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15fe1db1-6a41-4299-9df5-a64a8851d78c"}]: dispatch 2023-10-18T13:57:44.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:44 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/4154120490' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15fe1db1-6a41-4299-9df5-a64a8851d78c"}]': finished 2023-10-18T13:57:44.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:44 smithi158 ceph-mon[103317]: osdmap e6: 1 total, 0 up, 1 in 2023-10-18T13:57:44.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:44 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:57:44.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:44 smithi172 ceph-mon[103574]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:44.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:44 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/4154120490' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15fe1db1-6a41-4299-9df5-a64a8851d78c"}]: dispatch 2023-10-18T13:57:44.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:44 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/4154120490' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15fe1db1-6a41-4299-9df5-a64a8851d78c"}]': finished 2023-10-18T13:57:44.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:44 smithi172 ceph-mon[103574]: osdmap e6: 1 total, 0 up, 1 in 2023-10-18T13:57:44.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:44 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:57:44.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:44 smithi114 ceph-mon[99494]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:44.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:44 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/4154120490' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15fe1db1-6a41-4299-9df5-a64a8851d78c"}]: dispatch 2023-10-18T13:57:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:44 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/4154120490' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15fe1db1-6a41-4299-9df5-a64a8851d78c"}]': finished 2023-10-18T13:57:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:44 smithi114 ceph-mon[99494]: osdmap e6: 1 total, 0 up, 1 in 2023-10-18T13:57:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:44 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:57:45.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:45 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2075753485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:57:45.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:45 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2075753485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:57:45.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:45 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2075753485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:57:46.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:46 smithi158 ceph-mon[103317]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:46.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:46 smithi172 ceph-mon[103574]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:46.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:46 smithi114 ceph-mon[99494]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:48.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:48 smithi172 ceph-mon[103574]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:48.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:48 smithi114 ceph-mon[99494]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:49.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:48 smithi158 ceph-mon[103317]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:50.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:50 smithi172 ceph-mon[103574]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:50.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:50 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-18T13:57:50.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:50 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:50.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:50 smithi114 ceph-mon[99494]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:50.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:50 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-18T13:57:50.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:50 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:51.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:50 smithi158 ceph-mon[103317]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:51.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:50 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-18T13:57:51.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:50 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:51.814 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:51 smithi114 ceph-mon[99494]: Deploying daemon osd.0 on smithi114 2023-10-18T13:57:52.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:51 smithi158 ceph-mon[103317]: Deploying daemon osd.0 on smithi114 2023-10-18T13:57:52.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:51 smithi172 ceph-mon[103574]: Deploying daemon osd.0 on smithi114 2023-10-18T13:57:52.787 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:52 smithi114 ceph-mon[99494]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:53.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:52 smithi158 ceph-mon[103317]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:53.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:52 smithi172 ceph-mon[103574]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:54.451 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:54 smithi114 ceph-mon[99494]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:54.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:54 smithi158 ceph-mon[103317]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:54.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:54 smithi172 ceph-mon[103574]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:55.936 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:55 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:55.936 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:55 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:55.936 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:55 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:56.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:55 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:56.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:55 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:56.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:55 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:56.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:55 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:56.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:55 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:56.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:55 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:57.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:56 smithi172 ceph-mon[103574]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:56 smithi114 ceph-mon[99494]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:57.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:56 smithi158 ceph-mon[103317]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:Created osd(s) 0 on host 'smithi114' 2023-10-18T13:57:57.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:57.523+0000 7f209a7fc700 1 -- 172.21.15.114:0/2096760715 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f20a4101e80 con 0x7f20900a14c0 2023-10-18T13:57:57.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:57.525+0000 7f20ab64c700 1 -- 172.21.15.114:0/2096760715 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f20900a14c0 msgr2=0x7f20900a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:57.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:57.525+0000 7f20ab64c700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f20900a14c0 0x7f20900a3980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20940099d0 tx=0x7f2094008040 comp rx=0 tx=0).stop 2023-10-18T13:57:57.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:57.525+0000 7f20ab64c700 1 -- 172.21.15.114:0/2096760715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a4069890 msgr2=0x7f20a419cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:57:57.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:57.525+0000 7f20ab64c700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a4069890 0x7f20a419cec0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f20a00098e0 tx=0x7f20a000f720 comp rx=0 tx=0).stop 2023-10-18T13:57:57.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:57.525+0000 7f20ab64c700 1 -- 172.21.15.114:0/2096760715 shutdown_connections 2023-10-18T13:57:57.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:57.525+0000 7f20ab64c700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f20900a14c0 0x7f20900a3980 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:57.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:57.525+0000 7f20ab64c700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20a41067f0 0x7f20a4196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:57.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:57.525+0000 7f20ab64c700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20a4068ed0 0x7f20a419c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:57.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:57.525+0000 7f20ab64c700 1 --2- 172.21.15.114:0/2096760715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a4069890 0x7f20a419cec0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:57:57.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:57.525+0000 7f20ab64c700 1 -- 172.21.15.114:0/2096760715 >> 172.21.15.114:0/2096760715 conn(0x7f20a4075a40 msgr2=0x7f20a40fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:57:57.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:57.525+0000 7f20ab64c700 1 -- 172.21.15.114:0/2096760715 shutdown_connections 2023-10-18T13:57:57.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:57:57.525+0000 7f20ab64c700 1 -- 172.21.15.114:0/2096760715 wait complete. 2023-10-18T13:57:57.941 DEBUG:teuthology.orchestra.run.smithi114:osd.0> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.0.service 2023-10-18T13:57:57.944 INFO:tasks.cephadm:Deploying osd.1 on smithi158 with /dev/vg_nvme/lv_4... 2023-10-18T13:57:57.944 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-18T13:57:57.977 INFO:journalctl@ceph.osd.0.smithi114.stdout:-- Logs begin at Wed 2023-10-18 13:40:26 UTC. -- 2023-10-18T13:57:58.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:57 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:57 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:57 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:58.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:57 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:58.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:57 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:57 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:58.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:57 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:57 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:57 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:57 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:57 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:58.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:57 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:58.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:57 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:57 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:58.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:57 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:57 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:57 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:57 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:57 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:57:58.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:57 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:57:58.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:57 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:57 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:57:58.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:57 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:57 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:57:58.515 INFO:teuthology.orchestra.run.smithi158.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-18T13:57:58.752 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 13:57:58 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-0[124655]: 2023-10-18T13:57:58.673+0000 7f25cee02640 -1 osd.0 0 log_to_monitors true 2023-10-18T13:57:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:58 smithi158 ceph-mon[103317]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:57:58 smithi158 ceph-mon[103317]: from='osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-18T13:57:59.030 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:58 smithi114 ceph-mon[99494]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:59.030 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:57:58 smithi114 ceph-mon[99494]: from='osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-18T13:57:59.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:58 smithi172 ceph-mon[103574]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:57:59.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:57:58 smithi172 ceph-mon[103574]: from='osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-18T13:58:00.075 INFO:teuthology.orchestra.run.smithi158.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-18T13:58:00.076 INFO:teuthology.orchestra.run.smithi158.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-18T13:58:00.076 INFO:teuthology.orchestra.run.smithi158.stderr: stderr: 10+0 records in 2023-10-18T13:58:00.076 INFO:teuthology.orchestra.run.smithi158.stderr:10+0 records out 2023-10-18T13:58:00.076 INFO:teuthology.orchestra.run.smithi158.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00816563 s, 1.3 GB/s 2023-10-18T13:58:00.077 INFO:teuthology.orchestra.run.smithi158.stderr:--> Zapping successful for: 2023-10-18T13:58:00.471 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi158:vg_nvme/lv_4 2023-10-18T13:58:00.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:00 smithi158 ceph-mon[103317]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:58:00.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:00 smithi158 ceph-mon[103317]: from='osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-18T13:58:00.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:00 smithi158 ceph-mon[103317]: osdmap e7: 1 total, 0 up, 1 in 2023-10-18T13:58:00.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:00 smithi158 ceph-mon[103317]: from='osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2023-10-18T13:58:00.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:00 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:00.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:00 smithi172 ceph-mon[103574]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:58:00.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:00 smithi172 ceph-mon[103574]: from='osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-18T13:58:00.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:00 smithi172 ceph-mon[103574]: osdmap e7: 1 total, 0 up, 1 in 2023-10-18T13:58:00.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:00 smithi172 ceph-mon[103574]: from='osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2023-10-18T13:58:00.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:00 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:00.838 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 13:58:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-0[124655]: 2023-10-18T13:58:00.510+0000 7f25c4479700 -1 osd.0 0 waiting for initial osdmap 2023-10-18T13:58:00.839 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 13:58:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-0[124655]: 2023-10-18T13:58:00.515+0000 7f25bd268700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T13:58:00.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:00 smithi114 ceph-mon[99494]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:58:00.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:00 smithi114 ceph-mon[99494]: from='osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-18T13:58:00.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:00 smithi114 ceph-mon[99494]: osdmap e7: 1 total, 0 up, 1 in 2023-10-18T13:58:00.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:00 smithi114 ceph-mon[99494]: from='osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2023-10-18T13:58:00.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:00 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:01.034 INFO:teuthology.orchestra.run.smithi158.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-18T13:58:01.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:01 smithi158 ceph-mon[103317]: from='osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2023-10-18T13:58:01.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:01 smithi158 ceph-mon[103317]: osdmap e8: 1 total, 0 up, 1 in 2023-10-18T13:58:01.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:01.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:01.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:01 smithi158 ceph-mon[103317]: Detected new or changed devices on smithi114 2023-10-18T13:58:01.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:01.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:01.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:58:01.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:01 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi114 to 17168M 2023-10-18T13:58:01.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:01.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:01.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:01.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:01.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:01 smithi172 ceph-mon[103574]: from='osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2023-10-18T13:58:01.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:01 smithi172 ceph-mon[103574]: osdmap e8: 1 total, 0 up, 1 in 2023-10-18T13:58:01.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:01.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:01.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:01 smithi172 ceph-mon[103574]: Detected new or changed devices on smithi114 2023-10-18T13:58:01.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:01.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:01.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:58:01.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:01 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi114 to 17168M 2023-10-18T13:58:01.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:01.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:01.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:01.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:01.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:01 smithi114 ceph-mon[99494]: from='osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2023-10-18T13:58:01.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:01 smithi114 ceph-mon[99494]: osdmap e8: 1 total, 0 up, 1 in 2023-10-18T13:58:01.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:01.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:01.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:01 smithi114 ceph-mon[99494]: Detected new or changed devices on smithi114 2023-10-18T13:58:01.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:01.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:01.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:58:01.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:01 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi114 to 17168M 2023-10-18T13:58:01.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:01.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:01.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:01.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:02.230 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.227+0000 7f0aadfb1700 1 -- 172.21.15.158:0/90893199 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0aa80ffb30 msgr2=0x7f0aa810d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:58:02.230 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.227+0000 7f0aadfb1700 1 --2- 172.21.15.158:0/90893199 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0aa80ffb30 0x7f0aa810d5c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000b0a0 tx=0x7f0aa000b3b0 comp rx=0 tx=0).stop 2023-10-18T13:58:02.231 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.227+0000 7f0aadfb1700 1 -- 172.21.15.158:0/90893199 shutdown_connections 2023-10-18T13:58:02.231 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.227+0000 7f0aadfb1700 1 --2- 172.21.15.158:0/90893199 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0aa80ffb30 0x7f0aa810d5c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:02.231 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.227+0000 7f0aadfb1700 1 --2- 172.21.15.158:0/90893199 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0aa81058d0 0x7f0aa8105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:02.231 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.227+0000 7f0aadfb1700 1 --2- 172.21.15.158:0/90893199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa80ff190 0x7f0aa80ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:02.231 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.227+0000 7f0aadfb1700 1 -- 172.21.15.158:0/90893199 >> 172.21.15.158:0/90893199 conn(0x7f0aa8074a10 msgr2=0x7f0aa8074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:58:02.232 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.227+0000 7f0aadfb1700 1 -- 172.21.15.158:0/90893199 shutdown_connections 2023-10-18T13:58:02.232 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.227+0000 7f0aadfb1700 1 -- 172.21.15.158:0/90893199 wait complete. 2023-10-18T13:58:02.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.228+0000 7f0aadfb1700 1 Processor -- start 2023-10-18T13:58:02.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.228+0000 7f0aadfb1700 1 -- start start 2023-10-18T13:58:02.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.228+0000 7f0aadfb1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa80ff190 0x7f0aa8100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:58:02.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.228+0000 7f0aadfb1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0aa80ffb30 0x7f0aa81008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:58:02.234 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.228+0000 7f0aadfb1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0aa81058d0 0x7f0aa8100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:58:02.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.228+0000 7f0aadfb1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa81a50a0 con 0x7f0aa81058d0 2023-10-18T13:58:02.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.228+0000 7f0aadfb1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa81a5210 con 0x7f0aa80ffb30 2023-10-18T13:58:02.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.228+0000 7f0aadfb1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa81a53d0 con 0x7f0aa80ff190 2023-10-18T13:58:02.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.228+0000 7f0aa6ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0aa80ffb30 0x7f0aa81008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:58:02.235 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.228+0000 7f0aa6ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0aa80ffb30 0x7f0aa81008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35042/0 (socket says 172.21.15.158:35042) 2023-10-18T13:58:02.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.228+0000 7f0aa6ffd700 1 -- 172.21.15.158:0/247571318 learned_addr learned my addr 172.21.15.158:0/247571318 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T13:58:02.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.228+0000 7f0aa7fff700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0aa81058d0 0x7f0aa8100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:58:02.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.229+0000 7f0aa77fe700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa80ff190 0x7f0aa8100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:58:02.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.229+0000 7f0aa6ffd700 1 -- 172.21.15.158:0/247571318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa80ff190 msgr2=0x7f0aa8100370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:58:02.236 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.229+0000 7f0aa6ffd700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa80ff190 0x7f0aa8100370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:02.237 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.229+0000 7f0aa6ffd700 1 -- 172.21.15.158:0/247571318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0aa81058d0 msgr2=0x7f0aa8100df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:58:02.237 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.229+0000 7f0aa6ffd700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0aa81058d0 0x7f0aa8100df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:02.237 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.229+0000 7f0aa6ffd700 1 -- 172.21.15.158:0/247571318 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0009d00 con 0x7f0aa80ffb30 2023-10-18T13:58:02.237 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.229+0000 7f0aa77fe700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa80ff190 0x7f0aa8100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T13:58:02.237 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.229+0000 7f0aa6ffd700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0aa80ffb30 0x7f0aa81008b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c9b0 tx=0x7f0a9800ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:58:02.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.229+0000 7f0aa4ff9700 1 -- 172.21.15.158:0/247571318 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98007b00 con 0x7f0aa80ffb30 2023-10-18T13:58:02.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.229+0000 7f0aa4ff9700 1 -- 172.21.15.158:0/247571318 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a98007c60 con 0x7f0aa80ffb30 2023-10-18T13:58:02.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.229+0000 7f0aadfb1700 1 -- 172.21.15.158:0/247571318 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa81a56b0 con 0x7f0aa80ffb30 2023-10-18T13:58:02.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.229+0000 7f0aa4ff9700 1 -- 172.21.15.158:0/247571318 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98018660 con 0x7f0aa80ffb30 2023-10-18T13:58:02.238 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.229+0000 7f0aadfb1700 1 -- 172.21.15.158:0/247571318 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa81a5bb0 con 0x7f0aa80ffb30 2023-10-18T13:58:02.239 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.230+0000 7f0aadfb1700 1 -- 172.21.15.158:0/247571318 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa8108d30 con 0x7f0aa80ffb30 2023-10-18T13:58:02.239 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.231+0000 7f0aa4ff9700 1 -- 172.21.15.158:0/247571318 <== mon.2 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f0a9800f450 con 0x7f0aa80ffb30 2023-10-18T13:58:02.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.231+0000 7f0aa4ff9700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0a900a1440 0x7f0a900a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:58:02.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.232+0000 7f0aa4ff9700 1 -- 172.21.15.158:0/247571318 <== mon.2 v2:172.21.15.158:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f0a980cb620 con 0x7f0aa80ffb30 2023-10-18T13:58:02.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.232+0000 7f0aa77fe700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0a900a1440 0x7f0a900a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:58:02.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.232+0000 7f0aa77fe700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0a900a1440 0x7f0a900a3900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c005e10 tx=0x7f0a9c005d20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:58:02.240 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.235+0000 7f0aa4ff9700 1 -- 172.21.15.158:0/247571318 <== mon.2 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0a980966b0 con 0x7f0aa80ffb30 2023-10-18T13:58:02.435 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:02.432+0000 7f0aadfb1700 1 -- 172.21.15.158:0/247571318 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0aa8101850 con 0x7f0a900a1440 2023-10-18T13:58:02.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:02 smithi158 ceph-mon[103317]: purged_snaps scrub starts 2023-10-18T13:58:02.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:02 smithi158 ceph-mon[103317]: purged_snaps scrub ok 2023-10-18T13:58:02.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:02 smithi158 ceph-mon[103317]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:58:02.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:02 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:02.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:02 smithi158 ceph-mon[103317]: osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344] boot 2023-10-18T13:58:02.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:02 smithi158 ceph-mon[103317]: osdmap e9: 1 total, 1 up, 1 in 2023-10-18T13:58:02.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:02 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:02.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:02 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:58:02.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:02 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:58:02.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:02 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:02.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:02 smithi172 ceph-mon[103574]: purged_snaps scrub starts 2023-10-18T13:58:02.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:02 smithi172 ceph-mon[103574]: purged_snaps scrub ok 2023-10-18T13:58:02.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:02 smithi172 ceph-mon[103574]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:58:02.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:02 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:02.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:02 smithi172 ceph-mon[103574]: osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344] boot 2023-10-18T13:58:02.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:02 smithi172 ceph-mon[103574]: osdmap e9: 1 total, 1 up, 1 in 2023-10-18T13:58:02.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:02 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:02.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:02 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:58:02.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:02 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:58:02.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:02 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:02.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:02 smithi114 ceph-mon[99494]: purged_snaps scrub starts 2023-10-18T13:58:02.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:02 smithi114 ceph-mon[99494]: purged_snaps scrub ok 2023-10-18T13:58:02.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:02 smithi114 ceph-mon[99494]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-18T13:58:02.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:02 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:02.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:02 smithi114 ceph-mon[99494]: osd.0 [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344] boot 2023-10-18T13:58:02.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:02 smithi114 ceph-mon[99494]: osdmap e9: 1 total, 1 up, 1 in 2023-10-18T13:58:02.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:02 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-18T13:58:02.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:02 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:58:02.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:02 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:58:02.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:02 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:03.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:03 smithi172 ceph-mon[103574]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:58:03.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:03 smithi172 ceph-mon[103574]: osdmap e10: 1 total, 1 up, 1 in 2023-10-18T13:58:03.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:03 smithi114 ceph-mon[99494]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:58:03.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:03 smithi114 ceph-mon[99494]: osdmap e10: 1 total, 1 up, 1 in 2023-10-18T13:58:04.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:03 smithi158 ceph-mon[103317]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:58:04.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:03 smithi158 ceph-mon[103317]: osdmap e10: 1 total, 1 up, 1 in 2023-10-18T13:58:04.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:04 smithi172 ceph-mon[103574]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:04.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:04 smithi114 ceph-mon[99494]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:05.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:04 smithi158 ceph-mon[103317]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:05.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:05 smithi172 ceph-mon[103574]: from='client.? 172.21.15.158:0/2878689757' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6"}]: dispatch 2023-10-18T13:58:05.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:05 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6"}]: dispatch 2023-10-18T13:58:05.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:05 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6"}]': finished 2023-10-18T13:58:05.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:05 smithi172 ceph-mon[103574]: osdmap e11: 2 total, 1 up, 2 in 2023-10-18T13:58:05.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:05 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:05.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:05 smithi172 ceph-mon[103574]: from='client.? 172.21.15.158:0/3990838186' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:58:05.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:05 smithi114 ceph-mon[99494]: from='client.? 172.21.15.158:0/2878689757' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6"}]: dispatch 2023-10-18T13:58:05.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:05 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6"}]: dispatch 2023-10-18T13:58:05.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:05 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6"}]': finished 2023-10-18T13:58:05.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:05 smithi114 ceph-mon[99494]: osdmap e11: 2 total, 1 up, 2 in 2023-10-18T13:58:05.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:05 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:05.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:05 smithi114 ceph-mon[99494]: from='client.? 172.21.15.158:0/3990838186' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:58:06.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:05 smithi158 ceph-mon[103317]: from='client.? 172.21.15.158:0/2878689757' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6"}]: dispatch 2023-10-18T13:58:06.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:05 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6"}]: dispatch 2023-10-18T13:58:06.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:05 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6"}]': finished 2023-10-18T13:58:06.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:05 smithi158 ceph-mon[103317]: osdmap e11: 2 total, 1 up, 2 in 2023-10-18T13:58:06.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:05 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:06.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:05 smithi158 ceph-mon[103317]: from='client.? 172.21.15.158:0/3990838186' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:58:07.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:06 smithi172 ceph-mon[103574]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:07.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:06 smithi114 ceph-mon[99494]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:07.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:06 smithi158 ceph-mon[103317]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:09.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:08 smithi172 ceph-mon[103574]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:09.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:08 smithi114 ceph-mon[99494]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:09.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:08 smithi158 ceph-mon[103317]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:11.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:10 smithi172 ceph-mon[103574]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:10 smithi114 ceph-mon[99494]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:11.111 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:10 smithi158 ceph-mon[103317]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:12.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:11 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-18T13:58:12.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:11 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:12.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:11 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-18T13:58:12.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:11 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:12.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:11 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-18T13:58:12.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:11 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:12.953 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:12 smithi158 ceph-mon[103317]: Deploying daemon osd.1 on smithi158 2023-10-18T13:58:12.953 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:12 smithi158 ceph-mon[103317]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:12 smithi114 ceph-mon[99494]: Deploying daemon osd.1 on smithi158 2023-10-18T13:58:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:12 smithi114 ceph-mon[99494]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:13.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:12 smithi172 ceph-mon[103574]: Deploying daemon osd.1 on smithi158 2023-10-18T13:58:13.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:12 smithi172 ceph-mon[103574]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:14.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:14 smithi158 ceph-mon[103317]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:14.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:14 smithi172 ceph-mon[103574]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:14.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:14 smithi114 ceph-mon[99494]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:16.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:16 smithi158 ceph-mon[103317]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:16.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:16 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:16.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:16 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:16.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:16 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:17.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:16 smithi172 ceph-mon[103574]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:17.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:16 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:17.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:16 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:17.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:16 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:17.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:16 smithi114 ceph-mon[99494]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:17.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:16 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:17.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:16 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:17.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:16 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:18.351 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:18.346+0000 7f0aa4ff9700 1 -- 172.21.15.158:0/247571318 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0aa8101850 con 0x7f0a900a1440 2023-10-18T13:58:18.351 INFO:teuthology.orchestra.run.smithi158.stdout:Created osd(s) 1 on host 'smithi158' 2023-10-18T13:58:18.353 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:18.349+0000 7f0aadfb1700 1 -- 172.21.15.158:0/247571318 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0a900a1440 msgr2=0x7f0a900a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:58:18.353 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:18.349+0000 7f0aadfb1700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0a900a1440 0x7f0a900a3900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c005e10 tx=0x7f0a9c005d20 comp rx=0 tx=0).stop 2023-10-18T13:58:18.353 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:18.349+0000 7f0aadfb1700 1 -- 172.21.15.158:0/247571318 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0aa80ffb30 msgr2=0x7f0aa81008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:58:18.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:18.349+0000 7f0aadfb1700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0aa80ffb30 0x7f0aa81008b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c9b0 tx=0x7f0a9800ccc0 comp rx=0 tx=0).stop 2023-10-18T13:58:18.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:18.349+0000 7f0aadfb1700 1 -- 172.21.15.158:0/247571318 shutdown_connections 2023-10-18T13:58:18.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:18.349+0000 7f0aadfb1700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0a900a1440 0x7f0a900a3900 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:18.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:18.349+0000 7f0aadfb1700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0aa81058d0 0x7f0aa8100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:18.354 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:18.349+0000 7f0aadfb1700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa80ff190 0x7f0aa8100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:18.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:18.349+0000 7f0aadfb1700 1 --2- 172.21.15.158:0/247571318 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0aa80ffb30 0x7f0aa81008b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:18.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:18.349+0000 7f0aadfb1700 1 -- 172.21.15.158:0/247571318 >> 172.21.15.158:0/247571318 conn(0x7f0aa8074a10 msgr2=0x7f0aa80fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:58:18.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:18.349+0000 7f0aadfb1700 1 -- 172.21.15.158:0/247571318 shutdown_connections 2023-10-18T13:58:18.355 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:58:18.349+0000 7f0aadfb1700 1 -- 172.21.15.158:0/247571318 wait complete. 2023-10-18T13:58:18.840 DEBUG:teuthology.orchestra.run.smithi158:osd.1> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.1.service 2023-10-18T13:58:18.843 INFO:tasks.cephadm:Deploying osd.2 on smithi172 with /dev/vg_nvme/lv_4... 2023-10-18T13:58:18.843 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-18T13:58:18.871 INFO:journalctl@ceph.osd.1.smithi158.stdout:-- Logs begin at Wed 2023-10-18 13:41:14 UTC. -- 2023-10-18T13:58:19.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:18 smithi158 ceph-mon[103317]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:19.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:18 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:18 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:18 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:19.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:18 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:19.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:18 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:18 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:18 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:18 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:19.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:18 smithi172 ceph-mon[103574]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:19.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:18 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:18 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:18 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:19.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:18 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:19.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:18 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:18 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:18 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:18 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:18 smithi114 ceph-mon[99494]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:18 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:18 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:18 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:19.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:18 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:19.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:18 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:18 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:18 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:19.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:18 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:19.411 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T13:58:19.843 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:19 smithi158 ceph-mon[103317]: from='osd.1 [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-18T13:58:19.844 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:19 smithi158 ceph-mon[103317]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-18T13:58:19.844 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 13:58:19 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-1[109543]: 2023-10-18T13:58:19.542+0000 7f1427230640 -1 osd.1 0 log_to_monitors true 2023-10-18T13:58:19.955 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:19 smithi172 ceph-mon[103574]: from='osd.1 [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-18T13:58:19.956 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:19 smithi172 ceph-mon[103574]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-18T13:58:20.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:19 smithi114 ceph-mon[99494]: from='osd.1 [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-18T13:58:20.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:19 smithi114 ceph-mon[99494]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-18T13:58:20.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:20 smithi172 ceph-mon[103574]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:20.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:20 smithi172 ceph-mon[103574]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-18T13:58:20.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:20 smithi172 ceph-mon[103574]: from='osd.1 [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T13:58:20.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:20 smithi172 ceph-mon[103574]: osdmap e12: 2 total, 1 up, 2 in 2023-10-18T13:58:20.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:20 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:20.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:20 smithi172 ceph-mon[103574]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T13:58:20.981 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-18T13:58:20.981 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-18T13:58:20.981 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2023-10-18T13:58:20.982 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2023-10-18T13:58:20.982 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111155 s, 943 MB/s 2023-10-18T13:58:20.982 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2023-10-18T13:58:21.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:20 smithi158 ceph-mon[103317]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:21.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:20 smithi158 ceph-mon[103317]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-18T13:58:21.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:20 smithi158 ceph-mon[103317]: from='osd.1 [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T13:58:21.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:20 smithi158 ceph-mon[103317]: osdmap e12: 2 total, 1 up, 2 in 2023-10-18T13:58:21.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:20 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:21.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:20 smithi158 ceph-mon[103317]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T13:58:21.023 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 13:58:20 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-1[109543]: 2023-10-18T13:58:20.662+0000 7f141c8a7700 -1 osd.1 0 waiting for initial osdmap 2023-10-18T13:58:21.023 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 13:58:20 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-1[109543]: 2023-10-18T13:58:20.668+0000 7f1416698700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T13:58:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:20 smithi114 ceph-mon[99494]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:20 smithi114 ceph-mon[99494]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-18T13:58:21.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:20 smithi114 ceph-mon[99494]: from='osd.1 [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T13:58:21.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:20 smithi114 ceph-mon[99494]: osdmap e12: 2 total, 1 up, 2 in 2023-10-18T13:58:21.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:20 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:21.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:20 smithi114 ceph-mon[99494]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T13:58:21.455 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2023-10-18T13:58:22.017 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T13:58:22.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:21 smithi158 ceph-mon[103317]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]': finished 2023-10-18T13:58:22.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:21 smithi158 ceph-mon[103317]: osdmap e13: 2 total, 1 up, 2 in 2023-10-18T13:58:22.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:21 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:22.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:21 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:22.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:21 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:22.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:21 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:22.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:21 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:58:22.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:21 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:22.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:21 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:22.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:21 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:22.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:21 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:22.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:21 smithi172 ceph-mon[103574]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]': finished 2023-10-18T13:58:22.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:21 smithi172 ceph-mon[103574]: osdmap e13: 2 total, 1 up, 2 in 2023-10-18T13:58:22.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:21 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:22.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:21 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:22.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:21 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:22.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:21 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:22.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:21 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:58:22.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:21 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:22.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:21 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:22.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:21 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:22.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:21 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:22.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:21 smithi114 ceph-mon[99494]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]': finished 2023-10-18T13:58:22.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:21 smithi114 ceph-mon[99494]: osdmap e13: 2 total, 1 up, 2 in 2023-10-18T13:58:22.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:21 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:22.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:21 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:22.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:21 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:22.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:21 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:22.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:21 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:58:22.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:21 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:22.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:21 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:22.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:21 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:22.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:21 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:22.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:22 smithi172 ceph-mon[103574]: purged_snaps scrub starts 2023-10-18T13:58:22.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:22 smithi172 ceph-mon[103574]: purged_snaps scrub ok 2023-10-18T13:58:22.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:22 smithi172 ceph-mon[103574]: Detected new or changed devices on smithi158 2023-10-18T13:58:22.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:22 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi158 to 17168M 2023-10-18T13:58:22.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:22 smithi172 ceph-mon[103574]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:22.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:22 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:22.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:22 smithi172 ceph-mon[103574]: osd.1 [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165] boot 2023-10-18T13:58:22.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:22 smithi172 ceph-mon[103574]: osdmap e14: 2 total, 2 up, 2 in 2023-10-18T13:58:22.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:22 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:23.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:22 smithi158 ceph-mon[103317]: purged_snaps scrub starts 2023-10-18T13:58:23.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:22 smithi158 ceph-mon[103317]: purged_snaps scrub ok 2023-10-18T13:58:23.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:22 smithi158 ceph-mon[103317]: Detected new or changed devices on smithi158 2023-10-18T13:58:23.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:22 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi158 to 17168M 2023-10-18T13:58:23.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:22 smithi158 ceph-mon[103317]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:23.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:22 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:23.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:22 smithi158 ceph-mon[103317]: osd.1 [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165] boot 2023-10-18T13:58:23.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:22 smithi158 ceph-mon[103317]: osdmap e14: 2 total, 2 up, 2 in 2023-10-18T13:58:23.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:22 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:22 smithi114 ceph-mon[99494]: purged_snaps scrub starts 2023-10-18T13:58:23.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:22 smithi114 ceph-mon[99494]: purged_snaps scrub ok 2023-10-18T13:58:23.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:22 smithi114 ceph-mon[99494]: Detected new or changed devices on smithi158 2023-10-18T13:58:23.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:22 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi158 to 17168M 2023-10-18T13:58:23.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:22 smithi114 ceph-mon[99494]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-18T13:58:23.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:22 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:23.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:22 smithi114 ceph-mon[99494]: osd.1 [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165] boot 2023-10-18T13:58:23.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:22 smithi114 ceph-mon[99494]: osdmap e14: 2 total, 2 up, 2 in 2023-10-18T13:58:23.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:22 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-18T13:58:23.246 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.243+0000 7f9bb11bb700 1 -- 172.21.15.172:0/49363143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac100390 msgr2=0x7f9bac10c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:58:23.247 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.243+0000 7f9bb11bb700 1 --2- 172.21.15.172:0/49363143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac100390 0x7f9bac10c5b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400b0a0 tx=0x7f9ba400b3b0 comp rx=0 tx=0).stop 2023-10-18T13:58:23.247 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.243+0000 7f9bb11bb700 1 -- 172.21.15.172:0/49363143 shutdown_connections 2023-10-18T13:58:23.247 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.243+0000 7f9bb11bb700 1 --2- 172.21.15.172:0/49363143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac100390 0x7f9bac10c5b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:23.247 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.243+0000 7f9bb11bb700 1 --2- 172.21.15.172:0/49363143 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bac104710 0x7f9bac104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:23.248 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.243+0000 7f9bb11bb700 1 --2- 172.21.15.172:0/49363143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bac0ff9d0 0x7f9bac0ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:23.248 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.243+0000 7f9bb11bb700 1 -- 172.21.15.172:0/49363143 >> 172.21.15.172:0/49363143 conn(0x7f9bac0765b0 msgr2=0x7f9bac0769c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:58:23.248 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.243+0000 7f9bb11bb700 1 -- 172.21.15.172:0/49363143 shutdown_connections 2023-10-18T13:58:23.248 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.243+0000 7f9bb11bb700 1 -- 172.21.15.172:0/49363143 wait complete. 2023-10-18T13:58:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.243+0000 7f9bb11bb700 1 Processor -- start 2023-10-18T13:58:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9bb11bb700 1 -- start start 2023-10-18T13:58:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9bb11bb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bac0ff9d0 0x7f9bac19c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:58:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9bb11bb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac100390 0x7f9bac19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:58:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9bb11bb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bac104710 0x7f9bac1969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:58:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9bb11bb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac197040 con 0x7f9bac0ff9d0 2023-10-18T13:58:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9bb11bb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac1971b0 con 0x7f9bac104710 2023-10-18T13:58:23.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9bb11bb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac197370 con 0x7f9bac100390 2023-10-18T13:58:23.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9baa59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac100390 0x7f9bac19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:58:23.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9baa59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac100390 0x7f9bac19cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55062/0 (socket says 172.21.15.172:55062) 2023-10-18T13:58:23.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9baa59c700 1 -- 172.21.15.172:0/2276040303 learned_addr learned my addr 172.21.15.172:0/2276040303 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T13:58:23.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9baad9d700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bac0ff9d0 0x7f9bac19c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:58:23.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9bab59e700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bac104710 0x7f9bac1969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:58:23.253 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9baa59c700 1 -- 172.21.15.172:0/2276040303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bac104710 msgr2=0x7f9bac1969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:58:23.253 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9baa59c700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bac104710 0x7f9bac1969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:23.253 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9baa59c700 1 -- 172.21.15.172:0/2276040303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bac0ff9d0 msgr2=0x7f9bac19c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:58:23.253 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9baa59c700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bac0ff9d0 0x7f9bac19c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:23.253 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9baa59c700 1 -- 172.21.15.172:0/2276040303 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba4009d00 con 0x7f9bac100390 2023-10-18T13:58:23.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.244+0000 7f9baa59c700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac100390 0x7f9bac19cde0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00d950 tx=0x7f9b9c00dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:58:23.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.245+0000 7f9b93fff700 1 -- 172.21.15.172:0/2276040303 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c00f890 con 0x7f9bac100390 2023-10-18T13:58:23.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.245+0000 7f9b93fff700 1 -- 172.21.15.172:0/2276040303 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b9c010460 con 0x7f9bac100390 2023-10-18T13:58:23.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.245+0000 7f9bb11bb700 1 -- 172.21.15.172:0/2276040303 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bac197650 con 0x7f9bac100390 2023-10-18T13:58:23.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.245+0000 7f9b93fff700 1 -- 172.21.15.172:0/2276040303 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c00e610 con 0x7f9bac100390 2023-10-18T13:58:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.245+0000 7f9bb11bb700 1 -- 172.21.15.172:0/2276040303 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac1a3890 con 0x7f9bac100390 2023-10-18T13:58:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.246+0000 7f9bb11bb700 1 -- 172.21.15.172:0/2276040303 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac108d10 con 0x7f9bac100390 2023-10-18T13:58:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.247+0000 7f9b93fff700 1 -- 172.21.15.172:0/2276040303 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f9b9c0108d0 con 0x7f9bac100390 2023-10-18T13:58:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.247+0000 7f9b93fff700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9b940a1440 0x7f9b940a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:58:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.247+0000 7f9b93fff700 1 -- 172.21.15.172:0/2276040303 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2524+0+0 (secure 0 0 0) 0x7f9b9c0cb330 con 0x7f9bac100390 2023-10-18T13:58:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.247+0000 7f9baad9d700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9b940a1440 0x7f9b940a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:58:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.248+0000 7f9baad9d700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9b940a1440 0x7f9b940a3900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009a10 tx=0x7f9ba0009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:58:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.252+0000 7f9b93fff700 1 -- 172.21.15.172:0/2276040303 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9b9c096110 con 0x7f9bac100390 2023-10-18T13:58:23.451 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:23.447+0000 7f9bb11bb700 1 -- 172.21.15.172:0/2276040303 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bac197ea0 con 0x7f9b940a1440 2023-10-18T13:58:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:24 smithi172 ceph-mon[103574]: osdmap e15: 2 total, 2 up, 2 in 2023-10-18T13:58:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:24 smithi172 ceph-mon[103574]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:58:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:58:24.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:58:24.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:24.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:24 smithi172 ceph-mon[103574]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:24 smithi158 ceph-mon[103317]: osdmap e15: 2 total, 2 up, 2 in 2023-10-18T13:58:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:24 smithi158 ceph-mon[103317]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:58:24.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:58:24.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:58:24.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:24.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:24 smithi158 ceph-mon[103317]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:24.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:24 smithi114 ceph-mon[99494]: osdmap e15: 2 total, 2 up, 2 in 2023-10-18T13:58:24.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:24 smithi114 ceph-mon[99494]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:58:24.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:58:24.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:58:24.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:24.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:24 smithi114 ceph-mon[99494]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:26.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:26 smithi114 ceph-mon[99494]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:26.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:26 smithi114 ceph-mon[99494]: from='client.? 172.21.15.172:0/1912846756' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80de4181-f876-479e-a082-21a042f58b09"}]: dispatch 2023-10-18T13:58:26.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:26 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80de4181-f876-479e-a082-21a042f58b09"}]: dispatch 2023-10-18T13:58:26.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:26 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80de4181-f876-479e-a082-21a042f58b09"}]': finished 2023-10-18T13:58:26.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:26 smithi114 ceph-mon[99494]: osdmap e16: 3 total, 2 up, 3 in 2023-10-18T13:58:26.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:26.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:26 smithi114 ceph-mon[99494]: from='client.? 172.21.15.172:0/2128930659' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:58:27.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:26 smithi158 ceph-mon[103317]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:27.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:26 smithi158 ceph-mon[103317]: from='client.? 172.21.15.172:0/1912846756' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80de4181-f876-479e-a082-21a042f58b09"}]: dispatch 2023-10-18T13:58:27.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:26 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80de4181-f876-479e-a082-21a042f58b09"}]: dispatch 2023-10-18T13:58:27.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:26 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80de4181-f876-479e-a082-21a042f58b09"}]': finished 2023-10-18T13:58:27.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:26 smithi158 ceph-mon[103317]: osdmap e16: 3 total, 2 up, 3 in 2023-10-18T13:58:27.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:27.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:26 smithi158 ceph-mon[103317]: from='client.? 172.21.15.172:0/2128930659' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:58:27.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:26 smithi172 ceph-mon[103574]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:27.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:26 smithi172 ceph-mon[103574]: from='client.? 172.21.15.172:0/1912846756' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80de4181-f876-479e-a082-21a042f58b09"}]: dispatch 2023-10-18T13:58:27.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:26 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80de4181-f876-479e-a082-21a042f58b09"}]: dispatch 2023-10-18T13:58:27.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:26 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80de4181-f876-479e-a082-21a042f58b09"}]': finished 2023-10-18T13:58:27.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:26 smithi172 ceph-mon[103574]: osdmap e16: 3 total, 2 up, 3 in 2023-10-18T13:58:27.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:27.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:26 smithi172 ceph-mon[103574]: from='client.? 172.21.15.172:0/2128930659' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:58:28.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:28 smithi114 ceph-mon[99494]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:28 smithi158 ceph-mon[103317]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:29.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:28 smithi172 ceph-mon[103574]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:30.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:30 smithi114 ceph-mon[99494]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:30.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:30 smithi172 ceph-mon[103574]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:31.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:30 smithi158 ceph-mon[103317]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:32.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:32 smithi114 ceph-mon[99494]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:32.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:32 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-18T13:58:32.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:32 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:32.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:32 smithi172 ceph-mon[103574]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:32.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:32 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-18T13:58:32.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:32 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:32 smithi158 ceph-mon[103317]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:32 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-18T13:58:33.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:32 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:33.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:33 smithi114 ceph-mon[99494]: Deploying daemon osd.2 on smithi172 2023-10-18T13:58:34.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:33 smithi158 ceph-mon[103317]: Deploying daemon osd.2 on smithi172 2023-10-18T13:58:34.036 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:33 smithi172 ceph-mon[103574]: Deploying daemon osd.2 on smithi172 2023-10-18T13:58:34.722 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:34 smithi172 ceph-mon[103574]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:34.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:34 smithi114 ceph-mon[99494]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:35.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:34 smithi158 ceph-mon[103317]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:36.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:36 smithi114 ceph-mon[99494]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:36.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:36 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:36.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:36 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:36.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:36 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:36.996 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:36 smithi172 ceph-mon[103574]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:36.997 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:36 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:36.997 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:36 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:36.997 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:36 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:37.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:36 smithi158 ceph-mon[103317]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:37.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:36 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:37.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:36 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:37.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:36 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:38.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:38 smithi114 ceph-mon[99494]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:38.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:38.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:38.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:38.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:38.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:38.868 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:38 smithi172 ceph-mon[103574]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:38.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:38.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:38.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:38.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:38.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:39.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:38 smithi158 ceph-mon[103317]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:39.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:39.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:39.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:39.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:39.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:39.210 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:39.207+0000 7f9b93fff700 1 -- 172.21.15.172:0/2276040303 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9bac197ea0 con 0x7f9b940a1440 2023-10-18T13:58:39.211 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 2 on host 'smithi172' 2023-10-18T13:58:39.213 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:39.209+0000 7f9bb11bb700 1 -- 172.21.15.172:0/2276040303 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9b940a1440 msgr2=0x7f9b940a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:58:39.213 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:39.209+0000 7f9bb11bb700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9b940a1440 0x7f9b940a3900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009a10 tx=0x7f9ba0009190 comp rx=0 tx=0).stop 2023-10-18T13:58:39.213 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:39.209+0000 7f9bb11bb700 1 -- 172.21.15.172:0/2276040303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac100390 msgr2=0x7f9bac19cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:58:39.213 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:39.209+0000 7f9bb11bb700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac100390 0x7f9bac19cde0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00d950 tx=0x7f9b9c00dc60 comp rx=0 tx=0).stop 2023-10-18T13:58:39.213 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:39.209+0000 7f9bb11bb700 1 -- 172.21.15.172:0/2276040303 shutdown_connections 2023-10-18T13:58:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:39.209+0000 7f9bb11bb700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9b940a1440 0x7f9b940a3900 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:39.209+0000 7f9bb11bb700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bac104710 0x7f9bac1969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:39.209+0000 7f9bb11bb700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bac0ff9d0 0x7f9bac19c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:39.209+0000 7f9bb11bb700 1 --2- 172.21.15.172:0/2276040303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac100390 0x7f9bac19cde0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:39.209+0000 7f9bb11bb700 1 -- 172.21.15.172:0/2276040303 >> 172.21.15.172:0/2276040303 conn(0x7f9bac0765b0 msgr2=0x7f9bac0691c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:58:39.215 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:39.209+0000 7f9bb11bb700 1 -- 172.21.15.172:0/2276040303 shutdown_connections 2023-10-18T13:58:39.215 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:58:39.209+0000 7f9bb11bb700 1 -- 172.21.15.172:0/2276040303 wait complete. 2023-10-18T13:58:39.612 DEBUG:teuthology.orchestra.run.smithi172:osd.2> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.2.service 2023-10-18T13:58:39.614 INFO:tasks.cephadm:Deploying osd.3 on smithi114 with /dev/vg_nvme/lv_3... 2023-10-18T13:58:39.615 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-18T13:58:39.645 INFO:journalctl@ceph.osd.2.smithi172.stdout:-- Logs begin at Wed 2023-10-18 13:40:49 UTC. -- 2023-10-18T13:58:40.184 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:58:40.377 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:40 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:40.377 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:40 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:40.377 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:40 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:40.377 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:40 smithi172 ceph-mon[103574]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:40.378 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 13:58:40 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-2[110722]: 2023-10-18T13:58:40.295+0000 7fa9a56dd640 -1 osd.2 0 log_to_monitors true 2023-10-18T13:58:40.451 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:40 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:40.451 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:40 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:40.451 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:40 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:40.451 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:40 smithi114 ceph-mon[99494]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:40.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:40 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:40.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:40 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:40.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:40 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:40.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:40 smithi158 ceph-mon[103317]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:41.270 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:41 smithi114 ceph-mon[99494]: from='osd.2 [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-18T13:58:41.271 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:41 smithi114 ceph-mon[99494]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-18T13:58:41.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:41 smithi158 ceph-mon[103317]: from='osd.2 [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-18T13:58:41.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:41 smithi158 ceph-mon[103317]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-18T13:58:41.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:41 smithi172 ceph-mon[103574]: from='osd.2 [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-18T13:58:41.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:41 smithi172 ceph-mon[103574]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-18T13:58:41.756 INFO:teuthology.orchestra.run.smithi114.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-18T13:58:41.757 INFO:teuthology.orchestra.run.smithi114.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-18T13:58:41.757 INFO:teuthology.orchestra.run.smithi114.stderr: stderr: 10+0 records in 2023-10-18T13:58:41.757 INFO:teuthology.orchestra.run.smithi114.stderr:10+0 records out 2023-10-18T13:58:41.757 INFO:teuthology.orchestra.run.smithi114.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125083 s, 838 MB/s 2023-10-18T13:58:41.758 INFO:teuthology.orchestra.run.smithi114.stderr:--> Zapping successful for: 2023-10-18T13:58:42.232 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi114:vg_nvme/lv_3 2023-10-18T13:58:42.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:42 smithi158 ceph-mon[103317]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-18T13:58:42.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:42 smithi158 ceph-mon[103317]: from='osd.2 [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T13:58:42.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:42 smithi158 ceph-mon[103317]: osdmap e17: 3 total, 2 up, 3 in 2023-10-18T13:58:42.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:42.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:42 smithi158 ceph-mon[103317]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T13:58:42.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:42 smithi158 ceph-mon[103317]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:42.559 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 13:58:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-2[110722]: 2023-10-18T13:58:42.214+0000 7fa99ad54700 -1 osd.2 0 waiting for initial osdmap 2023-10-18T13:58:42.560 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 13:58:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-2[110722]: 2023-10-18T13:58:42.220+0000 7fa994344700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T13:58:42.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:42 smithi172 ceph-mon[103574]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-18T13:58:42.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:42 smithi172 ceph-mon[103574]: from='osd.2 [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T13:58:42.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:42 smithi172 ceph-mon[103574]: osdmap e17: 3 total, 2 up, 3 in 2023-10-18T13:58:42.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:42.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:42 smithi172 ceph-mon[103574]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T13:58:42.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:42 smithi172 ceph-mon[103574]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:42.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:42 smithi114 ceph-mon[99494]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-18T13:58:42.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:42 smithi114 ceph-mon[99494]: from='osd.2 [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T13:58:42.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:42 smithi114 ceph-mon[99494]: osdmap e17: 3 total, 2 up, 3 in 2023-10-18T13:58:42.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:42.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:42 smithi114 ceph-mon[99494]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T13:58:42.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:42 smithi114 ceph-mon[99494]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:42.797 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:58:43.322 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:43 smithi114 ceph-mon[99494]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-10-18T13:58:43.323 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:43 smithi114 ceph-mon[99494]: osdmap e18: 3 total, 2 up, 3 in 2023-10-18T13:58:43.323 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:43.323 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:43.323 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:43 smithi114 ceph-mon[99494]: Detected new or changed devices on smithi172 2023-10-18T13:58:43.324 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:43.324 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:43.324 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:58:43.324 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:43 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi172 to 17168M 2023-10-18T13:58:43.324 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:43.325 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:43.325 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:43.325 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:43.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:43 smithi158 ceph-mon[103317]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-10-18T13:58:43.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:43 smithi158 ceph-mon[103317]: osdmap e18: 3 total, 2 up, 3 in 2023-10-18T13:58:43.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:43.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:43.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:43 smithi158 ceph-mon[103317]: Detected new or changed devices on smithi172 2023-10-18T13:58:43.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:43.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:43.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:58:43.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:43 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi172 to 17168M 2023-10-18T13:58:43.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:43.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:43.524 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:43.524 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:43.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:43 smithi172 ceph-mon[103574]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-10-18T13:58:43.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:43 smithi172 ceph-mon[103574]: osdmap e18: 3 total, 2 up, 3 in 2023-10-18T13:58:43.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:43.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:43.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:43 smithi172 ceph-mon[103574]: Detected new or changed devices on smithi172 2023-10-18T13:58:43.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:43.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:43.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:58:43.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:43 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi172 to 17168M 2023-10-18T13:58:43.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:43.562 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:43.562 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:58:43.562 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:44.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.002+0000 7fb6a28c3700 1 -- 172.21.15.114:0/735361511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb69c0ff6e0 msgr2=0x7fb69c0ffb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:58:44.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.002+0000 7fb6a28c3700 1 --2- 172.21.15.114:0/735361511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb69c0ff6e0 0x7fb69c0ffb60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb684009990 tx=0x7fb684009ca0 comp rx=0 tx=0).stop 2023-10-18T13:58:44.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.002+0000 7fb6a28c3700 1 -- 172.21.15.114:0/735361511 shutdown_connections 2023-10-18T13:58:44.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.002+0000 7fb6a28c3700 1 --2- 172.21.15.114:0/735361511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb69c1000a0 0x7fb69c10c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:44.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.002+0000 7fb6a28c3700 1 --2- 172.21.15.114:0/735361511 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb69c1045b0 0x7fb69c104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:44.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.002+0000 7fb6a28c3700 1 --2- 172.21.15.114:0/735361511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb69c0ff6e0 0x7fb69c0ffb60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:44.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.002+0000 7fb6a28c3700 1 -- 172.21.15.114:0/735361511 >> 172.21.15.114:0/735361511 conn(0x7fb69c0766c0 msgr2=0x7fb69c076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:58:44.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.002+0000 7fb6a28c3700 1 -- 172.21.15.114:0/735361511 shutdown_connections 2023-10-18T13:58:44.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.002+0000 7fb6a28c3700 1 -- 172.21.15.114:0/735361511 wait complete. 2023-10-18T13:58:44.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.003+0000 7fb6a28c3700 1 Processor -- start 2023-10-18T13:58:44.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.003+0000 7fb6a28c3700 1 -- start start 2023-10-18T13:58:44.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.003+0000 7fb6a28c3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb69c0ff6e0 0x7fb69c19b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:58:44.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.003+0000 7fb6a28c3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb69c1000a0 0x7fb69c19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:58:44.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.003+0000 7fb6a28c3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb69c1045b0 0x7fb69c195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:58:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.003+0000 7fb6a28c3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c195f90 con 0x7fb69c1045b0 2023-10-18T13:58:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.003+0000 7fb6a28c3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c196100 con 0x7fb69c1000a0 2023-10-18T13:58:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.003+0000 7fb6a28c3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c1962c0 con 0x7fb69c0ff6e0 2023-10-18T13:58:44.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.003+0000 7fb6a0e60700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb69c1045b0 0x7fb69c195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:58:44.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.003+0000 7fb6a0e60700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb69c1045b0 0x7fb69c195930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41554/0 (socket says 172.21.15.114:41554) 2023-10-18T13:58:44.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.003+0000 7fb6a0e60700 1 -- 172.21.15.114:0/2013847524 learned_addr learned my addr 172.21.15.114:0/2013847524 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:58:44.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.004+0000 7fb69b7fe700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb69c1000a0 0x7fb69c19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:58:44.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.004+0000 7fb69bfff700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb69c0ff6e0 0x7fb69c19b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:58:44.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.004+0000 7fb6a0e60700 1 -- 172.21.15.114:0/2013847524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb69c0ff6e0 msgr2=0x7fb69c19b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:58:44.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.004+0000 7fb6a0e60700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb69c0ff6e0 0x7fb69c19b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:44.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.004+0000 7fb6a0e60700 1 -- 172.21.15.114:0/2013847524 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb69c1000a0 msgr2=0x7fb69c19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:58:44.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.004+0000 7fb6a0e60700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb69c1000a0 0x7fb69c19bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:58:44.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.004+0000 7fb6a0e60700 1 -- 172.21.15.114:0/2013847524 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840095f0 con 0x7fb69c1045b0 2023-10-18T13:58:44.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.004+0000 7fb6a0e60700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb69c1045b0 0x7fb69c195930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb694007ee0 tx=0x7fb69400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:58:44.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.004+0000 7fb6997fa700 1 -- 172.21.15.114:0/2013847524 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb694017070 con 0x7fb69c1045b0 2023-10-18T13:58:44.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.004+0000 7fb6997fa700 1 -- 172.21.15.114:0/2013847524 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb69400f040 con 0x7fb69c1045b0 2023-10-18T13:58:44.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.004+0000 7fb6a28c3700 1 -- 172.21.15.114:0/2013847524 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69c1965a0 con 0x7fb69c1045b0 2023-10-18T13:58:44.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.004+0000 7fb6997fa700 1 -- 172.21.15.114:0/2013847524 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb694005580 con 0x7fb69c1045b0 2023-10-18T13:58:44.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.004+0000 7fb6a28c3700 1 -- 172.21.15.114:0/2013847524 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69c1a27e0 con 0x7fb69c1045b0 2023-10-18T13:58:44.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.005+0000 7fb6a28c3700 1 -- 172.21.15.114:0/2013847524 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69c107c20 con 0x7fb69c1045b0 2023-10-18T13:58:44.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.006+0000 7fb6997fa700 1 -- 172.21.15.114:0/2013847524 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fb69400db20 con 0x7fb69c1045b0 2023-10-18T13:58:44.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.007+0000 7fb6997fa700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb6880a14c0 0x7fb6880a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:58:44.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.007+0000 7fb69bfff700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb6880a14c0 0x7fb6880a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:58:44.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.007+0000 7fb6997fa700 1 -- 172.21.15.114:0/2013847524 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3066+0+0 (secure 0 0 0) 0x7fb6940cb580 con 0x7fb69c1045b0 2023-10-18T13:58:44.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.007+0000 7fb69bfff700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb6880a14c0 0x7fb6880a3980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb68c005950 tx=0x7fb68c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:58:44.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.011+0000 7fb6997fa700 1 -- 172.21.15.114:0/2013847524 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb6940960a0 con 0x7fb69c1045b0 2023-10-18T13:58:44.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:44.209+0000 7fb6a28c3700 1 -- 172.21.15.114:0/2013847524 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb69c196df0 con 0x7fb6880a14c0 2023-10-18T13:58:44.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:44 smithi158 ceph-mon[103317]: purged_snaps scrub starts 2023-10-18T13:58:44.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:44 smithi158 ceph-mon[103317]: purged_snaps scrub ok 2023-10-18T13:58:44.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:44 smithi158 ceph-mon[103317]: osd.2 [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113] boot 2023-10-18T13:58:44.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:44 smithi158 ceph-mon[103317]: osdmap e19: 3 total, 3 up, 3 in 2023-10-18T13:58:44.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:44 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:44.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:44 smithi158 ceph-mon[103317]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:44.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:44 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-18T13:58:44.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:44 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:58:44.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:44 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:58:44.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:44 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:44.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:44 smithi172 ceph-mon[103574]: purged_snaps scrub starts 2023-10-18T13:58:44.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:44 smithi172 ceph-mon[103574]: purged_snaps scrub ok 2023-10-18T13:58:44.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:44 smithi172 ceph-mon[103574]: osd.2 [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113] boot 2023-10-18T13:58:44.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:44 smithi172 ceph-mon[103574]: osdmap e19: 3 total, 3 up, 3 in 2023-10-18T13:58:44.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:44 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:44.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:44 smithi172 ceph-mon[103574]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:44.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:44 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-18T13:58:44.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:44 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:58:44.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:44 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:58:44.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:44 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:44.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:44 smithi114 ceph-mon[99494]: purged_snaps scrub starts 2023-10-18T13:58:44.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:44 smithi114 ceph-mon[99494]: purged_snaps scrub ok 2023-10-18T13:58:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:44 smithi114 ceph-mon[99494]: osd.2 [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113] boot 2023-10-18T13:58:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:44 smithi114 ceph-mon[99494]: osdmap e19: 3 total, 3 up, 3 in 2023-10-18T13:58:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:44 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-18T13:58:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:44 smithi114 ceph-mon[99494]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-18T13:58:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:44 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-18T13:58:44.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:44 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:58:44.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:44 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:58:44.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:44 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:45.320 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:45 smithi114 ceph-mon[99494]: from='client.14481 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:58:45.321 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-18T13:58:45.321 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:45 smithi114 ceph-mon[99494]: osdmap e20: 3 total, 3 up, 3 in 2023-10-18T13:58:45.321 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-18T13:58:45.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:45 smithi158 ceph-mon[103317]: from='client.14481 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:58:45.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-18T13:58:45.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:45 smithi158 ceph-mon[103317]: osdmap e20: 3 total, 3 up, 3 in 2023-10-18T13:58:45.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-18T13:58:45.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:45 smithi172 ceph-mon[103574]: from='client.14481 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:58:45.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-18T13:58:45.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:45 smithi172 ceph-mon[103574]: osdmap e20: 3 total, 3 up, 3 in 2023-10-18T13:58:45.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-18T13:58:45.839 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 13:58:45 smithi114 sudo[130252]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-18T13:58:45.839 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 13:58:45 smithi114 sudo[130252]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-18T13:58:45.839 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 13:58:45 smithi114 sudo[130252]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-18T13:58:45.839 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 13:58:45 smithi114 sudo[130252]: pam_unix(sudo:session): session closed for user root 2023-10-18T13:58:46.249 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 13:58:45 smithi114 sudo[130289]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-18T13:58:46.249 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 13:58:45 smithi114 sudo[130289]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-18T13:58:46.249 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 13:58:45 smithi114 sudo[130289]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-18T13:58:46.249 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 13:58:45 smithi114 sudo[130289]: pam_unix(sudo:session): session closed for user root 2023-10-18T13:58:46.380 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:46 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-18T13:58:46.381 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:46 smithi158 ceph-mon[103317]: osdmap e21: 3 total, 3 up, 3 in 2023-10-18T13:58:46.381 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:46 smithi158 ceph-mon[103317]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:58:46.381 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:46 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:46.382 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 13:58:46 smithi158 sudo[114347]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-18T13:58:46.382 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 13:58:46 smithi158 sudo[114347]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-18T13:58:46.382 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 13:58:46 smithi158 sudo[114347]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-18T13:58:46.382 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 13:58:46 smithi158 sudo[114347]: pam_unix(sudo:session): session closed for user root 2023-10-18T13:58:46.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:46 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-18T13:58:46.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:46 smithi172 ceph-mon[103574]: osdmap e21: 3 total, 3 up, 3 in 2023-10-18T13:58:46.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:46 smithi172 ceph-mon[103574]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:58:46.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:46 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:46.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:46 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-18T13:58:46.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:46 smithi114 ceph-mon[99494]: osdmap e21: 3 total, 3 up, 3 in 2023-10-18T13:58:46.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:46 smithi114 ceph-mon[99494]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:58:46.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:46 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:46.771 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 13:58:46 smithi158 sudo[114350]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-18T13:58:46.771 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 13:58:46 smithi158 sudo[114350]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-18T13:58:46.771 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 13:58:46 smithi158 sudo[114350]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-18T13:58:46.772 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 13:58:46 smithi158 sudo[114350]: pam_unix(sudo:session): session closed for user root 2023-10-18T13:58:46.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:58:46.890+0000 7fb6997fa700 1 -- 172.21.15.114:0/2013847524 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fb694096470 con 0x7fb69c1045b0 2023-10-18T13:58:46.904 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 13:58:46 smithi172 sudo[116144]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-18T13:58:46.904 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 13:58:46 smithi172 sudo[116144]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-18T13:58:46.904 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 13:58:46 smithi172 sudo[116144]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-18T13:58:46.904 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 13:58:46 smithi172 sudo[116144]: pam_unix(sudo:session): session closed for user root 2023-10-18T13:58:47.309 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 13:58:46 smithi172 sudo[116147]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-18T13:58:47.310 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 13:58:46 smithi172 sudo[116147]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-18T13:58:47.310 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 13:58:46 smithi172 sudo[116147]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-18T13:58:47.310 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 13:58:46 smithi172 sudo[116147]: pam_unix(sudo:session): session closed for user root 2023-10-18T13:58:47.424 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 sudo[130374]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-18T13:58:47.424 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 sudo[130374]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-18T13:58:47.424 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 sudo[130374]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-18T13:58:47.424 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 sudo[130374]: pam_unix(sudo:session): session closed for user root 2023-10-18T13:58:47.683 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 ceph-mon[103574]: osdmap e22: 3 total, 3 up, 3 in 2023-10-18T13:58:47.684 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:47.684 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3331023470' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3dd2a81b-67be-449d-89e7-cbd3dd2f010b"}]: dispatch 2023-10-18T13:58:47.684 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3331023470' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3dd2a81b-67be-449d-89e7-cbd3dd2f010b"}]': finished 2023-10-18T13:58:47.684 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 ceph-mon[103574]: osdmap e23: 4 total, 3 up, 4 in 2023-10-18T13:58:47.685 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:58:47.685 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 ceph-mon[103574]: mgrmap e20: x(active, since 99s), standbys: z, y 2023-10-18T13:58:47.685 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:47.685 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 ceph-mon[103574]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-18T13:58:47.685 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 sudo[116150]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-18T13:58:47.686 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 sudo[116150]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-18T13:58:47.686 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 sudo[116150]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-18T13:58:47.686 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 sudo[116150]: pam_unix(sudo:session): session closed for user root 2023-10-18T13:58:47.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:47 smithi158 ceph-mon[103317]: osdmap e22: 3 total, 3 up, 3 in 2023-10-18T13:58:47.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:47 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:47.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:47 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3331023470' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3dd2a81b-67be-449d-89e7-cbd3dd2f010b"}]: dispatch 2023-10-18T13:58:47.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:47 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3331023470' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3dd2a81b-67be-449d-89e7-cbd3dd2f010b"}]': finished 2023-10-18T13:58:47.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:47 smithi158 ceph-mon[103317]: osdmap e23: 4 total, 3 up, 4 in 2023-10-18T13:58:47.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:47 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:58:47.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:47 smithi158 ceph-mon[103317]: mgrmap e20: x(active, since 99s), standbys: z, y 2023-10-18T13:58:47.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:47 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:47.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:47 smithi158 ceph-mon[103317]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-18T13:58:47.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 sudo[130377]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-18T13:58:47.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 sudo[130377]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-18T13:58:47.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 sudo[130377]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-18T13:58:47.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 sudo[130377]: pam_unix(sudo:session): session closed for user root 2023-10-18T13:58:47.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 ceph-mon[99494]: osdmap e22: 3 total, 3 up, 3 in 2023-10-18T13:58:47.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:47.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3331023470' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3dd2a81b-67be-449d-89e7-cbd3dd2f010b"}]: dispatch 2023-10-18T13:58:47.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3331023470' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3dd2a81b-67be-449d-89e7-cbd3dd2f010b"}]': finished 2023-10-18T13:58:47.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 ceph-mon[99494]: osdmap e23: 4 total, 3 up, 4 in 2023-10-18T13:58:47.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:58:47.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 ceph-mon[99494]: mgrmap e20: x(active, since 99s), standbys: z, y 2023-10-18T13:58:47.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:47.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:47 smithi114 ceph-mon[99494]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-18T13:58:48.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 sudo[116153]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-18T13:58:48.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 sudo[116153]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-18T13:58:48.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 sudo[116153]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-18T13:58:48.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:47 smithi172 sudo[116153]: pam_unix(sudo:session): session closed for user root 2023-10-18T13:58:48.416 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 sudo[114353]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-18T13:58:48.416 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 sudo[114353]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-18T13:58:48.416 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 sudo[114353]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-18T13:58:48.416 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 sudo[114353]: pam_unix(sudo:session): session closed for user root 2023-10-18T13:58:48.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 sudo[114356]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-18T13:58:48.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 sudo[114356]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-18T13:58:48.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 sudo[114356]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-18T13:58:48.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 sudo[114356]: pam_unix(sudo:session): session closed for user root 2023-10-18T13:58:48.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-18T13:58:48.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:58:48.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:58:48.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:58:48.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-18T13:58:48.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:58:48.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:58:48.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:58:48.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:58:48.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1798423410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:58:48.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-18T13:58:48.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-18T13:58:48.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:58:48.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:58:48.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:58:48.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:48 smithi158 ceph-mon[103317]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-18T13:58:48.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-18T13:58:48.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:58:48.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:58:48.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:58:48.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-18T13:58:48.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:58:48.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:58:48.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:58:48.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:58:48.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1798423410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:58:48.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-18T13:58:48.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-18T13:58:48.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:58:48.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:58:48.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:58:48.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:48 smithi172 ceph-mon[103574]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-18T13:58:48.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-18T13:58:48.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:58:48.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:58:48.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:58:48.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-18T13:58:48.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:58:48.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:58:48.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:58:48.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:58:48.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1798423410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:58:48.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-18T13:58:48.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-18T13:58:48.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-18T13:58:48.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-18T13:58:48.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-18T13:58:48.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:48 smithi114 ceph-mon[99494]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-18T13:58:50.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:50 smithi114 ceph-mon[99494]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:58:51.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:50 smithi158 ceph-mon[103317]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:58:51.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:50 smithi172 ceph-mon[103574]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:58:52.749 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:52 smithi114 ceph-mon[99494]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:58:53.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:52 smithi158 ceph-mon[103317]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:58:53.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:52 smithi172 ceph-mon[103574]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:58:54.428 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:54 smithi114 ceph-mon[99494]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-10-18T13:58:54.428 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:54 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-18T13:58:54.429 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:54 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:54.429 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:54 smithi114 ceph-mon[99494]: Deploying daemon osd.3 on smithi114 2023-10-18T13:58:54.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:54 smithi158 ceph-mon[103317]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-10-18T13:58:54.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:54 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-18T13:58:54.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:54 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:54.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:54 smithi158 ceph-mon[103317]: Deploying daemon osd.3 on smithi114 2023-10-18T13:58:54.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:54 smithi172 ceph-mon[103574]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-10-18T13:58:54.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:54 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-18T13:58:54.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:54 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:58:54.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:54 smithi172 ceph-mon[103574]: Deploying daemon osd.3 on smithi114 2023-10-18T13:58:56.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:56 smithi114 ceph-mon[99494]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-18T13:58:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:56 smithi158 ceph-mon[103317]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-18T13:58:57.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:56 smithi172 ceph-mon[103574]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-18T13:58:59.060 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:58 smithi114 ceph-mon[99494]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-18T13:58:59.061 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:58 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:59.061 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:58 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:59.061 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:58:58 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:59.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:58 smithi158 ceph-mon[103317]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-18T13:58:59.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:58 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:59.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:58 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:59.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:58:58 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:58:59.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:58 smithi172 ceph-mon[103574]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-18T13:58:59.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:58 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:59.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:58 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:58:59.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:58:58 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:00.608+0000 7fb6997fa700 1 -- 172.21.15.114:0/2013847524 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb69c196df0 con 0x7fb6880a14c0 2023-10-18T13:59:00.613 INFO:teuthology.orchestra.run.smithi114.stdout:Created osd(s) 3 on host 'smithi114' 2023-10-18T13:59:00.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:00.610+0000 7fb6a28c3700 1 -- 172.21.15.114:0/2013847524 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb6880a14c0 msgr2=0x7fb6880a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:00.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:00.610+0000 7fb6a28c3700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb6880a14c0 0x7fb6880a3980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb68c005950 tx=0x7fb68c00b410 comp rx=0 tx=0).stop 2023-10-18T13:59:00.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:00.610+0000 7fb6a28c3700 1 -- 172.21.15.114:0/2013847524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb69c1045b0 msgr2=0x7fb69c195930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:00.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:00.610+0000 7fb6a28c3700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb69c1045b0 0x7fb69c195930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb694007ee0 tx=0x7fb69400d3b0 comp rx=0 tx=0).stop 2023-10-18T13:59:00.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:00.611+0000 7fb6a28c3700 1 -- 172.21.15.114:0/2013847524 shutdown_connections 2023-10-18T13:59:00.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:00.611+0000 7fb6a28c3700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb6880a14c0 0x7fb6880a3980 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:00.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:00.611+0000 7fb6a28c3700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb69c1045b0 0x7fb69c195930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:00.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:00.611+0000 7fb6a28c3700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb69c0ff6e0 0x7fb69c19b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:00.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:00.611+0000 7fb6a28c3700 1 --2- 172.21.15.114:0/2013847524 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb69c1000a0 0x7fb69c19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:00.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:00.611+0000 7fb6a28c3700 1 -- 172.21.15.114:0/2013847524 >> 172.21.15.114:0/2013847524 conn(0x7fb69c0766c0 msgr2=0x7fb69c0fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:59:00.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:00.611+0000 7fb6a28c3700 1 -- 172.21.15.114:0/2013847524 shutdown_connections 2023-10-18T13:59:00.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:00.611+0000 7fb6a28c3700 1 -- 172.21.15.114:0/2013847524 wait complete. 2023-10-18T13:59:01.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:00 smithi114 ceph-mon[99494]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-18T13:59:01.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:00 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:00 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:00 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:01.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:00 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:01.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:00 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:00 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:00 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:00 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:01.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:00 smithi158 ceph-mon[103317]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-18T13:59:01.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:00 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:00 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:00 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:01.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:00 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:01.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:00 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:00 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:00 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:00 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:01.280 DEBUG:teuthology.orchestra.run.smithi114:osd.3> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.3.service 2023-10-18T13:59:01.283 INFO:tasks.cephadm:Deploying osd.4 on smithi158 with /dev/vg_nvme/lv_3... 2023-10-18T13:59:01.283 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-18T13:59:01.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:00 smithi172 ceph-mon[103574]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-18T13:59:01.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:00 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:00 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:00 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:01.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:00 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:01.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:00 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:00 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:00 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:01.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:00 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:01.312 INFO:journalctl@ceph.osd.3.smithi114.stdout:-- Logs begin at Wed 2023-10-18 13:40:26 UTC. -- 2023-10-18T13:59:01.857 INFO:teuthology.orchestra.run.smithi158.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-18T13:59:02.013 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:01 smithi114 ceph-mon[99494]: from='osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-18T13:59:02.014 INFO:journalctl@ceph.osd.3.smithi114.stdout:Oct 18 13:59:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-3[132576]: 2023-10-18T13:59:01.712+0000 7f0e855cc640 -1 osd.3 0 log_to_monitors true 2023-10-18T13:59:02.100 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:01 smithi158 ceph-mon[103317]: from='osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-18T13:59:02.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:01 smithi172 ceph-mon[103574]: from='osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-18T13:59:03.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:02 smithi158 ceph-mon[103317]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-18T13:59:03.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:02 smithi158 ceph-mon[103317]: from='osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-18T13:59:03.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:02 smithi158 ceph-mon[103317]: osdmap e24: 4 total, 3 up, 4 in 2023-10-18T13:59:03.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:02 smithi158 ceph-mon[103317]: from='osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2023-10-18T13:59:03.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:02 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:59:03.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:02 smithi114 ceph-mon[99494]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-18T13:59:03.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:02 smithi114 ceph-mon[99494]: from='osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-18T13:59:03.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:02 smithi114 ceph-mon[99494]: osdmap e24: 4 total, 3 up, 4 in 2023-10-18T13:59:03.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:02 smithi114 ceph-mon[99494]: from='osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2023-10-18T13:59:03.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:02 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:59:03.090 INFO:journalctl@ceph.osd.3.smithi114.stdout:Oct 18 13:59:02 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-3[132576]: 2023-10-18T13:59:02.835+0000 7f0e7ac43700 -1 osd.3 0 waiting for initial osdmap 2023-10-18T13:59:03.090 INFO:journalctl@ceph.osd.3.smithi114.stdout:Oct 18 13:59:02 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-3[132576]: 2023-10-18T13:59:02.840+0000 7f0e74a34700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T13:59:03.246 INFO:teuthology.orchestra.run.smithi158.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-18T13:59:03.247 INFO:teuthology.orchestra.run.smithi158.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-18T13:59:03.247 INFO:teuthology.orchestra.run.smithi158.stderr: stderr: 10+0 records in 2023-10-18T13:59:03.247 INFO:teuthology.orchestra.run.smithi158.stderr:10+0 records out 2023-10-18T13:59:03.247 INFO:teuthology.orchestra.run.smithi158.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00806329 s, 1.3 GB/s 2023-10-18T13:59:03.248 INFO:teuthology.orchestra.run.smithi158.stderr:--> Zapping successful for: 2023-10-18T13:59:03.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:02 smithi172 ceph-mon[103574]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-18T13:59:03.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:02 smithi172 ceph-mon[103574]: from='osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-18T13:59:03.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:02 smithi172 ceph-mon[103574]: osdmap e24: 4 total, 3 up, 4 in 2023-10-18T13:59:03.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:02 smithi172 ceph-mon[103574]: from='osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2023-10-18T13:59:03.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:02 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:59:03.601 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi158:vg_nvme/lv_3 2023-10-18T13:59:04.032 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:03 smithi114 ceph-mon[99494]: from='osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2023-10-18T13:59:04.032 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:03 smithi114 ceph-mon[99494]: osdmap e25: 4 total, 3 up, 4 in 2023-10-18T13:59:04.032 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:59:04.032 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:59:04.033 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:03 smithi114 ceph-mon[99494]: osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386] boot 2023-10-18T13:59:04.033 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:03 smithi114 ceph-mon[99494]: osdmap e26: 4 total, 4 up, 4 in 2023-10-18T13:59:04.033 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:59:04.159 INFO:teuthology.orchestra.run.smithi158.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-18T13:59:04.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:03 smithi158 ceph-mon[103317]: from='osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2023-10-18T13:59:04.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:03 smithi158 ceph-mon[103317]: osdmap e25: 4 total, 3 up, 4 in 2023-10-18T13:59:04.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:59:04.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:59:04.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:03 smithi158 ceph-mon[103317]: osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386] boot 2023-10-18T13:59:04.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:03 smithi158 ceph-mon[103317]: osdmap e26: 4 total, 4 up, 4 in 2023-10-18T13:59:04.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:59:04.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:03 smithi172 ceph-mon[103574]: from='osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2023-10-18T13:59:04.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:03 smithi172 ceph-mon[103574]: osdmap e25: 4 total, 3 up, 4 in 2023-10-18T13:59:04.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:59:04.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:59:04.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:03 smithi172 ceph-mon[103574]: osd.3 [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386] boot 2023-10-18T13:59:04.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:03 smithi172 ceph-mon[103574]: osdmap e26: 4 total, 4 up, 4 in 2023-10-18T13:59:04.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-18T13:59:05.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:04 smithi158 ceph-mon[103317]: purged_snaps scrub starts 2023-10-18T13:59:05.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:04 smithi158 ceph-mon[103317]: purged_snaps scrub ok 2023-10-18T13:59:05.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:04 smithi158 ceph-mon[103317]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:59:05.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:04 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:05.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:04 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:05.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:04 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:05.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:04 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:05.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:04 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:05.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:04 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:05.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:04 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:05.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:04 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:05.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:04 smithi158 ceph-mon[103317]: osdmap e27: 4 total, 4 up, 4 in 2023-10-18T13:59:05.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:04 smithi172 ceph-mon[103574]: purged_snaps scrub starts 2023-10-18T13:59:05.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:04 smithi172 ceph-mon[103574]: purged_snaps scrub ok 2023-10-18T13:59:05.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:04 smithi172 ceph-mon[103574]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:59:05.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:04 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:05.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:04 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:05.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:04 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:05.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:04 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:05.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:04 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:05.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:04 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:05.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:04 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:05.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:04 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:05.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:04 smithi172 ceph-mon[103574]: osdmap e27: 4 total, 4 up, 4 in 2023-10-18T13:59:05.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:04 smithi114 ceph-mon[99494]: purged_snaps scrub starts 2023-10-18T13:59:05.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:04 smithi114 ceph-mon[99494]: purged_snaps scrub ok 2023-10-18T13:59:05.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:04 smithi114 ceph-mon[99494]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-18T13:59:05.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:04 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:05.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:04 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:05.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:04 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:05.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:04 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:05.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:04 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:05.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:04 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:05.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:04 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:05.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:04 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:05.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:04 smithi114 ceph-mon[99494]: osdmap e27: 4 total, 4 up, 4 in 2023-10-18T13:59:05.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.407+0000 7ff83267a700 1 -- 172.21.15.158:0/108208677 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff82c100110 msgr2=0x7ff82c10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:05.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.407+0000 7ff83267a700 1 --2- 172.21.15.158:0/108208677 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff82c100110 0x7ff82c10c580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff82400b0a0 tx=0x7ff82400b3b0 comp rx=0 tx=0).stop 2023-10-18T13:59:05.411 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.407+0000 7ff83267a700 1 -- 172.21.15.158:0/108208677 shutdown_connections 2023-10-18T13:59:05.412 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.407+0000 7ff83267a700 1 --2- 172.21.15.158:0/108208677 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff82c100110 0x7ff82c10c580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:05.412 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.407+0000 7ff83267a700 1 --2- 172.21.15.158:0/108208677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff82c1056b0 0x7ff82c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:05.412 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.407+0000 7ff83267a700 1 --2- 172.21.15.158:0/108208677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c0ff750 0x7ff82c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:05.412 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.407+0000 7ff83267a700 1 -- 172.21.15.158:0/108208677 >> 172.21.15.158:0/108208677 conn(0x7ff82c075790 msgr2=0x7ff82c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:59:05.412 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.407+0000 7ff83267a700 1 -- 172.21.15.158:0/108208677 shutdown_connections 2023-10-18T13:59:05.413 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.407+0000 7ff83267a700 1 -- 172.21.15.158:0/108208677 wait complete. 2023-10-18T13:59:05.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff83267a700 1 Processor -- start 2023-10-18T13:59:05.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff83267a700 1 -- start start 2023-10-18T13:59:05.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff83267a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff82c0ff750 0x7ff82c19c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:59:05.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff83267a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c100110 0x7ff82c19cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:59:05.415 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff83267a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff82c1056b0 0x7ff82c196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:59:05.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff83267a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c197270 con 0x7ff82c1056b0 2023-10-18T13:59:05.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff83267a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c1973e0 con 0x7ff82c0ff750 2023-10-18T13:59:05.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff83267a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c1975a0 con 0x7ff82c100110 2023-10-18T13:59:05.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff82bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff82c0ff750 0x7ff82c19c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:59:05.416 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff82bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff82c0ff750 0x7ff82c19c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35118/0 (socket says 172.21.15.158:35118) 2023-10-18T13:59:05.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff82bfff700 1 -- 172.21.15.158:0/3110491307 learned_addr learned my addr 172.21.15.158:0/3110491307 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T13:59:05.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff830c17700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff82c1056b0 0x7ff82c196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:59:05.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff82b7fe700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c100110 0x7ff82c19cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:59:05.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff82bfff700 1 -- 172.21.15.158:0/3110491307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c100110 msgr2=0x7ff82c19cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:05.417 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff82bfff700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c100110 0x7ff82c19cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:05.418 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff82bfff700 1 -- 172.21.15.158:0/3110491307 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff82c1056b0 msgr2=0x7ff82c196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:05.418 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff82bfff700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff82c1056b0 0x7ff82c196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:05.419 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.408+0000 7ff82bfff700 1 -- 172.21.15.158:0/3110491307 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff824009d00 con 0x7ff82c0ff750 2023-10-18T13:59:05.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.409+0000 7ff82bfff700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff82c0ff750 0x7ff82c19c9c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00e9a0 tx=0x7ff81c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:59:05.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.409+0000 7ff8297fa700 1 -- 172.21.15.158:0/3110491307 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c009790 con 0x7ff82c0ff750 2023-10-18T13:59:05.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.409+0000 7ff83267a700 1 -- 172.21.15.158:0/3110491307 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c1977c0 con 0x7ff82c0ff750 2023-10-18T13:59:05.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.409+0000 7ff8297fa700 1 -- 172.21.15.158:0/3110491307 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff81c00cbd0 con 0x7ff82c0ff750 2023-10-18T13:59:05.420 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.409+0000 7ff8297fa700 1 -- 172.21.15.158:0/3110491307 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c018680 con 0x7ff82c0ff750 2023-10-18T13:59:05.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.409+0000 7ff83267a700 1 -- 172.21.15.158:0/3110491307 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c10d050 con 0x7ff82c0ff750 2023-10-18T13:59:05.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.410+0000 7ff83267a700 1 -- 172.21.15.158:0/3110491307 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82c107c40 con 0x7ff82c0ff750 2023-10-18T13:59:05.421 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.411+0000 7ff8297fa700 1 -- 172.21.15.158:0/3110491307 <== mon.2 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7ff81c00cd40 con 0x7ff82c0ff750 2023-10-18T13:59:05.422 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.412+0000 7ff8297fa700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff8180a14d0 0x7ff8180a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:59:05.422 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.412+0000 7ff82b7fe700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff8180a14d0 0x7ff8180a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:59:05.422 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.412+0000 7ff8297fa700 1 -- 172.21.15.158:0/3110491307 <== mon.2 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3913+0+0 (secure 0 0 0) 0x7ff81c014070 con 0x7ff82c0ff750 2023-10-18T13:59:05.422 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.412+0000 7ff82b7fe700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff8180a14d0 0x7ff8180a3990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff82c1981e0 tx=0x7ff814005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:59:05.423 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.416+0000 7ff8297fa700 1 -- 172.21.15.158:0/3110491307 <== mon.2 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff81c052100 con 0x7ff82c0ff750 2023-10-18T13:59:05.619 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:05.615+0000 7ff83267a700 1 -- 172.21.15.158:0/3110491307 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff82c197f50 con 0x7ff8180a14d0 2023-10-18T13:59:06.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:05 smithi158 ceph-mon[103317]: Detected new or changed devices on smithi114 2023-10-18T13:59:06.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:05 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi114 to 8584M 2023-10-18T13:59:06.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:05 smithi158 ceph-mon[103317]: osdmap e28: 4 total, 4 up, 4 in 2023-10-18T13:59:06.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:05 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:59:06.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:05 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:59:06.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:05 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:06.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:05 smithi172 ceph-mon[103574]: Detected new or changed devices on smithi114 2023-10-18T13:59:06.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:05 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi114 to 8584M 2023-10-18T13:59:06.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:05 smithi172 ceph-mon[103574]: osdmap e28: 4 total, 4 up, 4 in 2023-10-18T13:59:06.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:05 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:59:06.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:05 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:59:06.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:05 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:06.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:05 smithi114 ceph-mon[99494]: Detected new or changed devices on smithi114 2023-10-18T13:59:06.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:05 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi114 to 8584M 2023-10-18T13:59:06.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:05 smithi114 ceph-mon[99494]: osdmap e28: 4 total, 4 up, 4 in 2023-10-18T13:59:06.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:05 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:59:06.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:05 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:59:06.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:05 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:07.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:06 smithi158 ceph-mon[103317]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:07.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:06 smithi158 ceph-mon[103317]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:59:07.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:06 smithi158 ceph-mon[103317]: osdmap e29: 4 total, 4 up, 4 in 2023-10-18T13:59:07.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:06 smithi172 ceph-mon[103574]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:07.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:06 smithi172 ceph-mon[103574]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:59:07.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:06 smithi172 ceph-mon[103574]: osdmap e29: 4 total, 4 up, 4 in 2023-10-18T13:59:07.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:06 smithi114 ceph-mon[99494]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:07.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:06 smithi114 ceph-mon[99494]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:59:07.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:06 smithi114 ceph-mon[99494]: osdmap e29: 4 total, 4 up, 4 in 2023-10-18T13:59:08.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:08 smithi158 ceph-mon[103317]: osdmap e30: 4 total, 4 up, 4 in 2023-10-18T13:59:08.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:08 smithi158 ceph-mon[103317]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:08.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:08 smithi158 ceph-mon[103317]: from='client.? 172.21.15.158:0/3593382024' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88faf89f-ba5c-4658-8744-a2dff1084f11"}]: dispatch 2023-10-18T13:59:08.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:08 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88faf89f-ba5c-4658-8744-a2dff1084f11"}]: dispatch 2023-10-18T13:59:08.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:08 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88faf89f-ba5c-4658-8744-a2dff1084f11"}]': finished 2023-10-18T13:59:08.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:08 smithi158 ceph-mon[103317]: osdmap e31: 5 total, 4 up, 5 in 2023-10-18T13:59:08.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:08.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:08 smithi172 ceph-mon[103574]: osdmap e30: 4 total, 4 up, 4 in 2023-10-18T13:59:08.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:08 smithi172 ceph-mon[103574]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:08.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:08 smithi172 ceph-mon[103574]: from='client.? 172.21.15.158:0/3593382024' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88faf89f-ba5c-4658-8744-a2dff1084f11"}]: dispatch 2023-10-18T13:59:08.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:08 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88faf89f-ba5c-4658-8744-a2dff1084f11"}]: dispatch 2023-10-18T13:59:08.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:08 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88faf89f-ba5c-4658-8744-a2dff1084f11"}]': finished 2023-10-18T13:59:08.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:08 smithi172 ceph-mon[103574]: osdmap e31: 5 total, 4 up, 5 in 2023-10-18T13:59:08.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:08.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:08 smithi114 ceph-mon[99494]: osdmap e30: 4 total, 4 up, 4 in 2023-10-18T13:59:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:08 smithi114 ceph-mon[99494]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:08 smithi114 ceph-mon[99494]: from='client.? 172.21.15.158:0/3593382024' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88faf89f-ba5c-4658-8744-a2dff1084f11"}]: dispatch 2023-10-18T13:59:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:08 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88faf89f-ba5c-4658-8744-a2dff1084f11"}]: dispatch 2023-10-18T13:59:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:08 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88faf89f-ba5c-4658-8744-a2dff1084f11"}]': finished 2023-10-18T13:59:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:08 smithi114 ceph-mon[99494]: osdmap e31: 5 total, 4 up, 5 in 2023-10-18T13:59:08.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:09.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:09 smithi158 ceph-mon[103317]: from='client.? 172.21.15.158:0/3152737825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:59:09.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:09 smithi172 ceph-mon[103574]: from='client.? 172.21.15.158:0/3152737825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:59:09.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:09 smithi114 ceph-mon[99494]: from='client.? 172.21.15.158:0/3152737825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:59:10.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:10 smithi158 ceph-mon[103317]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2023-10-18T13:59:10.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:10 smithi172 ceph-mon[103574]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2023-10-18T13:59:10.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:10 smithi114 ceph-mon[99494]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2023-10-18T13:59:12.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:12 smithi114 ceph-mon[99494]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-18T13:59:12.942 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:12 smithi158 ceph-mon[103317]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-18T13:59:13.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:12 smithi172 ceph-mon[103574]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-18T13:59:14.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:14 smithi158 ceph-mon[103317]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-18T13:59:14.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:14 smithi172 ceph-mon[103574]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-18T13:59:14.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:14 smithi114 ceph-mon[99494]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-18T13:59:15.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:15 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-18T13:59:15.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:15 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:15.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:15 smithi158 ceph-mon[103317]: Deploying daemon osd.4 on smithi158 2023-10-18T13:59:15.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:15 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-18T13:59:15.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:15 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:15.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:15 smithi172 ceph-mon[103574]: Deploying daemon osd.4 on smithi158 2023-10-18T13:59:15.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:15 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-18T13:59:15.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:15 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:15.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:15 smithi114 ceph-mon[99494]: Deploying daemon osd.4 on smithi158 2023-10-18T13:59:16.441 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:16 smithi158 ceph-mon[103317]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-18T13:59:16.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:16 smithi172 ceph-mon[103574]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-18T13:59:16.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:16 smithi114 ceph-mon[99494]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-18T13:59:18.639 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:18 smithi158 ceph-mon[103317]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-18T13:59:18.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:18 smithi114 ceph-mon[99494]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-18T13:59:19.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:18 smithi172 ceph-mon[103574]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-18T13:59:19.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:19 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:19.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:19 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:19.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:19 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:20.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:19 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:20.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:19 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:20.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:19 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:20.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:19 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:20.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:19 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:20.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:19 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:20.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:20 smithi158 ceph-mon[103317]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:21.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:20 smithi172 ceph-mon[103574]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:20 smithi114 ceph-mon[99494]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:21.280 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:21.276+0000 7ff8297fa700 1 -- 172.21.15.158:0/3110491307 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff82c197f50 con 0x7ff8180a14d0 2023-10-18T13:59:21.280 INFO:teuthology.orchestra.run.smithi158.stdout:Created osd(s) 4 on host 'smithi158' 2023-10-18T13:59:21.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:21.279+0000 7ff83267a700 1 -- 172.21.15.158:0/3110491307 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff8180a14d0 msgr2=0x7ff8180a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:21.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:21.279+0000 7ff83267a700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff8180a14d0 0x7ff8180a3990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff82c1981e0 tx=0x7ff814005d50 comp rx=0 tx=0).stop 2023-10-18T13:59:21.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:21.279+0000 7ff83267a700 1 -- 172.21.15.158:0/3110491307 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff82c0ff750 msgr2=0x7ff82c19c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:21.282 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:21.279+0000 7ff83267a700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff82c0ff750 0x7ff82c19c9c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00e9a0 tx=0x7ff81c00ecb0 comp rx=0 tx=0).stop 2023-10-18T13:59:21.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:21.279+0000 7ff83267a700 1 -- 172.21.15.158:0/3110491307 shutdown_connections 2023-10-18T13:59:21.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:21.279+0000 7ff83267a700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff8180a14d0 0x7ff8180a3990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:21.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:21.279+0000 7ff83267a700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff82c1056b0 0x7ff82c196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:21.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:21.279+0000 7ff83267a700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff82c0ff750 0x7ff82c19c9c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:21.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:21.279+0000 7ff83267a700 1 --2- 172.21.15.158:0/3110491307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c100110 0x7ff82c19cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:21.283 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:21.279+0000 7ff83267a700 1 -- 172.21.15.158:0/3110491307 >> 172.21.15.158:0/3110491307 conn(0x7ff82c075790 msgr2=0x7ff82c0fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:59:21.284 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:21.279+0000 7ff83267a700 1 -- 172.21.15.158:0/3110491307 shutdown_connections 2023-10-18T13:59:21.284 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T13:59:21.279+0000 7ff83267a700 1 -- 172.21.15.158:0/3110491307 wait complete. 2023-10-18T13:59:21.650 DEBUG:teuthology.orchestra.run.smithi158:osd.4> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.4.service 2023-10-18T13:59:21.652 INFO:tasks.cephadm:Deploying osd.5 on smithi172 with /dev/vg_nvme/lv_3... 2023-10-18T13:59:21.653 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-18T13:59:21.685 INFO:journalctl@ceph.osd.4.smithi158.stdout:-- Logs begin at Wed 2023-10-18 13:41:14 UTC. -- 2023-10-18T13:59:22.221 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T13:59:22.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:21 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:22.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:21 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:22.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:21 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:22.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:21 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:22.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:21 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:22.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:21 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:22.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:21 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:22.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:21 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:22.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:21 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:22.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:21 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:22.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:21 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:22.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:21 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:22.944 INFO:journalctl@ceph.osd.4.smithi158.stdout:Oct 18 13:59:22 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-4[117466]: 2023-10-18T13:59:22.610+0000 7f885b45b640 -1 osd.4 0 log_to_monitors true 2023-10-18T13:59:23.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:22 smithi172 ceph-mon[103574]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:23.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:22 smithi172 ceph-mon[103574]: from='osd.4 [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T13:59:23.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:22 smithi172 ceph-mon[103574]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T13:59:23.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:22 smithi158 ceph-mon[103317]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:23.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:22 smithi158 ceph-mon[103317]: from='osd.4 [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T13:59:23.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:22 smithi158 ceph-mon[103317]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T13:59:23.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:22 smithi114 ceph-mon[99494]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:23.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:22 smithi114 ceph-mon[99494]: from='osd.4 [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T13:59:23.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:22 smithi114 ceph-mon[99494]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-18T13:59:23.785 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-18T13:59:23.785 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-18T13:59:23.785 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2023-10-18T13:59:23.785 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2023-10-18T13:59:23.786 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113674 s, 922 MB/s 2023-10-18T13:59:23.786 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2023-10-18T13:59:24.277 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2023-10-18T13:59:24.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:24 smithi172 ceph-mon[103574]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-18T13:59:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:24 smithi172 ceph-mon[103574]: osdmap e32: 5 total, 4 up, 5 in 2023-10-18T13:59:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:24 smithi172 ceph-mon[103574]: from='osd.4 [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T13:59:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:24 smithi172 ceph-mon[103574]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T13:59:24.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:24 smithi172 ceph-mon[103574]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:24.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:24 smithi114 ceph-mon[99494]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-18T13:59:24.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:24 smithi114 ceph-mon[99494]: osdmap e32: 5 total, 4 up, 5 in 2023-10-18T13:59:24.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:24.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:24 smithi114 ceph-mon[99494]: from='osd.4 [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T13:59:24.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:24 smithi114 ceph-mon[99494]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T13:59:24.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:24 smithi114 ceph-mon[99494]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:24.771 INFO:journalctl@ceph.osd.4.smithi158.stdout:Oct 18 13:59:24 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-4[117466]: 2023-10-18T13:59:24.275+0000 7f8850ad2700 -1 osd.4 0 waiting for initial osdmap 2023-10-18T13:59:24.771 INFO:journalctl@ceph.osd.4.smithi158.stdout:Oct 18 13:59:24 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-4[117466]: 2023-10-18T13:59:24.285+0000 7f884c8c7700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T13:59:24.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:24 smithi158 ceph-mon[103317]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-18T13:59:24.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:24 smithi158 ceph-mon[103317]: osdmap e32: 5 total, 4 up, 5 in 2023-10-18T13:59:24.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:24.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:24 smithi158 ceph-mon[103317]: from='osd.4 [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T13:59:24.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:24 smithi158 ceph-mon[103317]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T13:59:24.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:24 smithi158 ceph-mon[103317]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:24.846 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T13:59:25.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]': finished 2023-10-18T13:59:25.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: osdmap e33: 5 total, 4 up, 5 in 2023-10-18T13:59:25.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:25.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:25.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: Detected new or changed devices on smithi158 2023-10-18T13:59:25.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:25.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:25.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi158 to 8584M 2023-10-18T13:59:25.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:25.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:25.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:25.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:25.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:25.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:25 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]': finished 2023-10-18T13:59:25.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: osdmap e33: 5 total, 4 up, 5 in 2023-10-18T13:59:25.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:25.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:25.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: Detected new or changed devices on smithi158 2023-10-18T13:59:25.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:25.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:25.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi158 to 8584M 2023-10-18T13:59:25.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:25.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:25.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:25.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:25.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:25.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:25 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]': finished 2023-10-18T13:59:25.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: osdmap e33: 5 total, 4 up, 5 in 2023-10-18T13:59:25.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:25.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:25.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: Detected new or changed devices on smithi158 2023-10-18T13:59:25.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:25.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:25.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi158 to 8584M 2023-10-18T13:59:25.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:25.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:25.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:25.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:25.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:25.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:25.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:25 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:26.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.124+0000 7f8e39718700 1 -- 172.21.15.172:0/2863840790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e340ff150 msgr2=0x7f8e340ff5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:26.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.124+0000 7f8e39718700 1 --2- 172.21.15.172:0/2863840790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e340ff150 0x7f8e340ff5d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009990 tx=0x7f8e24009ca0 comp rx=0 tx=0).stop 2023-10-18T13:59:26.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.124+0000 7f8e39718700 1 -- 172.21.15.172:0/2863840790 shutdown_connections 2023-10-18T13:59:26.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.124+0000 7f8e39718700 1 --2- 172.21.15.172:0/2863840790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e340ffb10 0x7f8e3410d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:26.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.124+0000 7f8e39718700 1 --2- 172.21.15.172:0/2863840790 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e34105840 0x7f8e34105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:26.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.124+0000 7f8e39718700 1 --2- 172.21.15.172:0/2863840790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e340ff150 0x7f8e340ff5d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:26.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.124+0000 7f8e39718700 1 -- 172.21.15.172:0/2863840790 >> 172.21.15.172:0/2863840790 conn(0x7f8e34074aa0 msgr2=0x7f8e34074eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:59:26.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.124+0000 7f8e39718700 1 -- 172.21.15.172:0/2863840790 shutdown_connections 2023-10-18T13:59:26.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.124+0000 7f8e39718700 1 -- 172.21.15.172:0/2863840790 wait complete. 2023-10-18T13:59:26.132 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.125+0000 7f8e39718700 1 Processor -- start 2023-10-18T13:59:26.132 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.125+0000 7f8e39718700 1 -- start start 2023-10-18T13:59:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e39718700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e340ff150 0x7f8e3419c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:59:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e39718700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e340ffb10 0x7f8e3419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:59:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e39718700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e34105840 0x7f8e34196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:59:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e39718700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e34197060 con 0x7f8e340ffb10 2023-10-18T13:59:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e39718700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e341971d0 con 0x7f8e34105840 2023-10-18T13:59:26.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e39718700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e34197390 con 0x7f8e340ff150 2023-10-18T13:59:26.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e32ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e340ff150 0x7f8e3419c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:59:26.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e32ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e340ff150 0x7f8e3419c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55140/0 (socket says 172.21.15.172:55140) 2023-10-18T13:59:26.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e32ffd700 1 -- 172.21.15.172:0/3289021427 learned_addr learned my addr 172.21.15.172:0/3289021427 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T13:59:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e327fc700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e340ffb10 0x7f8e3419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:59:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e337fe700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e34105840 0x7f8e34196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:59:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e32ffd700 1 -- 172.21.15.172:0/3289021427 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e34105840 msgr2=0x7f8e34196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e32ffd700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e34105840 0x7f8e34196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e32ffd700 1 -- 172.21.15.172:0/3289021427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e340ffb10 msgr2=0x7f8e3419cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:26.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e32ffd700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e340ffb10 0x7f8e3419cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:26.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e32ffd700 1 -- 172.21.15.172:0/3289021427 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e240095f0 con 0x7f8e340ff150 2023-10-18T13:59:26.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e32ffd700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e340ff150 0x7f8e3419c870 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800c920 tx=0x7f8e2800cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:59:26.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e1bfff700 1 -- 172.21.15.172:0/3289021427 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28007b00 con 0x7f8e340ff150 2023-10-18T13:59:26.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e39718700 1 -- 172.21.15.172:0/3289021427 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e34197670 con 0x7f8e340ff150 2023-10-18T13:59:26.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e1bfff700 1 -- 172.21.15.172:0/3289021427 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e2800ce70 con 0x7f8e340ff150 2023-10-18T13:59:26.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e1bfff700 1 -- 172.21.15.172:0/3289021427 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e280054e0 con 0x7f8e340ff150 2023-10-18T13:59:26.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.126+0000 7f8e39718700 1 -- 172.21.15.172:0/3289021427 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e341a3860 con 0x7f8e340ff150 2023-10-18T13:59:26.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.127+0000 7f8e39718700 1 -- 172.21.15.172:0/3289021427 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e34108db0 con 0x7f8e340ff150 2023-10-18T13:59:26.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.128+0000 7f8e1bfff700 1 -- 172.21.15.172:0/3289021427 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f8e28004750 con 0x7f8e340ff150 2023-10-18T13:59:26.138 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.129+0000 7f8e1bfff700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8e1c0a1550 0x7f8e1c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:59:26.138 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.129+0000 7f8e1bfff700 1 -- 172.21.15.172:0/3289021427 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4316+0+0 (secure 0 0 0) 0x7f8e280cb8e0 con 0x7f8e340ff150 2023-10-18T13:59:26.138 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.129+0000 7f8e327fc700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8e1c0a1550 0x7f8e1c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:59:26.138 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.130+0000 7f8e327fc700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8e1c0a1550 0x7f8e1c0a3a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400b5c0 tx=0x7f8e24005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:59:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.133+0000 7f8e1bfff700 1 -- 172.21.15.172:0/3289021427 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8e28095ee0 con 0x7f8e340ff150 2023-10-18T13:59:26.332 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:26.330+0000 7f8e39718700 1 -- 172.21.15.172:0/3289021427 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e34197e70 con 0x7f8e1c0a1550 2023-10-18T13:59:26.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:26 smithi172 ceph-mon[103574]: purged_snaps scrub starts 2023-10-18T13:59:26.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:26 smithi172 ceph-mon[103574]: purged_snaps scrub ok 2023-10-18T13:59:26.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:26.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:26 smithi172 ceph-mon[103574]: osd.4 [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851] boot 2023-10-18T13:59:26.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:26 smithi172 ceph-mon[103574]: osdmap e34: 5 total, 5 up, 5 in 2023-10-18T13:59:26.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:26.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:26 smithi172 ceph-mon[103574]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:26.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:26 smithi114 ceph-mon[99494]: purged_snaps scrub starts 2023-10-18T13:59:26.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:26 smithi114 ceph-mon[99494]: purged_snaps scrub ok 2023-10-18T13:59:26.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:26.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:26 smithi114 ceph-mon[99494]: osd.4 [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851] boot 2023-10-18T13:59:26.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:26 smithi114 ceph-mon[99494]: osdmap e34: 5 total, 5 up, 5 in 2023-10-18T13:59:26.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:26.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:26 smithi114 ceph-mon[99494]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:26.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:26 smithi158 ceph-mon[103317]: purged_snaps scrub starts 2023-10-18T13:59:26.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:26 smithi158 ceph-mon[103317]: purged_snaps scrub ok 2023-10-18T13:59:26.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:26.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:26 smithi158 ceph-mon[103317]: osd.4 [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851] boot 2023-10-18T13:59:26.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:26 smithi158 ceph-mon[103317]: osdmap e34: 5 total, 5 up, 5 in 2023-10-18T13:59:26.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-18T13:59:26.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:26 smithi158 ceph-mon[103317]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-18T13:59:27.410 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:27 smithi172 ceph-mon[103574]: osdmap e35: 5 total, 5 up, 5 in 2023-10-18T13:59:27.410 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:27 smithi172 ceph-mon[103574]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:59:27.411 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:59:27.411 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:59:27.411 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:27.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:27 smithi114 ceph-mon[99494]: osdmap e35: 5 total, 5 up, 5 in 2023-10-18T13:59:27.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:27 smithi114 ceph-mon[99494]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:59:27.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:59:27.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:59:27.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:27.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:27 smithi158 ceph-mon[103317]: osdmap e35: 5 total, 5 up, 5 in 2023-10-18T13:59:27.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:27 smithi158 ceph-mon[103317]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:59:27.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:59:27.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:59:27.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:28.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:28 smithi172 ceph-mon[103574]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:28.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:28 smithi114 ceph-mon[99494]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:28.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:28 smithi158 ceph-mon[103317]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:29.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:29 smithi114 ceph-mon[99494]: from='client.? 172.21.15.172:0/1388499133' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc3a8ec1-7475-444d-ad2c-98f52164c622"}]: dispatch 2023-10-18T13:59:29.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:29 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc3a8ec1-7475-444d-ad2c-98f52164c622"}]: dispatch 2023-10-18T13:59:29.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:29 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc3a8ec1-7475-444d-ad2c-98f52164c622"}]': finished 2023-10-18T13:59:29.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:29 smithi114 ceph-mon[99494]: osdmap e36: 6 total, 5 up, 6 in 2023-10-18T13:59:29.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:29 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:29.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:29 smithi158 ceph-mon[103317]: from='client.? 172.21.15.172:0/1388499133' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc3a8ec1-7475-444d-ad2c-98f52164c622"}]: dispatch 2023-10-18T13:59:29.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:29 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc3a8ec1-7475-444d-ad2c-98f52164c622"}]: dispatch 2023-10-18T13:59:29.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:29 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc3a8ec1-7475-444d-ad2c-98f52164c622"}]': finished 2023-10-18T13:59:29.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:29 smithi158 ceph-mon[103317]: osdmap e36: 6 total, 5 up, 6 in 2023-10-18T13:59:29.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:29 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:29.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:29 smithi172 ceph-mon[103574]: from='client.? 172.21.15.172:0/1388499133' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc3a8ec1-7475-444d-ad2c-98f52164c622"}]: dispatch 2023-10-18T13:59:29.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:29 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc3a8ec1-7475-444d-ad2c-98f52164c622"}]: dispatch 2023-10-18T13:59:29.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:29 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc3a8ec1-7475-444d-ad2c-98f52164c622"}]': finished 2023-10-18T13:59:29.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:29 smithi172 ceph-mon[103574]: osdmap e36: 6 total, 5 up, 6 in 2023-10-18T13:59:29.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:29 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:30.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:30 smithi114 ceph-mon[99494]: from='client.? 172.21.15.172:0/947313114' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:59:30.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:30 smithi114 ceph-mon[99494]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:30.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:30 smithi158 ceph-mon[103317]: from='client.? 172.21.15.172:0/947313114' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:59:30.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:30 smithi158 ceph-mon[103317]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:30.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:30 smithi172 ceph-mon[103574]: from='client.? 172.21.15.172:0/947313114' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:59:30.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:30 smithi172 ceph-mon[103574]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:32.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:32 smithi172 ceph-mon[103574]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:32.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:32 smithi114 ceph-mon[99494]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:32 smithi158 ceph-mon[103317]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:34.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:34 smithi158 ceph-mon[103317]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:34.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:34 smithi172 ceph-mon[103574]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:34.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:34 smithi114 ceph-mon[99494]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:35.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:35 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-18T13:59:35.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:35 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:35.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:35 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-18T13:59:35.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:35 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:35.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:35 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-18T13:59:35.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:35 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:36.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:36 smithi158 ceph-mon[103317]: Deploying daemon osd.5 on smithi172 2023-10-18T13:59:36.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:36 smithi158 ceph-mon[103317]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:36.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:36 smithi172 ceph-mon[103574]: Deploying daemon osd.5 on smithi172 2023-10-18T13:59:36.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:36 smithi172 ceph-mon[103574]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:36.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:36 smithi114 ceph-mon[99494]: Deploying daemon osd.5 on smithi172 2023-10-18T13:59:36.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:36 smithi114 ceph-mon[99494]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:38.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:38 smithi172 ceph-mon[103574]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:38.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:38 smithi114 ceph-mon[99494]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:39.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:38 smithi158 ceph-mon[103317]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:40.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:40 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:40.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:40 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:40.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:40 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:40.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:40 smithi172 ceph-mon[103574]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:40.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:40 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:40.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:40 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:40.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:40 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:40.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:40 smithi158 ceph-mon[103317]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:40.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:40 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:40.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:40 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:40.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:40 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:40.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:40 smithi114 ceph-mon[99494]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:42.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:42.084+0000 7f8e1bfff700 1 -- 172.21.15.172:0/3289021427 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8e34197e70 con 0x7f8e1c0a1550 2023-10-18T13:59:42.089 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 5 on host 'smithi172' 2023-10-18T13:59:42.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:42.087+0000 7f8e39718700 1 -- 172.21.15.172:0/3289021427 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8e1c0a1550 msgr2=0x7f8e1c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:42.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:42.087+0000 7f8e39718700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8e1c0a1550 0x7f8e1c0a3a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400b5c0 tx=0x7f8e24005960 comp rx=0 tx=0).stop 2023-10-18T13:59:42.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:42.087+0000 7f8e39718700 1 -- 172.21.15.172:0/3289021427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e340ff150 msgr2=0x7f8e3419c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:42.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:42.087+0000 7f8e39718700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e340ff150 0x7f8e3419c870 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800c920 tx=0x7f8e2800cc30 comp rx=0 tx=0).stop 2023-10-18T13:59:42.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:42.087+0000 7f8e39718700 1 -- 172.21.15.172:0/3289021427 shutdown_connections 2023-10-18T13:59:42.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:42.087+0000 7f8e39718700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8e1c0a1550 0x7f8e1c0a3a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:42.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:42.087+0000 7f8e39718700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e34105840 0x7f8e34196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:42.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:42.087+0000 7f8e39718700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e340ff150 0x7f8e3419c870 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:42.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:42.087+0000 7f8e39718700 1 --2- 172.21.15.172:0/3289021427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e340ffb10 0x7f8e3419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:42.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:42.087+0000 7f8e39718700 1 -- 172.21.15.172:0/3289021427 >> 172.21.15.172:0/3289021427 conn(0x7f8e34074aa0 msgr2=0x7f8e340fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:59:42.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:42.087+0000 7f8e39718700 1 -- 172.21.15.172:0/3289021427 shutdown_connections 2023-10-18T13:59:42.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T13:59:42.087+0000 7f8e39718700 1 -- 172.21.15.172:0/3289021427 wait complete. 2023-10-18T13:59:42.436 DEBUG:teuthology.orchestra.run.smithi172:osd.5> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.5.service 2023-10-18T13:59:42.439 INFO:tasks.cephadm:Deploying osd.6 on smithi114 with /dev/vg_nvme/lv_2... 2023-10-18T13:59:42.439 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-18T13:59:42.468 INFO:journalctl@ceph.osd.5.smithi172.stdout:-- Logs begin at Wed 2023-10-18 13:40:49 UTC. -- 2023-10-18T13:59:42.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:42 smithi114 ceph-mon[99494]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:42.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:42.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:42.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:42.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:42.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:42.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:42.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:42.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:42.979 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:42 smithi172 ceph-mon[103574]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:42.980 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:42.980 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:42.980 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:42.980 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:42.980 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:42.981 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:42.981 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:42.981 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:43.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:42 smithi158 ceph-mon[103317]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:43.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:43.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:43.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:43.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:43.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:43.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:43.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:43.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T13:59:43.023 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:59:43.560 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 13:59:43 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T13:59:43.377+0000 7f446ffdd640 -1 osd.5 0 log_to_monitors true 2023-10-18T13:59:44.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:44 smithi114 ceph-mon[99494]: from='osd.5 [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-18T13:59:44.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:44 smithi114 ceph-mon[99494]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-18T13:59:44.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:44 smithi114 ceph-mon[99494]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-18T13:59:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-18T13:59:44.513 INFO:teuthology.orchestra.run.smithi114.stderr: stderr: 10+0 records in 2023-10-18T13:59:44.513 INFO:teuthology.orchestra.run.smithi114.stderr:10+0 records out 2023-10-18T13:59:44.513 INFO:teuthology.orchestra.run.smithi114.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111933 s, 937 MB/s 2023-10-18T13:59:44.513 INFO:teuthology.orchestra.run.smithi114.stderr:--> Zapping successful for: 2023-10-18T13:59:44.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:44 smithi158 ceph-mon[103317]: from='osd.5 [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-18T13:59:44.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:44 smithi158 ceph-mon[103317]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-18T13:59:44.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:44 smithi158 ceph-mon[103317]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:44.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:44 smithi172 ceph-mon[103574]: from='osd.5 [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-18T13:59:44.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:44 smithi172 ceph-mon[103574]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-18T13:59:44.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:44 smithi172 ceph-mon[103574]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:44.876 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi114:vg_nvme/lv_2 2023-10-18T13:59:45.310 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T13:59:45.225+0000 7f4465654700 -1 osd.5 0 waiting for initial osdmap 2023-10-18T13:59:45.310 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T13:59:45.231+0000 7f445ec44700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T13:59:45.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-mon[103574]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-18T13:59:45.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-mon[103574]: osdmap e37: 6 total, 5 up, 6 in 2023-10-18T13:59:45.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:45.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-mon[103574]: from='osd.5 [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T13:59:45.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-mon[103574]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T13:59:45.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:45.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:45.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:45.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:45.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:45.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:45.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:45.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:45.436 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T13:59:45.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:45 smithi158 ceph-mon[103317]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-18T13:59:45.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:45 smithi158 ceph-mon[103317]: osdmap e37: 6 total, 5 up, 6 in 2023-10-18T13:59:45.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:45.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:45 smithi158 ceph-mon[103317]: from='osd.5 [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T13:59:45.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:45 smithi158 ceph-mon[103317]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T13:59:45.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:45.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:45.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:45.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:45.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:45.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:45.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:45.524 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:45.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:45 smithi114 ceph-mon[99494]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-18T13:59:45.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:45 smithi114 ceph-mon[99494]: osdmap e37: 6 total, 5 up, 6 in 2023-10-18T13:59:45.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:45.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:45 smithi114 ceph-mon[99494]: from='osd.5 [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T13:59:45.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:45 smithi114 ceph-mon[99494]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T13:59:45.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:45.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:45.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:45.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-18T13:59:45.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:45.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:45.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T13:59:45.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T13:59:46.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:46 smithi158 ceph-mon[103317]: Detected new or changed devices on smithi172 2023-10-18T13:59:46.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:46 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi172 to 8584M 2023-10-18T13:59:46.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:46 smithi158 ceph-mon[103317]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-10-18T13:59:46.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:46 smithi158 ceph-mon[103317]: osdmap e38: 6 total, 5 up, 6 in 2023-10-18T13:59:46.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:46 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:46.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:46 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:46.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:46 smithi158 ceph-mon[103317]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:46.536 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:46 smithi114 ceph-mon[99494]: Detected new or changed devices on smithi172 2023-10-18T13:59:46.536 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:46 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi172 to 8584M 2023-10-18T13:59:46.536 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:46 smithi114 ceph-mon[99494]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-10-18T13:59:46.537 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:46 smithi114 ceph-mon[99494]: osdmap e38: 6 total, 5 up, 6 in 2023-10-18T13:59:46.537 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:46 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:46.537 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:46 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:46.537 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:46 smithi114 ceph-mon[99494]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:46.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:46 smithi172 ceph-mon[103574]: Detected new or changed devices on smithi172 2023-10-18T13:59:46.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:46 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi172 to 8584M 2023-10-18T13:59:46.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:46 smithi172 ceph-mon[103574]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-10-18T13:59:46.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:46 smithi172 ceph-mon[103574]: osdmap e38: 6 total, 5 up, 6 in 2023-10-18T13:59:46.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:46 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:46.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:46 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:46.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:46 smithi172 ceph-mon[103574]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-18T13:59:46.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.730+0000 7fed1a164700 1 -- 172.21.15.114:0/2136681471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed14068190 msgr2=0x7fed140685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:46.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.730+0000 7fed1a164700 1 --2- 172.21.15.114:0/2136681471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed14068190 0x7fed140685f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fed04009990 tx=0x7fed04009ca0 comp rx=0 tx=0).stop 2023-10-18T13:59:46.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.730+0000 7fed1a164700 1 -- 172.21.15.114:0/2136681471 shutdown_connections 2023-10-18T13:59:46.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.730+0000 7fed1a164700 1 --2- 172.21.15.114:0/2136681471 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fed14068b30 0x7fed1410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:46.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.730+0000 7fed1a164700 1 --2- 172.21.15.114:0/2136681471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed141067a0 0x7fed14106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:46.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.730+0000 7fed1a164700 1 --2- 172.21.15.114:0/2136681471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed14068190 0x7fed140685f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:46.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.730+0000 7fed1a164700 1 -- 172.21.15.114:0/2136681471 >> 172.21.15.114:0/2136681471 conn(0x7fed14075790 msgr2=0x7fed14075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T13:59:46.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.730+0000 7fed1a164700 1 -- 172.21.15.114:0/2136681471 shutdown_connections 2023-10-18T13:59:46.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.730+0000 7fed1a164700 1 -- 172.21.15.114:0/2136681471 wait complete. 2023-10-18T13:59:46.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed1a164700 1 Processor -- start 2023-10-18T13:59:46.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed1a164700 1 -- start start 2023-10-18T13:59:46.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed1a164700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fed14068190 0x7fed1419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:59:46.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed1a164700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed14068b30 0x7fed1419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:59:46.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed1a164700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed141067a0 0x7fed14196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:59:46.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed1a164700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed141970f0 con 0x7fed141067a0 2023-10-18T13:59:46.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed1a164700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed14197260 con 0x7fed14068190 2023-10-18T13:59:46.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed1a164700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed14197420 con 0x7fed14068b30 2023-10-18T13:59:46.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed13fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed141067a0 0x7fed14196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:59:46.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed13fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed141067a0 0x7fed14196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41686/0 (socket says 172.21.15.114:41686) 2023-10-18T13:59:46.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed13fff700 1 -- 172.21.15.114:0/2123931586 learned_addr learned my addr 172.21.15.114:0/2123931586 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T13:59:46.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed137fe700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fed14068190 0x7fed1419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:59:46.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed12ffd700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed14068b30 0x7fed1419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:59:46.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed13fff700 1 -- 172.21.15.114:0/2123931586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed14068b30 msgr2=0x7fed1419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:46.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed13fff700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed14068b30 0x7fed1419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:46.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed13fff700 1 -- 172.21.15.114:0/2123931586 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fed14068190 msgr2=0x7fed1419c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T13:59:46.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed13fff700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fed14068190 0x7fed1419c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T13:59:46.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed13fff700 1 -- 172.21.15.114:0/2123931586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed040095f0 con 0x7fed141067a0 2023-10-18T13:59:46.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.731+0000 7fed12ffd700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed14068b30 0x7fed1419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T13:59:46.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.732+0000 7fed13fff700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed141067a0 0x7fed14196a90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fed0c007d70 tx=0x7fed0c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:59:46.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.732+0000 7fed10ff9700 1 -- 172.21.15.114:0/2123931586 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c00ad40 con 0x7fed141067a0 2023-10-18T13:59:46.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.732+0000 7fed10ff9700 1 -- 172.21.15.114:0/2123931586 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed0c0128e0 con 0x7fed141067a0 2023-10-18T13:59:46.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.732+0000 7fed1a164700 1 -- 172.21.15.114:0/2123931586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed14197700 con 0x7fed141067a0 2023-10-18T13:59:46.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.732+0000 7fed10ff9700 1 -- 172.21.15.114:0/2123931586 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0116b0 con 0x7fed141067a0 2023-10-18T13:59:46.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.732+0000 7fed1a164700 1 -- 172.21.15.114:0/2123931586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed141a3940 con 0x7fed141067a0 2023-10-18T13:59:46.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.733+0000 7fed1a164700 1 -- 172.21.15.114:0/2123931586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed14108d50 con 0x7fed141067a0 2023-10-18T13:59:46.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.734+0000 7fed10ff9700 1 -- 172.21.15.114:0/2123931586 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fed0c012420 con 0x7fed141067a0 2023-10-18T13:59:46.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.734+0000 7fed10ff9700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fed000a1550 0x7fed000a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T13:59:46.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.735+0000 7fed10ff9700 1 -- 172.21.15.114:0/2123931586 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4781+0+0 (secure 0 0 0) 0x7fed0c0cc1c0 con 0x7fed141067a0 2023-10-18T13:59:46.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.735+0000 7fed137fe700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fed000a1550 0x7fed000a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T13:59:46.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.735+0000 7fed137fe700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fed000a1550 0x7fed000a3a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009a10 tx=0x7fecfc009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T13:59:46.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.739+0000 7fed10ff9700 1 -- 172.21.15.114:0/2123931586 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fed0c0965f0 con 0x7fed141067a0 2023-10-18T13:59:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T13:59:46.938+0000 7fed1a164700 1 -- 172.21.15.114:0/2123931586 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fed14197f50 con 0x7fed000a1550 2023-10-18T13:59:47.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:47 smithi158 ceph-mon[103317]: purged_snaps scrub starts 2023-10-18T13:59:47.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:47 smithi158 ceph-mon[103317]: purged_snaps scrub ok 2023-10-18T13:59:47.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:47 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:47.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:47 smithi158 ceph-mon[103317]: osd.5 [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562] boot 2023-10-18T13:59:47.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:47 smithi158 ceph-mon[103317]: osdmap e39: 6 total, 6 up, 6 in 2023-10-18T13:59:47.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:47 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:47.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:47 smithi158 ceph-mon[103317]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:59:47.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:47 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:59:47.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:47 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:59:47.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:47 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:47.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:47 smithi172 ceph-mon[103574]: purged_snaps scrub starts 2023-10-18T13:59:47.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:47 smithi172 ceph-mon[103574]: purged_snaps scrub ok 2023-10-18T13:59:47.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:47 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:47.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:47 smithi172 ceph-mon[103574]: osd.5 [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562] boot 2023-10-18T13:59:47.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:47 smithi172 ceph-mon[103574]: osdmap e39: 6 total, 6 up, 6 in 2023-10-18T13:59:47.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:47 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:47.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:47 smithi172 ceph-mon[103574]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:59:47.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:47 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:59:47.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:47 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:59:47.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:47 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:47.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:47 smithi114 ceph-mon[99494]: purged_snaps scrub starts 2023-10-18T13:59:47.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:47 smithi114 ceph-mon[99494]: purged_snaps scrub ok 2023-10-18T13:59:47.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:47 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:47.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:47 smithi114 ceph-mon[99494]: osd.5 [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562] boot 2023-10-18T13:59:47.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:47 smithi114 ceph-mon[99494]: osdmap e39: 6 total, 6 up, 6 in 2023-10-18T13:59:47.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:47 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-18T13:59:47.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:47 smithi114 ceph-mon[99494]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T13:59:47.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:47 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T13:59:47.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:47 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T13:59:47.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:47 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:48.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:48 smithi114 ceph-mon[99494]: osdmap e40: 6 total, 6 up, 6 in 2023-10-18T13:59:48.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:48 smithi114 ceph-mon[99494]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-18T13:59:48.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:48 smithi158 ceph-mon[103317]: osdmap e40: 6 total, 6 up, 6 in 2023-10-18T13:59:48.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:48 smithi158 ceph-mon[103317]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-18T13:59:48.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:48 smithi172 ceph-mon[103574]: osdmap e40: 6 total, 6 up, 6 in 2023-10-18T13:59:48.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:48 smithi172 ceph-mon[103574]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-18T13:59:49.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:49 smithi158 ceph-mon[103317]: osdmap e41: 6 total, 6 up, 6 in 2023-10-18T13:59:49.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:49 smithi172 ceph-mon[103574]: osdmap e41: 6 total, 6 up, 6 in 2023-10-18T13:59:49.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:49 smithi114 ceph-mon[99494]: osdmap e41: 6 total, 6 up, 6 in 2023-10-18T13:59:50.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:50 smithi158 ceph-mon[103317]: osdmap e42: 6 total, 6 up, 6 in 2023-10-18T13:59:50.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:50 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3605846243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "01b49bae-b64b-40ff-8931-4052c324a4ad"}]: dispatch 2023-10-18T13:59:50.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:50 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3605846243' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "01b49bae-b64b-40ff-8931-4052c324a4ad"}]': finished 2023-10-18T13:59:50.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:50 smithi158 ceph-mon[103317]: osdmap e43: 7 total, 6 up, 7 in 2023-10-18T13:59:50.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:50 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T13:59:50.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:50 smithi158 ceph-mon[103317]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-18T13:59:50.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:50 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3830888172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:59:50.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:50 smithi172 ceph-mon[103574]: osdmap e42: 6 total, 6 up, 6 in 2023-10-18T13:59:50.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:50 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3605846243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "01b49bae-b64b-40ff-8931-4052c324a4ad"}]: dispatch 2023-10-18T13:59:50.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:50 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3605846243' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "01b49bae-b64b-40ff-8931-4052c324a4ad"}]': finished 2023-10-18T13:59:50.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:50 smithi172 ceph-mon[103574]: osdmap e43: 7 total, 6 up, 7 in 2023-10-18T13:59:50.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:50 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T13:59:50.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:50 smithi172 ceph-mon[103574]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-18T13:59:50.562 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:50 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3830888172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:59:50.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:50 smithi114 ceph-mon[99494]: osdmap e42: 6 total, 6 up, 6 in 2023-10-18T13:59:50.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:50 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3605846243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "01b49bae-b64b-40ff-8931-4052c324a4ad"}]: dispatch 2023-10-18T13:59:50.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:50 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3605846243' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "01b49bae-b64b-40ff-8931-4052c324a4ad"}]': finished 2023-10-18T13:59:50.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:50 smithi114 ceph-mon[99494]: osdmap e43: 7 total, 6 up, 7 in 2023-10-18T13:59:50.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:50 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T13:59:50.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:50 smithi114 ceph-mon[99494]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-18T13:59:50.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:50 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3830888172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T13:59:52.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:52 smithi114 ceph-mon[99494]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-18T13:59:53.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:52 smithi158 ceph-mon[103317]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-18T13:59:53.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:52 smithi172 ceph-mon[103574]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-18T13:59:54.466 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:54 smithi114 ceph-mon[99494]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-18T13:59:54.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:54 smithi158 ceph-mon[103317]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-18T13:59:54.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:54 smithi172 ceph-mon[103574]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-18T13:59:56.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:56 smithi114 ceph-mon[99494]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-18T13:59:56.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:56 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-18T13:59:56.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:56 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:56 smithi158 ceph-mon[103317]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-18T13:59:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:56 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-18T13:59:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:56 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:57.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:56 smithi172 ceph-mon[103574]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-18T13:59:57.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:56 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-18T13:59:57.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:56 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T13:59:57.822 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:57 smithi114 ceph-mon[99494]: Deploying daemon osd.6 on smithi114 2023-10-18T13:59:58.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:57 smithi158 ceph-mon[103317]: Deploying daemon osd.6 on smithi114 2023-10-18T13:59:58.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:57 smithi172 ceph-mon[103574]: Deploying daemon osd.6 on smithi114 2023-10-18T13:59:58.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 13:59:58 smithi114 ceph-mon[99494]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2023-10-18T13:59:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 13:59:58 smithi158 ceph-mon[103317]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2023-10-18T13:59:59.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 13:59:58 smithi172 ceph-mon[103574]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2023-10-18T14:00:00.893 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:00 smithi114 ceph-mon[99494]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-18T14:00:00.894 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:00 smithi114 ceph-mon[99494]: overall HEALTH_OK 2023-10-18T14:00:00.894 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:00 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:00.894 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:00 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:00.894 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:00 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:01.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:00 smithi158 ceph-mon[103317]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-18T14:00:01.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:00 smithi158 ceph-mon[103317]: overall HEALTH_OK 2023-10-18T14:00:01.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:00 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:01.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:00 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:01.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:00 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:01.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:00 smithi172 ceph-mon[103574]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-18T14:00:01.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:00 smithi172 ceph-mon[103574]: overall HEALTH_OK 2023-10-18T14:00:01.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:00 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:01.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:00 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:01.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:00 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:02.886 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:02 smithi114 ceph-mon[99494]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-18T14:00:03.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:02 smithi158 ceph-mon[103317]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-18T14:00:03.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:02 smithi172 ceph-mon[103574]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-18T14:00:03.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:03.239+0000 7fed10ff9700 1 -- 172.21.15.114:0/2123931586 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fed14197f50 con 0x7fed000a1550 2023-10-18T14:00:03.244 INFO:teuthology.orchestra.run.smithi114.stdout:Created osd(s) 6 on host 'smithi114' 2023-10-18T14:00:03.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:03.241+0000 7fed1a164700 1 -- 172.21.15.114:0/2123931586 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fed000a1550 msgr2=0x7fed000a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:03.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:03.241+0000 7fed1a164700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fed000a1550 0x7fed000a3a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009a10 tx=0x7fecfc009190 comp rx=0 tx=0).stop 2023-10-18T14:00:03.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:03.242+0000 7fed1a164700 1 -- 172.21.15.114:0/2123931586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed141067a0 msgr2=0x7fed14196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:03.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:03.242+0000 7fed1a164700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed141067a0 0x7fed14196a90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fed0c007d70 tx=0x7fed0c00a340 comp rx=0 tx=0).stop 2023-10-18T14:00:03.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:03.242+0000 7fed1a164700 1 -- 172.21.15.114:0/2123931586 shutdown_connections 2023-10-18T14:00:03.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:03.242+0000 7fed1a164700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fed000a1550 0x7fed000a3a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:03.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:03.242+0000 7fed1a164700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed141067a0 0x7fed14196a90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:03.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:03.242+0000 7fed1a164700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fed14068190 0x7fed1419c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:03.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:03.242+0000 7fed1a164700 1 --2- 172.21.15.114:0/2123931586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed14068b30 0x7fed1419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:03.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:03.242+0000 7fed1a164700 1 -- 172.21.15.114:0/2123931586 >> 172.21.15.114:0/2123931586 conn(0x7fed14075790 msgr2=0x7fed140fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:00:03.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:03.242+0000 7fed1a164700 1 -- 172.21.15.114:0/2123931586 shutdown_connections 2023-10-18T14:00:03.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:03.242+0000 7fed1a164700 1 -- 172.21.15.114:0/2123931586 wait complete. 2023-10-18T14:00:03.716 DEBUG:teuthology.orchestra.run.smithi114:osd.6> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.6.service 2023-10-18T14:00:03.718 INFO:tasks.cephadm:Deploying osd.7 on smithi158 with /dev/vg_nvme/lv_2... 2023-10-18T14:00:03.718 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-18T14:00:03.750 INFO:journalctl@ceph.osd.6.smithi114.stdout:-- Logs begin at Wed 2023-10-18 13:40:26 UTC. -- 2023-10-18T14:00:04.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:04.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:04.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:04.207 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.208 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.208 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:04.208 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:04.208 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.208 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.209 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.209 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:04.303 INFO:teuthology.orchestra.run.smithi158.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-18T14:00:04.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:04.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:04.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:04.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:04.519 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:00:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:00:04.403+0000 7fbf37750640 -1 osd.6 0 log_to_monitors true 2023-10-18T14:00:05.199 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:04 smithi158 ceph-mon[103317]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-18T14:00:05.200 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:04 smithi158 ceph-mon[103317]: from='osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-18T14:00:05.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:04 smithi172 ceph-mon[103574]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-18T14:00:05.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:04 smithi172 ceph-mon[103574]: from='osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-18T14:00:05.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:04 smithi114 ceph-mon[99494]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-18T14:00:05.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:04 smithi114 ceph-mon[99494]: from='osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-18T14:00:05.702 INFO:teuthology.orchestra.run.smithi158.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-18T14:00:05.702 INFO:teuthology.orchestra.run.smithi158.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-18T14:00:05.702 INFO:teuthology.orchestra.run.smithi158.stderr: stderr: 10+0 records in 2023-10-18T14:00:05.703 INFO:teuthology.orchestra.run.smithi158.stderr:10+0 records out 2023-10-18T14:00:05.703 INFO:teuthology.orchestra.run.smithi158.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123183 s, 851 MB/s 2023-10-18T14:00:05.703 INFO:teuthology.orchestra.run.smithi158.stderr:--> Zapping successful for: 2023-10-18T14:00:06.058 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi158:vg_nvme/lv_2 2023-10-18T14:00:06.338 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:00:06 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:00:06.219+0000 7fbf2cdc7700 -1 osd.6 0 waiting for initial osdmap 2023-10-18T14:00:06.339 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:00:06 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:00:06.227+0000 7fbf263b7700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T14:00:06.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:06 smithi114 ceph-mon[99494]: from='osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-18T14:00:06.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:06 smithi114 ceph-mon[99494]: osdmap e44: 7 total, 6 up, 7 in 2023-10-18T14:00:06.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:06 smithi114 ceph-mon[99494]: from='osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2023-10-18T14:00:06.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T14:00:06.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:06 smithi114 ceph-mon[99494]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-18T14:00:06.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:06 smithi158 ceph-mon[103317]: from='osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-18T14:00:06.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:06 smithi158 ceph-mon[103317]: osdmap e44: 7 total, 6 up, 7 in 2023-10-18T14:00:06.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:06 smithi158 ceph-mon[103317]: from='osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2023-10-18T14:00:06.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T14:00:06.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:06 smithi158 ceph-mon[103317]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-18T14:00:06.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:06 smithi172 ceph-mon[103574]: from='osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-18T14:00:06.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:06 smithi172 ceph-mon[103574]: osdmap e44: 7 total, 6 up, 7 in 2023-10-18T14:00:06.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:06 smithi172 ceph-mon[103574]: from='osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2023-10-18T14:00:06.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T14:00:06.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:06 smithi172 ceph-mon[103574]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-18T14:00:06.619 INFO:teuthology.orchestra.run.smithi158.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-18T14:00:07.400 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: from='osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2023-10-18T14:00:07.400 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: osdmap e45: 7 total, 6 up, 7 in 2023-10-18T14:00:07.400 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T14:00:07.401 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T14:00:07.401 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: Detected new or changed devices on smithi114 2023-10-18T14:00:07.401 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:07.401 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:07.401 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:07.402 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:07.402 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:07.402 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi114 to 5722M 2023-10-18T14:00:07.402 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:07.402 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:07.403 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:07.403 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:07.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: from='osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2023-10-18T14:00:07.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: osdmap e45: 7 total, 6 up, 7 in 2023-10-18T14:00:07.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T14:00:07.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T14:00:07.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: Detected new or changed devices on smithi114 2023-10-18T14:00:07.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:07.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:07.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:07.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:07.562 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:07.562 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi114 to 5722M 2023-10-18T14:00:07.562 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:07.562 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:07.562 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:07.563 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:07.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: from='osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2023-10-18T14:00:07.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: osdmap e45: 7 total, 6 up, 7 in 2023-10-18T14:00:07.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T14:00:07.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T14:00:07.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: Detected new or changed devices on smithi114 2023-10-18T14:00:07.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:07.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:07.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:07.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:07.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:07.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi114 to 5722M 2023-10-18T14:00:07.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:07.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:07.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:07.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:07.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.836+0000 7fb688152700 1 -- 172.21.15.158:0/3246384309 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6801067a0 msgr2=0x7fb680106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:07.842 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.836+0000 7fb688152700 1 --2- 172.21.15.158:0/3246384309 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6801067a0 0x7fb680106b80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb670009990 tx=0x7fb670009ca0 comp rx=0 tx=0).stop 2023-10-18T14:00:07.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.836+0000 7fb688152700 1 -- 172.21.15.158:0/3246384309 shutdown_connections 2023-10-18T14:00:07.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.836+0000 7fb688152700 1 --2- 172.21.15.158:0/3246384309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb680068b30 0x7fb68010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:07.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.836+0000 7fb688152700 1 --2- 172.21.15.158:0/3246384309 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6801067a0 0x7fb680106b80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:07.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.836+0000 7fb688152700 1 --2- 172.21.15.158:0/3246384309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb680068190 0x7fb6800685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:07.843 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.836+0000 7fb688152700 1 -- 172.21.15.158:0/3246384309 >> 172.21.15.158:0/3246384309 conn(0x7fb680075790 msgr2=0x7fb680075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:00:07.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.836+0000 7fb688152700 1 -- 172.21.15.158:0/3246384309 shutdown_connections 2023-10-18T14:00:07.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.836+0000 7fb688152700 1 -- 172.21.15.158:0/3246384309 wait complete. 2023-10-18T14:00:07.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.837+0000 7fb688152700 1 Processor -- start 2023-10-18T14:00:07.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.837+0000 7fb688152700 1 -- start start 2023-10-18T14:00:07.844 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.837+0000 7fb688152700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680068190 0x7fb68019c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:00:07.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.837+0000 7fb688152700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb680068b30 0x7fb68019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:00:07.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.837+0000 7fb688152700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801067a0 0x7fb680196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:00:07.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.837+0000 7fb688152700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6801970b0 con 0x7fb680068b30 2023-10-18T14:00:07.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.837+0000 7fb688152700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb680197220 con 0x7fb680068190 2023-10-18T14:00:07.845 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.837+0000 7fb688152700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6801973e0 con 0x7fb6801067a0 2023-10-18T14:00:07.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.837+0000 7fb685eee700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680068190 0x7fb68019c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:00:07.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.837+0000 7fb685eee700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680068190 0x7fb68019c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35218/0 (socket says 172.21.15.158:35218) 2023-10-18T14:00:07.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.837+0000 7fb685eee700 1 -- 172.21.15.158:0/986096069 learned_addr learned my addr 172.21.15.158:0/986096069 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T14:00:07.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.837+0000 7fb6856ed700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb680068b30 0x7fb68019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:00:07.846 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.837+0000 7fb6866ef700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801067a0 0x7fb680196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:00:07.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.838+0000 7fb685eee700 1 -- 172.21.15.158:0/986096069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801067a0 msgr2=0x7fb680196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:07.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.838+0000 7fb685eee700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801067a0 0x7fb680196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:07.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.838+0000 7fb685eee700 1 -- 172.21.15.158:0/986096069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb680068b30 msgr2=0x7fb68019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:07.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.838+0000 7fb685eee700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb680068b30 0x7fb68019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:07.847 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.838+0000 7fb685eee700 1 -- 172.21.15.158:0/986096069 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6700095f0 con 0x7fb680068190 2023-10-18T14:00:07.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.838+0000 7fb685eee700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680068190 0x7fb68019c8c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb670000c00 tx=0x7fb67000f7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:00:07.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.838+0000 7fb676ffd700 1 -- 172.21.15.158:0/986096069 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67001d070 con 0x7fb680068190 2023-10-18T14:00:07.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.838+0000 7fb688152700 1 -- 172.21.15.158:0/986096069 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb680197660 con 0x7fb680068190 2023-10-18T14:00:07.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.838+0000 7fb676ffd700 1 -- 172.21.15.158:0/986096069 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb67000fd30 con 0x7fb680068190 2023-10-18T14:00:07.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.838+0000 7fb676ffd700 1 -- 172.21.15.158:0/986096069 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670017630 con 0x7fb680068190 2023-10-18T14:00:07.848 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.838+0000 7fb688152700 1 -- 172.21.15.158:0/986096069 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6801a38b0 con 0x7fb680068190 2023-10-18T14:00:07.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.839+0000 7fb688152700 1 -- 172.21.15.158:0/986096069 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb680108d50 con 0x7fb680068190 2023-10-18T14:00:07.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.840+0000 7fb676ffd700 1 -- 172.21.15.158:0/986096069 <== mon.2 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fb670004830 con 0x7fb680068190 2023-10-18T14:00:07.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.841+0000 7fb676ffd700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb66c0a14d0 0x7fb66c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:00:07.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.841+0000 7fb676ffd700 1 -- 172.21.15.158:0/986096069 <== mon.2 v2:172.21.15.158:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5180+0+0 (secure 0 0 0) 0x7fb6700cd700 con 0x7fb680068190 2023-10-18T14:00:07.850 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.841+0000 7fb6856ed700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb66c0a14d0 0x7fb66c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:00:07.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.841+0000 7fb6856ed700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb66c0a14d0 0x7fb66c0a3990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb680197bc0 tx=0x7fb67c00a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:00:07.851 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:07.844+0000 7fb676ffd700 1 -- 172.21.15.158:0/986096069 <== mon.2 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb670097a30 con 0x7fb680068190 2023-10-18T14:00:08.043 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:08.039+0000 7fb688152700 1 -- 172.21.15.158:0/986096069 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb68004e530 con 0x7fb66c0a14d0 2023-10-18T14:00:08.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:08 smithi158 ceph-mon[103317]: purged_snaps scrub starts 2023-10-18T14:00:08.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:08 smithi158 ceph-mon[103317]: purged_snaps scrub ok 2023-10-18T14:00:08.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:08 smithi158 ceph-mon[103317]: osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982] boot 2023-10-18T14:00:08.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:08 smithi158 ceph-mon[103317]: osdmap e46: 7 total, 7 up, 7 in 2023-10-18T14:00:08.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T14:00:08.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:08 smithi158 ceph-mon[103317]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-18T14:00:08.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:00:08.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:00:08.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:08.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:08 smithi172 ceph-mon[103574]: purged_snaps scrub starts 2023-10-18T14:00:08.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:08 smithi172 ceph-mon[103574]: purged_snaps scrub ok 2023-10-18T14:00:08.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:08 smithi172 ceph-mon[103574]: osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982] boot 2023-10-18T14:00:08.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:08 smithi172 ceph-mon[103574]: osdmap e46: 7 total, 7 up, 7 in 2023-10-18T14:00:08.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T14:00:08.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:08 smithi172 ceph-mon[103574]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-18T14:00:08.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:00:08.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:00:08.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:08.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:08 smithi114 ceph-mon[99494]: purged_snaps scrub starts 2023-10-18T14:00:08.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:08 smithi114 ceph-mon[99494]: purged_snaps scrub ok 2023-10-18T14:00:08.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:08 smithi114 ceph-mon[99494]: osd.6 [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982] boot 2023-10-18T14:00:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:08 smithi114 ceph-mon[99494]: osdmap e46: 7 total, 7 up, 7 in 2023-10-18T14:00:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-18T14:00:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:08 smithi114 ceph-mon[99494]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-18T14:00:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:00:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:00:08.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:09.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:09 smithi158 ceph-mon[103317]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:00:09.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:09 smithi158 ceph-mon[103317]: osdmap e47: 7 total, 7 up, 7 in 2023-10-18T14:00:09.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:09 smithi172 ceph-mon[103574]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:00:09.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:09 smithi172 ceph-mon[103574]: osdmap e47: 7 total, 7 up, 7 in 2023-10-18T14:00:09.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:09 smithi114 ceph-mon[99494]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:00:09.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:09 smithi114 ceph-mon[99494]: osdmap e47: 7 total, 7 up, 7 in 2023-10-18T14:00:10.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:10 smithi158 ceph-mon[103317]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:10.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:10 smithi172 ceph-mon[103574]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:10.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:10 smithi114 ceph-mon[99494]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:11.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:11 smithi158 ceph-mon[103317]: from='client.? 172.21.15.158:0/1720540333' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30538b90-fa16-45be-a0a6-1afeb7551926"}]: dispatch 2023-10-18T14:00:11.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:11 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30538b90-fa16-45be-a0a6-1afeb7551926"}]: dispatch 2023-10-18T14:00:11.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:11 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30538b90-fa16-45be-a0a6-1afeb7551926"}]': finished 2023-10-18T14:00:11.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:11 smithi158 ceph-mon[103317]: osdmap e48: 8 total, 7 up, 8 in 2023-10-18T14:00:11.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:11 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:11.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:11 smithi158 ceph-mon[103317]: from='client.? 172.21.15.158:0/1231031374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:00:11.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:11 smithi172 ceph-mon[103574]: from='client.? 172.21.15.158:0/1720540333' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30538b90-fa16-45be-a0a6-1afeb7551926"}]: dispatch 2023-10-18T14:00:11.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:11 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30538b90-fa16-45be-a0a6-1afeb7551926"}]: dispatch 2023-10-18T14:00:11.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:11 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30538b90-fa16-45be-a0a6-1afeb7551926"}]': finished 2023-10-18T14:00:11.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:11 smithi172 ceph-mon[103574]: osdmap e48: 8 total, 7 up, 8 in 2023-10-18T14:00:11.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:11 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:11.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:11 smithi172 ceph-mon[103574]: from='client.? 172.21.15.158:0/1231031374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:00:11.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:11 smithi114 ceph-mon[99494]: from='client.? 172.21.15.158:0/1720540333' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30538b90-fa16-45be-a0a6-1afeb7551926"}]: dispatch 2023-10-18T14:00:11.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:11 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30538b90-fa16-45be-a0a6-1afeb7551926"}]: dispatch 2023-10-18T14:00:11.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:11 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30538b90-fa16-45be-a0a6-1afeb7551926"}]': finished 2023-10-18T14:00:11.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:11 smithi114 ceph-mon[99494]: osdmap e48: 8 total, 7 up, 8 in 2023-10-18T14:00:11.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:11 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:11.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:11 smithi114 ceph-mon[99494]: from='client.? 172.21.15.158:0/1231031374' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:00:12.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:12 smithi158 ceph-mon[103317]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:12.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:12 smithi172 ceph-mon[103574]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:12.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:12 smithi114 ceph-mon[99494]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:14.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:14 smithi158 ceph-mon[103317]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:14.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:14 smithi172 ceph-mon[103574]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:14.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:14 smithi114 ceph-mon[99494]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:16.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:16 smithi158 ceph-mon[103317]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:16.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:16 smithi114 ceph-mon[99494]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:17.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:16 smithi172 ceph-mon[103574]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:17.757 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-18T14:00:17.758 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:17.758 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:17 smithi158 ceph-mon[103317]: Deploying daemon osd.7 on smithi158 2023-10-18T14:00:18.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-18T14:00:18.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:18.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:17 smithi172 ceph-mon[103574]: Deploying daemon osd.7 on smithi158 2023-10-18T14:00:18.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-18T14:00:18.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:18.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:17 smithi114 ceph-mon[99494]: Deploying daemon osd.7 on smithi158 2023-10-18T14:00:19.002 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:18 smithi158 ceph-mon[103317]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:19.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:18 smithi172 ceph-mon[103574]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:18 smithi114 ceph-mon[99494]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:20.887 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:20 smithi158 ceph-mon[103317]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:21.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:20 smithi172 ceph-mon[103574]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:20 smithi114 ceph-mon[99494]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:22.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:22 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:22.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:22 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:22.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:22 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:22.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:22 smithi158 ceph-mon[103317]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:22.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:22 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:22.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:22 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:22.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:22 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:22.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:22 smithi172 ceph-mon[103574]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:22.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:22 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:22.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:22 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:22.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:22 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:22.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:22 smithi114 ceph-mon[99494]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:24.002 INFO:teuthology.orchestra.run.smithi158.stdout:Created osd(s) 7 on host 'smithi158' 2023-10-18T14:00:24.002 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:23.997+0000 7fb676ffd700 1 -- 172.21.15.158:0/986096069 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb68004e530 con 0x7fb66c0a14d0 2023-10-18T14:00:24.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:24.000+0000 7fb688152700 1 -- 172.21.15.158:0/986096069 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb66c0a14d0 msgr2=0x7fb66c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:24.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:24.000+0000 7fb688152700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb66c0a14d0 0x7fb66c0a3990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb680197bc0 tx=0x7fb67c00a380 comp rx=0 tx=0).stop 2023-10-18T14:00:24.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:24.000+0000 7fb688152700 1 -- 172.21.15.158:0/986096069 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680068190 msgr2=0x7fb68019c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:24.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:24.000+0000 7fb688152700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680068190 0x7fb68019c8c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb670000c00 tx=0x7fb67000f7d0 comp rx=0 tx=0).stop 2023-10-18T14:00:24.004 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:24.000+0000 7fb688152700 1 -- 172.21.15.158:0/986096069 shutdown_connections 2023-10-18T14:00:24.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:24.000+0000 7fb688152700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb66c0a14d0 0x7fb66c0a3990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:24.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:24.000+0000 7fb688152700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801067a0 0x7fb680196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:24.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:24.000+0000 7fb688152700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680068190 0x7fb68019c8c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:24.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:24.000+0000 7fb688152700 1 --2- 172.21.15.158:0/986096069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb680068b30 0x7fb68019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:24.005 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:24.000+0000 7fb688152700 1 -- 172.21.15.158:0/986096069 >> 172.21.15.158:0/986096069 conn(0x7fb680075790 msgr2=0x7fb6800fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:00:24.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:24.000+0000 7fb688152700 1 -- 172.21.15.158:0/986096069 shutdown_connections 2023-10-18T14:00:24.006 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:00:24.000+0000 7fb688152700 1 -- 172.21.15.158:0/986096069 wait complete. 2023-10-18T14:00:24.508 DEBUG:teuthology.orchestra.run.smithi158:osd.7> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.7.service 2023-10-18T14:00:24.511 INFO:tasks.cephadm:Deploying osd.8 on smithi172 with /dev/vg_nvme/lv_2... 2023-10-18T14:00:24.511 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-18T14:00:24.543 INFO:journalctl@ceph.osd.7.smithi158.stdout:-- Logs begin at Wed 2023-10-18 13:41:14 UTC. -- 2023-10-18T14:00:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:24 smithi158 ceph-mon[103317]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:24.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:24.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:24.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:24.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:24 smithi172 ceph-mon[103574]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:24.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:24.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:24.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:24.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:24.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:24 smithi114 ceph-mon[99494]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:24.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:24.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:24.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:24.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:25.082 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T14:00:25.271 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:00:25 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:00:25.156+0000 7f9e93587640 -1 osd.7 0 log_to_monitors true 2023-10-18T14:00:25.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:25 smithi158 ceph-mon[103317]: from='osd.7 [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-18T14:00:25.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:25 smithi158 ceph-mon[103317]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-18T14:00:25.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:25 smithi172 ceph-mon[103574]: from='osd.7 [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-18T14:00:25.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:25 smithi172 ceph-mon[103574]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-18T14:00:25.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:25 smithi114 ceph-mon[99494]: from='osd.7 [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-18T14:00:25.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:25 smithi114 ceph-mon[99494]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-18T14:00:26.552 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:26 smithi172 ceph-mon[103574]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:26.552 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:26 smithi172 ceph-mon[103574]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-18T14:00:26.553 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:26 smithi172 ceph-mon[103574]: from='osd.7 [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T14:00:26.553 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:26 smithi172 ceph-mon[103574]: osdmap e49: 8 total, 7 up, 8 in 2023-10-18T14:00:26.553 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:26.553 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:26 smithi172 ceph-mon[103574]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T14:00:26.570 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-18T14:00:26.570 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-18T14:00:26.570 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2023-10-18T14:00:26.570 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2023-10-18T14:00:26.571 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.021358 s, 491 MB/s 2023-10-18T14:00:26.571 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2023-10-18T14:00:26.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:26 smithi114 ceph-mon[99494]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:26.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:26 smithi114 ceph-mon[99494]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-18T14:00:26.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:26 smithi114 ceph-mon[99494]: from='osd.7 [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T14:00:26.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:26 smithi114 ceph-mon[99494]: osdmap e49: 8 total, 7 up, 8 in 2023-10-18T14:00:26.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:26.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:26 smithi114 ceph-mon[99494]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T14:00:26.873 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:26 smithi158 ceph-mon[103317]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:26.873 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:26 smithi158 ceph-mon[103317]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-18T14:00:26.873 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:26 smithi158 ceph-mon[103317]: from='osd.7 [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T14:00:26.874 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:26 smithi158 ceph-mon[103317]: osdmap e49: 8 total, 7 up, 8 in 2023-10-18T14:00:26.874 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:26.874 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:26 smithi158 ceph-mon[103317]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T14:00:26.874 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:00:26 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:00:26.544+0000 7f9e88bfe700 -1 osd.7 0 waiting for initial osdmap 2023-10-18T14:00:26.875 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:00:26 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:00:26.555+0000 7f9e841f2700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T14:00:26.936 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2023-10-18T14:00:27.497 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T14:00:27.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]': finished 2023-10-18T14:00:27.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: osdmap e50: 8 total, 7 up, 8 in 2023-10-18T14:00:27.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:27.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:27.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:27.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:27.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:27.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:27.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:27.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:27.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:27.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:27.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:27.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:27.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:27.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:27.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:27 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:27.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]': finished 2023-10-18T14:00:27.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: osdmap e50: 8 total, 7 up, 8 in 2023-10-18T14:00:27.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:27.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:27.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:27.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:27.842 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:27.842 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:27.842 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:27.842 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:27.842 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:27.843 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:27.843 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:27.843 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:27.843 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:27.843 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:27.844 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:27 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:28.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]': finished 2023-10-18T14:00:28.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: osdmap e50: 8 total, 7 up, 8 in 2023-10-18T14:00:28.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:28.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:28.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:28.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:28.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:28.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:28.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:28.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:28.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:28.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:28.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:28.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:28.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:28.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:28.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:27 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:28.705 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.700+0000 7fdff6975700 1 -- 172.21.15.172:0/1833319999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdff00ffa10 msgr2=0x7fdff00ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:28.705 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.700+0000 7fdff6975700 1 --2- 172.21.15.172:0/1833319999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdff00ffa10 0x7fdff00ffe90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009990 tx=0x7fdfd8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:00:28.705 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.700+0000 7fdff6975700 1 -- 172.21.15.172:0/1833319999 shutdown_connections 2023-10-18T14:00:28.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.700+0000 7fdff6975700 1 --2- 172.21.15.172:0/1833319999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff01003d0 0x7fdff010c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:28.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.700+0000 7fdff6975700 1 --2- 172.21.15.172:0/1833319999 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdff0105760 0x7fdff0105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:28.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.700+0000 7fdff6975700 1 --2- 172.21.15.172:0/1833319999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdff00ffa10 0x7fdff00ffe90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:28.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.700+0000 7fdff6975700 1 -- 172.21.15.172:0/1833319999 >> 172.21.15.172:0/1833319999 conn(0x7fdff0076490 msgr2=0x7fdff00768a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:00:28.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.700+0000 7fdff6975700 1 -- 172.21.15.172:0/1833319999 shutdown_connections 2023-10-18T14:00:28.707 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.700+0000 7fdff6975700 1 -- 172.21.15.172:0/1833319999 wait complete. 2023-10-18T14:00:28.707 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.701+0000 7fdff6975700 1 Processor -- start 2023-10-18T14:00:28.707 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.701+0000 7fdff6975700 1 -- start start 2023-10-18T14:00:28.709 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdff6975700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdff00ffa10 0x7fdff01979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:00:28.709 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdff6975700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdff01003d0 0x7fdff0197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:00:28.710 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdff6975700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff0105760 0x7fdff01a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:00:28.710 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdff6975700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff01987c0 con 0x7fdff0105760 2023-10-18T14:00:28.710 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdff6975700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff01a2f80 con 0x7fdff00ffa10 2023-10-18T14:00:28.710 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdff6975700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff01a30c0 con 0x7fdff01003d0 2023-10-18T14:00:28.710 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfef7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdff01003d0 0x7fdff0197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:00:28.711 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfef7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdff01003d0 0x7fdff0197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55258/0 (socket says 172.21.15.172:55258) 2023-10-18T14:00:28.711 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfef7fe700 1 -- 172.21.15.172:0/2093667227 learned_addr learned my addr 172.21.15.172:0/2093667227 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T14:00:28.711 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfeffff700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdff00ffa10 0x7fdff01979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:00:28.711 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdff4f12700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff0105760 0x7fdff01a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:00:28.711 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfef7fe700 1 -- 172.21.15.172:0/2093667227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdff00ffa10 msgr2=0x7fdff01979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:28.712 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfef7fe700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdff00ffa10 0x7fdff01979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:28.712 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfef7fe700 1 -- 172.21.15.172:0/2093667227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff0105760 msgr2=0x7fdff01a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:28.712 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfef7fe700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff0105760 0x7fdff01a2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:28.712 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfef7fe700 1 -- 172.21.15.172:0/2093667227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd80095f0 con 0x7fdff01003d0 2023-10-18T14:00:28.712 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfeffff700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdff00ffa10 0x7fdff01979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:00:28.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdff4f12700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff0105760 0x7fdff01a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:00:28.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfef7fe700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdff01003d0 0x7fdff0197f00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80098e0 tx=0x7fdfd800f720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:00:28.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfed7fa700 1 -- 172.21.15.172:0/2093667227 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd801d070 con 0x7fdff01003d0 2023-10-18T14:00:28.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdff6975700 1 -- 172.21.15.172:0/2093667227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff01a32e0 con 0x7fdff01003d0 2023-10-18T14:00:28.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfed7fa700 1 -- 172.21.15.172:0/2093667227 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdfd800fb90 con 0x7fdff01003d0 2023-10-18T14:00:28.714 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.702+0000 7fdfed7fa700 1 -- 172.21.15.172:0/2093667227 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8017650 con 0x7fdff01003d0 2023-10-18T14:00:28.714 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.703+0000 7fdff6975700 1 -- 172.21.15.172:0/2093667227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff01a36f0 con 0x7fdff01003d0 2023-10-18T14:00:28.714 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.703+0000 7fdff6975700 1 -- 172.21.15.172:0/2093667227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff0107bb0 con 0x7fdff01003d0 2023-10-18T14:00:28.714 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.705+0000 7fdfed7fa700 1 -- 172.21.15.172:0/2093667227 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fdfd800fd00 con 0x7fdff01003d0 2023-10-18T14:00:28.714 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.705+0000 7fdfed7fa700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdfdc0a14d0 0x7fdfdc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:00:28.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.705+0000 7fdfed7fa700 1 -- 172.21.15.172:0/2093667227 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5641+0+0 (secure 0 0 0) 0x7fdfd80cd3d0 con 0x7fdff01003d0 2023-10-18T14:00:28.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.705+0000 7fdfeffff700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdfdc0a14d0 0x7fdfdc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:00:28.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.706+0000 7fdfeffff700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdfdc0a14d0 0x7fdfdc0a3990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0005fd0 tx=0x7fdfe0005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:00:28.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.709+0000 7fdfed7fa700 1 -- 172.21.15.172:0/2093667227 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdfd8097530 con 0x7fdff01003d0 2023-10-18T14:00:28.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:28 smithi172 ceph-mon[103574]: purged_snaps scrub starts 2023-10-18T14:00:28.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:28 smithi172 ceph-mon[103574]: purged_snaps scrub ok 2023-10-18T14:00:28.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:28 smithi172 ceph-mon[103574]: Detected new or changed devices on smithi158 2023-10-18T14:00:28.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:28 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi158 to 5722M 2023-10-18T14:00:28.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:28 smithi172 ceph-mon[103574]: pgmap v138: 1 pgs: 1 unknown; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:28.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:28 smithi172 ceph-mon[103574]: osd.7 [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303] boot 2023-10-18T14:00:28.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:28 smithi172 ceph-mon[103574]: osdmap e51: 8 total, 8 up, 8 in 2023-10-18T14:00:28.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:28 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:28.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:28 smithi172 ceph-mon[103574]: osdmap e52: 8 total, 8 up, 8 in 2023-10-18T14:00:28.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:28 smithi114 ceph-mon[99494]: purged_snaps scrub starts 2023-10-18T14:00:28.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:28 smithi114 ceph-mon[99494]: purged_snaps scrub ok 2023-10-18T14:00:28.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:28 smithi114 ceph-mon[99494]: Detected new or changed devices on smithi158 2023-10-18T14:00:28.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:28 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi158 to 5722M 2023-10-18T14:00:28.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:28 smithi114 ceph-mon[99494]: pgmap v138: 1 pgs: 1 unknown; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:28.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:28 smithi114 ceph-mon[99494]: osd.7 [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303] boot 2023-10-18T14:00:28.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:28 smithi114 ceph-mon[99494]: osdmap e51: 8 total, 8 up, 8 in 2023-10-18T14:00:28.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:28 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:28.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:28 smithi114 ceph-mon[99494]: osdmap e52: 8 total, 8 up, 8 in 2023-10-18T14:00:28.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:28.906+0000 7fdff6975700 1 -- 172.21.15.172:0/2093667227 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fdff0069420 con 0x7fdfdc0a14d0 2023-10-18T14:00:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:28 smithi158 ceph-mon[103317]: purged_snaps scrub starts 2023-10-18T14:00:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:28 smithi158 ceph-mon[103317]: purged_snaps scrub ok 2023-10-18T14:00:29.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:28 smithi158 ceph-mon[103317]: Detected new or changed devices on smithi158 2023-10-18T14:00:29.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:28 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi158 to 5722M 2023-10-18T14:00:29.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:28 smithi158 ceph-mon[103317]: pgmap v138: 1 pgs: 1 unknown; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-18T14:00:29.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:28 smithi158 ceph-mon[103317]: osd.7 [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303] boot 2023-10-18T14:00:29.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:28 smithi158 ceph-mon[103317]: osdmap e51: 8 total, 8 up, 8 in 2023-10-18T14:00:29.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:28 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-18T14:00:29.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:28 smithi158 ceph-mon[103317]: osdmap e52: 8 total, 8 up, 8 in 2023-10-18T14:00:29.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:29 smithi172 ceph-mon[103574]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:00:29.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:29 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:00:29.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:29 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:00:29.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:29 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:29.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:29 smithi172 ceph-mon[103574]: osdmap e53: 8 total, 8 up, 8 in 2023-10-18T14:00:29.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:29 smithi114 ceph-mon[99494]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:00:29.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:29 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:00:29.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:29 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:00:29.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:29 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:29.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:29 smithi114 ceph-mon[99494]: osdmap e53: 8 total, 8 up, 8 in 2023-10-18T14:00:30.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:29 smithi158 ceph-mon[103317]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:00:30.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:29 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:00:30.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:29 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:00:30.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:29 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:30.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:29 smithi158 ceph-mon[103317]: osdmap e53: 8 total, 8 up, 8 in 2023-10-18T14:00:30.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:30 smithi172 ceph-mon[103574]: pgmap v142: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:30.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:30 smithi172 ceph-mon[103574]: osdmap e54: 8 total, 8 up, 8 in 2023-10-18T14:00:30.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:30 smithi114 ceph-mon[99494]: pgmap v142: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:30.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:30 smithi114 ceph-mon[99494]: osdmap e54: 8 total, 8 up, 8 in 2023-10-18T14:00:31.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:30 smithi158 ceph-mon[103317]: pgmap v142: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:31.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:30 smithi158 ceph-mon[103317]: osdmap e54: 8 total, 8 up, 8 in 2023-10-18T14:00:31.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:31 smithi114 ceph-mon[99494]: from='client.? 172.21.15.172:0/4272294401' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c96c813e-f792-48c5-abf5-c11fc3a69a29"}]: dispatch 2023-10-18T14:00:31.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:31 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c96c813e-f792-48c5-abf5-c11fc3a69a29"}]: dispatch 2023-10-18T14:00:31.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:31 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c96c813e-f792-48c5-abf5-c11fc3a69a29"}]': finished 2023-10-18T14:00:31.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:31 smithi114 ceph-mon[99494]: osdmap e55: 9 total, 8 up, 9 in 2023-10-18T14:00:31.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:31 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:32.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:31 smithi158 ceph-mon[103317]: from='client.? 172.21.15.172:0/4272294401' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c96c813e-f792-48c5-abf5-c11fc3a69a29"}]: dispatch 2023-10-18T14:00:32.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:31 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c96c813e-f792-48c5-abf5-c11fc3a69a29"}]: dispatch 2023-10-18T14:00:32.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:31 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c96c813e-f792-48c5-abf5-c11fc3a69a29"}]': finished 2023-10-18T14:00:32.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:31 smithi158 ceph-mon[103317]: osdmap e55: 9 total, 8 up, 9 in 2023-10-18T14:00:32.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:31 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:32.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:31 smithi172 ceph-mon[103574]: from='client.? 172.21.15.172:0/4272294401' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c96c813e-f792-48c5-abf5-c11fc3a69a29"}]: dispatch 2023-10-18T14:00:32.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:31 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c96c813e-f792-48c5-abf5-c11fc3a69a29"}]: dispatch 2023-10-18T14:00:32.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:31 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c96c813e-f792-48c5-abf5-c11fc3a69a29"}]': finished 2023-10-18T14:00:32.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:31 smithi172 ceph-mon[103574]: osdmap e55: 9 total, 8 up, 9 in 2023-10-18T14:00:32.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:31 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:32.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:32 smithi114 ceph-mon[99494]: pgmap v145: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:32.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:32 smithi114 ceph-mon[99494]: from='client.? 172.21.15.172:0/378449570' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:00:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:32 smithi158 ceph-mon[103317]: pgmap v145: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:32 smithi158 ceph-mon[103317]: from='client.? 172.21.15.172:0/378449570' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:00:33.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:32 smithi172 ceph-mon[103574]: pgmap v145: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:33.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:32 smithi172 ceph-mon[103574]: from='client.? 172.21.15.172:0/378449570' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:00:34.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:34 smithi158 ceph-mon[103317]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:34.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:34 smithi172 ceph-mon[103574]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:34.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:34 smithi114 ceph-mon[99494]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:37.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:36 smithi158 ceph-mon[103317]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:37.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:36 smithi172 ceph-mon[103574]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:37.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:36 smithi114 ceph-mon[99494]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:38.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:38 smithi172 ceph-mon[103574]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:38.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-18T14:00:38.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:38.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:38 smithi172 ceph-mon[103574]: Deploying daemon osd.8 on smithi172 2023-10-18T14:00:39.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:38 smithi158 ceph-mon[103317]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:39.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-18T14:00:39.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:39.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:38 smithi158 ceph-mon[103317]: Deploying daemon osd.8 on smithi172 2023-10-18T14:00:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:38 smithi114 ceph-mon[99494]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-18T14:00:39.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:39.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:38 smithi114 ceph-mon[99494]: Deploying daemon osd.8 on smithi172 2023-10-18T14:00:41.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:40 smithi158 ceph-mon[103317]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:41.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:40 smithi172 ceph-mon[103574]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:41.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:40 smithi114 ceph-mon[99494]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:42.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:42 smithi172 ceph-mon[103574]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:42.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:42.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:42.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:43.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:42 smithi158 ceph-mon[103317]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:43.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:43.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:43.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:42 smithi114 ceph-mon[99494]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:43.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:43.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:44.496 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:44 smithi172 ceph-mon[103574]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:44.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:44 smithi158 ceph-mon[103317]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:44.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:44 smithi114 ceph-mon[99494]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:44.768 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 8 on host 'smithi172' 2023-10-18T14:00:44.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:44.765+0000 7fdfed7fa700 1 -- 172.21.15.172:0/2093667227 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdff0069420 con 0x7fdfdc0a14d0 2023-10-18T14:00:44.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:44.767+0000 7fdff6975700 1 -- 172.21.15.172:0/2093667227 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdfdc0a14d0 msgr2=0x7fdfdc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:44.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:44.767+0000 7fdff6975700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdfdc0a14d0 0x7fdfdc0a3990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0005fd0 tx=0x7fdfe0005ee0 comp rx=0 tx=0).stop 2023-10-18T14:00:44.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:44.767+0000 7fdff6975700 1 -- 172.21.15.172:0/2093667227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdff01003d0 msgr2=0x7fdff0197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:44.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:44.767+0000 7fdff6975700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdff01003d0 0x7fdff0197f00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80098e0 tx=0x7fdfd800f720 comp rx=0 tx=0).stop 2023-10-18T14:00:44.771 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:44.767+0000 7fdff6975700 1 -- 172.21.15.172:0/2093667227 shutdown_connections 2023-10-18T14:00:44.771 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:44.767+0000 7fdff6975700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdfdc0a14d0 0x7fdfdc0a3990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:44.771 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:44.767+0000 7fdff6975700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff0105760 0x7fdff01a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:44.771 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:44.767+0000 7fdff6975700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdff00ffa10 0x7fdff01979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:44.771 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:44.767+0000 7fdff6975700 1 --2- 172.21.15.172:0/2093667227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdff01003d0 0x7fdff0197f00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:44.772 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:44.767+0000 7fdff6975700 1 -- 172.21.15.172:0/2093667227 >> 172.21.15.172:0/2093667227 conn(0x7fdff0076490 msgr2=0x7fdff00fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:00:44.772 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:44.767+0000 7fdff6975700 1 -- 172.21.15.172:0/2093667227 shutdown_connections 2023-10-18T14:00:44.772 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:00:44.767+0000 7fdff6975700 1 -- 172.21.15.172:0/2093667227 wait complete. 2023-10-18T14:00:45.191 DEBUG:teuthology.orchestra.run.smithi172:osd.8> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.8.service 2023-10-18T14:00:45.193 INFO:tasks.cephadm:Deploying osd.9 on smithi114 with /dev/vg_nvme/lv_1... 2023-10-18T14:00:45.194 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-18T14:00:45.225 INFO:journalctl@ceph.osd.8.smithi172.stdout:-- Logs begin at Wed 2023-10-18 13:40:49 UTC. -- 2023-10-18T14:00:45.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:45.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:45.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:45.694 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.694 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.694 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:45.694 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:45.695 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.695 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.695 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.695 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:45.768 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:00:45.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:45.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:45.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:45.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:00:46.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:00:46 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:00:46.046+0000 7f69d7b9e640 -1 osd.8 0 log_to_monitors true 2023-10-18T14:00:46.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:46 smithi114 ceph-mon[99494]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:46.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:46 smithi114 ceph-mon[99494]: from='osd.8 [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-18T14:00:46.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:46 smithi114 ceph-mon[99494]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-18T14:00:46.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:46 smithi158 ceph-mon[103317]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:46.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:46 smithi158 ceph-mon[103317]: from='osd.8 [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-18T14:00:46.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:46 smithi158 ceph-mon[103317]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-18T14:00:46.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:46 smithi172 ceph-mon[103574]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:46.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:46 smithi172 ceph-mon[103574]: from='osd.8 [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-18T14:00:46.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:46 smithi172 ceph-mon[103574]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-18T14:00:47.259 INFO:teuthology.orchestra.run.smithi114.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-18T14:00:47.260 INFO:teuthology.orchestra.run.smithi114.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-18T14:00:47.260 INFO:teuthology.orchestra.run.smithi114.stderr: stderr: 10+0 records in 2023-10-18T14:00:47.260 INFO:teuthology.orchestra.run.smithi114.stderr:10+0 records out 2023-10-18T14:00:47.260 INFO:teuthology.orchestra.run.smithi114.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110929 s, 945 MB/s 2023-10-18T14:00:47.261 INFO:teuthology.orchestra.run.smithi114.stderr:--> Zapping successful for: 2023-10-18T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:47 smithi114 ceph-mon[99494]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-18T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:47 smithi114 ceph-mon[99494]: osdmap e56: 9 total, 8 up, 9 in 2023-10-18T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:47 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:47 smithi114 ceph-mon[99494]: from='osd.8 [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:47 smithi114 ceph-mon[99494]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T14:00:47.611 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi114:vg_nvme/lv_1 2023-10-18T14:00:47.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:47 smithi158 ceph-mon[103317]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-18T14:00:47.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:47 smithi158 ceph-mon[103317]: osdmap e56: 9 total, 8 up, 9 in 2023-10-18T14:00:47.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:47 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:47.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:47 smithi158 ceph-mon[103317]: from='osd.8 [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T14:00:47.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:47 smithi158 ceph-mon[103317]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T14:00:47.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:47 smithi172 ceph-mon[103574]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-18T14:00:47.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:47 smithi172 ceph-mon[103574]: osdmap e56: 9 total, 8 up, 9 in 2023-10-18T14:00:47.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:47 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:47.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:47 smithi172 ceph-mon[103574]: from='osd.8 [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T14:00:47.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:47 smithi172 ceph-mon[103574]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T14:00:47.811 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:00:47 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:00:47.452+0000 7f69cd215700 -1 osd.8 0 waiting for initial osdmap 2023-10-18T14:00:47.811 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:00:47 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:00:47.463+0000 7f69c900a700 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T14:00:48.168 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:00:48.695 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-10-18T14:00:48.696 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: osdmap e57: 9 total, 8 up, 9 in 2023-10-18T14:00:48.696 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:48.696 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:48.696 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:48.697 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: Detected new or changed devices on smithi172 2023-10-18T14:00:48.697 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:48.697 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:48.697 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:48.697 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:48.698 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:48.698 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi172 to 5722M 2023-10-18T14:00:48.698 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:48.698 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:48.698 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:48.699 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:48.699 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: osd.8 [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640] boot 2023-10-18T14:00:48.699 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: osdmap e58: 9 total, 9 up, 9 in 2023-10-18T14:00:48.699 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:48.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-10-18T14:00:48.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: osdmap e57: 9 total, 8 up, 9 in 2023-10-18T14:00:48.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:48.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:48.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:48.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: Detected new or changed devices on smithi172 2023-10-18T14:00:48.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:48.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:48.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:48.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:48.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:48.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi172 to 5722M 2023-10-18T14:00:48.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:48.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:48.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:48.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:48.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: osd.8 [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640] boot 2023-10-18T14:00:48.776 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: osdmap e58: 9 total, 9 up, 9 in 2023-10-18T14:00:48.776 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:48.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-10-18T14:00:48.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: osdmap e57: 9 total, 8 up, 9 in 2023-10-18T14:00:48.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:48.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:48.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-18T14:00:48.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: Detected new or changed devices on smithi172 2023-10-18T14:00:48.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:48.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:48.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:48.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:48.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:00:48.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi172 to 5722M 2023-10-18T14:00:48.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:48.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:48.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:00:48.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:00:48.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: osd.8 [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640] boot 2023-10-18T14:00:48.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: osdmap e58: 9 total, 9 up, 9 in 2023-10-18T14:00:48.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-18T14:00:49.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.355+0000 7f21fc9a7700 1 -- 172.21.15.114:0/3475257406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21f8068a90 msgr2=0x7f21f8068f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:49.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.355+0000 7f21fc9a7700 1 --2- 172.21.15.114:0/3475257406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21f8068a90 0x7f21f8068f10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f21e80099c0 tx=0x7f21e8009cd0 comp rx=0 tx=0).stop 2023-10-18T14:00:49.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.355+0000 7f21fc9a7700 1 -- 172.21.15.114:0/3475257406 shutdown_connections 2023-10-18T14:00:49.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.355+0000 7f21fc9a7700 1 --2- 172.21.15.114:0/3475257406 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21f8069450 0x7f21f810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.355+0000 7f21fc9a7700 1 --2- 172.21.15.114:0/3475257406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21f8105670 0x7f21f8105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.355+0000 7f21fc9a7700 1 --2- 172.21.15.114:0/3475257406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21f8068a90 0x7f21f8068f10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.355+0000 7f21fc9a7700 1 -- 172.21.15.114:0/3475257406 >> 172.21.15.114:0/3475257406 conn(0x7f21f80766c0 msgr2=0x7f21f8076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:00:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.355+0000 7f21fc9a7700 1 -- 172.21.15.114:0/3475257406 shutdown_connections 2023-10-18T14:00:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.355+0000 7f21fc9a7700 1 -- 172.21.15.114:0/3475257406 wait complete. 2023-10-18T14:00:49.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.356+0000 7f21fc9a7700 1 Processor -- start 2023-10-18T14:00:49.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.356+0000 7f21fc9a7700 1 -- start start 2023-10-18T14:00:49.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.356+0000 7f21fc9a7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21f8068a90 0x7f21f819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:00:49.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.356+0000 7f21fc9a7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21f8069450 0x7f21f819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:00:49.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.356+0000 7f21fc9a7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21f8105670 0x7f21f8196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:00:49.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.356+0000 7f21fc9a7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f81970b0 con 0x7f21f8069450 2023-10-18T14:00:49.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.356+0000 7f21fc9a7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8197220 con 0x7f21f8068a90 2023-10-18T14:00:49.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.356+0000 7f21fc9a7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f81973e0 con 0x7f21f8105670 2023-10-18T14:00:49.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.356+0000 7f21f5d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21f8069450 0x7f21f819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:00:49.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.356+0000 7f21f5d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21f8069450 0x7f21f819ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41822/0 (socket says 172.21.15.114:41822) 2023-10-18T14:00:49.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.356+0000 7f21f5d9b700 1 -- 172.21.15.114:0/1464730200 learned_addr learned my addr 172.21.15.114:0/1464730200 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:00:49.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21f659c700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21f8068a90 0x7f21f819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:00:49.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21f6d9d700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21f8105670 0x7f21f8196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:00:49.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21f5d9b700 1 -- 172.21.15.114:0/1464730200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21f8105670 msgr2=0x7f21f8196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:49.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21f5d9b700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21f8105670 0x7f21f8196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:49.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21f5d9b700 1 -- 172.21.15.114:0/1464730200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21f8068a90 msgr2=0x7f21f819c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:00:49.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21f5d9b700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21f8068a90 0x7f21f819c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:00:49.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21f5d9b700 1 -- 172.21.15.114:0/1464730200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e80095f0 con 0x7f21f8069450 2023-10-18T14:00:49.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21f659c700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21f8068a90 0x7f21f819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:00:49.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21f5d9b700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21f8069450 0x7f21f819ce50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21e80098e0 tx=0x7f21e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:00:49.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21e77fe700 1 -- 172.21.15.114:0/1464730200 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e801d070 con 0x7f21f8069450 2023-10-18T14:00:49.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21fc9a7700 1 -- 172.21.15.114:0/1464730200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f8197660 con 0x7f21f8069450 2023-10-18T14:00:49.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21e77fe700 1 -- 172.21.15.114:0/1464730200 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21e800fbb0 con 0x7f21f8069450 2023-10-18T14:00:49.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21e77fe700 1 -- 172.21.15.114:0/1464730200 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8022d40 con 0x7f21f8069450 2023-10-18T14:00:49.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.357+0000 7f21fc9a7700 1 -- 172.21.15.114:0/1464730200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f81a3900 con 0x7f21f8069450 2023-10-18T14:00:49.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.358+0000 7f21fc9a7700 1 -- 172.21.15.114:0/1464730200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f8108d30 con 0x7f21f8069450 2023-10-18T14:00:49.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.360+0000 7f21e77fe700 1 -- 172.21.15.114:0/1464730200 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f21e800fd20 con 0x7f21f8069450 2023-10-18T14:00:49.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.360+0000 7f21e77fe700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f21e00a14d0 0x7f21e00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:00:49.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.360+0000 7f21f659c700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f21e00a14d0 0x7f21e00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:00:49.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.361+0000 7f21e77fe700 1 -- 172.21.15.114:0/1464730200 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f21e80cdfc0 con 0x7f21f8069450 2023-10-18T14:00:49.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.361+0000 7f21f659c700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f21e00a14d0 0x7f21e00a3990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0099d0 tx=0x7f21ec008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:00:49.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.364+0000 7f21e77fe700 1 -- 172.21.15.114:0/1464730200 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f21e8097f70 con 0x7f21f8069450 2023-10-18T14:00:49.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:00:49.562+0000 7f21fc9a7700 1 -- 172.21.15.114:0/1464730200 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f21f804e560 con 0x7f21e00a14d0 2023-10-18T14:00:49.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:49 smithi158 ceph-mon[103317]: purged_snaps scrub starts 2023-10-18T14:00:49.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:49 smithi158 ceph-mon[103317]: purged_snaps scrub ok 2023-10-18T14:00:49.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:49 smithi158 ceph-mon[103317]: osdmap e59: 9 total, 9 up, 9 in 2023-10-18T14:00:49.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:49 smithi172 ceph-mon[103574]: purged_snaps scrub starts 2023-10-18T14:00:49.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:49 smithi172 ceph-mon[103574]: purged_snaps scrub ok 2023-10-18T14:00:49.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:49 smithi172 ceph-mon[103574]: osdmap e59: 9 total, 9 up, 9 in 2023-10-18T14:00:49.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:49 smithi114 ceph-mon[99494]: purged_snaps scrub starts 2023-10-18T14:00:49.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:49 smithi114 ceph-mon[99494]: purged_snaps scrub ok 2023-10-18T14:00:49.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:49 smithi114 ceph-mon[99494]: osdmap e59: 9 total, 9 up, 9 in 2023-10-18T14:00:50.711 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:50 smithi114 ceph-mon[99494]: pgmap v158: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:00:50.712 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:50 smithi114 ceph-mon[99494]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:00:50.712 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:50 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:00:50.712 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:50 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:00:50.713 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:50 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:50.713 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:50 smithi114 ceph-mon[99494]: osdmap e60: 9 total, 9 up, 9 in 2023-10-18T14:00:50.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:50 smithi158 ceph-mon[103317]: pgmap v158: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:00:50.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:50 smithi158 ceph-mon[103317]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:00:50.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:50 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:00:50.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:50 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:00:50.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:50 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:50.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:50 smithi158 ceph-mon[103317]: osdmap e60: 9 total, 9 up, 9 in 2023-10-18T14:00:50.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:50 smithi172 ceph-mon[103574]: pgmap v158: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:00:50.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:50 smithi172 ceph-mon[103574]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:00:50.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:50 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:00:50.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:50 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:00:50.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:50 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:00:50.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:50 smithi172 ceph-mon[103574]: osdmap e60: 9 total, 9 up, 9 in 2023-10-18T14:00:52.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:52 smithi158 ceph-mon[103317]: osdmap e61: 9 total, 9 up, 9 in 2023-10-18T14:00:52.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:52 smithi158 ceph-mon[103317]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:00:52.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:52 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3713157685' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08e69155-0486-455e-8286-a8cff49f0f73"}]: dispatch 2023-10-18T14:00:52.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:52 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3713157685' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08e69155-0486-455e-8286-a8cff49f0f73"}]': finished 2023-10-18T14:00:52.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:52 smithi158 ceph-mon[103317]: osdmap e62: 10 total, 9 up, 10 in 2023-10-18T14:00:52.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:52 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:00:52.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:52 smithi172 ceph-mon[103574]: osdmap e61: 9 total, 9 up, 9 in 2023-10-18T14:00:52.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:52 smithi172 ceph-mon[103574]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:00:52.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:52 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3713157685' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08e69155-0486-455e-8286-a8cff49f0f73"}]: dispatch 2023-10-18T14:00:52.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:52 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3713157685' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08e69155-0486-455e-8286-a8cff49f0f73"}]': finished 2023-10-18T14:00:52.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:52 smithi172 ceph-mon[103574]: osdmap e62: 10 total, 9 up, 10 in 2023-10-18T14:00:52.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:52 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:00:52.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:52 smithi114 ceph-mon[99494]: osdmap e61: 9 total, 9 up, 9 in 2023-10-18T14:00:52.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:52 smithi114 ceph-mon[99494]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:00:52.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:52 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3713157685' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08e69155-0486-455e-8286-a8cff49f0f73"}]: dispatch 2023-10-18T14:00:52.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:52 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3713157685' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08e69155-0486-455e-8286-a8cff49f0f73"}]': finished 2023-10-18T14:00:52.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:52 smithi114 ceph-mon[99494]: osdmap e62: 10 total, 9 up, 10 in 2023-10-18T14:00:52.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:52 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:00:53.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:53 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2951668433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:00:53.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:53 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2951668433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:00:53.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:53 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2951668433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:00:54.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:54 smithi158 ceph-mon[103317]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 134 KiB/s, 0 objects/s recovering 2023-10-18T14:00:54.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:54 smithi172 ceph-mon[103574]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 134 KiB/s, 0 objects/s recovering 2023-10-18T14:00:54.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:54 smithi114 ceph-mon[99494]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 134 KiB/s, 0 objects/s recovering 2023-10-18T14:00:57.008 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:56 smithi114 ceph-mon[99494]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-18T14:00:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:56 smithi158 ceph-mon[103317]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-18T14:00:57.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:56 smithi172 ceph-mon[103574]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-18T14:00:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:58 smithi158 ceph-mon[103317]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-18T14:00:59.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:58 smithi172 ceph-mon[103574]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-18T14:00:59.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:58 smithi114 ceph-mon[99494]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-18T14:01:00.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:59 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-18T14:01:00.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:59 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:00.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:00:59 smithi158 ceph-mon[103317]: Deploying daemon osd.9 on smithi114 2023-10-18T14:01:00.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:59 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-18T14:01:00.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:59 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:00.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:00:59 smithi172 ceph-mon[103574]: Deploying daemon osd.9 on smithi114 2023-10-18T14:01:00.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:59 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-18T14:01:00.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:59 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:00.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:00:59 smithi114 ceph-mon[99494]: Deploying daemon osd.9 on smithi114 2023-10-18T14:01:00.825 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:00 smithi114 ceph-mon[99494]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-10-18T14:01:01.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:00 smithi158 ceph-mon[103317]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-10-18T14:01:01.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:00 smithi172 ceph-mon[103574]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-10-18T14:01:02.890 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:02 smithi114 ceph-mon[99494]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-18T14:01:03.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:02 smithi158 ceph-mon[103317]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-18T14:01:03.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:02 smithi172 ceph-mon[103574]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-18T14:01:04.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:04 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:04.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:04 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:04.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:04 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:04.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:04 smithi114 ceph-mon[99494]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-18T14:01:04.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:04 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:04.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:04 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:04.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:04 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:04.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:04 smithi158 ceph-mon[103317]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-18T14:01:04.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:04 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:04.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:04 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:04.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:04 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:04.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:04 smithi172 ceph-mon[103574]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-18T14:01:05.967 INFO:teuthology.orchestra.run.smithi114.stdout:Created osd(s) 9 on host 'smithi114' 2023-10-18T14:01:05.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:05.963+0000 7f21e77fe700 1 -- 172.21.15.114:0/1464730200 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f21f804e560 con 0x7f21e00a14d0 2023-10-18T14:01:05.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:05.965+0000 7f21fc9a7700 1 -- 172.21.15.114:0/1464730200 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f21e00a14d0 msgr2=0x7f21e00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:05.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:05.965+0000 7f21fc9a7700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f21e00a14d0 0x7f21e00a3990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0099d0 tx=0x7f21ec008040 comp rx=0 tx=0).stop 2023-10-18T14:01:05.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:05.965+0000 7f21fc9a7700 1 -- 172.21.15.114:0/1464730200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21f8069450 msgr2=0x7f21f819ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:05.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:05.965+0000 7f21fc9a7700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21f8069450 0x7f21f819ce50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21e80098e0 tx=0x7f21e80057f0 comp rx=0 tx=0).stop 2023-10-18T14:01:05.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:05.965+0000 7f21fc9a7700 1 -- 172.21.15.114:0/1464730200 shutdown_connections 2023-10-18T14:01:05.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:05.965+0000 7f21fc9a7700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f21e00a14d0 0x7f21e00a3990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:05.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:05.965+0000 7f21fc9a7700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21f8105670 0x7f21f8196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:05.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:05.965+0000 7f21fc9a7700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f21f8068a90 0x7f21f819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:05.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:05.965+0000 7f21fc9a7700 1 --2- 172.21.15.114:0/1464730200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21f8069450 0x7f21f819ce50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:05.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:05.965+0000 7f21fc9a7700 1 -- 172.21.15.114:0/1464730200 >> 172.21.15.114:0/1464730200 conn(0x7f21f80766c0 msgr2=0x7f21f80fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:01:05.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:05.965+0000 7f21fc9a7700 1 -- 172.21.15.114:0/1464730200 shutdown_connections 2023-10-18T14:01:05.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:05.965+0000 7f21fc9a7700 1 -- 172.21.15.114:0/1464730200 wait complete. 2023-10-18T14:01:06.466 DEBUG:teuthology.orchestra.run.smithi114:osd.9> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.9.service 2023-10-18T14:01:06.468 INFO:tasks.cephadm:Deploying osd.10 on smithi158 with /dev/vg_nvme/lv_1... 2023-10-18T14:01:06.469 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-18T14:01:06.498 INFO:journalctl@ceph.osd.9.smithi114.stdout:-- Logs begin at Wed 2023-10-18 13:40:26 UTC. -- 2023-10-18T14:01:06.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:06 smithi158 ceph-mon[103317]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:01:06.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:06.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:06.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:06.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:06.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:06.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:06.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:06.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:06.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:06 smithi114 ceph-mon[99494]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:01:06.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:06.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:06.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:06.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:06.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:06.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:06.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:06.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:07.045 INFO:teuthology.orchestra.run.smithi158.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-18T14:01:07.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:06 smithi172 ceph-mon[103574]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:01:07.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:07.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:07.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:07.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:07.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:07.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:07.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:07.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:07.243 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:01:07 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:01:07.022+0000 7fbff27b2640 -1 osd.9 0 log_to_monitors true 2023-10-18T14:01:07.780 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:07 smithi114 ceph-mon[99494]: from='osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-18T14:01:08.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:07 smithi158 ceph-mon[103317]: from='osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-18T14:01:08.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:07 smithi172 ceph-mon[103574]: from='osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-18T14:01:08.585 INFO:teuthology.orchestra.run.smithi158.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-18T14:01:08.585 INFO:teuthology.orchestra.run.smithi158.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-18T14:01:08.586 INFO:teuthology.orchestra.run.smithi158.stderr: stderr: 10+0 records in 2023-10-18T14:01:08.586 INFO:teuthology.orchestra.run.smithi158.stderr:10+0 records out 2023-10-18T14:01:08.586 INFO:teuthology.orchestra.run.smithi158.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00822037 s, 1.3 GB/s 2023-10-18T14:01:08.586 INFO:teuthology.orchestra.run.smithi158.stderr: stderr: 2023-10-18T14:01:08.586 INFO:teuthology.orchestra.run.smithi158.stderr:--> Zapping successful for: 2023-10-18T14:01:08.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:08 smithi114 ceph-mon[99494]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:01:08.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:08 smithi114 ceph-mon[99494]: from='osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-18T14:01:08.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:08 smithi114 ceph-mon[99494]: osdmap e63: 10 total, 9 up, 10 in 2023-10-18T14:01:08.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:08 smithi114 ceph-mon[99494]: from='osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2023-10-18T14:01:08.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:01:08.840 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:01:08 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:01:08.626+0000 7fbfe7e29700 -1 osd.9 0 waiting for initial osdmap 2023-10-18T14:01:08.840 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:01:08 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:01:08.639+0000 7fbfe3c1e700 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T14:01:08.930 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:08 smithi158 ceph-mon[103317]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:01:08.930 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:08 smithi158 ceph-mon[103317]: from='osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-18T14:01:08.930 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:08 smithi158 ceph-mon[103317]: osdmap e63: 10 total, 9 up, 10 in 2023-10-18T14:01:08.930 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:08 smithi158 ceph-mon[103317]: from='osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2023-10-18T14:01:08.931 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:01:08.999 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi158:vg_nvme/lv_1 2023-10-18T14:01:09.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:08 smithi172 ceph-mon[103574]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:01:09.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:08 smithi172 ceph-mon[103574]: from='osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-18T14:01:09.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:08 smithi172 ceph-mon[103574]: osdmap e63: 10 total, 9 up, 10 in 2023-10-18T14:01:09.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:08 smithi172 ceph-mon[103574]: from='osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2023-10-18T14:01:09.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:01:09.565 INFO:teuthology.orchestra.run.smithi158.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-18T14:01:09.941 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: from='osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2023-10-18T14:01:09.941 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: osdmap e64: 10 total, 9 up, 10 in 2023-10-18T14:01:09.941 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:01:09.941 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:01:09.942 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:09.942 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:09.942 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:09.942 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:09.942 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:09.943 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:09.943 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:09.943 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:09.943 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:09.943 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:09 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:10.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: from='osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2023-10-18T14:01:10.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: osdmap e64: 10 total, 9 up, 10 in 2023-10-18T14:01:10.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:01:10.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:01:10.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:10.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:10.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:10.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:10.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:10.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:10.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:10.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:10.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:10.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:09 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:10.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: from='osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2023-10-18T14:01:10.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: osdmap e64: 10 total, 9 up, 10 in 2023-10-18T14:01:10.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:01:10.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:01:10.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:10.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:10.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:10.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:10.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:10.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:10.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:10.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:10.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:10.092 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:09 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:10.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.788+0000 7f271bba0700 1 -- 172.21.15.158:0/1851592926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2714101260 msgr2=0x7f271410d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:10.793 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.788+0000 7f271bba0700 1 --2- 172.21.15.158:0/1851592926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2714101260 0x7f271410d650 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f270c00b0a0 tx=0x7f270c00b3b0 comp rx=0 tx=0).stop 2023-10-18T14:01:10.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.788+0000 7f271bba0700 1 -- 172.21.15.158:0/1851592926 shutdown_connections 2023-10-18T14:01:10.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.788+0000 7f271bba0700 1 --2- 172.21.15.158:0/1851592926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2714101260 0x7f271410d650 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:10.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.788+0000 7f271bba0700 1 --2- 172.21.15.158:0/1851592926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27141057c0 0x7f2714105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:10.794 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.788+0000 7f271bba0700 1 --2- 172.21.15.158:0/1851592926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27141008a0 0x7f2714100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:10.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.788+0000 7f271bba0700 1 -- 172.21.15.158:0/1851592926 >> 172.21.15.158:0/1851592926 conn(0x7f27140779e0 msgr2=0x7f2714077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:01:10.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.788+0000 7f271bba0700 1 -- 172.21.15.158:0/1851592926 shutdown_connections 2023-10-18T14:01:10.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.788+0000 7f271bba0700 1 -- 172.21.15.158:0/1851592926 wait complete. 2023-10-18T14:01:10.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271bba0700 1 Processor -- start 2023-10-18T14:01:10.795 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271bba0700 1 -- start start 2023-10-18T14:01:10.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271bba0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27141008a0 0x7f271419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:10.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271bba0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2714101260 0x7f271419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:10.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271bba0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27141057c0 0x7f2714196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:10.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271bba0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27141971a0 con 0x7f27141008a0 2023-10-18T14:01:10.796 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271bba0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2714197310 con 0x7f27141057c0 2023-10-18T14:01:10.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271bba0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27141974d0 con 0x7f2714101260 2023-10-18T14:01:10.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271a13d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27141057c0 0x7f2714196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:10.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271a13d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27141057c0 0x7f2714196b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:35368/0 (socket says 172.21.15.158:35368) 2023-10-18T14:01:10.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271a13d700 1 -- 172.21.15.158:0/4011974255 learned_addr learned my addr 172.21.15.158:0/4011974255 (peer_addr_for_me v2:172.21.15.158:0/0) 2023-10-18T14:01:10.797 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271913b700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2714101260 0x7f271419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:10.798 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271a13d700 1 -- 172.21.15.158:0/4011974255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2714101260 msgr2=0x7f271419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:10.798 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271993c700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27141008a0 0x7f271419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:10.798 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271a13d700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2714101260 0x7f271419cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:10.798 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271a13d700 1 -- 172.21.15.158:0/4011974255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27141008a0 msgr2=0x7f271419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:10.799 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271a13d700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27141008a0 0x7f271419c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:10.799 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.789+0000 7f271a13d700 1 -- 172.21.15.158:0/4011974255 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c009d00 con 0x7f27141057c0 2023-10-18T14:01:10.799 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.790+0000 7f271a13d700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27141057c0 0x7f2714196b30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f270c00b830 tx=0x7f270c007920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:01:10.799 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.790+0000 7f270affd700 1 -- 172.21.15.158:0/4011974255 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c00e040 con 0x7f27141057c0 2023-10-18T14:01:10.799 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.790+0000 7f270affd700 1 -- 172.21.15.158:0/4011974255 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f270c004e60 con 0x7f27141057c0 2023-10-18T14:01:10.800 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.790+0000 7f270affd700 1 -- 172.21.15.158:0/4011974255 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0053c0 con 0x7f27141057c0 2023-10-18T14:01:10.800 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.790+0000 7f271bba0700 1 -- 172.21.15.158:0/4011974255 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2714197750 con 0x7f27141057c0 2023-10-18T14:01:10.800 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.790+0000 7f271bba0700 1 -- 172.21.15.158:0/4011974255 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27141a39e0 con 0x7f27141057c0 2023-10-18T14:01:10.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.791+0000 7f271bba0700 1 -- 172.21.15.158:0/4011974255 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2714108da0 con 0x7f27141057c0 2023-10-18T14:01:10.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.792+0000 7f270affd700 1 -- 172.21.15.158:0/4011974255 <== mon.2 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f270c01baa0 con 0x7f27141057c0 2023-10-18T14:01:10.801 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.793+0000 7f270affd700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f27000a14d0 0x7f27000a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:10.802 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.793+0000 7f270affd700 1 -- 172.21.15.158:0/4011974255 <== mon.2 v2:172.21.15.158:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6476+0+0 (secure 0 0 0) 0x7f270c0ce650 con 0x7f27141057c0 2023-10-18T14:01:10.802 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.793+0000 7f271993c700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f27000a14d0 0x7f27000a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:10.802 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.793+0000 7f271993c700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f27000a14d0 0x7f27000a3990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2714101930 tx=0x7f2704005c70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:01:10.802 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.797+0000 7f270affd700 1 -- 172.21.15.158:0/4011974255 <== mon.2 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f270c098470 con 0x7f27141057c0 2023-10-18T14:01:10.994 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:10.991+0000 7f271bba0700 1 -- 172.21.15.158:0/4011974255 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f271404e560 con 0x7f27000a14d0 2023-10-18T14:01:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:10 smithi158 ceph-mon[103317]: purged_snaps scrub starts 2023-10-18T14:01:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:10 smithi158 ceph-mon[103317]: purged_snaps scrub ok 2023-10-18T14:01:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:10 smithi158 ceph-mon[103317]: Detected new or changed devices on smithi114 2023-10-18T14:01:11.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:10 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi114 to 4292M 2023-10-18T14:01:11.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:10 smithi158 ceph-mon[103317]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:01:11.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:10 smithi158 ceph-mon[103317]: osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633] boot 2023-10-18T14:01:11.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:10 smithi158 ceph-mon[103317]: osdmap e65: 10 total, 10 up, 10 in 2023-10-18T14:01:11.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:10 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:01:11.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:10 smithi172 ceph-mon[103574]: purged_snaps scrub starts 2023-10-18T14:01:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:10 smithi172 ceph-mon[103574]: purged_snaps scrub ok 2023-10-18T14:01:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:10 smithi172 ceph-mon[103574]: Detected new or changed devices on smithi114 2023-10-18T14:01:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:10 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi114 to 4292M 2023-10-18T14:01:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:10 smithi172 ceph-mon[103574]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:01:11.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:10 smithi172 ceph-mon[103574]: osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633] boot 2023-10-18T14:01:11.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:10 smithi172 ceph-mon[103574]: osdmap e65: 10 total, 10 up, 10 in 2023-10-18T14:01:11.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:10 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:01:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:10 smithi114 ceph-mon[99494]: purged_snaps scrub starts 2023-10-18T14:01:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:10 smithi114 ceph-mon[99494]: purged_snaps scrub ok 2023-10-18T14:01:11.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:10 smithi114 ceph-mon[99494]: Detected new or changed devices on smithi114 2023-10-18T14:01:11.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:10 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi114 to 4292M 2023-10-18T14:01:11.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:10 smithi114 ceph-mon[99494]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-18T14:01:11.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:10 smithi114 ceph-mon[99494]: osd.9 [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633] boot 2023-10-18T14:01:11.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:10 smithi114 ceph-mon[99494]: osdmap e65: 10 total, 10 up, 10 in 2023-10-18T14:01:11.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:10 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-18T14:01:11.999 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:11 smithi158 ceph-mon[103317]: osdmap e66: 10 total, 10 up, 10 in 2023-10-18T14:01:12.000 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:11 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:01:12.000 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:11 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:01:12.000 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:11 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:12.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:11 smithi172 ceph-mon[103574]: osdmap e66: 10 total, 10 up, 10 in 2023-10-18T14:01:12.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:11 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:01:12.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:11 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:01:12.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:11 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:12.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:11 smithi114 ceph-mon[99494]: osdmap e66: 10 total, 10 up, 10 in 2023-10-18T14:01:12.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:11 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:01:12.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:11 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:01:12.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:11 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:13.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:12 smithi158 ceph-mon[103317]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:01:13.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:12 smithi158 ceph-mon[103317]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:13.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:12 smithi172 ceph-mon[103574]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:01:13.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:12 smithi172 ceph-mon[103574]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:12 smithi114 ceph-mon[99494]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi158:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:01:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:12 smithi114 ceph-mon[99494]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:14.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:14 smithi158 ceph-mon[103317]: from='client.? 172.21.15.158:0/83067159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f75dcc-ae8d-401c-b2e9-bcde3eeee081"}]: dispatch 2023-10-18T14:01:14.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:14 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f75dcc-ae8d-401c-b2e9-bcde3eeee081"}]: dispatch 2023-10-18T14:01:14.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:14 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0f75dcc-ae8d-401c-b2e9-bcde3eeee081"}]': finished 2023-10-18T14:01:14.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:14 smithi158 ceph-mon[103317]: osdmap e67: 11 total, 10 up, 11 in 2023-10-18T14:01:14.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:14.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:14 smithi158 ceph-mon[103317]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:14.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:14 smithi158 ceph-mon[103317]: from='client.? 172.21.15.158:0/2135337884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:01:14.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:14 smithi172 ceph-mon[103574]: from='client.? 172.21.15.158:0/83067159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f75dcc-ae8d-401c-b2e9-bcde3eeee081"}]: dispatch 2023-10-18T14:01:14.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:14 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f75dcc-ae8d-401c-b2e9-bcde3eeee081"}]: dispatch 2023-10-18T14:01:14.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:14 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0f75dcc-ae8d-401c-b2e9-bcde3eeee081"}]': finished 2023-10-18T14:01:14.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:14 smithi172 ceph-mon[103574]: osdmap e67: 11 total, 10 up, 11 in 2023-10-18T14:01:14.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:14.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:14 smithi172 ceph-mon[103574]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:14.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:14 smithi172 ceph-mon[103574]: from='client.? 172.21.15.158:0/2135337884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:01:14.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:14 smithi114 ceph-mon[99494]: from='client.? 172.21.15.158:0/83067159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f75dcc-ae8d-401c-b2e9-bcde3eeee081"}]: dispatch 2023-10-18T14:01:14.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:14 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f75dcc-ae8d-401c-b2e9-bcde3eeee081"}]: dispatch 2023-10-18T14:01:14.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:14 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0f75dcc-ae8d-401c-b2e9-bcde3eeee081"}]': finished 2023-10-18T14:01:14.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:14 smithi114 ceph-mon[99494]: osdmap e67: 11 total, 10 up, 11 in 2023-10-18T14:01:14.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:14.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:14 smithi114 ceph-mon[99494]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:14.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:14 smithi114 ceph-mon[99494]: from='client.? 172.21.15.158:0/2135337884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:01:17.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:16 smithi158 ceph-mon[103317]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:17.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:16 smithi172 ceph-mon[103574]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:17.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:16 smithi114 ceph-mon[99494]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:18.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:18 smithi158 ceph-mon[103317]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:19.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:18 smithi172 ceph-mon[103574]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:18 smithi114 ceph-mon[99494]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:21.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:20 smithi158 ceph-mon[103317]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:21.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:20 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-18T14:01:21.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:20 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:21.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:20 smithi158 ceph-mon[103317]: Deploying daemon osd.10 on smithi158 2023-10-18T14:01:21.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:20 smithi172 ceph-mon[103574]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:21.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:20 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-18T14:01:21.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:20 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:21.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:20 smithi172 ceph-mon[103574]: Deploying daemon osd.10 on smithi158 2023-10-18T14:01:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:20 smithi114 ceph-mon[99494]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:20 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-18T14:01:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:20 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:21.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:20 smithi114 ceph-mon[99494]: Deploying daemon osd.10 on smithi158 2023-10-18T14:01:23.012 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:22 smithi158 ceph-mon[103317]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:23.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:22 smithi172 ceph-mon[103574]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:22 smithi114 ceph-mon[99494]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:25.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:24 smithi158 ceph-mon[103317]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:25.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:25.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:25.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:25.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:24 smithi172 ceph-mon[103574]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:25.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:25.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:25.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:25.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:24 smithi114 ceph-mon[99494]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:25.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:25.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:25.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:26.757 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:26.752+0000 7f270affd700 1 -- 172.21.15.158:0/4011974255 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f271404e560 con 0x7f27000a14d0 2023-10-18T14:01:26.757 INFO:teuthology.orchestra.run.smithi158.stdout:Created osd(s) 10 on host 'smithi158' 2023-10-18T14:01:26.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:26.755+0000 7f271bba0700 1 -- 172.21.15.158:0/4011974255 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f27000a14d0 msgr2=0x7f27000a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:26.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:26.755+0000 7f271bba0700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f27000a14d0 0x7f27000a3990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2714101930 tx=0x7f2704005c70 comp rx=0 tx=0).stop 2023-10-18T14:01:26.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:26.755+0000 7f271bba0700 1 -- 172.21.15.158:0/4011974255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27141057c0 msgr2=0x7f2714196b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:26.759 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:26.755+0000 7f271bba0700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27141057c0 0x7f2714196b30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f270c00b830 tx=0x7f270c007920 comp rx=0 tx=0).stop 2023-10-18T14:01:26.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:26.755+0000 7f271bba0700 1 -- 172.21.15.158:0/4011974255 shutdown_connections 2023-10-18T14:01:26.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:26.755+0000 7f271bba0700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f27000a14d0 0x7f27000a3990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:26.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:26.755+0000 7f271bba0700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27141057c0 0x7f2714196b30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:26.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:26.755+0000 7f271bba0700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27141008a0 0x7f271419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:26.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:26.755+0000 7f271bba0700 1 --2- 172.21.15.158:0/4011974255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2714101260 0x7f271419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:26.760 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:26.755+0000 7f271bba0700 1 -- 172.21.15.158:0/4011974255 >> 172.21.15.158:0/4011974255 conn(0x7f27140779e0 msgr2=0x7f27140fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:01:26.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:26.755+0000 7f271bba0700 1 -- 172.21.15.158:0/4011974255 shutdown_connections 2023-10-18T14:01:26.761 INFO:teuthology.orchestra.run.smithi158.stderr:2023-10-18T14:01:26.755+0000 7f271bba0700 1 -- 172.21.15.158:0/4011974255 wait complete. 2023-10-18T14:01:27.155 DEBUG:teuthology.orchestra.run.smithi158:osd.10> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.10.service 2023-10-18T14:01:27.157 INFO:tasks.cephadm:Deploying osd.11 on smithi172 with /dev/vg_nvme/lv_1... 2023-10-18T14:01:27.157 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-18T14:01:27.191 INFO:journalctl@ceph.osd.10.smithi158.stdout:-- Logs begin at Wed 2023-10-18 13:41:14 UTC. -- 2023-10-18T14:01:27.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:26 smithi158 ceph-mon[103317]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:27.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:27.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:27.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:27.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:27.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:26 smithi172 ceph-mon[103574]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:27.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:27.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:27.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:27.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:27.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:26 smithi114 ceph-mon[99494]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:27.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:27.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:27.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:27.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:27.726 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T14:01:28.129 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:27 smithi158 ceph-mon[103317]: from='osd.10 [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-18T14:01:28.129 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:27 smithi158 ceph-mon[103317]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-18T14:01:28.130 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:01:27 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:01:27.952+0000 7f9fdc44c640 -1 osd.10 0 log_to_monitors true 2023-10-18T14:01:28.280 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:27 smithi172 ceph-mon[103574]: from='osd.10 [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-18T14:01:28.281 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:27 smithi172 ceph-mon[103574]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-18T14:01:28.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:27 smithi114 ceph-mon[99494]: from='osd.10 [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-18T14:01:28.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:27 smithi114 ceph-mon[99494]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-18T14:01:29.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:28 smithi158 ceph-mon[103317]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:29.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:28 smithi158 ceph-mon[103317]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-18T14:01:29.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:28 smithi158 ceph-mon[103317]: osdmap e68: 11 total, 10 up, 11 in 2023-10-18T14:01:29.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:28 smithi158 ceph-mon[103317]: from='osd.10 [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T14:01:29.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:28 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:29.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:28 smithi158 ceph-mon[103317]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T14:01:29.273 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:01:28 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:01:28.995+0000 7f9fd1ac3700 -1 osd.10 0 waiting for initial osdmap 2023-10-18T14:01:29.273 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:01:29 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:01:29.006+0000 7f9fcb8b4700 -1 osd.10 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T14:01:29.298 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-18T14:01:29.298 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-18T14:01:29.299 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2023-10-18T14:01:29.299 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2023-10-18T14:01:29.299 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0127882 s, 820 MB/s 2023-10-18T14:01:29.299 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2023-10-18T14:01:29.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:28 smithi172 ceph-mon[103574]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:29.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:28 smithi172 ceph-mon[103574]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-18T14:01:29.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:28 smithi172 ceph-mon[103574]: osdmap e68: 11 total, 10 up, 11 in 2023-10-18T14:01:29.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:28 smithi172 ceph-mon[103574]: from='osd.10 [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T14:01:29.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:28 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:29.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:28 smithi172 ceph-mon[103574]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T14:01:29.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:28 smithi114 ceph-mon[99494]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:29.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:28 smithi114 ceph-mon[99494]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-18T14:01:29.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:28 smithi114 ceph-mon[99494]: osdmap e68: 11 total, 10 up, 11 in 2023-10-18T14:01:29.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:28 smithi114 ceph-mon[99494]: from='osd.10 [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T14:01:29.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:28 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:29.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:28 smithi114 ceph-mon[99494]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]: dispatch 2023-10-18T14:01:29.684 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi172:vg_nvme/lv_1 2023-10-18T14:01:30.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]': finished 2023-10-18T14:01:30.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: osdmap e69: 11 total, 10 up, 11 in 2023-10-18T14:01:30.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:30.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:30.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:30.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: Detected new or changed devices on smithi158 2023-10-18T14:01:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:30.244 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T14:01:30.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]': finished 2023-10-18T14:01:30.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: osdmap e69: 11 total, 10 up, 11 in 2023-10-18T14:01:30.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:30.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:30.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:30.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: Detected new or changed devices on smithi158 2023-10-18T14:01:30.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:30.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:30.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:30.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:30.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:30.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:30.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi158 to 4292M 2023-10-18T14:01:30.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:30.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:30.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:30.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:30.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:30.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi158 to 4292M 2023-10-18T14:01:30.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:30.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:30.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:30.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:30.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi158", "root=default"]}]': finished 2023-10-18T14:01:30.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: osdmap e69: 11 total, 10 up, 11 in 2023-10-18T14:01:30.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:30.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:30.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-18T14:01:30.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: Detected new or changed devices on smithi158 2023-10-18T14:01:30.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:30.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:30.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:30.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:30.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:30.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:30.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi158 to 4292M 2023-10-18T14:01:30.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:30.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:30.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:30.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:31.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:31 smithi172 ceph-mon[103574]: purged_snaps scrub starts 2023-10-18T14:01:31.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:31 smithi172 ceph-mon[103574]: purged_snaps scrub ok 2023-10-18T14:01:31.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:31 smithi172 ceph-mon[103574]: osd.10 [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341] boot 2023-10-18T14:01:31.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:31 smithi172 ceph-mon[103574]: osdmap e70: 11 total, 11 up, 11 in 2023-10-18T14:01:31.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:31 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:31.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:31 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:31.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:31 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:31.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:31 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:31.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:31 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:31.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:31 smithi172 ceph-mon[103574]: osdmap e71: 11 total, 11 up, 11 in 2023-10-18T14:01:31.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:31 smithi158 ceph-mon[103317]: purged_snaps scrub starts 2023-10-18T14:01:31.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:31 smithi158 ceph-mon[103317]: purged_snaps scrub ok 2023-10-18T14:01:31.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:31 smithi158 ceph-mon[103317]: osd.10 [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341] boot 2023-10-18T14:01:31.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:31 smithi158 ceph-mon[103317]: osdmap e70: 11 total, 11 up, 11 in 2023-10-18T14:01:31.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:31 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:31.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:31 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:31.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:31 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:31.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:31 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:31.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:31 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:31.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:31 smithi158 ceph-mon[103317]: osdmap e71: 11 total, 11 up, 11 in 2023-10-18T14:01:31.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:31 smithi114 ceph-mon[99494]: purged_snaps scrub starts 2023-10-18T14:01:31.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:31 smithi114 ceph-mon[99494]: purged_snaps scrub ok 2023-10-18T14:01:31.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:31 smithi114 ceph-mon[99494]: osd.10 [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341] boot 2023-10-18T14:01:31.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:31 smithi114 ceph-mon[99494]: osdmap e70: 11 total, 11 up, 11 in 2023-10-18T14:01:31.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:31 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-18T14:01:31.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:31 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:31.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:31 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:31.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:31 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:31.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:31 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:31.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:31 smithi114 ceph-mon[99494]: osdmap e71: 11 total, 11 up, 11 in 2023-10-18T14:01:31.567 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.563+0000 7fd03c933700 1 -- 172.21.15.172:0/3775978865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0381056b0 msgr2=0x7fd038105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:31.567 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.563+0000 7fd03c933700 1 --2- 172.21.15.172:0/3775978865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0381056b0 0x7fd038105a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd028009990 tx=0x7fd028009ca0 comp rx=0 tx=0).stop 2023-10-18T14:01:31.567 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.563+0000 7fd03c933700 1 -- 172.21.15.172:0/3775978865 shutdown_connections 2023-10-18T14:01:31.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.563+0000 7fd03c933700 1 --2- 172.21.15.172:0/3775978865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd038100110 0x7fd03810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:31.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.563+0000 7fd03c933700 1 --2- 172.21.15.172:0/3775978865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0381056b0 0x7fd038105a90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:31.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.563+0000 7fd03c933700 1 --2- 172.21.15.172:0/3775978865 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0380ff750 0x7fd0380ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:31.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.563+0000 7fd03c933700 1 -- 172.21.15.172:0/3775978865 >> 172.21.15.172:0/3775978865 conn(0x7fd038075790 msgr2=0x7fd038075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:01:31.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.563+0000 7fd03c933700 1 -- 172.21.15.172:0/3775978865 shutdown_connections 2023-10-18T14:01:31.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.563+0000 7fd03c933700 1 -- 172.21.15.172:0/3775978865 wait complete. 2023-10-18T14:01:31.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd03c933700 1 Processor -- start 2023-10-18T14:01:31.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd03c933700 1 -- start start 2023-10-18T14:01:31.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd03c933700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0380ff750 0x7fd038197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:31.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd03c933700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd038100110 0x7fd038197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:31.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd03c933700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0381056b0 0x7fd038198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:31.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd03c933700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0381a2db0 con 0x7fd0380ff750 2023-10-18T14:01:31.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd03c933700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0381a2f20 con 0x7fd0381056b0 2023-10-18T14:01:31.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd03c933700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0381a30e0 con 0x7fd038100110 2023-10-18T14:01:31.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd035d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd038100110 0x7fd038197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:31.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd035d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd038100110 0x7fd038197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55406/0 (socket says 172.21.15.172:55406) 2023-10-18T14:01:31.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd035d9b700 1 -- 172.21.15.172:0/3389378447 learned_addr learned my addr 172.21.15.172:0/3389378447 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T14:01:31.574 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd036d9d700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0381056b0 0x7fd038198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:31.574 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd03659c700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0380ff750 0x7fd038197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:31.574 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd035d9b700 1 -- 172.21.15.172:0/3389378447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0381056b0 msgr2=0x7fd038198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:31.574 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd035d9b700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0381056b0 0x7fd038198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:31.574 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd035d9b700 1 -- 172.21.15.172:0/3389378447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0380ff750 msgr2=0x7fd038197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:31.575 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd035d9b700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0380ff750 0x7fd038197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:31.575 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd035d9b700 1 -- 172.21.15.172:0/3389378447 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0280095f0 con 0x7fd038100110 2023-10-18T14:01:31.575 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd036d9d700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0381056b0 0x7fd038198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:01:31.575 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.564+0000 7fd03659c700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0380ff750 0x7fd038197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:01:31.575 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.565+0000 7fd035d9b700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd038100110 0x7fd038197fe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00b530 tx=0x7fd02c00b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:01:31.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.565+0000 7fd0277fe700 1 -- 172.21.15.172:0/3389378447 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c011830 con 0x7fd038100110 2023-10-18T14:01:31.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.565+0000 7fd0277fe700 1 -- 172.21.15.172:0/3389378447 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd02c011e50 con 0x7fd038100110 2023-10-18T14:01:31.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.565+0000 7fd03c933700 1 -- 172.21.15.172:0/3389378447 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0381a33c0 con 0x7fd038100110 2023-10-18T14:01:31.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.565+0000 7fd0277fe700 1 -- 172.21.15.172:0/3389378447 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c00f2e0 con 0x7fd038100110 2023-10-18T14:01:31.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.565+0000 7fd03c933700 1 -- 172.21.15.172:0/3389378447 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0381a38c0 con 0x7fd038100110 2023-10-18T14:01:31.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.566+0000 7fd03c933700 1 -- 172.21.15.172:0/3389378447 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd038107cb0 con 0x7fd038100110 2023-10-18T14:01:31.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.567+0000 7fd0277fe700 1 -- 172.21.15.172:0/3389378447 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fd02c010580 con 0x7fd038100110 2023-10-18T14:01:31.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.567+0000 7fd0277fe700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd0200a14d0 0x7fd0200a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:31.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.567+0000 7fd0277fe700 1 -- 172.21.15.172:0/3389378447 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6938+0+0 (secure 0 0 0) 0x7fd02c0cc330 con 0x7fd038100110 2023-10-18T14:01:31.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.568+0000 7fd03659c700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd0200a14d0 0x7fd0200a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:31.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.568+0000 7fd03659c700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd0200a14d0 0x7fd0200a3990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd02800b5c0 tx=0x7fd028005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:01:31.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.572+0000 7fd0277fe700 1 -- 172.21.15.172:0/3389378447 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd02c095ef0 con 0x7fd038100110 2023-10-18T14:01:31.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:31.766+0000 7fd03c933700 1 -- 172.21.15.172:0/3389378447 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd038068700 con 0x7fd0200a14d0 2023-10-18T14:01:32.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:32 smithi158 ceph-mon[103317]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail 2023-10-18T14:01:32.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:32 smithi158 ceph-mon[103317]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:01:32.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:32 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:01:32.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:32 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:01:32.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:32 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:32.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:32 smithi158 ceph-mon[103317]: osdmap e72: 11 total, 11 up, 11 in 2023-10-18T14:01:32.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:32 smithi172 ceph-mon[103574]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail 2023-10-18T14:01:32.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:32 smithi172 ceph-mon[103574]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:01:32.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:32 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:01:32.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:32 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:01:32.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:32 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:32.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:32 smithi172 ceph-mon[103574]: osdmap e72: 11 total, 11 up, 11 in 2023-10-18T14:01:32.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:32 smithi114 ceph-mon[99494]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail 2023-10-18T14:01:32.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:32 smithi114 ceph-mon[99494]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:01:32.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:32 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-18T14:01:32.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:32 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-18T14:01:32.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:32 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:32.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:32 smithi114 ceph-mon[99494]: osdmap e72: 11 total, 11 up, 11 in 2023-10-18T14:01:34.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:34 smithi172 ceph-mon[103574]: osdmap e73: 11 total, 11 up, 11 in 2023-10-18T14:01:34.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:34 smithi172 ceph-mon[103574]: pgmap v194: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-10-18T14:01:34.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:34 smithi114 ceph-mon[99494]: osdmap e73: 11 total, 11 up, 11 in 2023-10-18T14:01:34.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:34 smithi114 ceph-mon[99494]: pgmap v194: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-10-18T14:01:34.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:34 smithi158 ceph-mon[103317]: osdmap e73: 11 total, 11 up, 11 in 2023-10-18T14:01:34.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:34 smithi158 ceph-mon[103317]: pgmap v194: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-10-18T14:01:35.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:35 smithi172 ceph-mon[103574]: osdmap e74: 11 total, 11 up, 11 in 2023-10-18T14:01:35.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:35 smithi172 ceph-mon[103574]: from='client.? 172.21.15.172:0/3043874942' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee"}]: dispatch 2023-10-18T14:01:35.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:35 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee"}]: dispatch 2023-10-18T14:01:35.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:35 smithi172 ceph-mon[103574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee"}]': finished 2023-10-18T14:01:35.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:35 smithi172 ceph-mon[103574]: osdmap e75: 12 total, 11 up, 12 in 2023-10-18T14:01:35.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:35 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:35.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:35 smithi172 ceph-mon[103574]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-10-18T14:01:35.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:35 smithi172 ceph-mon[103574]: from='client.? 172.21.15.172:0/3597047375' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:01:35.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:35 smithi114 ceph-mon[99494]: osdmap e74: 11 total, 11 up, 11 in 2023-10-18T14:01:35.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:35 smithi114 ceph-mon[99494]: from='client.? 172.21.15.172:0/3043874942' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee"}]: dispatch 2023-10-18T14:01:35.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:35 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee"}]: dispatch 2023-10-18T14:01:35.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:35 smithi114 ceph-mon[99494]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee"}]': finished 2023-10-18T14:01:35.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:35 smithi114 ceph-mon[99494]: osdmap e75: 12 total, 11 up, 12 in 2023-10-18T14:01:35.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:35 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:35.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:35 smithi114 ceph-mon[99494]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-10-18T14:01:35.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:35 smithi114 ceph-mon[99494]: from='client.? 172.21.15.172:0/3597047375' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:01:35.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:35 smithi158 ceph-mon[103317]: osdmap e74: 11 total, 11 up, 11 in 2023-10-18T14:01:35.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:35 smithi158 ceph-mon[103317]: from='client.? 172.21.15.172:0/3043874942' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee"}]: dispatch 2023-10-18T14:01:35.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:35 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee"}]: dispatch 2023-10-18T14:01:35.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:35 smithi158 ceph-mon[103317]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee"}]': finished 2023-10-18T14:01:35.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:35 smithi158 ceph-mon[103317]: osdmap e75: 12 total, 11 up, 12 in 2023-10-18T14:01:35.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:35 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:35.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:35 smithi158 ceph-mon[103317]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-10-18T14:01:35.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:35 smithi158 ceph-mon[103317]: from='client.? 172.21.15.172:0/3597047375' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-18T14:01:36.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:36 smithi172 ceph-mon[103574]: pgmap v197: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-10-18T14:01:36.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:36 smithi114 ceph-mon[99494]: pgmap v197: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-10-18T14:01:36.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:36 smithi158 ceph-mon[103317]: pgmap v197: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-10-18T14:01:39.001 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:38 smithi172 ceph-mon[103574]: pgmap v198: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-10-18T14:01:39.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:38 smithi158 ceph-mon[103317]: pgmap v198: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-10-18T14:01:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:38 smithi114 ceph-mon[99494]: pgmap v198: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2023-10-18T14:01:40.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:39 smithi158 ceph-mon[103317]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-10-18T14:01:40.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:39 smithi158 ceph-mon[103317]: Cluster is now healthy 2023-10-18T14:01:40.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:39 smithi172 ceph-mon[103574]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-10-18T14:01:40.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:39 smithi172 ceph-mon[103574]: Cluster is now healthy 2023-10-18T14:01:40.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:39 smithi114 ceph-mon[99494]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-10-18T14:01:40.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:39 smithi114 ceph-mon[99494]: Cluster is now healthy 2023-10-18T14:01:41.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:40 smithi158 ceph-mon[103317]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2023-10-18T14:01:41.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:40 smithi172 ceph-mon[103574]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2023-10-18T14:01:41.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:40 smithi114 ceph-mon[99494]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2023-10-18T14:01:42.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:41 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-18T14:01:42.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:41 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:42.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:41 smithi158 ceph-mon[103317]: Deploying daemon osd.11 on smithi172 2023-10-18T14:01:42.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:41 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-18T14:01:42.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:41 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:42.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:41 smithi172 ceph-mon[103574]: Deploying daemon osd.11 on smithi172 2023-10-18T14:01:42.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:41 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-18T14:01:42.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:41 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:42.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:41 smithi114 ceph-mon[99494]: Deploying daemon osd.11 on smithi172 2023-10-18T14:01:42.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:42 smithi172 ceph-mon[103574]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-18T14:01:43.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:42 smithi158 ceph-mon[103317]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-18T14:01:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:42 smithi114 ceph-mon[99494]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-18T14:01:44.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:44 smithi158 ceph-mon[103317]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-10-18T14:01:44.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:44 smithi172 ceph-mon[103574]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-10-18T14:01:44.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:44 smithi114 ceph-mon[99494]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-10-18T14:01:46.247 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:46.248 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:46.248 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:46.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:46.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:46.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:46.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:46.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:46.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:47.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:46 smithi158 ceph-mon[103317]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-18T14:01:47.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:46 smithi172 ceph-mon[103574]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-18T14:01:47.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:46 smithi114 ceph-mon[99494]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-18T14:01:47.477 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:47.474+0000 7fd0277fe700 1 -- 172.21.15.172:0/3389378447 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fd038068700 con 0x7fd0200a14d0 2023-10-18T14:01:47.478 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 11 on host 'smithi172' 2023-10-18T14:01:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:47.476+0000 7fd03c933700 1 -- 172.21.15.172:0/3389378447 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd0200a14d0 msgr2=0x7fd0200a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:47.476+0000 7fd03c933700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd0200a14d0 0x7fd0200a3990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd02800b5c0 tx=0x7fd028005fb0 comp rx=0 tx=0).stop 2023-10-18T14:01:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:47.476+0000 7fd03c933700 1 -- 172.21.15.172:0/3389378447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd038100110 msgr2=0x7fd038197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:47.476+0000 7fd03c933700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd038100110 0x7fd038197fe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00b530 tx=0x7fd02c00b8f0 comp rx=0 tx=0).stop 2023-10-18T14:01:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:47.476+0000 7fd03c933700 1 -- 172.21.15.172:0/3389378447 shutdown_connections 2023-10-18T14:01:47.481 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:47.476+0000 7fd03c933700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd0200a14d0 0x7fd0200a3990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:47.481 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:47.476+0000 7fd03c933700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd0381056b0 0x7fd038198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:47.481 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:47.476+0000 7fd03c933700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0380ff750 0x7fd038197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:47.481 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:47.476+0000 7fd03c933700 1 --2- 172.21.15.172:0/3389378447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd038100110 0x7fd038197fe0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:47.481 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:47.476+0000 7fd03c933700 1 -- 172.21.15.172:0/3389378447 >> 172.21.15.172:0/3389378447 conn(0x7fd038075790 msgr2=0x7fd0380fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:01:47.482 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:47.476+0000 7fd03c933700 1 -- 172.21.15.172:0/3389378447 shutdown_connections 2023-10-18T14:01:47.482 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:01:47.476+0000 7fd03c933700 1 -- 172.21.15.172:0/3389378447 wait complete. 2023-10-18T14:01:47.934 DEBUG:teuthology.orchestra.run.smithi172:osd.11> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.11.service 2023-10-18T14:01:47.936 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-18T14:01:47.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd stat -f json 2023-10-18T14:01:47.965 INFO:journalctl@ceph.osd.11.smithi172.stdout:-- Logs begin at Wed 2023-10-18 13:40:49 UTC. -- 2023-10-18T14:01:48.510 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:01:48.751 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:48.751 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:48.752 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:48 smithi114 ceph-mon[99494]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-18T14:01:48.752 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:48.752 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:48.760 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:48.760 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:48.760 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:48 smithi172 ceph-mon[103574]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-18T14:01:48.761 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:48.761 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:48.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:48.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:48.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:48 smithi158 ceph-mon[103317]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-18T14:01:48.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:48.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:49.059 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:01:48 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:01:48.892+0000 7f7923f97640 -1 osd.11 0 log_to_monitors true 2023-10-18T14:01:49.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:49 smithi172 ceph-mon[103574]: from='osd.11 [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-18T14:01:49.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:49 smithi172 ceph-mon[103574]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-18T14:01:49.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:49 smithi158 ceph-mon[103317]: from='osd.11 [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-18T14:01:49.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:49 smithi158 ceph-mon[103317]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-18T14:01:49.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:49 smithi114 ceph-mon[99494]: from='osd.11 [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-18T14:01:49.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:49 smithi114 ceph-mon[99494]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-18T14:01:49.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.835+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3694670050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef941002a0 msgr2=0x7fef94100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:49.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.835+0000 7fef9a6a0700 1 --2- 172.21.15.114:0/3694670050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef941002a0 0x7fef94100720 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009990 tx=0x7fef7c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:01:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3694670050 shutdown_connections 2023-10-18T14:01:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 --2- 172.21.15.114:0/3694670050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef94100c60 0x7fef9410c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 --2- 172.21.15.114:0/3694670050 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef94104720 0x7fef94104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 --2- 172.21.15.114:0/3694670050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef941002a0 0x7fef94100720 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:49.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3694670050 >> 172.21.15.114:0/3694670050 conn(0x7fef94074a10 msgr2=0x7fef94074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:01:49.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3694670050 shutdown_connections 2023-10-18T14:01:49.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3694670050 wait complete. 2023-10-18T14:01:49.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 Processor -- start 2023-10-18T14:01:49.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 -- start start 2023-10-18T14:01:49.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef941002a0 0x7fef94101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:49.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef94100c60 0x7fef94101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:49.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef94104720 0x7fef94101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:49.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef941a4ff0 con 0x7fef94100c60 2023-10-18T14:01:49.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef941a5160 con 0x7fef94104720 2023-10-18T14:01:49.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.836+0000 7fef9a6a0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef941a5320 con 0x7fef941002a0 2023-10-18T14:01:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef8bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef94100c60 0x7fef94101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef8bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef94100c60 0x7fef94101960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41980/0 (socket says 172.21.15.114:41980) 2023-10-18T14:01:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef8bfff700 1 -- 172.21.15.114:0/3151057864 learned_addr learned my addr 172.21.15.114:0/3151057864 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:01:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef93fff700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef941002a0 0x7fef94101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef98c3d700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef94104720 0x7fef94101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef8bfff700 1 -- 172.21.15.114:0/3151057864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef941002a0 msgr2=0x7fef94101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef8bfff700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef941002a0 0x7fef94101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef8bfff700 1 -- 172.21.15.114:0/3151057864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef94104720 msgr2=0x7fef94101ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef8bfff700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef94104720 0x7fef94101ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef8bfff700 1 -- 172.21.15.114:0/3151057864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c0095f0 con 0x7fef94100c60 2023-10-18T14:01:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef8bfff700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef94100c60 0x7fef94101960 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fef7c005910 tx=0x7fef7c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:01:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef91ffb700 1 -- 172.21.15.114:0/3151057864 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c01d070 con 0x7fef94100c60 2023-10-18T14:01:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef91ffb700 1 -- 172.21.15.114:0/3151057864 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef7c022470 con 0x7fef94100c60 2023-10-18T14:01:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3151057864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef941a55a0 con 0x7fef94100c60 2023-10-18T14:01:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef91ffb700 1 -- 172.21.15.114:0/3151057864 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c017650 con 0x7fef94100c60 2023-10-18T14:01:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.837+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3151057864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef941a59b0 con 0x7fef94100c60 2023-10-18T14:01:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.838+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3151057864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef94067d10 con 0x7fef94100c60 2023-10-18T14:01:49.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.840+0000 7fef91ffb700 1 -- 172.21.15.114:0/3151057864 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fef7c0225e0 con 0x7fef94100c60 2023-10-18T14:01:49.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.840+0000 7fef91ffb700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fef800a1550 0x7fef800a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:49.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.840+0000 7fef93fff700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fef800a1550 0x7fef800a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:49.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.841+0000 7fef91ffb700 1 -- 172.21.15.114:0/3151057864 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7046+0+0 (secure 0 0 0) 0x7fef7c0cdfd0 con 0x7fef94100c60 2023-10-18T14:01:49.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.841+0000 7fef93fff700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fef800a1550 0x7fef800a3a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef8400f540 tx=0x7fef8400b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:01:49.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:49.844+0000 7fef91ffb700 1 -- 172.21.15.114:0/3151057864 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fef7c097b10 con 0x7fef94100c60 2023-10-18T14:01:50.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.035+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3151057864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fef9404e4c0 con 0x7fef94100c60 2023-10-18T14:01:50.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.035+0000 7fef91ffb700 1 -- 172.21.15.114:0/3151057864 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) v1 ==== 74+0+133 (secure 0 0 0) 0x7fef7c09b130 con 0x7fef94100c60 2023-10-18T14:01:50.039 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:01:50.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.037+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3151057864 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fef800a1550 msgr2=0x7fef800a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:50.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.037+0000 7fef9a6a0700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fef800a1550 0x7fef800a3a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef8400f540 tx=0x7fef8400b040 comp rx=0 tx=0).stop 2023-10-18T14:01:50.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.037+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3151057864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef94100c60 msgr2=0x7fef94101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:50.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.037+0000 7fef9a6a0700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef94100c60 0x7fef94101960 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fef7c005910 tx=0x7fef7c004730 comp rx=0 tx=0).stop 2023-10-18T14:01:50.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.037+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3151057864 shutdown_connections 2023-10-18T14:01:50.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.037+0000 7fef9a6a0700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fef800a1550 0x7fef800a3a10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:50.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.037+0000 7fef9a6a0700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fef94104720 0x7fef94101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:50.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.037+0000 7fef9a6a0700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef941002a0 0x7fef94101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:50.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.037+0000 7fef9a6a0700 1 --2- 172.21.15.114:0/3151057864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef94100c60 0x7fef94101960 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:50.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.037+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3151057864 >> 172.21.15.114:0/3151057864 conn(0x7fef94074a10 msgr2=0x7fef94103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:01:50.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.037+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3151057864 shutdown_connections 2023-10-18T14:01:50.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:50.037+0000 7fef9a6a0700 1 -- 172.21.15.114:0/3151057864 wait complete. 2023-10-18T14:01:50.463 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1697637689,"num_in_osds":12,"osd_in_since":1697637694,"num_remapped_pgs":0} 2023-10-18T14:01:50.488 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:01:50 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:01:50.483+0000 7f791960e700 -1 osd.11 0 waiting for initial osdmap 2023-10-18T14:01:50.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:50 smithi158 ceph-mon[103317]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-18T14:01:50.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:50 smithi158 ceph-mon[103317]: osdmap e76: 12 total, 11 up, 12 in 2023-10-18T14:01:50.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:50 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:50.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:50 smithi158 ceph-mon[103317]: from='osd.11 [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T14:01:50.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:50 smithi158 ceph-mon[103317]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T14:01:50.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:50 smithi158 ceph-mon[103317]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-18T14:01:50.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:50 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3151057864' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-18T14:01:50.809 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:01:50 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:01:50.497+0000 7f7912bfe700 -1 osd.11 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T14:01:50.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:50 smithi172 ceph-mon[103574]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-18T14:01:50.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:50 smithi172 ceph-mon[103574]: osdmap e76: 12 total, 11 up, 12 in 2023-10-18T14:01:50.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:50 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:50.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:50 smithi172 ceph-mon[103574]: from='osd.11 [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T14:01:50.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:50 smithi172 ceph-mon[103574]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T14:01:50.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:50 smithi172 ceph-mon[103574]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-18T14:01:50.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:50 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3151057864' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-18T14:01:50.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:50 smithi114 ceph-mon[99494]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-18T14:01:50.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:50 smithi114 ceph-mon[99494]: osdmap e76: 12 total, 11 up, 12 in 2023-10-18T14:01:50.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:50 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:50.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:50 smithi114 ceph-mon[99494]: from='osd.11 [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T14:01:50.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:50 smithi114 ceph-mon[99494]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-10-18T14:01:50.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:50 smithi114 ceph-mon[99494]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-18T14:01:50.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:50 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3151057864' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-18T14:01:51.464 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd stat -f json 2023-10-18T14:01:51.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-10-18T14:01:51.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: osdmap e77: 12 total, 11 up, 12 in 2023-10-18T14:01:51.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:51.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:51.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: Detected new or changed devices on smithi172 2023-10-18T14:01:51.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:51.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:51.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:51.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:51.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi172 to 4292M 2023-10-18T14:01:51.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:51.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:51.774 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:51.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:51.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:51.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.775 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:51 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:51.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-10-18T14:01:51.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: osdmap e77: 12 total, 11 up, 12 in 2023-10-18T14:01:51.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:51.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:51.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: Detected new or changed devices on smithi172 2023-10-18T14:01:51.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:51.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:51.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:51.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:51.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi172 to 4292M 2023-10-18T14:01:51.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:51.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:51.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:51.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:51.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:51.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:51 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:51.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-10-18T14:01:51.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: osdmap e77: 12 total, 11 up, 12 in 2023-10-18T14:01:51.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:51.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:51.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: Detected new or changed devices on smithi172 2023-10-18T14:01:51.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:51.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:51.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:51.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:01:51.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi172 to 4292M 2023-10-18T14:01:51.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:51.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:51.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.842 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:01:51.842 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:01:51.842 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:01:51.842 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:01:51.842 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:51 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:52.038 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:01:52.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:52 smithi114 ceph-mon[99494]: purged_snaps scrub starts 2023-10-18T14:01:52.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:52 smithi114 ceph-mon[99494]: purged_snaps scrub ok 2023-10-18T14:01:52.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:52 smithi114 ceph-mon[99494]: osd.11 [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171] boot 2023-10-18T14:01:52.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:52 smithi114 ceph-mon[99494]: osdmap e78: 12 total, 12 up, 12 in 2023-10-18T14:01:52.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:52 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:52.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:52 smithi114 ceph-mon[99494]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-18T14:01:52.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:52 smithi158 ceph-mon[103317]: purged_snaps scrub starts 2023-10-18T14:01:52.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:52 smithi158 ceph-mon[103317]: purged_snaps scrub ok 2023-10-18T14:01:52.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:52 smithi158 ceph-mon[103317]: osd.11 [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171] boot 2023-10-18T14:01:52.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:52 smithi158 ceph-mon[103317]: osdmap e78: 12 total, 12 up, 12 in 2023-10-18T14:01:52.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:52 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:52.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:52 smithi158 ceph-mon[103317]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-18T14:01:52.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:52 smithi172 ceph-mon[103574]: purged_snaps scrub starts 2023-10-18T14:01:52.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:52 smithi172 ceph-mon[103574]: purged_snaps scrub ok 2023-10-18T14:01:52.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:52 smithi172 ceph-mon[103574]: osd.11 [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171] boot 2023-10-18T14:01:52.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:52 smithi172 ceph-mon[103574]: osdmap e78: 12 total, 12 up, 12 in 2023-10-18T14:01:52.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:52 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-18T14:01:52.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:52 smithi172 ceph-mon[103574]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-18T14:01:53.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.332+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2954304763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d481000a0 msgr2=0x7f7d4810c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:53.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.332+0000 7f7d4fdad700 1 --2- 172.21.15.114:0/2954304763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d481000a0 0x7f7d4810c540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000b0a0 tx=0x7f7d4000b3b0 comp rx=0 tx=0).stop 2023-10-18T14:01:53.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.332+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2954304763 shutdown_connections 2023-10-18T14:01:53.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.332+0000 7f7d4fdad700 1 --2- 172.21.15.114:0/2954304763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d481000a0 0x7f7d4810c540 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:53.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.332+0000 7f7d4fdad700 1 --2- 172.21.15.114:0/2954304763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d481045b0 0x7f7d48104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:53.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.332+0000 7f7d4fdad700 1 --2- 172.21.15.114:0/2954304763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d480ff6e0 0x7f7d480ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:53.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.332+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2954304763 >> 172.21.15.114:0/2954304763 conn(0x7f7d480766c0 msgr2=0x7f7d48076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:01:53.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.332+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2954304763 shutdown_connections 2023-10-18T14:01:53.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.332+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2954304763 wait complete. 2023-10-18T14:01:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.332+0000 7f7d4fdad700 1 Processor -- start 2023-10-18T14:01:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4fdad700 1 -- start start 2023-10-18T14:01:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4fdad700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d480ff6e0 0x7f7d48197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:53.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4fdad700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d481000a0 0x7f7d481980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4fdad700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d481045b0 0x7f7d481a2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4fdad700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d481989b0 con 0x7f7d481000a0 2023-10-18T14:01:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4fdad700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d481a3170 con 0x7f7d480ff6e0 2023-10-18T14:01:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4fdad700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d481a32b0 con 0x7f7d481045b0 2023-10-18T14:01:53.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4d348700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d481000a0 0x7f7d481980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:53.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4d348700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d481000a0 0x7f7d481980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41996/0 (socket says 172.21.15.114:41996) 2023-10-18T14:01:53.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4d348700 1 -- 172.21.15.114:0/2141637639 learned_addr learned my addr 172.21.15.114:0/2141637639 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:01:53.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4db49700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d480ff6e0 0x7f7d48197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:53.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4e34a700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d481045b0 0x7f7d481a2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:53.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4d348700 1 -- 172.21.15.114:0/2141637639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d481045b0 msgr2=0x7f7d481a2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:53.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4d348700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d481045b0 0x7f7d481a2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:53.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4d348700 1 -- 172.21.15.114:0/2141637639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d480ff6e0 msgr2=0x7f7d48197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:53.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4d348700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d480ff6e0 0x7f7d48197bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:53.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4d348700 1 -- 172.21.15.114:0/2141637639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d40009d00 con 0x7f7d481000a0 2023-10-18T14:01:53.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4d348700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d481000a0 0x7f7d481980f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800b530 tx=0x7f7d3800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:01:53.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d3effd700 1 -- 172.21.15.114:0/2141637639 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38011830 con 0x7f7d481000a0 2023-10-18T14:01:53.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d3effd700 1 -- 172.21.15.114:0/2141637639 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d38011e50 con 0x7f7d481000a0 2023-10-18T14:01:53.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2141637639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d48195a00 con 0x7f7d481000a0 2023-10-18T14:01:53.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.333+0000 7f7d3effd700 1 -- 172.21.15.114:0/2141637639 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3800f2e0 con 0x7f7d481000a0 2023-10-18T14:01:53.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.334+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2141637639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d48195f00 con 0x7f7d481000a0 2023-10-18T14:01:53.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.334+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2141637639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d48107c20 con 0x7f7d481000a0 2023-10-18T14:01:53.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.335+0000 7f7d3effd700 1 -- 172.21.15.114:0/2141637639 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f7d38010580 con 0x7f7d481000a0 2023-10-18T14:01:53.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.336+0000 7f7d3effd700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7d340a14d0 0x7f7d340a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:53.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.336+0000 7f7d4db49700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7d340a14d0 0x7f7d340a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:53.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.336+0000 7f7d3effd700 1 -- 172.21.15.114:0/2141637639 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f7d380cca30 con 0x7f7d481000a0 2023-10-18T14:01:53.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.336+0000 7f7d4db49700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7d340a14d0 0x7f7d340a3990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7d44005950 tx=0x7f7d440058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:01:53.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.340+0000 7f7d3effd700 1 -- 172.21.15.114:0/2141637639 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7d38096460 con 0x7f7d481000a0 2023-10-18T14:01:53.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.530+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2141637639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f7d48100dd0 con 0x7f7d481000a0 2023-10-18T14:01:53.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.530+0000 7f7d3effd700 1 -- 172.21.15.114:0/2141637639 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) v1 ==== 74+0+133 (secure 0 0 0) 0x7f7d38099a80 con 0x7f7d481000a0 2023-10-18T14:01:53.535 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:01:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.532+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2141637639 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7d340a14d0 msgr2=0x7f7d340a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:53.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.532+0000 7f7d4fdad700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7d340a14d0 0x7f7d340a3990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7d44005950 tx=0x7f7d440058e0 comp rx=0 tx=0).stop 2023-10-18T14:01:53.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.532+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2141637639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d481000a0 msgr2=0x7f7d481980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:53.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.532+0000 7f7d4fdad700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d481000a0 0x7f7d481980f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800b530 tx=0x7f7d3800b8f0 comp rx=0 tx=0).stop 2023-10-18T14:01:53.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.532+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2141637639 shutdown_connections 2023-10-18T14:01:53.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.533+0000 7f7d4fdad700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7d340a14d0 0x7f7d340a3990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:53.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.533+0000 7f7d4fdad700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d481045b0 0x7f7d481a2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.533+0000 7f7d4fdad700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7d480ff6e0 0x7f7d48197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.533+0000 7f7d4fdad700 1 --2- 172.21.15.114:0/2141637639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d481000a0 0x7f7d481980f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.533+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2141637639 >> 172.21.15.114:0/2141637639 conn(0x7f7d480766c0 msgr2=0x7f7d480fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:01:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.533+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2141637639 shutdown_connections 2023-10-18T14:01:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:53.533+0000 7f7d4fdad700 1 -- 172.21.15.114:0/2141637639 wait complete. 2023-10-18T14:01:53.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:53 smithi158 ceph-mon[103317]: osdmap e79: 12 total, 12 up, 12 in 2023-10-18T14:01:53.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:53 smithi172 ceph-mon[103574]: osdmap e79: 12 total, 12 up, 12 in 2023-10-18T14:01:53.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:53 smithi114 ceph-mon[99494]: osdmap e79: 12 total, 12 up, 12 in 2023-10-18T14:01:53.991 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":79,"num_osds":12,"num_up_osds":12,"osd_up_since":1697637711,"num_in_osds":12,"osd_in_since":1697637694,"num_remapped_pgs":0} 2023-10-18T14:01:53.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-18T14:01:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:01:54.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:54 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2141637639' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-18T14:01:54.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:54 smithi158 ceph-mon[103317]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:01:54.772 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:54 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2141637639' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-18T14:01:54.772 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:54 smithi114 ceph-mon[99494]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:01:54.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:54 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2141637639' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-18T14:01:54.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:54 smithi172 ceph-mon[103574]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:01:55.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.842+0000 7f546d294700 1 -- 172.21.15.114:0/1684403797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54680ff750 msgr2=0x7f54680ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:55.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.842+0000 7f546d294700 1 --2- 172.21.15.114:0/1684403797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54680ff750 0x7f54680ffbd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5458009990 tx=0x7f5458009ca0 comp rx=0 tx=0).stop 2023-10-18T14:01:55.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.842+0000 7f546d294700 1 -- 172.21.15.114:0/1684403797 shutdown_connections 2023-10-18T14:01:55.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.842+0000 7f546d294700 1 --2- 172.21.15.114:0/1684403797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5468100110 0x7f546810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:55.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.842+0000 7f546d294700 1 --2- 172.21.15.114:0/1684403797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54681056b0 0x7f5468105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:55.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.842+0000 7f546d294700 1 --2- 172.21.15.114:0/1684403797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54680ff750 0x7f54680ffbd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:55.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.842+0000 7f546d294700 1 -- 172.21.15.114:0/1684403797 >> 172.21.15.114:0/1684403797 conn(0x7f5468075790 msgr2=0x7f5468075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:01:55.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.842+0000 7f546d294700 1 -- 172.21.15.114:0/1684403797 shutdown_connections 2023-10-18T14:01:55.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.842+0000 7f546d294700 1 -- 172.21.15.114:0/1684403797 wait complete. 2023-10-18T14:01:55.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.843+0000 7f546d294700 1 Processor -- start 2023-10-18T14:01:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.843+0000 7f546d294700 1 -- start start 2023-10-18T14:01:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.843+0000 7f546d294700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54680ff750 0x7f5468197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.843+0000 7f546d294700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5468100110 0x7f5468197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.843+0000 7f546d294700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54681056b0 0x7f5468198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.843+0000 7f546d294700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681a2d50 con 0x7f5468100110 2023-10-18T14:01:55.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.843+0000 7f546d294700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681a2ec0 con 0x7f54680ff750 2023-10-18T14:01:55.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.843+0000 7f546d294700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681a3080 con 0x7f54681056b0 2023-10-18T14:01:55.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f54667fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5468100110 0x7f5468197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:55.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f54667fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5468100110 0x7f5468197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42018/0 (socket says 172.21.15.114:42018) 2023-10-18T14:01:55.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f54667fc700 1 -- 172.21.15.114:0/2111227730 learned_addr learned my addr 172.21.15.114:0/2111227730 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:01:55.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f54677fe700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54681056b0 0x7f5468198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:55.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f5466ffd700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54680ff750 0x7f5468197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:55.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f54667fc700 1 -- 172.21.15.114:0/2111227730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54681056b0 msgr2=0x7f5468198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:55.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f54667fc700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54681056b0 0x7f5468198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:55.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f54667fc700 1 -- 172.21.15.114:0/2111227730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54680ff750 msgr2=0x7f5468197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:55.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f54667fc700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54680ff750 0x7f5468197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:55.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f54667fc700 1 -- 172.21.15.114:0/2111227730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54580095f0 con 0x7f5468100110 2023-10-18T14:01:55.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f5466ffd700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54680ff750 0x7f5468197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:01:55.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f54667fc700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5468100110 0x7f5468197fa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f545800f6a0 tx=0x7f545800f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:01:55.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f544ffff700 1 -- 172.21.15.114:0/2111227730 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545801d070 con 0x7f5468100110 2023-10-18T14:01:55.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f546d294700 1 -- 172.21.15.114:0/2111227730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54681a3300 con 0x7f5468100110 2023-10-18T14:01:55.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f544ffff700 1 -- 172.21.15.114:0/2111227730 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f545800fca0 con 0x7f5468100110 2023-10-18T14:01:55.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f544ffff700 1 -- 172.21.15.114:0/2111227730 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458017650 con 0x7f5468100110 2023-10-18T14:01:55.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.844+0000 7f546d294700 1 -- 172.21.15.114:0/2111227730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54681a37a0 con 0x7f5468100110 2023-10-18T14:01:55.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.845+0000 7f546d294700 1 -- 172.21.15.114:0/2111227730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5468107c40 con 0x7f5468100110 2023-10-18T14:01:55.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.846+0000 7f544ffff700 1 -- 172.21.15.114:0/2111227730 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f5458022470 con 0x7f5468100110 2023-10-18T14:01:55.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.847+0000 7f544ffff700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f54500a1550 0x7f54500a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:55.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.847+0000 7f5466ffd700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f54500a1550 0x7f54500a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:55.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.847+0000 7f544ffff700 1 -- 172.21.15.114:0/2111227730 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f54580cde00 con 0x7f5468100110 2023-10-18T14:01:55.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.847+0000 7f5466ffd700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f54500a1550 0x7f54500a3a10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f545c005fd0 tx=0x7f545c005d40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:01:55.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:55.852+0000 7f544ffff700 1 -- 172.21.15.114:0/2111227730 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5458097820 con 0x7f5468100110 2023-10-18T14:01:56.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.041+0000 7f546d294700 1 -- 172.21.15.114:0/2111227730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54680686e0 con 0x7f5468100110 2023-10-18T14:01:56.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.042+0000 7f544ffff700 1 -- 172.21.15.114:0/2111227730 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18823 (secure 0 0 0) 0x7f5458027090 con 0x7f5468100110 2023-10-18T14:01:56.046 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:01:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":79,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:01:52.492213+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:01:56.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.044+0000 7f546d294700 1 -- 172.21.15.114:0/2111227730 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f54500a1550 msgr2=0x7f54500a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:56.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.044+0000 7f546d294700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f54500a1550 0x7f54500a3a10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f545c005fd0 tx=0x7f545c005d40 comp rx=0 tx=0).stop 2023-10-18T14:01:56.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.044+0000 7f546d294700 1 -- 172.21.15.114:0/2111227730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5468100110 msgr2=0x7f5468197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:56.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.044+0000 7f546d294700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5468100110 0x7f5468197fa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f545800f6a0 tx=0x7f545800f780 comp rx=0 tx=0).stop 2023-10-18T14:01:56.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.044+0000 7f546d294700 1 -- 172.21.15.114:0/2111227730 shutdown_connections 2023-10-18T14:01:56.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.044+0000 7f546d294700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f54500a1550 0x7f54500a3a10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:56.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.044+0000 7f546d294700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54681056b0 0x7f5468198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:56.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.044+0000 7f546d294700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f54680ff750 0x7f5468197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:56.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.044+0000 7f546d294700 1 --2- 172.21.15.114:0/2111227730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5468100110 0x7f5468197fa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:56.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.044+0000 7f546d294700 1 -- 172.21.15.114:0/2111227730 >> 172.21.15.114:0/2111227730 conn(0x7f5468075790 msgr2=0x7f54680fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:01:56.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.044+0000 7f546d294700 1 -- 172.21.15.114:0/2111227730 shutdown_connections 2023-10-18T14:01:56.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:56.044+0000 7f546d294700 1 -- 172.21.15.114:0/2111227730 wait complete. 2023-10-18T14:01:56.490 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T13:58:43.813590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T14:01:56.491 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-18T14:01:56.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:56 smithi114 ceph-mon[99494]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:01:56.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:56 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2111227730' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:01:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:56 smithi158 ceph-mon[103317]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:01:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:56 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2111227730' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:01:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:01:57.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:56 smithi172 ceph-mon[103574]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:01:57.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:56 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2111227730' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:01:58.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.228+0000 7f7c47aff700 1 -- 172.21.15.114:0/3747796746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c401045b0 msgr2=0x7f7c40104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:58.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.228+0000 7f7c47aff700 1 --2- 172.21.15.114:0/3747796746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c401045b0 0x7f7c40104990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009990 tx=0x7f7c30009ca0 comp rx=0 tx=0).stop 2023-10-18T14:01:58.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.228+0000 7f7c47aff700 1 -- 172.21.15.114:0/3747796746 shutdown_connections 2023-10-18T14:01:58.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.228+0000 7f7c47aff700 1 --2- 172.21.15.114:0/3747796746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c401000a0 0x7f7c4010c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:58.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.228+0000 7f7c47aff700 1 --2- 172.21.15.114:0/3747796746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c401045b0 0x7f7c40104990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:58.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.228+0000 7f7c47aff700 1 --2- 172.21.15.114:0/3747796746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c400ff6e0 0x7f7c400ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.228+0000 7f7c47aff700 1 -- 172.21.15.114:0/3747796746 >> 172.21.15.114:0/3747796746 conn(0x7f7c400766c0 msgr2=0x7f7c40076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:01:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.228+0000 7f7c47aff700 1 -- 172.21.15.114:0/3747796746 shutdown_connections 2023-10-18T14:01:58.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.228+0000 7f7c47aff700 1 -- 172.21.15.114:0/3747796746 wait complete. 2023-10-18T14:01:58.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.229+0000 7f7c47aff700 1 Processor -- start 2023-10-18T14:01:58.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.229+0000 7f7c47aff700 1 -- start start 2023-10-18T14:01:58.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.229+0000 7f7c47aff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c400ff6e0 0x7f7c40195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:58.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.229+0000 7f7c47aff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c401000a0 0x7f7c40195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:58.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.229+0000 7f7c47aff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c401045b0 0x7f7c4019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:58.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.229+0000 7f7c47aff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4019a950 con 0x7f7c401045b0 2023-10-18T14:01:58.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.229+0000 7f7c47aff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4019aac0 con 0x7f7c401000a0 2023-10-18T14:01:58.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.229+0000 7f7c47aff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4019ac80 con 0x7f7c400ff6e0 2023-10-18T14:01:58.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.229+0000 7f7c4609c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c401045b0 0x7f7c4019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:58.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.229+0000 7f7c4609c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c401045b0 0x7f7c4019a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42032/0 (socket says 172.21.15.114:42032) 2023-10-18T14:01:58.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.229+0000 7f7c4609c700 1 -- 172.21.15.114:0/103034477 learned_addr learned my addr 172.21.15.114:0/103034477 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:01:58.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.230+0000 7f7c4509a700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c401000a0 0x7f7c40195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:58.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.230+0000 7f7c4589b700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c400ff6e0 0x7f7c40195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:58.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.230+0000 7f7c4609c700 1 -- 172.21.15.114:0/103034477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c400ff6e0 msgr2=0x7f7c40195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:58.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.230+0000 7f7c4609c700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c400ff6e0 0x7f7c40195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:58.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.230+0000 7f7c4609c700 1 -- 172.21.15.114:0/103034477 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c401000a0 msgr2=0x7f7c40195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:58.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.230+0000 7f7c4609c700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c401000a0 0x7f7c40195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:58.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.230+0000 7f7c4609c700 1 -- 172.21.15.114:0/103034477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c300095f0 con 0x7f7c401045b0 2023-10-18T14:01:58.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.230+0000 7f7c4609c700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c401045b0 0x7f7c4019a380 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7c38007d70 tx=0x7f7c3800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:01:58.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.230+0000 7f7c36ffd700 1 -- 172.21.15.114:0/103034477 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800ac90 con 0x7f7c401045b0 2023-10-18T14:01:58.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.230+0000 7f7c36ffd700 1 -- 172.21.15.114:0/103034477 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c3800adf0 con 0x7f7c401045b0 2023-10-18T14:01:58.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.230+0000 7f7c47aff700 1 -- 172.21.15.114:0/103034477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4019af60 con 0x7f7c401045b0 2023-10-18T14:01:58.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.230+0000 7f7c36ffd700 1 -- 172.21.15.114:0/103034477 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380115e0 con 0x7f7c401045b0 2023-10-18T14:01:58.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.230+0000 7f7c47aff700 1 -- 172.21.15.114:0/103034477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c401a2800 con 0x7f7c401045b0 2023-10-18T14:01:58.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.231+0000 7f7c47aff700 1 -- 172.21.15.114:0/103034477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c40107c20 con 0x7f7c401045b0 2023-10-18T14:01:58.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.232+0000 7f7c36ffd700 1 -- 172.21.15.114:0/103034477 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f7c38012420 con 0x7f7c401045b0 2023-10-18T14:01:58.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.233+0000 7f7c36ffd700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7c2c0a14d0 0x7f7c2c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:01:58.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.233+0000 7f7c4589b700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7c2c0a14d0 0x7f7c2c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:01:58.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.233+0000 7f7c36ffd700 1 -- 172.21.15.114:0/103034477 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f7c380ccea0 con 0x7f7c401045b0 2023-10-18T14:01:58.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.233+0000 7f7c4589b700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7c2c0a14d0 0x7f7c2c0a3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000b2e0 tx=0x7f7c30005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:01:58.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.236+0000 7f7c36ffd700 1 -- 172.21.15.114:0/103034477 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7c380968d0 con 0x7f7c401045b0 2023-10-18T14:01:58.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.427+0000 7f7c47aff700 1 -- 172.21.15.114:0/103034477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c40196e10 con 0x7f7c401045b0 2023-10-18T14:01:58.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.427+0000 7f7c36ffd700 1 -- 172.21.15.114:0/103034477 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c38099ef0 con 0x7f7c401045b0 2023-10-18T14:01:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T14:01:58.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.429+0000 7f7c47aff700 1 -- 172.21.15.114:0/103034477 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7c2c0a14d0 msgr2=0x7f7c2c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:58.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.429+0000 7f7c47aff700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7c2c0a14d0 0x7f7c2c0a3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000b2e0 tx=0x7f7c30005960 comp rx=0 tx=0).stop 2023-10-18T14:01:58.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.429+0000 7f7c47aff700 1 -- 172.21.15.114:0/103034477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c401045b0 msgr2=0x7f7c4019a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:01:58.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.429+0000 7f7c47aff700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c401045b0 0x7f7c4019a380 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7c38007d70 tx=0x7f7c3800a340 comp rx=0 tx=0).stop 2023-10-18T14:01:58.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.429+0000 7f7c47aff700 1 -- 172.21.15.114:0/103034477 shutdown_connections 2023-10-18T14:01:58.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.429+0000 7f7c47aff700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7c2c0a14d0 0x7f7c2c0a3990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:58.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.429+0000 7f7c47aff700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c401045b0 0x7f7c4019a380 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:58.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.429+0000 7f7c47aff700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c400ff6e0 0x7f7c40195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:58.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.429+0000 7f7c47aff700 1 --2- 172.21.15.114:0/103034477 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c401000a0 0x7f7c40195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:01:58.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.429+0000 7f7c47aff700 1 -- 172.21.15.114:0/103034477 >> 172.21.15.114:0/103034477 conn(0x7f7c400766c0 msgr2=0x7f7c400fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:01:58.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.429+0000 7f7c47aff700 1 -- 172.21.15.114:0/103034477 shutdown_connections 2023-10-18T14:01:58.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:01:58.429+0000 7f7c47aff700 1 -- 172.21.15.114:0/103034477 wait complete. 2023-10-18T14:01:58.791 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:58 smithi114 ceph-mon[99494]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:01:58.791 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:01:58 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/103034477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:01:58.792 INFO:tasks.cephadm:Adding mds.a on smithi114 2023-10-18T14:01:58.793 INFO:tasks.cephadm:Adding mds.d on smithi114 2023-10-18T14:01:58.793 INFO:tasks.cephadm:Adding mds.g on smithi114 2023-10-18T14:01:58.793 INFO:tasks.cephadm:Adding mds.j on smithi114 2023-10-18T14:01:58.793 INFO:tasks.cephadm:Adding mds.b on smithi158 2023-10-18T14:01:58.793 INFO:tasks.cephadm:Adding mds.e on smithi158 2023-10-18T14:01:58.794 INFO:tasks.cephadm:Adding mds.h on smithi158 2023-10-18T14:01:58.794 INFO:tasks.cephadm:Adding mds.k on smithi158 2023-10-18T14:01:58.794 INFO:tasks.cephadm:Adding mds.c on smithi172 2023-10-18T14:01:58.795 INFO:tasks.cephadm:Adding mds.f on smithi172 2023-10-18T14:01:58.795 INFO:tasks.cephadm:Adding mds.i on smithi172 2023-10-18T14:01:58.795 INFO:tasks.cephadm:Adding mds.l on smithi172 2023-10-18T14:01:58.795 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph orch apply mds all '12;smithi114=a;smithi114=d;smithi114=g;smithi114=j;smithi158=b;smithi158=e;smithi158=h;smithi158=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l' 2023-10-18T14:01:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:58 smithi158 ceph-mon[103317]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:01:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:01:58 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/103034477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:01:59.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:58 smithi172 ceph-mon[103574]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:01:59.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:01:58 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/103034477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:01:59.374 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T14:02:00.583 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.580+0000 7fd3358cf700 1 -- 172.21.15.172:0/2418350240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330105690 msgr2=0x7fd330105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:00.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.580+0000 7fd3358cf700 1 --2- 172.21.15.172:0/2418350240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330105690 0x7fd330105a70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd320009990 tx=0x7fd320009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:00.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.580+0000 7fd3358cf700 1 -- 172.21.15.172:0/2418350240 shutdown_connections 2023-10-18T14:02:00.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.580+0000 7fd3358cf700 1 --2- 172.21.15.172:0/2418350240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3301000a0 0x7fd33010c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:00.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.580+0000 7fd3358cf700 1 --2- 172.21.15.172:0/2418350240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330105690 0x7fd330105a70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:00.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.580+0000 7fd3358cf700 1 --2- 172.21.15.172:0/2418350240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3300ff6e0 0x7fd3300ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:00.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.580+0000 7fd3358cf700 1 -- 172.21.15.172:0/2418350240 >> 172.21.15.172:0/2418350240 conn(0x7fd3300766c0 msgr2=0x7fd330076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:00.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.580+0000 7fd3358cf700 1 -- 172.21.15.172:0/2418350240 shutdown_connections 2023-10-18T14:02:00.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.580+0000 7fd3358cf700 1 -- 172.21.15.172:0/2418350240 wait complete. 2023-10-18T14:02:00.588 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.581+0000 7fd3358cf700 1 Processor -- start 2023-10-18T14:02:00.588 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.581+0000 7fd3358cf700 1 -- start start 2023-10-18T14:02:00.588 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd3358cf700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3300ff6e0 0x7fd330197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:00.588 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd3358cf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3301000a0 0x7fd330197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:00.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd3358cf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330105690 0x7fd3301a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:00.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd3358cf700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3301987a0 con 0x7fd3301000a0 2023-10-18T14:02:00.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd3358cf700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3301a2fd0 con 0x7fd3300ff6e0 2023-10-18T14:02:00.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd3358cf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3301a3110 con 0x7fd330105690 2023-10-18T14:02:00.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd32f7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330105690 0x7fd3301a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:00.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd32f7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330105690 0x7fd3301a2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55534/0 (socket says 172.21.15.172:55534) 2023-10-18T14:02:00.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd32f7fe700 1 -- 172.21.15.172:0/2166424380 learned_addr learned my addr 172.21.15.172:0/2166424380 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T14:02:00.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd32effd700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3300ff6e0 0x7fd330197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:00.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd32e7fc700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3301000a0 0x7fd330197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:00.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd32f7fe700 1 -- 172.21.15.172:0/2166424380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3300ff6e0 msgr2=0x7fd330197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:00.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd32f7fe700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3300ff6e0 0x7fd330197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:00.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd32f7fe700 1 -- 172.21.15.172:0/2166424380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3301000a0 msgr2=0x7fd330197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:00.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd32f7fe700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3301000a0 0x7fd330197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:00.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd32f7fe700 1 -- 172.21.15.172:0/2166424380 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3200095f0 con 0x7fd330105690 2023-10-18T14:02:00.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd32e7fc700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3301000a0 0x7fd330197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:02:00.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd32f7fe700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330105690 0x7fd3301a2a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd328007ee0 tx=0x7fd32800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:00.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.582+0000 7fd3348cd700 1 -- 172.21.15.172:0/2166424380 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328017070 con 0x7fd330105690 2023-10-18T14:02:00.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.583+0000 7fd3348cd700 1 -- 172.21.15.172:0/2166424380 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd32800f040 con 0x7fd330105690 2023-10-18T14:02:00.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.583+0000 7fd3348cd700 1 -- 172.21.15.172:0/2166424380 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328005740 con 0x7fd330105690 2023-10-18T14:02:00.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.583+0000 7fd3358cf700 1 -- 172.21.15.172:0/2166424380 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3301a3370 con 0x7fd330105690 2023-10-18T14:02:00.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.583+0000 7fd3358cf700 1 -- 172.21.15.172:0/2166424380 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3301a3820 con 0x7fd330105690 2023-10-18T14:02:00.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.584+0000 7fd3358cf700 1 -- 172.21.15.172:0/2166424380 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd330107c90 con 0x7fd330105690 2023-10-18T14:02:00.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.584+0000 7fd3348cd700 1 -- 172.21.15.172:0/2166424380 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fd32800dbd0 con 0x7fd330105690 2023-10-18T14:02:00.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.585+0000 7fd3348cd700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3180a1550 0x7fd3180a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:00.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.585+0000 7fd3348cd700 1 -- 172.21.15.172:0/2166424380 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fd3280cc0d0 con 0x7fd330105690 2023-10-18T14:02:00.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.585+0000 7fd32effd700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3180a1550 0x7fd3180a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:00.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.586+0000 7fd32effd700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3180a1550 0x7fd3180a3a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd320005850 tx=0x7fd32001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:00.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.589+0000 7fd3348cd700 1 -- 172.21.15.172:0/2166424380 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd328095b00 con 0x7fd330105690 2023-10-18T14:02:00.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.786+0000 7fd3358cf700 1 -- 172.21.15.172:0/2166424380 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi114=a;smithi114=d;smithi114=g;smithi114=j;smithi158=b;smithi158=e;smithi158=h;smithi158=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fd33010f630 con 0x7fd3180a1550 2023-10-18T14:02:00.796 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.794+0000 7fd3348cd700 1 -- 172.21.15.172:0/2166424380 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fd33010f630 con 0x7fd3180a1550 2023-10-18T14:02:00.797 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mds.all update... 2023-10-18T14:02:00.799 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.796+0000 7fd3358cf700 1 -- 172.21.15.172:0/2166424380 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3180a1550 msgr2=0x7fd3180a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:00.799 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.796+0000 7fd3358cf700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3180a1550 0x7fd3180a3a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd320005850 tx=0x7fd32001a040 comp rx=0 tx=0).stop 2023-10-18T14:02:00.799 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.796+0000 7fd3358cf700 1 -- 172.21.15.172:0/2166424380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330105690 msgr2=0x7fd3301a2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:00.799 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.796+0000 7fd3358cf700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330105690 0x7fd3301a2a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd328007ee0 tx=0x7fd32800d3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:00.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.796+0000 7fd3358cf700 1 -- 172.21.15.172:0/2166424380 shutdown_connections 2023-10-18T14:02:00.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.796+0000 7fd3358cf700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3180a1550 0x7fd3180a3a10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:00.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.796+0000 7fd3358cf700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330105690 0x7fd3301a2a90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:00.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.796+0000 7fd3358cf700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3300ff6e0 0x7fd330197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:00.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.796+0000 7fd3358cf700 1 --2- 172.21.15.172:0/2166424380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3301000a0 0x7fd330197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:00.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.796+0000 7fd3358cf700 1 -- 172.21.15.172:0/2166424380 >> 172.21.15.172:0/2166424380 conn(0x7fd3300766c0 msgr2=0x7fd3300fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:00.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.796+0000 7fd3358cf700 1 -- 172.21.15.172:0/2166424380 shutdown_connections 2023-10-18T14:02:00.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T14:02:00.796+0000 7fd3358cf700 1 -- 172.21.15.172:0/2166424380 wait complete. 2023-10-18T14:02:00.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:00 smithi172 ceph-mon[103574]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:01.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:00 smithi158 ceph-mon[103317]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:01.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:00 smithi114 ceph-mon[99494]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:01.231 DEBUG:teuthology.orchestra.run.smithi114:mds.a> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.a.service 2023-10-18T14:02:01.235 DEBUG:teuthology.orchestra.run.smithi114:mds.d> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.d.service 2023-10-18T14:02:01.271 INFO:journalctl@ceph.mds.a.smithi114.stdout:-- Logs begin at Wed 2023-10-18 13:40:26 UTC. -- 2023-10-18T14:02:01.272 DEBUG:teuthology.orchestra.run.smithi114:mds.g> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.g.service 2023-10-18T14:02:01.302 INFO:journalctl@ceph.mds.d.smithi114.stdout:-- Logs begin at Wed 2023-10-18 13:40:26 UTC. -- 2023-10-18T14:02:01.303 DEBUG:teuthology.orchestra.run.smithi114:mds.j> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.j.service 2023-10-18T14:02:01.331 INFO:journalctl@ceph.mds.g.smithi114.stdout:-- Logs begin at Wed 2023-10-18 13:40:26 UTC. -- 2023-10-18T14:02:01.331 DEBUG:teuthology.orchestra.run.smithi158:mds.b> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.b.service 2023-10-18T14:02:01.334 DEBUG:teuthology.orchestra.run.smithi158:mds.e> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.e.service 2023-10-18T14:02:01.358 INFO:journalctl@ceph.mds.j.smithi114.stdout:-- Logs begin at Wed 2023-10-18 13:40:26 UTC. -- 2023-10-18T14:02:01.371 INFO:journalctl@ceph.mds.b.smithi158.stdout:-- Logs begin at Wed 2023-10-18 13:41:14 UTC. -- 2023-10-18T14:02:01.373 DEBUG:teuthology.orchestra.run.smithi158:mds.h> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.h.service 2023-10-18T14:02:01.401 INFO:journalctl@ceph.mds.e.smithi158.stdout:-- Logs begin at Wed 2023-10-18 13:41:14 UTC. -- 2023-10-18T14:02:01.402 DEBUG:teuthology.orchestra.run.smithi158:mds.k> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.k.service 2023-10-18T14:02:01.430 INFO:journalctl@ceph.mds.h.smithi158.stdout:-- Logs begin at Wed 2023-10-18 13:41:14 UTC. -- 2023-10-18T14:02:01.431 DEBUG:teuthology.orchestra.run.smithi172:mds.c> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.c.service 2023-10-18T14:02:01.433 DEBUG:teuthology.orchestra.run.smithi172:mds.f> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.f.service 2023-10-18T14:02:01.458 INFO:journalctl@ceph.mds.k.smithi158.stdout:-- Logs begin at Wed 2023-10-18 13:41:14 UTC. -- 2023-10-18T14:02:01.464 INFO:journalctl@ceph.mds.c.smithi172.stdout:-- Logs begin at Wed 2023-10-18 13:40:49 UTC. -- 2023-10-18T14:02:01.465 DEBUG:teuthology.orchestra.run.smithi172:mds.i> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.i.service 2023-10-18T14:02:01.491 INFO:journalctl@ceph.mds.f.smithi172.stdout:-- Logs begin at Wed 2023-10-18 13:40:49 UTC. -- 2023-10-18T14:02:01.492 DEBUG:teuthology.orchestra.run.smithi172:mds.l> sudo journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.l.service 2023-10-18T14:02:01.518 INFO:journalctl@ceph.mds.i.smithi172.stdout:-- Logs begin at Wed 2023-10-18 13:40:49 UTC. -- 2023-10-18T14:02:01.519 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-18T14:02:01.519 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:02:01.550 INFO:journalctl@ceph.mds.l.smithi172.stdout:-- Logs begin at Wed 2023-10-18 13:40:49 UTC. -- 2023-10-18T14:02:01.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.655+0000 7f11cc750700 1 -- 172.21.15.114:0/3494458439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c4104640 msgr2=0x7f11c4104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:01.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.655+0000 7f11cc750700 1 --2- 172.21.15.114:0/3494458439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c4104640 0x7f11c4104a20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009990 tx=0x7f11c0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:01.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.655+0000 7f11cc750700 1 -- 172.21.15.114:0/3494458439 shutdown_connections 2023-10-18T14:02:01.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.655+0000 7f11cc750700 1 --2- 172.21.15.114:0/3494458439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c4100b20 0x7f11c410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:01.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.655+0000 7f11cc750700 1 --2- 172.21.15.114:0/3494458439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c4104640 0x7f11c4104a20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:01.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.655+0000 7f11cc750700 1 --2- 172.21.15.114:0/3494458439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11c4100160 0x7f11c41005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:01.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.655+0000 7f11cc750700 1 -- 172.21.15.114:0/3494458439 >> 172.21.15.114:0/3494458439 conn(0x7f11c40748e0 msgr2=0x7f11c4074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:01.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.655+0000 7f11cc750700 1 -- 172.21.15.114:0/3494458439 shutdown_connections 2023-10-18T14:02:01.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.655+0000 7f11cc750700 1 -- 172.21.15.114:0/3494458439 wait complete. 2023-10-18T14:02:01.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11cc750700 1 Processor -- start 2023-10-18T14:02:01.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11cc750700 1 -- start start 2023-10-18T14:02:01.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11cc750700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c4100160 0x7f11c419c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:01.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11cc750700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c4100b20 0x7f11c419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:01.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11cc750700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11c4104640 0x7f11c41968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:01.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11cc750700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c4196f50 con 0x7f11c4100b20 2023-10-18T14:02:01.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11cc750700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c41970c0 con 0x7f11c4104640 2023-10-18T14:02:01.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11cc750700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c4197280 con 0x7f11c4100160 2023-10-18T14:02:01.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11c9ceb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c4100b20 0x7f11c419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:01.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11c9ceb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c4100b20 0x7f11c419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42044/0 (socket says 172.21.15.114:42044) 2023-10-18T14:02:01.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11c9ceb700 1 -- 172.21.15.114:0/1353954090 learned_addr learned my addr 172.21.15.114:0/1353954090 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:01.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11ca4ec700 1 --2- 172.21.15.114:0/1353954090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c4100160 0x7f11c419c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:01.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11c9ceb700 1 -- 172.21.15.114:0/1353954090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c4100160 msgr2=0x7f11c419c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:01.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11c9ceb700 1 --2- 172.21.15.114:0/1353954090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c4100160 0x7f11c419c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:01.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11c9ceb700 1 -- 172.21.15.114:0/1353954090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11c4104640 msgr2=0x7f11c41968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:01.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11c9ceb700 1 --2- 172.21.15.114:0/1353954090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11c4104640 0x7f11c41968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:01.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11c9ceb700 1 -- 172.21.15.114:0/1353954090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c00095f0 con 0x7f11c4100b20 2023-10-18T14:02:01.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11c9ceb700 1 --2- 172.21.15.114:0/1353954090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c4100b20 0x7f11c419cd00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f11b400d950 tx=0x7f11b400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:01.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11bb7fe700 1 -- 172.21.15.114:0/1353954090 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b40098c0 con 0x7f11c4100b20 2023-10-18T14:02:01.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11bb7fe700 1 -- 172.21.15.114:0/1353954090 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11b4010460 con 0x7f11c4100b20 2023-10-18T14:02:01.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11bb7fe700 1 -- 172.21.15.114:0/1353954090 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b400f620 con 0x7f11c4100b20 2023-10-18T14:02:01.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11cc750700 1 -- 172.21.15.114:0/1353954090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c4197560 con 0x7f11c4100b20 2023-10-18T14:02:01.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.656+0000 7f11cc750700 1 -- 172.21.15.114:0/1353954090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c41a37b0 con 0x7f11c4100b20 2023-10-18T14:02:01.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.657+0000 7f11cc750700 1 -- 172.21.15.114:0/1353954090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c4108bf0 con 0x7f11c4100b20 2023-10-18T14:02:01.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.659+0000 7f11bb7fe700 1 -- 172.21.15.114:0/1353954090 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f11b40108d0 con 0x7f11c4100b20 2023-10-18T14:02:01.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.659+0000 7f11bb7fe700 1 --2- 172.21.15.114:0/1353954090 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f11b00a14d0 0x7f11b00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:01.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.659+0000 7f11bb7fe700 1 -- 172.21.15.114:0/1353954090 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f11b40cc770 con 0x7f11c4100b20 2023-10-18T14:02:01.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.659+0000 7f11ca4ec700 1 --2- 172.21.15.114:0/1353954090 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f11b00a14d0 0x7f11b00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:01.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.660+0000 7f11ca4ec700 1 --2- 172.21.15.114:0/1353954090 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f11b00a14d0 0x7f11b00a3990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f11c0006010 tx=0x7f11c0005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:01.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.663+0000 7f11bb7fe700 1 -- 172.21.15.114:0/1353954090 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f11b40961a0 con 0x7f11c4100b20 2023-10-18T14:02:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.859+0000 7f11cc750700 1 -- 172.21.15.114:0/1353954090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11c40688c0 con 0x7f11c4100b20 2023-10-18T14:02:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.860+0000 7f11bb7fe700 1 -- 172.21.15.114:0/1353954090 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18823 (secure 0 0 0) 0x7f11b40997c0 con 0x7f11c4100b20 2023-10-18T14:02:01.863 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":79,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:01:52.492213+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:02:01.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.862+0000 7f11cc750700 1 -- 172.21.15.114:0/1353954090 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f11b00a14d0 msgr2=0x7f11b00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:01.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.862+0000 7f11cc750700 1 --2- 172.21.15.114:0/1353954090 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f11b00a14d0 0x7f11b00a3990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f11c0006010 tx=0x7f11c0005960 comp rx=0 tx=0).stop 2023-10-18T14:02:01.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.862+0000 7f11cc750700 1 -- 172.21.15.114:0/1353954090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c4100b20 msgr2=0x7f11c419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:01.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.862+0000 7f11cc750700 1 --2- 172.21.15.114:0/1353954090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c4100b20 0x7f11c419cd00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f11b400d950 tx=0x7f11b400dc60 comp rx=0 tx=0).stop 2023-10-18T14:02:01.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.862+0000 7f11cc750700 1 -- 172.21.15.114:0/1353954090 shutdown_connections 2023-10-18T14:02:01.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.862+0000 7f11cc750700 1 --2- 172.21.15.114:0/1353954090 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f11b00a14d0 0x7f11b00a3990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:01.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.862+0000 7f11cc750700 1 --2- 172.21.15.114:0/1353954090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f11c4104640 0x7f11c41968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:01.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.862+0000 7f11cc750700 1 --2- 172.21.15.114:0/1353954090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c4100160 0x7f11c419c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.862+0000 7f11cc750700 1 --2- 172.21.15.114:0/1353954090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c4100b20 0x7f11c419cd00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.862+0000 7f11cc750700 1 -- 172.21.15.114:0/1353954090 >> 172.21.15.114:0/1353954090 conn(0x7f11c40748e0 msgr2=0x7f11c40ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.862+0000 7f11cc750700 1 -- 172.21.15.114:0/1353954090 shutdown_connections 2023-10-18T14:02:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.862+0000 7f11cc750700 1 -- 172.21.15.114:0/1353954090 wait complete. 2023-10-18T14:02:01.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T13:58:43.813590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T14:02:01.878 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T14:02:02.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.999+0000 7f9feaf19700 1 -- 172.21.15.114:0/1604752393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe40ff9d0 msgr2=0x7f9fe40ffdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:02.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:01.999+0000 7f9feaf19700 1 --2- 172.21.15.114:0/1604752393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe40ff9d0 0x7f9fe40ffdb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009990 tx=0x7f9fd8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.000+0000 7f9feaf19700 1 -- 172.21.15.114:0/1604752393 shutdown_connections 2023-10-18T14:02:02.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.000+0000 7f9feaf19700 1 --2- 172.21.15.114:0/1604752393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fe4101ba0 0x7f9fe410c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.000+0000 7f9feaf19700 1 --2- 172.21.15.114:0/1604752393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe40ff9d0 0x7f9fe40ffdb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.000+0000 7f9feaf19700 1 --2- 172.21.15.114:0/1604752393 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe41011e0 0x7f9fe4101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.000+0000 7f9feaf19700 1 -- 172.21.15.114:0/1604752393 >> 172.21.15.114:0/1604752393 conn(0x7f9fe40fb0a0 msgr2=0x7f9fe40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:02.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.000+0000 7f9feaf19700 1 -- 172.21.15.114:0/1604752393 shutdown_connections 2023-10-18T14:02:02.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.000+0000 7f9feaf19700 1 -- 172.21.15.114:0/1604752393 wait complete. 2023-10-18T14:02:02.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.000+0000 7f9feaf19700 1 Processor -- start 2023-10-18T14:02:02.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.000+0000 7f9feaf19700 1 -- start start 2023-10-18T14:02:02.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9feaf19700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fe40ff9d0 0x7f9fe419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:02.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9feaf19700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe41011e0 0x7f9fe419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:02.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9feaf19700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe4101ba0 0x7f9fe41959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:02.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9feaf19700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4196000 con 0x7f9fe4101ba0 2023-10-18T14:02:02.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9feaf19700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4196170 con 0x7f9fe41011e0 2023-10-18T14:02:02.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9feaf19700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4196330 con 0x7f9fe40ff9d0 2023-10-18T14:02:02.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe94b6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe4101ba0 0x7f9fe41959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:02.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe94b6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe4101ba0 0x7f9fe41959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42060/0 (socket says 172.21.15.114:42060) 2023-10-18T14:02:02.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe94b6700 1 -- 172.21.15.114:0/3627528557 learned_addr learned my addr 172.21.15.114:0/3627528557 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:02.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe8cb5700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fe40ff9d0 0x7f9fe419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:02.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe3fff700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe41011e0 0x7f9fe419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:02.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe94b6700 1 -- 172.21.15.114:0/3627528557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fe40ff9d0 msgr2=0x7f9fe419b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:02.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe94b6700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fe40ff9d0 0x7f9fe419b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe94b6700 1 -- 172.21.15.114:0/3627528557 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe41011e0 msgr2=0x7f9fe419bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:02.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe94b6700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe41011e0 0x7f9fe419bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe94b6700 1 -- 172.21.15.114:0/3627528557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd80095f0 con 0x7f9fe4101ba0 2023-10-18T14:02:02.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe94b6700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe4101ba0 0x7f9fe41959a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00db90 tx=0x7f9fdc00dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:02.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe1ffb700 1 -- 172.21.15.114:0/3627528557 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00e6a0 con 0x7f9fe4101ba0 2023-10-18T14:02:02.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe1ffb700 1 -- 172.21.15.114:0/3627528557 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fdc00bac0 con 0x7f9fe4101ba0 2023-10-18T14:02:02.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9feaf19700 1 -- 172.21.15.114:0/3627528557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe41965b0 con 0x7f9fe4101ba0 2023-10-18T14:02:02.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.001+0000 7f9fe1ffb700 1 -- 172.21.15.114:0/3627528557 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc009e00 con 0x7f9fe4101ba0 2023-10-18T14:02:02.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.002+0000 7f9feaf19700 1 -- 172.21.15.114:0/3627528557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe4068c30 con 0x7f9fe4101ba0 2023-10-18T14:02:02.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.002+0000 7f9feaf19700 1 -- 172.21.15.114:0/3627528557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe4100d50 con 0x7f9fe4101ba0 2023-10-18T14:02:02.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.003+0000 7f9fe1ffb700 1 -- 172.21.15.114:0/3627528557 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f9fdc00e800 con 0x7f9fe4101ba0 2023-10-18T14:02:02.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.004+0000 7f9fe1ffb700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9fd40a14d0 0x7f9fd40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:02.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.004+0000 7f9fe8cb5700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9fd40a14d0 0x7f9fd40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:02.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.004+0000 7f9fe1ffb700 1 -- 172.21.15.114:0/3627528557 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f9fdc006e40 con 0x7f9fe4101ba0 2023-10-18T14:02:02.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.004+0000 7f9fe8cb5700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9fd40a14d0 0x7f9fd40a3990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800b5c0 tx=0x7f9fd8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:02.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.008+0000 7f9fe1ffb700 1 -- 172.21.15.114:0/3627528557 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9fdc050100 con 0x7f9fe4101ba0 2023-10-18T14:02:02.047 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:01 smithi172 ceph-mon[103574]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi114=a;smithi114=d;smithi114=g;smithi114=j;smithi158=b;smithi158=e;smithi158=h;smithi158=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:02.047 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:01 smithi172 ceph-mon[103574]: Saving service mds.all spec with placement smithi114=a;smithi114=d;smithi114=g;smithi114=j;smithi158=b;smithi158=e;smithi158=h;smithi158=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2023-10-18T14:02:02.047 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:02.047 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:02:02.048 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:02.048 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:02:02.048 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:02.048 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:02.048 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:02.049 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:01 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:02.049 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:01 smithi172 ceph-mon[103574]: Deploying daemon mds.l on smithi172 2023-10-18T14:02:02.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:01 smithi114 ceph-mon[99494]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi114=a;smithi114=d;smithi114=g;smithi114=j;smithi158=b;smithi158=e;smithi158=h;smithi158=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:02.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:01 smithi114 ceph-mon[99494]: Saving service mds.all spec with placement smithi114=a;smithi114=d;smithi114=g;smithi114=j;smithi158=b;smithi158=e;smithi158=h;smithi158=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2023-10-18T14:02:02.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:02.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:02:02.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:02.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:02:02.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:02.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:02.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:02.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:01 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:02.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:01 smithi114 ceph-mon[99494]: Deploying daemon mds.l on smithi172 2023-10-18T14:02:02.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.199+0000 7f9feaf19700 1 -- 172.21.15.114:0/3627528557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9fe4196e60 con 0x7f9fe4101ba0 2023-10-18T14:02:02.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.199+0000 7f9fe1ffb700 1 -- 172.21.15.114:0/3627528557 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9fdc0977a0 con 0x7f9fe4101ba0 2023-10-18T14:02:02.202 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T14:02:02.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.201+0000 7f9feaf19700 1 -- 172.21.15.114:0/3627528557 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9fd40a14d0 msgr2=0x7f9fd40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:02.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.201+0000 7f9feaf19700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9fd40a14d0 0x7f9fd40a3990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800b5c0 tx=0x7f9fd8005960 comp rx=0 tx=0).stop 2023-10-18T14:02:02.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.201+0000 7f9feaf19700 1 -- 172.21.15.114:0/3627528557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe4101ba0 msgr2=0x7f9fe41959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:02.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.201+0000 7f9feaf19700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe4101ba0 0x7f9fe41959a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00db90 tx=0x7f9fdc00dea0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.201+0000 7f9feaf19700 1 -- 172.21.15.114:0/3627528557 shutdown_connections 2023-10-18T14:02:02.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.201+0000 7f9feaf19700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9fd40a14d0 0x7f9fd40a3990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.201+0000 7f9feaf19700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe4101ba0 0x7f9fe41959a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.201+0000 7f9feaf19700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fe40ff9d0 0x7f9fe419b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.201+0000 7f9feaf19700 1 --2- 172.21.15.114:0/3627528557 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9fe41011e0 0x7f9fe419bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.202+0000 7f9feaf19700 1 -- 172.21.15.114:0/3627528557 >> 172.21.15.114:0/3627528557 conn(0x7f9fe40fb0a0 msgr2=0x7f9fe40fb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:02.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.202+0000 7f9feaf19700 1 -- 172.21.15.114:0/3627528557 shutdown_connections 2023-10-18T14:02:02.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.202+0000 7f9feaf19700 1 -- 172.21.15.114:0/3627528557 wait complete. 2023-10-18T14:02:02.217 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:02:02.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:01 smithi158 ceph-mon[103317]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi114=a;smithi114=d;smithi114=g;smithi114=j;smithi158=b;smithi158=e;smithi158=h;smithi158=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:02.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:01 smithi158 ceph-mon[103317]: Saving service mds.all spec with placement smithi114=a;smithi114=d;smithi114=g;smithi114=j;smithi158=b;smithi158=e;smithi158=h;smithi158=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2023-10-18T14:02:02.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:02.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:02:02.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:02.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:02:02.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:02.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:02.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:02.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:01 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:02.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:01 smithi158 ceph-mon[103317]: Deploying daemon mds.l on smithi172 2023-10-18T14:02:02.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.335+0000 7fb73e9f3700 1 -- 172.21.15.114:0/4056411542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7380ff5b0 msgr2=0x7fb7380ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:02.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.335+0000 7fb73e9f3700 1 --2- 172.21.15.114:0/4056411542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7380ff5b0 0x7fb7380ffa30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb7280099c0 tx=0x7fb728009cd0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.335+0000 7fb73e9f3700 1 -- 172.21.15.114:0/4056411542 shutdown_connections 2023-10-18T14:02:02.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.335+0000 7fb73e9f3700 1 --2- 172.21.15.114:0/4056411542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7380fff70 0x7fb73810c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.335+0000 7fb73e9f3700 1 --2- 172.21.15.114:0/4056411542 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb738105670 0x7fb738105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.335+0000 7fb73e9f3700 1 --2- 172.21.15.114:0/4056411542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7380ff5b0 0x7fb7380ffa30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.335+0000 7fb73e9f3700 1 -- 172.21.15.114:0/4056411542 >> 172.21.15.114:0/4056411542 conn(0x7fb7380fb060 msgr2=0x7fb7380fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:02.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.335+0000 7fb73e9f3700 1 -- 172.21.15.114:0/4056411542 shutdown_connections 2023-10-18T14:02:02.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.335+0000 7fb73e9f3700 1 -- 172.21.15.114:0/4056411542 wait complete. 2023-10-18T14:02:02.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.335+0000 7fb73e9f3700 1 Processor -- start 2023-10-18T14:02:02.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.335+0000 7fb73e9f3700 1 -- start start 2023-10-18T14:02:02.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb73e9f3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7380ff5b0 0x7fb73819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:02.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb73e9f3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7380fff70 0x7fb73819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:02.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb73e9f3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb738105670 0x7fb738196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:02.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb73e9f3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb738196fe0 con 0x7fb7380fff70 2023-10-18T14:02:02.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb73e9f3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb738197150 con 0x7fb738105670 2023-10-18T14:02:02.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb73e9f3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb738197310 con 0x7fb7380ff5b0 2023-10-18T14:02:02.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb7377fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7380fff70 0x7fb73819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:02.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb7377fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7380fff70 0x7fb73819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42072/0 (socket says 172.21.15.114:42072) 2023-10-18T14:02:02.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb7377fe700 1 -- 172.21.15.114:0/2145274663 learned_addr learned my addr 172.21.15.114:0/2145274663 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:02.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb737fff700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7380ff5b0 0x7fb73819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:02.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb73cf90700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb738105670 0x7fb738196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:02.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb7377fe700 1 -- 172.21.15.114:0/2145274663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7380ff5b0 msgr2=0x7fb73819c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:02.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb7377fe700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7380ff5b0 0x7fb73819c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb7377fe700 1 -- 172.21.15.114:0/2145274663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb738105670 msgr2=0x7fb738196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:02.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb7377fe700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb738105670 0x7fb738196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb7377fe700 1 -- 172.21.15.114:0/2145274663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280095f0 con 0x7fb7380fff70 2023-10-18T14:02:02.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb7377fe700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7380fff70 0x7fb73819cd40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb72800b580 tx=0x7fb72800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:02.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.336+0000 7fb7357fa700 1 -- 172.21.15.114:0/2145274663 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72801c070 con 0x7fb7380fff70 2023-10-18T14:02:02.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.337+0000 7fb73e9f3700 1 -- 172.21.15.114:0/2145274663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb738197590 con 0x7fb7380fff70 2023-10-18T14:02:02.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.337+0000 7fb7357fa700 1 -- 172.21.15.114:0/2145274663 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb72800fd80 con 0x7fb7380fff70 2023-10-18T14:02:02.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.337+0000 7fb7357fa700 1 -- 172.21.15.114:0/2145274663 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728022c40 con 0x7fb7380fff70 2023-10-18T14:02:02.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.337+0000 7fb73e9f3700 1 -- 172.21.15.114:0/2145274663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7381a37f0 con 0x7fb7380fff70 2023-10-18T14:02:02.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.337+0000 7fb73e9f3700 1 -- 172.21.15.114:0/2145274663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7381977a0 con 0x7fb7380fff70 2023-10-18T14:02:02.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.338+0000 7fb7357fa700 1 -- 172.21.15.114:0/2145274663 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fb728020070 con 0x7fb7380fff70 2023-10-18T14:02:02.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.339+0000 7fb7357fa700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb7200a14d0 0x7fb7200a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:02.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.339+0000 7fb737fff700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb7200a14d0 0x7fb7200a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:02.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.339+0000 7fb7357fa700 1 -- 172.21.15.114:0/2145274663 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fb7280cdc80 con 0x7fb7380fff70 2023-10-18T14:02:02.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.339+0000 7fb737fff700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb7200a14d0 0x7fb7200a3990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009c60 tx=0x7fb72c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:02.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.342+0000 7fb7357fa700 1 -- 172.21.15.114:0/2145274663 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb728097740 con 0x7fb7380fff70 2023-10-18T14:02:02.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.579+0000 7fb73e9f3700 1 -- 172.21.15.114:0/2145274663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb738100cd0 con 0x7fb7380fff70 2023-10-18T14:02:02.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.580+0000 7fb7357fa700 1 -- 172.21.15.114:0/2145274663 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fb72809ad60 con 0x7fb7380fff70 2023-10-18T14:02:02.583 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:02.583 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-18T14:02:02.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.582+0000 7fb73e9f3700 1 -- 172.21.15.114:0/2145274663 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb7200a14d0 msgr2=0x7fb7200a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:02.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.582+0000 7fb73e9f3700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb7200a14d0 0x7fb7200a3990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009c60 tx=0x7fb72c009260 comp rx=0 tx=0).stop 2023-10-18T14:02:02.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.582+0000 7fb73e9f3700 1 -- 172.21.15.114:0/2145274663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7380fff70 msgr2=0x7fb73819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:02.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.582+0000 7fb73e9f3700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7380fff70 0x7fb73819cd40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb72800b580 tx=0x7fb72800f690 comp rx=0 tx=0).stop 2023-10-18T14:02:02.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.582+0000 7fb73e9f3700 1 -- 172.21.15.114:0/2145274663 shutdown_connections 2023-10-18T14:02:02.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.582+0000 7fb73e9f3700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb7200a14d0 0x7fb7200a3990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.582+0000 7fb73e9f3700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb738105670 0x7fb738196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.582+0000 7fb73e9f3700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7380ff5b0 0x7fb73819c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.582+0000 7fb73e9f3700 1 --2- 172.21.15.114:0/2145274663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7380fff70 0x7fb73819cd40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.582+0000 7fb73e9f3700 1 -- 172.21.15.114:0/2145274663 >> 172.21.15.114:0/2145274663 conn(0x7fb7380fb060 msgr2=0x7fb738103740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.582+0000 7fb73e9f3700 1 -- 172.21.15.114:0/2145274663 shutdown_connections 2023-10-18T14:02:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:02.582+0000 7fb73e9f3700 1 -- 172.21.15.114:0/2145274663 wait complete. 2023-10-18T14:02:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 1 2023-10-18T14:02:02.727 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:02:02 smithi172 systemd[1]: Starting Ceph mds.l for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:02:02.980 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:02:02 smithi172 podman[142385]: 2023-10-18T14:02:02.981 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:02 smithi172 ceph-mon[103574]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:02.981 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:02 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1353954090' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:02.982 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:02 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3627528557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:02:02.982 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:02 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2145274663' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:03.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:02 smithi114 ceph-mon[99494]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:03.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:02 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1353954090' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:03.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:02 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3627528557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:02:03.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:02 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2145274663' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:03.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:02 smithi158 ceph-mon[103317]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:03.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:02 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1353954090' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:03.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:02 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3627528557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:02:03.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:02 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2145274663' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:03.310 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:02:02 smithi172 ceph-mds[142425]: -- 172.21.15.172:0/2714339845 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559a7e4ef1e0 con 0x559a7e4c4c00 2023-10-18T14:02:03.310 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:02:02 smithi172 bash[142385]: 2118ca0add8157db9a9a160c14d8d355d985b10c538abdd535aa5af8c1c10e63 2023-10-18T14:02:03.310 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:02:02 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-l[142401]: starting mds.l at 2023-10-18T14:02:03.310 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:02:03 smithi172 systemd[1]: Started Ceph mds.l for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T14:02:04.260 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:03 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6832/3053339885,v1:172.21.15.172:6833/3053339885] up:boot 2023-10-18T14:02:04.260 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:03 smithi158 ceph-mon[103317]: fsmap 1 up:standby 2023-10-18T14:02:04.260 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-18T14:02:04.260 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:04.261 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:04.261 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:04.261 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:04.261 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:04.261 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:03 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:04.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:03 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6832/3053339885,v1:172.21.15.172:6833/3053339885] up:boot 2023-10-18T14:02:04.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:03 smithi172 ceph-mon[103574]: fsmap 1 up:standby 2023-10-18T14:02:04.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-18T14:02:04.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:04.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:04.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:04.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:04.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:04.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:03 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:04.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:03 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6832/3053339885,v1:172.21.15.172:6833/3053339885] up:boot 2023-10-18T14:02:04.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:03 smithi114 ceph-mon[99494]: fsmap 1 up:standby 2023-10-18T14:02:04.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-18T14:02:04.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:04.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:04.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:04.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:04.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:04.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:03 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:04.521 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:02:04 smithi158 systemd[1]: Starting Ceph mds.k for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:02:04.598 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:02:04.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.729+0000 7f5de30b1700 1 -- 172.21.15.114:0/433505342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ddc0ff8d0 msgr2=0x7f5ddc0ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:04.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.729+0000 7f5de30b1700 1 --2- 172.21.15.114:0/433505342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ddc0ff8d0 0x7f5ddc0ffd50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8009990 tx=0x7f5dc8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:04.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.729+0000 7f5de30b1700 1 -- 172.21.15.114:0/433505342 shutdown_connections 2023-10-18T14:02:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.729+0000 7f5de30b1700 1 --2- 172.21.15.114:0/433505342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ddc100290 0x7f5ddc10c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.730+0000 7f5de30b1700 1 --2- 172.21.15.114:0/433505342 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ddc105710 0x7f5ddc105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.730+0000 7f5de30b1700 1 --2- 172.21.15.114:0/433505342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ddc0ff8d0 0x7f5ddc0ffd50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.730+0000 7f5de30b1700 1 -- 172.21.15.114:0/433505342 >> 172.21.15.114:0/433505342 conn(0x7f5ddc076400 msgr2=0x7f5ddc076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.730+0000 7f5de30b1700 1 -- 172.21.15.114:0/433505342 shutdown_connections 2023-10-18T14:02:04.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.730+0000 7f5de30b1700 1 -- 172.21.15.114:0/433505342 wait complete. 2023-10-18T14:02:04.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.730+0000 7f5de30b1700 1 Processor -- start 2023-10-18T14:02:04.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.730+0000 7f5de30b1700 1 -- start start 2023-10-18T14:02:04.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.730+0000 7f5de30b1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ddc0ff8d0 0x7f5ddc195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:04.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.730+0000 7f5de30b1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ddc100290 0x7f5ddc195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:04.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.730+0000 7f5de30b1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ddc105710 0x7f5ddc196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:04.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.730+0000 7f5de30b1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc1a4fa0 con 0x7f5ddc100290 2023-10-18T14:02:04.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.730+0000 7f5de30b1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc1a5110 con 0x7f5ddc0ff8d0 2023-10-18T14:02:04.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.730+0000 7f5de30b1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc1a52d0 con 0x7f5ddc105710 2023-10-18T14:02:04.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5ddbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ddc100290 0x7f5ddc195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:04.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5ddbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ddc100290 0x7f5ddc195d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42086/0 (socket says 172.21.15.114:42086) 2023-10-18T14:02:04.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5ddbfff700 1 -- 172.21.15.114:0/2322602649 learned_addr learned my addr 172.21.15.114:0/2322602649 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:04.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5de164e700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ddc105710 0x7f5ddc196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:04.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5de0e4d700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ddc0ff8d0 0x7f5ddc195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:04.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5ddbfff700 1 -- 172.21.15.114:0/2322602649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ddc105710 msgr2=0x7f5ddc196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:04.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5ddbfff700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ddc105710 0x7f5ddc196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:04.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5ddbfff700 1 -- 172.21.15.114:0/2322602649 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ddc0ff8d0 msgr2=0x7f5ddc195800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:04.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5ddbfff700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ddc0ff8d0 0x7f5ddc195800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:04.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5ddbfff700 1 -- 172.21.15.114:0/2322602649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc80095f0 con 0x7f5ddc100290 2023-10-18T14:02:04.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5de0e4d700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ddc0ff8d0 0x7f5ddc195800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:02:04.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5ddbfff700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ddc100290 0x7f5ddc195d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80098e0 tx=0x7f5dc800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5dd9ffb700 1 -- 172.21.15.114:0/2322602649 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc801d070 con 0x7f5ddc100290 2023-10-18T14:02:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5de30b1700 1 -- 172.21.15.114:0/2322602649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ddc1a5550 con 0x7f5ddc100290 2023-10-18T14:02:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5dd9ffb700 1 -- 172.21.15.114:0/2322602649 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dc8022470 con 0x7f5ddc100290 2023-10-18T14:02:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5dd9ffb700 1 -- 172.21.15.114:0/2322602649 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8017650 con 0x7f5ddc100290 2023-10-18T14:02:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.731+0000 7f5de30b1700 1 -- 172.21.15.114:0/2322602649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ddc1a5a00 con 0x7f5ddc100290 2023-10-18T14:02:04.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.732+0000 7f5de30b1700 1 -- 172.21.15.114:0/2322602649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ddc107b00 con 0x7f5ddc100290 2023-10-18T14:02:04.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.734+0000 7f5dd9ffb700 1 -- 172.21.15.114:0/2322602649 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f5dc80225e0 con 0x7f5ddc100290 2023-10-18T14:02:04.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.734+0000 7f5dd9ffb700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5dcc0a14d0 0x7f5dcc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:04.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.734+0000 7f5dd9ffb700 1 -- 172.21.15.114:0/2322602649 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f5dc80cdd70 con 0x7f5ddc100290 2023-10-18T14:02:04.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.734+0000 7f5de0e4d700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5dcc0a14d0 0x7f5dcc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:04.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.735+0000 7f5de0e4d700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5dcc0a14d0 0x7f5dcc0a3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00099d0 tx=0x7f5dd0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:04.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.738+0000 7f5dd9ffb700 1 -- 172.21.15.114:0/2322602649 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5dc8097830 con 0x7f5ddc100290 2023-10-18T14:02:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.973+0000 7f5de30b1700 1 -- 172.21.15.114:0/2322602649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ddc100cc0 con 0x7f5ddc100290 2023-10-18T14:02:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.973+0000 7f5dd9ffb700 1 -- 172.21.15.114:0/2322602649 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7f5dc8027540 con 0x7f5ddc100290 2023-10-18T14:02:04.977 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:04.977 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-18T14:02:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.976+0000 7f5de30b1700 1 -- 172.21.15.114:0/2322602649 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5dcc0a14d0 msgr2=0x7f5dcc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.976+0000 7f5de30b1700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5dcc0a14d0 0x7f5dcc0a3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00099d0 tx=0x7f5dd0008040 comp rx=0 tx=0).stop 2023-10-18T14:02:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.976+0000 7f5de30b1700 1 -- 172.21.15.114:0/2322602649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ddc100290 msgr2=0x7f5ddc195d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:04.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.976+0000 7f5de30b1700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ddc100290 0x7f5ddc195d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80098e0 tx=0x7f5dc800f670 comp rx=0 tx=0).stop 2023-10-18T14:02:04.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.976+0000 7f5de30b1700 1 -- 172.21.15.114:0/2322602649 shutdown_connections 2023-10-18T14:02:04.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.976+0000 7f5de30b1700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5dcc0a14d0 0x7f5dcc0a3990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:04.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.976+0000 7f5de30b1700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ddc105710 0x7f5ddc196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:04.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.976+0000 7f5de30b1700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ddc0ff8d0 0x7f5ddc195800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.976+0000 7f5de30b1700 1 --2- 172.21.15.114:0/2322602649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ddc100290 0x7f5ddc195d40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.976+0000 7f5de30b1700 1 -- 172.21.15.114:0/2322602649 >> 172.21.15.114:0/2322602649 conn(0x7f5ddc076400 msgr2=0x7f5ddc0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.976+0000 7f5de30b1700 1 -- 172.21.15.114:0/2322602649 shutdown_connections 2023-10-18T14:02:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:04.976+0000 7f5de30b1700 1 -- 172.21.15.114:0/2322602649 wait complete. 2023-10-18T14:02:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 2 2023-10-18T14:02:05.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:04 smithi158 ceph-mon[103317]: Deploying daemon mds.k on smithi158 2023-10-18T14:02:05.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:04 smithi158 ceph-mon[103317]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:05.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:04 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2322602649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:05.022 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:02:04 smithi158 podman[140123]: 2023-10-18T14:02:05.022 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:02:04 smithi158 ceph-mds[140163]: -- 172.21.15.158:0/1264896135 <== mon.2 v2:172.21.15.158:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562d0c3171e0 con 0x562d0c2ec800 2023-10-18T14:02:05.022 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:02:04 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-k[140139]: starting mds.k at 2023-10-18T14:02:05.023 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:02:04 smithi158 bash[140123]: 42c88d01847909582424f9c7076e32e70c6313b96428923283ad0a7df44fda76 2023-10-18T14:02:05.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:04 smithi172 ceph-mon[103574]: Deploying daemon mds.k on smithi158 2023-10-18T14:02:05.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:04 smithi172 ceph-mon[103574]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:05.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:04 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2322602649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:05.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:04 smithi114 ceph-mon[99494]: Deploying daemon mds.k on smithi158 2023-10-18T14:02:05.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:04 smithi114 ceph-mon[99494]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:05.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:04 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2322602649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:05.521 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:02:05 smithi158 systemd[1]: Started Ceph mds.k for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T14:02:06.377 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:06.377 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:06.377 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:06.377 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:06.377 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:06.378 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:06.378 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:06 smithi114 ceph-mon[99494]: Deploying daemon mds.j on smithi114 2023-10-18T14:02:06.378 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:06 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.158:6832/2306126907,v1:172.21.15.158:6833/2306126907] up:boot 2023-10-18T14:02:06.378 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:06 smithi114 ceph-mon[99494]: fsmap 2 up:standby 2023-10-18T14:02:06.378 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:06 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-18T14:02:06.379 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:06 smithi114 ceph-mon[99494]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:06.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:06.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:06.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:06.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:06.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:06.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:06.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:06 smithi158 ceph-mon[103317]: Deploying daemon mds.j on smithi114 2023-10-18T14:02:06.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:06 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.158:6832/2306126907,v1:172.21.15.158:6833/2306126907] up:boot 2023-10-18T14:02:06.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:06 smithi158 ceph-mon[103317]: fsmap 2 up:standby 2023-10-18T14:02:06.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:06 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-18T14:02:06.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:06 smithi158 ceph-mon[103317]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:06.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:06.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:06.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:06.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:06.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:06.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:06.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:06 smithi172 ceph-mon[103574]: Deploying daemon mds.j on smithi114 2023-10-18T14:02:06.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:06 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.158:6832/2306126907,v1:172.21.15.158:6833/2306126907] up:boot 2023-10-18T14:02:06.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:06 smithi172 ceph-mon[103574]: fsmap 2 up:standby 2023-10-18T14:02:06.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:06 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-18T14:02:06.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:06 smithi172 ceph-mon[103574]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:06.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:02:07.020 INFO:journalctl@ceph.mds.j.smithi114.stdout:Oct 18 14:02:06 smithi114 systemd[1]: Starting Ceph mds.j for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:02:07.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.122+0000 7fb228534700 1 -- 172.21.15.114:0/1083146796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2200ff5f0 msgr2=0x7fb2200ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:07.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.122+0000 7fb228534700 1 --2- 172.21.15.114:0/1083146796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2200ff5f0 0x7fb2200ffa70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009990 tx=0x7fb21c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:07.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.122+0000 7fb228534700 1 -- 172.21.15.114:0/1083146796 shutdown_connections 2023-10-18T14:02:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.122+0000 7fb228534700 1 --2- 172.21.15.114:0/1083146796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2200fffb0 0x7fb22010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.122+0000 7fb228534700 1 --2- 172.21.15.114:0/1083146796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb220105680 0x7fb220105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.122+0000 7fb228534700 1 --2- 172.21.15.114:0/1083146796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2200ff5f0 0x7fb2200ffa70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.122+0000 7fb228534700 1 -- 172.21.15.114:0/1083146796 >> 172.21.15.114:0/1083146796 conn(0x7fb2200767e0 msgr2=0x7fb220076bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.122+0000 7fb228534700 1 -- 172.21.15.114:0/1083146796 shutdown_connections 2023-10-18T14:02:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.122+0000 7fb228534700 1 -- 172.21.15.114:0/1083146796 wait complete. 2023-10-18T14:02:07.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.123+0000 7fb228534700 1 Processor -- start 2023-10-18T14:02:07.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.123+0000 7fb228534700 1 -- start start 2023-10-18T14:02:07.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.123+0000 7fb228534700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2200ff5f0 0x7fb220195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:07.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.123+0000 7fb228534700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2200fffb0 0x7fb220195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:07.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.123+0000 7fb228534700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb220105680 0x7fb22019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:07.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.123+0000 7fb228534700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22019a900 con 0x7fb220105680 2023-10-18T14:02:07.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.123+0000 7fb228534700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22019aa70 con 0x7fb2200fffb0 2023-10-18T14:02:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.123+0000 7fb228534700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22019ac30 con 0x7fb2200ff5f0 2023-10-18T14:02:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.123+0000 7fb226ad1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb220105680 0x7fb22019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.123+0000 7fb226ad1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb220105680 0x7fb22019a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42098/0 (socket says 172.21.15.114:42098) 2023-10-18T14:02:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.123+0000 7fb226ad1700 1 -- 172.21.15.114:0/3144859633 learned_addr learned my addr 172.21.15.114:0/3144859633 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb2262d0700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2200ff5f0 0x7fb220195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb225acf700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2200fffb0 0x7fb220195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb226ad1700 1 -- 172.21.15.114:0/3144859633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2200ff5f0 msgr2=0x7fb220195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb226ad1700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2200ff5f0 0x7fb220195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb226ad1700 1 -- 172.21.15.114:0/3144859633 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2200fffb0 msgr2=0x7fb220195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb226ad1700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2200fffb0 0x7fb220195fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb226ad1700 1 -- 172.21.15.114:0/3144859633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c0095f0 con 0x7fb220105680 2023-10-18T14:02:07.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb225acf700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2200fffb0 0x7fb220195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:07.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb226ad1700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb220105680 0x7fb22019a330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb218007f10 tx=0x7fb21800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:07.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb2137fe700 1 -- 172.21.15.114:0/3144859633 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218017070 con 0x7fb220105680 2023-10-18T14:02:07.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb2137fe700 1 -- 172.21.15.114:0/3144859633 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb21800f040 con 0x7fb220105680 2023-10-18T14:02:07.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb228534700 1 -- 172.21.15.114:0/3144859633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22019af10 con 0x7fb220105680 2023-10-18T14:02:07.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb2137fe700 1 -- 172.21.15.114:0/3144859633 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218005740 con 0x7fb220105680 2023-10-18T14:02:07.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.124+0000 7fb228534700 1 -- 172.21.15.114:0/3144859633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2201a27c0 con 0x7fb220105680 2023-10-18T14:02:07.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.125+0000 7fb228534700 1 -- 172.21.15.114:0/3144859633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb220107c00 con 0x7fb220105680 2023-10-18T14:02:07.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.126+0000 7fb2137fe700 1 -- 172.21.15.114:0/3144859633 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fb21800dc60 con 0x7fb220105680 2023-10-18T14:02:07.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.126+0000 7fb2137fe700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb20c0a14d0 0x7fb20c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:07.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.127+0000 7fb2137fe700 1 -- 172.21.15.114:0/3144859633 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fb2180cc160 con 0x7fb220105680 2023-10-18T14:02:07.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.127+0000 7fb2262d0700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb20c0a14d0 0x7fb20c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:07.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.127+0000 7fb2262d0700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb20c0a14d0 0x7fb20c0a3990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb2200688f0 tx=0x7fb21400a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:07.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.131+0000 7fb2137fe700 1 -- 172.21.15.114:0/3144859633 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb218095b90 con 0x7fb220105680 2023-10-18T14:02:07.291 INFO:journalctl@ceph.mds.j.smithi114.stdout:Oct 18 14:02:07 smithi114 podman[156469]: 2023-10-18T14:02:07.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.384+0000 7fb228534700 1 -- 172.21.15.114:0/3144859633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb220196d20 con 0x7fb220105680 2023-10-18T14:02:07.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.385+0000 7fb2137fe700 1 -- 172.21.15.114:0/3144859633 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2916 (secure 0 0 0) 0x7fb2180991b0 con 0x7fb220105680 2023-10-18T14:02:07.388 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:07.388 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24506,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-18T14:02:07.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.387+0000 7fb228534700 1 -- 172.21.15.114:0/3144859633 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb20c0a14d0 msgr2=0x7fb20c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:07.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.387+0000 7fb228534700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb20c0a14d0 0x7fb20c0a3990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb2200688f0 tx=0x7fb21400a380 comp rx=0 tx=0).stop 2023-10-18T14:02:07.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.387+0000 7fb228534700 1 -- 172.21.15.114:0/3144859633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb220105680 msgr2=0x7fb22019a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:07.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.387+0000 7fb228534700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb220105680 0x7fb22019a330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb218007f10 tx=0x7fb21800d3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:07.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.387+0000 7fb228534700 1 -- 172.21.15.114:0/3144859633 shutdown_connections 2023-10-18T14:02:07.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.387+0000 7fb228534700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb20c0a14d0 0x7fb20c0a3990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:07.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.387+0000 7fb228534700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb220105680 0x7fb22019a330 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:07.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.387+0000 7fb228534700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2200ff5f0 0x7fb220195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:07.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.387+0000 7fb228534700 1 --2- 172.21.15.114:0/3144859633 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2200fffb0 0x7fb220195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:07.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.387+0000 7fb228534700 1 -- 172.21.15.114:0/3144859633 >> 172.21.15.114:0/3144859633 conn(0x7fb2200767e0 msgr2=0x7fb2200fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:07.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.387+0000 7fb228534700 1 -- 172.21.15.114:0/3144859633 shutdown_connections 2023-10-18T14:02:07.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:07.387+0000 7fb228534700 1 -- 172.21.15.114:0/3144859633 wait complete. 2023-10-18T14:02:07.392 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 4 2023-10-18T14:02:07.588 INFO:journalctl@ceph.mds.j.smithi114.stdout:Oct 18 14:02:07 smithi114 ceph-mds[156553]: -- 172.21.15.114:0/1285803064 <== mon.0 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b3a05631e0 con 0x55b3a0538c00 2023-10-18T14:02:07.588 INFO:journalctl@ceph.mds.j.smithi114.stdout:Oct 18 14:02:07 smithi114 bash[156469]: 9693c209b5226f75f1ce1d5e97d86a2850df1c43052198b34117b0f691494877 2023-10-18T14:02:07.588 INFO:journalctl@ceph.mds.j.smithi114.stdout:Oct 18 14:02:07 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-j[156510]: starting mds.j at 2023-10-18T14:02:07.589 INFO:journalctl@ceph.mds.j.smithi114.stdout:Oct 18 14:02:07 smithi114 systemd[1]: Started Ceph mds.j for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T14:02:08.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:08 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.114:6834/1353369409,v1:172.21.15.114:6835/1353369409] up:boot 2023-10-18T14:02:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:08 smithi114 ceph-mon[99494]: fsmap 3 up:standby 2023-10-18T14:02:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-18T14:02:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:08.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:08 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3144859633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:08.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:08.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:08.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:08.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:08.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:08 smithi114 ceph-mon[99494]: Deploying daemon mds.d on smithi114 2023-10-18T14:02:08.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:08 smithi114 ceph-mon[99494]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:08.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:08.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:08 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.114:6834/1353369409,v1:172.21.15.114:6835/1353369409] up:boot 2023-10-18T14:02:08.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:08 smithi158 ceph-mon[103317]: fsmap 3 up:standby 2023-10-18T14:02:08.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-18T14:02:08.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:08.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:08 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3144859633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:08.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:08.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:08.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:08.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:08.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:08 smithi158 ceph-mon[103317]: Deploying daemon mds.d on smithi114 2023-10-18T14:02:08.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:08 smithi158 ceph-mon[103317]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:08.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:08.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:08 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.114:6834/1353369409,v1:172.21.15.114:6835/1353369409] up:boot 2023-10-18T14:02:08.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:08 smithi172 ceph-mon[103574]: fsmap 3 up:standby 2023-10-18T14:02:08.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-18T14:02:08.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:08.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:08 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3144859633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:08.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:08.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:08.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:08.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:08.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:08 smithi172 ceph-mon[103574]: Deploying daemon mds.d on smithi114 2023-10-18T14:02:08.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:08 smithi172 ceph-mon[103574]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:09.088 INFO:journalctl@ceph.mds.d.smithi114.stdout:Oct 18 14:02:08 smithi114 systemd[1]: Starting Ceph mds.d for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:02:09.403 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:02:09.510 INFO:journalctl@ceph.mds.d.smithi114.stdout:Oct 18 14:02:09 smithi114 podman[156856]: 2023-10-18T14:02:09.510 INFO:journalctl@ceph.mds.d.smithi114.stdout:Oct 18 14:02:09 smithi114 ceph-mds[156919]: -- 172.21.15.114:0/7728636 <== mon.0 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cdad0db1e0 con 0x55cdad0b0c00 2023-10-18T14:02:09.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.533+0000 7f79f8d77700 1 -- 172.21.15.114:0/420077347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40ff5e0 msgr2=0x7f79f40ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:09.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.533+0000 7f79f8d77700 1 --2- 172.21.15.114:0/420077347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40ff5e0 0x7f79f40ffa60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009990 tx=0x7f79e4009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:09.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.534+0000 7f79f8d77700 1 -- 172.21.15.114:0/420077347 shutdown_connections 2023-10-18T14:02:09.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.534+0000 7f79f8d77700 1 --2- 172.21.15.114:0/420077347 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79f40fffa0 0x7f79f410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:09.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.534+0000 7f79f8d77700 1 --2- 172.21.15.114:0/420077347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f4105660 0x7f79f4105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:09.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.534+0000 7f79f8d77700 1 --2- 172.21.15.114:0/420077347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40ff5e0 0x7f79f40ffa60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:09.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.534+0000 7f79f8d77700 1 -- 172.21.15.114:0/420077347 >> 172.21.15.114:0/420077347 conn(0x7f79f4076790 msgr2=0x7f79f4076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:09.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.534+0000 7f79f8d77700 1 -- 172.21.15.114:0/420077347 shutdown_connections 2023-10-18T14:02:09.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.534+0000 7f79f8d77700 1 -- 172.21.15.114:0/420077347 wait complete. 2023-10-18T14:02:09.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f8d77700 1 Processor -- start 2023-10-18T14:02:09.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f8d77700 1 -- start start 2023-10-18T14:02:09.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f8d77700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40ff5e0 0x7f79f4197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:09.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f8d77700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f40fffa0 0x7f79f4197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:09.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f8d77700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79f4105660 0x7f79f41a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:09.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f8d77700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f4198730 con 0x7f79f40ff5e0 2023-10-18T14:02:09.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f8d77700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f41a2f40 con 0x7f79f4105660 2023-10-18T14:02:09.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f8d77700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f41a3080 con 0x7f79f40fffa0 2023-10-18T14:02:09.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40ff5e0 0x7f79f4197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:09.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40ff5e0 0x7f79f4197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42130/0 (socket says 172.21.15.114:42130) 2023-10-18T14:02:09.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f259c700 1 -- 172.21.15.114:0/1177455115 learned_addr learned my addr 172.21.15.114:0/1177455115 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:09.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f1d9b700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f40fffa0 0x7f79f4197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:09.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f2d9d700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79f4105660 0x7f79f41a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:09.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f259c700 1 -- 172.21.15.114:0/1177455115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f40fffa0 msgr2=0x7f79f4197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:09.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f259c700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f40fffa0 0x7f79f4197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:09.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f259c700 1 -- 172.21.15.114:0/1177455115 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79f4105660 msgr2=0x7f79f41a2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:09.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f259c700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79f4105660 0x7f79f41a2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:09.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f259c700 1 -- 172.21.15.114:0/1177455115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e40095f0 con 0x7f79f40ff5e0 2023-10-18T14:02:09.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f2d9d700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79f4105660 0x7f79f41a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:02:09.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.535+0000 7f79f259c700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40ff5e0 0x7f79f4197980 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f79e800d980 tx=0x7f79e800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:09.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.536+0000 7f79e37fe700 1 -- 172.21.15.114:0/1177455115 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8009930 con 0x7f79f40ff5e0 2023-10-18T14:02:09.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.536+0000 7f79f8d77700 1 -- 172.21.15.114:0/1177455115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f41a3310 con 0x7f79f40ff5e0 2023-10-18T14:02:09.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.536+0000 7f79e37fe700 1 -- 172.21.15.114:0/1177455115 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79e8010460 con 0x7f79f40ff5e0 2023-10-18T14:02:09.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.536+0000 7f79e37fe700 1 -- 172.21.15.114:0/1177455115 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e800f620 con 0x7f79f40ff5e0 2023-10-18T14:02:09.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.536+0000 7f79f8d77700 1 -- 172.21.15.114:0/1177455115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f41a37a0 con 0x7f79f40ff5e0 2023-10-18T14:02:09.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.537+0000 7f79f8d77700 1 -- 172.21.15.114:0/1177455115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f4107be0 con 0x7f79f40ff5e0 2023-10-18T14:02:09.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.538+0000 7f79e37fe700 1 -- 172.21.15.114:0/1177455115 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f79e8010860 con 0x7f79f40ff5e0 2023-10-18T14:02:09.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.538+0000 7f79e37fe700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f79dc0a14d0 0x7f79dc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:09.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.538+0000 7f79f1d9b700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f79dc0a14d0 0x7f79dc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:09.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.538+0000 7f79e37fe700 1 -- 172.21.15.114:0/1177455115 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f79e80cc400 con 0x7f79f40ff5e0 2023-10-18T14:02:09.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.539+0000 7f79f1d9b700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f79dc0a14d0 0x7f79dc0a3990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f79e400b5c0 tx=0x7f79e4005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:09.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.542+0000 7f79e37fe700 1 -- 172.21.15.114:0/1177455115 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f79e8095e30 con 0x7f79f40ff5e0 2023-10-18T14:02:09.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.787+0000 7f79f8d77700 1 -- 172.21.15.114:0/1177455115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79f4100d00 con 0x7f79f40ff5e0 2023-10-18T14:02:09.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.788+0000 7f79e37fe700 1 -- 172.21.15.114:0/1177455115 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3710 (secure 0 0 0) 0x7f79e8017e90 con 0x7f79f40ff5e0 2023-10-18T14:02:09.792 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:09.792 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24506,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-18T14:02:09.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.790+0000 7f79f8d77700 1 -- 172.21.15.114:0/1177455115 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f79dc0a14d0 msgr2=0x7f79dc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:09.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.790+0000 7f79f8d77700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f79dc0a14d0 0x7f79dc0a3990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f79e400b5c0 tx=0x7f79e4005960 comp rx=0 tx=0).stop 2023-10-18T14:02:09.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.790+0000 7f79f8d77700 1 -- 172.21.15.114:0/1177455115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40ff5e0 msgr2=0x7f79f4197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:09.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.790+0000 7f79f8d77700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40ff5e0 0x7f79f4197980 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f79e800d980 tx=0x7f79e800dc90 comp rx=0 tx=0).stop 2023-10-18T14:02:09.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.790+0000 7f79f8d77700 1 -- 172.21.15.114:0/1177455115 shutdown_connections 2023-10-18T14:02:09.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.790+0000 7f79f8d77700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f79dc0a14d0 0x7f79dc0a3990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:09.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.790+0000 7f79f8d77700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79f4105660 0x7f79f41a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:09.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.790+0000 7f79f8d77700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79f40ff5e0 0x7f79f4197980 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:09.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.790+0000 7f79f8d77700 1 --2- 172.21.15.114:0/1177455115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f40fffa0 0x7f79f4197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:09.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.790+0000 7f79f8d77700 1 -- 172.21.15.114:0/1177455115 >> 172.21.15.114:0/1177455115 conn(0x7f79f4076790 msgr2=0x7f79f40fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:09.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.790+0000 7f79f8d77700 1 -- 172.21.15.114:0/1177455115 shutdown_connections 2023-10-18T14:02:09.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:09.790+0000 7f79f8d77700 1 -- 172.21.15.114:0/1177455115 wait complete. 2023-10-18T14:02:09.796 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 5 2023-10-18T14:02:09.805 INFO:journalctl@ceph.mds.d.smithi114.stdout:Oct 18 14:02:09 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-d[156872]: starting mds.d at 2023-10-18T14:02:09.805 INFO:journalctl@ceph.mds.d.smithi114.stdout:Oct 18 14:02:09 smithi114 bash[156856]: 069e542003667cf96494fd4642f85b8141fdee26b261101745f55ecf75105a03 2023-10-18T14:02:09.805 INFO:journalctl@ceph.mds.d.smithi114.stdout:Oct 18 14:02:09 smithi114 systemd[1]: Started Ceph mds.d for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T14:02:10.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:10 smithi114 ceph-mon[99494]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:10.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:10 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.114:6836/3590676300,v1:172.21.15.114:6837/3590676300] up:boot 2023-10-18T14:02:10.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:10 smithi114 ceph-mon[99494]: fsmap 4 up:standby 2023-10-18T14:02:10.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:10 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-18T14:02:10.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:10 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:10.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:10 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:10.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:10 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:10.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:10 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:10.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:10 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:10.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:10 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:10.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:10 smithi114 ceph-mon[99494]: Deploying daemon mds.e on smithi158 2023-10-18T14:02:10.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:10 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1177455115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:10.849 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:10 smithi158 ceph-mon[103317]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:10.849 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:10 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.114:6836/3590676300,v1:172.21.15.114:6837/3590676300] up:boot 2023-10-18T14:02:10.849 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:10 smithi158 ceph-mon[103317]: fsmap 4 up:standby 2023-10-18T14:02:10.849 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:10 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-18T14:02:10.850 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:10 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:10.850 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:10 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:10.850 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:10 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:10.850 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:10 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:10.850 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:10 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:10.851 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:10 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:10.851 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:10 smithi158 ceph-mon[103317]: Deploying daemon mds.e on smithi158 2023-10-18T14:02:10.851 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:10 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1177455115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:11.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:10 smithi172 ceph-mon[103574]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:10 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.114:6836/3590676300,v1:172.21.15.114:6837/3590676300] up:boot 2023-10-18T14:02:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:10 smithi172 ceph-mon[103574]: fsmap 4 up:standby 2023-10-18T14:02:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:10 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-18T14:02:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:10 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:10 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:10 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:11.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:10 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:11.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:10 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:11.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:10 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:11.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:10 smithi172 ceph-mon[103574]: Deploying daemon mds.e on smithi158 2023-10-18T14:02:11.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:10 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1177455115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:11.438 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:02:11 smithi158 systemd[1]: Starting Ceph mds.e for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:02:11.728 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:02:11 smithi158 podman[140468]: 2023-10-18T14:02:11.807 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:02:11.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.947+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/3034348442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc80fffa0 msgr2=0x7f0fc810c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:11.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.947+0000 7f0fcd7ad700 1 --2- 172.21.15.114:0/3034348442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc80fffa0 0x7f0fc810c490 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000b0a0 tx=0x7f0fc000b3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:11.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.947+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/3034348442 shutdown_connections 2023-10-18T14:02:11.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.947+0000 7f0fcd7ad700 1 --2- 172.21.15.114:0/3034348442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc80fffa0 0x7f0fc810c490 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:11.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.947+0000 7f0fcd7ad700 1 --2- 172.21.15.114:0/3034348442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0fc8105660 0x7f0fc8105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:11.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.947+0000 7f0fcd7ad700 1 --2- 172.21.15.114:0/3034348442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fc80ff5e0 0x7f0fc80ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:11.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.947+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/3034348442 >> 172.21.15.114:0/3034348442 conn(0x7f0fc8076790 msgr2=0x7f0fc8076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:11.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.947+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/3034348442 shutdown_connections 2023-10-18T14:02:11.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.947+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/3034348442 wait complete. 2023-10-18T14:02:11.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.948+0000 7f0fcd7ad700 1 Processor -- start 2023-10-18T14:02:11.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.948+0000 7f0fcd7ad700 1 -- start start 2023-10-18T14:02:11.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fcd7ad700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fc80ff5e0 0x7f0fc8197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:11.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fcd7ad700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc80fffa0 0x7f0fc8197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:11.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fcd7ad700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0fc8105660 0x7f0fc81a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:11.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fcd7ad700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81985d0 con 0x7f0fc80fffa0 2023-10-18T14:02:11.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fcd7ad700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81a2de0 con 0x7f0fc8105660 2023-10-18T14:02:11.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fcd7ad700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81a2f20 con 0x7f0fc80ff5e0 2023-10-18T14:02:11.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fc67fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc80fffa0 0x7f0fc8197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:11.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fc67fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc80fffa0 0x7f0fc8197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42148/0 (socket says 172.21.15.114:42148) 2023-10-18T14:02:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fc67fc700 1 -- 172.21.15.114:0/1793851637 learned_addr learned my addr 172.21.15.114:0/1793851637 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fc6ffd700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fc80ff5e0 0x7f0fc8197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fc67fc700 1 -- 172.21.15.114:0/1793851637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fc80ff5e0 msgr2=0x7f0fc8197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fc67fc700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fc80ff5e0 0x7f0fc8197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fc77fe700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0fc8105660 0x7f0fc81a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fc67fc700 1 -- 172.21.15.114:0/1793851637 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0fc8105660 msgr2=0x7f0fc81a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:11.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fc67fc700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0fc8105660 0x7f0fc81a28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:11.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fc67fc700 1 -- 172.21.15.114:0/1793851637 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc0009d00 con 0x7f0fc80fffa0 2023-10-18T14:02:11.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fc6ffd700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fc80ff5e0 0x7f0fc8197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:02:11.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fc67fc700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc80fffa0 0x7f0fc8197d60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00e9a0 tx=0x7f0fbc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:11.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0faffff700 1 -- 172.21.15.114:0/1793851637 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc009790 con 0x7f0fc80fffa0 2023-10-18T14:02:11.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0faffff700 1 -- 172.21.15.114:0/1793851637 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0fbc00cbd0 con 0x7f0fc80fffa0 2023-10-18T14:02:11.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/1793851637 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc81a31b0 con 0x7f0fc80fffa0 2023-10-18T14:02:11.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0faffff700 1 -- 172.21.15.114:0/1793851637 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc018680 con 0x7f0fc80fffa0 2023-10-18T14:02:11.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.949+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/1793851637 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc81a36c0 con 0x7f0fc80fffa0 2023-10-18T14:02:11.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.950+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/1793851637 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc8107be0 con 0x7f0fc80fffa0 2023-10-18T14:02:11.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.952+0000 7f0faffff700 1 -- 172.21.15.114:0/1793851637 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f0fbc00cd40 con 0x7f0fc80fffa0 2023-10-18T14:02:11.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.952+0000 7f0faffff700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0fb00a14d0 0x7f0fb00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:11.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.952+0000 7f0fc6ffd700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0fb00a14d0 0x7f0fb00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.952+0000 7f0faffff700 1 -- 172.21.15.114:0/1793851637 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f0fbc014070 con 0x7f0fc80fffa0 2023-10-18T14:02:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.953+0000 7f0fc6ffd700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0fb00a14d0 0x7f0fb00a3990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8005950 tx=0x7f0fb80058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:11.956+0000 7f0faffff700 1 -- 172.21.15.114:0/1793851637 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0fbc096be0 con 0x7f0fc80fffa0 2023-10-18T14:02:12.021 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:02:11 smithi158 ceph-mds[140508]: -- 172.21.15.158:0/3283933795 <== mon.2 v2:172.21.15.158:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b70f7691e0 con 0x55b70f73ec00 2023-10-18T14:02:12.021 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:02:11 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-e[140484]: starting mds.e at 2023-10-18T14:02:12.021 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:02:11 smithi158 bash[140468]: 169cb03f9a545278ccfab5f40a7b5744ad0d8b9346250344ce200d9b0259ba47 2023-10-18T14:02:12.021 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:02:11 smithi158 systemd[1]: Started Ceph mds.e for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T14:02:12.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.191+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/1793851637 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fc8100d00 con 0x7f0fc80fffa0 2023-10-18T14:02:12.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.192+0000 7f0faffff700 1 -- 172.21.15.114:0/1793851637 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3710 (secure 0 0 0) 0x7f0fbc09a200 con 0x7f0fc80fffa0 2023-10-18T14:02:12.196 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:12.196 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24506,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-18T14:02:12.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.194+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/1793851637 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0fb00a14d0 msgr2=0x7f0fb00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:12.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.194+0000 7f0fcd7ad700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0fb00a14d0 0x7f0fb00a3990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8005950 tx=0x7f0fb80058e0 comp rx=0 tx=0).stop 2023-10-18T14:02:12.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.194+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/1793851637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc80fffa0 msgr2=0x7f0fc8197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:12.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.194+0000 7f0fcd7ad700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc80fffa0 0x7f0fc8197d60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00e9a0 tx=0x7f0fbc00ed60 comp rx=0 tx=0).stop 2023-10-18T14:02:12.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.194+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/1793851637 shutdown_connections 2023-10-18T14:02:12.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.194+0000 7f0fcd7ad700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0fb00a14d0 0x7f0fb00a3990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:12.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.194+0000 7f0fcd7ad700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0fc8105660 0x7f0fc81a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.194+0000 7f0fcd7ad700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fc80ff5e0 0x7f0fc8197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.194+0000 7f0fcd7ad700 1 --2- 172.21.15.114:0/1793851637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc80fffa0 0x7f0fc8197d60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.194+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/1793851637 >> 172.21.15.114:0/1793851637 conn(0x7f0fc8076790 msgr2=0x7f0fc80fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.194+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/1793851637 shutdown_connections 2023-10-18T14:02:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:12.194+0000 7f0fcd7ad700 1 -- 172.21.15.114:0/1793851637 wait complete. 2023-10-18T14:02:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 5 2023-10-18T14:02:13.145 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:12 smithi172 ceph-mon[103574]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:13.145 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:12 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:13.145 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:12 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:13.145 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:12 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:13.146 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:12 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:13.146 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:12 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:13.146 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:12 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:13.146 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:12 smithi172 ceph-mon[103574]: Deploying daemon mds.f on smithi172 2023-10-18T14:02:13.146 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:12 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1793851637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:13.147 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:12 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.158:6834/2562572095,v1:172.21.15.158:6835/2562572095] up:boot 2023-10-18T14:02:13.147 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:12 smithi172 ceph-mon[103574]: fsmap 5 up:standby 2023-10-18T14:02:13.147 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:12 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-18T14:02:13.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:12 smithi158 ceph-mon[103317]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:13.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:12 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:13.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:12 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:13.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:12 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:13.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:12 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:13.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:12 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:13.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:12 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:13.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:12 smithi158 ceph-mon[103317]: Deploying daemon mds.f on smithi172 2023-10-18T14:02:13.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:12 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1793851637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:13.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:12 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.158:6834/2562572095,v1:172.21.15.158:6835/2562572095] up:boot 2023-10-18T14:02:13.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:12 smithi158 ceph-mon[103317]: fsmap 5 up:standby 2023-10-18T14:02:13.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:12 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-18T14:02:13.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:12 smithi114 ceph-mon[99494]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:13.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:12 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:13.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:12 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:13.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:12 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:13.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:12 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:13.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:12 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:13.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:12 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:13.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:12 smithi114 ceph-mon[99494]: Deploying daemon mds.f on smithi172 2023-10-18T14:02:13.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:12 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1793851637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:13.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:12 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.158:6834/2562572095,v1:172.21.15.158:6835/2562572095] up:boot 2023-10-18T14:02:13.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:12 smithi114 ceph-mon[99494]: fsmap 5 up:standby 2023-10-18T14:02:13.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:12 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-18T14:02:13.560 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:02:13 smithi172 systemd[1]: Starting Ceph mds.f for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:02:13.938 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:02:13 smithi172 podman[142724]: 2023-10-18T14:02:14.211 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:02:14.261 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:02:13 smithi172 ceph-mds[142764]: -- 172.21.15.172:0/2890971295 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ce820131e0 con 0x55ce81fe8c00 2023-10-18T14:02:14.261 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:02:13 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: starting mds.f at 2023-10-18T14:02:14.262 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:02:13 smithi172 bash[142724]: 8dd87496bf3001f93a6b431d018e11aff3439f0b79b3c04929e016c4bf7e78d2 2023-10-18T14:02:14.262 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:02:14 smithi172 systemd[1]: Started Ceph mds.f for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T14:02:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.344+0000 7f42ffba6700 1 -- 172.21.15.114:0/2105153796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42f80ff8d0 msgr2=0x7f42f80ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.344+0000 7f42ffba6700 1 --2- 172.21.15.114:0/2105153796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42f80ff8d0 0x7f42f80ffd50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009990 tx=0x7f42f4009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.344+0000 7f42ffba6700 1 -- 172.21.15.114:0/2105153796 shutdown_connections 2023-10-18T14:02:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.344+0000 7f42ffba6700 1 --2- 172.21.15.114:0/2105153796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42f8100290 0x7f42f810c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.344+0000 7f42ffba6700 1 --2- 172.21.15.114:0/2105153796 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42f8105710 0x7f42f8105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.344+0000 7f42ffba6700 1 --2- 172.21.15.114:0/2105153796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42f80ff8d0 0x7f42f80ffd50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.344+0000 7f42ffba6700 1 -- 172.21.15.114:0/2105153796 >> 172.21.15.114:0/2105153796 conn(0x7f42f8076400 msgr2=0x7f42f8076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.344+0000 7f42ffba6700 1 -- 172.21.15.114:0/2105153796 shutdown_connections 2023-10-18T14:02:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.344+0000 7f42ffba6700 1 -- 172.21.15.114:0/2105153796 wait complete. 2023-10-18T14:02:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.344+0000 7f42ffba6700 1 Processor -- start 2023-10-18T14:02:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42ffba6700 1 -- start start 2023-10-18T14:02:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42ffba6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42f80ff8d0 0x7f42f819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42ffba6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42f8100290 0x7f42f819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42ffba6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42f8105710 0x7f42f8196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42ffba6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8196fb0 con 0x7f42f8100290 2023-10-18T14:02:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42ffba6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8197120 con 0x7f42f80ff8d0 2023-10-18T14:02:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42ffba6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81972e0 con 0x7f42f8105710 2023-10-18T14:02:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42fd141700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42f8100290 0x7f42f819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:14.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42fd141700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42f8100290 0x7f42f819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42160/0 (socket says 172.21.15.114:42160) 2023-10-18T14:02:14.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42fd141700 1 -- 172.21.15.114:0/2163460917 learned_addr learned my addr 172.21.15.114:0/2163460917 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:14.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42fe143700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42f8105710 0x7f42f8196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:14.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42fd942700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42f80ff8d0 0x7f42f819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:14.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42fd141700 1 -- 172.21.15.114:0/2163460917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42f8105710 msgr2=0x7f42f8196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42fd141700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42f8105710 0x7f42f8196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42fd141700 1 -- 172.21.15.114:0/2163460917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42f80ff8d0 msgr2=0x7f42f819c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42fd141700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42f80ff8d0 0x7f42f819c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42fd141700 1 -- 172.21.15.114:0/2163460917 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f40095f0 con 0x7f42f8100290 2023-10-18T14:02:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42fe143700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42f8105710 0x7f42f8196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:02:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42fd141700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42f8100290 0x7f42f819cd60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f42f4005910 tx=0x7f42f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42eeffd700 1 -- 172.21.15.114:0/2163460917 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f401d070 con 0x7f42f8100290 2023-10-18T14:02:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.345+0000 7f42ffba6700 1 -- 172.21.15.114:0/2163460917 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f8197560 con 0x7f42f8100290 2023-10-18T14:02:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.346+0000 7f42eeffd700 1 -- 172.21.15.114:0/2163460917 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42f4022470 con 0x7f42f8100290 2023-10-18T14:02:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.346+0000 7f42ffba6700 1 -- 172.21.15.114:0/2163460917 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f81a3810 con 0x7f42f8100290 2023-10-18T14:02:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.346+0000 7f42eeffd700 1 -- 172.21.15.114:0/2163460917 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4017650 con 0x7f42f8100290 2023-10-18T14:02:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.346+0000 7f42ffba6700 1 -- 172.21.15.114:0/2163460917 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f8100cc0 con 0x7f42f8100290 2023-10-18T14:02:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.347+0000 7f42eeffd700 1 -- 172.21.15.114:0/2163460917 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f42f40225e0 con 0x7f42f8100290 2023-10-18T14:02:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.348+0000 7f42eeffd700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f42e40a14d0 0x7f42e40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.348+0000 7f42fd942700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f42e40a14d0 0x7f42e40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.348+0000 7f42eeffd700 1 -- 172.21.15.114:0/2163460917 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f42f40cdd10 con 0x7f42f8100290 2023-10-18T14:02:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.349+0000 7f42fd942700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f42e40a14d0 0x7f42e40a3990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f42e8007be0 tx=0x7f42e80073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.353+0000 7f42eeffd700 1 -- 172.21.15.114:0/2163460917 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f42f40977d0 con 0x7f42f8100290 2023-10-18T14:02:14.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:14 smithi158 ceph-mon[103317]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:14.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:14.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:14.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:14.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:14.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:14.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:14 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:14.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:14 smithi172 ceph-mon[103574]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:14.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:14.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:14.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:14.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:14.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:14.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:14 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:14.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:14 smithi114 ceph-mon[99494]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:14.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:14.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:14.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:14.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:14.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:14.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:14 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:14.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.586+0000 7f42ffba6700 1 -- 172.21.15.114:0/2163460917 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42f8197e10 con 0x7f42f8100290 2023-10-18T14:02:14.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.587+0000 7f42eeffd700 1 -- 172.21.15.114:0/2163460917 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5298 (secure 0 0 0) 0x7f42f409adf0 con 0x7f42f8100290 2023-10-18T14:02:14.591 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:14.591 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24506,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24524,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24583,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-18T14:02:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.589+0000 7f42ffba6700 1 -- 172.21.15.114:0/2163460917 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f42e40a14d0 msgr2=0x7f42e40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.589+0000 7f42ffba6700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f42e40a14d0 0x7f42e40a3990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f42e8007be0 tx=0x7f42e80073d0 comp rx=0 tx=0).stop 2023-10-18T14:02:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.589+0000 7f42ffba6700 1 -- 172.21.15.114:0/2163460917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42f8100290 msgr2=0x7f42f819cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.589+0000 7f42ffba6700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42f8100290 0x7f42f819cd60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f42f4005910 tx=0x7f42f4004730 comp rx=0 tx=0).stop 2023-10-18T14:02:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.589+0000 7f42ffba6700 1 -- 172.21.15.114:0/2163460917 shutdown_connections 2023-10-18T14:02:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.589+0000 7f42ffba6700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f42e40a14d0 0x7f42e40a3990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.589+0000 7f42ffba6700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42f8105710 0x7f42f8196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.589+0000 7f42ffba6700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f42f80ff8d0 0x7f42f819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.589+0000 7f42ffba6700 1 --2- 172.21.15.114:0/2163460917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42f8100290 0x7f42f819cd60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.589+0000 7f42ffba6700 1 -- 172.21.15.114:0/2163460917 >> 172.21.15.114:0/2163460917 conn(0x7f42f8076400 msgr2=0x7f42f81039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.589+0000 7f42ffba6700 1 -- 172.21.15.114:0/2163460917 shutdown_connections 2023-10-18T14:02:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:14.589+0000 7f42ffba6700 1 -- 172.21.15.114:0/2163460917 wait complete. 2023-10-18T14:02:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 7 2023-10-18T14:02:15.468 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:15 smithi172 ceph-mon[103574]: Deploying daemon mds.c on smithi172 2023-10-18T14:02:15.469 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:15 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] up:boot 2023-10-18T14:02:15.469 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:15 smithi172 ceph-mon[103574]: fsmap 6 up:standby 2023-10-18T14:02:15.469 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:15 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-18T14:02:15.469 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:15 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2163460917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:15.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:15 smithi158 ceph-mon[103317]: Deploying daemon mds.c on smithi172 2023-10-18T14:02:15.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:15 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] up:boot 2023-10-18T14:02:15.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:15 smithi158 ceph-mon[103317]: fsmap 6 up:standby 2023-10-18T14:02:15.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:15 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-18T14:02:15.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:15 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2163460917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:15.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:15 smithi114 ceph-mon[99494]: Deploying daemon mds.c on smithi172 2023-10-18T14:02:15.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:15 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] up:boot 2023-10-18T14:02:15.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:15 smithi114 ceph-mon[99494]: fsmap 6 up:standby 2023-10-18T14:02:15.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:15 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-18T14:02:15.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:15 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2163460917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:15.810 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:02:15 smithi172 systemd[1]: Starting Ceph mds.c for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:02:16.270 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:02:16 smithi172 podman[143064]: 2023-10-18T14:02:16.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:16 smithi158 ceph-mon[103317]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:16.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:16 smithi172 ceph-mon[103574]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:16.560 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:02:16 smithi172 ceph-mds[143104]: -- 172.21.15.172:0/963716165 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fd006751e0 con 0x55fd0064ac00 2023-10-18T14:02:16.560 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:02:16 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: starting mds.c at 2023-10-18T14:02:16.560 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:02:16 smithi172 bash[143064]: d80c468d469e1da9136ce549ecf645f4d8cbca9bbf893f49ef29afab54d5ac83 2023-10-18T14:02:16.560 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:02:16 smithi172 systemd[1]: Started Ceph mds.c for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T14:02:16.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:16 smithi114 ceph-mon[99494]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:16.606 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:02:16.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.736+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/3905796215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf34105660 msgr2=0x7fbf34105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:16.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.736+0000 7fbf3ad0c700 1 --2- 172.21.15.114:0/3905796215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf34105660 0x7fbf34105a40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbf280099c0 tx=0x7fbf28009cd0 comp rx=0 tx=0).stop 2023-10-18T14:02:16.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.736+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/3905796215 shutdown_connections 2023-10-18T14:02:16.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.736+0000 7fbf3ad0c700 1 --2- 172.21.15.114:0/3905796215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf341006d0 0x7fbf3410c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:16.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.736+0000 7fbf3ad0c700 1 --2- 172.21.15.114:0/3905796215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf34105660 0x7fbf34105a40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:16.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.736+0000 7fbf3ad0c700 1 --2- 172.21.15.114:0/3905796215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf340ffd10 0x7fbf34100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:16.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.736+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/3905796215 >> 172.21.15.114:0/3905796215 conn(0x7fbf34075b90 msgr2=0x7fbf340fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:16.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.736+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/3905796215 shutdown_connections 2023-10-18T14:02:16.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.736+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/3905796215 wait complete. 2023-10-18T14:02:16.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf3ad0c700 1 Processor -- start 2023-10-18T14:02:16.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf3ad0c700 1 -- start start 2023-10-18T14:02:16.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf3ad0c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf340ffd10 0x7fbf3419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf3ad0c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf341006d0 0x7fbf3419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf3ad0c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf34105660 0x7fbf34198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf3ad0c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf341990d0 con 0x7fbf340ffd10 2023-10-18T14:02:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf3ad0c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf34199240 con 0x7fbf34105660 2023-10-18T14:02:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf3ad0c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf34199400 con 0x7fbf341006d0 2023-10-18T14:02:16.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf38aa8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf340ffd10 0x7fbf3419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:16.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf38aa8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf340ffd10 0x7fbf3419e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42172/0 (socket says 172.21.15.114:42172) 2023-10-18T14:02:16.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf38aa8700 1 -- 172.21.15.114:0/373617096 learned_addr learned my addr 172.21.15.114:0/373617096 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:16.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf392a9700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf34105660 0x7fbf34198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:16.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf38aa8700 1 -- 172.21.15.114:0/373617096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf341006d0 msgr2=0x7fbf3419ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:16.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf38aa8700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf341006d0 0x7fbf3419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:16.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf38aa8700 1 -- 172.21.15.114:0/373617096 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf34105660 msgr2=0x7fbf34198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:16.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf38aa8700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf34105660 0x7fbf34198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:16.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf38aa8700 1 -- 172.21.15.114:0/373617096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf280095f0 con 0x7fbf340ffd10 2023-10-18T14:02:16.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.737+0000 7fbf392a9700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf34105660 0x7fbf34198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:16.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.738+0000 7fbf38aa8700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf340ffd10 0x7fbf3419e940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c010 tx=0x7fbf2800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:16.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.738+0000 7fbf31ffb700 1 -- 172.21.15.114:0/373617096 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2801c070 con 0x7fbf340ffd10 2023-10-18T14:02:16.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.738+0000 7fbf31ffb700 1 -- 172.21.15.114:0/373617096 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf28022420 con 0x7fbf340ffd10 2023-10-18T14:02:16.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.738+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/373617096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf34199680 con 0x7fbf340ffd10 2023-10-18T14:02:16.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.738+0000 7fbf31ffb700 1 -- 172.21.15.114:0/373617096 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28017650 con 0x7fbf340ffd10 2023-10-18T14:02:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.738+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/373617096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf341a5930 con 0x7fbf340ffd10 2023-10-18T14:02:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.739+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/373617096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf34100d20 con 0x7fbf340ffd10 2023-10-18T14:02:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.741+0000 7fbf31ffb700 1 -- 172.21.15.114:0/373617096 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fbf28020070 con 0x7fbf340ffd10 2023-10-18T14:02:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.741+0000 7fbf31ffb700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbf240a1550 0x7fbf240a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.741+0000 7fbf33fff700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbf240a1550 0x7fbf240a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:16.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.741+0000 7fbf31ffb700 1 -- 172.21.15.114:0/373617096 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fbf280cddf0 con 0x7fbf340ffd10 2023-10-18T14:02:16.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.742+0000 7fbf33fff700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbf240a1550 0x7fbf240a3a10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbf20005950 tx=0x7fbf200058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:16.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.745+0000 7fbf31ffb700 1 -- 172.21.15.114:0/373617096 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbf280978b0 con 0x7fbf340ffd10 2023-10-18T14:02:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.981+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/373617096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf34066ca0 con 0x7fbf340ffd10 2023-10-18T14:02:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.982+0000 7fbf31ffb700 1 -- 172.21.15.114:0/373617096 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5298 (secure 0 0 0) 0x7fbf28022590 con 0x7fbf340ffd10 2023-10-18T14:02:16.986 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:16.986 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24506,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24524,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24583,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-18T14:02:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.984+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/373617096 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbf240a1550 msgr2=0x7fbf240a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.984+0000 7fbf3ad0c700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbf240a1550 0x7fbf240a3a10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbf20005950 tx=0x7fbf200058e0 comp rx=0 tx=0).stop 2023-10-18T14:02:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.984+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/373617096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf340ffd10 msgr2=0x7fbf3419e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.984+0000 7fbf3ad0c700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf340ffd10 0x7fbf3419e940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c010 tx=0x7fbf2800f740 comp rx=0 tx=0).stop 2023-10-18T14:02:16.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.984+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/373617096 shutdown_connections 2023-10-18T14:02:16.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.984+0000 7fbf3ad0c700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbf240a1550 0x7fbf240a3a10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:16.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.984+0000 7fbf3ad0c700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf34105660 0x7fbf34198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:16.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.984+0000 7fbf3ad0c700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf340ffd10 0x7fbf3419e940 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:16.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.984+0000 7fbf3ad0c700 1 --2- 172.21.15.114:0/373617096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf341006d0 0x7fbf3419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:16.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.984+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/373617096 >> 172.21.15.114:0/373617096 conn(0x7fbf34075b90 msgr2=0x7fbf340fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:16.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.984+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/373617096 shutdown_connections 2023-10-18T14:02:16.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:16.984+0000 7fbf3ad0c700 1 -- 172.21.15.114:0/373617096 wait complete. 2023-10-18T14:02:16.990 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 7 2023-10-18T14:02:17.724 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:17.724 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:17.724 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:17.724 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:17.725 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:17.725 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:17.725 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:17 smithi158 ceph-mon[103317]: Deploying daemon mds.h on smithi158 2023-10-18T14:02:17.725 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:17 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/373617096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:17.725 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:17 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] up:boot 2023-10-18T14:02:17.726 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:17 smithi158 ceph-mon[103317]: fsmap 7 up:standby 2023-10-18T14:02:17.726 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:17 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-18T14:02:17.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:17.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:17.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:17.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:17.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:17.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:17.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:17 smithi172 ceph-mon[103574]: Deploying daemon mds.h on smithi158 2023-10-18T14:02:17.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:17 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/373617096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:17.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:17 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] up:boot 2023-10-18T14:02:17.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:17 smithi172 ceph-mon[103574]: fsmap 7 up:standby 2023-10-18T14:02:17.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:17 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-18T14:02:17.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:17.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:17.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:17.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:17.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:17.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:17.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:17 smithi114 ceph-mon[99494]: Deploying daemon mds.h on smithi158 2023-10-18T14:02:17.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:17 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/373617096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:17.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:17 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] up:boot 2023-10-18T14:02:17.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:17 smithi114 ceph-mon[99494]: fsmap 7 up:standby 2023-10-18T14:02:17.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:17 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-18T14:02:18.273 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:02:18 smithi158 systemd[1]: Starting Ceph mds.h for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:02:18.677 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:18 smithi158 ceph-mon[103317]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:18.677 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:02:18 smithi158 podman[140810]: 2023-10-18T14:02:18.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:18 smithi172 ceph-mon[103574]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:18.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:18 smithi114 ceph-mon[99494]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:19.001 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:02:19.021 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:02:18 smithi158 ceph-mds[140851]: -- 172.21.15.158:0/3339352831 <== mon.2 v2:172.21.15.158:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562d7a26b1e0 con 0x562d7a240c00 2023-10-18T14:02:19.021 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:02:18 smithi158 bash[140810]: 0a33070de2425a37440678a0da481609778e978ce6d36c1bd25ca2844115129d 2023-10-18T14:02:19.021 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:02:18 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-h[140826]: starting mds.h at 2023-10-18T14:02:19.022 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:02:18 smithi158 systemd[1]: Started Ceph mds.h for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T14:02:19.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.131+0000 7f4092c8b700 1 -- 172.21.15.114:0/1799723812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408c1066c0 msgr2=0x7f408c106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:19.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.131+0000 7f4092c8b700 1 --2- 172.21.15.114:0/1799723812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408c1066c0 0x7f408c106aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4080009990 tx=0x7f4080009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:19.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.131+0000 7f4092c8b700 1 -- 172.21.15.114:0/1799723812 shutdown_connections 2023-10-18T14:02:19.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.131+0000 7f4092c8b700 1 --2- 172.21.15.114:0/1799723812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408c067fa0 0x7f408c10d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:19.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.131+0000 7f4092c8b700 1 --2- 172.21.15.114:0/1799723812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408c1066c0 0x7f408c106aa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:19.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.131+0000 7f4092c8b700 1 --2- 172.21.15.114:0/1799723812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f408c106fe0 0x7f408c067870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:19.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.131+0000 7f4092c8b700 1 -- 172.21.15.114:0/1799723812 >> 172.21.15.114:0/1799723812 conn(0x7f408c076400 msgr2=0x7f408c076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:19.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.131+0000 7f4092c8b700 1 -- 172.21.15.114:0/1799723812 shutdown_connections 2023-10-18T14:02:19.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.131+0000 7f4092c8b700 1 -- 172.21.15.114:0/1799723812 wait complete. 2023-10-18T14:02:19.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.131+0000 7f4092c8b700 1 Processor -- start 2023-10-18T14:02:19.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.131+0000 7f4092c8b700 1 -- start start 2023-10-18T14:02:19.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f4092c8b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408c067fa0 0x7f408c19c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:19.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f4092c8b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408c1066c0 0x7f408c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:19.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f4092c8b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f408c106fe0 0x7f408c196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:19.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f4092c8b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c196f80 con 0x7f408c1066c0 2023-10-18T14:02:19.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f4092c8b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c1970f0 con 0x7f408c067fa0 2023-10-18T14:02:19.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f4092c8b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c1972b0 con 0x7f408c106fe0 2023-10-18T14:02:19.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f408bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408c1066c0 0x7f408c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:19.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f408bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408c1066c0 0x7f408c19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42188/0 (socket says 172.21.15.114:42188) 2023-10-18T14:02:19.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f408bfff700 1 -- 172.21.15.114:0/11734321 learned_addr learned my addr 172.21.15.114:0/11734321 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:19.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f4090a27700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408c067fa0 0x7f408c19c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:19.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f4091228700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f408c106fe0 0x7f408c196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:19.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f408bfff700 1 -- 172.21.15.114:0/11734321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f408c106fe0 msgr2=0x7f408c196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:19.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f408bfff700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f408c106fe0 0x7f408c196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:19.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f408bfff700 1 -- 172.21.15.114:0/11734321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408c067fa0 msgr2=0x7f408c19c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:19.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f408bfff700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408c067fa0 0x7f408c19c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:19.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f408bfff700 1 -- 172.21.15.114:0/11734321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800095f0 con 0x7f408c1066c0 2023-10-18T14:02:19.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f408bfff700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408c1066c0 0x7f408c19cd30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f407800d980 tx=0x7f407800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:19.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f4089ffb700 1 -- 172.21.15.114:0/11734321 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407800f890 con 0x7f408c1066c0 2023-10-18T14:02:19.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f4089ffb700 1 -- 172.21.15.114:0/11734321 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4078010460 con 0x7f408c1066c0 2023-10-18T14:02:19.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f4092c8b700 1 -- 172.21.15.114:0/11734321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408c197590 con 0x7f408c1066c0 2023-10-18T14:02:19.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.132+0000 7f4089ffb700 1 -- 172.21.15.114:0/11734321 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407800e610 con 0x7f408c1066c0 2023-10-18T14:02:19.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.133+0000 7f4092c8b700 1 -- 172.21.15.114:0/11734321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c1a37e0 con 0x7f408c1066c0 2023-10-18T14:02:19.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.133+0000 7f4092c8b700 1 -- 172.21.15.114:0/11734321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c108bf0 con 0x7f408c1066c0 2023-10-18T14:02:19.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.134+0000 7f4089ffb700 1 -- 172.21.15.114:0/11734321 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f40780105d0 con 0x7f408c1066c0 2023-10-18T14:02:19.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.135+0000 7f4089ffb700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f407c0a14d0 0x7f407c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:19.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.135+0000 7f4090a27700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f407c0a14d0 0x7f407c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:19.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.135+0000 7f4089ffb700 1 -- 172.21.15.114:0/11734321 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f40780cc2f0 con 0x7f408c1066c0 2023-10-18T14:02:19.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.135+0000 7f4090a27700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f407c0a14d0 0x7f407c0a3990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f408000b5c0 tx=0x7f4080005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:19.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.139+0000 7f4089ffb700 1 -- 172.21.15.114:0/11734321 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4078095d20 con 0x7f408c1066c0 2023-10-18T14:02:19.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.374+0000 7f4092c8b700 1 -- 172.21.15.114:0/11734321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f408c101de0 con 0x7f408c1066c0 2023-10-18T14:02:19.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.375+0000 7f4089ffb700 1 -- 172.21.15.114:0/11734321 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6092 (secure 0 0 0) 0x7f4078099340 con 0x7f408c1066c0 2023-10-18T14:02:19.379 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:19.379 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24506,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24524,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24583,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-18T14:02:19.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.377+0000 7f4092c8b700 1 -- 172.21.15.114:0/11734321 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f407c0a14d0 msgr2=0x7f407c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:19.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.377+0000 7f4092c8b700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f407c0a14d0 0x7f407c0a3990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f408000b5c0 tx=0x7f4080005960 comp rx=0 tx=0).stop 2023-10-18T14:02:19.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.377+0000 7f4092c8b700 1 -- 172.21.15.114:0/11734321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408c1066c0 msgr2=0x7f408c19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:19.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.377+0000 7f4092c8b700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408c1066c0 0x7f408c19cd30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f407800d980 tx=0x7f407800dc90 comp rx=0 tx=0).stop 2023-10-18T14:02:19.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.377+0000 7f4092c8b700 1 -- 172.21.15.114:0/11734321 shutdown_connections 2023-10-18T14:02:19.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.377+0000 7f4092c8b700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f407c0a14d0 0x7f407c0a3990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:19.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.377+0000 7f4092c8b700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f408c106fe0 0x7f408c196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:19.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.377+0000 7f4092c8b700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408c067fa0 0x7f408c19c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:19.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.377+0000 7f4092c8b700 1 --2- 172.21.15.114:0/11734321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408c1066c0 0x7f408c19cd30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:19.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.377+0000 7f4092c8b700 1 -- 172.21.15.114:0/11734321 >> 172.21.15.114:0/11734321 conn(0x7f408c076400 msgr2=0x7f408c0fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:19.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.377+0000 7f4092c8b700 1 -- 172.21.15.114:0/11734321 shutdown_connections 2023-10-18T14:02:19.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:19.377+0000 7f4092c8b700 1 -- 172.21.15.114:0/11734321 wait complete. 2023-10-18T14:02:19.384 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2023-10-18T14:02:20.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:19 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:20.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:19 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:20.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:19 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:20.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:19 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:20.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:19 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:20.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:19 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:20.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:19 smithi158 ceph-mon[103317]: Deploying daemon mds.i on smithi172 2023-10-18T14:02:20.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:19 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/11734321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:20.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:19 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.158:6836/1076778559,v1:172.21.15.158:6837/1076778559] up:boot 2023-10-18T14:02:20.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:19 smithi158 ceph-mon[103317]: fsmap 8 up:standby 2023-10-18T14:02:20.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:19 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-18T14:02:20.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:19 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:20.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:19 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:20.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:19 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:20.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:19 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:20.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:19 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:20.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:19 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:20.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:19 smithi172 ceph-mon[103574]: Deploying daemon mds.i on smithi172 2023-10-18T14:02:20.026 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:19 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/11734321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:20.026 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:19 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.158:6836/1076778559,v1:172.21.15.158:6837/1076778559] up:boot 2023-10-18T14:02:20.026 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:19 smithi172 ceph-mon[103574]: fsmap 8 up:standby 2023-10-18T14:02:20.026 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:19 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-18T14:02:20.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:19 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:20.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:19 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:20.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:19 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:20.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:19 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:20.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:19 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:20.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:19 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:20.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:19 smithi114 ceph-mon[99494]: Deploying daemon mds.i on smithi172 2023-10-18T14:02:20.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:19 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/11734321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:20.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:19 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.158:6836/1076778559,v1:172.21.15.158:6837/1076778559] up:boot 2023-10-18T14:02:20.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:19 smithi114 ceph-mon[99494]: fsmap 8 up:standby 2023-10-18T14:02:20.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:19 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-18T14:02:20.560 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:02:20 smithi172 systemd[1]: Starting Ceph mds.i for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:02:20.928 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:02:20 smithi172 podman[143404]: 2023-10-18T14:02:20.928 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:20 smithi172 ceph-mon[103574]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:21.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:20 smithi158 ceph-mon[103317]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:20 smithi114 ceph-mon[99494]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:21.309 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:02:20 smithi172 ceph-mds[143444]: -- 172.21.15.172:0/677948708 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56407500d1e0 con 0x564074fe3000 2023-10-18T14:02:21.310 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:02:20 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-i[143420]: starting mds.i at 2023-10-18T14:02:21.310 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:02:20 smithi172 bash[143404]: 1d9eb45cc857546eef67a361f033d2dd0ebff45174f08ca5f655ec5c3afc71af 2023-10-18T14:02:21.310 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:02:20 smithi172 systemd[1]: Started Ceph mds.i for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T14:02:21.394 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:02:21.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.526+0000 7f66c9be6700 1 -- 172.21.15.114:0/1691455876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66c41066b0 msgr2=0x7f66c4106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:21.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.526+0000 7f66c9be6700 1 --2- 172.21.15.114:0/1691455876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66c41066b0 0x7f66c4106a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009990 tx=0x7f66b4009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:21.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.526+0000 7f66c9be6700 1 -- 172.21.15.114:0/1691455876 shutdown_connections 2023-10-18T14:02:21.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.526+0000 7f66c9be6700 1 --2- 172.21.15.114:0/1691455876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c4101060 0x7f66c410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:21.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.526+0000 7f66c9be6700 1 --2- 172.21.15.114:0/1691455876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66c41066b0 0x7f66c4106a90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:21.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.526+0000 7f66c9be6700 1 --2- 172.21.15.114:0/1691455876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66c41006a0 0x7f66c4100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:21.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.526+0000 7f66c9be6700 1 -- 172.21.15.114:0/1691455876 >> 172.21.15.114:0/1691455876 conn(0x7f66c40fc1d0 msgr2=0x7f66c40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:21.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.526+0000 7f66c9be6700 1 -- 172.21.15.114:0/1691455876 shutdown_connections 2023-10-18T14:02:21.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.526+0000 7f66c9be6700 1 -- 172.21.15.114:0/1691455876 wait complete. 2023-10-18T14:02:21.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.527+0000 7f66c9be6700 1 Processor -- start 2023-10-18T14:02:21.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.527+0000 7f66c9be6700 1 -- start start 2023-10-18T14:02:21.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c9be6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41006a0 0x7f66c419c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:21.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c9be6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66c4101060 0x7f66c419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:21.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c9be6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66c41066b0 0x7f66c4196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:21.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c9be6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c4196f80 con 0x7f66c41006a0 2023-10-18T14:02:21.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c9be6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c41970f0 con 0x7f66c4101060 2023-10-18T14:02:21.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c9be6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c41972b0 con 0x7f66c41066b0 2023-10-18T14:02:21.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c37fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41006a0 0x7f66c419c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:21.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c2ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66c4101060 0x7f66c419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:21.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c37fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41006a0 0x7f66c419c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42200/0 (socket says 172.21.15.114:42200) 2023-10-18T14:02:21.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c37fe700 1 -- 172.21.15.114:0/2174685089 learned_addr learned my addr 172.21.15.114:0/2174685089 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:21.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c3fff700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66c41066b0 0x7f66c4196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:21.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c37fe700 1 -- 172.21.15.114:0/2174685089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66c41066b0 msgr2=0x7f66c4196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:21.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c37fe700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66c41066b0 0x7f66c4196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:21.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c37fe700 1 -- 172.21.15.114:0/2174685089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66c4101060 msgr2=0x7f66c419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:21.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c37fe700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66c4101060 0x7f66c419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:21.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c37fe700 1 -- 172.21.15.114:0/2174685089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc009c40 con 0x7f66c41006a0 2023-10-18T14:02:21.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c3fff700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66c41066b0 0x7f66c4196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:21.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c37fe700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41006a0 0x7f66c419c7f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f66b4000c00 tx=0x7f66b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:21.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c0ff9700 1 -- 172.21.15.114:0/2174685089 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b401d070 con 0x7f66c41006a0 2023-10-18T14:02:21.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c0ff9700 1 -- 172.21.15.114:0/2174685089 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66b4022470 con 0x7f66c41006a0 2023-10-18T14:02:21.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c9be6700 1 -- 172.21.15.114:0/2174685089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b40095f0 con 0x7f66c41006a0 2023-10-18T14:02:21.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c0ff9700 1 -- 172.21.15.114:0/2174685089 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4017650 con 0x7f66c41006a0 2023-10-18T14:02:21.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.528+0000 7f66c9be6700 1 -- 172.21.15.114:0/2174685089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c41a3600 con 0x7f66c41006a0 2023-10-18T14:02:21.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.530+0000 7f66c9be6700 1 -- 172.21.15.114:0/2174685089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c4108c30 con 0x7f66c41006a0 2023-10-18T14:02:21.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.532+0000 7f66c0ff9700 1 -- 172.21.15.114:0/2174685089 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f66b40225e0 con 0x7f66c41006a0 2023-10-18T14:02:21.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.533+0000 7f66c0ff9700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f66ac0a14d0 0x7f66ac0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:21.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.533+0000 7f66c0ff9700 1 -- 172.21.15.114:0/2174685089 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f66b40ce390 con 0x7f66c41006a0 2023-10-18T14:02:21.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.533+0000 7f66c2ffd700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f66ac0a14d0 0x7f66ac0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:21.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.533+0000 7f66c2ffd700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f66ac0a14d0 0x7f66ac0a3990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f66c4197ae0 tx=0x7f66b8009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:21.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.535+0000 7f66c0ff9700 1 -- 172.21.15.114:0/2174685089 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f66b4097db0 con 0x7f66c41006a0 2023-10-18T14:02:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.788+0000 7f66c9be6700 1 -- 172.21.15.114:0/2174685089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66c4197470 con 0x7f66c41006a0 2023-10-18T14:02:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.789+0000 7f66c0ff9700 1 -- 172.21.15.114:0/2174685089 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7682 (secure 0 0 0) 0x7f66b409b3d0 con 0x7f66c41006a0 2023-10-18T14:02:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:21.794 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24506,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24524,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24583,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24616,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-18T14:02:21.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.791+0000 7f66c9be6700 1 -- 172.21.15.114:0/2174685089 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f66ac0a14d0 msgr2=0x7f66ac0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:21.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.791+0000 7f66c9be6700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f66ac0a14d0 0x7f66ac0a3990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f66c4197ae0 tx=0x7f66b8009260 comp rx=0 tx=0).stop 2023-10-18T14:02:21.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.791+0000 7f66c9be6700 1 -- 172.21.15.114:0/2174685089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41006a0 msgr2=0x7f66c419c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:21.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.791+0000 7f66c9be6700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41006a0 0x7f66c419c7f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f66b4000c00 tx=0x7f66b4004730 comp rx=0 tx=0).stop 2023-10-18T14:02:21.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.791+0000 7f66c9be6700 1 -- 172.21.15.114:0/2174685089 shutdown_connections 2023-10-18T14:02:21.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.791+0000 7f66c9be6700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f66ac0a14d0 0x7f66ac0a3990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:21.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.791+0000 7f66c9be6700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66c41066b0 0x7f66c4196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:21.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.791+0000 7f66c9be6700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41006a0 0x7f66c419c7f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:21.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.791+0000 7f66c9be6700 1 --2- 172.21.15.114:0/2174685089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66c4101060 0x7f66c419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:21.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.791+0000 7f66c9be6700 1 -- 172.21.15.114:0/2174685089 >> 172.21.15.114:0/2174685089 conn(0x7f66c40fc1d0 msgr2=0x7f66c40fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:21.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.792+0000 7f66c9be6700 1 -- 172.21.15.114:0/2174685089 shutdown_connections 2023-10-18T14:02:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:21.792+0000 7f66c9be6700 1 -- 172.21.15.114:0/2174685089 wait complete. 2023-10-18T14:02:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 10 2023-10-18T14:02:22.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:22 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:22.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:22 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:22.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:22 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:22.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:22 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:22.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:22 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:22.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:22 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:22.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:22 smithi158 ceph-mon[103317]: Deploying daemon mds.g on smithi114 2023-10-18T14:02:22.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:22 smithi158 ceph-mon[103317]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:22.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:22 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] up:boot 2023-10-18T14:02:22.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:22 smithi158 ceph-mon[103317]: fsmap 9 up:standby 2023-10-18T14:02:22.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:22 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-18T14:02:22.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:22 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2174685089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:22.309 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:22 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:22.309 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:22 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:22.310 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:22 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:22.310 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:22 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:22.310 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:22 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:22.310 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:22 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:22.310 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:22 smithi114 ceph-mon[99494]: Deploying daemon mds.g on smithi114 2023-10-18T14:02:22.311 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:22 smithi114 ceph-mon[99494]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:22.311 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:22 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] up:boot 2023-10-18T14:02:22.311 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:22 smithi114 ceph-mon[99494]: fsmap 9 up:standby 2023-10-18T14:02:22.311 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:22 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-18T14:02:22.311 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:22 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2174685089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:22.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:22 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:22.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:22 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:22.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:22 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:22.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:22 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:22.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:22 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:22.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:22 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:22.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:22 smithi172 ceph-mon[103574]: Deploying daemon mds.g on smithi114 2023-10-18T14:02:22.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:22 smithi172 ceph-mon[103574]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:22.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:22 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] up:boot 2023-10-18T14:02:22.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:22 smithi172 ceph-mon[103574]: fsmap 9 up:standby 2023-10-18T14:02:22.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:22 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-18T14:02:22.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:22 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2174685089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:22.839 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:02:22 smithi114 systemd[1]: Starting Ceph mds.g for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:02:23.123 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:02:22 smithi114 podman[157465]: 2023-10-18T14:02:23.588 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:02:23 smithi114 ceph-mds[157506]: -- 172.21.15.114:0/1780791544 <== mon.0 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5634d36251e0 con 0x5634d35fa800 2023-10-18T14:02:23.589 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:02:23 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-g[157481]: starting mds.g at 2023-10-18T14:02:23.589 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:02:23 smithi114 bash[157465]: c17de26a1ec8bbb7352df8f75b9a83b6aab1f3ac4cf1b1ea889db753f723c1a6 2023-10-18T14:02:23.589 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:02:23 smithi114 systemd[1]: Started Ceph mds.g for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T14:02:23.809 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:02:23.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.942+0000 7f9272039700 1 -- 172.21.15.114:0/1317828391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c106720 msgr2=0x7f926c106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:23.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.942+0000 7f9272039700 1 --2- 172.21.15.114:0/1317828391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c106720 0x7f926c106b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9260009990 tx=0x7f9260009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:23.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.942+0000 7f9272039700 1 -- 172.21.15.114:0/1317828391 shutdown_connections 2023-10-18T14:02:23.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.942+0000 7f9272039700 1 --2- 172.21.15.114:0/1317828391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f926c0ff5a0 0x7f926c10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:23.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.942+0000 7f9272039700 1 --2- 172.21.15.114:0/1317828391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c106720 0x7f926c106b00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:23.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.942+0000 7f9272039700 1 --2- 172.21.15.114:0/1317828391 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f926c0fec00 0x7f926c0ff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:23.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.942+0000 7f9272039700 1 -- 172.21.15.114:0/1317828391 >> 172.21.15.114:0/1317828391 conn(0x7f926c075b90 msgr2=0x7f926c0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:23.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.942+0000 7f9272039700 1 -- 172.21.15.114:0/1317828391 shutdown_connections 2023-10-18T14:02:23.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.942+0000 7f9272039700 1 -- 172.21.15.114:0/1317828391 wait complete. 2023-10-18T14:02:23.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.943+0000 7f9272039700 1 Processor -- start 2023-10-18T14:02:23.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.943+0000 7f9272039700 1 -- start start 2023-10-18T14:02:23.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.943+0000 7f9272039700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f926c0fec00 0x7f926c0ffde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:23.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.943+0000 7f9272039700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c0ff5a0 0x7f926c100320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:23.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.943+0000 7f9272039700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f926c106720 0x7f926c100860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:23.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.943+0000 7f9272039700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c1a4fc0 con 0x7f926c0ff5a0 2023-10-18T14:02:23.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.943+0000 7f9272039700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c1a5130 con 0x7f926c106720 2023-10-18T14:02:23.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.943+0000 7f9272039700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c1a52f0 con 0x7f926c0fec00 2023-10-18T14:02:23.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.943+0000 7f926affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c0ff5a0 0x7f926c100320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:23.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.943+0000 7f926affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c0ff5a0 0x7f926c100320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42230/0 (socket says 172.21.15.114:42230) 2023-10-18T14:02:23.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.943+0000 7f926affd700 1 -- 172.21.15.114:0/2579751965 learned_addr learned my addr 172.21.15.114:0/2579751965 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:23.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.944+0000 7f926b7fe700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f926c0fec00 0x7f926c0ffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:23.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.944+0000 7f926affd700 1 -- 172.21.15.114:0/2579751965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f926c0fec00 msgr2=0x7f926c0ffde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:23.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.944+0000 7f926affd700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f926c0fec00 0x7f926c0ffde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:23.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.944+0000 7f926affd700 1 -- 172.21.15.114:0/2579751965 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f926c106720 msgr2=0x7f926c100860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:23.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.944+0000 7f926affd700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f926c106720 0x7f926c100860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:23.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.944+0000 7f926affd700 1 -- 172.21.15.114:0/2579751965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600095f0 con 0x7f926c0ff5a0 2023-10-18T14:02:23.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.944+0000 7f926b7fe700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f926c0fec00 0x7f926c0ffde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:23.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.944+0000 7f926affd700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c0ff5a0 0x7f926c100320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f925c00b530 tx=0x7f925c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:23.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.944+0000 7f9268ff9700 1 -- 172.21.15.114:0/2579751965 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c011830 con 0x7f926c0ff5a0 2023-10-18T14:02:23.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.944+0000 7f9272039700 1 -- 172.21.15.114:0/2579751965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926c1a55d0 con 0x7f926c0ff5a0 2023-10-18T14:02:23.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.944+0000 7f9268ff9700 1 -- 172.21.15.114:0/2579751965 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f925c011e50 con 0x7f926c0ff5a0 2023-10-18T14:02:23.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.944+0000 7f9268ff9700 1 -- 172.21.15.114:0/2579751965 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00f2e0 con 0x7f926c0ff5a0 2023-10-18T14:02:23.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.944+0000 7f9272039700 1 -- 172.21.15.114:0/2579751965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926c1a5b30 con 0x7f926c0ff5a0 2023-10-18T14:02:23.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.945+0000 7f9272039700 1 -- 172.21.15.114:0/2579751965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926c108cc0 con 0x7f926c0ff5a0 2023-10-18T14:02:23.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.946+0000 7f9268ff9700 1 -- 172.21.15.114:0/2579751965 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f925c010580 con 0x7f926c0ff5a0 2023-10-18T14:02:23.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.947+0000 7f9268ff9700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92540a14d0 0x7f92540a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:23.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.947+0000 7f926b7fe700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92540a14d0 0x7f92540a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:23.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.947+0000 7f9268ff9700 1 -- 172.21.15.114:0/2579751965 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f925c0cca30 con 0x7f926c0ff5a0 2023-10-18T14:02:23.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.947+0000 7f926b7fe700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92540a14d0 0x7f92540a3990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f926000b5c0 tx=0x7f9260005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:23.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:23.950+0000 7f9268ff9700 1 -- 172.21.15.114:0/2579751965 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f925c096460 con 0x7f926c0ff5a0 2023-10-18T14:02:24.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.206+0000 7f9272039700 1 -- 172.21.15.114:0/2579751965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f926c1012c0 con 0x7f926c0ff5a0 2023-10-18T14:02:24.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.206+0000 7f9268ff9700 1 -- 172.21.15.114:0/2579751965 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8477 (secure 0 0 0) 0x7f925c099a80 con 0x7f926c0ff5a0 2023-10-18T14:02:24.210 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:24.211 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24506,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24524,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24583,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24616,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-18T14:02:24.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.208+0000 7f9272039700 1 -- 172.21.15.114:0/2579751965 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92540a14d0 msgr2=0x7f92540a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:24.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.208+0000 7f9272039700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92540a14d0 0x7f92540a3990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f926000b5c0 tx=0x7f9260005fb0 comp rx=0 tx=0).stop 2023-10-18T14:02:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.208+0000 7f9272039700 1 -- 172.21.15.114:0/2579751965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c0ff5a0 msgr2=0x7f926c100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.208+0000 7f9272039700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c0ff5a0 0x7f926c100320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f925c00b530 tx=0x7f925c00b8f0 comp rx=0 tx=0).stop 2023-10-18T14:02:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.208+0000 7f9272039700 1 -- 172.21.15.114:0/2579751965 shutdown_connections 2023-10-18T14:02:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.208+0000 7f9272039700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92540a14d0 0x7f92540a3990 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.208+0000 7f9272039700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f926c106720 0x7f926c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:24.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.208+0000 7f9272039700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f926c0fec00 0x7f926c0ffde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:24.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.208+0000 7f9272039700 1 --2- 172.21.15.114:0/2579751965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c0ff5a0 0x7f926c100320 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:24.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.208+0000 7f9272039700 1 -- 172.21.15.114:0/2579751965 >> 172.21.15.114:0/2579751965 conn(0x7f926c075b90 msgr2=0x7f926c103730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:24.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.208+0000 7f9272039700 1 -- 172.21.15.114:0/2579751965 shutdown_connections 2023-10-18T14:02:24.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:24.208+0000 7f9272039700 1 -- 172.21.15.114:0/2579751965 wait complete. 2023-10-18T14:02:24.215 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 11 2023-10-18T14:02:24.472 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:24 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.114:6838/2312997594,v1:172.21.15.114:6839/2312997594] up:boot 2023-10-18T14:02:24.473 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:24 smithi114 ceph-mon[99494]: fsmap 10 up:standby 2023-10-18T14:02:24.473 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-18T14:02:24.473 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:24.474 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:24.474 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:24.474 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:24.474 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:24.474 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:24 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:24.475 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:24 smithi114 ceph-mon[99494]: Deploying daemon mds.a on smithi114 2023-10-18T14:02:24.475 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:24 smithi114 ceph-mon[99494]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:24.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:24 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.114:6838/2312997594,v1:172.21.15.114:6839/2312997594] up:boot 2023-10-18T14:02:24.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:24 smithi158 ceph-mon[103317]: fsmap 10 up:standby 2023-10-18T14:02:24.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-18T14:02:24.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:24.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:24.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:24.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:24.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:24.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:24 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:24.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:24 smithi158 ceph-mon[103317]: Deploying daemon mds.a on smithi114 2023-10-18T14:02:24.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:24 smithi158 ceph-mon[103317]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:24.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:24 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.114:6838/2312997594,v1:172.21.15.114:6839/2312997594] up:boot 2023-10-18T14:02:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:24 smithi172 ceph-mon[103574]: fsmap 10 up:standby 2023-10-18T14:02:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-18T14:02:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:24.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:24.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:24.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:24 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:24.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:24 smithi172 ceph-mon[103574]: Deploying daemon mds.a on smithi114 2023-10-18T14:02:24.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:24 smithi172 ceph-mon[103574]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:25.088 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:02:24 smithi114 systemd[1]: Starting Ceph mds.a for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:02:25.397 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:02:25 smithi114 podman[157853]: 2023-10-18T14:02:25.397 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:25 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2579751965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:25.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:25 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2579751965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:25.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:25 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2579751965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:25.838 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:02:25 smithi114 ceph-mds[157893]: -- 172.21.15.114:0/2690305469 <== mon.0 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56037eaef1e0 con 0x56037eac4c00 2023-10-18T14:02:25.838 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:02:25 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: starting mds.a at 2023-10-18T14:02:25.839 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:02:25 smithi114 bash[157853]: dc0173111c4fbc834835e2df339ef9240d9d54c65159a06b3cb6cf3241ef377e 2023-10-18T14:02:25.839 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:02:25 smithi114 systemd[1]: Started Ceph mds.a for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T14:02:26.226 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:02:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.362+0000 7ff106348700 1 -- 172.21.15.114:0/241788974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff100101060 msgr2=0x7ff10010d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.362+0000 7ff106348700 1 --2- 172.21.15.114:0/241788974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff100101060 0x7ff10010d570 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800b0a0 tx=0x7ff0f800b3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.362+0000 7ff106348700 1 -- 172.21.15.114:0/241788974 shutdown_connections 2023-10-18T14:02:26.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.362+0000 7ff106348700 1 --2- 172.21.15.114:0/241788974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff100101060 0x7ff10010d570 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:26.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.362+0000 7ff106348700 1 --2- 172.21.15.114:0/241788974 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1001066b0 0x7ff100106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:26.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.362+0000 7ff106348700 1 --2- 172.21.15.114:0/241788974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1001006a0 0x7ff100100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:26.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.362+0000 7ff106348700 1 -- 172.21.15.114:0/241788974 >> 172.21.15.114:0/241788974 conn(0x7ff1000fc1d0 msgr2=0x7ff1000fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:26.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.362+0000 7ff106348700 1 -- 172.21.15.114:0/241788974 shutdown_connections 2023-10-18T14:02:26.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.362+0000 7ff106348700 1 -- 172.21.15.114:0/241788974 wait complete. 2023-10-18T14:02:26.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff106348700 1 Processor -- start 2023-10-18T14:02:26.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff106348700 1 -- start start 2023-10-18T14:02:26.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff106348700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1001006a0 0x7ff100072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:26.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff106348700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff100101060 0x7ff100073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:26.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff106348700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1001066b0 0x7ff100073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:26.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff106348700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1001a4e20 con 0x7ff100101060 2023-10-18T14:02:26.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff106348700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1001a4f90 con 0x7ff1001066b0 2023-10-18T14:02:26.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff106348700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1001a5150 con 0x7ff1001006a0 2023-10-18T14:02:26.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff0ff7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff100101060 0x7ff100073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:26.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff0ff7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff100101060 0x7ff100073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42254/0 (socket says 172.21.15.114:42254) 2023-10-18T14:02:26.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff0ff7fe700 1 -- 172.21.15.114:0/3541562035 learned_addr learned my addr 172.21.15.114:0/3541562035 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:26.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff1048e5700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1001066b0 0x7ff100073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff0fffff700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1001006a0 0x7ff100072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.363+0000 7ff0ff7fe700 1 -- 172.21.15.114:0/3541562035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1001006a0 msgr2=0x7ff100072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.364+0000 7ff0ff7fe700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1001006a0 0x7ff100072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.364+0000 7ff0ff7fe700 1 -- 172.21.15.114:0/3541562035 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1001066b0 msgr2=0x7ff100073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.364+0000 7ff0ff7fe700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1001066b0 0x7ff100073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:26.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.364+0000 7ff0ff7fe700 1 -- 172.21.15.114:0/3541562035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f8009d00 con 0x7ff100101060 2023-10-18T14:02:26.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.364+0000 7ff0ff7fe700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff100101060 0x7ff100073030 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400d950 tx=0x7ff0f400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:26.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.364+0000 7ff0fd7fa700 1 -- 172.21.15.114:0/3541562035 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4009940 con 0x7ff100101060 2023-10-18T14:02:26.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.364+0000 7ff0fd7fa700 1 -- 172.21.15.114:0/3541562035 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0f4010460 con 0x7ff100101060 2023-10-18T14:02:26.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.364+0000 7ff106348700 1 -- 172.21.15.114:0/3541562035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1001a5430 con 0x7ff100101060 2023-10-18T14:02:26.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.364+0000 7ff0fd7fa700 1 -- 172.21.15.114:0/3541562035 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f400f620 con 0x7ff100101060 2023-10-18T14:02:26.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.364+0000 7ff106348700 1 -- 172.21.15.114:0/3541562035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1001a5990 con 0x7ff100101060 2023-10-18T14:02:26.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.365+0000 7ff106348700 1 -- 172.21.15.114:0/3541562035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff100108cc0 con 0x7ff100101060 2023-10-18T14:02:26.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.366+0000 7ff0fd7fa700 1 -- 172.21.15.114:0/3541562035 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7ff0f40108d0 con 0x7ff100101060 2023-10-18T14:02:26.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.366+0000 7ff0fd7fa700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff0e80a1550 0x7ff0e80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:26.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.367+0000 7ff0fffff700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff0e80a1550 0x7ff0e80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:26.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.367+0000 7ff0fd7fa700 1 -- 172.21.15.114:0/3541562035 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7ff0f40cc760 con 0x7ff100101060 2023-10-18T14:02:26.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.367+0000 7ff0fffff700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff0e80a1550 0x7ff0e80a3a10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0005fd0 tx=0x7ff0f0005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:26.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.370+0000 7ff0fd7fa700 1 -- 172.21.15.114:0/3541562035 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff0f4096190 con 0x7ff100101060 2023-10-18T14:02:26.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:26.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:26.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:26.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:26.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:26.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:26.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:26 smithi114 ceph-mon[99494]: Deploying daemon mds.b on smithi158 2023-10-18T14:02:26.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:26 smithi114 ceph-mon[99494]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:26.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:26 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] up:boot 2023-10-18T14:02:26.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:26 smithi114 ceph-mon[99494]: fsmap 11 up:standby 2023-10-18T14:02:26.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:26 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-18T14:02:26.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.606+0000 7ff106348700 1 -- 172.21.15.114:0/3541562035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff100101de0 con 0x7ff100101060 2023-10-18T14:02:26.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.607+0000 7ff0fd7fa700 1 -- 172.21.15.114:0/3541562035 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9272 (secure 0 0 0) 0x7ff0f40997b0 con 0x7ff100101060 2023-10-18T14:02:26.611 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:26.612 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24506,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24524,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24583,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24616,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-18T14:02:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.609+0000 7ff106348700 1 -- 172.21.15.114:0/3541562035 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff0e80a1550 msgr2=0x7ff0e80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:26.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.609+0000 7ff106348700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff0e80a1550 0x7ff0e80a3a10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0005fd0 tx=0x7ff0f0005ee0 comp rx=0 tx=0).stop 2023-10-18T14:02:26.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.609+0000 7ff106348700 1 -- 172.21.15.114:0/3541562035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff100101060 msgr2=0x7ff100073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:26.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.609+0000 7ff106348700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff100101060 0x7ff100073030 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400d950 tx=0x7ff0f400dc60 comp rx=0 tx=0).stop 2023-10-18T14:02:26.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.609+0000 7ff106348700 1 -- 172.21.15.114:0/3541562035 shutdown_connections 2023-10-18T14:02:26.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.609+0000 7ff106348700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff0e80a1550 0x7ff0e80a3a10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:26.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.609+0000 7ff106348700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1001066b0 0x7ff100073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:26.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.609+0000 7ff106348700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1001006a0 0x7ff100072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:26.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.609+0000 7ff106348700 1 --2- 172.21.15.114:0/3541562035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff100101060 0x7ff100073030 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:26.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.609+0000 7ff106348700 1 -- 172.21.15.114:0/3541562035 >> 172.21.15.114:0/3541562035 conn(0x7ff1000fc1d0 msgr2=0x7ff1000fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:26.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.609+0000 7ff106348700 1 -- 172.21.15.114:0/3541562035 shutdown_connections 2023-10-18T14:02:26.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:26.609+0000 7ff106348700 1 -- 172.21.15.114:0/3541562035 wait complete. 2023-10-18T14:02:26.616 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 12 2023-10-18T14:02:26.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:26.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:26.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:26.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:26.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:26.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:26.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:26 smithi158 ceph-mon[103317]: Deploying daemon mds.b on smithi158 2023-10-18T14:02:26.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:26 smithi158 ceph-mon[103317]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:26.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:26 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] up:boot 2023-10-18T14:02:26.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:26 smithi158 ceph-mon[103317]: fsmap 11 up:standby 2023-10-18T14:02:26.773 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:26 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-18T14:02:26.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:26.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:26.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:26.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-18T14:02:26.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-18T14:02:26.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:26.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:26 smithi172 ceph-mon[103574]: Deploying daemon mds.b on smithi158 2023-10-18T14:02:26.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:26 smithi172 ceph-mon[103574]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:26.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:26 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] up:boot 2023-10-18T14:02:26.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:26 smithi172 ceph-mon[103574]: fsmap 11 up:standby 2023-10-18T14:02:26.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:26 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-18T14:02:27.272 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:02:27 smithi158 systemd[1]: Starting Ceph mds.b for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:02:27.755 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:27 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3541562035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:27.755 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:02:27 smithi158 podman[141165]: 2023-10-18T14:02:27.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:27 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3541562035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:27.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:27 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3541562035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:28.021 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:02:27 smithi158 ceph-mds[141205]: -- 172.21.15.158:0/3756874494 <== mon.2 v2:172.21.15.158:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56391374b1e0 con 0x563913721000 2023-10-18T14:02:28.021 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:02:27 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: starting mds.b at 2023-10-18T14:02:28.021 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:02:27 smithi158 bash[141165]: 1112236ce61f0b598f028975009d124bd9c4a2cf82ce2c28c5cb6aada7616f75 2023-10-18T14:02:28.022 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:02:27 smithi158 systemd[1]: Started Ceph mds.b for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T14:02:28.626 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:02:28.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.752+0000 7f67519fd700 1 -- 172.21.15.114:0/3126311833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f674c1066b0 msgr2=0x7f674c106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:28.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.752+0000 7f67519fd700 1 --2- 172.21.15.114:0/3126311833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f674c1066b0 0x7f674c106a90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f674400b0a0 tx=0x7f674400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:28.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.753+0000 7f67519fd700 1 -- 172.21.15.114:0/3126311833 shutdown_connections 2023-10-18T14:02:28.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.753+0000 7f67519fd700 1 --2- 172.21.15.114:0/3126311833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f674c101060 0x7f674c10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:28.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.753+0000 7f67519fd700 1 --2- 172.21.15.114:0/3126311833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f674c1066b0 0x7f674c106a90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:28.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.753+0000 7f67519fd700 1 --2- 172.21.15.114:0/3126311833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f674c1006a0 0x7f674c100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:28.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.753+0000 7f67519fd700 1 -- 172.21.15.114:0/3126311833 >> 172.21.15.114:0/3126311833 conn(0x7f674c0fc1d0 msgr2=0x7f674c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:28.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.753+0000 7f67519fd700 1 -- 172.21.15.114:0/3126311833 shutdown_connections 2023-10-18T14:02:28.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.753+0000 7f67519fd700 1 -- 172.21.15.114:0/3126311833 wait complete. 2023-10-18T14:02:28.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.753+0000 7f67519fd700 1 Processor -- start 2023-10-18T14:02:28.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f67519fd700 1 -- start start 2023-10-18T14:02:28.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f67519fd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f674c1006a0 0x7f674c19c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:28.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f67519fd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f674c101060 0x7f674c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:28.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f67519fd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f674c1066b0 0x7f674c196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:28.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f67519fd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c196f80 con 0x7f674c1006a0 2023-10-18T14:02:28.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f67519fd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c1970f0 con 0x7f674c101060 2023-10-18T14:02:28.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f67519fd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c1972b0 con 0x7f674c1066b0 2023-10-18T14:02:28.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f674affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f674c1006a0 0x7f674c19c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:28.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f674affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f674c1006a0 0x7f674c19c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42266/0 (socket says 172.21.15.114:42266) 2023-10-18T14:02:28.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f674affd700 1 -- 172.21.15.114:0/1742183337 learned_addr learned my addr 172.21.15.114:0/1742183337 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f674a7fc700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f674c101060 0x7f674c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f674b7fe700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f674c1066b0 0x7f674c196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f674affd700 1 -- 172.21.15.114:0/1742183337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f674c1066b0 msgr2=0x7f674c196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f674affd700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f674c1066b0 0x7f674c196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f674affd700 1 -- 172.21.15.114:0/1742183337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f674c101060 msgr2=0x7f674c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:28.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f674affd700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f674c101060 0x7f674c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:28.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f674affd700 1 -- 172.21.15.114:0/1742183337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6744009d00 con 0x7f674c1006a0 2023-10-18T14:02:28.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.754+0000 7f674affd700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f674c1006a0 0x7f674c19c7f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f67440062a0 tx=0x7f6744005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:28.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.755+0000 7f67509fb700 1 -- 172.21.15.114:0/1742183337 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674400e040 con 0x7f674c1006a0 2023-10-18T14:02:28.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.755+0000 7f67519fd700 1 -- 172.21.15.114:0/1742183337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674c197530 con 0x7f674c1006a0 2023-10-18T14:02:28.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.755+0000 7f67509fb700 1 -- 172.21.15.114:0/1742183337 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6744012e80 con 0x7f674c1006a0 2023-10-18T14:02:28.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.755+0000 7f67509fb700 1 -- 172.21.15.114:0/1742183337 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674401b450 con 0x7f674c1006a0 2023-10-18T14:02:28.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.755+0000 7f67519fd700 1 -- 172.21.15.114:0/1742183337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674c1a37e0 con 0x7f674c1006a0 2023-10-18T14:02:28.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.756+0000 7f67519fd700 1 -- 172.21.15.114:0/1742183337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674c108c30 con 0x7f674c1006a0 2023-10-18T14:02:28.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.757+0000 7f67509fb700 1 -- 172.21.15.114:0/1742183337 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f67440129c0 con 0x7f674c1006a0 2023-10-18T14:02:28.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.757+0000 7f67509fb700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f67340a14d0 0x7f67340a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:28.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.758+0000 7f674a7fc700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f67340a14d0 0x7f67340a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:28.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.758+0000 7f67509fb700 1 -- 172.21.15.114:0/1742183337 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f67440ce960 con 0x7f674c1006a0 2023-10-18T14:02:28.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.758+0000 7f674a7fc700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f67340a14d0 0x7f67340a3990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f674c197ae0 tx=0x7f674000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:28.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:28.761+0000 7f67509fb700 1 -- 172.21.15.114:0/1742183337 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6744098420 con 0x7f674c1006a0 2023-10-18T14:02:29.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.011+0000 7f67519fd700 1 -- 172.21.15.114:0/1742183337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f674c101de0 con 0x7f674c1006a0 2023-10-18T14:02:29.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.012+0000 7f67509fb700 1 -- 172.21.15.114:0/1742183337 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10067 (secure 0 0 0) 0x7f674409ba40 con 0x7f674c1006a0 2023-10-18T14:02:29.017 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:29.017 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24506,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24524,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24566,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":24583,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24616,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-18T14:02:29.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.014+0000 7f67519fd700 1 -- 172.21.15.114:0/1742183337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f67340a14d0 msgr2=0x7f67340a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.014+0000 7f67519fd700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f67340a14d0 0x7f67340a3990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f674c197ae0 tx=0x7f674000b410 comp rx=0 tx=0).stop 2023-10-18T14:02:29.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.014+0000 7f67519fd700 1 -- 172.21.15.114:0/1742183337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f674c1006a0 msgr2=0x7f674c19c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.014+0000 7f67519fd700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f674c1006a0 0x7f674c19c7f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f67440062a0 tx=0x7f6744005a60 comp rx=0 tx=0).stop 2023-10-18T14:02:29.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.014+0000 7f67519fd700 1 -- 172.21.15.114:0/1742183337 shutdown_connections 2023-10-18T14:02:29.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.014+0000 7f67519fd700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f67340a14d0 0x7f67340a3990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.014+0000 7f67519fd700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f674c1066b0 0x7f674c196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.014+0000 7f67519fd700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f674c1006a0 0x7f674c19c7f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.014+0000 7f67519fd700 1 --2- 172.21.15.114:0/1742183337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f674c101060 0x7f674c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.014+0000 7f67519fd700 1 -- 172.21.15.114:0/1742183337 >> 172.21.15.114:0/1742183337 conn(0x7f674c0fc1d0 msgr2=0x7f674c0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.014+0000 7f67519fd700 1 -- 172.21.15.114:0/1742183337 shutdown_connections 2023-10-18T14:02:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.014+0000 7f67519fd700 1 -- 172.21.15.114:0/1742183337 wait complete. 2023-10-18T14:02:29.021 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 13 2023-10-18T14:02:29.029 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:28 smithi114 ceph-mon[99494]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:29.029 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:28 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.030 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:28 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.030 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:28 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.030 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:28 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.030 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:28 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.030 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:28 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:02:29.031 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:28 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] up:boot 2023-10-18T14:02:29.031 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:28 smithi114 ceph-mon[99494]: fsmap 12 up:standby 2023-10-18T14:02:29.031 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:28 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-18T14:02:29.032 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:02:29.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.155+0000 7fa6b6233700 1 -- 172.21.15.114:0/749530104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6b0100290 msgr2=0x7fa6b010c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.155+0000 7fa6b6233700 1 --2- 172.21.15.114:0/749530104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6b0100290 0x7fa6b010c420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009990 tx=0x7fa6a8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.155+0000 7fa6b6233700 1 -- 172.21.15.114:0/749530104 shutdown_connections 2023-10-18T14:02:29.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.155+0000 7fa6b6233700 1 --2- 172.21.15.114:0/749530104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6b0100290 0x7fa6b010c420 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.155+0000 7fa6b6233700 1 --2- 172.21.15.114:0/749530104 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa6b0105710 0x7fa6b0105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.155+0000 7fa6b6233700 1 --2- 172.21.15.114:0/749530104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6b00ff8d0 0x7fa6b00ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.155+0000 7fa6b6233700 1 -- 172.21.15.114:0/749530104 >> 172.21.15.114:0/749530104 conn(0x7fa6b0076400 msgr2=0x7fa6b0076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:29.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.155+0000 7fa6b6233700 1 -- 172.21.15.114:0/749530104 shutdown_connections 2023-10-18T14:02:29.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.155+0000 7fa6b6233700 1 -- 172.21.15.114:0/749530104 wait complete. 2023-10-18T14:02:29.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.156+0000 7fa6b6233700 1 Processor -- start 2023-10-18T14:02:29.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.156+0000 7fa6b6233700 1 -- start start 2023-10-18T14:02:29.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.156+0000 7fa6b6233700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6b00ff8d0 0x7fa6b019c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:29.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.156+0000 7fa6b6233700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6b0100290 0x7fa6b019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:29.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.156+0000 7fa6b6233700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa6b0105710 0x7fa6b01968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:29.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.156+0000 7fa6b6233700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0196f20 con 0x7fa6b0100290 2023-10-18T14:02:29.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.156+0000 7fa6b6233700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0197090 con 0x7fa6b0105710 2023-10-18T14:02:29.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.156+0000 7fa6b6233700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0197250 con 0x7fa6b00ff8d0 2023-10-18T14:02:29.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.156+0000 7fa6aeffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6b0100290 0x7fa6b019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:29.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.156+0000 7fa6aeffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6b0100290 0x7fa6b019ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42282/0 (socket says 172.21.15.114:42282) 2023-10-18T14:02:29.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.156+0000 7fa6aeffd700 1 -- 172.21.15.114:0/4090800818 learned_addr learned my addr 172.21.15.114:0/4090800818 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:29.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.156+0000 7fa6af7fe700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6b00ff8d0 0x7fa6b019c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:29.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.156+0000 7fa6affff700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa6b0105710 0x7fa6b01968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:29.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.157+0000 7fa6aeffd700 1 -- 172.21.15.114:0/4090800818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6b00ff8d0 msgr2=0x7fa6b019c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.157+0000 7fa6aeffd700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6b00ff8d0 0x7fa6b019c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.157+0000 7fa6aeffd700 1 -- 172.21.15.114:0/4090800818 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa6b0105710 msgr2=0x7fa6b01968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.157+0000 7fa6aeffd700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa6b0105710 0x7fa6b01968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.157+0000 7fa6aeffd700 1 -- 172.21.15.114:0/4090800818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a80095f0 con 0x7fa6b0100290 2023-10-18T14:02:29.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.157+0000 7fa6af7fe700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6b00ff8d0 0x7fa6b019c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:02:29.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.157+0000 7fa6aeffd700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6b0100290 0x7fa6b019ccd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa69800e9a0 tx=0x7fa69800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:29.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.157+0000 7fa6acff9700 1 -- 172.21.15.114:0/4090800818 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698009790 con 0x7fa6b0100290 2023-10-18T14:02:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.157+0000 7fa6acff9700 1 -- 172.21.15.114:0/4090800818 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa698010430 con 0x7fa6b0100290 2023-10-18T14:02:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.157+0000 7fa6b6233700 1 -- 172.21.15.114:0/4090800818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b0197530 con 0x7fa6b0100290 2023-10-18T14:02:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.157+0000 7fa6acff9700 1 -- 172.21.15.114:0/4090800818 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698018680 con 0x7fa6b0100290 2023-10-18T14:02:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.157+0000 7fa6b6233700 1 -- 172.21.15.114:0/4090800818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b01a3780 con 0x7fa6b0100290 2023-10-18T14:02:29.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.158+0000 7fa6b6233700 1 -- 172.21.15.114:0/4090800818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b0100cc0 con 0x7fa6b0100290 2023-10-18T14:02:29.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.159+0000 7fa6acff9700 1 -- 172.21.15.114:0/4090800818 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fa6980105a0 con 0x7fa6b0100290 2023-10-18T14:02:29.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.160+0000 7fa6acff9700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa69c0a14d0 0x7fa69c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:29.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.160+0000 7fa6acff9700 1 -- 172.21.15.114:0/4090800818 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fa698014070 con 0x7fa6b0100290 2023-10-18T14:02:29.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.160+0000 7fa6af7fe700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa69c0a14d0 0x7fa69c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:29.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.160+0000 7fa6af7fe700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa69c0a14d0 0x7fa69c0a3990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000a7b0 tx=0x7fa6a000d040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:29.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.163+0000 7fa6acff9700 1 -- 172.21.15.114:0/4090800818 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa698096e60 con 0x7fa6b0100290 2023-10-18T14:02:29.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:28 smithi158 ceph-mon[103317]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:29.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:28 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:28 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:28 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:28 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:28 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:28 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:02:29.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:28 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] up:boot 2023-10-18T14:02:29.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:28 smithi158 ceph-mon[103317]: fsmap 12 up:standby 2023-10-18T14:02:29.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:28 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-18T14:02:29.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:28 smithi172 ceph-mon[103574]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:29.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:28 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:28 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:28 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:28 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:28 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:29.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:28 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:02:29.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:28 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] up:boot 2023-10-18T14:02:29.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:28 smithi172 ceph-mon[103574]: fsmap 12 up:standby 2023-10-18T14:02:29.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:28 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-18T14:02:29.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.368+0000 7fa6b6233700 1 -- 172.21.15.114:0/4090800818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6b0067530 con 0x7fa6b0100290 2023-10-18T14:02:29.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.369+0000 7fa6acff9700 1 -- 172.21.15.114:0/4090800818 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18823 (secure 0 0 0) 0x7fa69809a480 con 0x7fa6b0100290 2023-10-18T14:02:29.373 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:29.374 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":79,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:01:52.492213+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:02:29.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.371+0000 7fa6b6233700 1 -- 172.21.15.114:0/4090800818 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa69c0a14d0 msgr2=0x7fa69c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.371+0000 7fa6b6233700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa69c0a14d0 0x7fa69c0a3990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000a7b0 tx=0x7fa6a000d040 comp rx=0 tx=0).stop 2023-10-18T14:02:29.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.371+0000 7fa6b6233700 1 -- 172.21.15.114:0/4090800818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6b0100290 msgr2=0x7fa6b019ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.371+0000 7fa6b6233700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6b0100290 0x7fa6b019ccd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa69800e9a0 tx=0x7fa69800ecb0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.371+0000 7fa6b6233700 1 -- 172.21.15.114:0/4090800818 shutdown_connections 2023-10-18T14:02:29.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.371+0000 7fa6b6233700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa69c0a14d0 0x7fa69c0a3990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.371+0000 7fa6b6233700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa6b0105710 0x7fa6b01968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.371+0000 7fa6b6233700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6b00ff8d0 0x7fa6b019c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.371+0000 7fa6b6233700 1 --2- 172.21.15.114:0/4090800818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6b0100290 0x7fa6b019ccd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.371+0000 7fa6b6233700 1 -- 172.21.15.114:0/4090800818 >> 172.21.15.114:0/4090800818 conn(0x7fa6b0076400 msgr2=0x7fa6b0103790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:29.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.371+0000 7fa6b6233700 1 -- 172.21.15.114:0/4090800818 shutdown_connections 2023-10-18T14:02:29.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.371+0000 7fa6b6233700 1 -- 172.21.15.114:0/4090800818 wait complete. 2023-10-18T14:02:29.388 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T13:58:43.813590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T14:02:29.389 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T14:02:29.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.516+0000 7fcf14bc8700 1 -- 172.21.15.114:0/926242459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf10103df0 msgr2=0x7fcf101041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.516+0000 7fcf14bc8700 1 --2- 172.21.15.114:0/926242459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf10103df0 0x7fcf101041d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800b0d0 tx=0x7fcf0800b3e0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.516+0000 7fcf14bc8700 1 -- 172.21.15.114:0/926242459 shutdown_connections 2023-10-18T14:02:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.516+0000 7fcf14bc8700 1 --2- 172.21.15.114:0/926242459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf100ffa70 0x7fcf1010bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.516+0000 7fcf14bc8700 1 --2- 172.21.15.114:0/926242459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf10103df0 0x7fcf101041d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.516+0000 7fcf14bc8700 1 --2- 172.21.15.114:0/926242459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf100ff0b0 0x7fcf100ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.516+0000 7fcf14bc8700 1 -- 172.21.15.114:0/926242459 >> 172.21.15.114:0/926242459 conn(0x7fcf10074940 msgr2=0x7fcf10074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.516+0000 7fcf14bc8700 1 -- 172.21.15.114:0/926242459 shutdown_connections 2023-10-18T14:02:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.516+0000 7fcf14bc8700 1 -- 172.21.15.114:0/926242459 wait complete. 2023-10-18T14:02:29.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.517+0000 7fcf14bc8700 1 Processor -- start 2023-10-18T14:02:29.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.517+0000 7fcf14bc8700 1 -- start start 2023-10-18T14:02:29.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.517+0000 7fcf14bc8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf100ff0b0 0x7fcf1019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.517+0000 7fcf14bc8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf100ffa70 0x7fcf1019cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.517+0000 7fcf14bc8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf10103df0 0x7fcf10196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.517+0000 7fcf14bc8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10197230 con 0x7fcf10103df0 2023-10-18T14:02:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.517+0000 7fcf14bc8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf101973a0 con 0x7fcf100ffa70 2023-10-18T14:02:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.517+0000 7fcf14bc8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10197560 con 0x7fcf100ff0b0 2023-10-18T14:02:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.517+0000 7fcf0ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf10103df0 0x7fcf10196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.517+0000 7fcf0ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf10103df0 0x7fcf10196bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42296/0 (socket says 172.21.15.114:42296) 2023-10-18T14:02:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.517+0000 7fcf0ed9d700 1 -- 172.21.15.114:0/278706702 learned_addr learned my addr 172.21.15.114:0/278706702 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.517+0000 7fcf0e59c700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf100ff0b0 0x7fcf1019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.517+0000 7fcf0dd9b700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf100ffa70 0x7fcf1019cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.518+0000 7fcf0ed9d700 1 -- 172.21.15.114:0/278706702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf100ff0b0 msgr2=0x7fcf1019ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.518+0000 7fcf0ed9d700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf100ff0b0 0x7fcf1019ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.518+0000 7fcf0ed9d700 1 -- 172.21.15.114:0/278706702 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf100ffa70 msgr2=0x7fcf1019cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.518+0000 7fcf0ed9d700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf100ffa70 0x7fcf1019cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.518+0000 7fcf0ed9d700 1 -- 172.21.15.114:0/278706702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf08009d00 con 0x7fcf10103df0 2023-10-18T14:02:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.518+0000 7fcf0e59c700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf100ff0b0 0x7fcf1019ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:02:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.518+0000 7fcf0ed9d700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf10103df0 0x7fcf10196bd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000c900 tx=0x7fcf0000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.518+0000 7fceff7fe700 1 -- 172.21.15.114:0/278706702 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00007b00 con 0x7fcf10103df0 2023-10-18T14:02:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.518+0000 7fcf14bc8700 1 -- 172.21.15.114:0/278706702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf10197840 con 0x7fcf10103df0 2023-10-18T14:02:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.518+0000 7fceff7fe700 1 -- 172.21.15.114:0/278706702 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf00007c60 con 0x7fcf10103df0 2023-10-18T14:02:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.518+0000 7fceff7fe700 1 -- 172.21.15.114:0/278706702 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00018660 con 0x7fcf10103df0 2023-10-18T14:02:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.518+0000 7fcf14bc8700 1 -- 172.21.15.114:0/278706702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf101a3a40 con 0x7fcf10103df0 2023-10-18T14:02:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.519+0000 7fcf14bc8700 1 -- 172.21.15.114:0/278706702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf10108af0 con 0x7fcf10103df0 2023-10-18T14:02:29.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.520+0000 7fceff7fe700 1 -- 172.21.15.114:0/278706702 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fcf0000f450 con 0x7fcf10103df0 2023-10-18T14:02:29.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.520+0000 7fceff7fe700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fcef80a14d0 0x7fcef80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:29.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.520+0000 7fcf0e59c700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fcef80a14d0 0x7fcef80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:29.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.521+0000 7fceff7fe700 1 -- 172.21.15.114:0/278706702 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fcf000cc950 con 0x7fcf10103df0 2023-10-18T14:02:29.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.521+0000 7fcf0e59c700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fcef80a14d0 0x7fcef80a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800d010 tx=0x7fcf0800b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:29.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.525+0000 7fceff7fe700 1 -- 172.21.15.114:0/278706702 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcf00096380 con 0x7fcf10103df0 2023-10-18T14:02:29.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.726+0000 7fcf14bc8700 1 -- 172.21.15.114:0/278706702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf10197fd0 con 0x7fcf10103df0 2023-10-18T14:02:29.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.726+0000 7fceff7fe700 1 -- 172.21.15.114:0/278706702 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf000999a0 con 0x7fcf10103df0 2023-10-18T14:02:29.731 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T14:02:29.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.729+0000 7fcf14bc8700 1 -- 172.21.15.114:0/278706702 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fcef80a14d0 msgr2=0x7fcef80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.729+0000 7fcf14bc8700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fcef80a14d0 0x7fcef80a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800d010 tx=0x7fcf0800b040 comp rx=0 tx=0).stop 2023-10-18T14:02:29.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.729+0000 7fcf14bc8700 1 -- 172.21.15.114:0/278706702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf10103df0 msgr2=0x7fcf10196bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.729+0000 7fcf14bc8700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf10103df0 0x7fcf10196bd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000c900 tx=0x7fcf0000ccc0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.729+0000 7fcf14bc8700 1 -- 172.21.15.114:0/278706702 shutdown_connections 2023-10-18T14:02:29.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.729+0000 7fcf14bc8700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fcef80a14d0 0x7fcef80a3990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.729+0000 7fcf14bc8700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf10103df0 0x7fcf10196bd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.729+0000 7fcf14bc8700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf100ff0b0 0x7fcf1019ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.729+0000 7fcf14bc8700 1 --2- 172.21.15.114:0/278706702 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcf100ffa70 0x7fcf1019cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.729+0000 7fcf14bc8700 1 -- 172.21.15.114:0/278706702 >> 172.21.15.114:0/278706702 conn(0x7fcf10074940 msgr2=0x7fcf10105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:29.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.729+0000 7fcf14bc8700 1 -- 172.21.15.114:0/278706702 shutdown_connections 2023-10-18T14:02:29.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.729+0000 7fcf14bc8700 1 -- 172.21.15.114:0/278706702 wait complete. 2023-10-18T14:02:29.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-18T14:02:29.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.868+0000 7f45bb198700 1 -- 172.21.15.114:0/3774199809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b4068cf0 msgr2=0x7f45b40690d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.868+0000 7f45bb198700 1 --2- 172.21.15.114:0/3774199809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b4068cf0 0x7f45b40690d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009990 tx=0x7f45a8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.868+0000 7f45bb198700 1 -- 172.21.15.114:0/3774199809 shutdown_connections 2023-10-18T14:02:29.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.868+0000 7f45bb198700 1 --2- 172.21.15.114:0/3774199809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45b410d140 0x7f45b410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.868+0000 7f45bb198700 1 --2- 172.21.15.114:0/3774199809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b4068cf0 0x7f45b40690d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.868+0000 7f45bb198700 1 --2- 172.21.15.114:0/3774199809 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45b4069610 0x7f45b410cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.868+0000 7f45bb198700 1 -- 172.21.15.114:0/3774199809 >> 172.21.15.114:0/3774199809 conn(0x7f45b4076710 msgr2=0x7f45b4076b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:29.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.868+0000 7f45bb198700 1 -- 172.21.15.114:0/3774199809 shutdown_connections 2023-10-18T14:02:29.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.868+0000 7f45bb198700 1 -- 172.21.15.114:0/3774199809 wait complete. 2023-10-18T14:02:29.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.869+0000 7f45bb198700 1 Processor -- start 2023-10-18T14:02:29.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.869+0000 7f45bb198700 1 -- start start 2023-10-18T14:02:29.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.869+0000 7f45bb198700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b4068cf0 0x7f45b419ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:29.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.869+0000 7f45bb198700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45b4069610 0x7f45b419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:29.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.869+0000 7f45bb198700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45b410d140 0x7f45b4198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:29.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.869+0000 7f45bb198700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b41991f0 con 0x7f45b4068cf0 2023-10-18T14:02:29.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.869+0000 7f45bb198700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4199360 con 0x7f45b410d140 2023-10-18T14:02:29.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.869+0000 7f45bb198700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4199520 con 0x7f45b4069610 2023-10-18T14:02:29.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.869+0000 7f45b8f34700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b4068cf0 0x7f45b419ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:29.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.869+0000 7f45b8f34700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b4068cf0 0x7f45b419ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42308/0 (socket says 172.21.15.114:42308) 2023-10-18T14:02:29.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.869+0000 7f45b8f34700 1 -- 172.21.15.114:0/1324851929 learned_addr learned my addr 172.21.15.114:0/1324851929 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:29.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.869+0000 7f45b3fff700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45b4069610 0x7f45b419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:29.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.869+0000 7f45b9735700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45b410d140 0x7f45b4198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:29.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.870+0000 7f45b8f34700 1 -- 172.21.15.114:0/1324851929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45b4069610 msgr2=0x7f45b419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.870+0000 7f45b8f34700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45b4069610 0x7f45b419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.870+0000 7f45b8f34700 1 -- 172.21.15.114:0/1324851929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45b410d140 msgr2=0x7f45b4198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:29.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.870+0000 7f45b8f34700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45b410d140 0x7f45b4198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:29.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.870+0000 7f45b8f34700 1 -- 172.21.15.114:0/1324851929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a80095f0 con 0x7f45b4068cf0 2023-10-18T14:02:29.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.870+0000 7f45b8f34700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b4068cf0 0x7f45b419ea60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f45a8005910 tx=0x7f45a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:29.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.870+0000 7f45b1ffb700 1 -- 172.21.15.114:0/1324851929 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a801d070 con 0x7f45b4068cf0 2023-10-18T14:02:29.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.870+0000 7f45b1ffb700 1 -- 172.21.15.114:0/1324851929 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45a8022470 con 0x7f45b4068cf0 2023-10-18T14:02:29.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.870+0000 7f45bb198700 1 -- 172.21.15.114:0/1324851929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b41997a0 con 0x7f45b4068cf0 2023-10-18T14:02:29.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.870+0000 7f45b1ffb700 1 -- 172.21.15.114:0/1324851929 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a8017650 con 0x7f45b4068cf0 2023-10-18T14:02:29.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.870+0000 7f45bb198700 1 -- 172.21.15.114:0/1324851929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b41a5a50 con 0x7f45b4068cf0 2023-10-18T14:02:29.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.871+0000 7f45bb198700 1 -- 172.21.15.114:0/1324851929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b4108360 con 0x7f45b4068cf0 2023-10-18T14:02:29.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.873+0000 7f45b1ffb700 1 -- 172.21.15.114:0/1324851929 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f45a80225e0 con 0x7f45b4068cf0 2023-10-18T14:02:29.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.874+0000 7f45b1ffb700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f45a40a14d0 0x7f45a40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:29.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.874+0000 7f45b3fff700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f45a40a14d0 0x7f45a40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:29.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.874+0000 7f45b1ffb700 1 -- 172.21.15.114:0/1324851929 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f45a80cdcb0 con 0x7f45b4068cf0 2023-10-18T14:02:29.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.874+0000 7f45b3fff700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f45a40a14d0 0x7f45a40a3990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f45b419a230 tx=0x7f45a0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:29.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:29.878+0000 7f45b1ffb700 1 -- 172.21.15.114:0/1324851929 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f45a8097770 con 0x7f45b4068cf0 2023-10-18T14:02:30.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:29 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1742183337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:30.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:29 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/4090800818' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:30.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:29 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/278706702' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:02:30.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.086+0000 7f45bb198700 1 -- 172.21.15.114:0/1324851929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f45b40ffbe0 con 0x7f45b4068cf0 2023-10-18T14:02:30.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.086+0000 7f45b1ffb700 1 -- 172.21.15.114:0/1324851929 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+65 (secure 0 0 0) 0x7f45a809ad90 con 0x7f45b4068cf0 2023-10-18T14:02:30.090 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:30.090 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2023-10-18T14:02:30.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:02:30.091 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2023-10-18T14:02:30.091 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2023-10-18T14:02:30.091 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:02:30.091 INFO:teuthology.orchestra.run.smithi114.stdout:] 2023-10-18T14:02:30.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.088+0000 7f45bb198700 1 -- 172.21.15.114:0/1324851929 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f45a40a14d0 msgr2=0x7f45a40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:30.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.088+0000 7f45bb198700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f45a40a14d0 0x7f45a40a3990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f45b419a230 tx=0x7f45a0009260 comp rx=0 tx=0).stop 2023-10-18T14:02:30.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.088+0000 7f45bb198700 1 -- 172.21.15.114:0/1324851929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b4068cf0 msgr2=0x7f45b419ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:30.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.088+0000 7f45bb198700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b4068cf0 0x7f45b419ea60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f45a8005910 tx=0x7f45a8004730 comp rx=0 tx=0).stop 2023-10-18T14:02:30.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.088+0000 7f45bb198700 1 -- 172.21.15.114:0/1324851929 shutdown_connections 2023-10-18T14:02:30.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.088+0000 7f45bb198700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f45a40a14d0 0x7f45a40a3990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.088+0000 7f45bb198700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f45b410d140 0x7f45b4198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.088+0000 7f45bb198700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b4068cf0 0x7f45b419ea60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.088+0000 7f45bb198700 1 --2- 172.21.15.114:0/1324851929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45b4069610 0x7f45b419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.088+0000 7f45bb198700 1 -- 172.21.15.114:0/1324851929 >> 172.21.15.114:0/1324851929 conn(0x7f45b4076710 msgr2=0x7f45b410e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:30.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.088+0000 7f45bb198700 1 -- 172.21.15.114:0/1324851929 shutdown_connections 2023-10-18T14:02:30.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.088+0000 7f45bb198700 1 -- 172.21.15.114:0/1324851929 wait complete. 2023-10-18T14:02:30.104 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-18T14:02:30.105 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-18T14:02:30.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.235+0000 7f263241d700 1 -- 172.21.15.114:0/2348061466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f262c104e60 msgr2=0x7f262c105240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:30.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.235+0000 7f263241d700 1 --2- 172.21.15.114:0/2348061466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f262c104e60 0x7f262c105240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f261c0099c0 tx=0x7f261c009cd0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.235+0000 7f263241d700 1 -- 172.21.15.114:0/2348061466 shutdown_connections 2023-10-18T14:02:30.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.235+0000 7f263241d700 1 --2- 172.21.15.114:0/2348061466 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f262c0ffa50 0x7f262c10bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.235+0000 7f263241d700 1 --2- 172.21.15.114:0/2348061466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f262c104e60 0x7f262c105240 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.235+0000 7f263241d700 1 --2- 172.21.15.114:0/2348061466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f262c0ff090 0x7f262c0ff510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.235+0000 7f263241d700 1 -- 172.21.15.114:0/2348061466 >> 172.21.15.114:0/2348061466 conn(0x7f262c0749e0 msgr2=0x7f262c074df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:30.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.235+0000 7f263241d700 1 -- 172.21.15.114:0/2348061466 shutdown_connections 2023-10-18T14:02:30.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.235+0000 7f263241d700 1 -- 172.21.15.114:0/2348061466 wait complete. 2023-10-18T14:02:30.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.235+0000 7f263241d700 1 Processor -- start 2023-10-18T14:02:30.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.235+0000 7f263241d700 1 -- start start 2023-10-18T14:02:30.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f263241d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f262c0ff090 0x7f262c19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:30.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f263241d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f262c0ffa50 0x7f262c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:30.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f263241d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f262c104e60 0x7f262c196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:30.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f263241d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c197060 con 0x7f262c0ff090 2023-10-18T14:02:30.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f263241d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c1971d0 con 0x7f262c0ffa50 2023-10-18T14:02:30.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f263241d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c197390 con 0x7f262c104e60 2023-10-18T14:02:30.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f262bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f262c0ff090 0x7f262c19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:30.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f262bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f262c0ff090 0x7f262c19c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42320/0 (socket says 172.21.15.114:42320) 2023-10-18T14:02:30.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f262bfff700 1 -- 172.21.15.114:0/2232226389 learned_addr learned my addr 172.21.15.114:0/2232226389 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:30.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f26309ba700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f262c104e60 0x7f262c196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:30.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f2623fff700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f262c0ffa50 0x7f262c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:30.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f262bfff700 1 -- 172.21.15.114:0/2232226389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f262c104e60 msgr2=0x7f262c196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:30.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f262bfff700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f262c104e60 0x7f262c196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f262bfff700 1 -- 172.21.15.114:0/2232226389 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f262c0ffa50 msgr2=0x7f262c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f262bfff700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f262c0ffa50 0x7f262c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f262bfff700 1 -- 172.21.15.114:0/2232226389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0095f0 con 0x7f262c0ff090 2023-10-18T14:02:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f262bfff700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f262c0ff090 0x7f262c19c8d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c010 tx=0x7f261c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f2629ffb700 1 -- 172.21.15.114:0/2232226389 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c01c070 con 0x7f262c0ff090 2023-10-18T14:02:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f2629ffb700 1 -- 172.21.15.114:0/2232226389 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f261c00fe60 con 0x7f262c0ff090 2023-10-18T14:02:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f263241d700 1 -- 172.21.15.114:0/2232226389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262c197610 con 0x7f262c0ff090 2023-10-18T14:02:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f2629ffb700 1 -- 172.21.15.114:0/2232226389 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c022d80 con 0x7f262c0ff090 2023-10-18T14:02:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.236+0000 7f263241d700 1 -- 172.21.15.114:0/2232226389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c1a38c0 con 0x7f262c0ff090 2023-10-18T14:02:30.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.237+0000 7f263241d700 1 -- 172.21.15.114:0/2232226389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c109250 con 0x7f262c0ff090 2023-10-18T14:02:30.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.238+0000 7f2629ffb700 1 -- 172.21.15.114:0/2232226389 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f261c020070 con 0x7f262c0ff090 2023-10-18T14:02:30.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.239+0000 7f2629ffb700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f26180a14d0 0x7f26180a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:30.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.239+0000 7f2623fff700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f26180a14d0 0x7f26180a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:30.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.239+0000 7f2629ffb700 1 -- 172.21.15.114:0/2232226389 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f261c0cda00 con 0x7f262c0ff090 2023-10-18T14:02:30.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.239+0000 7f2623fff700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f26180a14d0 0x7f26180a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f262c197bc0 tx=0x7f261400a370 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:30.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.243+0000 7f2629ffb700 1 -- 172.21.15.114:0/2232226389 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f261c097540 con 0x7f262c0ff090 2023-10-18T14:02:30.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:29 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1742183337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:30.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:29 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/4090800818' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:30.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:29 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/278706702' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:02:30.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:29 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1742183337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:30.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:29 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/4090800818' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:30.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:29 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/278706702' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:02:30.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.444+0000 7f263241d700 1 -- 172.21.15.114:0/2232226389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f262c197ec0 con 0x7f262c0ff090 2023-10-18T14:02:30.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.824+0000 7f2629ffb700 1 -- 172.21.15.114:0/2232226389 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7f261c09ab60 con 0x7f262c0ff090 2023-10-18T14:02:30.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.826+0000 7f263241d700 1 -- 172.21.15.114:0/2232226389 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f26180a14d0 msgr2=0x7f26180a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:30.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.826+0000 7f263241d700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f26180a14d0 0x7f26180a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f262c197bc0 tx=0x7f261400a370 comp rx=0 tx=0).stop 2023-10-18T14:02:30.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.826+0000 7f263241d700 1 -- 172.21.15.114:0/2232226389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f262c0ff090 msgr2=0x7f262c19c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:30.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.826+0000 7f263241d700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f262c0ff090 0x7f262c19c8d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c010 tx=0x7f261c00f690 comp rx=0 tx=0).stop 2023-10-18T14:02:30.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.827+0000 7f263241d700 1 -- 172.21.15.114:0/2232226389 shutdown_connections 2023-10-18T14:02:30.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.827+0000 7f263241d700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f26180a14d0 0x7f26180a3990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.827+0000 7f263241d700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f262c104e60 0x7f262c196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.827+0000 7f263241d700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f262c0ff090 0x7f262c19c8d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.827+0000 7f263241d700 1 --2- 172.21.15.114:0/2232226389 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f262c0ffa50 0x7f262c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.827+0000 7f263241d700 1 -- 172.21.15.114:0/2232226389 >> 172.21.15.114:0/2232226389 conn(0x7f262c0749e0 msgr2=0x7f262c104210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:30.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.827+0000 7f263241d700 1 -- 172.21.15.114:0/2232226389 shutdown_connections 2023-10-18T14:02:30.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.827+0000 7f263241d700 1 -- 172.21.15.114:0/2232226389 wait complete. 2023-10-18T14:02:30.833 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2023-10-18T14:02:30.848 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-18T14:02:30.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.976+0000 7fc364dba700 1 -- 172.21.15.114:0/3427932413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc360100a40 msgr2=0x7fc36010cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:30.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.976+0000 7fc364dba700 1 --2- 172.21.15.114:0/3427932413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc360100a40 0x7fc36010cc50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc354009990 tx=0x7fc354009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.976+0000 7fc364dba700 1 -- 172.21.15.114:0/3427932413 shutdown_connections 2023-10-18T14:02:30.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.976+0000 7fc364dba700 1 --2- 172.21.15.114:0/3427932413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc36010d190 0x7fc36010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.976+0000 7fc364dba700 1 --2- 172.21.15.114:0/3427932413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc360100120 0x7fc360100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.976+0000 7fc364dba700 1 --2- 172.21.15.114:0/3427932413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc360100a40 0x7fc36010cc50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.976+0000 7fc364dba700 1 -- 172.21.15.114:0/3427932413 >> 172.21.15.114:0/3427932413 conn(0x7fc3600767f0 msgr2=0x7fc360076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.976+0000 7fc364dba700 1 -- 172.21.15.114:0/3427932413 shutdown_connections 2023-10-18T14:02:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.976+0000 7fc364dba700 1 -- 172.21.15.114:0/3427932413 wait complete. 2023-10-18T14:02:30.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc364dba700 1 Processor -- start 2023-10-18T14:02:30.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc364dba700 1 -- start start 2023-10-18T14:02:30.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc364dba700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc360100120 0x7fc360198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:30.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc364dba700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc360100a40 0x7fc360199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:30.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc364dba700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc36010d190 0x7fc36019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:30.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc364dba700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36019dd10 con 0x7fc360100a40 2023-10-18T14:02:30.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc364dba700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36019de80 con 0x7fc36010d190 2023-10-18T14:02:30.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc364dba700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36019e040 con 0x7fc360100120 2023-10-18T14:02:30.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc35dd9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc360100a40 0x7fc360199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:30.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc35dd9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc360100a40 0x7fc360199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42334/0 (socket says 172.21.15.114:42334) 2023-10-18T14:02:30.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc35dd9b700 1 -- 172.21.15.114:0/3689661560 learned_addr learned my addr 172.21.15.114:0/3689661560 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:30.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc35ed9d700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc36010d190 0x7fc36019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:30.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc35e59c700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc360100120 0x7fc360198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:30.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc35dd9b700 1 -- 172.21.15.114:0/3689661560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc360100120 msgr2=0x7fc360198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:30.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc35dd9b700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc360100120 0x7fc360198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc35dd9b700 1 -- 172.21.15.114:0/3689661560 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc36010d190 msgr2=0x7fc36019d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc35dd9b700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc36010d190 0x7fc36019d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.977+0000 7fc35dd9b700 1 -- 172.21.15.114:0/3689661560 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3540095f0 con 0x7fc360100a40 2023-10-18T14:02:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.978+0000 7fc35dd9b700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc360100a40 0x7fc360199330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc354000c00 tx=0x7fc354004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.978+0000 7fc34f7fe700 1 -- 172.21.15.114:0/3689661560 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35401d070 con 0x7fc360100a40 2023-10-18T14:02:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.978+0000 7fc34f7fe700 1 -- 172.21.15.114:0/3689661560 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc354022470 con 0x7fc360100a40 2023-10-18T14:02:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.978+0000 7fc34f7fe700 1 -- 172.21.15.114:0/3689661560 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354017650 con 0x7fc360100a40 2023-10-18T14:02:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.978+0000 7fc364dba700 1 -- 172.21.15.114:0/3689661560 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36019e2c0 con 0x7fc360100a40 2023-10-18T14:02:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.978+0000 7fc364dba700 1 -- 172.21.15.114:0/3689661560 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36019e540 con 0x7fc360100a40 2023-10-18T14:02:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.979+0000 7fc364dba700 1 -- 172.21.15.114:0/3689661560 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3601083b0 con 0x7fc360100a40 2023-10-18T14:02:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.980+0000 7fc34f7fe700 1 -- 172.21.15.114:0/3689661560 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fc3540225e0 con 0x7fc360100a40 2023-10-18T14:02:30.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.980+0000 7fc34f7fe700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc3480a14d0 0x7fc3480a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:30.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.981+0000 7fc34f7fe700 1 -- 172.21.15.114:0/3689661560 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7712+0+0 (secure 0 0 0) 0x7fc3540ce150 con 0x7fc360100a40 2023-10-18T14:02:30.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.981+0000 7fc35e59c700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc3480a14d0 0x7fc3480a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:30.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.981+0000 7fc35e59c700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc3480a14d0 0x7fc3480a3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc350009c60 tx=0x7fc350009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:30.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:30.984+0000 7fc34f7fe700 1 -- 172.21.15.114:0/3689661560 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc354097aa0 con 0x7fc360100a40 2023-10-18T14:02:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:30 smithi114 ceph-mon[99494]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:30 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1324851929' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-18T14:02:31.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:30 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2232226389' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-18T14:02:31.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:30 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.184+0000 7fc364dba700 1 -- 172.21.15.114:0/3689661560 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc3600ffc30 con 0x7fc360100a40 2023-10-18T14:02:31.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:30 smithi158 ceph-mon[103317]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:31.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:30 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1324851929' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-18T14:02:31.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:30 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2232226389' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-18T14:02:31.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:30 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:30 smithi172 ceph-mon[103574]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:31.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:30 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1324851929' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-18T14:02:31.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:30 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2232226389' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-18T14:02:31.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:30 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:31.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.829+0000 7fc34f7fe700 1 -- 172.21.15.114:0/3689661560 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc35409b0c0 con 0x7fc360100a40 2023-10-18T14:02:31.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.834+0000 7fc364dba700 1 -- 172.21.15.114:0/3689661560 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc3480a14d0 msgr2=0x7fc3480a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:31.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.834+0000 7fc364dba700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc3480a14d0 0x7fc3480a3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc350009c60 tx=0x7fc350009260 comp rx=0 tx=0).stop 2023-10-18T14:02:31.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.834+0000 7fc364dba700 1 -- 172.21.15.114:0/3689661560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc360100a40 msgr2=0x7fc360199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:31.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.834+0000 7fc364dba700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc360100a40 0x7fc360199330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc354000c00 tx=0x7fc354004730 comp rx=0 tx=0).stop 2023-10-18T14:02:31.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.834+0000 7fc364dba700 1 -- 172.21.15.114:0/3689661560 shutdown_connections 2023-10-18T14:02:31.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.834+0000 7fc364dba700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc3480a14d0 0x7fc3480a3990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:31.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.834+0000 7fc364dba700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc36010d190 0x7fc36019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:31.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.834+0000 7fc364dba700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc360100120 0x7fc360198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:31.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.834+0000 7fc364dba700 1 --2- 172.21.15.114:0/3689661560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc360100a40 0x7fc360199330 secure :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc354000c00 tx=0x7fc354004730 comp rx=0 tx=0).stop 2023-10-18T14:02:31.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.834+0000 7fc364dba700 1 -- 172.21.15.114:0/3689661560 >> 172.21.15.114:0/3689661560 conn(0x7fc3600767f0 msgr2=0x7fc36010e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:31.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.839+0000 7fc364dba700 1 -- 172.21.15.114:0/3689661560 shutdown_connections 2023-10-18T14:02:31.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.844+0000 7fc364dba700 1 -- 172.21.15.114:0/3689661560 wait complete. 2023-10-18T14:02:31.853 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2023-10-18T14:02:31.864 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-18T14:02:31.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.989+0000 7ff58dc9d700 1 -- 172.21.15.114:0/3617065780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5881056e0 msgr2=0x7ff588105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:31.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.989+0000 7ff58dc9d700 1 --2- 172.21.15.114:0/3617065780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5881056e0 0x7ff588105ac0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff58000b0a0 tx=0x7ff58000b3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:31.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.989+0000 7ff58dc9d700 1 -- 172.21.15.114:0/3617065780 shutdown_connections 2023-10-18T14:02:31.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.989+0000 7ff58dc9d700 1 --2- 172.21.15.114:0/3617065780 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff588100000 0x7ff58810c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:31.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.989+0000 7ff58dc9d700 1 --2- 172.21.15.114:0/3617065780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5881056e0 0x7ff588105ac0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:31.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.989+0000 7ff58dc9d700 1 --2- 172.21.15.114:0/3617065780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5880ff640 0x7ff5880ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:31.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.989+0000 7ff58dc9d700 1 -- 172.21.15.114:0/3617065780 >> 172.21.15.114:0/3617065780 conn(0x7ff5880767f0 msgr2=0x7ff588076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:31.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.989+0000 7ff58dc9d700 1 -- 172.21.15.114:0/3617065780 shutdown_connections 2023-10-18T14:02:31.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.989+0000 7ff58dc9d700 1 -- 172.21.15.114:0/3617065780 wait complete. 2023-10-18T14:02:31.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.989+0000 7ff58dc9d700 1 Processor -- start 2023-10-18T14:02:31.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.989+0000 7ff58dc9d700 1 -- start start 2023-10-18T14:02:31.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff58dc9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5880ff640 0x7ff588196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:31.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff58dc9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff588100000 0x7ff588197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:31.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff58dc9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5881056e0 0x7ff58819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:31.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff58dc9d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58819ab60 con 0x7ff5881056e0 2023-10-18T14:02:31.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff58dc9d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58819acd0 con 0x7ff588100000 2023-10-18T14:02:31.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff58dc9d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58819ae90 con 0x7ff5880ff640 2023-10-18T14:02:31.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff587fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5881056e0 0x7ff58819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:31.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff586ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff588100000 0x7ff588197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:31.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff587fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5881056e0 0x7ff58819a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42354/0 (socket says 172.21.15.114:42354) 2023-10-18T14:02:31.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff587fff700 1 -- 172.21.15.114:0/1114661399 learned_addr learned my addr 172.21.15.114:0/1114661399 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:31.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff5877fe700 1 --2- 172.21.15.114:0/1114661399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5880ff640 0x7ff588196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:32.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff587fff700 1 -- 172.21.15.114:0/1114661399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5880ff640 msgr2=0x7ff588196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:32.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff587fff700 1 --2- 172.21.15.114:0/1114661399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5880ff640 0x7ff588196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:32.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff587fff700 1 -- 172.21.15.114:0/1114661399 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff588100000 msgr2=0x7ff588197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:32.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff587fff700 1 --2- 172.21.15.114:0/1114661399 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff588100000 0x7ff588197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:32.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff587fff700 1 -- 172.21.15.114:0/1114661399 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff580009d00 con 0x7ff5881056e0 2023-10-18T14:02:32.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff587fff700 1 --2- 172.21.15.114:0/1114661399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5881056e0 0x7ff58819a560 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff57800d6d0 tx=0x7ff57800d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:32.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff584ff9700 1 -- 172.21.15.114:0/1114661399 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578004a30 con 0x7ff5881056e0 2023-10-18T14:02:32.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff584ff9700 1 -- 172.21.15.114:0/1114661399 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5780054e0 con 0x7ff5881056e0 2023-10-18T14:02:32.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff584ff9700 1 -- 172.21.15.114:0/1114661399 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57800fbf0 con 0x7ff5881056e0 2023-10-18T14:02:32.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff58dc9d700 1 -- 172.21.15.114:0/1114661399 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58819b170 con 0x7ff5881056e0 2023-10-18T14:02:32.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.990+0000 7ff58dc9d700 1 -- 172.21.15.114:0/1114661399 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5881a3ad0 con 0x7ff5881056e0 2023-10-18T14:02:32.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.991+0000 7ff58dc9d700 1 -- 172.21.15.114:0/1114661399 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff588100d30 con 0x7ff5881056e0 2023-10-18T14:02:32.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.992+0000 7ff584ff9700 1 -- 172.21.15.114:0/1114661399 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7ff57800fd50 con 0x7ff5881056e0 2023-10-18T14:02:32.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.993+0000 7ff584ff9700 1 --2- 172.21.15.114:0/1114661399 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff5740a1550 0x7ff5740a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:32.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.993+0000 7ff5877fe700 1 --2- 172.21.15.114:0/1114661399 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff5740a1550 0x7ff5740a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:32.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.993+0000 7ff584ff9700 1 -- 172.21.15.114:0/1114661399 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8094+0+0 (secure 0 0 0) 0x7ff5780ccfc0 con 0x7ff5881056e0 2023-10-18T14:02:32.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.993+0000 7ff5877fe700 1 --2- 172.21.15.114:0/1114661399 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff5740a1550 0x7ff5740a3a10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff580009fd0 tx=0x7ff58000b7b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:32.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:31.997+0000 7ff584ff9700 1 -- 172.21.15.114:0/1114661399 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff578096700 con 0x7ff5881056e0 2023-10-18T14:02:32.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:31 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2232226389' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-18T14:02:32.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:31 smithi114 ceph-mon[99494]: osdmap e80: 12 total, 12 up, 12 in 2023-10-18T14:02:32.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:31 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3689661560' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-18T14:02:32.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:31 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:32.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:31 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:02:32.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:31 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:32.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:31 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:02:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.249+0000 7ff58dc9d700 1 -- 172.21.15.114:0/1114661399 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff5880675a0 con 0x7ff5881056e0 2023-10-18T14:02:32.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:31 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2232226389' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-18T14:02:32.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:31 smithi158 ceph-mon[103317]: osdmap e80: 12 total, 12 up, 12 in 2023-10-18T14:02:32.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:31 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3689661560' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-18T14:02:32.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:31 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:32.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:31 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:02:32.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:31 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:32.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:31 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:02:32.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:31 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2232226389' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-18T14:02:32.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:31 smithi172 ceph-mon[103574]: osdmap e80: 12 total, 12 up, 12 in 2023-10-18T14:02:32.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:31 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3689661560' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-18T14:02:32.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:31 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:32.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:31 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:02:32.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:31 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:32.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:31 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:02:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.840+0000 7ff584ff9700 1 -- 172.21.15.114:0/1114661399 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff578016020 con 0x7ff5881056e0 2023-10-18T14:02:32.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.844+0000 7ff58dc9d700 1 -- 172.21.15.114:0/1114661399 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff5740a1550 msgr2=0x7ff5740a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:32.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.844+0000 7ff58dc9d700 1 --2- 172.21.15.114:0/1114661399 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff5740a1550 0x7ff5740a3a10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff580009fd0 tx=0x7ff58000b7b0 comp rx=0 tx=0).stop 2023-10-18T14:02:32.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.844+0000 7ff58dc9d700 1 -- 172.21.15.114:0/1114661399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5881056e0 msgr2=0x7ff58819a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:32.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.844+0000 7ff58dc9d700 1 --2- 172.21.15.114:0/1114661399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5881056e0 0x7ff58819a560 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff57800d6d0 tx=0x7ff57800d9e0 comp rx=0 tx=0).stop 2023-10-18T14:02:32.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.844+0000 7ff58dc9d700 1 -- 172.21.15.114:0/1114661399 shutdown_connections 2023-10-18T14:02:32.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.844+0000 7ff58dc9d700 1 --2- 172.21.15.114:0/1114661399 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff5740a1550 0x7ff5740a3a10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:32.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.844+0000 7ff58dc9d700 1 --2- 172.21.15.114:0/1114661399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5881056e0 0x7ff58819a560 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:32.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.844+0000 7ff58dc9d700 1 --2- 172.21.15.114:0/1114661399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5880ff640 0x7ff588196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:32.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.844+0000 7ff58dc9d700 1 --2- 172.21.15.114:0/1114661399 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff588100000 0x7ff588197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:32.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.844+0000 7ff58dc9d700 1 -- 172.21.15.114:0/1114661399 >> 172.21.15.114:0/1114661399 conn(0x7ff5880767f0 msgr2=0x7ff5881039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:32.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.844+0000 7ff58dc9d700 1 -- 172.21.15.114:0/1114661399 shutdown_connections 2023-10-18T14:02:32.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.844+0000 7ff58dc9d700 1 -- 172.21.15.114:0/1114661399 wait complete. 2023-10-18T14:02:32.852 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 2 and data pool 3 2023-10-18T14:02:32.863 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:02:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.992+0000 7fc52c0f6700 1 -- 172.21.15.114:0/4184906487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5240ff8d0 msgr2=0x7fc5240ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.992+0000 7fc52c0f6700 1 --2- 172.21.15.114:0/4184906487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5240ff8d0 0x7fc5240ffd50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc514009990 tx=0x7fc514009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 -- 172.21.15.114:0/4184906487 shutdown_connections 2023-10-18T14:02:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 --2- 172.21.15.114:0/4184906487 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc524100290 0x7fc52410c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 --2- 172.21.15.114:0/4184906487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc524105710 0x7fc524105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 --2- 172.21.15.114:0/4184906487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5240ff8d0 0x7fc5240ffd50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 -- 172.21.15.114:0/4184906487 >> 172.21.15.114:0/4184906487 conn(0x7fc524076400 msgr2=0x7fc524076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:33.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 -- 172.21.15.114:0/4184906487 shutdown_connections 2023-10-18T14:02:33.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 -- 172.21.15.114:0/4184906487 wait complete. 2023-10-18T14:02:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 Processor -- start 2023-10-18T14:02:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 -- start start 2023-10-18T14:02:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5240ff8d0 0x7fc52419c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc524100290 0x7fc52419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc524105710 0x7fc524196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:33.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc524196f60 con 0x7fc5240ff8d0 2023-10-18T14:02:33.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5241970d0 con 0x7fc524100290 2023-10-18T14:02:33.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc52c0f6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc524197290 con 0x7fc524105710 2023-10-18T14:02:33.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.993+0000 7fc529e92700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5240ff8d0 0x7fc52419c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:33.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc529e92700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5240ff8d0 0x7fc52419c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42364/0 (socket says 172.21.15.114:42364) 2023-10-18T14:02:33.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc529e92700 1 -- 172.21.15.114:0/1764618481 learned_addr learned my addr 172.21.15.114:0/1764618481 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:33.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc52a693700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc524105710 0x7fc524196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:33.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc529691700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc524100290 0x7fc52419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:33.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc529e92700 1 -- 172.21.15.114:0/1764618481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc524105710 msgr2=0x7fc524196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:33.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc529e92700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc524105710 0x7fc524196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc529e92700 1 -- 172.21.15.114:0/1764618481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc524100290 msgr2=0x7fc52419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:33.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc529e92700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc524100290 0x7fc52419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc529e92700 1 -- 172.21.15.114:0/1764618481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5140095f0 con 0x7fc5240ff8d0 2023-10-18T14:02:33.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc529691700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc524100290 0x7fc52419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:02:33.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc529e92700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5240ff8d0 0x7fc52419c7d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc52000d950 tx=0x7fc52000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:33.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc51affd700 1 -- 172.21.15.114:0/1764618481 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520009940 con 0x7fc5240ff8d0 2023-10-18T14:02:33.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc51affd700 1 -- 172.21.15.114:0/1764618481 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc520010460 con 0x7fc5240ff8d0 2023-10-18T14:02:33.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc51affd700 1 -- 172.21.15.114:0/1764618481 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000f620 con 0x7fc5240ff8d0 2023-10-18T14:02:33.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc52c0f6700 1 -- 172.21.15.114:0/1764618481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc524197570 con 0x7fc5240ff8d0 2023-10-18T14:02:33.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.994+0000 7fc52c0f6700 1 -- 172.21.15.114:0/1764618481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5241a37c0 con 0x7fc5240ff8d0 2023-10-18T14:02:33.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.995+0000 7fc52c0f6700 1 -- 172.21.15.114:0/1764618481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc524100cc0 con 0x7fc5240ff8d0 2023-10-18T14:02:33.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.996+0000 7fc51affd700 1 -- 172.21.15.114:0/1764618481 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fc5200108d0 con 0x7fc5240ff8d0 2023-10-18T14:02:33.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.997+0000 7fc51affd700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc5100a1550 0x7fc5100a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:33.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.997+0000 7fc529691700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc5100a1550 0x7fc5100a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:33.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.997+0000 7fc51affd700 1 -- 172.21.15.114:0/1764618481 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fc5200ccb30 con 0x7fc5240ff8d0 2023-10-18T14:02:33.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:32.997+0000 7fc529691700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc5100a1550 0x7fc5100a3a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc514006010 tx=0x7fc51401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:33.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.000+0000 7fc51affd700 1 -- 172.21.15.114:0/1764618481 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc520096150 con 0x7fc5240ff8d0 2023-10-18T14:02:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:32 smithi114 ceph-mon[99494]: pgmap v230: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:32 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3689661560' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-18T14:02:33.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:32 smithi114 ceph-mon[99494]: osdmap e81: 12 total, 12 up, 12 in 2023-10-18T14:02:33.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:32 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1114661399' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-18T14:02:33.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:32 smithi114 ceph-mon[99494]: daemon mds.i assigned to filesystem cephfs as rank 0 2023-10-18T14:02:33.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:32 smithi114 ceph-mon[99494]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-18T14:02:33.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:32 smithi114 ceph-mon[99494]: osdmap e82: 12 total, 12 up, 12 in 2023-10-18T14:02:33.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:32 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:33.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.203+0000 7fc52c0f6700 1 -- 172.21.15.114:0/1764618481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc524067530 con 0x7fc5240ff8d0 2023-10-18T14:02:33.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.204+0000 7fc51affd700 1 -- 172.21.15.114:0/1764618481 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22533 (secure 0 0 0) 0x7fc520020090 con 0x7fc5240ff8d0 2023-10-18T14:02:33.208 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:33.209 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":82,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:02:32.251578+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:02:33.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.206+0000 7fc52c0f6700 1 -- 172.21.15.114:0/1764618481 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc5100a1550 msgr2=0x7fc5100a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:33.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.206+0000 7fc52c0f6700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc5100a1550 0x7fc5100a3a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc514006010 tx=0x7fc51401a040 comp rx=0 tx=0).stop 2023-10-18T14:02:33.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.206+0000 7fc52c0f6700 1 -- 172.21.15.114:0/1764618481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5240ff8d0 msgr2=0x7fc52419c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:33.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.206+0000 7fc52c0f6700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5240ff8d0 0x7fc52419c7d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc52000d950 tx=0x7fc52000dc60 comp rx=0 tx=0).stop 2023-10-18T14:02:33.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.206+0000 7fc52c0f6700 1 -- 172.21.15.114:0/1764618481 shutdown_connections 2023-10-18T14:02:33.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.206+0000 7fc52c0f6700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc5100a1550 0x7fc5100a3a10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.206+0000 7fc52c0f6700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc524105710 0x7fc524196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.206+0000 7fc52c0f6700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5240ff8d0 0x7fc52419c7d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.206+0000 7fc52c0f6700 1 --2- 172.21.15.114:0/1764618481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc524100290 0x7fc52419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.206+0000 7fc52c0f6700 1 -- 172.21.15.114:0/1764618481 >> 172.21.15.114:0/1764618481 conn(0x7fc524076400 msgr2=0x7fc524067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:33.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.207+0000 7fc52c0f6700 1 -- 172.21.15.114:0/1764618481 shutdown_connections 2023-10-18T14:02:33.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.207+0000 7fc52c0f6700 1 -- 172.21.15.114:0/1764618481 wait complete. 2023-10-18T14:02:33.225 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:02:33.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:32 smithi158 ceph-mon[103317]: pgmap v230: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:33.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:32 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3689661560' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-18T14:02:33.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:32 smithi158 ceph-mon[103317]: osdmap e81: 12 total, 12 up, 12 in 2023-10-18T14:02:33.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:32 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1114661399' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-18T14:02:33.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:32 smithi158 ceph-mon[103317]: daemon mds.i assigned to filesystem cephfs as rank 0 2023-10-18T14:02:33.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:32 smithi158 ceph-mon[103317]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-18T14:02:33.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:32 smithi158 ceph-mon[103317]: osdmap e82: 12 total, 12 up, 12 in 2023-10-18T14:02:33.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:32 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:33.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:32 smithi172 ceph-mon[103574]: pgmap v230: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-18T14:02:33.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:32 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3689661560' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-18T14:02:33.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:32 smithi172 ceph-mon[103574]: osdmap e81: 12 total, 12 up, 12 in 2023-10-18T14:02:33.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:32 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1114661399' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-18T14:02:33.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:32 smithi172 ceph-mon[103574]: daemon mds.i assigned to filesystem cephfs as rank 0 2023-10-18T14:02:33.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:32 smithi172 ceph-mon[103574]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-18T14:02:33.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:32 smithi172 ceph-mon[103574]: osdmap e82: 12 total, 12 up, 12 in 2023-10-18T14:02:33.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:32 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:33.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.348+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1097523498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a40ffa10 msgr2=0x7f60a410bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:33.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.348+0000 7f60a8b3d700 1 --2- 172.21.15.114:0/1097523498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a40ffa10 0x7f60a410bc20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f609c009fc0 tx=0x7f609c00b330 comp rx=0 tx=0).stop 2023-10-18T14:02:33.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.348+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1097523498 shutdown_connections 2023-10-18T14:02:33.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.348+0000 7f60a8b3d700 1 --2- 172.21.15.114:0/1097523498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a40ffa10 0x7f60a410bc20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.348+0000 7f60a8b3d700 1 --2- 172.21.15.114:0/1097523498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60a4103d90 0x7f60a4104170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.348+0000 7f60a8b3d700 1 --2- 172.21.15.114:0/1097523498 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60a40ff050 0x7f60a40ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.348+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1097523498 >> 172.21.15.114:0/1097523498 conn(0x7f60a40748e0 msgr2=0x7f60a4074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:33.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.348+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1097523498 shutdown_connections 2023-10-18T14:02:33.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.348+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1097523498 wait complete. 2023-10-18T14:02:33.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.349+0000 7f60a8b3d700 1 Processor -- start 2023-10-18T14:02:33.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.349+0000 7f60a8b3d700 1 -- start start 2023-10-18T14:02:33.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.349+0000 7f60a8b3d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a40ff050 0x7f60a419b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:33.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.349+0000 7f60a8b3d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60a40ffa10 0x7f60a419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:33.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.349+0000 7f60a8b3d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60a4103d90 0x7f60a4196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:33.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.349+0000 7f60a8b3d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a4197100 con 0x7f60a40ff050 2023-10-18T14:02:33.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.349+0000 7f60a8b3d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a4197270 con 0x7f60a4103d90 2023-10-18T14:02:33.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.349+0000 7f60a8b3d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a4197430 con 0x7f60a40ffa10 2023-10-18T14:02:33.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.349+0000 7f60a259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a40ff050 0x7f60a419b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:33.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.349+0000 7f60a259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a40ff050 0x7f60a419b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42378/0 (socket says 172.21.15.114:42378) 2023-10-18T14:02:33.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.349+0000 7f60a259c700 1 -- 172.21.15.114:0/1121978621 learned_addr learned my addr 172.21.15.114:0/1121978621 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:33.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.349+0000 7f60a2d9d700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60a4103d90 0x7f60a4196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:33.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.349+0000 7f60a1d9b700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60a40ffa10 0x7f60a419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:33.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.350+0000 7f60a259c700 1 -- 172.21.15.114:0/1121978621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60a40ffa10 msgr2=0x7f60a419bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:33.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.350+0000 7f60a259c700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60a40ffa10 0x7f60a419bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.350+0000 7f60a259c700 1 -- 172.21.15.114:0/1121978621 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60a4103d90 msgr2=0x7f60a4196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:33.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.350+0000 7f60a259c700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60a4103d90 0x7f60a4196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.350+0000 7f60a259c700 1 -- 172.21.15.114:0/1121978621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60980095f0 con 0x7f60a40ff050 2023-10-18T14:02:33.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.350+0000 7f60a259c700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a40ff050 0x7f60a419b790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f609400e970 tx=0x7f609400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:33.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.350+0000 7f60937fe700 1 -- 172.21.15.114:0/1121978621 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094009790 con 0x7f60a40ff050 2023-10-18T14:02:33.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.350+0000 7f60937fe700 1 -- 172.21.15.114:0/1121978621 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f609400c7e0 con 0x7f60a40ff050 2023-10-18T14:02:33.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.350+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1121978621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c009c40 con 0x7f60a40ff050 2023-10-18T14:02:33.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.350+0000 7f60937fe700 1 -- 172.21.15.114:0/1121978621 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094003c70 con 0x7f60a40ff050 2023-10-18T14:02:33.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.350+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1121978621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a41978b0 con 0x7f60a40ff050 2023-10-18T14:02:33.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.351+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1121978621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a41004c0 con 0x7f60a40ff050 2023-10-18T14:02:33.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.352+0000 7f60937fe700 1 -- 172.21.15.114:0/1121978621 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f609400cc50 con 0x7f60a40ff050 2023-10-18T14:02:33.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.353+0000 7f60937fe700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f608c0a14d0 0x7f608c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:33.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.353+0000 7f60a1d9b700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f608c0a14d0 0x7f608c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:33.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.353+0000 7f60937fe700 1 -- 172.21.15.114:0/1121978621 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f6094014070 con 0x7f60a40ff050 2023-10-18T14:02:33.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.353+0000 7f60a1d9b700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f608c0a14d0 0x7f608c0a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f60a40fed70 tx=0x7f6098009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:33.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.357+0000 7f60937fe700 1 -- 172.21.15.114:0/1121978621 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6094096700 con 0x7f60a40ff050 2023-10-18T14:02:33.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.566+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1121978621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60a4067980 con 0x7f60a40ff050 2023-10-18T14:02:33.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.567+0000 7f60937fe700 1 -- 172.21.15.114:0/1121978621 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22520 (secure 0 0 0) 0x7f6094003dd0 con 0x7f60a40ff050 2023-10-18T14:02:33.571 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:33.572 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":83,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:02:33.431521+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:02:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.569+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1121978621 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f608c0a14d0 msgr2=0x7f608c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.569+0000 7f60a8b3d700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f608c0a14d0 0x7f608c0a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f60a40fed70 tx=0x7f6098009310 comp rx=0 tx=0).stop 2023-10-18T14:02:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.569+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1121978621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a40ff050 msgr2=0x7f60a419b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.569+0000 7f60a8b3d700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a40ff050 0x7f60a419b790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f609400e970 tx=0x7f609400ec80 comp rx=0 tx=0).stop 2023-10-18T14:02:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.569+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1121978621 shutdown_connections 2023-10-18T14:02:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.569+0000 7f60a8b3d700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f608c0a14d0 0x7f608c0a3990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.569+0000 7f60a8b3d700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f60a4103d90 0x7f60a4196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.569+0000 7f60a8b3d700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60a40ff050 0x7f60a419b790 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.569+0000 7f60a8b3d700 1 --2- 172.21.15.114:0/1121978621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60a40ffa10 0x7f60a419bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.569+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1121978621 >> 172.21.15.114:0/1121978621 conn(0x7f60a40748e0 msgr2=0x7f60a41029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.569+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1121978621 shutdown_connections 2023-10-18T14:02:33.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.569+0000 7f60a8b3d700 1 -- 172.21.15.114:0/1121978621 wait complete. 2023-10-18T14:02:33.586 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-18T14:02:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.712+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/4179271490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca0068de0 msgr2=0x7f0ca0069260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.712+0000 7f0ca4bf8700 1 --2- 172.21.15.114:0/4179271490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca0068de0 0x7f0ca0069260 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009990 tx=0x7f0c94009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.712+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/4179271490 shutdown_connections 2023-10-18T14:02:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.712+0000 7f0ca4bf8700 1 --2- 172.21.15.114:0/4179271490 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ca00697a0 0x7f0ca010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.712+0000 7f0ca4bf8700 1 --2- 172.21.15.114:0/4179271490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca0106780 0x7f0ca0106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.712+0000 7f0ca4bf8700 1 --2- 172.21.15.114:0/4179271490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca0068de0 0x7f0ca0069260 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.712+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/4179271490 >> 172.21.15.114:0/4179271490 conn(0x7f0ca0076790 msgr2=0x7f0ca0076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:33.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.712+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/4179271490 shutdown_connections 2023-10-18T14:02:33.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.712+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/4179271490 wait complete. 2023-10-18T14:02:33.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.713+0000 7f0ca4bf8700 1 Processor -- start 2023-10-18T14:02:33.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.713+0000 7f0ca4bf8700 1 -- start start 2023-10-18T14:02:33.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.713+0000 7f0ca4bf8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ca0068de0 0x7f0ca019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:33.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.713+0000 7f0ca4bf8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca00697a0 0x7f0ca019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:33.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.713+0000 7f0ca4bf8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca0106780 0x7f0ca0196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:33.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.713+0000 7f0ca4bf8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01970a0 con 0x7f0ca00697a0 2023-10-18T14:02:33.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.713+0000 7f0ca4bf8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0197210 con 0x7f0ca0068de0 2023-10-18T14:02:33.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.713+0000 7f0ca4bf8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01973d0 con 0x7f0ca0106780 2023-10-18T14:02:33.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.713+0000 7f0c9dd9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca00697a0 0x7f0ca019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:33.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.713+0000 7f0c9dd9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca00697a0 0x7f0ca019ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42394/0 (socket says 172.21.15.114:42394) 2023-10-18T14:02:33.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.713+0000 7f0c9dd9b700 1 -- 172.21.15.114:0/3692695409 learned_addr learned my addr 172.21.15.114:0/3692695409 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:33.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.714+0000 7f0c9ed9d700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca0106780 0x7f0ca0196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:33.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.714+0000 7f0c9e59c700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ca0068de0 0x7f0ca019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:33.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.714+0000 7f0c9dd9b700 1 -- 172.21.15.114:0/3692695409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca0106780 msgr2=0x7f0ca0196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:33.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.714+0000 7f0c9dd9b700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca0106780 0x7f0ca0196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.714+0000 7f0c9dd9b700 1 -- 172.21.15.114:0/3692695409 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ca0068de0 msgr2=0x7f0ca019c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.714+0000 7f0c9dd9b700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ca0068de0 0x7f0ca019c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.714+0000 7f0c9dd9b700 1 -- 172.21.15.114:0/3692695409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c940095f0 con 0x7f0ca00697a0 2023-10-18T14:02:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.714+0000 7f0c9dd9b700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca00697a0 0x7f0ca019ce50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0c94000c00 tx=0x7f0c9400f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.714+0000 7f0c8f7fe700 1 -- 172.21.15.114:0/3692695409 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9401d070 con 0x7f0ca00697a0 2023-10-18T14:02:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.714+0000 7f0c8f7fe700 1 -- 172.21.15.114:0/3692695409 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c9400fde0 con 0x7f0ca00697a0 2023-10-18T14:02:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.714+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/3692695409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca0197650 con 0x7f0ca00697a0 2023-10-18T14:02:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.714+0000 7f0c8f7fe700 1 -- 172.21.15.114:0/3692695409 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94017770 con 0x7f0ca00697a0 2023-10-18T14:02:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.714+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/3692695409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca01a3900 con 0x7f0ca00697a0 2023-10-18T14:02:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.715+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/3692695409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca0108cb0 con 0x7f0ca00697a0 2023-10-18T14:02:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.716+0000 7f0c8f7fe700 1 -- 172.21.15.114:0/3692695409 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f0c94022aa0 con 0x7f0ca00697a0 2023-10-18T14:02:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.717+0000 7f0c8f7fe700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0c880a14d0 0x7f0c880a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.717+0000 7f0c9e59c700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0c880a14d0 0x7f0c880a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.717+0000 7f0c8f7fe700 1 -- 172.21.15.114:0/3692695409 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f0c940ce470 con 0x7f0ca00697a0 2023-10-18T14:02:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.717+0000 7f0c9e59c700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0c880a14d0 0x7f0c880a3990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0c98007dc0 tx=0x7f0c980072f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:33.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.720+0000 7f0c8f7fe700 1 -- 172.21.15.114:0/3692695409 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0c94097b20 con 0x7f0ca00697a0 2023-10-18T14:02:33.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:33.971+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/3692695409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0ca0197f00 con 0x7f0ca00697a0 2023-10-18T14:02:34.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:33 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1114661399' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-18T14:02:34.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:33 smithi158 ceph-mon[103317]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2023-10-18T14:02:34.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:33 smithi158 ceph-mon[103317]: daemon mds.i is now active in filesystem cephfs as rank 0 2023-10-18T14:02:34.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:33 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1764618481' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:34.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:33 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] up:active 2023-10-18T14:02:34.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:33 smithi158 ceph-mon[103317]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-18T14:02:34.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:33 smithi158 ceph-mon[103317]: osdmap e83: 12 total, 12 up, 12 in 2023-10-18T14:02:34.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:33 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1121978621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:34.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:33 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1114661399' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-18T14:02:34.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:33 smithi172 ceph-mon[103574]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2023-10-18T14:02:34.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:33 smithi172 ceph-mon[103574]: daemon mds.i is now active in filesystem cephfs as rank 0 2023-10-18T14:02:34.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:33 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1764618481' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:34.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:33 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] up:active 2023-10-18T14:02:34.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:33 smithi172 ceph-mon[103574]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-18T14:02:34.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:33 smithi172 ceph-mon[103574]: osdmap e83: 12 total, 12 up, 12 in 2023-10-18T14:02:34.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:33 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1121978621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:34.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:33 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1114661399' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-18T14:02:34.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:33 smithi114 ceph-mon[99494]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2023-10-18T14:02:34.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:33 smithi114 ceph-mon[99494]: daemon mds.i is now active in filesystem cephfs as rank 0 2023-10-18T14:02:34.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:33 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1764618481' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:34.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:33 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] up:active 2023-10-18T14:02:34.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:33 smithi114 ceph-mon[99494]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-18T14:02:34.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:33 smithi114 ceph-mon[99494]: osdmap e83: 12 total, 12 up, 12 in 2023-10-18T14:02:34.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:33 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1121978621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:34.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.851+0000 7f0c8f7fe700 1 -- 172.21.15.114:0/3692695409 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0c9409b140 con 0x7f0ca00697a0 2023-10-18T14:02:34.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.854+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/3692695409 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0c880a14d0 msgr2=0x7f0c880a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:34.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.854+0000 7f0ca4bf8700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0c880a14d0 0x7f0c880a3990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0c98007dc0 tx=0x7f0c980072f0 comp rx=0 tx=0).stop 2023-10-18T14:02:34.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.854+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/3692695409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca00697a0 msgr2=0x7f0ca019ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:34.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.854+0000 7f0ca4bf8700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca00697a0 0x7f0ca019ce50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0c94000c00 tx=0x7f0c9400f880 comp rx=0 tx=0).stop 2023-10-18T14:02:34.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.854+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/3692695409 shutdown_connections 2023-10-18T14:02:34.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.854+0000 7f0ca4bf8700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0c880a14d0 0x7f0c880a3990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:34.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.854+0000 7f0ca4bf8700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca0106780 0x7f0ca0196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:34.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.854+0000 7f0ca4bf8700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0ca0068de0 0x7f0ca019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:34.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.854+0000 7f0ca4bf8700 1 --2- 172.21.15.114:0/3692695409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca00697a0 0x7f0ca019ce50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:34.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.854+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/3692695409 >> 172.21.15.114:0/3692695409 conn(0x7f0ca0076790 msgr2=0x7f0ca00fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:34.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.854+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/3692695409 shutdown_connections 2023-10-18T14:02:34.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.854+0000 7f0ca4bf8700 1 -- 172.21.15.114:0/3692695409 wait complete. 2023-10-18T14:02:34.872 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2023-10-18T14:02:34.873 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-10-18T14:02:35.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.996+0000 7f4c08e20700 1 -- 172.21.15.114:0/3900096776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c040ff640 msgr2=0x7f4c040ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:35.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.996+0000 7f4c08e20700 1 --2- 172.21.15.114:0/3900096776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c040ff640 0x7f4c040ffac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009990 tx=0x7f4bf8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:35.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.996+0000 7f4c08e20700 1 -- 172.21.15.114:0/3900096776 shutdown_connections 2023-10-18T14:02:35.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.996+0000 7f4c08e20700 1 --2- 172.21.15.114:0/3900096776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c04100000 0x7f4c0410c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:35.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.996+0000 7f4c08e20700 1 --2- 172.21.15.114:0/3900096776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c041056e0 0x7f4c04105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:35.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.996+0000 7f4c08e20700 1 --2- 172.21.15.114:0/3900096776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c040ff640 0x7f4c040ffac0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:35.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.996+0000 7f4c08e20700 1 -- 172.21.15.114:0/3900096776 >> 172.21.15.114:0/3900096776 conn(0x7f4c040767f0 msgr2=0x7f4c04076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:35.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.996+0000 7f4c08e20700 1 -- 172.21.15.114:0/3900096776 shutdown_connections 2023-10-18T14:02:35.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.997+0000 7f4c08e20700 1 -- 172.21.15.114:0/3900096776 wait complete. 2023-10-18T14:02:35.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.997+0000 7f4c08e20700 1 Processor -- start 2023-10-18T14:02:35.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.997+0000 7f4c08e20700 1 -- start start 2023-10-18T14:02:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.997+0000 7f4c08e20700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c040ff640 0x7f4c0419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.997+0000 7f4c08e20700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c04100000 0x7f4c0419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.997+0000 7f4c08e20700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c041056e0 0x7f4c04195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.997+0000 7f4c08e20700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c04195f70 con 0x7f4c040ff640 2023-10-18T14:02:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.997+0000 7f4c08e20700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c041960e0 con 0x7f4c04100000 2023-10-18T14:02:35.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.997+0000 7f4c08e20700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c041962a0 con 0x7f4c041056e0 2023-10-18T14:02:35.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4c0259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c040ff640 0x7f4c0419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:35.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4c0259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c040ff640 0x7f4c0419b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42406/0 (socket says 172.21.15.114:42406) 2023-10-18T14:02:35.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4c0259c700 1 -- 172.21.15.114:0/1572072018 learned_addr learned my addr 172.21.15.114:0/1572072018 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:35.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4c01d9b700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c04100000 0x7f4c0419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:35.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4c02d9d700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c041056e0 0x7f4c04195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:35.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4c0259c700 1 -- 172.21.15.114:0/1572072018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c041056e0 msgr2=0x7f4c04195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:35.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4c0259c700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c041056e0 0x7f4c04195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:35.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4c0259c700 1 -- 172.21.15.114:0/1572072018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c04100000 msgr2=0x7f4c0419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:35.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4c0259c700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c04100000 0x7f4c0419bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:35.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4c0259c700 1 -- 172.21.15.114:0/1572072018 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80095f0 con 0x7f4c040ff640 2023-10-18T14:02:35.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4c0259c700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c040ff640 0x7f4c0419b7e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400d980 tx=0x7f4bf400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:35.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4bf37fe700 1 -- 172.21.15.114:0/1572072018 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4004a30 con 0x7f4c040ff640 2023-10-18T14:02:35.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4c08e20700 1 -- 172.21.15.114:0/1572072018 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c04196580 con 0x7f4c040ff640 2023-10-18T14:02:35.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4bf37fe700 1 -- 172.21.15.114:0/1572072018 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4bf40054e0 con 0x7f4c040ff640 2023-10-18T14:02:35.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4bf37fe700 1 -- 172.21.15.114:0/1572072018 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf400fbc0 con 0x7f4c040ff640 2023-10-18T14:02:35.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.998+0000 7f4c08e20700 1 -- 172.21.15.114:0/1572072018 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c041a27d0 con 0x7f4c040ff640 2023-10-18T14:02:35.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:34.999+0000 7f4c08e20700 1 -- 172.21.15.114:0/1572072018 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c04107b80 con 0x7f4c040ff640 2023-10-18T14:02:35.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.000+0000 7f4bf37fe700 1 -- 172.21.15.114:0/1572072018 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f4bf4004c20 con 0x7f4c040ff640 2023-10-18T14:02:35.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.001+0000 7f4bf37fe700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4bec0a14d0 0x7f4bec0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:35.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.001+0000 7f4c01d9b700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4bec0a14d0 0x7f4bec0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:35.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.001+0000 7f4bf37fe700 1 -- 172.21.15.114:0/1572072018 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f4bf40ccef0 con 0x7f4c040ff640 2023-10-18T14:02:35.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.001+0000 7f4c01d9b700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4bec0a14d0 0x7f4bec0a3990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800b5c0 tx=0x7f4bf8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:35.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.004+0000 7f4bf37fe700 1 -- 172.21.15.114:0/1572072018 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4bf4096510 con 0x7f4c040ff640 2023-10-18T14:02:35.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.239+0000 7f4c08e20700 1 -- 172.21.15.114:0/1572072018 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f4c04196dd0 con 0x7f4c040ff640 2023-10-18T14:02:35.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:34 smithi158 ceph-mon[103317]: pgmap v234: 97 pgs: 8 creating+peering, 58 active+clean, 31 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 5 op/s 2023-10-18T14:02:35.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:34 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3692695409' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-18T14:02:35.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:35.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:02:35.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:34 smithi158 ceph-mon[103317]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-18T14:02:35.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:34 smithi158 ceph-mon[103317]: Cluster is now healthy 2023-10-18T14:02:35.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:34 smithi172 ceph-mon[103574]: pgmap v234: 97 pgs: 8 creating+peering, 58 active+clean, 31 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 5 op/s 2023-10-18T14:02:35.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:34 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3692695409' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-18T14:02:35.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:35.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:02:35.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:34 smithi172 ceph-mon[103574]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-18T14:02:35.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:34 smithi172 ceph-mon[103574]: Cluster is now healthy 2023-10-18T14:02:35.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:34 smithi114 ceph-mon[99494]: pgmap v234: 97 pgs: 8 creating+peering, 58 active+clean, 31 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 5 op/s 2023-10-18T14:02:35.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:34 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3692695409' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-18T14:02:35.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:02:35.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:02:35.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:02:35.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:34 smithi114 ceph-mon[99494]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-18T14:02:35.341 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:34 smithi114 ceph-mon[99494]: Cluster is now healthy 2023-10-18T14:02:35.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.856+0000 7f4bf37fe700 1 -- 172.21.15.114:0/1572072018 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v17) v1 ==== 105+0+0 (secure 0 0 0) 0x7f4bf4017070 con 0x7f4c040ff640 2023-10-18T14:02:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.860+0000 7f4c08e20700 1 -- 172.21.15.114:0/1572072018 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4bec0a14d0 msgr2=0x7f4bec0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.860+0000 7f4c08e20700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4bec0a14d0 0x7f4bec0a3990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800b5c0 tx=0x7f4bf8005960 comp rx=0 tx=0).stop 2023-10-18T14:02:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.860+0000 7f4c08e20700 1 -- 172.21.15.114:0/1572072018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c040ff640 msgr2=0x7f4c0419b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.860+0000 7f4c08e20700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c040ff640 0x7f4c0419b7e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400d980 tx=0x7f4bf400dc90 comp rx=0 tx=0).stop 2023-10-18T14:02:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.860+0000 7f4c08e20700 1 -- 172.21.15.114:0/1572072018 shutdown_connections 2023-10-18T14:02:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.860+0000 7f4c08e20700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4bec0a14d0 0x7f4bec0a3990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.860+0000 7f4c08e20700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c041056e0 0x7f4c04195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.860+0000 7f4c08e20700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c040ff640 0x7f4c0419b7e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:35.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.860+0000 7f4c08e20700 1 --2- 172.21.15.114:0/1572072018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c04100000 0x7f4c0419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:35.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.860+0000 7f4c08e20700 1 -- 172.21.15.114:0/1572072018 >> 172.21.15.114:0/1572072018 conn(0x7f4c040767f0 msgr2=0x7f4c040fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:35.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.860+0000 7f4c08e20700 1 -- 172.21.15.114:0/1572072018 shutdown_connections 2023-10-18T14:02:35.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:35.860+0000 7f4c08e20700 1 -- 172.21.15.114:0/1572072018 wait complete. 2023-10-18T14:02:35.880 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-18T14:02:36.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.002+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/2619104350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec0101ba0 msgr2=0x7f8ec010c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:36.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.002+0000 7f8ec7ea6700 1 --2- 172.21.15.114:0/2619104350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec0101ba0 0x7f8ec010c5e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800b0a0 tx=0x7f8eb800b3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:36.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/2619104350 shutdown_connections 2023-10-18T14:02:36.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 --2- 172.21.15.114:0/2619104350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec0101ba0 0x7f8ec010c5e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:36.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 --2- 172.21.15.114:0/2619104350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ec00ff9d0 0x7f8ec00ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:36.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 --2- 172.21.15.114:0/2619104350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ec01011e0 0x7f8ec0101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:36.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/2619104350 >> 172.21.15.114:0/2619104350 conn(0x7f8ec00fb0a0 msgr2=0x7f8ec00fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:36.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/2619104350 shutdown_connections 2023-10-18T14:02:36.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/2619104350 wait complete. 2023-10-18T14:02:36.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 Processor -- start 2023-10-18T14:02:36.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 -- start start 2023-10-18T14:02:36.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec00ff9d0 0x7f8ec019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:36.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ec01011e0 0x7f8ec019c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:36.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ec0101ba0 0x7f8ec0195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:36.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0196330 con 0x7f8ec00ff9d0 2023-10-18T14:02:36.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec01964a0 con 0x7f8ec01011e0 2023-10-18T14:02:36.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.003+0000 7f8ec7ea6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0196660 con 0x7f8ec0101ba0 2023-10-18T14:02:36.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec5c42700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec00ff9d0 0x7f8ec019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:36.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec5c42700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec00ff9d0 0x7f8ec019bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42420/0 (socket says 172.21.15.114:42420) 2023-10-18T14:02:36.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec5c42700 1 -- 172.21.15.114:0/3966599279 learned_addr learned my addr 172.21.15.114:0/3966599279 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:36.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec6443700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ec0101ba0 0x7f8ec0195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:36.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec5441700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ec01011e0 0x7f8ec019c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:36.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec5c42700 1 -- 172.21.15.114:0/3966599279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ec0101ba0 msgr2=0x7f8ec0195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:36.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec5c42700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ec0101ba0 0x7f8ec0195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:36.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec5c42700 1 -- 172.21.15.114:0/3966599279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ec01011e0 msgr2=0x7f8ec019c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:36.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec5c42700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ec01011e0 0x7f8ec019c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:36.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec5c42700 1 -- 172.21.15.114:0/3966599279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8009d00 con 0x7f8ec00ff9d0 2023-10-18T14:02:36.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec6443700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ec0101ba0 0x7f8ec0195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:02:36.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec5c42700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec00ff9d0 0x7f8ec019bac0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00b530 tx=0x7f8ebc00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:36.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8eb6ffd700 1 -- 172.21.15.114:0/3966599279 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc011830 con 0x7f8ec00ff9d0 2023-10-18T14:02:36.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/3966599279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec0196940 con 0x7f8ec00ff9d0 2023-10-18T14:02:36.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8eb6ffd700 1 -- 172.21.15.114:0/3966599279 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ebc011e50 con 0x7f8ec00ff9d0 2023-10-18T14:02:36.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8eb6ffd700 1 -- 172.21.15.114:0/3966599279 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00f2e0 con 0x7f8ec00ff9d0 2023-10-18T14:02:36.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.004+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/3966599279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec01a2a40 con 0x7f8ec00ff9d0 2023-10-18T14:02:36.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.005+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/3966599279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec0107cc0 con 0x7f8ec00ff9d0 2023-10-18T14:02:36.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.006+0000 7f8eb6ffd700 1 -- 172.21.15.114:0/3966599279 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f8ebc010580 con 0x7f8ec00ff9d0 2023-10-18T14:02:36.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.007+0000 7f8eb6ffd700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8eac0a14d0 0x7f8eac0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:36.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.007+0000 7f8ec5441700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8eac0a14d0 0x7f8eac0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:36.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.007+0000 7f8eb6ffd700 1 -- 172.21.15.114:0/3966599279 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f8ebc0cc890 con 0x7f8ec00ff9d0 2023-10-18T14:02:36.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.007+0000 7f8ec5441700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8eac0a14d0 0x7f8eac0a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0006fd0 tx=0x7f8eb0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:36.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.011+0000 7f8eb6ffd700 1 -- 172.21.15.114:0/3966599279 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8ebc095f10 con 0x7f8ec00ff9d0 2023-10-18T14:02:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.248+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/3966599279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f8ec0100d50 con 0x7f8ec00ff9d0 2023-10-18T14:02:36.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:35 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3692695409' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-18T14:02:36.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:35 smithi158 ceph-mon[103317]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-18T14:02:36.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:35 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1572072018' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-18T14:02:36.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:35 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3692695409' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-18T14:02:36.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:35 smithi172 ceph-mon[103574]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-18T14:02:36.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:35 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1572072018' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-18T14:02:36.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:35 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3692695409' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-18T14:02:36.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:35 smithi114 ceph-mon[99494]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-18T14:02:36.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:35 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1572072018' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-18T14:02:36.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.863+0000 7f8eb6ffd700 1 -- 172.21.15.114:0/3966599279 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f8ebc0150c0 con 0x7f8ec00ff9d0 2023-10-18T14:02:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.866+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/3966599279 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8eac0a14d0 msgr2=0x7f8eac0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.866+0000 7f8ec7ea6700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8eac0a14d0 0x7f8eac0a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0006fd0 tx=0x7f8eb0008040 comp rx=0 tx=0).stop 2023-10-18T14:02:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.866+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/3966599279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec00ff9d0 msgr2=0x7f8ec019bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.866+0000 7f8ec7ea6700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec00ff9d0 0x7f8ec019bac0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00b530 tx=0x7f8ebc00b8f0 comp rx=0 tx=0).stop 2023-10-18T14:02:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.866+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/3966599279 shutdown_connections 2023-10-18T14:02:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.866+0000 7f8ec7ea6700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8eac0a14d0 0x7f8eac0a3990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.866+0000 7f8ec7ea6700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ec0101ba0 0x7f8ec0195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.866+0000 7f8ec7ea6700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec00ff9d0 0x7f8ec019bac0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.866+0000 7f8ec7ea6700 1 --2- 172.21.15.114:0/3966599279 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8ec01011e0 0x7f8ec019c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.866+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/3966599279 >> 172.21.15.114:0/3966599279 conn(0x7f8ec00fb0a0 msgr2=0x7f8ec00fb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.866+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/3966599279 shutdown_connections 2023-10-18T14:02:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:36.866+0000 7f8ec7ea6700 1 -- 172.21.15.114:0/3966599279 wait complete. 2023-10-18T14:02:36.886 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-18T14:02:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.008+0000 7f8240f90700 1 -- 172.21.15.114:0/3167819695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f823c0ff9d0 msgr2=0x7f823c0ffdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.008+0000 7f8240f90700 1 --2- 172.21.15.114:0/3167819695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f823c0ff9d0 0x7f823c0ffdb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8230009990 tx=0x7f8230009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.008+0000 7f8240f90700 1 -- 172.21.15.114:0/3167819695 shutdown_connections 2023-10-18T14:02:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.008+0000 7f8240f90700 1 --2- 172.21.15.114:0/3167819695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f823c101ba0 0x7f823c10c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.008+0000 7f8240f90700 1 --2- 172.21.15.114:0/3167819695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f823c0ff9d0 0x7f823c0ffdb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.008+0000 7f8240f90700 1 --2- 172.21.15.114:0/3167819695 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f823c1011e0 0x7f823c101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.008+0000 7f8240f90700 1 -- 172.21.15.114:0/3167819695 >> 172.21.15.114:0/3167819695 conn(0x7f823c0fb0a0 msgr2=0x7f823c0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.008+0000 7f8240f90700 1 -- 172.21.15.114:0/3167819695 shutdown_connections 2023-10-18T14:02:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.008+0000 7f8240f90700 1 -- 172.21.15.114:0/3167819695 wait complete. 2023-10-18T14:02:37.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.009+0000 7f8240f90700 1 Processor -- start 2023-10-18T14:02:37.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.009+0000 7f8240f90700 1 -- start start 2023-10-18T14:02:37.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.009+0000 7f8240f90700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f823c0ff9d0 0x7f823c197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:37.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.009+0000 7f8240f90700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f823c1011e0 0x7f823c197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:37.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.009+0000 7f8240f90700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f823c101ba0 0x7f823c1a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:37.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.009+0000 7f8240f90700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1988b0 con 0x7f823c101ba0 2023-10-18T14:02:37.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.009+0000 7f8240f90700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1a3040 con 0x7f823c0ff9d0 2023-10-18T14:02:37.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.009+0000 7f8240f90700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1a31b0 con 0x7f823c1011e0 2023-10-18T14:02:37.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.009+0000 7f823ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f823c101ba0 0x7f823c1a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:37.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.009+0000 7f823ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f823c101ba0 0x7f823c1a2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42438/0 (socket says 172.21.15.114:42438) 2023-10-18T14:02:37.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.009+0000 7f823ad9d700 1 -- 172.21.15.114:0/1589553804 learned_addr learned my addr 172.21.15.114:0/1589553804 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:37.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f8239d9b700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f823c1011e0 0x7f823c197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:37.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f823a59c700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f823c0ff9d0 0x7f823c197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:37.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f823ad9d700 1 -- 172.21.15.114:0/1589553804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f823c1011e0 msgr2=0x7f823c197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:37.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f823ad9d700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f823c1011e0 0x7f823c197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:37.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f823ad9d700 1 -- 172.21.15.114:0/1589553804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f823c0ff9d0 msgr2=0x7f823c197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:37.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f823ad9d700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f823c0ff9d0 0x7f823c197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:37.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f823ad9d700 1 -- 172.21.15.114:0/1589553804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82300095f0 con 0x7f823c101ba0 2023-10-18T14:02:37.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f823a59c700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f823c0ff9d0 0x7f823c197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:37.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f8239d9b700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f823c1011e0 0x7f823c197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:37.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f823ad9d700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f823c101ba0 0x7f823c1a2b00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f823400ada0 tx=0x7f823400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:37.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f822b7fe700 1 -- 172.21.15.114:0/1589553804 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823400f070 con 0x7f823c101ba0 2023-10-18T14:02:37.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f822b7fe700 1 -- 172.21.15.114:0/1589553804 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8234007b30 con 0x7f823c101ba0 2023-10-18T14:02:37.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f822b7fe700 1 -- 172.21.15.114:0/1589553804 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8234005440 con 0x7f823c101ba0 2023-10-18T14:02:37.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f8240f90700 1 -- 172.21.15.114:0/1589553804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823c1a3490 con 0x7f823c101ba0 2023-10-18T14:02:37.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.010+0000 7f8240f90700 1 -- 172.21.15.114:0/1589553804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c1a39a0 con 0x7f823c101ba0 2023-10-18T14:02:37.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.011+0000 7f8240f90700 1 -- 172.21.15.114:0/1589553804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c107cc0 con 0x7f823c101ba0 2023-10-18T14:02:37.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.012+0000 7f822b7fe700 1 -- 172.21.15.114:0/1589553804 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f8234004ad0 con 0x7f823c101ba0 2023-10-18T14:02:37.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.013+0000 7f822b7fe700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f82240a1550 0x7f82240a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:37.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.013+0000 7f823a59c700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f82240a1550 0x7f82240a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:37.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.013+0000 7f822b7fe700 1 -- 172.21.15.114:0/1589553804 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f82340cc8b0 con 0x7f823c101ba0 2023-10-18T14:02:37.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.013+0000 7f823a59c700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f82240a1550 0x7f82240a3a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f823000b5c0 tx=0x7f8230005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:37.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.016+0000 7f822b7fe700 1 -- 172.21.15.114:0/1589553804 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8234095fc0 con 0x7f823c101ba0 2023-10-18T14:02:37.059 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:02:36 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-i[143420]: 2023-10-18T14:02:36.753+0000 7f303efa2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-18T14:02:37.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:36 smithi172 ceph-mon[103574]: pgmap v235: 97 pgs: 8 creating+peering, 82 active+clean, 7 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2023-10-18T14:02:37.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:36 smithi172 ceph-mon[103574]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-18T14:02:37.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:36 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1572072018' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-18T14:02:37.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:36 smithi172 ceph-mon[103574]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-18T14:02:37.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:36 smithi172 ceph-mon[103574]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-18T14:02:37.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:36 smithi172 ceph-mon[103574]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2023-10-18T14:02:37.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:36 smithi172 ceph-mon[103574]: daemon mds.c is now active in filesystem cephfs as rank 1 2023-10-18T14:02:37.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:36 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3966599279' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-18T14:02:37.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.256+0000 7f8240f90700 1 -- 172.21.15.114:0/1589553804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f823c100d50 con 0x7f823c101ba0 2023-10-18T14:02:37.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:36 smithi158 ceph-mon[103317]: pgmap v235: 97 pgs: 8 creating+peering, 82 active+clean, 7 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2023-10-18T14:02:37.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:36 smithi158 ceph-mon[103317]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-18T14:02:37.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:36 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1572072018' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-18T14:02:37.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:36 smithi158 ceph-mon[103317]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-18T14:02:37.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:36 smithi158 ceph-mon[103317]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-18T14:02:37.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:36 smithi158 ceph-mon[103317]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2023-10-18T14:02:37.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:36 smithi158 ceph-mon[103317]: daemon mds.c is now active in filesystem cephfs as rank 1 2023-10-18T14:02:37.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:36 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3966599279' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-18T14:02:37.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:36 smithi114 ceph-mon[99494]: pgmap v235: 97 pgs: 8 creating+peering, 82 active+clean, 7 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2023-10-18T14:02:37.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:36 smithi114 ceph-mon[99494]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-18T14:02:37.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:36 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1572072018' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-18T14:02:37.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:36 smithi114 ceph-mon[99494]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-18T14:02:37.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:36 smithi114 ceph-mon[99494]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-18T14:02:37.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:36 smithi114 ceph-mon[99494]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2023-10-18T14:02:37.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:36 smithi114 ceph-mon[99494]: daemon mds.c is now active in filesystem cephfs as rank 1 2023-10-18T14:02:37.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:36 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3966599279' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-18T14:02:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.872+0000 7f822b7fe700 1 -- 172.21.15.114:0/1589553804 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f82340995e0 con 0x7f823c101ba0 2023-10-18T14:02:37.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.874+0000 7f8240f90700 1 -- 172.21.15.114:0/1589553804 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f82240a1550 msgr2=0x7f82240a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.874+0000 7f8240f90700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f82240a1550 0x7f82240a3a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f823000b5c0 tx=0x7f8230005fb0 comp rx=0 tx=0).stop 2023-10-18T14:02:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.874+0000 7f8240f90700 1 -- 172.21.15.114:0/1589553804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f823c101ba0 msgr2=0x7f823c1a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.874+0000 7f8240f90700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f823c101ba0 0x7f823c1a2b00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f823400ada0 tx=0x7f823400c330 comp rx=0 tx=0).stop 2023-10-18T14:02:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.874+0000 7f8240f90700 1 -- 172.21.15.114:0/1589553804 shutdown_connections 2023-10-18T14:02:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.874+0000 7f8240f90700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f82240a1550 0x7f82240a3a10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:37.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.874+0000 7f8240f90700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f823c101ba0 0x7f823c1a2b00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:37.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.874+0000 7f8240f90700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f823c0ff9d0 0x7f823c197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:37.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.874+0000 7f8240f90700 1 --2- 172.21.15.114:0/1589553804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f823c1011e0 0x7f823c197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:37.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.875+0000 7f8240f90700 1 -- 172.21.15.114:0/1589553804 >> 172.21.15.114:0/1589553804 conn(0x7f823c0fb0a0 msgr2=0x7f823c0fb740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:37.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.875+0000 7f8240f90700 1 -- 172.21.15.114:0/1589553804 shutdown_connections 2023-10-18T14:02:37.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:37.875+0000 7f8240f90700 1 -- 172.21.15.114:0/1589553804 wait complete. 2023-10-18T14:02:37.896 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2023-10-18T14:02:37.896 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-10-18T14:02:38.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.020+0000 7f650eb1b700 1 -- 172.21.15.114:0/25007203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65081056e0 msgr2=0x7f6508105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:38.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.020+0000 7f650eb1b700 1 --2- 172.21.15.114:0/25007203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65081056e0 0x7f6508105ac0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009990 tx=0x7f64fc009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.020+0000 7f650eb1b700 1 -- 172.21.15.114:0/25007203 shutdown_connections 2023-10-18T14:02:38.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.020+0000 7f650eb1b700 1 --2- 172.21.15.114:0/25007203 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6508100000 0x7f650810c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.020+0000 7f650eb1b700 1 --2- 172.21.15.114:0/25007203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65081056e0 0x7f6508105ac0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.020+0000 7f650eb1b700 1 --2- 172.21.15.114:0/25007203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65080ff640 0x7f65080ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.020+0000 7f650eb1b700 1 -- 172.21.15.114:0/25007203 >> 172.21.15.114:0/25007203 conn(0x7f65080767f0 msgr2=0x7f6508076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.020+0000 7f650eb1b700 1 -- 172.21.15.114:0/25007203 shutdown_connections 2023-10-18T14:02:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.020+0000 7f650eb1b700 1 -- 172.21.15.114:0/25007203 wait complete. 2023-10-18T14:02:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650eb1b700 1 Processor -- start 2023-10-18T14:02:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650eb1b700 1 -- start start 2023-10-18T14:02:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650eb1b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65080ff640 0x7f6508197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650eb1b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6508100000 0x7f6508197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:38.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650eb1b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65081056e0 0x7f65081a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:38.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650eb1b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65081987e0 con 0x7f65081056e0 2023-10-18T14:02:38.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650eb1b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65081a2ff0 con 0x7f6508100000 2023-10-18T14:02:38.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650eb1b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65081a3130 con 0x7f65080ff640 2023-10-18T14:02:38.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650d0b8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65081056e0 0x7f65081a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:38.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650d0b8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65081056e0 0x7f65081a2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42450/0 (socket says 172.21.15.114:42450) 2023-10-18T14:02:38.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650d0b8700 1 -- 172.21.15.114:0/218049256 learned_addr learned my addr 172.21.15.114:0/218049256 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650c8b7700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65080ff640 0x7f6508197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650d0b8700 1 -- 172.21.15.114:0/218049256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65080ff640 msgr2=0x7f6508197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650d0b8700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65080ff640 0x7f6508197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650d0b8700 1 -- 172.21.15.114:0/218049256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6508100000 msgr2=0x7f6508197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650d0b8700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6508100000 0x7f6508197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650d0b8700 1 -- 172.21.15.114:0/218049256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0095f0 con 0x7f65081056e0 2023-10-18T14:02:38.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650c8b7700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65080ff640 0x7f6508197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:38.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.021+0000 7f650d0b8700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65081056e0 0x7f65081a2ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6500007f10 tx=0x7f650000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:38.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.022+0000 7f6505ffb700 1 -- 172.21.15.114:0/218049256 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500017070 con 0x7f65081056e0 2023-10-18T14:02:38.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.022+0000 7f650eb1b700 1 -- 172.21.15.114:0/218049256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65081a33c0 con 0x7f65081056e0 2023-10-18T14:02:38.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.022+0000 7f6505ffb700 1 -- 172.21.15.114:0/218049256 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f650000f040 con 0x7f65081056e0 2023-10-18T14:02:38.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.022+0000 7f6505ffb700 1 -- 172.21.15.114:0/218049256 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500005740 con 0x7f65081056e0 2023-10-18T14:02:38.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.022+0000 7f650eb1b700 1 -- 172.21.15.114:0/218049256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65081a38d0 con 0x7f65081056e0 2023-10-18T14:02:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.023+0000 7f650eb1b700 1 -- 172.21.15.114:0/218049256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6508107b80 con 0x7f65081056e0 2023-10-18T14:02:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.024+0000 7f6505ffb700 1 -- 172.21.15.114:0/218049256 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f650000dc60 con 0x7f65081056e0 2023-10-18T14:02:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.024+0000 7f6505ffb700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f64f80a14d0 0x7f64f80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.024+0000 7f6505ffb700 1 -- 172.21.15.114:0/218049256 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f65000cc4a0 con 0x7f65081056e0 2023-10-18T14:02:38.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.024+0000 7f650c8b7700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f64f80a14d0 0x7f64f80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:38.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.025+0000 7f650c8b7700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f64f80a14d0 0x7f64f80a3990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00b5c0 tx=0x7f64fc005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:38.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.028+0000 7f6505ffb700 1 -- 172.21.15.114:0/218049256 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6500095b20 con 0x7f65081056e0 2023-10-18T14:02:38.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.249+0000 7f650eb1b700 1 -- 172.21.15.114:0/218049256 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f6508067df0 con 0x7f64f80a14d0 2023-10-18T14:02:38.261 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:37 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3966599279' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-18T14:02:38.261 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:37 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] up:active 2023-10-18T14:02:38.262 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:37 smithi114 ceph-mon[99494]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-18T14:02:38.262 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:37 smithi114 ceph-mon[99494]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2023-10-18T14:02:38.262 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:37 smithi114 ceph-mon[99494]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2023-10-18T14:02:38.262 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:37 smithi114 ceph-mon[99494]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-10-18T14:02:38.262 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:37 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1589553804' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-18T14:02:38.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:37 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3966599279' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-18T14:02:38.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:37 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] up:active 2023-10-18T14:02:38.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:37 smithi158 ceph-mon[103317]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-18T14:02:38.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:37 smithi158 ceph-mon[103317]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2023-10-18T14:02:38.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:37 smithi158 ceph-mon[103317]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2023-10-18T14:02:38.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:37 smithi158 ceph-mon[103317]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-10-18T14:02:38.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:37 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1589553804' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-18T14:02:38.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.299+0000 7f6505ffb700 1 -- 172.21.15.114:0/218049256 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6508067df0 con 0x7f64f80a14d0 2023-10-18T14:02:38.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.301+0000 7f650eb1b700 1 -- 172.21.15.114:0/218049256 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f64f80a14d0 msgr2=0x7f64f80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:38.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.301+0000 7f650eb1b700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f64f80a14d0 0x7f64f80a3990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00b5c0 tx=0x7f64fc005fb0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.301+0000 7f650eb1b700 1 -- 172.21.15.114:0/218049256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65081056e0 msgr2=0x7f65081a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:38.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.301+0000 7f650eb1b700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65081056e0 0x7f65081a2ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6500007f10 tx=0x7f650000d3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.301+0000 7f650eb1b700 1 -- 172.21.15.114:0/218049256 shutdown_connections 2023-10-18T14:02:38.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.301+0000 7f650eb1b700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f64f80a14d0 0x7f64f80a3990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.301+0000 7f650eb1b700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65081056e0 0x7f65081a2ab0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.301+0000 7f650eb1b700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65080ff640 0x7f6508197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.301+0000 7f650eb1b700 1 --2- 172.21.15.114:0/218049256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6508100000 0x7f6508197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.301+0000 7f650eb1b700 1 -- 172.21.15.114:0/218049256 >> 172.21.15.114:0/218049256 conn(0x7f65080767f0 msgr2=0x7f65080fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:38.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.301+0000 7f650eb1b700 1 -- 172.21.15.114:0/218049256 shutdown_connections 2023-10-18T14:02:38.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.301+0000 7f650eb1b700 1 -- 172.21.15.114:0/218049256 wait complete. 2023-10-18T14:02:38.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:37 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3966599279' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-18T14:02:38.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:37 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] up:active 2023-10-18T14:02:38.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:37 smithi172 ceph-mon[103574]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-18T14:02:38.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:37 smithi172 ceph-mon[103574]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2023-10-18T14:02:38.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:37 smithi172 ceph-mon[103574]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2023-10-18T14:02:38.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:37 smithi172 ceph-mon[103574]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-10-18T14:02:38.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:37 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1589553804' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-18T14:02:38.317 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-10-18T14:02:38.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.438+0000 7ff123198700 1 -- 172.21.15.114:0/2146717215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff11c1011e0 msgr2=0x7ff11c101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:38.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.438+0000 7ff123198700 1 --2- 172.21.15.114:0/2146717215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff11c1011e0 0x7ff11c101660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff108009990 tx=0x7ff108009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.438+0000 7ff123198700 1 -- 172.21.15.114:0/2146717215 shutdown_connections 2023-10-18T14:02:38.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.438+0000 7ff123198700 1 --2- 172.21.15.114:0/2146717215 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff11c101ba0 0x7ff11c10c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.438+0000 7ff123198700 1 --2- 172.21.15.114:0/2146717215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff11c0ff9d0 0x7ff11c0ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.438+0000 7ff123198700 1 --2- 172.21.15.114:0/2146717215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff11c1011e0 0x7ff11c101660 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.438+0000 7ff123198700 1 -- 172.21.15.114:0/2146717215 >> 172.21.15.114:0/2146717215 conn(0x7ff11c0fb0a0 msgr2=0x7ff11c0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:38.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.438+0000 7ff123198700 1 -- 172.21.15.114:0/2146717215 shutdown_connections 2023-10-18T14:02:38.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.438+0000 7ff123198700 1 -- 172.21.15.114:0/2146717215 wait complete. 2023-10-18T14:02:38.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.438+0000 7ff123198700 1 Processor -- start 2023-10-18T14:02:38.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff123198700 1 -- start start 2023-10-18T14:02:38.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff123198700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff11c0ff9d0 0x7ff11c19c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:38.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff123198700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff11c1011e0 0x7ff11c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:38.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff123198700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff11c101ba0 0x7ff11c1969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:38.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff123198700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c197180 con 0x7ff11c0ff9d0 2023-10-18T14:02:38.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff123198700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c1972f0 con 0x7ff11c1011e0 2023-10-18T14:02:38.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff123198700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c1974b0 con 0x7ff11c101ba0 2023-10-18T14:02:38.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff120f34700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff11c0ff9d0 0x7ff11c19c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:38.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff120f34700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff11c0ff9d0 0x7ff11c19c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42496/0 (socket says 172.21.15.114:42496) 2023-10-18T14:02:38.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff120f34700 1 -- 172.21.15.114:0/1363401832 learned_addr learned my addr 172.21.15.114:0/1363401832 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:38.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff11bfff700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff11c1011e0 0x7ff11c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:38.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff121735700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff11c101ba0 0x7ff11c1969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:38.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff120f34700 1 -- 172.21.15.114:0/1363401832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff11c101ba0 msgr2=0x7ff11c1969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:38.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff120f34700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff11c101ba0 0x7ff11c1969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff120f34700 1 -- 172.21.15.114:0/1363401832 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff11c1011e0 msgr2=0x7ff11c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:38.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff120f34700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff11c1011e0 0x7ff11c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff120f34700 1 -- 172.21.15.114:0/1363401832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1080095f0 con 0x7ff11c0ff9d0 2023-10-18T14:02:38.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff11bfff700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff11c1011e0 0x7ff11c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:38.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff121735700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff11c101ba0 0x7ff11c1969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:38.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff120f34700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff11c0ff9d0 0x7ff11c19c8c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff11000c9b0 tx=0x7ff11000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:38.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff119ffb700 1 -- 172.21.15.114:0/1363401832 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110007b00 con 0x7ff11c0ff9d0 2023-10-18T14:02:38.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff123198700 1 -- 172.21.15.114:0/1363401832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11c197790 con 0x7ff11c0ff9d0 2023-10-18T14:02:38.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff119ffb700 1 -- 172.21.15.114:0/1363401832 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff110007c60 con 0x7ff11c0ff9d0 2023-10-18T14:02:38.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.439+0000 7ff119ffb700 1 -- 172.21.15.114:0/1363401832 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110018660 con 0x7ff11c0ff9d0 2023-10-18T14:02:38.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.440+0000 7ff123198700 1 -- 172.21.15.114:0/1363401832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11c1a3890 con 0x7ff11c0ff9d0 2023-10-18T14:02:38.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.441+0000 7ff123198700 1 -- 172.21.15.114:0/1363401832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11c108b60 con 0x7ff11c0ff9d0 2023-10-18T14:02:38.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.442+0000 7ff119ffb700 1 -- 172.21.15.114:0/1363401832 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7ff110018880 con 0x7ff11c0ff9d0 2023-10-18T14:02:38.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.442+0000 7ff119ffb700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff10c0a14d0 0x7ff10c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:38.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.442+0000 7ff11bfff700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff10c0a14d0 0x7ff10c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:38.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.442+0000 7ff119ffb700 1 -- 172.21.15.114:0/1363401832 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7ff1100ccdd0 con 0x7ff11c0ff9d0 2023-10-18T14:02:38.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.443+0000 7ff11bfff700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff10c0a14d0 0x7ff10c0a3990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff108000c00 tx=0x7ff108005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:38.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.447+0000 7ff119ffb700 1 -- 172.21.15.114:0/1363401832 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff110096450 con 0x7ff11c0ff9d0 2023-10-18T14:02:38.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T14:02:38.255+0000 7f3b9ca1a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T14:02:38.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T14:02:38.255+0000 7f3b9ca1a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T14:02:38.589 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T14:02:38.255+0000 7f3b9ca1a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T14:02:38.589 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T14:02:38.255+0000 7f3b9ca1a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T14:02:38.589 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T14:02:38.255+0000 7f3b9ca1a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T14:02:38.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.673+0000 7ff123198700 1 -- 172.21.15.114:0/1363401832 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff11c066d80 con 0x7ff10c0a14d0 2023-10-18T14:02:38.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.678+0000 7ff119ffb700 1 -- 172.21.15.114:0/1363401832 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7ff11c066d80 con 0x7ff10c0a14d0 2023-10-18T14:02:38.682 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/_nogroup/sv_0/ae153426-b5e1-41c4-bb65-8ec08442daf1 2023-10-18T14:02:38.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.680+0000 7ff123198700 1 -- 172.21.15.114:0/1363401832 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff10c0a14d0 msgr2=0x7ff10c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:38.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.680+0000 7ff123198700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff10c0a14d0 0x7ff10c0a3990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff108000c00 tx=0x7ff108005fb0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.680+0000 7ff123198700 1 -- 172.21.15.114:0/1363401832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff11c0ff9d0 msgr2=0x7ff11c19c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:38.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.680+0000 7ff123198700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff11c0ff9d0 0x7ff11c19c8c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff11000c9b0 tx=0x7ff11000cd70 comp rx=0 tx=0).stop 2023-10-18T14:02:38.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.680+0000 7ff123198700 1 -- 172.21.15.114:0/1363401832 shutdown_connections 2023-10-18T14:02:38.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.680+0000 7ff123198700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff10c0a14d0 0x7ff10c0a3990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.680+0000 7ff123198700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff11c101ba0 0x7ff11c1969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.680+0000 7ff123198700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff11c0ff9d0 0x7ff11c19c8c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.680+0000 7ff123198700 1 --2- 172.21.15.114:0/1363401832 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff11c1011e0 0x7ff11c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.680+0000 7ff123198700 1 -- 172.21.15.114:0/1363401832 >> 172.21.15.114:0/1363401832 conn(0x7ff11c0fb0a0 msgr2=0x7ff11c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:38.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.680+0000 7ff123198700 1 -- 172.21.15.114:0/1363401832 shutdown_connections 2023-10-18T14:02:38.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.680+0000 7ff123198700 1 -- 172.21.15.114:0/1363401832 wait complete. 2023-10-18T14:02:38.696 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-10-18T14:02:38.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.817+0000 7fc98826d700 1 -- 172.21.15.114:0/2595043405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9800ff680 msgr2=0x7fc9800ffb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:38.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.817+0000 7fc98826d700 1 --2- 172.21.15.114:0/2595043405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9800ff680 0x7fc9800ffb00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009990 tx=0x7fc97c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.817+0000 7fc98826d700 1 -- 172.21.15.114:0/2595043405 shutdown_connections 2023-10-18T14:02:38.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.817+0000 7fc98826d700 1 --2- 172.21.15.114:0/2595043405 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc980100040 0x7fc98010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.817+0000 7fc98826d700 1 --2- 172.21.15.114:0/2595043405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc980104560 0x7fc980104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.817+0000 7fc98826d700 1 --2- 172.21.15.114:0/2595043405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9800ff680 0x7fc9800ffb00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.817+0000 7fc98826d700 1 -- 172.21.15.114:0/2595043405 >> 172.21.15.114:0/2595043405 conn(0x7fc980076820 msgr2=0x7fc980076c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:38.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.817+0000 7fc98826d700 1 -- 172.21.15.114:0/2595043405 shutdown_connections 2023-10-18T14:02:38.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.817+0000 7fc98826d700 1 -- 172.21.15.114:0/2595043405 wait complete. 2023-10-18T14:02:38.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.818+0000 7fc98826d700 1 Processor -- start 2023-10-18T14:02:38.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.818+0000 7fc98826d700 1 -- start start 2023-10-18T14:02:38.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.818+0000 7fc98826d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9800ff680 0x7fc98019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:38.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.818+0000 7fc98826d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980100040 0x7fc98019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:38.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.818+0000 7fc98826d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc980104560 0x7fc980196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:38.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.818+0000 7fc98826d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc980196fb0 con 0x7fc980100040 2023-10-18T14:02:38.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.818+0000 7fc98826d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc980197120 con 0x7fc9800ff680 2023-10-18T14:02:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.818+0000 7fc98826d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9801972e0 con 0x7fc980104560 2023-10-18T14:02:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.818+0000 7fc985808700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980100040 0x7fc98019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.818+0000 7fc985808700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980100040 0x7fc98019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42512/0 (socket says 172.21.15.114:42512) 2023-10-18T14:02:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.818+0000 7fc985808700 1 -- 172.21.15.114:0/3543166726 learned_addr learned my addr 172.21.15.114:0/3543166726 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.819+0000 7fc985808700 1 -- 172.21.15.114:0/3543166726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc980104560 msgr2=0x7fc980196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:38.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.819+0000 7fc985808700 1 --2- 172.21.15.114:0/3543166726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc980104560 0x7fc980196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.819+0000 7fc985808700 1 -- 172.21.15.114:0/3543166726 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9800ff680 msgr2=0x7fc98019c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:38.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.819+0000 7fc985808700 1 --2- 172.21.15.114:0/3543166726 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9800ff680 0x7fc98019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:38.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.819+0000 7fc985808700 1 -- 172.21.15.114:0/3543166726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c0095f0 con 0x7fc980100040 2023-10-18T14:02:38.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.819+0000 7fc985808700 1 --2- 172.21.15.114:0/3543166726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980100040 0x7fc98019cd60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc97c000c00 tx=0x7fc97c00f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:38.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.819+0000 7fc9777fe700 1 -- 172.21.15.114:0/3543166726 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c01d070 con 0x7fc980100040 2023-10-18T14:02:38.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.819+0000 7fc9777fe700 1 -- 172.21.15.114:0/3543166726 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc97c00fc40 con 0x7fc980100040 2023-10-18T14:02:38.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.819+0000 7fc98826d700 1 -- 172.21.15.114:0/3543166726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc980197560 con 0x7fc980100040 2023-10-18T14:02:38.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.819+0000 7fc9777fe700 1 -- 172.21.15.114:0/3543166726 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c017650 con 0x7fc980100040 2023-10-18T14:02:38.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.819+0000 7fc98826d700 1 -- 172.21.15.114:0/3543166726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9801a3810 con 0x7fc980100040 2023-10-18T14:02:38.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.820+0000 7fc98826d700 1 -- 172.21.15.114:0/3543166726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc980108b20 con 0x7fc980100040 2023-10-18T14:02:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.821+0000 7fc9777fe700 1 -- 172.21.15.114:0/3543166726 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fc97c0050c0 con 0x7fc980100040 2023-10-18T14:02:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.821+0000 7fc9777fe700 1 --2- 172.21.15.114:0/3543166726 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc96c0a1550 0x7fc96c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.822+0000 7fc986009700 1 --2- 172.21.15.114:0/3543166726 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc96c0a1550 0x7fc96c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.822+0000 7fc9777fe700 1 -- 172.21.15.114:0/3543166726 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fc97c0ce000 con 0x7fc980100040 2023-10-18T14:02:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.822+0000 7fc986009700 1 --2- 172.21.15.114:0/3543166726 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc96c0a1550 0x7fc96c0a3a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc97000a9b0 tx=0x7fc970005c90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:38.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:38.825+0000 7fc9777fe700 1 -- 172.21.15.114:0/3543166726 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc97c05d100 con 0x7fc980100040 2023-10-18T14:02:39.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.050+0000 7fc98826d700 1 -- 172.21.15.114:0/3543166726 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fc980197e10 con 0x7fc96c0a1550 2023-10-18T14:02:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.075+0000 7fc9777fe700 1 -- 172.21.15.114:0/3543166726 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc980197e10 con 0x7fc96c0a1550 2023-10-18T14:02:39.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.077+0000 7fc98826d700 1 -- 172.21.15.114:0/3543166726 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc96c0a1550 msgr2=0x7fc96c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.077+0000 7fc98826d700 1 --2- 172.21.15.114:0/3543166726 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc96c0a1550 0x7fc96c0a3a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc97000a9b0 tx=0x7fc970005c90 comp rx=0 tx=0).stop 2023-10-18T14:02:39.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.078+0000 7fc98826d700 1 -- 172.21.15.114:0/3543166726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980100040 msgr2=0x7fc98019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.078+0000 7fc98826d700 1 --2- 172.21.15.114:0/3543166726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980100040 0x7fc98019cd60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc97c000c00 tx=0x7fc97c00f720 comp rx=0 tx=0).stop 2023-10-18T14:02:39.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.078+0000 7fc98826d700 1 -- 172.21.15.114:0/3543166726 shutdown_connections 2023-10-18T14:02:39.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.078+0000 7fc98826d700 1 --2- 172.21.15.114:0/3543166726 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc96c0a1550 0x7fc96c0a3a10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.078+0000 7fc98826d700 1 --2- 172.21.15.114:0/3543166726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc980104560 0x7fc980196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.078+0000 7fc98826d700 1 --2- 172.21.15.114:0/3543166726 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9800ff680 0x7fc98019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.078+0000 7fc98826d700 1 --2- 172.21.15.114:0/3543166726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980100040 0x7fc98019cd60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.078+0000 7fc98826d700 1 -- 172.21.15.114:0/3543166726 >> 172.21.15.114:0/3543166726 conn(0x7fc980076820 msgr2=0x7fc9800690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:39.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.078+0000 7fc98826d700 1 -- 172.21.15.114:0/3543166726 shutdown_connections 2023-10-18T14:02:39.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.078+0000 7fc98826d700 1 -- 172.21.15.114:0/3543166726 wait complete. 2023-10-18T14:02:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: pgmap v236: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s wr, 9 op/s 2023-10-18T14:02:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1589553804' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-18T14:02:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] up:active 2023-10-18T14:02:39.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: daemon mds.b assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-18T14:02:39.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2023-10-18T14:02:39.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=f=up:active,3=b=up:creating} 8 up:standby 2023-10-18T14:02:39.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: daemon mds.b is now active in filesystem cephfs as rank 3 2023-10-18T14:02:39.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] up:active 2023-10-18T14:02:39.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-18T14:02:39.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-18T14:02:39.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: Cluster is now healthy 2023-10-18T14:02:39.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=f=up:active,3=b=up:active} 4 up:standby-replay 4 up:standby 2023-10-18T14:02:39.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2023-10-18T14:02:39.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:38 smithi114 ceph-mon[99494]: daemon mds.a is now active in filesystem cephfs as rank 4 2023-10-18T14:02:39.094 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-10-18T14:02:39.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.214+0000 7f6088df5700 1 -- 172.21.15.114:0/3143968236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60840ffa20 msgr2=0x7f608410bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.214+0000 7f6088df5700 1 --2- 172.21.15.114:0/3143968236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60840ffa20 0x7f608410bc80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f607c00b0d0 tx=0x7f607c00b3e0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.214+0000 7f6088df5700 1 -- 172.21.15.114:0/3143968236 shutdown_connections 2023-10-18T14:02:39.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.214+0000 7f6088df5700 1 --2- 172.21.15.114:0/3143968236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60840ffa20 0x7f608410bc80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.214+0000 7f6088df5700 1 --2- 172.21.15.114:0/3143968236 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6084104f90 0x7f6084105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.214+0000 7f6088df5700 1 --2- 172.21.15.114:0/3143968236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60840ff060 0x7f60840ff4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.214+0000 7f6088df5700 1 -- 172.21.15.114:0/3143968236 >> 172.21.15.114:0/3143968236 conn(0x7f6084075c20 msgr2=0x7f6084076030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:39.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.214+0000 7f6088df5700 1 -- 172.21.15.114:0/3143968236 shutdown_connections 2023-10-18T14:02:39.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.214+0000 7f6088df5700 1 -- 172.21.15.114:0/3143968236 wait complete. 2023-10-18T14:02:39.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f6088df5700 1 Processor -- start 2023-10-18T14:02:39.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f6088df5700 1 -- start start 2023-10-18T14:02:39.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f6088df5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60840ff060 0x7f6084195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:39.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f6088df5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60840ffa20 0x7f60841957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:39.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f6088df5700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6084104f90 0x7f608419b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:39.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f6088df5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608419bc10 con 0x7f60840ff060 2023-10-18T14:02:39.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f6088df5700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608419bd80 con 0x7f6084104f90 2023-10-18T14:02:39.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f6088df5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608419bf40 con 0x7f60840ffa20 2023-10-18T14:02:39.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f608259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60840ff060 0x7f6084195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:39.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f608259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60840ff060 0x7f6084195270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42526/0 (socket says 172.21.15.114:42526) 2023-10-18T14:02:39.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f608259c700 1 -- 172.21.15.114:0/1335888851 learned_addr learned my addr 172.21.15.114:0/1335888851 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:39.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f6081d9b700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60840ffa20 0x7f60841957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:39.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f608259c700 1 -- 172.21.15.114:0/1335888851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60840ffa20 msgr2=0x7f60841957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f6082d9d700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6084104f90 0x7f608419b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:39.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f608259c700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60840ffa20 0x7f60841957b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f608259c700 1 -- 172.21.15.114:0/1335888851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6084104f90 msgr2=0x7f608419b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f608259c700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6084104f90 0x7f608419b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f608259c700 1 -- 172.21.15.114:0/1335888851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c009d00 con 0x7f60840ff060 2023-10-18T14:02:39.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.215+0000 7f6081d9b700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60840ffa20 0x7f60841957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:39.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.216+0000 7f608259c700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60840ff060 0x7f6084195270 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f607400c920 tx=0x7f607400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:39.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.216+0000 7f60737fe700 1 -- 172.21.15.114:0/1335888851 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074007b00 con 0x7f60840ff060 2023-10-18T14:02:39.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.216+0000 7f6088df5700 1 -- 172.21.15.114:0/1335888851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608419c220 con 0x7f60840ff060 2023-10-18T14:02:39.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.216+0000 7f60737fe700 1 -- 172.21.15.114:0/1335888851 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6074004cf0 con 0x7f60840ff060 2023-10-18T14:02:39.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.216+0000 7f60737fe700 1 -- 172.21.15.114:0/1335888851 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074005520 con 0x7f60840ff060 2023-10-18T14:02:39.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.216+0000 7f6088df5700 1 -- 172.21.15.114:0/1335888851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60841a3ad0 con 0x7f60840ff060 2023-10-18T14:02:39.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.217+0000 7f6088df5700 1 -- 172.21.15.114:0/1335888851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60841073d0 con 0x7f60840ff060 2023-10-18T14:02:39.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.218+0000 7f60737fe700 1 -- 172.21.15.114:0/1335888851 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f6074004750 con 0x7f60840ff060 2023-10-18T14:02:39.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.218+0000 7f60737fe700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f606c0a14d0 0x7f606c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:39.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.218+0000 7f6081d9b700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f606c0a14d0 0x7f606c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:39.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.218+0000 7f60737fe700 1 -- 172.21.15.114:0/1335888851 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f60740cca00 con 0x7f60840ff060 2023-10-18T14:02:39.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.219+0000 7f6081d9b700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f606c0a14d0 0x7f606c0a3990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6078005fd0 tx=0x7f6078005dc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:39.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.223+0000 7f60737fe700 1 -- 172.21.15.114:0/1335888851 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6074096020 con 0x7f60840ff060 2023-10-18T14:02:39.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: pgmap v236: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s wr, 9 op/s 2023-10-18T14:02:39.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1589553804' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-18T14:02:39.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] up:active 2023-10-18T14:02:39.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: daemon mds.b assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-18T14:02:39.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2023-10-18T14:02:39.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=f=up:active,3=b=up:creating} 8 up:standby 2023-10-18T14:02:39.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: daemon mds.b is now active in filesystem cephfs as rank 3 2023-10-18T14:02:39.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] up:active 2023-10-18T14:02:39.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-18T14:02:39.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-18T14:02:39.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: Cluster is now healthy 2023-10-18T14:02:39.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=f=up:active,3=b=up:active} 4 up:standby-replay 4 up:standby 2023-10-18T14:02:39.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2023-10-18T14:02:39.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:38 smithi158 ceph-mon[103317]: daemon mds.a is now active in filesystem cephfs as rank 4 2023-10-18T14:02:39.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: pgmap v236: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s wr, 9 op/s 2023-10-18T14:02:39.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1589553804' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-18T14:02:39.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] up:active 2023-10-18T14:02:39.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: daemon mds.b assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-18T14:02:39.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2023-10-18T14:02:39.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=f=up:active,3=b=up:creating} 8 up:standby 2023-10-18T14:02:39.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: daemon mds.b is now active in filesystem cephfs as rank 3 2023-10-18T14:02:39.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] up:active 2023-10-18T14:02:39.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-18T14:02:39.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-18T14:02:39.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: Cluster is now healthy 2023-10-18T14:02:39.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=f=up:active,3=b=up:active} 4 up:standby-replay 4 up:standby 2023-10-18T14:02:39.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2023-10-18T14:02:39.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:38 smithi172 ceph-mon[103574]: daemon mds.a is now active in filesystem cephfs as rank 4 2023-10-18T14:02:39.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.455+0000 7f6088df5700 1 -- 172.21.15.114:0/1335888851 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f60840689a0 con 0x7f606c0a14d0 2023-10-18T14:02:39.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.459+0000 7f60737fe700 1 -- 172.21.15.114:0/1335888851 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f60840689a0 con 0x7f606c0a14d0 2023-10-18T14:02:39.463 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c 2023-10-18T14:02:39.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.461+0000 7f6088df5700 1 -- 172.21.15.114:0/1335888851 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f606c0a14d0 msgr2=0x7f606c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.461+0000 7f6088df5700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f606c0a14d0 0x7f606c0a3990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6078005fd0 tx=0x7f6078005dc0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.461+0000 7f6088df5700 1 -- 172.21.15.114:0/1335888851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60840ff060 msgr2=0x7f6084195270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.461+0000 7f6088df5700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60840ff060 0x7f6084195270 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f607400c920 tx=0x7f607400cce0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.461+0000 7f6088df5700 1 -- 172.21.15.114:0/1335888851 shutdown_connections 2023-10-18T14:02:39.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.461+0000 7f6088df5700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f606c0a14d0 0x7f606c0a3990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.461+0000 7f6088df5700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6084104f90 0x7f608419b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.461+0000 7f6088df5700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60840ff060 0x7f6084195270 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.461+0000 7f6088df5700 1 --2- 172.21.15.114:0/1335888851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60840ffa20 0x7f60841957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.461+0000 7f6088df5700 1 -- 172.21.15.114:0/1335888851 >> 172.21.15.114:0/1335888851 conn(0x7f6084075c20 msgr2=0x7f60840fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:39.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.461+0000 7f6088df5700 1 -- 172.21.15.114:0/1335888851 shutdown_connections 2023-10-18T14:02:39.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.461+0000 7f6088df5700 1 -- 172.21.15.114:0/1335888851 wait complete. 2023-10-18T14:02:39.477 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:02:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.594+0000 7fcc22d62700 1 -- 172.21.15.114:0/4184574911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1c0fefc0 msgr2=0x7fcc1c0ff3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.594+0000 7fcc22d62700 1 --2- 172.21.15.114:0/4184574911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1c0fefc0 0x7fcc1c0ff3a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcc10009990 tx=0x7fcc10009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.594+0000 7fcc22d62700 1 -- 172.21.15.114:0/4184574911 shutdown_connections 2023-10-18T14:02:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.594+0000 7fcc22d62700 1 --2- 172.21.15.114:0/4184574911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc1c104090 0x7fcc1c10bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.594+0000 7fcc22d62700 1 --2- 172.21.15.114:0/4184574911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1c0fefc0 0x7fcc1c0ff3a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.594+0000 7fcc22d62700 1 --2- 172.21.15.114:0/4184574911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc1c0ff970 0x7fcc1c103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.594+0000 7fcc22d62700 1 -- 172.21.15.114:0/4184574911 >> 172.21.15.114:0/4184574911 conn(0x7fcc1c075b90 msgr2=0x7fcc1c0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.594+0000 7fcc22d62700 1 -- 172.21.15.114:0/4184574911 shutdown_connections 2023-10-18T14:02:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.594+0000 7fcc22d62700 1 -- 172.21.15.114:0/4184574911 wait complete. 2023-10-18T14:02:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.594+0000 7fcc22d62700 1 Processor -- start 2023-10-18T14:02:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.594+0000 7fcc22d62700 1 -- start start 2023-10-18T14:02:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc22d62700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1c0fefc0 0x7fcc1c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc22d62700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc1c104090 0x7fcc1c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc22d62700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc1c19d6a0 0x7fcc1c19db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc22d62700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c19e120 con 0x7fcc1c0fefc0 2023-10-18T14:02:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc22d62700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c19e290 con 0x7fcc1c19d6a0 2023-10-18T14:02:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc22d62700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c19e450 con 0x7fcc1c104090 2023-10-18T14:02:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc20afe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1c0fefc0 0x7fcc1c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc20afe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1c0fefc0 0x7fcc1c198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42554/0 (socket says 172.21.15.114:42554) 2023-10-18T14:02:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc20afe700 1 -- 172.21.15.114:0/3882958878 learned_addr learned my addr 172.21.15.114:0/3882958878 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc1bfff700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc1c104090 0x7fcc1c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc20afe700 1 -- 172.21.15.114:0/3882958878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc1c104090 msgr2=0x7fcc1c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc212ff700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc1c19d6a0 0x7fcc1c19db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc20afe700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc1c104090 0x7fcc1c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc20afe700 1 -- 172.21.15.114:0/3882958878 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc1c19d6a0 msgr2=0x7fcc1c19db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc20afe700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc1c19d6a0 0x7fcc1c19db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc20afe700 1 -- 172.21.15.114:0/3882958878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc100095f0 con 0x7fcc1c0fefc0 2023-10-18T14:02:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc1bfff700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc1c104090 0x7fcc1c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc20afe700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1c0fefc0 0x7fcc1c198dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcc100098e0 tx=0x7fcc1000f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc19ffb700 1 -- 172.21.15.114:0/3882958878 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1001d070 con 0x7fcc1c0fefc0 2023-10-18T14:02:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc19ffb700 1 -- 172.21.15.114:0/3882958878 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc1000fb90 con 0x7fcc1c0fefc0 2023-10-18T14:02:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc22d62700 1 -- 172.21.15.114:0/3882958878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c1a5950 con 0x7fcc1c0fefc0 2023-10-18T14:02:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.595+0000 7fcc19ffb700 1 -- 172.21.15.114:0/3882958878 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10017650 con 0x7fcc1c0fefc0 2023-10-18T14:02:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.596+0000 7fcc22d62700 1 -- 172.21.15.114:0/3882958878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c1a5dd0 con 0x7fcc1c0fefc0 2023-10-18T14:02:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.597+0000 7fcc22d62700 1 -- 172.21.15.114:0/3882958878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c10b710 con 0x7fcc1c0fefc0 2023-10-18T14:02:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.598+0000 7fcc19ffb700 1 -- 172.21.15.114:0/3882958878 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fcc1000fd00 con 0x7fcc1c0fefc0 2023-10-18T14:02:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.598+0000 7fcc19ffb700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fcc0c0a1550 0x7fcc0c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.598+0000 7fcc19ffb700 1 -- 172.21.15.114:0/3882958878 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fcc100ce0e0 con 0x7fcc1c0fefc0 2023-10-18T14:02:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.598+0000 7fcc1bfff700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fcc0c0a1550 0x7fcc0c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.599+0000 7fcc1bfff700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fcc0c0a1550 0x7fcc0c0a3a10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c19a310 tx=0x7fcc08008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.602+0000 7fcc19ffb700 1 -- 172.21.15.114:0/3882958878 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcc100977f0 con 0x7fcc1c0fefc0 2023-10-18T14:02:39.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.839+0000 7fcc22d62700 1 -- 172.21.15.114:0/3882958878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc1c19a0c0 con 0x7fcc1c0fefc0 2023-10-18T14:02:39.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.840+0000 7fcc19ffb700 1 -- 172.21.15.114:0/3882958878 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11390 (secure 0 0 0) 0x7fcc1009ae10 con 0x7fcc1c0fefc0 2023-10-18T14:02:39.844 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:39.844 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:02:39.260198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:02:39.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.842+0000 7fcc22d62700 1 -- 172.21.15.114:0/3882958878 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fcc0c0a1550 msgr2=0x7fcc0c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.842+0000 7fcc22d62700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fcc0c0a1550 0x7fcc0c0a3a10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c19a310 tx=0x7fcc08008040 comp rx=0 tx=0).stop 2023-10-18T14:02:39.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.842+0000 7fcc22d62700 1 -- 172.21.15.114:0/3882958878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1c0fefc0 msgr2=0x7fcc1c198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.842+0000 7fcc22d62700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1c0fefc0 0x7fcc1c198dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcc100098e0 tx=0x7fcc1000f720 comp rx=0 tx=0).stop 2023-10-18T14:02:39.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.842+0000 7fcc22d62700 1 -- 172.21.15.114:0/3882958878 shutdown_connections 2023-10-18T14:02:39.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.842+0000 7fcc22d62700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fcc0c0a1550 0x7fcc0c0a3a10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.842+0000 7fcc22d62700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcc1c19d6a0 0x7fcc1c19db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.842+0000 7fcc22d62700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1c0fefc0 0x7fcc1c198dc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.842+0000 7fcc22d62700 1 --2- 172.21.15.114:0/3882958878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc1c104090 0x7fcc1c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.842+0000 7fcc22d62700 1 -- 172.21.15.114:0/3882958878 >> 172.21.15.114:0/3882958878 conn(0x7fcc1c075b90 msgr2=0x7fcc1c102550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:39.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.842+0000 7fcc22d62700 1 -- 172.21.15.114:0/3882958878 shutdown_connections 2023-10-18T14:02:39.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.842+0000 7fcc22d62700 1 -- 172.21.15.114:0/3882958878 wait complete. 2023-10-18T14:02:39.849 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2023-10-18T14:02:39.859 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:02:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.977+0000 7fc45101a700 1 -- 172.21.15.114:0/2969190920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc44c100290 msgr2=0x7fc44c10c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.977+0000 7fc45101a700 1 --2- 172.21.15.114:0/2969190920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc44c100290 0x7fc44c10c420 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc44400b0a0 tx=0x7fc44400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.977+0000 7fc45101a700 1 -- 172.21.15.114:0/2969190920 shutdown_connections 2023-10-18T14:02:39.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.977+0000 7fc45101a700 1 --2- 172.21.15.114:0/2969190920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc44c100290 0x7fc44c10c420 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.977+0000 7fc45101a700 1 --2- 172.21.15.114:0/2969190920 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc44c105710 0x7fc44c105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.977+0000 7fc45101a700 1 --2- 172.21.15.114:0/2969190920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc44c0ff8d0 0x7fc44c0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.977+0000 7fc45101a700 1 -- 172.21.15.114:0/2969190920 >> 172.21.15.114:0/2969190920 conn(0x7fc44c076400 msgr2=0x7fc44c076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:39.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.977+0000 7fc45101a700 1 -- 172.21.15.114:0/2969190920 shutdown_connections 2023-10-18T14:02:39.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.977+0000 7fc45101a700 1 -- 172.21.15.114:0/2969190920 wait complete. 2023-10-18T14:02:39.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.977+0000 7fc45101a700 1 Processor -- start 2023-10-18T14:02:39.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc45101a700 1 -- start start 2023-10-18T14:02:39.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc45101a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc44c0ff8d0 0x7fc44c19c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:39.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc45101a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc44c100290 0x7fc44c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:39.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc45101a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc44c105710 0x7fc44c1969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:39.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc45101a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c1971b0 con 0x7fc44c100290 2023-10-18T14:02:39.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc45101a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c197320 con 0x7fc44c105710 2023-10-18T14:02:39.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc45101a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c1974e0 con 0x7fc44c0ff8d0 2023-10-18T14:02:39.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc44a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc44c100290 0x7fc44c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:39.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc44a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc44c100290 0x7fc44c19ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42570/0 (socket says 172.21.15.114:42570) 2023-10-18T14:02:39.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc44a59c700 1 -- 172.21.15.114:0/449068693 learned_addr learned my addr 172.21.15.114:0/449068693 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:39.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc44ad9d700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc44c0ff8d0 0x7fc44c19c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:39.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc44b59e700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc44c105710 0x7fc44c1969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:39.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc44a59c700 1 -- 172.21.15.114:0/449068693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc44c0ff8d0 msgr2=0x7fc44c19c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc44a59c700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc44c0ff8d0 0x7fc44c19c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc44a59c700 1 -- 172.21.15.114:0/449068693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc44c105710 msgr2=0x7fc44c1969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:39.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc44a59c700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc44c105710 0x7fc44c1969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:39.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc44a59c700 1 -- 172.21.15.114:0/449068693 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc444009d00 con 0x7fc44c100290 2023-10-18T14:02:39.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc44b59e700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc44c105710 0x7fc44c1969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:39.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc44a59c700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc44c100290 0x7fc44c19ce80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00e9a0 tx=0x7fc43c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:39.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.978+0000 7fc433fff700 1 -- 172.21.15.114:0/449068693 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c009790 con 0x7fc44c100290 2023-10-18T14:02:39.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.979+0000 7fc45101a700 1 -- 172.21.15.114:0/449068693 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44c1977c0 con 0x7fc44c100290 2023-10-18T14:02:39.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.979+0000 7fc433fff700 1 -- 172.21.15.114:0/449068693 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc43c00cbd0 con 0x7fc44c100290 2023-10-18T14:02:39.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.979+0000 7fc433fff700 1 -- 172.21.15.114:0/449068693 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c018680 con 0x7fc44c100290 2023-10-18T14:02:39.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.979+0000 7fc45101a700 1 -- 172.21.15.114:0/449068693 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44c1a3910 con 0x7fc44c100290 2023-10-18T14:02:39.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.979+0000 7fc45101a700 1 -- 172.21.15.114:0/449068693 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44c100cc0 con 0x7fc44c100290 2023-10-18T14:02:39.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.981+0000 7fc433fff700 1 -- 172.21.15.114:0/449068693 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fc43c00cd40 con 0x7fc44c100290 2023-10-18T14:02:39.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.981+0000 7fc433fff700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc4340a14d0 0x7fc4340a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:39.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.981+0000 7fc44ad9d700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc4340a14d0 0x7fc4340a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:39.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.981+0000 7fc433fff700 1 -- 172.21.15.114:0/449068693 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fc43c014070 con 0x7fc44c100290 2023-10-18T14:02:39.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.982+0000 7fc44ad9d700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc4340a14d0 0x7fc4340a3990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc440005950 tx=0x7fc4400058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:39.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:39.985+0000 7fc433fff700 1 -- 172.21.15.114:0/449068693 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc43c096b90 con 0x7fc44c100290 2023-10-18T14:02:40.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.178+0000 7fc45101a700 1 -- 172.21.15.114:0/449068693 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc44c067530 con 0x7fc44c100290 2023-10-18T14:02:40.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.180+0000 7fc433fff700 1 -- 172.21.15.114:0/449068693 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22520 (secure 0 0 0) 0x7fc43c09a1b0 con 0x7fc44c100290 2023-10-18T14:02:40.184 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:40.184 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":83,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:02:33.431521+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:02:40.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.182+0000 7fc45101a700 1 -- 172.21.15.114:0/449068693 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc4340a14d0 msgr2=0x7fc4340a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:40.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.182+0000 7fc45101a700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc4340a14d0 0x7fc4340a3990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc440005950 tx=0x7fc4400058e0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.182+0000 7fc45101a700 1 -- 172.21.15.114:0/449068693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc44c100290 msgr2=0x7fc44c19ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:40.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.182+0000 7fc45101a700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc44c100290 0x7fc44c19ce80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00e9a0 tx=0x7fc43c00ed60 comp rx=0 tx=0).stop 2023-10-18T14:02:40.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.182+0000 7fc45101a700 1 -- 172.21.15.114:0/449068693 shutdown_connections 2023-10-18T14:02:40.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.182+0000 7fc45101a700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc4340a14d0 0x7fc4340a3990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.182+0000 7fc45101a700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc44c105710 0x7fc44c1969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.182+0000 7fc45101a700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc44c0ff8d0 0x7fc44c19c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.182+0000 7fc45101a700 1 --2- 172.21.15.114:0/449068693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc44c100290 0x7fc44c19ce80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.182+0000 7fc45101a700 1 -- 172.21.15.114:0/449068693 >> 172.21.15.114:0/449068693 conn(0x7fc44c076400 msgr2=0x7fc44c0679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:40.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.182+0000 7fc45101a700 1 -- 172.21.15.114:0/449068693 shutdown_connections 2023-10-18T14:02:40.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.182+0000 7fc45101a700 1 -- 172.21.15.114:0/449068693 wait complete. 2023-10-18T14:02:40.197 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:39 smithi114 ceph-mon[99494]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:40.197 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:39 smithi114 ceph-mon[99494]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:40.197 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:39 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] up:active 2023-10-18T14:02:40.198 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:39 smithi114 ceph-mon[99494]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-18T14:02:40.198 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:39 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:02:40.198 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:39 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3882958878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:40.201 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-18T14:02:40.201 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T14:02:40.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:39 smithi158 ceph-mon[103317]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:40.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:39 smithi158 ceph-mon[103317]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:40.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:39 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] up:active 2023-10-18T14:02:40.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:39 smithi158 ceph-mon[103317]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-18T14:02:40.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:39 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:02:40.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:39 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3882958878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:40.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:39 smithi172 ceph-mon[103574]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:40.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:39 smithi172 ceph-mon[103574]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:40.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:39 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] up:active 2023-10-18T14:02:40.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:39 smithi172 ceph-mon[103574]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-18T14:02:40.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:39 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:02:40.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:39 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3882958878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:02:40.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.324+0000 7fb01544b700 1 -- 172.21.15.114:0/3707437578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0100ffc60 msgr2=0x7fb010105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:40.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.324+0000 7fb01544b700 1 --2- 172.21.15.114:0/3707437578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0100ffc60 0x7fb010105390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb000009990 tx=0x7fb000009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.324+0000 7fb01544b700 1 -- 172.21.15.114:0/3707437578 shutdown_connections 2023-10-18T14:02:40.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.324+0000 7fb01544b700 1 --2- 172.21.15.114:0/3707437578 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb010105ac0 0x7fb01010d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.324+0000 7fb01544b700 1 --2- 172.21.15.114:0/3707437578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0100ff2b0 0x7fb0100ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.324+0000 7fb01544b700 1 --2- 172.21.15.114:0/3707437578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0100ffc60 0x7fb010105390 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.324+0000 7fb01544b700 1 -- 172.21.15.114:0/3707437578 >> 172.21.15.114:0/3707437578 conn(0x7fb0100748d0 msgr2=0x7fb010074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:40.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.324+0000 7fb01544b700 1 -- 172.21.15.114:0/3707437578 shutdown_connections 2023-10-18T14:02:40.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.324+0000 7fb01544b700 1 -- 172.21.15.114:0/3707437578 wait complete. 2023-10-18T14:02:40.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.325+0000 7fb01544b700 1 Processor -- start 2023-10-18T14:02:40.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.325+0000 7fb01544b700 1 -- start start 2023-10-18T14:02:40.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.325+0000 7fb01544b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0100ff2b0 0x7fb01019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:40.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.325+0000 7fb01544b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010105ac0 0x7fb01019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:40.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.325+0000 7fb01544b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb010194810 0x7fb010194cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:40.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.325+0000 7fb01544b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb010195290 con 0x7fb010105ac0 2023-10-18T14:02:40.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.325+0000 7fb01544b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0101953d0 con 0x7fb010194810 2023-10-18T14:02:40.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.325+0000 7fb01544b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb010195590 con 0x7fb0100ff2b0 2023-10-18T14:02:40.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.325+0000 7fb00e7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010105ac0 0x7fb01019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:40.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.325+0000 7fb00e7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010105ac0 0x7fb01019ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42584/0 (socket says 172.21.15.114:42584) 2023-10-18T14:02:40.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.325+0000 7fb00e7fc700 1 -- 172.21.15.114:0/3479443950 learned_addr learned my addr 172.21.15.114:0/3479443950 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:40.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.325+0000 7fb00effd700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0100ff2b0 0x7fb01019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:40.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.326+0000 7fb00e7fc700 1 -- 172.21.15.114:0/3479443950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0100ff2b0 msgr2=0x7fb01019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:40.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.326+0000 7fb00e7fc700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0100ff2b0 0x7fb01019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.326+0000 7fb00e7fc700 1 -- 172.21.15.114:0/3479443950 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb010194810 msgr2=0x7fb010194cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:40.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.326+0000 7fb00f7fe700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb010194810 0x7fb010194cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:40.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.326+0000 7fb00e7fc700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb010194810 0x7fb010194cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.326+0000 7fb00e7fc700 1 -- 172.21.15.114:0/3479443950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0000095f0 con 0x7fb010105ac0 2023-10-18T14:02:40.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.326+0000 7fb00f7fe700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb010194810 0x7fb010194cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:40.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.326+0000 7fb00e7fc700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010105ac0 0x7fb01019ac20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb000000c00 tx=0x7fb0000036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:40.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.326+0000 7fb007fff700 1 -- 172.21.15.114:0/3479443950 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00001d070 con 0x7fb010105ac0 2023-10-18T14:02:40.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.326+0000 7fb007fff700 1 -- 172.21.15.114:0/3479443950 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb00000fb30 con 0x7fb010105ac0 2023-10-18T14:02:40.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.326+0000 7fb01544b700 1 -- 172.21.15.114:0/3479443950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0101a14f0 con 0x7fb010105ac0 2023-10-18T14:02:40.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.326+0000 7fb007fff700 1 -- 172.21.15.114:0/3479443950 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000022bb0 con 0x7fb010105ac0 2023-10-18T14:02:40.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.326+0000 7fb01544b700 1 -- 172.21.15.114:0/3479443950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0101a19c0 con 0x7fb010105ac0 2023-10-18T14:02:40.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.327+0000 7fb01544b700 1 -- 172.21.15.114:0/3479443950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb010108c90 con 0x7fb010105ac0 2023-10-18T14:02:40.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.328+0000 7fb007fff700 1 -- 172.21.15.114:0/3479443950 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fb00000fca0 con 0x7fb010105ac0 2023-10-18T14:02:40.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.328+0000 7fb007fff700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faffc0a15e0 0x7faffc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:40.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.328+0000 7fb00effd700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faffc0a15e0 0x7faffc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.328+0000 7fb007fff700 1 -- 172.21.15.114:0/3479443950 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fb0000ce490 con 0x7fb010105ac0 2023-10-18T14:02:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.329+0000 7fb00effd700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faffc0a15e0 0x7faffc0a3aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faff8005950 tx=0x7faff800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.333+0000 7fb007fff700 1 -- 172.21.15.114:0/3479443950 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb000097a40 con 0x7fb010105ac0 2023-10-18T14:02:40.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.525+0000 7fb01544b700 1 -- 172.21.15.114:0/3479443950 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb010195cd0 con 0x7faffc0a15e0 2023-10-18T14:02:40.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.535+0000 7fb007fff700 1 -- 172.21.15.114:0/3479443950 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+337281 (secure 0 0 0) 0x7fb010195cd0 con 0x7faffc0a15e0 2023-10-18T14:02:40.543 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:40.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.539+0000 7fb01544b700 1 -- 172.21.15.114:0/3479443950 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faffc0a15e0 msgr2=0x7faffc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:40.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.539+0000 7fb01544b700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faffc0a15e0 0x7faffc0a3aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faff8005950 tx=0x7faff800b410 comp rx=0 tx=0).stop 2023-10-18T14:02:40.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.539+0000 7fb01544b700 1 -- 172.21.15.114:0/3479443950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010105ac0 msgr2=0x7fb01019ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:40.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.539+0000 7fb01544b700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010105ac0 0x7fb01019ac20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb000000c00 tx=0x7fb0000036f0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.539+0000 7fb01544b700 1 -- 172.21.15.114:0/3479443950 shutdown_connections 2023-10-18T14:02:40.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.539+0000 7fb01544b700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faffc0a15e0 0x7faffc0a3aa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.539+0000 7fb01544b700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb010194810 0x7fb010194cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.539+0000 7fb01544b700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0100ff2b0 0x7fb01019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.539+0000 7fb01544b700 1 --2- 172.21.15.114:0/3479443950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb010105ac0 0x7fb01019ac20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.539+0000 7fb01544b700 1 -- 172.21.15.114:0/3479443950 >> 172.21.15.114:0/3479443950 conn(0x7fb0100748d0 msgr2=0x7fb0100fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:40.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.539+0000 7fb01544b700 1 -- 172.21.15.114:0/3479443950 shutdown_connections 2023-10-18T14:02:40.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.539+0000 7fb01544b700 1 -- 172.21.15.114:0/3479443950 wait complete. 2023-10-18T14:02:40.548 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T14:02:40.555 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2023-10-18T14:02:39.558706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596172,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":148,"num_read_kb":130,"num_write":310,"num_write_kb":2977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":251,"ondisk_log_size":251,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335036,"kb_used_data":10812,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606788,"statfs":{"total":1151940427776,"available":1151597350912,"internally_reserved":0,"allocated":11071488,"data_stored":7086263,"data_compressed":108561,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5804,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":129,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.727844"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436981+0000","last_change":"2023-10-18T14:02:32.447514+0000","last_active":"2023-10-18T14:02:33.436981+0000","last_peered":"2023-10-18T14:02:33.436981+0000","last_clean":"2023-10-18T14:02:33.436981+0000","last_became_active":"2023-10-18T14:02:32.447109+0000","last_became_peered":"2023-10-18T14:02:32.447109+0000","last_unstale":"2023-10-18T14:02:33.436981+0000","last_undegraded":"2023-10-18T14:02:33.436981+0000","last_fullsized":"2023-10-18T14:02:33.436981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:02:52.453371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868453+0000","last_change":"2023-10-18T14:02:32.457696+0000","last_active":"2023-10-18T14:02:33.868453+0000","last_peered":"2023-10-18T14:02:33.868453+0000","last_clean":"2023-10-18T14:02:33.868453+0000","last_became_active":"2023-10-18T14:02:32.457380+0000","last_became_peered":"2023-10-18T14:02:32.457380+0000","last_unstale":"2023-10-18T14:02:33.868453+0000","last_undegraded":"2023-10-18T14:02:33.868453+0000","last_fullsized":"2023-10-18T14:02:33.868453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:09:09.303044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.869225+0000","last_change":"2023-10-18T14:02:32.450312+0000","last_active":"2023-10-18T14:02:33.869225+0000","last_peered":"2023-10-18T14:02:33.869225+0000","last_clean":"2023-10-18T14:02:33.869225+0000","last_became_active":"2023-10-18T14:02:32.449994+0000","last_became_peered":"2023-10-18T14:02:32.449994+0000","last_unstale":"2023-10-18T14:02:33.869225+0000","last_undegraded":"2023-10-18T14:02:33.869225+0000","last_fullsized":"2023-10-18T14:02:33.869225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:28:32.445958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868018+0000","last_change":"2023-10-18T14:02:32.450511+0000","last_active":"2023-10-18T14:02:33.868018+0000","last_peered":"2023-10-18T14:02:33.868018+0000","last_clean":"2023-10-18T14:02:33.868018+0000","last_became_active":"2023-10-18T14:02:32.450105+0000","last_became_peered":"2023-10-18T14:02:32.450105+0000","last_unstale":"2023-10-18T14:02:33.868018+0000","last_undegraded":"2023-10-18T14:02:33.868018+0000","last_fullsized":"2023-10-18T14:02:33.868018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:24:52.054236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867921+0000","last_change":"2023-10-18T14:02:32.447099+0000","last_active":"2023-10-18T14:02:33.867921+0000","last_peered":"2023-10-18T14:02:33.867921+0000","last_clean":"2023-10-18T14:02:33.867921+0000","last_became_active":"2023-10-18T14:02:32.446812+0000","last_became_peered":"2023-10-18T14:02:32.446812+0000","last_unstale":"2023-10-18T14:02:33.867921+0000","last_undegraded":"2023-10-18T14:02:33.867921+0000","last_fullsized":"2023-10-18T14:02:33.867921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:11:10.895149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436985+0000","last_change":"2023-10-18T14:02:32.444055+0000","last_active":"2023-10-18T14:02:33.436985+0000","last_peered":"2023-10-18T14:02:33.436985+0000","last_clean":"2023-10-18T14:02:33.436985+0000","last_became_active":"2023-10-18T14:02:32.443750+0000","last_became_peered":"2023-10-18T14:02:32.443750+0000","last_unstale":"2023-10-18T14:02:33.436985+0000","last_undegraded":"2023-10-18T14:02:33.436985+0000","last_fullsized":"2023-10-18T14:02:33.436985+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:05:37.783713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027113+0000","last_change":"2023-10-18T14:02:32.462147+0000","last_active":"2023-10-18T14:02:34.027113+0000","last_peered":"2023-10-18T14:02:34.027113+0000","last_clean":"2023-10-18T14:02:34.027113+0000","last_became_active":"2023-10-18T14:02:32.461712+0000","last_became_peered":"2023-10-18T14:02:32.461712+0000","last_unstale":"2023-10-18T14:02:34.027113+0000","last_undegraded":"2023-10-18T14:02:34.027113+0000","last_fullsized":"2023-10-18T14:02:34.027113+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:10:39.936092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867458+0000","last_change":"2023-10-18T14:02:32.449466+0000","last_active":"2023-10-18T14:02:33.867458+0000","last_peered":"2023-10-18T14:02:33.867458+0000","last_clean":"2023-10-18T14:02:33.867458+0000","last_became_active":"2023-10-18T14:02:32.449146+0000","last_became_peered":"2023-10-18T14:02:32.449146+0000","last_unstale":"2023-10-18T14:02:33.867458+0000","last_undegraded":"2023-10-18T14:02:33.867458+0000","last_fullsized":"2023-10-18T14:02:33.867458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:28.427003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868312+0000","last_change":"2023-10-18T14:02:32.448901+0000","last_active":"2023-10-18T14:02:33.868312+0000","last_peered":"2023-10-18T14:02:33.868312+0000","last_clean":"2023-10-18T14:02:33.868312+0000","last_became_active":"2023-10-18T14:02:32.448379+0000","last_became_peered":"2023-10-18T14:02:32.448379+0000","last_unstale":"2023-10-18T14:02:33.868312+0000","last_undegraded":"2023-10-18T14:02:33.868312+0000","last_fullsized":"2023-10-18T14:02:33.868312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:53:22.743915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.437181+0000","last_change":"2023-10-18T14:02:32.446575+0000","last_active":"2023-10-18T14:02:33.437181+0000","last_peered":"2023-10-18T14:02:33.437181+0000","last_clean":"2023-10-18T14:02:33.437181+0000","last_became_active":"2023-10-18T14:02:32.445756+0000","last_became_peered":"2023-10-18T14:02:32.445756+0000","last_unstale":"2023-10-18T14:02:33.437181+0000","last_undegraded":"2023-10-18T14:02:33.437181+0000","last_fullsized":"2023-10-18T14:02:33.437181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:55.490373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027484+0000","last_change":"2023-10-18T14:02:32.460943+0000","last_active":"2023-10-18T14:02:34.027484+0000","last_peered":"2023-10-18T14:02:34.027484+0000","last_clean":"2023-10-18T14:02:34.027484+0000","last_became_active":"2023-10-18T14:02:32.460540+0000","last_became_peered":"2023-10-18T14:02:32.460540+0000","last_unstale":"2023-10-18T14:02:34.027484+0000","last_undegraded":"2023-10-18T14:02:34.027484+0000","last_fullsized":"2023-10-18T14:02:34.027484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:44:59.309663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867893+0000","last_change":"2023-10-18T14:02:32.450665+0000","last_active":"2023-10-18T14:02:33.867893+0000","last_peered":"2023-10-18T14:02:33.867893+0000","last_clean":"2023-10-18T14:02:33.867893+0000","last_became_active":"2023-10-18T14:02:32.450286+0000","last_became_peered":"2023-10-18T14:02:32.450286+0000","last_unstale":"2023-10-18T14:02:33.867893+0000","last_undegraded":"2023-10-18T14:02:33.867893+0000","last_fullsized":"2023-10-18T14:02:33.867893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:01:17.874856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436541+0000","last_change":"2023-10-18T14:02:32.444129+0000","last_active":"2023-10-18T14:02:33.436541+0000","last_peered":"2023-10-18T14:02:33.436541+0000","last_clean":"2023-10-18T14:02:33.436541+0000","last_became_active":"2023-10-18T14:02:32.443898+0000","last_became_peered":"2023-10-18T14:02:32.443898+0000","last_unstale":"2023-10-18T14:02:33.436541+0000","last_undegraded":"2023-10-18T14:02:33.436541+0000","last_fullsized":"2023-10-18T14:02:33.436541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:20:35.391806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867805+0000","last_change":"2023-10-18T14:02:32.457637+0000","last_active":"2023-10-18T14:02:33.867805+0000","last_peered":"2023-10-18T14:02:33.867805+0000","last_clean":"2023-10-18T14:02:33.867805+0000","last_became_active":"2023-10-18T14:02:32.457345+0000","last_became_peered":"2023-10-18T14:02:32.457345+0000","last_unstale":"2023-10-18T14:02:33.867805+0000","last_undegraded":"2023-10-18T14:02:33.867805+0000","last_fullsized":"2023-10-18T14:02:33.867805+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:18:47.579689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867599+0000","last_change":"2023-10-18T14:02:32.449765+0000","last_active":"2023-10-18T14:02:33.867599+0000","last_peered":"2023-10-18T14:02:33.867599+0000","last_clean":"2023-10-18T14:02:33.867599+0000","last_became_active":"2023-10-18T14:02:32.449467+0000","last_became_peered":"2023-10-18T14:02:32.449467+0000","last_unstale":"2023-10-18T14:02:33.867599+0000","last_undegraded":"2023-10-18T14:02:33.867599+0000","last_fullsized":"2023-10-18T14:02:33.867599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:09:15.324290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867400+0000","last_change":"2023-10-18T14:02:32.456634+0000","last_active":"2023-10-18T14:02:33.867400+0000","last_peered":"2023-10-18T14:02:33.867400+0000","last_clean":"2023-10-18T14:02:33.867400+0000","last_became_active":"2023-10-18T14:02:32.456336+0000","last_became_peered":"2023-10-18T14:02:32.456336+0000","last_unstale":"2023-10-18T14:02:33.867400+0000","last_undegraded":"2023-10-18T14:02:33.867400+0000","last_fullsized":"2023-10-18T14:02:33.867400+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:29:47.973539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.437009+0000","last_change":"2023-10-18T14:02:32.447357+0000","last_active":"2023-10-18T14:02:33.437009+0000","last_peered":"2023-10-18T14:02:33.437009+0000","last_clean":"2023-10-18T14:02:33.437009+0000","last_became_active":"2023-10-18T14:02:32.446756+0000","last_became_peered":"2023-10-18T14:02:32.446756+0000","last_unstale":"2023-10-18T14:02:33.437009+0000","last_undegraded":"2023-10-18T14:02:33.437009+0000","last_fullsized":"2023-10-18T14:02:33.437009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:13:22.467662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867665+0000","last_change":"2023-10-18T14:02:32.452786+0000","last_active":"2023-10-18T14:02:33.867665+0000","last_peered":"2023-10-18T14:02:33.867665+0000","last_clean":"2023-10-18T14:02:33.867665+0000","last_became_active":"2023-10-18T14:02:32.452551+0000","last_became_peered":"2023-10-18T14:02:32.452551+0000","last_unstale":"2023-10-18T14:02:33.867665+0000","last_undegraded":"2023-10-18T14:02:33.867665+0000","last_fullsized":"2023-10-18T14:02:33.867665+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:07.709943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867958+0000","last_change":"2023-10-18T14:02:32.453264+0000","last_active":"2023-10-18T14:02:33.867958+0000","last_peered":"2023-10-18T14:02:33.867958+0000","last_clean":"2023-10-18T14:02:33.867958+0000","last_became_active":"2023-10-18T14:02:32.452948+0000","last_became_peered":"2023-10-18T14:02:32.452948+0000","last_unstale":"2023-10-18T14:02:33.867958+0000","last_undegraded":"2023-10-18T14:02:33.867958+0000","last_fullsized":"2023-10-18T14:02:33.867958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:00:55.243191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867864+0000","last_change":"2023-10-18T14:02:31.843752+0000","last_active":"2023-10-18T14:02:33.867864+0000","last_peered":"2023-10-18T14:02:33.867864+0000","last_clean":"2023-10-18T14:02:33.867864+0000","last_became_active":"2023-10-18T14:02:31.843415+0000","last_became_peered":"2023-10-18T14:02:31.843415+0000","last_unstale":"2023-10-18T14:02:33.867864+0000","last_undegraded":"2023-10-18T14:02:33.867864+0000","last_fullsized":"2023-10-18T14:02:33.867864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:32:11.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868563+0000","last_change":"2023-10-18T14:02:32.458934+0000","last_active":"2023-10-18T14:02:33.868563+0000","last_peered":"2023-10-18T14:02:33.868563+0000","last_clean":"2023-10-18T14:02:33.868563+0000","last_became_active":"2023-10-18T14:02:32.458624+0000","last_became_peered":"2023-10-18T14:02:32.458624+0000","last_unstale":"2023-10-18T14:02:33.868563+0000","last_undegraded":"2023-10-18T14:02:33.868563+0000","last_fullsized":"2023-10-18T14:02:33.868563+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:24:20.034637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868723+0000","last_change":"2023-10-18T14:02:31.842666+0000","last_active":"2023-10-18T14:02:33.868723+0000","last_peered":"2023-10-18T14:02:33.868723+0000","last_clean":"2023-10-18T14:02:33.868723+0000","last_became_active":"2023-10-18T14:02:31.842366+0000","last_became_peered":"2023-10-18T14:02:31.842366+0000","last_unstale":"2023-10-18T14:02:33.868723+0000","last_undegraded":"2023-10-18T14:02:33.868723+0000","last_fullsized":"2023-10-18T14:02:33.868723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:11:08.150402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868771+0000","last_change":"2023-10-18T14:02:32.453731+0000","last_active":"2023-10-18T14:02:33.868771+0000","last_peered":"2023-10-18T14:02:33.868771+0000","last_clean":"2023-10-18T14:02:33.868771+0000","last_became_active":"2023-10-18T14:02:32.453405+0000","last_became_peered":"2023-10-18T14:02:32.453405+0000","last_unstale":"2023-10-18T14:02:33.868771+0000","last_undegraded":"2023-10-18T14:02:33.868771+0000","last_fullsized":"2023-10-18T14:02:33.868771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:19:57.878074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'11","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.267496+0000","last_change":"2023-10-18T14:02:31.851514+0000","last_active":"2023-10-18T14:02:38.267496+0000","last_peered":"2023-10-18T14:02:38.267496+0000","last_clean":"2023-10-18T14:02:38.267496+0000","last_became_active":"2023-10-18T14:02:31.851236+0000","last_became_peered":"2023-10-18T14:02:31.851236+0000","last_unstale":"2023-10-18T14:02:38.267496+0000","last_undegraded":"2023-10-18T14:02:38.267496+0000","last_fullsized":"2023-10-18T14:02:38.267496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:35:26.804135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868449+0000","last_change":"2023-10-18T14:02:32.460018+0000","last_active":"2023-10-18T14:02:33.868449+0000","last_peered":"2023-10-18T14:02:33.868449+0000","last_clean":"2023-10-18T14:02:33.868449+0000","last_became_active":"2023-10-18T14:02:32.459738+0000","last_became_peered":"2023-10-18T14:02:32.459738+0000","last_unstale":"2023-10-18T14:02:33.868449+0000","last_undegraded":"2023-10-18T14:02:33.868449+0000","last_fullsized":"2023-10-18T14:02:33.868449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:48.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.267543+0000","last_change":"2023-10-18T14:02:31.850112+0000","last_active":"2023-10-18T14:02:38.267543+0000","last_peered":"2023-10-18T14:02:38.267543+0000","last_clean":"2023-10-18T14:02:38.267543+0000","last_became_active":"2023-10-18T14:02:31.849515+0000","last_became_peered":"2023-10-18T14:02:31.849515+0000","last_unstale":"2023-10-18T14:02:38.267543+0000","last_undegraded":"2023-10-18T14:02:38.267543+0000","last_fullsized":"2023-10-18T14:02:38.267543+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:35:20.338900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868609+0000","last_change":"2023-10-18T14:02:32.459221+0000","last_active":"2023-10-18T14:02:33.868609+0000","last_peered":"2023-10-18T14:02:33.868609+0000","last_clean":"2023-10-18T14:02:33.868609+0000","last_became_active":"2023-10-18T14:02:32.458912+0000","last_became_peered":"2023-10-18T14:02:32.458912+0000","last_unstale":"2023-10-18T14:02:33.868609+0000","last_undegraded":"2023-10-18T14:02:33.868609+0000","last_fullsized":"2023-10-18T14:02:33.868609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:54:02.630861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.875520+0000","last_change":"2023-10-18T14:02:31.846754+0000","last_active":"2023-10-18T14:02:35.875520+0000","last_peered":"2023-10-18T14:02:35.875520+0000","last_clean":"2023-10-18T14:02:35.875520+0000","last_became_active":"2023-10-18T14:02:31.846450+0000","last_became_peered":"2023-10-18T14:02:31.846450+0000","last_unstale":"2023-10-18T14:02:35.875520+0000","last_undegraded":"2023-10-18T14:02:35.875520+0000","last_fullsized":"2023-10-18T14:02:35.875520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:11.929528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867981+0000","last_change":"2023-10-18T14:02:32.456175+0000","last_active":"2023-10-18T14:02:33.867981+0000","last_peered":"2023-10-18T14:02:33.867981+0000","last_clean":"2023-10-18T14:02:33.867981+0000","last_became_active":"2023-10-18T14:02:32.455839+0000","last_became_peered":"2023-10-18T14:02:32.455839+0000","last_unstale":"2023-10-18T14:02:33.867981+0000","last_undegraded":"2023-10-18T14:02:33.867981+0000","last_fullsized":"2023-10-18T14:02:33.867981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:48:14.035082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436825+0000","last_change":"2023-10-18T14:02:31.846135+0000","last_active":"2023-10-18T14:02:33.436825+0000","last_peered":"2023-10-18T14:02:33.436825+0000","last_clean":"2023-10-18T14:02:33.436825+0000","last_became_active":"2023-10-18T14:02:31.845800+0000","last_became_peered":"2023-10-18T14:02:31.845800+0000","last_unstale":"2023-10-18T14:02:33.436825+0000","last_undegraded":"2023-10-18T14:02:33.436825+0000","last_fullsized":"2023-10-18T14:02:33.436825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:22:55.945930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868304+0000","last_change":"2023-10-18T14:02:32.445803+0000","last_active":"2023-10-18T14:02:33.868304+0000","last_peered":"2023-10-18T14:02:33.868304+0000","last_clean":"2023-10-18T14:02:33.868304+0000","last_became_active":"2023-10-18T14:02:32.445489+0000","last_became_peered":"2023-10-18T14:02:32.445489+0000","last_unstale":"2023-10-18T14:02:33.868304+0000","last_undegraded":"2023-10-18T14:02:33.868304+0000","last_fullsized":"2023-10-18T14:02:33.868304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:38:46.101215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:36.878888+0000","last_change":"2023-10-18T14:02:31.843827+0000","last_active":"2023-10-18T14:02:36.878888+0000","last_peered":"2023-10-18T14:02:36.878888+0000","last_clean":"2023-10-18T14:02:36.878888+0000","last_became_active":"2023-10-18T14:02:31.843533+0000","last_became_peered":"2023-10-18T14:02:31.843533+0000","last_unstale":"2023-10-18T14:02:36.878888+0000","last_undegraded":"2023-10-18T14:02:36.878888+0000","last_fullsized":"2023-10-18T14:02:36.878888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:00:03.832002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867605+0000","last_change":"2023-10-18T14:02:32.447400+0000","last_active":"2023-10-18T14:02:33.867605+0000","last_peered":"2023-10-18T14:02:33.867605+0000","last_clean":"2023-10-18T14:02:33.867605+0000","last_became_active":"2023-10-18T14:02:32.447024+0000","last_became_peered":"2023-10-18T14:02:32.447024+0000","last_unstale":"2023-10-18T14:02:33.867605+0000","last_undegraded":"2023-10-18T14:02:33.867605+0000","last_fullsized":"2023-10-18T14:02:33.867605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:49:37.596273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868529+0000","last_change":"2023-10-18T14:02:31.847527+0000","last_active":"2023-10-18T14:02:33.868529+0000","last_peered":"2023-10-18T14:02:33.868529+0000","last_clean":"2023-10-18T14:02:33.868529+0000","last_became_active":"2023-10-18T14:02:31.847249+0000","last_became_peered":"2023-10-18T14:02:31.847249+0000","last_unstale":"2023-10-18T14:02:33.868529+0000","last_undegraded":"2023-10-18T14:02:33.868529+0000","last_fullsized":"2023-10-18T14:02:33.868529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:11:34.217776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867853+0000","last_change":"2023-10-18T14:02:32.452268+0000","last_active":"2023-10-18T14:02:33.867853+0000","last_peered":"2023-10-18T14:02:33.867853+0000","last_clean":"2023-10-18T14:02:33.867853+0000","last_became_active":"2023-10-18T14:02:32.451338+0000","last_became_peered":"2023-10-18T14:02:32.451338+0000","last_unstale":"2023-10-18T14:02:33.867853+0000","last_undegraded":"2023-10-18T14:02:33.867853+0000","last_fullsized":"2023-10-18T14:02:33.867853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:17:11.743280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.437137+0000","last_change":"2023-10-18T14:02:31.841862+0000","last_active":"2023-10-18T14:02:33.437137+0000","last_peered":"2023-10-18T14:02:33.437137+0000","last_clean":"2023-10-18T14:02:33.437137+0000","last_became_active":"2023-10-18T14:02:31.841481+0000","last_became_peered":"2023-10-18T14:02:31.841481+0000","last_unstale":"2023-10-18T14:02:33.437137+0000","last_undegraded":"2023-10-18T14:02:33.437137+0000","last_fullsized":"2023-10-18T14:02:33.437137+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:38:26.263626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868047+0000","last_change":"2023-10-18T14:02:32.447608+0000","last_active":"2023-10-18T14:02:33.868047+0000","last_peered":"2023-10-18T14:02:33.868047+0000","last_clean":"2023-10-18T14:02:33.868047+0000","last_became_active":"2023-10-18T14:02:32.447057+0000","last_became_peered":"2023-10-18T14:02:32.447057+0000","last_unstale":"2023-10-18T14:02:33.868047+0000","last_undegraded":"2023-10-18T14:02:33.868047+0000","last_fullsized":"2023-10-18T14:02:33.868047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:33:43.469496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.874923+0000","last_change":"2023-10-18T14:02:31.849118+0000","last_active":"2023-10-18T14:02:35.874923+0000","last_peered":"2023-10-18T14:02:35.874923+0000","last_clean":"2023-10-18T14:02:35.874923+0000","last_became_active":"2023-10-18T14:02:31.848827+0000","last_became_peered":"2023-10-18T14:02:31.848827+0000","last_unstale":"2023-10-18T14:02:35.874923+0000","last_undegraded":"2023-10-18T14:02:35.874923+0000","last_fullsized":"2023-10-18T14:02:35.874923+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:41:17.309102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868962+0000","last_change":"2023-10-18T14:02:32.447157+0000","last_active":"2023-10-18T14:02:33.868962+0000","last_peered":"2023-10-18T14:02:33.868962+0000","last_clean":"2023-10-18T14:02:33.868962+0000","last_became_active":"2023-10-18T14:02:32.446861+0000","last_became_peered":"2023-10-18T14:02:32.446861+0000","last_unstale":"2023-10-18T14:02:33.868962+0000","last_undegraded":"2023-10-18T14:02:33.868962+0000","last_fullsized":"2023-10-18T14:02:33.868962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:58:58.146931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868732+0000","last_change":"2023-10-18T14:02:31.838819+0000","last_active":"2023-10-18T14:02:33.868732+0000","last_peered":"2023-10-18T14:02:33.868732+0000","last_clean":"2023-10-18T14:02:33.868732+0000","last_became_active":"2023-10-18T14:02:31.838488+0000","last_became_peered":"2023-10-18T14:02:31.838488+0000","last_unstale":"2023-10-18T14:02:33.868732+0000","last_undegraded":"2023-10-18T14:02:33.868732+0000","last_fullsized":"2023-10-18T14:02:33.868732+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:41:37.569792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868573+0000","last_change":"2023-10-18T14:02:32.455108+0000","last_active":"2023-10-18T14:02:33.868573+0000","last_peered":"2023-10-18T14:02:33.868573+0000","last_clean":"2023-10-18T14:02:33.868573+0000","last_became_active":"2023-10-18T14:02:32.454821+0000","last_became_peered":"2023-10-18T14:02:32.454821+0000","last_unstale":"2023-10-18T14:02:33.868573+0000","last_undegraded":"2023-10-18T14:02:33.868573+0000","last_fullsized":"2023-10-18T14:02:33.868573+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:00:29.617633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.437012+0000","last_change":"2023-10-18T14:02:31.847241+0000","last_active":"2023-10-18T14:02:33.437012+0000","last_peered":"2023-10-18T14:02:33.437012+0000","last_clean":"2023-10-18T14:02:33.437012+0000","last_became_active":"2023-10-18T14:02:31.846786+0000","last_became_peered":"2023-10-18T14:02:31.846786+0000","last_unstale":"2023-10-18T14:02:33.437012+0000","last_undegraded":"2023-10-18T14:02:33.437012+0000","last_fullsized":"2023-10-18T14:02:33.437012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:53:47.539696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868475+0000","last_change":"2023-10-18T14:02:32.458530+0000","last_active":"2023-10-18T14:02:33.868475+0000","last_peered":"2023-10-18T14:02:33.868475+0000","last_clean":"2023-10-18T14:02:33.868475+0000","last_became_active":"2023-10-18T14:02:32.458199+0000","last_became_peered":"2023-10-18T14:02:32.458199+0000","last_unstale":"2023-10-18T14:02:33.868475+0000","last_undegraded":"2023-10-18T14:02:33.868475+0000","last_fullsized":"2023-10-18T14:02:33.868475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:52:16.107456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.264641+0000","last_change":"2023-10-18T14:02:31.845446+0000","last_active":"2023-10-18T14:02:38.264641+0000","last_peered":"2023-10-18T14:02:38.264641+0000","last_clean":"2023-10-18T14:02:38.264641+0000","last_became_active":"2023-10-18T14:02:31.845146+0000","last_became_peered":"2023-10-18T14:02:31.845146+0000","last_unstale":"2023-10-18T14:02:38.264641+0000","last_undegraded":"2023-10-18T14:02:38.264641+0000","last_fullsized":"2023-10-18T14:02:38.264641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:46:16.799500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436467+0000","last_change":"2023-10-18T14:02:32.456404+0000","last_active":"2023-10-18T14:02:33.436467+0000","last_peered":"2023-10-18T14:02:33.436467+0000","last_clean":"2023-10-18T14:02:33.436467+0000","last_became_active":"2023-10-18T14:02:32.456128+0000","last_became_peered":"2023-10-18T14:02:32.456128+0000","last_unstale":"2023-10-18T14:02:33.436467+0000","last_undegraded":"2023-10-18T14:02:33.436467+0000","last_fullsized":"2023-10-18T14:02:33.436467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:23:41.315513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.873559+0000","last_change":"2023-10-18T14:02:31.846871+0000","last_active":"2023-10-18T14:02:35.873559+0000","last_peered":"2023-10-18T14:02:35.873559+0000","last_clean":"2023-10-18T14:02:35.873559+0000","last_became_active":"2023-10-18T14:02:31.846570+0000","last_became_peered":"2023-10-18T14:02:31.846570+0000","last_unstale":"2023-10-18T14:02:35.873559+0000","last_undegraded":"2023-10-18T14:02:35.873559+0000","last_fullsized":"2023-10-18T14:02:35.873559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:38:46.096769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027285+0000","last_change":"2023-10-18T14:02:32.462678+0000","last_active":"2023-10-18T14:02:34.027285+0000","last_peered":"2023-10-18T14:02:34.027285+0000","last_clean":"2023-10-18T14:02:34.027285+0000","last_became_active":"2023-10-18T14:02:32.462331+0000","last_became_peered":"2023-10-18T14:02:32.462331+0000","last_unstale":"2023-10-18T14:02:34.027285+0000","last_undegraded":"2023-10-18T14:02:34.027285+0000","last_fullsized":"2023-10-18T14:02:34.027285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:11:32.934933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-18T14:02:32.437341+0000","last_change":"2023-10-18T14:02:31.844367+0000","last_active":"2023-10-18T14:02:32.437341+0000","last_peered":"2023-10-18T14:02:32.437341+0000","last_clean":"2023-10-18T14:02:32.437341+0000","last_became_active":"2023-10-18T14:02:31.844060+0000","last_became_peered":"2023-10-18T14:02:31.844060+0000","last_unstale":"2023-10-18T14:02:32.437341+0000","last_undegraded":"2023-10-18T14:02:32.437341+0000","last_fullsized":"2023-10-18T14:02:32.437341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:06:09.656240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027079+0000","last_change":"2023-10-18T14:02:32.464529+0000","last_active":"2023-10-18T14:02:34.027079+0000","last_peered":"2023-10-18T14:02:34.027079+0000","last_clean":"2023-10-18T14:02:34.027079+0000","last_became_active":"2023-10-18T14:02:32.464232+0000","last_became_peered":"2023-10-18T14:02:32.464232+0000","last_unstale":"2023-10-18T14:02:34.027079+0000","last_undegraded":"2023-10-18T14:02:34.027079+0000","last_fullsized":"2023-10-18T14:02:34.027079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:10:43.011803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.258262+0000","last_change":"2023-10-18T14:02:31.850537+0000","last_active":"2023-10-18T14:02:38.258262+0000","last_peered":"2023-10-18T14:02:38.258262+0000","last_clean":"2023-10-18T14:02:38.258262+0000","last_became_active":"2023-10-18T14:02:31.849391+0000","last_became_peered":"2023-10-18T14:02:31.849391+0000","last_unstale":"2023-10-18T14:02:38.258262+0000","last_undegraded":"2023-10-18T14:02:38.258262+0000","last_fullsized":"2023-10-18T14:02:38.258262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:19:31.270179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867658+0000","last_change":"2023-10-18T14:02:32.458608+0000","last_active":"2023-10-18T14:02:33.867658+0000","last_peered":"2023-10-18T14:02:33.867658+0000","last_clean":"2023-10-18T14:02:33.867658+0000","last_became_active":"2023-10-18T14:02:32.458298+0000","last_became_peered":"2023-10-18T14:02:32.458298+0000","last_unstale":"2023-10-18T14:02:33.867658+0000","last_undegraded":"2023-10-18T14:02:33.867658+0000","last_fullsized":"2023-10-18T14:02:33.867658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:02.105181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867952+0000","last_change":"2023-10-18T14:02:31.850706+0000","last_active":"2023-10-18T14:02:33.867952+0000","last_peered":"2023-10-18T14:02:33.867952+0000","last_clean":"2023-10-18T14:02:33.867952+0000","last_became_active":"2023-10-18T14:02:31.849354+0000","last_became_peered":"2023-10-18T14:02:31.849354+0000","last_unstale":"2023-10-18T14:02:33.867952+0000","last_undegraded":"2023-10-18T14:02:33.867952+0000","last_fullsized":"2023-10-18T14:02:33.867952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:51:31.071528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436839+0000","last_change":"2023-10-18T14:02:32.454196+0000","last_active":"2023-10-18T14:02:33.436839+0000","last_peered":"2023-10-18T14:02:33.436839+0000","last_clean":"2023-10-18T14:02:33.436839+0000","last_became_active":"2023-10-18T14:02:32.453861+0000","last_became_peered":"2023-10-18T14:02:32.453861+0000","last_unstale":"2023-10-18T14:02:33.436839+0000","last_undegraded":"2023-10-18T14:02:33.436839+0000","last_fullsized":"2023-10-18T14:02:33.436839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:43.217757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868091+0000","last_change":"2023-10-18T14:02:31.849707+0000","last_active":"2023-10-18T14:02:33.868091+0000","last_peered":"2023-10-18T14:02:33.868091+0000","last_clean":"2023-10-18T14:02:33.868091+0000","last_became_active":"2023-10-18T14:02:31.849442+0000","last_became_peered":"2023-10-18T14:02:31.849442+0000","last_unstale":"2023-10-18T14:02:33.868091+0000","last_undegraded":"2023-10-18T14:02:33.868091+0000","last_fullsized":"2023-10-18T14:02:33.868091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:39:15.669730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.437088+0000","last_change":"2023-10-18T14:02:32.457433+0000","last_active":"2023-10-18T14:02:33.437088+0000","last_peered":"2023-10-18T14:02:33.437088+0000","last_clean":"2023-10-18T14:02:33.437088+0000","last_became_active":"2023-10-18T14:02:32.457057+0000","last_became_peered":"2023-10-18T14:02:32.457057+0000","last_unstale":"2023-10-18T14:02:33.437088+0000","last_undegraded":"2023-10-18T14:02:33.437088+0000","last_fullsized":"2023-10-18T14:02:33.437088+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:53.088723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027242+0000","last_change":"2023-10-18T14:02:31.848595+0000","last_active":"2023-10-18T14:02:34.027242+0000","last_peered":"2023-10-18T14:02:34.027242+0000","last_clean":"2023-10-18T14:02:34.027242+0000","last_became_active":"2023-10-18T14:02:31.847987+0000","last_became_peered":"2023-10-18T14:02:31.847987+0000","last_unstale":"2023-10-18T14:02:34.027242+0000","last_undegraded":"2023-10-18T14:02:34.027242+0000","last_fullsized":"2023-10-18T14:02:34.027242+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:03:34.356729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.437092+0000","last_change":"2023-10-18T14:02:32.446514+0000","last_active":"2023-10-18T14:02:33.437092+0000","last_peered":"2023-10-18T14:02:33.437092+0000","last_clean":"2023-10-18T14:02:33.437092+0000","last_became_active":"2023-10-18T14:02:32.446015+0000","last_became_peered":"2023-10-18T14:02:32.446015+0000","last_unstale":"2023-10-18T14:02:33.437092+0000","last_undegraded":"2023-10-18T14:02:33.437092+0000","last_fullsized":"2023-10-18T14:02:33.437092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:21:09.897636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868762+0000","last_change":"2023-10-18T14:02:32.444969+0000","last_active":"2023-10-18T14:02:33.868762+0000","last_peered":"2023-10-18T14:02:33.868762+0000","last_clean":"2023-10-18T14:02:33.868762+0000","last_became_active":"2023-10-18T14:02:32.444592+0000","last_became_peered":"2023-10-18T14:02:32.444592+0000","last_unstale":"2023-10-18T14:02:33.868762+0000","last_undegraded":"2023-10-18T14:02:33.868762+0000","last_fullsized":"2023-10-18T14:02:33.868762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:02:58.377003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:36.879327+0000","last_change":"2023-10-18T14:02:31.847368+0000","last_active":"2023-10-18T14:02:36.879327+0000","last_peered":"2023-10-18T14:02:36.879327+0000","last_clean":"2023-10-18T14:02:36.879327+0000","last_became_active":"2023-10-18T14:02:31.847072+0000","last_became_peered":"2023-10-18T14:02:31.847072+0000","last_unstale":"2023-10-18T14:02:36.879327+0000","last_undegraded":"2023-10-18T14:02:36.879327+0000","last_fullsized":"2023-10-18T14:02:36.879327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:28:24.771284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.869088+0000","last_change":"2023-10-18T14:02:32.448283+0000","last_active":"2023-10-18T14:02:33.869088+0000","last_peered":"2023-10-18T14:02:33.869088+0000","last_clean":"2023-10-18T14:02:33.869088+0000","last_became_active":"2023-10-18T14:02:32.447988+0000","last_became_peered":"2023-10-18T14:02:32.447988+0000","last_unstale":"2023-10-18T14:02:33.869088+0000","last_undegraded":"2023-10-18T14:02:33.869088+0000","last_fullsized":"2023-10-18T14:02:33.869088+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:08:28.048443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.873659+0000","last_change":"2023-10-18T14:02:31.843678+0000","last_active":"2023-10-18T14:02:35.873659+0000","last_peered":"2023-10-18T14:02:35.873659+0000","last_clean":"2023-10-18T14:02:35.873659+0000","last_became_active":"2023-10-18T14:02:31.843332+0000","last_became_peered":"2023-10-18T14:02:31.843332+0000","last_unstale":"2023-10-18T14:02:35.873659+0000","last_undegraded":"2023-10-18T14:02:35.873659+0000","last_fullsized":"2023-10-18T14:02:35.873659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:06:04.549859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":319,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-18T14:02:32.563608+0000","last_change":"2023-10-18T14:01:34.022246+0000","last_active":"2023-10-18T14:02:32.563608+0000","last_peered":"2023-10-18T14:02:32.563608+0000","last_clean":"2023-10-18T14:02:32.563608+0000","last_became_active":"2023-10-18T14:01:34.021768+0000","last_became_peered":"2023-10-18T14:01:34.021768+0000","last_unstale":"2023-10-18T14:02:32.563608+0000","last_undegraded":"2023-10-18T14:02:32.563608+0000","last_fullsized":"2023-10-18T14:02:32.563608+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_clean_scrub_stamp":"2023-10-18T13:58:44.223424+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:48.521087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436266+0000","last_change":"2023-10-18T14:02:32.440662+0000","last_active":"2023-10-18T14:02:33.436266+0000","last_peered":"2023-10-18T14:02:33.436266+0000","last_clean":"2023-10-18T14:02:33.436266+0000","last_became_active":"2023-10-18T14:02:32.440345+0000","last_became_peered":"2023-10-18T14:02:32.440345+0000","last_unstale":"2023-10-18T14:02:33.436266+0000","last_undegraded":"2023-10-18T14:02:33.436266+0000","last_fullsized":"2023-10-18T14:02:33.436266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:21.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:36.878180+0000","last_change":"2023-10-18T14:02:31.850243+0000","last_active":"2023-10-18T14:02:36.878180+0000","last_peered":"2023-10-18T14:02:36.878180+0000","last_clean":"2023-10-18T14:02:36.878180+0000","last_became_active":"2023-10-18T14:02:31.849952+0000","last_became_peered":"2023-10-18T14:02:31.849952+0000","last_unstale":"2023-10-18T14:02:36.878180+0000","last_undegraded":"2023-10-18T14:02:36.878180+0000","last_fullsized":"2023-10-18T14:02:36.878180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:11:50.877219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.258272+0000","last_change":"2023-10-18T14:02:31.851089+0000","last_active":"2023-10-18T14:02:38.258272+0000","last_peered":"2023-10-18T14:02:38.258272+0000","last_clean":"2023-10-18T14:02:38.258272+0000","last_became_active":"2023-10-18T14:02:31.850759+0000","last_became_peered":"2023-10-18T14:02:31.850759+0000","last_unstale":"2023-10-18T14:02:38.258272+0000","last_undegraded":"2023-10-18T14:02:38.258272+0000","last_fullsized":"2023-10-18T14:02:38.258272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:53:37.797881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436681+0000","last_change":"2023-10-18T14:02:32.445046+0000","last_active":"2023-10-18T14:02:33.436681+0000","last_peered":"2023-10-18T14:02:33.436681+0000","last_clean":"2023-10-18T14:02:33.436681+0000","last_became_active":"2023-10-18T14:02:32.444827+0000","last_became_peered":"2023-10-18T14:02:32.444827+0000","last_unstale":"2023-10-18T14:02:33.436681+0000","last_undegraded":"2023-10-18T14:02:33.436681+0000","last_fullsized":"2023-10-18T14:02:33.436681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:26:11.024405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867756+0000","last_change":"2023-10-18T14:02:31.846888+0000","last_active":"2023-10-18T14:02:33.867756+0000","last_peered":"2023-10-18T14:02:33.867756+0000","last_clean":"2023-10-18T14:02:33.867756+0000","last_became_active":"2023-10-18T14:02:31.846591+0000","last_became_peered":"2023-10-18T14:02:31.846591+0000","last_unstale":"2023-10-18T14:02:33.867756+0000","last_undegraded":"2023-10-18T14:02:33.867756+0000","last_fullsized":"2023-10-18T14:02:33.867756+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:48:03.683135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867872+0000","last_change":"2023-10-18T14:02:32.456951+0000","last_active":"2023-10-18T14:02:33.867872+0000","last_peered":"2023-10-18T14:02:33.867872+0000","last_clean":"2023-10-18T14:02:33.867872+0000","last_became_active":"2023-10-18T14:02:32.456588+0000","last_became_peered":"2023-10-18T14:02:32.456588+0000","last_unstale":"2023-10-18T14:02:33.867872+0000","last_undegraded":"2023-10-18T14:02:33.867872+0000","last_fullsized":"2023-10-18T14:02:33.867872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:51:51.335310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.872568+0000","last_change":"2023-10-18T14:02:31.845258+0000","last_active":"2023-10-18T14:02:35.872568+0000","last_peered":"2023-10-18T14:02:35.872568+0000","last_clean":"2023-10-18T14:02:35.872568+0000","last_became_active":"2023-10-18T14:02:31.844933+0000","last_became_peered":"2023-10-18T14:02:31.844933+0000","last_unstale":"2023-10-18T14:02:35.872568+0000","last_undegraded":"2023-10-18T14:02:35.872568+0000","last_fullsized":"2023-10-18T14:02:35.872568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:51:46.765525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868572+0000","last_change":"2023-10-18T14:02:32.454955+0000","last_active":"2023-10-18T14:02:33.868572+0000","last_peered":"2023-10-18T14:02:33.868572+0000","last_clean":"2023-10-18T14:02:33.868572+0000","last_became_active":"2023-10-18T14:02:32.454689+0000","last_became_peered":"2023-10-18T14:02:32.454689+0000","last_unstale":"2023-10-18T14:02:33.868572+0000","last_undegraded":"2023-10-18T14:02:33.868572+0000","last_fullsized":"2023-10-18T14:02:33.868572+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:57:20.461517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.875464+0000","last_change":"2023-10-18T14:02:31.849273+0000","last_active":"2023-10-18T14:02:35.875464+0000","last_peered":"2023-10-18T14:02:35.875464+0000","last_clean":"2023-10-18T14:02:35.875464+0000","last_became_active":"2023-10-18T14:02:31.848985+0000","last_became_peered":"2023-10-18T14:02:31.848985+0000","last_unstale":"2023-10-18T14:02:35.875464+0000","last_undegraded":"2023-10-18T14:02:35.875464+0000","last_fullsized":"2023-10-18T14:02:35.875464+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:55:54.516857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867773+0000","last_change":"2023-10-18T14:02:32.449557+0000","last_active":"2023-10-18T14:02:33.867773+0000","last_peered":"2023-10-18T14:02:33.867773+0000","last_clean":"2023-10-18T14:02:33.867773+0000","last_became_active":"2023-10-18T14:02:32.449033+0000","last_became_peered":"2023-10-18T14:02:32.449033+0000","last_unstale":"2023-10-18T14:02:33.867773+0000","last_undegraded":"2023-10-18T14:02:33.867773+0000","last_fullsized":"2023-10-18T14:02:33.867773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:32.983379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.264562+0000","last_change":"2023-10-18T14:02:31.846109+0000","last_active":"2023-10-18T14:02:38.264562+0000","last_peered":"2023-10-18T14:02:38.264562+0000","last_clean":"2023-10-18T14:02:38.264562+0000","last_became_active":"2023-10-18T14:02:31.845236+0000","last_became_peered":"2023-10-18T14:02:31.845236+0000","last_unstale":"2023-10-18T14:02:38.264562+0000","last_undegraded":"2023-10-18T14:02:38.264562+0000","last_fullsized":"2023-10-18T14:02:38.264562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:46.880974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436708+0000","last_change":"2023-10-18T14:02:32.446465+0000","last_active":"2023-10-18T14:02:33.436708+0000","last_peered":"2023-10-18T14:02:33.436708+0000","last_clean":"2023-10-18T14:02:33.436708+0000","last_became_active":"2023-10-18T14:02:32.446172+0000","last_became_peered":"2023-10-18T14:02:32.446172+0000","last_unstale":"2023-10-18T14:02:33.436708+0000","last_undegraded":"2023-10-18T14:02:33.436708+0000","last_fullsized":"2023-10-18T14:02:33.436708+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:14:40.094870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.233415+0000","last_change":"2023-10-18T14:02:31.851198+0000","last_active":"2023-10-18T14:02:34.233415+0000","last_peered":"2023-10-18T14:02:34.233415+0000","last_clean":"2023-10-18T14:02:34.233415+0000","last_became_active":"2023-10-18T14:02:31.850524+0000","last_became_peered":"2023-10-18T14:02:31.850524+0000","last_unstale":"2023-10-18T14:02:34.233415+0000","last_undegraded":"2023-10-18T14:02:34.233415+0000","last_fullsized":"2023-10-18T14:02:34.233415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:13:44.133077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868101+0000","last_change":"2023-10-18T14:02:32.446732+0000","last_active":"2023-10-18T14:02:33.868101+0000","last_peered":"2023-10-18T14:02:33.868101+0000","last_clean":"2023-10-18T14:02:33.868101+0000","last_became_active":"2023-10-18T14:02:32.446418+0000","last_became_peered":"2023-10-18T14:02:32.446418+0000","last_unstale":"2023-10-18T14:02:33.868101+0000","last_undegraded":"2023-10-18T14:02:33.868101+0000","last_fullsized":"2023-10-18T14:02:33.868101+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:13.765988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.875633+0000","last_change":"2023-10-18T14:02:31.852648+0000","last_active":"2023-10-18T14:02:35.875633+0000","last_peered":"2023-10-18T14:02:35.875633+0000","last_clean":"2023-10-18T14:02:35.875633+0000","last_became_active":"2023-10-18T14:02:31.852361+0000","last_became_peered":"2023-10-18T14:02:31.852361+0000","last_unstale":"2023-10-18T14:02:35.875633+0000","last_undegraded":"2023-10-18T14:02:35.875633+0000","last_fullsized":"2023-10-18T14:02:35.875633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:54:28.189196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027263+0000","last_change":"2023-10-18T14:02:32.464220+0000","last_active":"2023-10-18T14:02:34.027263+0000","last_peered":"2023-10-18T14:02:34.027263+0000","last_clean":"2023-10-18T14:02:34.027263+0000","last_became_active":"2023-10-18T14:02:32.463213+0000","last_became_peered":"2023-10-18T14:02:32.463213+0000","last_unstale":"2023-10-18T14:02:34.027263+0000","last_undegraded":"2023-10-18T14:02:34.027263+0000","last_fullsized":"2023-10-18T14:02:34.027263+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:53.777086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.264378+0000","last_change":"2023-10-18T14:02:31.848305+0000","last_active":"2023-10-18T14:02:38.264378+0000","last_peered":"2023-10-18T14:02:38.264378+0000","last_clean":"2023-10-18T14:02:38.264378+0000","last_became_active":"2023-10-18T14:02:31.847739+0000","last_became_peered":"2023-10-18T14:02:31.847739+0000","last_unstale":"2023-10-18T14:02:38.264378+0000","last_undegraded":"2023-10-18T14:02:38.264378+0000","last_fullsized":"2023-10-18T14:02:38.264378+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:52:24.543703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027520+0000","last_change":"2023-10-18T14:02:32.460802+0000","last_active":"2023-10-18T14:02:34.027520+0000","last_peered":"2023-10-18T14:02:34.027520+0000","last_clean":"2023-10-18T14:02:34.027520+0000","last_became_active":"2023-10-18T14:02:32.460160+0000","last_became_peered":"2023-10-18T14:02:32.460160+0000","last_unstale":"2023-10-18T14:02:34.027520+0000","last_undegraded":"2023-10-18T14:02:34.027520+0000","last_fullsized":"2023-10-18T14:02:34.027520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:20:55.614142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-18T14:02:32.849522+0000","last_change":"2023-10-18T14:02:31.845468+0000","last_active":"2023-10-18T14:02:32.849522+0000","last_peered":"2023-10-18T14:02:32.849522+0000","last_clean":"2023-10-18T14:02:32.849522+0000","last_became_active":"2023-10-18T14:02:31.845057+0000","last_became_peered":"2023-10-18T14:02:31.845057+0000","last_unstale":"2023-10-18T14:02:32.849522+0000","last_undegraded":"2023-10-18T14:02:32.849522+0000","last_fullsized":"2023-10-18T14:02:32.849522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:08:23.972051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027279+0000","last_change":"2023-10-18T14:02:32.462572+0000","last_active":"2023-10-18T14:02:34.027279+0000","last_peered":"2023-10-18T14:02:34.027279+0000","last_clean":"2023-10-18T14:02:34.027279+0000","last_became_active":"2023-10-18T14:02:32.462140+0000","last_became_peered":"2023-10-18T14:02:32.462140+0000","last_unstale":"2023-10-18T14:02:34.027279+0000","last_undegraded":"2023-10-18T14:02:34.027279+0000","last_fullsized":"2023-10-18T14:02:34.027279+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:03:34.605932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436635+0000","last_change":"2023-10-18T14:02:31.847322+0000","last_active":"2023-10-18T14:02:33.436635+0000","last_peered":"2023-10-18T14:02:33.436635+0000","last_clean":"2023-10-18T14:02:33.436635+0000","last_became_active":"2023-10-18T14:02:31.847008+0000","last_became_peered":"2023-10-18T14:02:31.847008+0000","last_unstale":"2023-10-18T14:02:33.436635+0000","last_undegraded":"2023-10-18T14:02:33.436635+0000","last_fullsized":"2023-10-18T14:02:33.436635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:59:18.850165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027437+0000","last_change":"2023-10-18T14:02:32.461592+0000","last_active":"2023-10-18T14:02:34.027437+0000","last_peered":"2023-10-18T14:02:34.027437+0000","last_clean":"2023-10-18T14:02:34.027437+0000","last_became_active":"2023-10-18T14:02:32.461265+0000","last_became_peered":"2023-10-18T14:02:32.461265+0000","last_unstale":"2023-10-18T14:02:34.027437+0000","last_undegraded":"2023-10-18T14:02:34.027437+0000","last_fullsized":"2023-10-18T14:02:34.027437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:03.315431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436848+0000","last_change":"2023-10-18T14:02:32.445480+0000","last_active":"2023-10-18T14:02:33.436848+0000","last_peered":"2023-10-18T14:02:33.436848+0000","last_clean":"2023-10-18T14:02:33.436848+0000","last_became_active":"2023-10-18T14:02:32.443036+0000","last_became_peered":"2023-10-18T14:02:32.443036+0000","last_unstale":"2023-10-18T14:02:33.436848+0000","last_undegraded":"2023-10-18T14:02:33.436848+0000","last_fullsized":"2023-10-18T14:02:33.436848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:59:57.637358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867570+0000","last_change":"2023-10-18T14:02:32.456400+0000","last_active":"2023-10-18T14:02:33.867570+0000","last_peered":"2023-10-18T14:02:33.867570+0000","last_clean":"2023-10-18T14:02:33.867570+0000","last_became_active":"2023-10-18T14:02:32.456072+0000","last_became_peered":"2023-10-18T14:02:32.456072+0000","last_unstale":"2023-10-18T14:02:33.867570+0000","last_undegraded":"2023-10-18T14:02:33.867570+0000","last_fullsized":"2023-10-18T14:02:33.867570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:22:59.844454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867728+0000","last_change":"2023-10-18T14:02:32.448089+0000","last_active":"2023-10-18T14:02:33.867728+0000","last_peered":"2023-10-18T14:02:33.867728+0000","last_clean":"2023-10-18T14:02:33.867728+0000","last_became_active":"2023-10-18T14:02:32.447866+0000","last_became_peered":"2023-10-18T14:02:32.447866+0000","last_unstale":"2023-10-18T14:02:33.867728+0000","last_undegraded":"2023-10-18T14:02:33.867728+0000","last_fullsized":"2023-10-18T14:02:33.867728+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:28:35.558009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868069+0000","last_change":"2023-10-18T14:02:32.444103+0000","last_active":"2023-10-18T14:02:33.868069+0000","last_peered":"2023-10-18T14:02:33.868069+0000","last_clean":"2023-10-18T14:02:33.868069+0000","last_became_active":"2023-10-18T14:02:32.443762+0000","last_became_peered":"2023-10-18T14:02:32.443762+0000","last_unstale":"2023-10-18T14:02:33.868069+0000","last_undegraded":"2023-10-18T14:02:33.868069+0000","last_fullsized":"2023-10-18T14:02:33.868069+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:47.695764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436712+0000","last_change":"2023-10-18T14:02:32.449409+0000","last_active":"2023-10-18T14:02:33.436712+0000","last_peered":"2023-10-18T14:02:33.436712+0000","last_clean":"2023-10-18T14:02:33.436712+0000","last_became_active":"2023-10-18T14:02:32.449114+0000","last_became_peered":"2023-10-18T14:02:32.449114+0000","last_unstale":"2023-10-18T14:02:33.436712+0000","last_undegraded":"2023-10-18T14:02:33.436712+0000","last_fullsized":"2023-10-18T14:02:33.436712+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:59:45.167577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436849+0000","last_change":"2023-10-18T14:02:32.452013+0000","last_active":"2023-10-18T14:02:33.436849+0000","last_peered":"2023-10-18T14:02:33.436849+0000","last_clean":"2023-10-18T14:02:33.436849+0000","last_became_active":"2023-10-18T14:02:32.451734+0000","last_became_peered":"2023-10-18T14:02:32.451734+0000","last_unstale":"2023-10-18T14:02:33.436849+0000","last_undegraded":"2023-10-18T14:02:33.436849+0000","last_fullsized":"2023-10-18T14:02:33.436849+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:15:44.511378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868158+0000","last_change":"2023-10-18T14:02:32.445503+0000","last_active":"2023-10-18T14:02:33.868158+0000","last_peered":"2023-10-18T14:02:33.868158+0000","last_clean":"2023-10-18T14:02:33.868158+0000","last_became_active":"2023-10-18T14:02:32.445172+0000","last_became_peered":"2023-10-18T14:02:32.445172+0000","last_unstale":"2023-10-18T14:02:33.868158+0000","last_undegraded":"2023-10-18T14:02:33.868158+0000","last_fullsized":"2023-10-18T14:02:33.868158+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:23:08.456949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867732+0000","last_change":"2023-10-18T14:02:32.459690+0000","last_active":"2023-10-18T14:02:33.867732+0000","last_peered":"2023-10-18T14:02:33.867732+0000","last_clean":"2023-10-18T14:02:33.867732+0000","last_became_active":"2023-10-18T14:02:32.459373+0000","last_became_peered":"2023-10-18T14:02:32.459373+0000","last_unstale":"2023-10-18T14:02:33.867732+0000","last_undegraded":"2023-10-18T14:02:33.867732+0000","last_fullsized":"2023-10-18T14:02:33.867732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:36.092029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868624+0000","last_change":"2023-10-18T14:02:32.455076+0000","last_active":"2023-10-18T14:02:33.868624+0000","last_peered":"2023-10-18T14:02:33.868624+0000","last_clean":"2023-10-18T14:02:33.868624+0000","last_became_active":"2023-10-18T14:02:32.454750+0000","last_became_peered":"2023-10-18T14:02:32.454750+0000","last_unstale":"2023-10-18T14:02:33.868624+0000","last_undegraded":"2023-10-18T14:02:33.868624+0000","last_fullsized":"2023-10-18T14:02:33.868624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:08:00.855583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867755+0000","last_change":"2023-10-18T14:02:32.450714+0000","last_active":"2023-10-18T14:02:33.867755+0000","last_peered":"2023-10-18T14:02:33.867755+0000","last_clean":"2023-10-18T14:02:33.867755+0000","last_became_active":"2023-10-18T14:02:32.450429+0000","last_became_peered":"2023-10-18T14:02:32.450429+0000","last_unstale":"2023-10-18T14:02:33.867755+0000","last_undegraded":"2023-10-18T14:02:33.867755+0000","last_fullsized":"2023-10-18T14:02:33.867755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:43:21.746296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867787+0000","last_change":"2023-10-18T14:02:32.457392+0000","last_active":"2023-10-18T14:02:33.867787+0000","last_peered":"2023-10-18T14:02:33.867787+0000","last_clean":"2023-10-18T14:02:33.867787+0000","last_became_active":"2023-10-18T14:02:32.457072+0000","last_became_peered":"2023-10-18T14:02:32.457072+0000","last_unstale":"2023-10-18T14:02:33.867787+0000","last_undegraded":"2023-10-18T14:02:33.867787+0000","last_fullsized":"2023-10-18T14:02:33.867787+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:19:51.691351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436616+0000","last_change":"2023-10-18T14:02:32.457541+0000","last_active":"2023-10-18T14:02:33.436616+0000","last_peered":"2023-10-18T14:02:33.436616+0000","last_clean":"2023-10-18T14:02:33.436616+0000","last_became_active":"2023-10-18T14:02:32.457266+0000","last_became_peered":"2023-10-18T14:02:32.457266+0000","last_unstale":"2023-10-18T14:02:33.436616+0000","last_undegraded":"2023-10-18T14:02:33.436616+0000","last_fullsized":"2023-10-18T14:02:33.436616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:41:16.131463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436788+0000","last_change":"2023-10-18T14:02:32.454298+0000","last_active":"2023-10-18T14:02:33.436788+0000","last_peered":"2023-10-18T14:02:33.436788+0000","last_clean":"2023-10-18T14:02:33.436788+0000","last_became_active":"2023-10-18T14:02:32.453970+0000","last_became_peered":"2023-10-18T14:02:32.453970+0000","last_unstale":"2023-10-18T14:02:33.436788+0000","last_undegraded":"2023-10-18T14:02:33.436788+0000","last_fullsized":"2023-10-18T14:02:33.436788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:31:03.766761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250031,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5804,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":129,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":50039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449100,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":892928,"data_stored":440505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":10,"up_from":70,"seq":300647710734,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":1032348,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.39400000000000002}]},{"osd":2,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51800000000000002}]},{"osd":4,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.70599999999999996}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65100000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64800000000000002}]},{"osd":9,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":9,"up_from":65,"seq":279172874260,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":441087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.63400000000000001}]},{"osd":2,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56000000000000005}]},{"osd":3,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.59299999999999997}]},{"osd":4,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.73599999999999999}]},{"osd":5,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.755},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.81000000000000005}]},{"osd":8,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.76600000000000001}]},{"osd":10,"last update":"Wed Oct 18 14:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78700000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103192,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":440912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52900000000000003}]},{"osd":1,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.875},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.73499999999999999}]},{"osd":2,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.58999999999999997}]},{"osd":3,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.67400000000000004}]},{"osd":4,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.79500000000000004}]},{"osd":5,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.86099999999999999}]},{"osd":6,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.91400000000000003}]},{"osd":7,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":1.01}]},{"osd":9,"last update":"Wed Oct 18 14:02:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.90200000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.92800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":7,"up_from":51,"seq":219043332124,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":1032665,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47599999999999998}]},{"osd":1,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.41199999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.441,"15min":0.437},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70299999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60499999999999998}]},{"osd":2,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.76000000000000001}]},{"osd":3,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58899999999999997,"15min":0.58599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.67200000000000004}]},{"osd":4,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.376,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.63900000000000001}]},{"osd":5,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.495},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63600000000000001,"15min":0.624},"min":{"1min":0.439,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.54600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.86799999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91000000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72099999999999997}]},{"osd":8,"last update":"Wed Oct 18 14:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.84799999999999998}]},{"osd":9,"last update":"Wed Oct 18 14:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.83599999999999997}]},{"osd":10,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.871},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.86199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495649,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":440617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.27600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.34899999999999998,"15min":0.33500000000000002},"min":{"1min":0.29699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.316}]},{"osd":1,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.51700000000000002,"15min":0.497},"min":{"1min":0.40500000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.53800000000000003,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.42399999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80000000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.57299999999999995,"15min":0.55700000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.64900000000000002}]},{"osd":3,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.34100000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.436,"15min":0.42199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.496,"5min":0.379,"15min":0.379},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.55900000000000005,"15min":0.53900000000000003},"min":{"1min":0.51100000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.501}]},{"osd":5,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60899999999999999,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.45300000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89200000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":1.0089999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.57599999999999996}]},{"osd":8,"last update":"Wed Oct 18 14:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.628},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.63600000000000001}]},{"osd":9,"last update":"Wed Oct 18 14:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.55200000000000005}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.67000000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542198,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":442117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.432},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.80500000000000005,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Oct 18 14:01:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55200000000000005,"15min":0.54200000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46400000000000002}]},{"osd":3,"last update":"Wed Oct 18 14:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.53100000000000003,"15min":0.51900000000000002},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72899999999999998}]},{"osd":4,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.40600000000000003,"15min":0.38500000000000001},"min":{"1min":0.28999999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.46999999999999997,"15min":0.42899999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.78400000000000003}]},{"osd":5,"last update":"Wed Oct 18 14:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63},{"interface":"front","average":{"1min":0.62,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58499999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.54500000000000004,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.746},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.58799999999999997,"15min":0.56999999999999995},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.76000000000000001}]},{"osd":7,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76400000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.80300000000000005}]},{"osd":8,"last update":"Wed Oct 18 14:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.81899999999999995}]},{"osd":9,"last update":"Wed Oct 18 14:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.89500000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.86599999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":441983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 14:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.496},"min":{"1min":0.41799999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.52600000000000002,"15min":0.48899999999999999},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.432}]},{"osd":2,"last update":"Wed Oct 18 14:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.42399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79800000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49199999999999999}]},{"osd":3,"last update":"Wed Oct 18 14:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.40500000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.309,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.32200000000000001}]},{"osd":4,"last update":"Wed Oct 18 14:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.39700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Oct 18 14:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45300000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.45700000000000002}]},{"osd":6,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.50600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.755,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.439},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.39300000000000002}]},{"osd":7,"last update":"Wed Oct 18 14:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60499999999999998}]},{"osd":8,"last update":"Wed Oct 18 14:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.503},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57199999999999995}]},{"osd":9,"last update":"Wed Oct 18 14:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.52000000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56100000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378674,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":460902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.52300000000000002},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59599999999999997}]},{"osd":1,"last update":"Wed Oct 18 14:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77000000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.629},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77900000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.85799999999999998}]},{"osd":3,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.56299999999999994,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.81499999999999995}]},{"osd":4,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.79300000000000004}]},{"osd":5,"last update":"Wed Oct 18 14:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.29199999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.43099999999999999,"15min":0.42299999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.90400000000000003}]},{"osd":6,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.38700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.874},{"interface":"front","average":{"1min":0.63,"5min":0.56499999999999995,"15min":0.55400000000000005},"min":{"1min":0.48199999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.84099999999999997}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.34200000000000003}]},{"osd":8,"last update":"Wed Oct 18 14:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":1.0129999999999999}]},{"osd":9,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.89300000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.94999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":3,"up_from":26,"seq":111669149741,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":440582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.34599999999999997,"15min":0.32400000000000001},"min":{"1min":0.25800000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.35099999999999998},"min":{"1min":0.27700000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.37}]},{"osd":1,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53600000000000003,"15min":0.51400000000000001},"min":{"1min":0.374,"5min":0.316,"15min":0.316},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48899999999999999}]},{"osd":2,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.54200000000000004,"15min":0.51700000000000002},"min":{"1min":0.41999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.56399999999999995}]},{"osd":4,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84999999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53500000000000003}]},{"osd":5,"last update":"Wed Oct 18 14:01:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.71899999999999997,"15min":0.67900000000000005},"min":{"1min":0.51200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":6.5,"5min":6.5,"15min":6.5},"last":0.68600000000000005}]},{"osd":6,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.49299999999999999,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.47299999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.77500000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.76800000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.51900000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.56699999999999995}]},{"osd":9,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58799999999999997}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57599999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888105,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":440527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.42399999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.38400000000000001},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.39100000000000001,"15min":0.376},"min":{"1min":0.26000000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.32600000000000001}]},{"osd":2,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84399999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.438}]},{"osd":3,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.56499999999999995,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81999999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86699999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.67900000000000005}]},{"osd":5,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.503},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:02:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65600000000000003,"15min":0.64800000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55000000000000004,"15min":0.54100000000000004},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.39300000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.53500000000000003}]},{"osd":9,"last update":"Wed Oct 18 14:02:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.72899999999999998}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.46800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724581,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1032018,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.39400000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69899999999999995}]},{"osd":1,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.32200000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.66400000000000003}]},{"osd":2,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.47199999999999998}]},{"osd":3,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73799999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.435,"5min":0.374,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.41699999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.38400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.78200000000000003}]},{"osd":6,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59499999999999997,"15min":0.58799999999999997},"min":{"1min":0.48399999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.76100000000000001}]},{"osd":7,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76300000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67800000000000005}]},{"osd":8,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61499999999999999}]},{"osd":9,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.89100000000000001}]},{"osd":10,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":38647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T14:02:40.563 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T14:02:40.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.713+0000 7f738e588700 1 -- 172.21.15.114:0/1910337972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73881006d0 msgr2=0x7f738810c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:40.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.713+0000 7f738e588700 1 --2- 172.21.15.114:0/1910337972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73881006d0 0x7f738810c420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f738000b0d0 tx=0x7f738000b3e0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.713+0000 7f738e588700 1 -- 172.21.15.114:0/1910337972 shutdown_connections 2023-10-18T14:02:40.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.713+0000 7f738e588700 1 --2- 172.21.15.114:0/1910337972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73881006d0 0x7f738810c420 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.713+0000 7f738e588700 1 --2- 172.21.15.114:0/1910337972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7388105660 0x7f7388105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.713+0000 7f738e588700 1 --2- 172.21.15.114:0/1910337972 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f73880ffd10 0x7f7388100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.713+0000 7f738e588700 1 -- 172.21.15.114:0/1910337972 >> 172.21.15.114:0/1910337972 conn(0x7f7388075b90 msgr2=0x7f73880fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:40.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.713+0000 7f738e588700 1 -- 172.21.15.114:0/1910337972 shutdown_connections 2023-10-18T14:02:40.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.713+0000 7f738e588700 1 -- 172.21.15.114:0/1910337972 wait complete. 2023-10-18T14:02:40.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738e588700 1 Processor -- start 2023-10-18T14:02:40.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738e588700 1 -- start start 2023-10-18T14:02:40.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738e588700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f73880ffd10 0x7f7388198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:40.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738e588700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73881006d0 0x7f73881993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:40.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738e588700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7388105660 0x7f738819d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:40.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738e588700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738819dd80 con 0x7f7388105660 2023-10-18T14:02:40.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738e588700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738819def0 con 0x7f73880ffd10 2023-10-18T14:02:40.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738e588700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738819e0b0 con 0x7f73881006d0 2023-10-18T14:02:40.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738cb25700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7388105660 0x7f738819d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:40.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738cb25700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7388105660 0x7f738819d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42600/0 (socket says 172.21.15.114:42600) 2023-10-18T14:02:40.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738cb25700 1 -- 172.21.15.114:0/2793520681 learned_addr learned my addr 172.21.15.114:0/2793520681 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:40.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f7387fff700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f73880ffd10 0x7f7388198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:40.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f73877fe700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73881006d0 0x7f73881993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:40.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738cb25700 1 -- 172.21.15.114:0/2793520681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73881006d0 msgr2=0x7f73881993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:40.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738cb25700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73881006d0 0x7f73881993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738cb25700 1 -- 172.21.15.114:0/2793520681 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f73880ffd10 msgr2=0x7f7388198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:40.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738cb25700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f73880ffd10 0x7f7388198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738cb25700 1 -- 172.21.15.114:0/2793520681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7380009d00 con 0x7f7388105660 2023-10-18T14:02:40.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f7387fff700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f73880ffd10 0x7f7388198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.714+0000 7f738cb25700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7388105660 0x7f738819d740 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7380007fd0 tx=0x7f7380009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.715+0000 7f73857fa700 1 -- 172.21.15.114:0/2793520681 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738000e040 con 0x7f7388105660 2023-10-18T14:02:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.715+0000 7f738e588700 1 -- 172.21.15.114:0/2793520681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738819e330 con 0x7f7388105660 2023-10-18T14:02:40.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.715+0000 7f73857fa700 1 -- 172.21.15.114:0/2793520681 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7380004c50 con 0x7f7388105660 2023-10-18T14:02:40.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.715+0000 7f73857fa700 1 -- 172.21.15.114:0/2793520681 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738001b7c0 con 0x7f7388105660 2023-10-18T14:02:40.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.715+0000 7f738e588700 1 -- 172.21.15.114:0/2793520681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73881a5bd0 con 0x7f7388105660 2023-10-18T14:02:40.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.716+0000 7f738e588700 1 -- 172.21.15.114:0/2793520681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7388100d20 con 0x7f7388105660 2023-10-18T14:02:40.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.717+0000 7f73857fa700 1 -- 172.21.15.114:0/2793520681 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f7380005050 con 0x7f7388105660 2023-10-18T14:02:40.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.717+0000 7f73857fa700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f73700a1560 0x7f73700a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:40.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.717+0000 7f7387fff700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f73700a1560 0x7f73700a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:40.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.717+0000 7f73857fa700 1 -- 172.21.15.114:0/2793520681 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f73800ce700 con 0x7f7388105660 2023-10-18T14:02:40.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.718+0000 7f7387fff700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f73700a1560 0x7f73700a3a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7378007900 tx=0x7f7378008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:40.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.721+0000 7f73857fa700 1 -- 172.21.15.114:0/2793520681 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7380097cb0 con 0x7f7388105660 2023-10-18T14:02:40.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.913+0000 7f738e588700 1 -- 172.21.15.114:0/2793520681 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f738810f5c0 con 0x7f73700a1560 2023-10-18T14:02:40.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.922+0000 7f73857fa700 1 -- 172.21.15.114:0/2793520681 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+337281 (secure 0 0 0) 0x7f738810f5c0 con 0x7f73700a1560 2023-10-18T14:02:40.930 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:40.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.926+0000 7f738e588700 1 -- 172.21.15.114:0/2793520681 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f73700a1560 msgr2=0x7f73700a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:40.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.926+0000 7f738e588700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f73700a1560 0x7f73700a3a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7378007900 tx=0x7f7378008040 comp rx=0 tx=0).stop 2023-10-18T14:02:40.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.926+0000 7f738e588700 1 -- 172.21.15.114:0/2793520681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7388105660 msgr2=0x7f738819d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:40.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.926+0000 7f738e588700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7388105660 0x7f738819d740 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7380007fd0 tx=0x7f7380009570 comp rx=0 tx=0).stop 2023-10-18T14:02:40.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.926+0000 7f738e588700 1 -- 172.21.15.114:0/2793520681 shutdown_connections 2023-10-18T14:02:40.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.926+0000 7f738e588700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f73700a1560 0x7f73700a3a20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.926+0000 7f738e588700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7388105660 0x7f738819d740 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.926+0000 7f738e588700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f73880ffd10 0x7f7388198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.926+0000 7f738e588700 1 --2- 172.21.15.114:0/2793520681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73881006d0 0x7f73881993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:40.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.926+0000 7f738e588700 1 -- 172.21.15.114:0/2793520681 >> 172.21.15.114:0/2793520681 conn(0x7f7388075b90 msgr2=0x7f73880fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:40.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.926+0000 7f738e588700 1 -- 172.21.15.114:0/2793520681 shutdown_connections 2023-10-18T14:02:40.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:40.926+0000 7f738e588700 1 -- 172.21.15.114:0/2793520681 wait complete. 2023-10-18T14:02:40.936 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T14:02:40.942 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2023-10-18T14:02:39.558706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596172,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":148,"num_read_kb":130,"num_write":310,"num_write_kb":2977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":251,"ondisk_log_size":251,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335036,"kb_used_data":10812,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606788,"statfs":{"total":1151940427776,"available":1151597350912,"internally_reserved":0,"allocated":11071488,"data_stored":7086263,"data_compressed":108561,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5804,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":129,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.727844"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436981+0000","last_change":"2023-10-18T14:02:32.447514+0000","last_active":"2023-10-18T14:02:33.436981+0000","last_peered":"2023-10-18T14:02:33.436981+0000","last_clean":"2023-10-18T14:02:33.436981+0000","last_became_active":"2023-10-18T14:02:32.447109+0000","last_became_peered":"2023-10-18T14:02:32.447109+0000","last_unstale":"2023-10-18T14:02:33.436981+0000","last_undegraded":"2023-10-18T14:02:33.436981+0000","last_fullsized":"2023-10-18T14:02:33.436981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:02:52.453371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868453+0000","last_change":"2023-10-18T14:02:32.457696+0000","last_active":"2023-10-18T14:02:33.868453+0000","last_peered":"2023-10-18T14:02:33.868453+0000","last_clean":"2023-10-18T14:02:33.868453+0000","last_became_active":"2023-10-18T14:02:32.457380+0000","last_became_peered":"2023-10-18T14:02:32.457380+0000","last_unstale":"2023-10-18T14:02:33.868453+0000","last_undegraded":"2023-10-18T14:02:33.868453+0000","last_fullsized":"2023-10-18T14:02:33.868453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:09:09.303044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.869225+0000","last_change":"2023-10-18T14:02:32.450312+0000","last_active":"2023-10-18T14:02:33.869225+0000","last_peered":"2023-10-18T14:02:33.869225+0000","last_clean":"2023-10-18T14:02:33.869225+0000","last_became_active":"2023-10-18T14:02:32.449994+0000","last_became_peered":"2023-10-18T14:02:32.449994+0000","last_unstale":"2023-10-18T14:02:33.869225+0000","last_undegraded":"2023-10-18T14:02:33.869225+0000","last_fullsized":"2023-10-18T14:02:33.869225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:28:32.445958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868018+0000","last_change":"2023-10-18T14:02:32.450511+0000","last_active":"2023-10-18T14:02:33.868018+0000","last_peered":"2023-10-18T14:02:33.868018+0000","last_clean":"2023-10-18T14:02:33.868018+0000","last_became_active":"2023-10-18T14:02:32.450105+0000","last_became_peered":"2023-10-18T14:02:32.450105+0000","last_unstale":"2023-10-18T14:02:33.868018+0000","last_undegraded":"2023-10-18T14:02:33.868018+0000","last_fullsized":"2023-10-18T14:02:33.868018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:24:52.054236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867921+0000","last_change":"2023-10-18T14:02:32.447099+0000","last_active":"2023-10-18T14:02:33.867921+0000","last_peered":"2023-10-18T14:02:33.867921+0000","last_clean":"2023-10-18T14:02:33.867921+0000","last_became_active":"2023-10-18T14:02:32.446812+0000","last_became_peered":"2023-10-18T14:02:32.446812+0000","last_unstale":"2023-10-18T14:02:33.867921+0000","last_undegraded":"2023-10-18T14:02:33.867921+0000","last_fullsized":"2023-10-18T14:02:33.867921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:11:10.895149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436985+0000","last_change":"2023-10-18T14:02:32.444055+0000","last_active":"2023-10-18T14:02:33.436985+0000","last_peered":"2023-10-18T14:02:33.436985+0000","last_clean":"2023-10-18T14:02:33.436985+0000","last_became_active":"2023-10-18T14:02:32.443750+0000","last_became_peered":"2023-10-18T14:02:32.443750+0000","last_unstale":"2023-10-18T14:02:33.436985+0000","last_undegraded":"2023-10-18T14:02:33.436985+0000","last_fullsized":"2023-10-18T14:02:33.436985+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:05:37.783713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027113+0000","last_change":"2023-10-18T14:02:32.462147+0000","last_active":"2023-10-18T14:02:34.027113+0000","last_peered":"2023-10-18T14:02:34.027113+0000","last_clean":"2023-10-18T14:02:34.027113+0000","last_became_active":"2023-10-18T14:02:32.461712+0000","last_became_peered":"2023-10-18T14:02:32.461712+0000","last_unstale":"2023-10-18T14:02:34.027113+0000","last_undegraded":"2023-10-18T14:02:34.027113+0000","last_fullsized":"2023-10-18T14:02:34.027113+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:10:39.936092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867458+0000","last_change":"2023-10-18T14:02:32.449466+0000","last_active":"2023-10-18T14:02:33.867458+0000","last_peered":"2023-10-18T14:02:33.867458+0000","last_clean":"2023-10-18T14:02:33.867458+0000","last_became_active":"2023-10-18T14:02:32.449146+0000","last_became_peered":"2023-10-18T14:02:32.449146+0000","last_unstale":"2023-10-18T14:02:33.867458+0000","last_undegraded":"2023-10-18T14:02:33.867458+0000","last_fullsized":"2023-10-18T14:02:33.867458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:28.427003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868312+0000","last_change":"2023-10-18T14:02:32.448901+0000","last_active":"2023-10-18T14:02:33.868312+0000","last_peered":"2023-10-18T14:02:33.868312+0000","last_clean":"2023-10-18T14:02:33.868312+0000","last_became_active":"2023-10-18T14:02:32.448379+0000","last_became_peered":"2023-10-18T14:02:32.448379+0000","last_unstale":"2023-10-18T14:02:33.868312+0000","last_undegraded":"2023-10-18T14:02:33.868312+0000","last_fullsized":"2023-10-18T14:02:33.868312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:53:22.743915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.437181+0000","last_change":"2023-10-18T14:02:32.446575+0000","last_active":"2023-10-18T14:02:33.437181+0000","last_peered":"2023-10-18T14:02:33.437181+0000","last_clean":"2023-10-18T14:02:33.437181+0000","last_became_active":"2023-10-18T14:02:32.445756+0000","last_became_peered":"2023-10-18T14:02:32.445756+0000","last_unstale":"2023-10-18T14:02:33.437181+0000","last_undegraded":"2023-10-18T14:02:33.437181+0000","last_fullsized":"2023-10-18T14:02:33.437181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:55.490373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027484+0000","last_change":"2023-10-18T14:02:32.460943+0000","last_active":"2023-10-18T14:02:34.027484+0000","last_peered":"2023-10-18T14:02:34.027484+0000","last_clean":"2023-10-18T14:02:34.027484+0000","last_became_active":"2023-10-18T14:02:32.460540+0000","last_became_peered":"2023-10-18T14:02:32.460540+0000","last_unstale":"2023-10-18T14:02:34.027484+0000","last_undegraded":"2023-10-18T14:02:34.027484+0000","last_fullsized":"2023-10-18T14:02:34.027484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:44:59.309663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867893+0000","last_change":"2023-10-18T14:02:32.450665+0000","last_active":"2023-10-18T14:02:33.867893+0000","last_peered":"2023-10-18T14:02:33.867893+0000","last_clean":"2023-10-18T14:02:33.867893+0000","last_became_active":"2023-10-18T14:02:32.450286+0000","last_became_peered":"2023-10-18T14:02:32.450286+0000","last_unstale":"2023-10-18T14:02:33.867893+0000","last_undegraded":"2023-10-18T14:02:33.867893+0000","last_fullsized":"2023-10-18T14:02:33.867893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:01:17.874856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436541+0000","last_change":"2023-10-18T14:02:32.444129+0000","last_active":"2023-10-18T14:02:33.436541+0000","last_peered":"2023-10-18T14:02:33.436541+0000","last_clean":"2023-10-18T14:02:33.436541+0000","last_became_active":"2023-10-18T14:02:32.443898+0000","last_became_peered":"2023-10-18T14:02:32.443898+0000","last_unstale":"2023-10-18T14:02:33.436541+0000","last_undegraded":"2023-10-18T14:02:33.436541+0000","last_fullsized":"2023-10-18T14:02:33.436541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:20:35.391806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867805+0000","last_change":"2023-10-18T14:02:32.457637+0000","last_active":"2023-10-18T14:02:33.867805+0000","last_peered":"2023-10-18T14:02:33.867805+0000","last_clean":"2023-10-18T14:02:33.867805+0000","last_became_active":"2023-10-18T14:02:32.457345+0000","last_became_peered":"2023-10-18T14:02:32.457345+0000","last_unstale":"2023-10-18T14:02:33.867805+0000","last_undegraded":"2023-10-18T14:02:33.867805+0000","last_fullsized":"2023-10-18T14:02:33.867805+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:18:47.579689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867599+0000","last_change":"2023-10-18T14:02:32.449765+0000","last_active":"2023-10-18T14:02:33.867599+0000","last_peered":"2023-10-18T14:02:33.867599+0000","last_clean":"2023-10-18T14:02:33.867599+0000","last_became_active":"2023-10-18T14:02:32.449467+0000","last_became_peered":"2023-10-18T14:02:32.449467+0000","last_unstale":"2023-10-18T14:02:33.867599+0000","last_undegraded":"2023-10-18T14:02:33.867599+0000","last_fullsized":"2023-10-18T14:02:33.867599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:09:15.324290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867400+0000","last_change":"2023-10-18T14:02:32.456634+0000","last_active":"2023-10-18T14:02:33.867400+0000","last_peered":"2023-10-18T14:02:33.867400+0000","last_clean":"2023-10-18T14:02:33.867400+0000","last_became_active":"2023-10-18T14:02:32.456336+0000","last_became_peered":"2023-10-18T14:02:32.456336+0000","last_unstale":"2023-10-18T14:02:33.867400+0000","last_undegraded":"2023-10-18T14:02:33.867400+0000","last_fullsized":"2023-10-18T14:02:33.867400+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:29:47.973539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.437009+0000","last_change":"2023-10-18T14:02:32.447357+0000","last_active":"2023-10-18T14:02:33.437009+0000","last_peered":"2023-10-18T14:02:33.437009+0000","last_clean":"2023-10-18T14:02:33.437009+0000","last_became_active":"2023-10-18T14:02:32.446756+0000","last_became_peered":"2023-10-18T14:02:32.446756+0000","last_unstale":"2023-10-18T14:02:33.437009+0000","last_undegraded":"2023-10-18T14:02:33.437009+0000","last_fullsized":"2023-10-18T14:02:33.437009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:13:22.467662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867665+0000","last_change":"2023-10-18T14:02:32.452786+0000","last_active":"2023-10-18T14:02:33.867665+0000","last_peered":"2023-10-18T14:02:33.867665+0000","last_clean":"2023-10-18T14:02:33.867665+0000","last_became_active":"2023-10-18T14:02:32.452551+0000","last_became_peered":"2023-10-18T14:02:32.452551+0000","last_unstale":"2023-10-18T14:02:33.867665+0000","last_undegraded":"2023-10-18T14:02:33.867665+0000","last_fullsized":"2023-10-18T14:02:33.867665+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:07.709943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867958+0000","last_change":"2023-10-18T14:02:32.453264+0000","last_active":"2023-10-18T14:02:33.867958+0000","last_peered":"2023-10-18T14:02:33.867958+0000","last_clean":"2023-10-18T14:02:33.867958+0000","last_became_active":"2023-10-18T14:02:32.452948+0000","last_became_peered":"2023-10-18T14:02:32.452948+0000","last_unstale":"2023-10-18T14:02:33.867958+0000","last_undegraded":"2023-10-18T14:02:33.867958+0000","last_fullsized":"2023-10-18T14:02:33.867958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:00:55.243191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867864+0000","last_change":"2023-10-18T14:02:31.843752+0000","last_active":"2023-10-18T14:02:33.867864+0000","last_peered":"2023-10-18T14:02:33.867864+0000","last_clean":"2023-10-18T14:02:33.867864+0000","last_became_active":"2023-10-18T14:02:31.843415+0000","last_became_peered":"2023-10-18T14:02:31.843415+0000","last_unstale":"2023-10-18T14:02:33.867864+0000","last_undegraded":"2023-10-18T14:02:33.867864+0000","last_fullsized":"2023-10-18T14:02:33.867864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:32:11.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868563+0000","last_change":"2023-10-18T14:02:32.458934+0000","last_active":"2023-10-18T14:02:33.868563+0000","last_peered":"2023-10-18T14:02:33.868563+0000","last_clean":"2023-10-18T14:02:33.868563+0000","last_became_active":"2023-10-18T14:02:32.458624+0000","last_became_peered":"2023-10-18T14:02:32.458624+0000","last_unstale":"2023-10-18T14:02:33.868563+0000","last_undegraded":"2023-10-18T14:02:33.868563+0000","last_fullsized":"2023-10-18T14:02:33.868563+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:24:20.034637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868723+0000","last_change":"2023-10-18T14:02:31.842666+0000","last_active":"2023-10-18T14:02:33.868723+0000","last_peered":"2023-10-18T14:02:33.868723+0000","last_clean":"2023-10-18T14:02:33.868723+0000","last_became_active":"2023-10-18T14:02:31.842366+0000","last_became_peered":"2023-10-18T14:02:31.842366+0000","last_unstale":"2023-10-18T14:02:33.868723+0000","last_undegraded":"2023-10-18T14:02:33.868723+0000","last_fullsized":"2023-10-18T14:02:33.868723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:11:08.150402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868771+0000","last_change":"2023-10-18T14:02:32.453731+0000","last_active":"2023-10-18T14:02:33.868771+0000","last_peered":"2023-10-18T14:02:33.868771+0000","last_clean":"2023-10-18T14:02:33.868771+0000","last_became_active":"2023-10-18T14:02:32.453405+0000","last_became_peered":"2023-10-18T14:02:32.453405+0000","last_unstale":"2023-10-18T14:02:33.868771+0000","last_undegraded":"2023-10-18T14:02:33.868771+0000","last_fullsized":"2023-10-18T14:02:33.868771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:19:57.878074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'11","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.267496+0000","last_change":"2023-10-18T14:02:31.851514+0000","last_active":"2023-10-18T14:02:38.267496+0000","last_peered":"2023-10-18T14:02:38.267496+0000","last_clean":"2023-10-18T14:02:38.267496+0000","last_became_active":"2023-10-18T14:02:31.851236+0000","last_became_peered":"2023-10-18T14:02:31.851236+0000","last_unstale":"2023-10-18T14:02:38.267496+0000","last_undegraded":"2023-10-18T14:02:38.267496+0000","last_fullsized":"2023-10-18T14:02:38.267496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:35:26.804135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868449+0000","last_change":"2023-10-18T14:02:32.460018+0000","last_active":"2023-10-18T14:02:33.868449+0000","last_peered":"2023-10-18T14:02:33.868449+0000","last_clean":"2023-10-18T14:02:33.868449+0000","last_became_active":"2023-10-18T14:02:32.459738+0000","last_became_peered":"2023-10-18T14:02:32.459738+0000","last_unstale":"2023-10-18T14:02:33.868449+0000","last_undegraded":"2023-10-18T14:02:33.868449+0000","last_fullsized":"2023-10-18T14:02:33.868449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:48.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.267543+0000","last_change":"2023-10-18T14:02:31.850112+0000","last_active":"2023-10-18T14:02:38.267543+0000","last_peered":"2023-10-18T14:02:38.267543+0000","last_clean":"2023-10-18T14:02:38.267543+0000","last_became_active":"2023-10-18T14:02:31.849515+0000","last_became_peered":"2023-10-18T14:02:31.849515+0000","last_unstale":"2023-10-18T14:02:38.267543+0000","last_undegraded":"2023-10-18T14:02:38.267543+0000","last_fullsized":"2023-10-18T14:02:38.267543+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:35:20.338900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868609+0000","last_change":"2023-10-18T14:02:32.459221+0000","last_active":"2023-10-18T14:02:33.868609+0000","last_peered":"2023-10-18T14:02:33.868609+0000","last_clean":"2023-10-18T14:02:33.868609+0000","last_became_active":"2023-10-18T14:02:32.458912+0000","last_became_peered":"2023-10-18T14:02:32.458912+0000","last_unstale":"2023-10-18T14:02:33.868609+0000","last_undegraded":"2023-10-18T14:02:33.868609+0000","last_fullsized":"2023-10-18T14:02:33.868609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:54:02.630861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.875520+0000","last_change":"2023-10-18T14:02:31.846754+0000","last_active":"2023-10-18T14:02:35.875520+0000","last_peered":"2023-10-18T14:02:35.875520+0000","last_clean":"2023-10-18T14:02:35.875520+0000","last_became_active":"2023-10-18T14:02:31.846450+0000","last_became_peered":"2023-10-18T14:02:31.846450+0000","last_unstale":"2023-10-18T14:02:35.875520+0000","last_undegraded":"2023-10-18T14:02:35.875520+0000","last_fullsized":"2023-10-18T14:02:35.875520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:11.929528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867981+0000","last_change":"2023-10-18T14:02:32.456175+0000","last_active":"2023-10-18T14:02:33.867981+0000","last_peered":"2023-10-18T14:02:33.867981+0000","last_clean":"2023-10-18T14:02:33.867981+0000","last_became_active":"2023-10-18T14:02:32.455839+0000","last_became_peered":"2023-10-18T14:02:32.455839+0000","last_unstale":"2023-10-18T14:02:33.867981+0000","last_undegraded":"2023-10-18T14:02:33.867981+0000","last_fullsized":"2023-10-18T14:02:33.867981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:48:14.035082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436825+0000","last_change":"2023-10-18T14:02:31.846135+0000","last_active":"2023-10-18T14:02:33.436825+0000","last_peered":"2023-10-18T14:02:33.436825+0000","last_clean":"2023-10-18T14:02:33.436825+0000","last_became_active":"2023-10-18T14:02:31.845800+0000","last_became_peered":"2023-10-18T14:02:31.845800+0000","last_unstale":"2023-10-18T14:02:33.436825+0000","last_undegraded":"2023-10-18T14:02:33.436825+0000","last_fullsized":"2023-10-18T14:02:33.436825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:22:55.945930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868304+0000","last_change":"2023-10-18T14:02:32.445803+0000","last_active":"2023-10-18T14:02:33.868304+0000","last_peered":"2023-10-18T14:02:33.868304+0000","last_clean":"2023-10-18T14:02:33.868304+0000","last_became_active":"2023-10-18T14:02:32.445489+0000","last_became_peered":"2023-10-18T14:02:32.445489+0000","last_unstale":"2023-10-18T14:02:33.868304+0000","last_undegraded":"2023-10-18T14:02:33.868304+0000","last_fullsized":"2023-10-18T14:02:33.868304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:38:46.101215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:36.878888+0000","last_change":"2023-10-18T14:02:31.843827+0000","last_active":"2023-10-18T14:02:36.878888+0000","last_peered":"2023-10-18T14:02:36.878888+0000","last_clean":"2023-10-18T14:02:36.878888+0000","last_became_active":"2023-10-18T14:02:31.843533+0000","last_became_peered":"2023-10-18T14:02:31.843533+0000","last_unstale":"2023-10-18T14:02:36.878888+0000","last_undegraded":"2023-10-18T14:02:36.878888+0000","last_fullsized":"2023-10-18T14:02:36.878888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:00:03.832002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867605+0000","last_change":"2023-10-18T14:02:32.447400+0000","last_active":"2023-10-18T14:02:33.867605+0000","last_peered":"2023-10-18T14:02:33.867605+0000","last_clean":"2023-10-18T14:02:33.867605+0000","last_became_active":"2023-10-18T14:02:32.447024+0000","last_became_peered":"2023-10-18T14:02:32.447024+0000","last_unstale":"2023-10-18T14:02:33.867605+0000","last_undegraded":"2023-10-18T14:02:33.867605+0000","last_fullsized":"2023-10-18T14:02:33.867605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:49:37.596273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868529+0000","last_change":"2023-10-18T14:02:31.847527+0000","last_active":"2023-10-18T14:02:33.868529+0000","last_peered":"2023-10-18T14:02:33.868529+0000","last_clean":"2023-10-18T14:02:33.868529+0000","last_became_active":"2023-10-18T14:02:31.847249+0000","last_became_peered":"2023-10-18T14:02:31.847249+0000","last_unstale":"2023-10-18T14:02:33.868529+0000","last_undegraded":"2023-10-18T14:02:33.868529+0000","last_fullsized":"2023-10-18T14:02:33.868529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:11:34.217776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867853+0000","last_change":"2023-10-18T14:02:32.452268+0000","last_active":"2023-10-18T14:02:33.867853+0000","last_peered":"2023-10-18T14:02:33.867853+0000","last_clean":"2023-10-18T14:02:33.867853+0000","last_became_active":"2023-10-18T14:02:32.451338+0000","last_became_peered":"2023-10-18T14:02:32.451338+0000","last_unstale":"2023-10-18T14:02:33.867853+0000","last_undegraded":"2023-10-18T14:02:33.867853+0000","last_fullsized":"2023-10-18T14:02:33.867853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:17:11.743280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.437137+0000","last_change":"2023-10-18T14:02:31.841862+0000","last_active":"2023-10-18T14:02:33.437137+0000","last_peered":"2023-10-18T14:02:33.437137+0000","last_clean":"2023-10-18T14:02:33.437137+0000","last_became_active":"2023-10-18T14:02:31.841481+0000","last_became_peered":"2023-10-18T14:02:31.841481+0000","last_unstale":"2023-10-18T14:02:33.437137+0000","last_undegraded":"2023-10-18T14:02:33.437137+0000","last_fullsized":"2023-10-18T14:02:33.437137+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:38:26.263626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868047+0000","last_change":"2023-10-18T14:02:32.447608+0000","last_active":"2023-10-18T14:02:33.868047+0000","last_peered":"2023-10-18T14:02:33.868047+0000","last_clean":"2023-10-18T14:02:33.868047+0000","last_became_active":"2023-10-18T14:02:32.447057+0000","last_became_peered":"2023-10-18T14:02:32.447057+0000","last_unstale":"2023-10-18T14:02:33.868047+0000","last_undegraded":"2023-10-18T14:02:33.868047+0000","last_fullsized":"2023-10-18T14:02:33.868047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:33:43.469496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.874923+0000","last_change":"2023-10-18T14:02:31.849118+0000","last_active":"2023-10-18T14:02:35.874923+0000","last_peered":"2023-10-18T14:02:35.874923+0000","last_clean":"2023-10-18T14:02:35.874923+0000","last_became_active":"2023-10-18T14:02:31.848827+0000","last_became_peered":"2023-10-18T14:02:31.848827+0000","last_unstale":"2023-10-18T14:02:35.874923+0000","last_undegraded":"2023-10-18T14:02:35.874923+0000","last_fullsized":"2023-10-18T14:02:35.874923+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:41:17.309102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868962+0000","last_change":"2023-10-18T14:02:32.447157+0000","last_active":"2023-10-18T14:02:33.868962+0000","last_peered":"2023-10-18T14:02:33.868962+0000","last_clean":"2023-10-18T14:02:33.868962+0000","last_became_active":"2023-10-18T14:02:32.446861+0000","last_became_peered":"2023-10-18T14:02:32.446861+0000","last_unstale":"2023-10-18T14:02:33.868962+0000","last_undegraded":"2023-10-18T14:02:33.868962+0000","last_fullsized":"2023-10-18T14:02:33.868962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:58:58.146931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868732+0000","last_change":"2023-10-18T14:02:31.838819+0000","last_active":"2023-10-18T14:02:33.868732+0000","last_peered":"2023-10-18T14:02:33.868732+0000","last_clean":"2023-10-18T14:02:33.868732+0000","last_became_active":"2023-10-18T14:02:31.838488+0000","last_became_peered":"2023-10-18T14:02:31.838488+0000","last_unstale":"2023-10-18T14:02:33.868732+0000","last_undegraded":"2023-10-18T14:02:33.868732+0000","last_fullsized":"2023-10-18T14:02:33.868732+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:41:37.569792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868573+0000","last_change":"2023-10-18T14:02:32.455108+0000","last_active":"2023-10-18T14:02:33.868573+0000","last_peered":"2023-10-18T14:02:33.868573+0000","last_clean":"2023-10-18T14:02:33.868573+0000","last_became_active":"2023-10-18T14:02:32.454821+0000","last_became_peered":"2023-10-18T14:02:32.454821+0000","last_unstale":"2023-10-18T14:02:33.868573+0000","last_undegraded":"2023-10-18T14:02:33.868573+0000","last_fullsized":"2023-10-18T14:02:33.868573+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:00:29.617633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.437012+0000","last_change":"2023-10-18T14:02:31.847241+0000","last_active":"2023-10-18T14:02:33.437012+0000","last_peered":"2023-10-18T14:02:33.437012+0000","last_clean":"2023-10-18T14:02:33.437012+0000","last_became_active":"2023-10-18T14:02:31.846786+0000","last_became_peered":"2023-10-18T14:02:31.846786+0000","last_unstale":"2023-10-18T14:02:33.437012+0000","last_undegraded":"2023-10-18T14:02:33.437012+0000","last_fullsized":"2023-10-18T14:02:33.437012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:53:47.539696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868475+0000","last_change":"2023-10-18T14:02:32.458530+0000","last_active":"2023-10-18T14:02:33.868475+0000","last_peered":"2023-10-18T14:02:33.868475+0000","last_clean":"2023-10-18T14:02:33.868475+0000","last_became_active":"2023-10-18T14:02:32.458199+0000","last_became_peered":"2023-10-18T14:02:32.458199+0000","last_unstale":"2023-10-18T14:02:33.868475+0000","last_undegraded":"2023-10-18T14:02:33.868475+0000","last_fullsized":"2023-10-18T14:02:33.868475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:52:16.107456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.264641+0000","last_change":"2023-10-18T14:02:31.845446+0000","last_active":"2023-10-18T14:02:38.264641+0000","last_peered":"2023-10-18T14:02:38.264641+0000","last_clean":"2023-10-18T14:02:38.264641+0000","last_became_active":"2023-10-18T14:02:31.845146+0000","last_became_peered":"2023-10-18T14:02:31.845146+0000","last_unstale":"2023-10-18T14:02:38.264641+0000","last_undegraded":"2023-10-18T14:02:38.264641+0000","last_fullsized":"2023-10-18T14:02:38.264641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:46:16.799500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436467+0000","last_change":"2023-10-18T14:02:32.456404+0000","last_active":"2023-10-18T14:02:33.436467+0000","last_peered":"2023-10-18T14:02:33.436467+0000","last_clean":"2023-10-18T14:02:33.436467+0000","last_became_active":"2023-10-18T14:02:32.456128+0000","last_became_peered":"2023-10-18T14:02:32.456128+0000","last_unstale":"2023-10-18T14:02:33.436467+0000","last_undegraded":"2023-10-18T14:02:33.436467+0000","last_fullsized":"2023-10-18T14:02:33.436467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:23:41.315513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.873559+0000","last_change":"2023-10-18T14:02:31.846871+0000","last_active":"2023-10-18T14:02:35.873559+0000","last_peered":"2023-10-18T14:02:35.873559+0000","last_clean":"2023-10-18T14:02:35.873559+0000","last_became_active":"2023-10-18T14:02:31.846570+0000","last_became_peered":"2023-10-18T14:02:31.846570+0000","last_unstale":"2023-10-18T14:02:35.873559+0000","last_undegraded":"2023-10-18T14:02:35.873559+0000","last_fullsized":"2023-10-18T14:02:35.873559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:38:46.096769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027285+0000","last_change":"2023-10-18T14:02:32.462678+0000","last_active":"2023-10-18T14:02:34.027285+0000","last_peered":"2023-10-18T14:02:34.027285+0000","last_clean":"2023-10-18T14:02:34.027285+0000","last_became_active":"2023-10-18T14:02:32.462331+0000","last_became_peered":"2023-10-18T14:02:32.462331+0000","last_unstale":"2023-10-18T14:02:34.027285+0000","last_undegraded":"2023-10-18T14:02:34.027285+0000","last_fullsized":"2023-10-18T14:02:34.027285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:11:32.934933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-18T14:02:32.437341+0000","last_change":"2023-10-18T14:02:31.844367+0000","last_active":"2023-10-18T14:02:32.437341+0000","last_peered":"2023-10-18T14:02:32.437341+0000","last_clean":"2023-10-18T14:02:32.437341+0000","last_became_active":"2023-10-18T14:02:31.844060+0000","last_became_peered":"2023-10-18T14:02:31.844060+0000","last_unstale":"2023-10-18T14:02:32.437341+0000","last_undegraded":"2023-10-18T14:02:32.437341+0000","last_fullsized":"2023-10-18T14:02:32.437341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:06:09.656240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027079+0000","last_change":"2023-10-18T14:02:32.464529+0000","last_active":"2023-10-18T14:02:34.027079+0000","last_peered":"2023-10-18T14:02:34.027079+0000","last_clean":"2023-10-18T14:02:34.027079+0000","last_became_active":"2023-10-18T14:02:32.464232+0000","last_became_peered":"2023-10-18T14:02:32.464232+0000","last_unstale":"2023-10-18T14:02:34.027079+0000","last_undegraded":"2023-10-18T14:02:34.027079+0000","last_fullsized":"2023-10-18T14:02:34.027079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:10:43.011803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.258262+0000","last_change":"2023-10-18T14:02:31.850537+0000","last_active":"2023-10-18T14:02:38.258262+0000","last_peered":"2023-10-18T14:02:38.258262+0000","last_clean":"2023-10-18T14:02:38.258262+0000","last_became_active":"2023-10-18T14:02:31.849391+0000","last_became_peered":"2023-10-18T14:02:31.849391+0000","last_unstale":"2023-10-18T14:02:38.258262+0000","last_undegraded":"2023-10-18T14:02:38.258262+0000","last_fullsized":"2023-10-18T14:02:38.258262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:19:31.270179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867658+0000","last_change":"2023-10-18T14:02:32.458608+0000","last_active":"2023-10-18T14:02:33.867658+0000","last_peered":"2023-10-18T14:02:33.867658+0000","last_clean":"2023-10-18T14:02:33.867658+0000","last_became_active":"2023-10-18T14:02:32.458298+0000","last_became_peered":"2023-10-18T14:02:32.458298+0000","last_unstale":"2023-10-18T14:02:33.867658+0000","last_undegraded":"2023-10-18T14:02:33.867658+0000","last_fullsized":"2023-10-18T14:02:33.867658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:02.105181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867952+0000","last_change":"2023-10-18T14:02:31.850706+0000","last_active":"2023-10-18T14:02:33.867952+0000","last_peered":"2023-10-18T14:02:33.867952+0000","last_clean":"2023-10-18T14:02:33.867952+0000","last_became_active":"2023-10-18T14:02:31.849354+0000","last_became_peered":"2023-10-18T14:02:31.849354+0000","last_unstale":"2023-10-18T14:02:33.867952+0000","last_undegraded":"2023-10-18T14:02:33.867952+0000","last_fullsized":"2023-10-18T14:02:33.867952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:51:31.071528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436839+0000","last_change":"2023-10-18T14:02:32.454196+0000","last_active":"2023-10-18T14:02:33.436839+0000","last_peered":"2023-10-18T14:02:33.436839+0000","last_clean":"2023-10-18T14:02:33.436839+0000","last_became_active":"2023-10-18T14:02:32.453861+0000","last_became_peered":"2023-10-18T14:02:32.453861+0000","last_unstale":"2023-10-18T14:02:33.436839+0000","last_undegraded":"2023-10-18T14:02:33.436839+0000","last_fullsized":"2023-10-18T14:02:33.436839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:43.217757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868091+0000","last_change":"2023-10-18T14:02:31.849707+0000","last_active":"2023-10-18T14:02:33.868091+0000","last_peered":"2023-10-18T14:02:33.868091+0000","last_clean":"2023-10-18T14:02:33.868091+0000","last_became_active":"2023-10-18T14:02:31.849442+0000","last_became_peered":"2023-10-18T14:02:31.849442+0000","last_unstale":"2023-10-18T14:02:33.868091+0000","last_undegraded":"2023-10-18T14:02:33.868091+0000","last_fullsized":"2023-10-18T14:02:33.868091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:39:15.669730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.437088+0000","last_change":"2023-10-18T14:02:32.457433+0000","last_active":"2023-10-18T14:02:33.437088+0000","last_peered":"2023-10-18T14:02:33.437088+0000","last_clean":"2023-10-18T14:02:33.437088+0000","last_became_active":"2023-10-18T14:02:32.457057+0000","last_became_peered":"2023-10-18T14:02:32.457057+0000","last_unstale":"2023-10-18T14:02:33.437088+0000","last_undegraded":"2023-10-18T14:02:33.437088+0000","last_fullsized":"2023-10-18T14:02:33.437088+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:53.088723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027242+0000","last_change":"2023-10-18T14:02:31.848595+0000","last_active":"2023-10-18T14:02:34.027242+0000","last_peered":"2023-10-18T14:02:34.027242+0000","last_clean":"2023-10-18T14:02:34.027242+0000","last_became_active":"2023-10-18T14:02:31.847987+0000","last_became_peered":"2023-10-18T14:02:31.847987+0000","last_unstale":"2023-10-18T14:02:34.027242+0000","last_undegraded":"2023-10-18T14:02:34.027242+0000","last_fullsized":"2023-10-18T14:02:34.027242+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:03:34.356729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.437092+0000","last_change":"2023-10-18T14:02:32.446514+0000","last_active":"2023-10-18T14:02:33.437092+0000","last_peered":"2023-10-18T14:02:33.437092+0000","last_clean":"2023-10-18T14:02:33.437092+0000","last_became_active":"2023-10-18T14:02:32.446015+0000","last_became_peered":"2023-10-18T14:02:32.446015+0000","last_unstale":"2023-10-18T14:02:33.437092+0000","last_undegraded":"2023-10-18T14:02:33.437092+0000","last_fullsized":"2023-10-18T14:02:33.437092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:21:09.897636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868762+0000","last_change":"2023-10-18T14:02:32.444969+0000","last_active":"2023-10-18T14:02:33.868762+0000","last_peered":"2023-10-18T14:02:33.868762+0000","last_clean":"2023-10-18T14:02:33.868762+0000","last_became_active":"2023-10-18T14:02:32.444592+0000","last_became_peered":"2023-10-18T14:02:32.444592+0000","last_unstale":"2023-10-18T14:02:33.868762+0000","last_undegraded":"2023-10-18T14:02:33.868762+0000","last_fullsized":"2023-10-18T14:02:33.868762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:02:58.377003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:36.879327+0000","last_change":"2023-10-18T14:02:31.847368+0000","last_active":"2023-10-18T14:02:36.879327+0000","last_peered":"2023-10-18T14:02:36.879327+0000","last_clean":"2023-10-18T14:02:36.879327+0000","last_became_active":"2023-10-18T14:02:31.847072+0000","last_became_peered":"2023-10-18T14:02:31.847072+0000","last_unstale":"2023-10-18T14:02:36.879327+0000","last_undegraded":"2023-10-18T14:02:36.879327+0000","last_fullsized":"2023-10-18T14:02:36.879327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:28:24.771284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.869088+0000","last_change":"2023-10-18T14:02:32.448283+0000","last_active":"2023-10-18T14:02:33.869088+0000","last_peered":"2023-10-18T14:02:33.869088+0000","last_clean":"2023-10-18T14:02:33.869088+0000","last_became_active":"2023-10-18T14:02:32.447988+0000","last_became_peered":"2023-10-18T14:02:32.447988+0000","last_unstale":"2023-10-18T14:02:33.869088+0000","last_undegraded":"2023-10-18T14:02:33.869088+0000","last_fullsized":"2023-10-18T14:02:33.869088+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:08:28.048443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.873659+0000","last_change":"2023-10-18T14:02:31.843678+0000","last_active":"2023-10-18T14:02:35.873659+0000","last_peered":"2023-10-18T14:02:35.873659+0000","last_clean":"2023-10-18T14:02:35.873659+0000","last_became_active":"2023-10-18T14:02:31.843332+0000","last_became_peered":"2023-10-18T14:02:31.843332+0000","last_unstale":"2023-10-18T14:02:35.873659+0000","last_undegraded":"2023-10-18T14:02:35.873659+0000","last_fullsized":"2023-10-18T14:02:35.873659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:06:04.549859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":319,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-18T14:02:32.563608+0000","last_change":"2023-10-18T14:01:34.022246+0000","last_active":"2023-10-18T14:02:32.563608+0000","last_peered":"2023-10-18T14:02:32.563608+0000","last_clean":"2023-10-18T14:02:32.563608+0000","last_became_active":"2023-10-18T14:01:34.021768+0000","last_became_peered":"2023-10-18T14:01:34.021768+0000","last_unstale":"2023-10-18T14:02:32.563608+0000","last_undegraded":"2023-10-18T14:02:32.563608+0000","last_fullsized":"2023-10-18T14:02:32.563608+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_clean_scrub_stamp":"2023-10-18T13:58:44.223424+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:48.521087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436266+0000","last_change":"2023-10-18T14:02:32.440662+0000","last_active":"2023-10-18T14:02:33.436266+0000","last_peered":"2023-10-18T14:02:33.436266+0000","last_clean":"2023-10-18T14:02:33.436266+0000","last_became_active":"2023-10-18T14:02:32.440345+0000","last_became_peered":"2023-10-18T14:02:32.440345+0000","last_unstale":"2023-10-18T14:02:33.436266+0000","last_undegraded":"2023-10-18T14:02:33.436266+0000","last_fullsized":"2023-10-18T14:02:33.436266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:21.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:36.878180+0000","last_change":"2023-10-18T14:02:31.850243+0000","last_active":"2023-10-18T14:02:36.878180+0000","last_peered":"2023-10-18T14:02:36.878180+0000","last_clean":"2023-10-18T14:02:36.878180+0000","last_became_active":"2023-10-18T14:02:31.849952+0000","last_became_peered":"2023-10-18T14:02:31.849952+0000","last_unstale":"2023-10-18T14:02:36.878180+0000","last_undegraded":"2023-10-18T14:02:36.878180+0000","last_fullsized":"2023-10-18T14:02:36.878180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:11:50.877219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.258272+0000","last_change":"2023-10-18T14:02:31.851089+0000","last_active":"2023-10-18T14:02:38.258272+0000","last_peered":"2023-10-18T14:02:38.258272+0000","last_clean":"2023-10-18T14:02:38.258272+0000","last_became_active":"2023-10-18T14:02:31.850759+0000","last_became_peered":"2023-10-18T14:02:31.850759+0000","last_unstale":"2023-10-18T14:02:38.258272+0000","last_undegraded":"2023-10-18T14:02:38.258272+0000","last_fullsized":"2023-10-18T14:02:38.258272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:53:37.797881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436681+0000","last_change":"2023-10-18T14:02:32.445046+0000","last_active":"2023-10-18T14:02:33.436681+0000","last_peered":"2023-10-18T14:02:33.436681+0000","last_clean":"2023-10-18T14:02:33.436681+0000","last_became_active":"2023-10-18T14:02:32.444827+0000","last_became_peered":"2023-10-18T14:02:32.444827+0000","last_unstale":"2023-10-18T14:02:33.436681+0000","last_undegraded":"2023-10-18T14:02:33.436681+0000","last_fullsized":"2023-10-18T14:02:33.436681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:26:11.024405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867756+0000","last_change":"2023-10-18T14:02:31.846888+0000","last_active":"2023-10-18T14:02:33.867756+0000","last_peered":"2023-10-18T14:02:33.867756+0000","last_clean":"2023-10-18T14:02:33.867756+0000","last_became_active":"2023-10-18T14:02:31.846591+0000","last_became_peered":"2023-10-18T14:02:31.846591+0000","last_unstale":"2023-10-18T14:02:33.867756+0000","last_undegraded":"2023-10-18T14:02:33.867756+0000","last_fullsized":"2023-10-18T14:02:33.867756+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:48:03.683135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867872+0000","last_change":"2023-10-18T14:02:32.456951+0000","last_active":"2023-10-18T14:02:33.867872+0000","last_peered":"2023-10-18T14:02:33.867872+0000","last_clean":"2023-10-18T14:02:33.867872+0000","last_became_active":"2023-10-18T14:02:32.456588+0000","last_became_peered":"2023-10-18T14:02:32.456588+0000","last_unstale":"2023-10-18T14:02:33.867872+0000","last_undegraded":"2023-10-18T14:02:33.867872+0000","last_fullsized":"2023-10-18T14:02:33.867872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:51:51.335310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.872568+0000","last_change":"2023-10-18T14:02:31.845258+0000","last_active":"2023-10-18T14:02:35.872568+0000","last_peered":"2023-10-18T14:02:35.872568+0000","last_clean":"2023-10-18T14:02:35.872568+0000","last_became_active":"2023-10-18T14:02:31.844933+0000","last_became_peered":"2023-10-18T14:02:31.844933+0000","last_unstale":"2023-10-18T14:02:35.872568+0000","last_undegraded":"2023-10-18T14:02:35.872568+0000","last_fullsized":"2023-10-18T14:02:35.872568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:51:46.765525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868572+0000","last_change":"2023-10-18T14:02:32.454955+0000","last_active":"2023-10-18T14:02:33.868572+0000","last_peered":"2023-10-18T14:02:33.868572+0000","last_clean":"2023-10-18T14:02:33.868572+0000","last_became_active":"2023-10-18T14:02:32.454689+0000","last_became_peered":"2023-10-18T14:02:32.454689+0000","last_unstale":"2023-10-18T14:02:33.868572+0000","last_undegraded":"2023-10-18T14:02:33.868572+0000","last_fullsized":"2023-10-18T14:02:33.868572+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:57:20.461517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.875464+0000","last_change":"2023-10-18T14:02:31.849273+0000","last_active":"2023-10-18T14:02:35.875464+0000","last_peered":"2023-10-18T14:02:35.875464+0000","last_clean":"2023-10-18T14:02:35.875464+0000","last_became_active":"2023-10-18T14:02:31.848985+0000","last_became_peered":"2023-10-18T14:02:31.848985+0000","last_unstale":"2023-10-18T14:02:35.875464+0000","last_undegraded":"2023-10-18T14:02:35.875464+0000","last_fullsized":"2023-10-18T14:02:35.875464+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:55:54.516857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867773+0000","last_change":"2023-10-18T14:02:32.449557+0000","last_active":"2023-10-18T14:02:33.867773+0000","last_peered":"2023-10-18T14:02:33.867773+0000","last_clean":"2023-10-18T14:02:33.867773+0000","last_became_active":"2023-10-18T14:02:32.449033+0000","last_became_peered":"2023-10-18T14:02:32.449033+0000","last_unstale":"2023-10-18T14:02:33.867773+0000","last_undegraded":"2023-10-18T14:02:33.867773+0000","last_fullsized":"2023-10-18T14:02:33.867773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:32.983379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.264562+0000","last_change":"2023-10-18T14:02:31.846109+0000","last_active":"2023-10-18T14:02:38.264562+0000","last_peered":"2023-10-18T14:02:38.264562+0000","last_clean":"2023-10-18T14:02:38.264562+0000","last_became_active":"2023-10-18T14:02:31.845236+0000","last_became_peered":"2023-10-18T14:02:31.845236+0000","last_unstale":"2023-10-18T14:02:38.264562+0000","last_undegraded":"2023-10-18T14:02:38.264562+0000","last_fullsized":"2023-10-18T14:02:38.264562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:46.880974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436708+0000","last_change":"2023-10-18T14:02:32.446465+0000","last_active":"2023-10-18T14:02:33.436708+0000","last_peered":"2023-10-18T14:02:33.436708+0000","last_clean":"2023-10-18T14:02:33.436708+0000","last_became_active":"2023-10-18T14:02:32.446172+0000","last_became_peered":"2023-10-18T14:02:32.446172+0000","last_unstale":"2023-10-18T14:02:33.436708+0000","last_undegraded":"2023-10-18T14:02:33.436708+0000","last_fullsized":"2023-10-18T14:02:33.436708+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:14:40.094870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.233415+0000","last_change":"2023-10-18T14:02:31.851198+0000","last_active":"2023-10-18T14:02:34.233415+0000","last_peered":"2023-10-18T14:02:34.233415+0000","last_clean":"2023-10-18T14:02:34.233415+0000","last_became_active":"2023-10-18T14:02:31.850524+0000","last_became_peered":"2023-10-18T14:02:31.850524+0000","last_unstale":"2023-10-18T14:02:34.233415+0000","last_undegraded":"2023-10-18T14:02:34.233415+0000","last_fullsized":"2023-10-18T14:02:34.233415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:13:44.133077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868101+0000","last_change":"2023-10-18T14:02:32.446732+0000","last_active":"2023-10-18T14:02:33.868101+0000","last_peered":"2023-10-18T14:02:33.868101+0000","last_clean":"2023-10-18T14:02:33.868101+0000","last_became_active":"2023-10-18T14:02:32.446418+0000","last_became_peered":"2023-10-18T14:02:32.446418+0000","last_unstale":"2023-10-18T14:02:33.868101+0000","last_undegraded":"2023-10-18T14:02:33.868101+0000","last_fullsized":"2023-10-18T14:02:33.868101+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:13.765988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:35.875633+0000","last_change":"2023-10-18T14:02:31.852648+0000","last_active":"2023-10-18T14:02:35.875633+0000","last_peered":"2023-10-18T14:02:35.875633+0000","last_clean":"2023-10-18T14:02:35.875633+0000","last_became_active":"2023-10-18T14:02:31.852361+0000","last_became_peered":"2023-10-18T14:02:31.852361+0000","last_unstale":"2023-10-18T14:02:35.875633+0000","last_undegraded":"2023-10-18T14:02:35.875633+0000","last_fullsized":"2023-10-18T14:02:35.875633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:54:28.189196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027263+0000","last_change":"2023-10-18T14:02:32.464220+0000","last_active":"2023-10-18T14:02:34.027263+0000","last_peered":"2023-10-18T14:02:34.027263+0000","last_clean":"2023-10-18T14:02:34.027263+0000","last_became_active":"2023-10-18T14:02:32.463213+0000","last_became_peered":"2023-10-18T14:02:32.463213+0000","last_unstale":"2023-10-18T14:02:34.027263+0000","last_undegraded":"2023-10-18T14:02:34.027263+0000","last_fullsized":"2023-10-18T14:02:34.027263+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:53.777086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:38.264378+0000","last_change":"2023-10-18T14:02:31.848305+0000","last_active":"2023-10-18T14:02:38.264378+0000","last_peered":"2023-10-18T14:02:38.264378+0000","last_clean":"2023-10-18T14:02:38.264378+0000","last_became_active":"2023-10-18T14:02:31.847739+0000","last_became_peered":"2023-10-18T14:02:31.847739+0000","last_unstale":"2023-10-18T14:02:38.264378+0000","last_undegraded":"2023-10-18T14:02:38.264378+0000","last_fullsized":"2023-10-18T14:02:38.264378+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:52:24.543703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027520+0000","last_change":"2023-10-18T14:02:32.460802+0000","last_active":"2023-10-18T14:02:34.027520+0000","last_peered":"2023-10-18T14:02:34.027520+0000","last_clean":"2023-10-18T14:02:34.027520+0000","last_became_active":"2023-10-18T14:02:32.460160+0000","last_became_peered":"2023-10-18T14:02:32.460160+0000","last_unstale":"2023-10-18T14:02:34.027520+0000","last_undegraded":"2023-10-18T14:02:34.027520+0000","last_fullsized":"2023-10-18T14:02:34.027520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:20:55.614142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-18T14:02:32.849522+0000","last_change":"2023-10-18T14:02:31.845468+0000","last_active":"2023-10-18T14:02:32.849522+0000","last_peered":"2023-10-18T14:02:32.849522+0000","last_clean":"2023-10-18T14:02:32.849522+0000","last_became_active":"2023-10-18T14:02:31.845057+0000","last_became_peered":"2023-10-18T14:02:31.845057+0000","last_unstale":"2023-10-18T14:02:32.849522+0000","last_undegraded":"2023-10-18T14:02:32.849522+0000","last_fullsized":"2023-10-18T14:02:32.849522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:08:23.972051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027279+0000","last_change":"2023-10-18T14:02:32.462572+0000","last_active":"2023-10-18T14:02:34.027279+0000","last_peered":"2023-10-18T14:02:34.027279+0000","last_clean":"2023-10-18T14:02:34.027279+0000","last_became_active":"2023-10-18T14:02:32.462140+0000","last_became_peered":"2023-10-18T14:02:32.462140+0000","last_unstale":"2023-10-18T14:02:34.027279+0000","last_undegraded":"2023-10-18T14:02:34.027279+0000","last_fullsized":"2023-10-18T14:02:34.027279+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:03:34.605932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436635+0000","last_change":"2023-10-18T14:02:31.847322+0000","last_active":"2023-10-18T14:02:33.436635+0000","last_peered":"2023-10-18T14:02:33.436635+0000","last_clean":"2023-10-18T14:02:33.436635+0000","last_became_active":"2023-10-18T14:02:31.847008+0000","last_became_peered":"2023-10-18T14:02:31.847008+0000","last_unstale":"2023-10-18T14:02:33.436635+0000","last_undegraded":"2023-10-18T14:02:33.436635+0000","last_fullsized":"2023-10-18T14:02:33.436635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:59:18.850165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:34.027437+0000","last_change":"2023-10-18T14:02:32.461592+0000","last_active":"2023-10-18T14:02:34.027437+0000","last_peered":"2023-10-18T14:02:34.027437+0000","last_clean":"2023-10-18T14:02:34.027437+0000","last_became_active":"2023-10-18T14:02:32.461265+0000","last_became_peered":"2023-10-18T14:02:32.461265+0000","last_unstale":"2023-10-18T14:02:34.027437+0000","last_undegraded":"2023-10-18T14:02:34.027437+0000","last_fullsized":"2023-10-18T14:02:34.027437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:03.315431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436848+0000","last_change":"2023-10-18T14:02:32.445480+0000","last_active":"2023-10-18T14:02:33.436848+0000","last_peered":"2023-10-18T14:02:33.436848+0000","last_clean":"2023-10-18T14:02:33.436848+0000","last_became_active":"2023-10-18T14:02:32.443036+0000","last_became_peered":"2023-10-18T14:02:32.443036+0000","last_unstale":"2023-10-18T14:02:33.436848+0000","last_undegraded":"2023-10-18T14:02:33.436848+0000","last_fullsized":"2023-10-18T14:02:33.436848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:59:57.637358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867570+0000","last_change":"2023-10-18T14:02:32.456400+0000","last_active":"2023-10-18T14:02:33.867570+0000","last_peered":"2023-10-18T14:02:33.867570+0000","last_clean":"2023-10-18T14:02:33.867570+0000","last_became_active":"2023-10-18T14:02:32.456072+0000","last_became_peered":"2023-10-18T14:02:32.456072+0000","last_unstale":"2023-10-18T14:02:33.867570+0000","last_undegraded":"2023-10-18T14:02:33.867570+0000","last_fullsized":"2023-10-18T14:02:33.867570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:22:59.844454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867728+0000","last_change":"2023-10-18T14:02:32.448089+0000","last_active":"2023-10-18T14:02:33.867728+0000","last_peered":"2023-10-18T14:02:33.867728+0000","last_clean":"2023-10-18T14:02:33.867728+0000","last_became_active":"2023-10-18T14:02:32.447866+0000","last_became_peered":"2023-10-18T14:02:32.447866+0000","last_unstale":"2023-10-18T14:02:33.867728+0000","last_undegraded":"2023-10-18T14:02:33.867728+0000","last_fullsized":"2023-10-18T14:02:33.867728+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:28:35.558009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868069+0000","last_change":"2023-10-18T14:02:32.444103+0000","last_active":"2023-10-18T14:02:33.868069+0000","last_peered":"2023-10-18T14:02:33.868069+0000","last_clean":"2023-10-18T14:02:33.868069+0000","last_became_active":"2023-10-18T14:02:32.443762+0000","last_became_peered":"2023-10-18T14:02:32.443762+0000","last_unstale":"2023-10-18T14:02:33.868069+0000","last_undegraded":"2023-10-18T14:02:33.868069+0000","last_fullsized":"2023-10-18T14:02:33.868069+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:47.695764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436712+0000","last_change":"2023-10-18T14:02:32.449409+0000","last_active":"2023-10-18T14:02:33.436712+0000","last_peered":"2023-10-18T14:02:33.436712+0000","last_clean":"2023-10-18T14:02:33.436712+0000","last_became_active":"2023-10-18T14:02:32.449114+0000","last_became_peered":"2023-10-18T14:02:32.449114+0000","last_unstale":"2023-10-18T14:02:33.436712+0000","last_undegraded":"2023-10-18T14:02:33.436712+0000","last_fullsized":"2023-10-18T14:02:33.436712+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:59:45.167577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436849+0000","last_change":"2023-10-18T14:02:32.452013+0000","last_active":"2023-10-18T14:02:33.436849+0000","last_peered":"2023-10-18T14:02:33.436849+0000","last_clean":"2023-10-18T14:02:33.436849+0000","last_became_active":"2023-10-18T14:02:32.451734+0000","last_became_peered":"2023-10-18T14:02:32.451734+0000","last_unstale":"2023-10-18T14:02:33.436849+0000","last_undegraded":"2023-10-18T14:02:33.436849+0000","last_fullsized":"2023-10-18T14:02:33.436849+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:15:44.511378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868158+0000","last_change":"2023-10-18T14:02:32.445503+0000","last_active":"2023-10-18T14:02:33.868158+0000","last_peered":"2023-10-18T14:02:33.868158+0000","last_clean":"2023-10-18T14:02:33.868158+0000","last_became_active":"2023-10-18T14:02:32.445172+0000","last_became_peered":"2023-10-18T14:02:32.445172+0000","last_unstale":"2023-10-18T14:02:33.868158+0000","last_undegraded":"2023-10-18T14:02:33.868158+0000","last_fullsized":"2023-10-18T14:02:33.868158+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:23:08.456949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867732+0000","last_change":"2023-10-18T14:02:32.459690+0000","last_active":"2023-10-18T14:02:33.867732+0000","last_peered":"2023-10-18T14:02:33.867732+0000","last_clean":"2023-10-18T14:02:33.867732+0000","last_became_active":"2023-10-18T14:02:32.459373+0000","last_became_peered":"2023-10-18T14:02:32.459373+0000","last_unstale":"2023-10-18T14:02:33.867732+0000","last_undegraded":"2023-10-18T14:02:33.867732+0000","last_fullsized":"2023-10-18T14:02:33.867732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:36.092029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.868624+0000","last_change":"2023-10-18T14:02:32.455076+0000","last_active":"2023-10-18T14:02:33.868624+0000","last_peered":"2023-10-18T14:02:33.868624+0000","last_clean":"2023-10-18T14:02:33.868624+0000","last_became_active":"2023-10-18T14:02:32.454750+0000","last_became_peered":"2023-10-18T14:02:32.454750+0000","last_unstale":"2023-10-18T14:02:33.868624+0000","last_undegraded":"2023-10-18T14:02:33.868624+0000","last_fullsized":"2023-10-18T14:02:33.868624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:08:00.855583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867755+0000","last_change":"2023-10-18T14:02:32.450714+0000","last_active":"2023-10-18T14:02:33.867755+0000","last_peered":"2023-10-18T14:02:33.867755+0000","last_clean":"2023-10-18T14:02:33.867755+0000","last_became_active":"2023-10-18T14:02:32.450429+0000","last_became_peered":"2023-10-18T14:02:32.450429+0000","last_unstale":"2023-10-18T14:02:33.867755+0000","last_undegraded":"2023-10-18T14:02:33.867755+0000","last_fullsized":"2023-10-18T14:02:33.867755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:43:21.746296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.867787+0000","last_change":"2023-10-18T14:02:32.457392+0000","last_active":"2023-10-18T14:02:33.867787+0000","last_peered":"2023-10-18T14:02:33.867787+0000","last_clean":"2023-10-18T14:02:33.867787+0000","last_became_active":"2023-10-18T14:02:32.457072+0000","last_became_peered":"2023-10-18T14:02:32.457072+0000","last_unstale":"2023-10-18T14:02:33.867787+0000","last_undegraded":"2023-10-18T14:02:33.867787+0000","last_fullsized":"2023-10-18T14:02:33.867787+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:19:51.691351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436616+0000","last_change":"2023-10-18T14:02:32.457541+0000","last_active":"2023-10-18T14:02:33.436616+0000","last_peered":"2023-10-18T14:02:33.436616+0000","last_clean":"2023-10-18T14:02:33.436616+0000","last_became_active":"2023-10-18T14:02:32.457266+0000","last_became_peered":"2023-10-18T14:02:32.457266+0000","last_unstale":"2023-10-18T14:02:33.436616+0000","last_undegraded":"2023-10-18T14:02:33.436616+0000","last_fullsized":"2023-10-18T14:02:33.436616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:41:16.131463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-18T14:02:33.436788+0000","last_change":"2023-10-18T14:02:32.454298+0000","last_active":"2023-10-18T14:02:33.436788+0000","last_peered":"2023-10-18T14:02:33.436788+0000","last_clean":"2023-10-18T14:02:33.436788+0000","last_became_active":"2023-10-18T14:02:32.453970+0000","last_became_peered":"2023-10-18T14:02:32.453970+0000","last_unstale":"2023-10-18T14:02:33.436788+0000","last_undegraded":"2023-10-18T14:02:33.436788+0000","last_fullsized":"2023-10-18T14:02:33.436788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:31:03.766761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250031,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5804,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":129,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":50039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449100,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":892928,"data_stored":440505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":10,"up_from":70,"seq":300647710734,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":1032348,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.39400000000000002}]},{"osd":2,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51800000000000002}]},{"osd":4,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.70599999999999996}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65100000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64800000000000002}]},{"osd":9,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":9,"up_from":65,"seq":279172874260,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":441087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.63400000000000001}]},{"osd":2,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56000000000000005}]},{"osd":3,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.59299999999999997}]},{"osd":4,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.73599999999999999}]},{"osd":5,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.755},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.81000000000000005}]},{"osd":8,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.76600000000000001}]},{"osd":10,"last update":"Wed Oct 18 14:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78700000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103192,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":440912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52900000000000003}]},{"osd":1,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.875},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.73499999999999999}]},{"osd":2,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.58999999999999997}]},{"osd":3,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.67400000000000004}]},{"osd":4,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.79500000000000004}]},{"osd":5,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.86099999999999999}]},{"osd":6,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.91400000000000003}]},{"osd":7,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":1.01}]},{"osd":9,"last update":"Wed Oct 18 14:02:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.90200000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.92800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":7,"up_from":51,"seq":219043332124,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":1032665,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47599999999999998}]},{"osd":1,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.41199999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.441,"15min":0.437},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70299999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60499999999999998}]},{"osd":2,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.76000000000000001}]},{"osd":3,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58899999999999997,"15min":0.58599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.67200000000000004}]},{"osd":4,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.376,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.63900000000000001}]},{"osd":5,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.495},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63600000000000001,"15min":0.624},"min":{"1min":0.439,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.54600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.86799999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91000000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72099999999999997}]},{"osd":8,"last update":"Wed Oct 18 14:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.84799999999999998}]},{"osd":9,"last update":"Wed Oct 18 14:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.83599999999999997}]},{"osd":10,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.871},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.86199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495649,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":440617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.27600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.34899999999999998,"15min":0.33500000000000002},"min":{"1min":0.29699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.316}]},{"osd":1,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.51700000000000002,"15min":0.497},"min":{"1min":0.40500000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.53800000000000003,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.42399999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80000000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.57299999999999995,"15min":0.55700000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.64900000000000002}]},{"osd":3,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.34100000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.436,"15min":0.42199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.496,"5min":0.379,"15min":0.379},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.55900000000000005,"15min":0.53900000000000003},"min":{"1min":0.51100000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.501}]},{"osd":5,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60899999999999999,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.45300000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89200000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":1.0089999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.57599999999999996}]},{"osd":8,"last update":"Wed Oct 18 14:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.628},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.63600000000000001}]},{"osd":9,"last update":"Wed Oct 18 14:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.55200000000000005}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.67000000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542198,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":442117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.432},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.80500000000000005,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Oct 18 14:01:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55200000000000005,"15min":0.54200000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46400000000000002}]},{"osd":3,"last update":"Wed Oct 18 14:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.53100000000000003,"15min":0.51900000000000002},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72899999999999998}]},{"osd":4,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.40600000000000003,"15min":0.38500000000000001},"min":{"1min":0.28999999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.46999999999999997,"15min":0.42899999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.78400000000000003}]},{"osd":5,"last update":"Wed Oct 18 14:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63},{"interface":"front","average":{"1min":0.62,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58499999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.54500000000000004,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.746},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.58799999999999997,"15min":0.56999999999999995},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.76000000000000001}]},{"osd":7,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76400000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.80300000000000005}]},{"osd":8,"last update":"Wed Oct 18 14:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.81899999999999995}]},{"osd":9,"last update":"Wed Oct 18 14:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.89500000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.86599999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":441983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 14:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.496},"min":{"1min":0.41799999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.52600000000000002,"15min":0.48899999999999999},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.432}]},{"osd":2,"last update":"Wed Oct 18 14:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.42399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79800000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49199999999999999}]},{"osd":3,"last update":"Wed Oct 18 14:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.40500000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.309,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.32200000000000001}]},{"osd":4,"last update":"Wed Oct 18 14:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.39700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Oct 18 14:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45300000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.45700000000000002}]},{"osd":6,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.50600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.755,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.439},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.39300000000000002}]},{"osd":7,"last update":"Wed Oct 18 14:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60499999999999998}]},{"osd":8,"last update":"Wed Oct 18 14:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.503},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57199999999999995}]},{"osd":9,"last update":"Wed Oct 18 14:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.52000000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56100000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378674,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":460902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.52300000000000002},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59599999999999997}]},{"osd":1,"last update":"Wed Oct 18 14:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77000000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.629},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77900000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.85799999999999998}]},{"osd":3,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.56299999999999994,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.81499999999999995}]},{"osd":4,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.79300000000000004}]},{"osd":5,"last update":"Wed Oct 18 14:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42699999999999999,"15min":0.42499999999999999},"min":{"1min":0.29199999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.43099999999999999,"15min":0.42299999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.90400000000000003}]},{"osd":6,"last update":"Wed Oct 18 14:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.38700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.874},{"interface":"front","average":{"1min":0.63,"5min":0.56499999999999995,"15min":0.55400000000000005},"min":{"1min":0.48199999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.84099999999999997}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.34200000000000003}]},{"osd":8,"last update":"Wed Oct 18 14:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":1.0129999999999999}]},{"osd":9,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.89300000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.94999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":3,"up_from":26,"seq":111669149741,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":440582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.34599999999999997,"15min":0.32400000000000001},"min":{"1min":0.25800000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.35099999999999998},"min":{"1min":0.27700000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.37}]},{"osd":1,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53600000000000003,"15min":0.51400000000000001},"min":{"1min":0.374,"5min":0.316,"15min":0.316},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48899999999999999}]},{"osd":2,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.54200000000000004,"15min":0.51700000000000002},"min":{"1min":0.41999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.56399999999999995}]},{"osd":4,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84999999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53500000000000003}]},{"osd":5,"last update":"Wed Oct 18 14:01:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.71899999999999997,"15min":0.67900000000000005},"min":{"1min":0.51200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":6.5,"5min":6.5,"15min":6.5},"last":0.68600000000000005}]},{"osd":6,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.49299999999999999,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.47299999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.77500000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.76800000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.51900000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.56699999999999995}]},{"osd":9,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58799999999999997}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57599999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888105,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":440527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.42399999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.38400000000000001},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.39100000000000001,"15min":0.376},"min":{"1min":0.26000000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.32600000000000001}]},{"osd":2,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84399999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.438}]},{"osd":3,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.56499999999999995,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81999999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86699999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.67900000000000005}]},{"osd":5,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.503},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:02:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.42699999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65600000000000003,"15min":0.64800000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55000000000000004,"15min":0.54100000000000004},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.39300000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.53500000000000003}]},{"osd":9,"last update":"Wed Oct 18 14:02:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.72899999999999998}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.46800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724581,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1032018,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.39400000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69899999999999995}]},{"osd":1,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.32200000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.66400000000000003}]},{"osd":2,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.47199999999999998}]},{"osd":3,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73799999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.435,"5min":0.374,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.41699999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.38400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.78200000000000003}]},{"osd":6,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59499999999999997,"15min":0.58799999999999997},"min":{"1min":0.48399999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.76100000000000001}]},{"osd":7,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76300000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67800000000000005}]},{"osd":8,"last update":"Wed Oct 18 14:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61499999999999999}]},{"osd":9,"last update":"Wed Oct 18 14:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.89100000000000001}]},{"osd":10,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":38647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T14:02:40.949 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-18T14:02:40.950 INFO:tasks.cephadm:Setting up client nodes... 2023-10-18T14:02:40.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-18T14:02:41.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:40 smithi158 ceph-mon[103317]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:41.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:40 smithi158 ceph-mon[103317]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:41.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:40 smithi158 ceph-mon[103317]: pgmap v237: 97 pgs: 97 active+clean; 582 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 5.0 KiB/s wr, 18 op/s 2023-10-18T14:02:41.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:40 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/449068693' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:41.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:40 smithi158 ceph-mon[103317]: mgrmap e21: x(active, since 5m), standbys: z, y 2023-10-18T14:02:41.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:40 smithi172 ceph-mon[103574]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:41.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:40 smithi172 ceph-mon[103574]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:41.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:40 smithi172 ceph-mon[103574]: pgmap v237: 97 pgs: 97 active+clean; 582 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 5.0 KiB/s wr, 18 op/s 2023-10-18T14:02:41.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:40 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/449068693' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:41.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:40 smithi172 ceph-mon[103574]: mgrmap e21: x(active, since 5m), standbys: z, y 2023-10-18T14:02:41.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:40 smithi114 ceph-mon[99494]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:41.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:40 smithi114 ceph-mon[99494]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:02:41.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:40 smithi114 ceph-mon[99494]: pgmap v237: 97 pgs: 97 active+clean; 582 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 5.0 KiB/s wr, 18 op/s 2023-10-18T14:02:41.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:40 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/449068693' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:41.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:40 smithi114 ceph-mon[99494]: mgrmap e21: x(active, since 5m), standbys: z, y 2023-10-18T14:02:41.533 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:42.013 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:41 smithi114 ceph-mon[99494]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:02:42.013 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:41 smithi114 ceph-mon[99494]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:02:42.059 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:02:41 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-i[143420]: 2023-10-18T14:02:41.754+0000 7f303efa2700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-10-18T14:02:42.060 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:02:41 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-i[143420]: 2023-10-18T14:02:41.754+0000 7f303efa2700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-10-18T14:02:42.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:41 smithi172 ceph-mon[103574]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:02:42.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:41 smithi172 ceph-mon[103574]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:02:42.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:41 smithi158 ceph-mon[103317]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:02:42.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:41 smithi158 ceph-mon[103317]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:02:42.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.745+0000 7fc11cf86700 1 -- 172.21.15.114:0/1994994146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc118100810 msgr2=0x7fc11810c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:42.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.745+0000 7fc11cf86700 1 --2- 172.21.15.114:0/1994994146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc118100810 0x7fc11810c560 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc11000b0a0 tx=0x7fc11000b3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:42.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.746+0000 7fc11cf86700 1 -- 172.21.15.114:0/1994994146 shutdown_connections 2023-10-18T14:02:42.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.746+0000 7fc11cf86700 1 --2- 172.21.15.114:0/1994994146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc118100810 0x7fc11810c560 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:42.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.746+0000 7fc11cf86700 1 --2- 172.21.15.114:0/1994994146 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc118105720 0x7fc118105b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:42.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.746+0000 7fc11cf86700 1 --2- 172.21.15.114:0/1994994146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1180ffe50 0x7fc1181002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:42.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.746+0000 7fc11cf86700 1 -- 172.21.15.114:0/1994994146 >> 172.21.15.114:0/1994994146 conn(0x7fc118075cf0 msgr2=0x7fc1180fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:42.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.746+0000 7fc11cf86700 1 -- 172.21.15.114:0/1994994146 shutdown_connections 2023-10-18T14:02:42.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.746+0000 7fc11cf86700 1 -- 172.21.15.114:0/1994994146 wait complete. 2023-10-18T14:02:42.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.746+0000 7fc11cf86700 1 Processor -- start 2023-10-18T14:02:42.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc11cf86700 1 -- start start 2023-10-18T14:02:42.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc11cf86700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1180ffe50 0x7fc11819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:42.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc11cf86700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc118100810 0x7fc11819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:42.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc11cf86700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc118105720 0x7fc118195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:42.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc11cf86700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc118196080 con 0x7fc118100810 2023-10-18T14:02:42.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc11cf86700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1181961f0 con 0x7fc118105720 2023-10-18T14:02:42.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc11cf86700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1181963b0 con 0x7fc1180ffe50 2023-10-18T14:02:42.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc115d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc118100810 0x7fc11819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:42.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc115d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc118100810 0x7fc11819bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42612/0 (socket says 172.21.15.114:42612) 2023-10-18T14:02:42.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc115d9b700 1 -- 172.21.15.114:0/1052690935 learned_addr learned my addr 172.21.15.114:0/1052690935 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:42.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc116d9d700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc118105720 0x7fc118195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:42.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc11659c700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1180ffe50 0x7fc11819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:42.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc115d9b700 1 -- 172.21.15.114:0/1052690935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1180ffe50 msgr2=0x7fc11819b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:42.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc115d9b700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1180ffe50 0x7fc11819b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:42.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc115d9b700 1 -- 172.21.15.114:0/1052690935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc118105720 msgr2=0x7fc118195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:42.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc115d9b700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc118105720 0x7fc118195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:42.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc115d9b700 1 -- 172.21.15.114:0/1052690935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc110009d00 con 0x7fc118100810 2023-10-18T14:02:42.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc116d9d700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc118105720 0x7fc118195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:02:42.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc115d9b700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc118100810 0x7fc11819bdd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc10800b530 tx=0x7fc10800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:42.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.747+0000 7fc10f7fe700 1 -- 172.21.15.114:0/1052690935 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108011830 con 0x7fc118100810 2023-10-18T14:02:42.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.748+0000 7fc11cf86700 1 -- 172.21.15.114:0/1052690935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc118196690 con 0x7fc118100810 2023-10-18T14:02:42.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.748+0000 7fc11cf86700 1 -- 172.21.15.114:0/1052690935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1181a2880 con 0x7fc118100810 2023-10-18T14:02:42.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.748+0000 7fc10f7fe700 1 -- 172.21.15.114:0/1052690935 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc108011e50 con 0x7fc118100810 2023-10-18T14:02:42.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.748+0000 7fc10f7fe700 1 -- 172.21.15.114:0/1052690935 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10801ae90 con 0x7fc118100810 2023-10-18T14:02:42.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.749+0000 7fc11cf86700 1 -- 172.21.15.114:0/1052690935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc118107cb0 con 0x7fc118100810 2023-10-18T14:02:42.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.750+0000 7fc10f7fe700 1 -- 172.21.15.114:0/1052690935 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fc10801a590 con 0x7fc118100810 2023-10-18T14:02:42.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.750+0000 7fc10f7fe700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc1040a1560 0x7fc1040a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:42.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.750+0000 7fc11659c700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc1040a1560 0x7fc1040a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:42.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.750+0000 7fc10f7fe700 1 -- 172.21.15.114:0/1052690935 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fc1080cc980 con 0x7fc118100810 2023-10-18T14:02:42.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.751+0000 7fc11659c700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc1040a1560 0x7fc1040a3a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc100005fd0 tx=0x7fc100005dd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:42.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:42.755+0000 7fc10f7fe700 1 -- 172.21.15.114:0/1052690935 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc108095f50 con 0x7fc118100810 2023-10-18T14:02:43.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.025+0000 7fc11cf86700 1 -- 172.21.15.114:0/1052690935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fc118196e90 con 0x7fc118100810 2023-10-18T14:02:43.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.027+0000 7fc10f7fe700 1 -- 172.21.15.114:0/1052690935 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7fc1080150f0 con 0x7fc118100810 2023-10-18T14:02:43.031 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2023-10-18T14:02:43.031 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQCD5S9ltMaYARAArs8UziQHZsyUS9JuHOqBqw== 2023-10-18T14:02:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.029+0000 7fc11cf86700 1 -- 172.21.15.114:0/1052690935 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc1040a1560 msgr2=0x7fc1040a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.029+0000 7fc11cf86700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc1040a1560 0x7fc1040a3a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc100005fd0 tx=0x7fc100005dd0 comp rx=0 tx=0).stop 2023-10-18T14:02:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.029+0000 7fc11cf86700 1 -- 172.21.15.114:0/1052690935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc118100810 msgr2=0x7fc11819bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.029+0000 7fc11cf86700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc118100810 0x7fc11819bdd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc10800b530 tx=0x7fc10800b8f0 comp rx=0 tx=0).stop 2023-10-18T14:02:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.029+0000 7fc11cf86700 1 -- 172.21.15.114:0/1052690935 shutdown_connections 2023-10-18T14:02:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.029+0000 7fc11cf86700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc1040a1560 0x7fc1040a3a20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.029+0000 7fc11cf86700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc118105720 0x7fc118195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:43.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.029+0000 7fc11cf86700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1180ffe50 0x7fc11819b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:43.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.029+0000 7fc11cf86700 1 --2- 172.21.15.114:0/1052690935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc118100810 0x7fc11819bdd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:43.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.029+0000 7fc11cf86700 1 -- 172.21.15.114:0/1052690935 >> 172.21.15.114:0/1052690935 conn(0x7fc118075cf0 msgr2=0x7fc1180fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:43.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.029+0000 7fc11cf86700 1 -- 172.21.15.114:0/1052690935 shutdown_connections 2023-10-18T14:02:43.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:43.029+0000 7fc11cf86700 1 -- 172.21.15.114:0/1052690935 wait complete. 2023-10-18T14:02:43.188 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:42 smithi114 ceph-mon[99494]: pgmap v238: 97 pgs: 97 active+clean; 617 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.0 KiB/s wr, 25 op/s 2023-10-18T14:02:43.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:42 smithi158 ceph-mon[103317]: pgmap v238: 97 pgs: 97 active+clean; 617 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.0 KiB/s wr, 25 op/s 2023-10-18T14:02:43.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:42 smithi172 ceph-mon[103574]: pgmap v238: 97 pgs: 97 active+clean; 617 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.0 KiB/s wr, 25 op/s 2023-10-18T14:02:43.389 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T14:02:43.389 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-18T14:02:43.390 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-18T14:02:43.429 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph config log 1 --format=json 2023-10-18T14:02:44.023 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:44.227 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:43 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1052690935' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-18T14:02:44.228 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:43 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1052690935' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-18T14:02:44.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:43 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1052690935' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-18T14:02:44.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:43 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1052690935' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-18T14:02:44.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:43 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1052690935' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-18T14:02:44.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:43 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1052690935' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-18T14:02:45.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.221+0000 7fd022c6b700 1 -- 172.21.15.114:0/4157867525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd01c1000a0 msgr2=0x7fd01c10c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:45.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.221+0000 7fd022c6b700 1 --2- 172.21.15.114:0/4157867525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd01c1000a0 0x7fd01c10c560 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd01400b0a0 tx=0x7fd01400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:45.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 -- 172.21.15.114:0/4157867525 shutdown_connections 2023-10-18T14:02:45.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 --2- 172.21.15.114:0/4157867525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd01c1000a0 0x7fd01c10c560 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:45.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 --2- 172.21.15.114:0/4157867525 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd01c105690 0x7fd01c105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:45.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 --2- 172.21.15.114:0/4157867525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd01c0ff6e0 0x7fd01c0ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:45.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 -- 172.21.15.114:0/4157867525 >> 172.21.15.114:0/4157867525 conn(0x7fd01c0766c0 msgr2=0x7fd01c076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:45.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 -- 172.21.15.114:0/4157867525 shutdown_connections 2023-10-18T14:02:45.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 -- 172.21.15.114:0/4157867525 wait complete. 2023-10-18T14:02:45.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 Processor -- start 2023-10-18T14:02:45.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 -- start start 2023-10-18T14:02:45.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd01c0ff6e0 0x7fd01c19b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:45.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd01c1000a0 0x7fd01c19be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:45.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd01c105690 0x7fd01c195a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:45.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c196070 con 0x7fd01c1000a0 2023-10-18T14:02:45.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c1961e0 con 0x7fd01c0ff6e0 2023-10-18T14:02:45.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd022c6b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c1963a0 con 0x7fd01c105690 2023-10-18T14:02:45.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.222+0000 7fd01bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd01c1000a0 0x7fd01c19be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:45.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd01bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd01c1000a0 0x7fd01c19be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42624/0 (socket says 172.21.15.114:42624) 2023-10-18T14:02:45.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd01bfff700 1 -- 172.21.15.114:0/1776071619 learned_addr learned my addr 172.21.15.114:0/1776071619 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:45.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd021208700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd01c105690 0x7fd01c195a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:45.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd020a07700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd01c0ff6e0 0x7fd01c19b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd01bfff700 1 -- 172.21.15.114:0/1776071619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd01c105690 msgr2=0x7fd01c195a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd01bfff700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd01c105690 0x7fd01c195a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd01bfff700 1 -- 172.21.15.114:0/1776071619 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd01c0ff6e0 msgr2=0x7fd01c19b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd01bfff700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd01c0ff6e0 0x7fd01c19b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd01bfff700 1 -- 172.21.15.114:0/1776071619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd014009d00 con 0x7fd01c1000a0 2023-10-18T14:02:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd020a07700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd01c0ff6e0 0x7fd01c19b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd01bfff700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd01c1000a0 0x7fd01c19be00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd00800c9b0 tx=0x7fd00800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd019ffb700 1 -- 172.21.15.114:0/1776071619 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008007b00 con 0x7fd01c1000a0 2023-10-18T14:02:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd019ffb700 1 -- 172.21.15.114:0/1776071619 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd008007c60 con 0x7fd01c1000a0 2023-10-18T14:02:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd022c6b700 1 -- 172.21.15.114:0/1776071619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01c196680 con 0x7fd01c1000a0 2023-10-18T14:02:45.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd019ffb700 1 -- 172.21.15.114:0/1776071619 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008018660 con 0x7fd01c1000a0 2023-10-18T14:02:45.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.223+0000 7fd022c6b700 1 -- 172.21.15.114:0/1776071619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01c1a28b0 con 0x7fd01c1000a0 2023-10-18T14:02:45.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.224+0000 7fd022c6b700 1 -- 172.21.15.114:0/1776071619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01c107cb0 con 0x7fd01c1000a0 2023-10-18T14:02:45.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.225+0000 7fd019ffb700 1 -- 172.21.15.114:0/1776071619 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fd00800f450 con 0x7fd01c1000a0 2023-10-18T14:02:45.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.226+0000 7fd019ffb700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd00c0a1560 0x7fd00c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:45.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.226+0000 7fd020a07700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd00c0a1560 0x7fd00c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:45.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.226+0000 7fd019ffb700 1 -- 172.21.15.114:0/1776071619 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fd0080cce80 con 0x7fd01c1000a0 2023-10-18T14:02:45.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.226+0000 7fd020a07700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd00c0a1560 0x7fd00c0a3a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd010007900 tx=0x7fd010008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:45.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.230+0000 7fd019ffb700 1 -- 172.21.15.114:0/1776071619 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd0080963a0 con 0x7fd01c1000a0 2023-10-18T14:02:45.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:44 smithi158 ceph-mon[103317]: pgmap v239: 97 pgs: 97 active+clean; 619 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 9.9 KiB/s wr, 27 op/s 2023-10-18T14:02:45.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:44 smithi172 ceph-mon[103574]: pgmap v239: 97 pgs: 97 active+clean; 619 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 9.9 KiB/s wr, 27 op/s 2023-10-18T14:02:45.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:44 smithi114 ceph-mon[99494]: pgmap v239: 97 pgs: 97 active+clean; 619 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 9.9 KiB/s wr, 27 op/s 2023-10-18T14:02:45.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.422+0000 7fd022c6b700 1 -- 172.21.15.114:0/1776071619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7fd01c196ec0 con 0x7fd01c1000a0 2023-10-18T14:02:45.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.422+0000 7fd019ffb700 1 -- 172.21.15.114:0/1776071619 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v46) v1 ==== 86+0+133 (secure 0 0 0) 0x7fd0080cae60 con 0x7fd01c1000a0 2023-10-18T14:02:45.426 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:45.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.424+0000 7fd022c6b700 1 -- 172.21.15.114:0/1776071619 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd00c0a1560 msgr2=0x7fd00c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.424+0000 7fd022c6b700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd00c0a1560 0x7fd00c0a3a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd010007900 tx=0x7fd010008040 comp rx=0 tx=0).stop 2023-10-18T14:02:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.424+0000 7fd022c6b700 1 -- 172.21.15.114:0/1776071619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd01c1000a0 msgr2=0x7fd01c19be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.425+0000 7fd022c6b700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd01c1000a0 0x7fd01c19be00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd00800c9b0 tx=0x7fd00800ccc0 comp rx=0 tx=0).stop 2023-10-18T14:02:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.425+0000 7fd022c6b700 1 -- 172.21.15.114:0/1776071619 shutdown_connections 2023-10-18T14:02:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.425+0000 7fd022c6b700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd00c0a1560 0x7fd00c0a3a20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:45.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.425+0000 7fd022c6b700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd01c105690 0x7fd01c195a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:45.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.425+0000 7fd022c6b700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd01c0ff6e0 0x7fd01c19b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:45.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.425+0000 7fd022c6b700 1 --2- 172.21.15.114:0/1776071619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd01c1000a0 0x7fd01c19be00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:45.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.425+0000 7fd022c6b700 1 -- 172.21.15.114:0/1776071619 >> 172.21.15.114:0/1776071619 conn(0x7fd01c0766c0 msgr2=0x7fd01c0fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:45.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.425+0000 7fd022c6b700 1 -- 172.21.15.114:0/1776071619 shutdown_connections 2023-10-18T14:02:45.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:45.425+0000 7fd022c6b700 1 -- 172.21.15.114:0/1776071619 wait complete. 2023-10-18T14:02:45.868 INFO:teuthology.orchestra.run.smithi114.stdout:[{"version":46,"timestamp":"2023-10-18T14:02:27.863258+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2023-10-18T14:02:45.868 INFO:tasks.ceph_manager:config epoch is 46 2023-10-18T14:02:45.869 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-18T14:02:45.869 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-18T14:02:45.870 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-18T14:02:46.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:45 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1776071619' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-18T14:02:46.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:45 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1776071619' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-18T14:02:46.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:45 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1776071619' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-18T14:02:46.428 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:46.963 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:46 smithi114 ceph-mon[99494]: pgmap v240: 97 pgs: 97 active+clean; 623 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.7 KiB/s wr, 23 op/s 2023-10-18T14:02:47.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:46 smithi158 ceph-mon[103317]: pgmap v240: 97 pgs: 97 active+clean; 623 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.7 KiB/s wr, 23 op/s 2023-10-18T14:02:47.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:46 smithi172 ceph-mon[103574]: pgmap v240: 97 pgs: 97 active+clean; 623 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.7 KiB/s wr, 23 op/s 2023-10-18T14:02:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.714+0000 7f771a33d700 1 -- 172.21.15.114:0/3518784189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77140ffb30 msgr2=0x7f771410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.714+0000 7f771a33d700 1 --2- 172.21.15.114:0/3518784189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77140ffb30 0x7f771410d5c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f770c00b0a0 tx=0x7f770c00b3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.714+0000 7f771a33d700 1 -- 172.21.15.114:0/3518784189 shutdown_connections 2023-10-18T14:02:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.714+0000 7f771a33d700 1 --2- 172.21.15.114:0/3518784189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77140ffb30 0x7f771410d5c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.714+0000 7f771a33d700 1 --2- 172.21.15.114:0/3518784189 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77141058d0 0x7f7714105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.714+0000 7f771a33d700 1 --2- 172.21.15.114:0/3518784189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77140ff190 0x7f77140ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.714+0000 7f771a33d700 1 -- 172.21.15.114:0/3518784189 >> 172.21.15.114:0/3518784189 conn(0x7f7714074a10 msgr2=0x7f7714074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:47.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.714+0000 7f771a33d700 1 -- 172.21.15.114:0/3518784189 shutdown_connections 2023-10-18T14:02:47.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.714+0000 7f771a33d700 1 -- 172.21.15.114:0/3518784189 wait complete. 2023-10-18T14:02:47.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.715+0000 7f771a33d700 1 Processor -- start 2023-10-18T14:02:47.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.715+0000 7f771a33d700 1 -- start start 2023-10-18T14:02:47.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.715+0000 7f771a33d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77140ff190 0x7f771419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:47.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.715+0000 7f771a33d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77140ffb30 0x7f771419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:47.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.715+0000 7f771a33d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77141058d0 0x7f7714196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:47.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.715+0000 7f771a33d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77141970d0 con 0x7f77140ffb30 2023-10-18T14:02:47.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.715+0000 7f771a33d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7714197240 con 0x7f77141058d0 2023-10-18T14:02:47.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.715+0000 7f771a33d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7714197400 con 0x7f77140ff190 2023-10-18T14:02:47.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.715+0000 7f77137fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77140ffb30 0x7f771419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:47.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f77137fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77140ffb30 0x7f771419ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42642/0 (socket says 172.21.15.114:42642) 2023-10-18T14:02:47.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f77137fe700 1 -- 172.21.15.114:0/3858748575 learned_addr learned my addr 172.21.15.114:0/3858748575 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:47.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f7713fff700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77140ff190 0x7f771419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:47.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f77188da700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77141058d0 0x7f7714196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f77137fe700 1 -- 172.21.15.114:0/3858748575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77140ff190 msgr2=0x7f771419c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f77137fe700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77140ff190 0x7f771419c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f77137fe700 1 -- 172.21.15.114:0/3858748575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77141058d0 msgr2=0x7f7714196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f77137fe700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77141058d0 0x7f7714196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f77137fe700 1 -- 172.21.15.114:0/3858748575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009d00 con 0x7f77140ffb30 2023-10-18T14:02:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f77188da700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77141058d0 0x7f7714196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:47.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f77137fe700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77140ffb30 0x7f771419ce60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f770800c920 tx=0x7f770800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:47.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f77117fa700 1 -- 172.21.15.114:0/3858748575 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708007b00 con 0x7f77140ffb30 2023-10-18T14:02:47.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f77117fa700 1 -- 172.21.15.114:0/3858748575 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f770800ce70 con 0x7f77140ffb30 2023-10-18T14:02:47.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f771a33d700 1 -- 172.21.15.114:0/3858748575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77141976e0 con 0x7f77140ffb30 2023-10-18T14:02:47.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f77117fa700 1 -- 172.21.15.114:0/3858748575 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080054e0 con 0x7f77140ffb30 2023-10-18T14:02:47.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.716+0000 7f771a33d700 1 -- 172.21.15.114:0/3858748575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77141a3910 con 0x7f77140ffb30 2023-10-18T14:02:47.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.717+0000 7f771a33d700 1 -- 172.21.15.114:0/3858748575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7714108d30 con 0x7f77140ffb30 2023-10-18T14:02:47.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.719+0000 7f77117fa700 1 -- 172.21.15.114:0/3858748575 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f7708004750 con 0x7f77140ffb30 2023-10-18T14:02:47.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.719+0000 7f77117fa700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76fc0a1560 0x7f76fc0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:47.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.719+0000 7f7713fff700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76fc0a1560 0x7f76fc0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:47.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.720+0000 7f77117fa700 1 -- 172.21.15.114:0/3858748575 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f77080cce80 con 0x7f77140ffb30 2023-10-18T14:02:47.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.720+0000 7f7713fff700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76fc0a1560 0x7f76fc0a3a20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7714068160 tx=0x7f770400a3b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:47.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.722+0000 7f77117fa700 1 -- 172.21.15.114:0/3858748575 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f77080963a0 con 0x7f77140ffb30 2023-10-18T14:02:47.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.971+0000 7f771a33d700 1 -- 172.21.15.114:0/3858748575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7714067c30 con 0x7f77140ffb30 2023-10-18T14:02:47.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.975+0000 7f77117fa700 1 -- 172.21.15.114:0/3858748575 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) v1 ==== 74+0+260432 (secure 0 0 0) 0x7f77080cae60 con 0x7f77140ffb30 2023-10-18T14:02:47.981 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.978+0000 7f771a33d700 1 -- 172.21.15.114:0/3858748575 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76fc0a1560 msgr2=0x7f76fc0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.978+0000 7f771a33d700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76fc0a1560 0x7f76fc0a3a20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7714068160 tx=0x7f770400a3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.978+0000 7f771a33d700 1 -- 172.21.15.114:0/3858748575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77140ffb30 msgr2=0x7f771419ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.978+0000 7f771a33d700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77140ffb30 0x7f771419ce60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f770800c920 tx=0x7f770800cc30 comp rx=0 tx=0).stop 2023-10-18T14:02:47.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.978+0000 7f771a33d700 1 -- 172.21.15.114:0/3858748575 shutdown_connections 2023-10-18T14:02:47.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.978+0000 7f771a33d700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76fc0a1560 0x7f76fc0a3a20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:47.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.978+0000 7f771a33d700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f77141058d0 0x7f7714196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:47.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.978+0000 7f771a33d700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77140ff190 0x7f771419c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:47.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.978+0000 7f771a33d700 1 --2- 172.21.15.114:0/3858748575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77140ffb30 0x7f771419ce60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:47.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.978+0000 7f771a33d700 1 -- 172.21.15.114:0/3858748575 >> 172.21.15.114:0/3858748575 conn(0x7f7714074a10 msgr2=0x7f77140fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:47.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.978+0000 7f771a33d700 1 -- 172.21.15.114:0/3858748575 shutdown_connections 2023-10-18T14:02:47.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:47.978+0000 7f771a33d700 1 -- 172.21.15.114:0/3858748575 wait complete. 2023-10-18T14:02:48.375 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"active_gid":14217,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3416629288},{"type":"v1","addr":"172.21.15.114:6801","nonce":3416629288}]},"active_addr":"172.21.15.114:6801/3416629288","active_change":"2023-10-18T13:57:07.487256+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24136,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24149,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.114:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":673836612}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":3171085199}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":3780641963}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":3534981371}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":2691505937}]}]} 2023-10-18T14:02:48.381 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-18T14:02:48.382 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-18T14:02:48.382 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-18T14:02:48.945 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:49.185 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:48 smithi114 ceph-mon[99494]: pgmap v241: 97 pgs: 97 active+clean; 623 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.9 KiB/s wr, 24 op/s 2023-10-18T14:02:49.185 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:48 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3858748575' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-18T14:02:49.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:48 smithi158 ceph-mon[103317]: pgmap v241: 97 pgs: 97 active+clean; 623 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.9 KiB/s wr, 24 op/s 2023-10-18T14:02:49.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:48 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3858748575' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-18T14:02:49.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:48 smithi172 ceph-mon[103574]: pgmap v241: 97 pgs: 97 active+clean; 623 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.9 KiB/s wr, 24 op/s 2023-10-18T14:02:49.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:48 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3858748575' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-18T14:02:50.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.270+0000 7f1982852700 1 -- 172.21.15.114:0/1740300828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f197c100110 msgr2=0x7f197c10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:50.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.270+0000 7f1982852700 1 --2- 172.21.15.114:0/1740300828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f197c100110 0x7f197c10c580 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f197400b0a0 tx=0x7f197400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:50.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.270+0000 7f1982852700 1 -- 172.21.15.114:0/1740300828 shutdown_connections 2023-10-18T14:02:50.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.270+0000 7f1982852700 1 --2- 172.21.15.114:0/1740300828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f197c100110 0x7f197c10c580 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:50.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.270+0000 7f1982852700 1 --2- 172.21.15.114:0/1740300828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f197c1056b0 0x7f197c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:50.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.270+0000 7f1982852700 1 --2- 172.21.15.114:0/1740300828 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f197c0ff750 0x7f197c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:50.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.270+0000 7f1982852700 1 -- 172.21.15.114:0/1740300828 >> 172.21.15.114:0/1740300828 conn(0x7f197c075790 msgr2=0x7f197c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:50.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.270+0000 7f1982852700 1 -- 172.21.15.114:0/1740300828 shutdown_connections 2023-10-18T14:02:50.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.270+0000 7f1982852700 1 -- 172.21.15.114:0/1740300828 wait complete. 2023-10-18T14:02:50.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.271+0000 7f1982852700 1 Processor -- start 2023-10-18T14:02:50.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.271+0000 7f1982852700 1 -- start start 2023-10-18T14:02:50.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.271+0000 7f1982852700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f197c0ff750 0x7f197c19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:50.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.271+0000 7f1982852700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f197c100110 0x7f197c19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:50.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.271+0000 7f1982852700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f197c1056b0 0x7f197c195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:50.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.271+0000 7f1982852700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c196090 con 0x7f197c0ff750 2023-10-18T14:02:50.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.271+0000 7f1982852700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c196200 con 0x7f197c100110 2023-10-18T14:02:50.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.271+0000 7f1982852700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c1963c0 con 0x7f197c1056b0 2023-10-18T14:02:50.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.271+0000 7f197bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f197c0ff750 0x7f197c19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:50.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.271+0000 7f197bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f197c0ff750 0x7f197c19b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42652/0 (socket says 172.21.15.114:42652) 2023-10-18T14:02:50.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.271+0000 7f197bfff700 1 -- 172.21.15.114:0/2890539759 learned_addr learned my addr 172.21.15.114:0/2890539759 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:50.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.271+0000 7f1980def700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f197c1056b0 0x7f197c195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:50.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.272+0000 7f1973fff700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f197c100110 0x7f197c19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:50.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.272+0000 7f197bfff700 1 -- 172.21.15.114:0/2890539759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f197c1056b0 msgr2=0x7f197c195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:50.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.272+0000 7f197bfff700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f197c1056b0 0x7f197c195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:50.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.272+0000 7f197bfff700 1 -- 172.21.15.114:0/2890539759 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f197c100110 msgr2=0x7f197c19bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:50.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.272+0000 7f197bfff700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f197c100110 0x7f197c19bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:50.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.272+0000 7f197bfff700 1 -- 172.21.15.114:0/2890539759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1974009d00 con 0x7f197c0ff750 2023-10-18T14:02:50.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.272+0000 7f197bfff700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f197c0ff750 0x7f197c19b8a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f196c00c9b0 tx=0x7f196c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:50.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.272+0000 7f1979ffb700 1 -- 172.21.15.114:0/2890539759 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c007b00 con 0x7f197c0ff750 2023-10-18T14:02:50.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.272+0000 7f1979ffb700 1 -- 172.21.15.114:0/2890539759 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f196c007c60 con 0x7f197c0ff750 2023-10-18T14:02:50.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.272+0000 7f1982852700 1 -- 172.21.15.114:0/2890539759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c196640 con 0x7f197c0ff750 2023-10-18T14:02:50.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.272+0000 7f1979ffb700 1 -- 172.21.15.114:0/2890539759 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c018660 con 0x7f197c0ff750 2023-10-18T14:02:50.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.272+0000 7f1982852700 1 -- 172.21.15.114:0/2890539759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c068360 con 0x7f197c0ff750 2023-10-18T14:02:50.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.273+0000 7f1982852700 1 -- 172.21.15.114:0/2890539759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c100df0 con 0x7f197c0ff750 2023-10-18T14:02:50.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.274+0000 7f1979ffb700 1 -- 172.21.15.114:0/2890539759 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f196c018880 con 0x7f197c0ff750 2023-10-18T14:02:50.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.275+0000 7f1979ffb700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f19680a1560 0x7f19680a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:50.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.275+0000 7f1973fff700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f19680a1560 0x7f19680a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:50.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.275+0000 7f1979ffb700 1 -- 172.21.15.114:0/2890539759 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f196c0ccee0 con 0x7f197c0ff750 2023-10-18T14:02:50.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.275+0000 7f1973fff700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f19680a1560 0x7f19680a3a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1964005950 tx=0x7f19640058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:50.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.279+0000 7f1979ffb700 1 -- 172.21.15.114:0/2890539759 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f196c096400 con 0x7f197c0ff750 2023-10-18T14:02:50.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.471+0000 7f1982852700 1 -- 172.21.15.114:0/2890539759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f197c04e4c0 con 0x7f197c0ff750 2023-10-18T14:02:50.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.472+0000 7f1979ffb700 1 -- 172.21.15.114:0/2890539759 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22520 (secure 0 0 0) 0x7f196c099a20 con 0x7f197c0ff750 2023-10-18T14:02:50.475 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:50.476 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":83,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:02:33.431521+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:02:50.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.474+0000 7f1982852700 1 -- 172.21.15.114:0/2890539759 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f19680a1560 msgr2=0x7f19680a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:50.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.474+0000 7f1982852700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f19680a1560 0x7f19680a3a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1964005950 tx=0x7f19640058e0 comp rx=0 tx=0).stop 2023-10-18T14:02:50.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.474+0000 7f1982852700 1 -- 172.21.15.114:0/2890539759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f197c0ff750 msgr2=0x7f197c19b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:50.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.474+0000 7f1982852700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f197c0ff750 0x7f197c19b8a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f196c00c9b0 tx=0x7f196c00cd70 comp rx=0 tx=0).stop 2023-10-18T14:02:50.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.474+0000 7f1982852700 1 -- 172.21.15.114:0/2890539759 shutdown_connections 2023-10-18T14:02:50.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.474+0000 7f1982852700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f19680a1560 0x7f19680a3a20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:50.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.474+0000 7f1982852700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f197c1056b0 0x7f197c195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:50.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.474+0000 7f1982852700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f197c0ff750 0x7f197c19b8a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:50.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.474+0000 7f1982852700 1 --2- 172.21.15.114:0/2890539759 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f197c100110 0x7f197c19bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:50.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.474+0000 7f1982852700 1 -- 172.21.15.114:0/2890539759 >> 172.21.15.114:0/2890539759 conn(0x7f197c075790 msgr2=0x7f197c0fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:50.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.474+0000 7f1982852700 1 -- 172.21.15.114:0/2890539759 shutdown_connections 2023-10-18T14:02:50.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:50.474+0000 7f1982852700 1 -- 172.21.15.114:0/2890539759 wait complete. 2023-10-18T14:02:50.901 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-18T14:02:50.902 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-18T14:02:51.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:50 smithi114 ceph-mon[99494]: pgmap v242: 97 pgs: 97 active+clean; 623 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.9 KiB/s wr, 23 op/s 2023-10-18T14:02:51.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:50 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2890539759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:51.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:50 smithi158 ceph-mon[103317]: pgmap v242: 97 pgs: 97 active+clean; 623 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.9 KiB/s wr, 23 op/s 2023-10-18T14:02:51.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:50 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2890539759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:51.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:50 smithi172 ceph-mon[103574]: pgmap v242: 97 pgs: 97 active+clean; 623 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.9 KiB/s wr, 23 op/s 2023-10-18T14:02:51.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:50 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2890539759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:51.458 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:52.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.619+0000 7fa105fc9700 1 -- 172.21.15.114:0/3942830517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa100105840 msgr2=0x7fa100105c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:52.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.619+0000 7fa105fc9700 1 --2- 172.21.15.114:0/3942830517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa100105840 0x7fa100105c20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009990 tx=0x7fa0e8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:52.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.619+0000 7fa105fc9700 1 -- 172.21.15.114:0/3942830517 shutdown_connections 2023-10-18T14:02:52.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.619+0000 7fa105fc9700 1 --2- 172.21.15.114:0/3942830517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1000ffb10 0x7fa10010d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:52.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.619+0000 7fa105fc9700 1 --2- 172.21.15.114:0/3942830517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa100105840 0x7fa100105c20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:52.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.619+0000 7fa105fc9700 1 --2- 172.21.15.114:0/3942830517 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1000ff150 0x7fa1000ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:52.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.619+0000 7fa105fc9700 1 -- 172.21.15.114:0/3942830517 >> 172.21.15.114:0/3942830517 conn(0x7fa100074aa0 msgr2=0x7fa100074eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:52.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.619+0000 7fa105fc9700 1 -- 172.21.15.114:0/3942830517 shutdown_connections 2023-10-18T14:02:52.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.619+0000 7fa105fc9700 1 -- 172.21.15.114:0/3942830517 wait complete. 2023-10-18T14:02:52.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.620+0000 7fa105fc9700 1 Processor -- start 2023-10-18T14:02:52.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.620+0000 7fa105fc9700 1 -- start start 2023-10-18T14:02:52.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.620+0000 7fa105fc9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1000ff150 0x7fa10019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:52.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.620+0000 7fa105fc9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1000ffb10 0x7fa10019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:52.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.620+0000 7fa105fc9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa100105840 0x7fa100196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:52.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.620+0000 7fa105fc9700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1001970e0 con 0x7fa1000ffb10 2023-10-18T14:02:52.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.620+0000 7fa105fc9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa100197250 con 0x7fa100105840 2023-10-18T14:02:52.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.620+0000 7fa105fc9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa100197410 con 0x7fa1000ff150 2023-10-18T14:02:52.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.620+0000 7fa0feffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1000ffb10 0x7fa10019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:52.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.620+0000 7fa0feffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1000ffb10 0x7fa10019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42666/0 (socket says 172.21.15.114:42666) 2023-10-18T14:02:52.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.620+0000 7fa0feffd700 1 -- 172.21.15.114:0/2390904915 learned_addr learned my addr 172.21.15.114:0/2390904915 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:52.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.621+0000 7fa0ff7fe700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1000ff150 0x7fa10019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:52.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.621+0000 7fa0fffff700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa100105840 0x7fa100196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:52.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.621+0000 7fa0feffd700 1 -- 172.21.15.114:0/2390904915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1000ff150 msgr2=0x7fa10019c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:52.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.621+0000 7fa0feffd700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1000ff150 0x7fa10019c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:52.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.621+0000 7fa0feffd700 1 -- 172.21.15.114:0/2390904915 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa100105840 msgr2=0x7fa100196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:52.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.621+0000 7fa0feffd700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa100105840 0x7fa100196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:52.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.621+0000 7fa0feffd700 1 -- 172.21.15.114:0/2390904915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e80095f0 con 0x7fa1000ffb10 2023-10-18T14:02:52.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.621+0000 7fa0feffd700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1000ffb10 0x7fa10019ce80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000b530 tx=0x7fa0f000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:52.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.621+0000 7fa0fcff9700 1 -- 172.21.15.114:0/2390904915 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0011830 con 0x7fa1000ffb10 2023-10-18T14:02:52.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.621+0000 7fa105fc9700 1 -- 172.21.15.114:0/2390904915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1001976f0 con 0x7fa1000ffb10 2023-10-18T14:02:52.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.621+0000 7fa0fcff9700 1 -- 172.21.15.114:0/2390904915 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa0f0011e50 con 0x7fa1000ffb10 2023-10-18T14:02:52.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.621+0000 7fa0fcff9700 1 -- 172.21.15.114:0/2390904915 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000f2e0 con 0x7fa1000ffb10 2023-10-18T14:02:52.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.621+0000 7fa105fc9700 1 -- 172.21.15.114:0/2390904915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1001a3930 con 0x7fa1000ffb10 2023-10-18T14:02:52.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.622+0000 7fa105fc9700 1 -- 172.21.15.114:0/2390904915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa100108db0 con 0x7fa1000ffb10 2023-10-18T14:02:52.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.623+0000 7fa0fcff9700 1 -- 172.21.15.114:0/2390904915 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fa0f0010380 con 0x7fa1000ffb10 2023-10-18T14:02:52.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.623+0000 7fa0fcff9700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa0ec0a1560 0x7fa0ec0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:52.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.624+0000 7fa0fcff9700 1 -- 172.21.15.114:0/2390904915 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fa0f00cc960 con 0x7fa1000ffb10 2023-10-18T14:02:52.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.624+0000 7fa0ff7fe700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa0ec0a1560 0x7fa0ec0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:52.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.624+0000 7fa0ff7fe700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa0ec0a1560 0x7fa0ec0a3a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800b5c0 tx=0x7fa0e8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:52.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.628+0000 7fa0fcff9700 1 -- 172.21.15.114:0/2390904915 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa0f0095f90 con 0x7fa1000ffb10 2023-10-18T14:02:52.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.818+0000 7fa105fc9700 1 -- 172.21.15.114:0/2390904915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa100197f40 con 0x7fa1000ffb10 2023-10-18T14:02:52.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.820+0000 7fa0fcff9700 1 -- 172.21.15.114:0/2390904915 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22520 (secure 0 0 0) 0x7fa0f0015090 con 0x7fa1000ffb10 2023-10-18T14:02:52.823 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:02:52.824 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":83,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:02:33.431521+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:02:52.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.822+0000 7fa105fc9700 1 -- 172.21.15.114:0/2390904915 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa0ec0a1560 msgr2=0x7fa0ec0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:52.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.822+0000 7fa105fc9700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa0ec0a1560 0x7fa0ec0a3a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800b5c0 tx=0x7fa0e8005960 comp rx=0 tx=0).stop 2023-10-18T14:02:52.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.822+0000 7fa105fc9700 1 -- 172.21.15.114:0/2390904915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1000ffb10 msgr2=0x7fa10019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:52.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.822+0000 7fa105fc9700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1000ffb10 0x7fa10019ce80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000b530 tx=0x7fa0f000b840 comp rx=0 tx=0).stop 2023-10-18T14:02:52.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.822+0000 7fa105fc9700 1 -- 172.21.15.114:0/2390904915 shutdown_connections 2023-10-18T14:02:52.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.822+0000 7fa105fc9700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa0ec0a1560 0x7fa0ec0a3a20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:52.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.822+0000 7fa105fc9700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa100105840 0x7fa100196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:52.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.822+0000 7fa105fc9700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1000ff150 0x7fa10019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:52.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.822+0000 7fa105fc9700 1 --2- 172.21.15.114:0/2390904915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1000ffb10 0x7fa10019ce80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:52.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.822+0000 7fa105fc9700 1 -- 172.21.15.114:0/2390904915 >> 172.21.15.114:0/2390904915 conn(0x7fa100074aa0 msgr2=0x7fa1000fd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:52.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.822+0000 7fa105fc9700 1 -- 172.21.15.114:0/2390904915 shutdown_connections 2023-10-18T14:02:52.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:52.822+0000 7fa105fc9700 1 -- 172.21.15.114:0/2390904915 wait complete. 2023-10-18T14:02:53.202 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:52 smithi114 ceph-mon[99494]: pgmap v243: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 19 op/s 2023-10-18T14:02:53.202 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:52 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2390904915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:53.204 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-18T14:02:53.204 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-18T14:02:53.205 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-18T14:02:53.206 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-18T14:02:53.206 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-18T14:02:53.207 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-18T14:02:53.207 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-18T14:02:53.208 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-18T14:02:53.209 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-18T14:02:53.209 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-18T14:02:53.210 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-18T14:02:53.211 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-18T14:02:53.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:52 smithi158 ceph-mon[103317]: pgmap v243: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 19 op/s 2023-10-18T14:02:53.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:52 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2390904915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:53.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:52 smithi172 ceph-mon[103574]: pgmap v243: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 19 op/s 2023-10-18T14:02:53.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:52 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2390904915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:02:54.104 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:54.441 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:54.470 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:54.505 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:54.515 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:54.518 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:54 smithi114 ceph-mon[99494]: pgmap v244: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2023-10-18T14:02:54.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:54 smithi158 ceph-mon[103317]: pgmap v244: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2023-10-18T14:02:54.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:54 smithi172 ceph-mon[103574]: pgmap v244: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2023-10-18T14:02:54.677 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:55.678 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:55.680 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:56.497 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:56.709 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:56.724 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:56 smithi114 ceph-mon[99494]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-18T14:02:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:56 smithi158 ceph-mon[103317]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-18T14:02:57.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:56 smithi172 ceph-mon[103574]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-18T14:02:57.407 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:02:57.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.828+0000 7ffad9259700 1 -- 172.21.15.114:0/4231795331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad41056b0 msgr2=0x7ffad4105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.828+0000 7ffad9259700 1 --2- 172.21.15.114:0/4231795331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad41056b0 0x7ffad4105a90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00b0a0 tx=0x7ffacc00b3b0 comp rx=0 tx=0).stop 2023-10-18T14:02:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.828+0000 7ffad9259700 1 -- 172.21.15.114:0/4231795331 shutdown_connections 2023-10-18T14:02:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.828+0000 7ffad9259700 1 --2- 172.21.15.114:0/4231795331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffad4100110 0x7ffad410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.828+0000 7ffad9259700 1 --2- 172.21.15.114:0/4231795331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad41056b0 0x7ffad4105a90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:57.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.828+0000 7ffad9259700 1 --2- 172.21.15.114:0/4231795331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffad40ff750 0x7ffad40ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:57.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.828+0000 7ffad9259700 1 -- 172.21.15.114:0/4231795331 >> 172.21.15.114:0/4231795331 conn(0x7ffad4075790 msgr2=0x7ffad4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:57.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.828+0000 7ffad9259700 1 -- 172.21.15.114:0/4231795331 shutdown_connections 2023-10-18T14:02:57.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.828+0000 7ffad9259700 1 -- 172.21.15.114:0/4231795331 wait complete. 2023-10-18T14:02:57.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.829+0000 7ffad9259700 1 Processor -- start 2023-10-18T14:02:57.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.829+0000 7ffad9259700 1 -- start start 2023-10-18T14:02:57.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.829+0000 7ffad9259700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffad40ff750 0x7ffad419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:57.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.829+0000 7ffad9259700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad4100110 0x7ffad419bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:57.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.829+0000 7ffad9259700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffad41056b0 0x7ffad4195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:57.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.829+0000 7ffad9259700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad4196160 con 0x7ffad4100110 2023-10-18T14:02:57.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.829+0000 7ffad9259700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad41962d0 con 0x7ffad41056b0 2023-10-18T14:02:57.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.829+0000 7ffad9259700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad4196490 con 0x7ffad40ff750 2023-10-18T14:02:57.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.829+0000 7ffad259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad4100110 0x7ffad419bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:57.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.829+0000 7ffad259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad4100110 0x7ffad419bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42678/0 (socket says 172.21.15.114:42678) 2023-10-18T14:02:57.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.829+0000 7ffad2d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffad40ff750 0x7ffad419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:57.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.829+0000 7ffad259c700 1 -- 172.21.15.114:0/412927868 learned_addr learned my addr 172.21.15.114:0/412927868 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:57.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.830+0000 7ffad359e700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffad41056b0 0x7ffad4195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:57.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.830+0000 7ffad259c700 1 -- 172.21.15.114:0/412927868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffad40ff750 msgr2=0x7ffad419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:57.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.830+0000 7ffad259c700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffad40ff750 0x7ffad419b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:57.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.830+0000 7ffad259c700 1 -- 172.21.15.114:0/412927868 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffad41056b0 msgr2=0x7ffad4195b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:57.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.830+0000 7ffad259c700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ffad41056b0 0x7ffad4195b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:57.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.830+0000 7ffad259c700 1 -- 172.21.15.114:0/412927868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc009d00 con 0x7ffad4100110 2023-10-18T14:02:57.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.830+0000 7ffad2d9d700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffad40ff750 0x7ffad419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:02:57.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.830+0000 7ffad259c700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad4100110 0x7ffad419bf00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00d950 tx=0x7ffabc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:57.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.830+0000 7ffacbfff700 1 -- 172.21.15.114:0/412927868 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc00f890 con 0x7ffad4100110 2023-10-18T14:02:57.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.830+0000 7ffacbfff700 1 -- 172.21.15.114:0/412927868 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffabc010460 con 0x7ffad4100110 2023-10-18T14:02:57.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.830+0000 7ffacbfff700 1 -- 172.21.15.114:0/412927868 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc00e610 con 0x7ffad4100110 2023-10-18T14:02:57.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.831+0000 7ffad9259700 1 -- 172.21.15.114:0/412927868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad4196770 con 0x7ffad4100110 2023-10-18T14:02:57.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.831+0000 7ffad9259700 1 -- 172.21.15.114:0/412927868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad4068360 con 0x7ffad4100110 2023-10-18T14:02:57.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.832+0000 7ffad9259700 1 -- 172.21.15.114:0/412927868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffad410f960 con 0x7ffad4100110 2023-10-18T14:02:57.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.834+0000 7ffacbfff700 1 -- 172.21.15.114:0/412927868 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7ffabc0108d0 con 0x7ffad4100110 2023-10-18T14:02:57.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.834+0000 7ffacbfff700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ffac00a15e0 0x7ffac00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:57.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.834+0000 7ffad2d9d700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ffac00a15e0 0x7ffac00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:57.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.834+0000 7ffacbfff700 1 -- 172.21.15.114:0/412927868 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7ffabc0ccaa0 con 0x7ffad4100110 2023-10-18T14:02:57.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.834+0000 7ffacbfff700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165] conn(0x7ffac00aaf50 0x7ffac00ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:57.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.834+0000 7ffacbfff700 1 -- 172.21.15.114:0/412927868 --> [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffac00ada20 con 0x7ffac00aaf50 2023-10-18T14:02:57.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.835+0000 7ffacbfff700 1 -- 172.21.15.114:0/412927868 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffabc0d12c0 con 0x7ffad4100110 2023-10-18T14:02:57.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.835+0000 7ffad359e700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165] conn(0x7ffac00aaf50 0x7ffac00ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:57.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.835+0000 7ffad2d9d700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ffac00a15e0 0x7ffac00a3aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffacc007fd0 tx=0x7ffacc00b7b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:57.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.835+0000 7ffad359e700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165] conn(0x7ffac00aaf50 0x7ffac00ad370 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:57.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.836+0000 7ffacbfff700 1 -- 172.21.15.114:0/412927868 <== osd.1 v2:172.21.15.158:6800/1402372165 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ffac00ada20 con 0x7ffac00aaf50 2023-10-18T14:02:57.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.852+0000 7ffad9259700 1 -- 172.21.15.114:0/412927868 --> [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffad4068840 con 0x7ffac00aaf50 2023-10-18T14:02:57.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.853+0000 7ffacbfff700 1 -- 172.21.15.114:0/412927868 <== osd.1 v2:172.21.15.158:6800/1402372165 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffad4068840 con 0x7ffac00aaf50 2023-10-18T14:02:57.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.853+0000 7ffad9259700 1 -- 172.21.15.114:0/412927868 >> [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165] conn(0x7ffac00aaf50 msgr2=0x7ffac00ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:57.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.853+0000 7ffad9259700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165] conn(0x7ffac00aaf50 0x7ffac00ad370 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:57.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.853+0000 7ffad9259700 1 -- 172.21.15.114:0/412927868 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ffac00a15e0 msgr2=0x7ffac00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:57.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.853+0000 7ffad9259700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ffac00a15e0 0x7ffac00a3aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffacc007fd0 tx=0x7ffacc00b7b0 comp rx=0 tx=0).stop 2023-10-18T14:02:57.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.853+0000 7ffad9259700 1 -- 172.21.15.114:0/412927868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad4100110 msgr2=0x7ffad419bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:57.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.853+0000 7ffad9259700 1 --2- 172.21.15.114:0/412927868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad4100110 0x7ffad419bf00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00d950 tx=0x7ffabc00dc60 comp rx=0 tx=0).stop 2023-10-18T14:02:57.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.853+0000 7ffad359e700 1 -- 172.21.15.114:0/412927868 reap_dead start 2023-10-18T14:02:57.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.853+0000 7ffad9259700 1 -- 172.21.15.114:0/412927868 shutdown_connections 2023-10-18T14:02:57.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.853+0000 7ffad9259700 1 -- 172.21.15.114:0/412927868 >> 172.21.15.114:0/412927868 conn(0x7ffad4075790 msgr2=0x7ffad40fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:57.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.854+0000 7ffad9259700 1 -- 172.21.15.114:0/412927868 shutdown_connections 2023-10-18T14:02:57.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:57.854+0000 7ffad9259700 1 -- 172.21.15.114:0/412927868 wait complete. 2023-10-18T14:02:58.884 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:02:58 smithi114 ceph-mon[99494]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-10-18T14:02:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:02:58 smithi158 ceph-mon[103317]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-10-18T14:02:59.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:02:58 smithi172 ceph-mon[103574]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-10-18T14:02:59.597 INFO:teuthology.orchestra.run.smithi114.stdout:60129542203 2023-10-18T14:02:59.598 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-18T14:02:59.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.910+0000 7fefbf9e3700 1 -- 172.21.15.114:0/896105057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb8068e50 msgr2=0x7fefb8069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:59.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.910+0000 7fefbf9e3700 1 --2- 172.21.15.114:0/896105057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb8068e50 0x7fefb8069230 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009990 tx=0x7fefb4009ca0 comp rx=0 tx=0).stop 2023-10-18T14:02:59.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.910+0000 7fefbf9e3700 1 -- 172.21.15.114:0/896105057 shutdown_connections 2023-10-18T14:02:59.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.910+0000 7fefbf9e3700 1 --2- 172.21.15.114:0/896105057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefb810d290 0x7fefb810f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:59.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.910+0000 7fefbf9e3700 1 --2- 172.21.15.114:0/896105057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb8068e50 0x7fefb8069230 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:59.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.910+0000 7fefbf9e3700 1 --2- 172.21.15.114:0/896105057 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fefb8069770 0x7fefb810cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:59.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.910+0000 7fefbf9e3700 1 -- 172.21.15.114:0/896105057 >> 172.21.15.114:0/896105057 conn(0x7fefb80766f0 msgr2=0x7fefb8076b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:59.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.910+0000 7fefbf9e3700 1 -- 172.21.15.114:0/896105057 shutdown_connections 2023-10-18T14:02:59.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.912+0000 7fefbf9e3700 1 -- 172.21.15.114:0/896105057 wait complete. 2023-10-18T14:02:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbf9e3700 1 Processor -- start 2023-10-18T14:02:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbf9e3700 1 -- start start 2023-10-18T14:02:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbf9e3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefb8068e50 0x7fefb8198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbf9e3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb8069770 0x7fefb81993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbf9e3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fefb810d290 0x7fefb819d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbf9e3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb819dd90 con 0x7fefb8069770 2023-10-18T14:02:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbf9e3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb819df00 con 0x7fefb810d290 2023-10-18T14:02:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbf9e3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb819e0c0 con 0x7fefb8068e50 2023-10-18T14:02:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbcf7e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb8069770 0x7fefb81993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbcf7e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb8069770 0x7fefb81993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42708/0 (socket says 172.21.15.114:42708) 2023-10-18T14:02:59.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbcf7e700 1 -- 172.21.15.114:0/1693344160 learned_addr learned my addr 172.21.15.114:0/1693344160 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:02:59.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbd77f700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefb8068e50 0x7fefb8198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:59.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbdf80700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fefb810d290 0x7fefb819d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:59.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbcf7e700 1 -- 172.21.15.114:0/1693344160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefb8068e50 msgr2=0x7fefb8198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:59.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbcf7e700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefb8068e50 0x7fefb8198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:59.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbcf7e700 1 -- 172.21.15.114:0/1693344160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fefb810d290 msgr2=0x7fefb819d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:59.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbcf7e700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fefb810d290 0x7fefb819d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:59.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbcf7e700 1 -- 172.21.15.114:0/1693344160 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40095f0 con 0x7fefb8069770 2023-10-18T14:02:59.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.913+0000 7fefbdf80700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fefb810d290 0x7fefb819d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:02:59.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.914+0000 7fefbcf7e700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb8069770 0x7fefb81993d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fefa800b530 tx=0x7fefa800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:59.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.914+0000 7fefae7fc700 1 -- 172.21.15.114:0/1693344160 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa8011830 con 0x7fefb8069770 2023-10-18T14:02:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.914+0000 7fefbf9e3700 1 -- 172.21.15.114:0/1693344160 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb819e3a0 con 0x7fefb8069770 2023-10-18T14:02:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.914+0000 7fefae7fc700 1 -- 172.21.15.114:0/1693344160 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefa8011e50 con 0x7fefb8069770 2023-10-18T14:02:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.914+0000 7fefae7fc700 1 -- 172.21.15.114:0/1693344160 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa800f2e0 con 0x7fefb8069770 2023-10-18T14:02:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.914+0000 7fefbf9e3700 1 -- 172.21.15.114:0/1693344160 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb81a5c00 con 0x7fefb8069770 2023-10-18T14:02:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.915+0000 7fefbf9e3700 1 -- 172.21.15.114:0/1693344160 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fefb8112c40 con 0x7fefb8069770 2023-10-18T14:02:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.916+0000 7fefae7fc700 1 -- 172.21.15.114:0/1693344160 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fefa8010580 con 0x7fefb8069770 2023-10-18T14:02:59.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.917+0000 7fefae7fc700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fefa40a1560 0x7fefa40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:59.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.917+0000 7fefbd77f700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fefa40a1560 0x7fefa40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:59.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.917+0000 7fefae7fc700 1 -- 172.21.15.114:0/1693344160 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fefa80ccf40 con 0x7fefb8069770 2023-10-18T14:02:59.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.917+0000 7fefae7fc700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633] conn(0x7fefa40aaed0 0x7fefa40ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:02:59.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.917+0000 7fefae7fc700 1 -- 172.21.15.114:0/1693344160 --> [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fefa40ad9a0 con 0x7fefa40aaed0 2023-10-18T14:02:59.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.917+0000 7fefae7fc700 1 -- 172.21.15.114:0/1693344160 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefa80cd350 con 0x7fefb8069770 2023-10-18T14:02:59.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.917+0000 7fefbdf80700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633] conn(0x7fefa40aaed0 0x7fefa40ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:02:59.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.917+0000 7fefbd77f700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fefa40a1560 0x7fefa40a3a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fefb400b5c0 tx=0x7fefb401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:59.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.918+0000 7fefbdf80700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633] conn(0x7fefa40aaed0 0x7fefa40ad2f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:02:59.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.918+0000 7fefae7fc700 1 -- 172.21.15.114:0/1693344160 <== osd.9 v2:172.21.15.114:6826/1353419633 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fefa40ad9a0 con 0x7fefa40aaed0 2023-10-18T14:02:59.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.934+0000 7fefbf9e3700 1 -- 172.21.15.114:0/1693344160 --> [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fefb8060e70 con 0x7fefa40aaed0 2023-10-18T14:02:59.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.934+0000 7fefae7fc700 1 -- 172.21.15.114:0/1693344160 <== osd.9 v2:172.21.15.114:6826/1353419633 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fefb8060e70 con 0x7fefa40aaed0 2023-10-18T14:02:59.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.935+0000 7fefbf9e3700 1 -- 172.21.15.114:0/1693344160 >> [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633] conn(0x7fefa40aaed0 msgr2=0x7fefa40ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:59.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.935+0000 7fefbf9e3700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633] conn(0x7fefa40aaed0 0x7fefa40ad2f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:02:59.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.935+0000 7fefbf9e3700 1 -- 172.21.15.114:0/1693344160 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fefa40a1560 msgr2=0x7fefa40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:59.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.935+0000 7fefbf9e3700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fefa40a1560 0x7fefa40a3a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fefb400b5c0 tx=0x7fefb401a040 comp rx=0 tx=0).stop 2023-10-18T14:02:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.935+0000 7fefbf9e3700 1 -- 172.21.15.114:0/1693344160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb8069770 msgr2=0x7fefb81993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:02:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.935+0000 7fefbf9e3700 1 --2- 172.21.15.114:0/1693344160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefb8069770 0x7fefb81993d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fefa800b530 tx=0x7fefa800b8f0 comp rx=0 tx=0).stop 2023-10-18T14:02:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.935+0000 7fefbdf80700 1 -- 172.21.15.114:0/1693344160 reap_dead start 2023-10-18T14:02:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.935+0000 7fefbf9e3700 1 -- 172.21.15.114:0/1693344160 shutdown_connections 2023-10-18T14:02:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.935+0000 7fefbf9e3700 1 -- 172.21.15.114:0/1693344160 >> 172.21.15.114:0/1693344160 conn(0x7fefb80766f0 msgr2=0x7fefb810e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:02:59.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.935+0000 7fefbf9e3700 1 -- 172.21.15.114:0/1693344160 shutdown_connections 2023-10-18T14:02:59.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:59.935+0000 7fefbf9e3700 1 -- 172.21.15.114:0/1693344160 wait complete. 2023-10-18T14:03:00.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.176+0000 7f01893ea700 1 -- 172.21.15.114:0/3432544059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0184100110 msgr2=0x7f018410c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.176+0000 7f01893ea700 1 --2- 172.21.15.114:0/3432544059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0184100110 0x7f018410c580 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0174009990 tx=0x7f0174009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.176+0000 7f01893ea700 1 -- 172.21.15.114:0/3432544059 shutdown_connections 2023-10-18T14:03:00.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.176+0000 7f01893ea700 1 --2- 172.21.15.114:0/3432544059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0184100110 0x7f018410c580 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.176+0000 7f01893ea700 1 --2- 172.21.15.114:0/3432544059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01841056b0 0x7f0184105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.176+0000 7f01893ea700 1 --2- 172.21.15.114:0/3432544059 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01840ff750 0x7f01840ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.176+0000 7f01893ea700 1 -- 172.21.15.114:0/3432544059 >> 172.21.15.114:0/3432544059 conn(0x7f0184075790 msgr2=0x7f0184075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:00.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.176+0000 7f01893ea700 1 -- 172.21.15.114:0/3432544059 shutdown_connections 2023-10-18T14:03:00.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.176+0000 7f01893ea700 1 -- 172.21.15.114:0/3432544059 wait complete. 2023-10-18T14:03:00.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.176+0000 7f01893ea700 1 Processor -- start 2023-10-18T14:03:00.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.176+0000 7f01893ea700 1 -- start start 2023-10-18T14:03:00.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f01893ea700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01840ff750 0x7f0184197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f01893ea700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0184100110 0x7f0184198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f01893ea700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01841056b0 0x7f01841a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f01893ea700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01841988e0 con 0x7f01840ff750 2023-10-18T14:03:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f01893ea700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01841a30a0 con 0x7f01841056b0 2023-10-18T14:03:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f01893ea700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01841a31e0 con 0x7f0184100110 2023-10-18T14:03:00.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f0182ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01840ff750 0x7f0184197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f0182ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01840ff750 0x7f0184197ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42722/0 (socket says 172.21.15.114:42722) 2023-10-18T14:03:00.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f0182ffd700 1 -- 172.21.15.114:0/2872653666 learned_addr learned my addr 172.21.15.114:0/2872653666 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:00.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f01837fe700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01841056b0 0x7f01841a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f01827fc700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0184100110 0x7f0184198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f0182ffd700 1 -- 172.21.15.114:0/2872653666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0184100110 msgr2=0x7f0184198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f0182ffd700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0184100110 0x7f0184198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f0182ffd700 1 -- 172.21.15.114:0/2872653666 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01841056b0 msgr2=0x7f01841a2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f0182ffd700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01841056b0 0x7f01841a2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f0182ffd700 1 -- 172.21.15.114:0/2872653666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01740095f0 con 0x7f01840ff750 2023-10-18T14:03:00.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f01837fe700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f01841056b0 0x7f01841a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:00.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f0182ffd700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01840ff750 0x7f0184197ae0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f017c00ba50 tx=0x7f017c00be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:00.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f017bfff700 1 -- 172.21.15.114:0/2872653666 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c00cab0 con 0x7f01840ff750 2023-10-18T14:03:00.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f01893ea700 1 -- 172.21.15.114:0/2872653666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01841a3460 con 0x7f01840ff750 2023-10-18T14:03:00.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f017bfff700 1 -- 172.21.15.114:0/2872653666 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f017c00cc10 con 0x7f01840ff750 2023-10-18T14:03:00.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.177+0000 7f017bfff700 1 -- 172.21.15.114:0/2872653666 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c0075d0 con 0x7f01840ff750 2023-10-18T14:03:00.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.178+0000 7f01893ea700 1 -- 172.21.15.114:0/2872653666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01841a3960 con 0x7f01840ff750 2023-10-18T14:03:00.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.178+0000 7f01893ea700 1 -- 172.21.15.114:0/2872653666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f018410f960 con 0x7f01840ff750 2023-10-18T14:03:00.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.180+0000 7f017bfff700 1 -- 172.21.15.114:0/2872653666 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f017c014440 con 0x7f01840ff750 2023-10-18T14:03:00.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.180+0000 7f017bfff700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f01700a1560 0x7f01700a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.180+0000 7f01827fc700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f01700a1560 0x7f01700a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.180+0000 7f017bfff700 1 -- 172.21.15.114:0/2872653666 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f017c006e40 con 0x7f01840ff750 2023-10-18T14:03:00.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.180+0000 7f017bfff700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171] conn(0x7f01700aaed0 0x7f01700ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.180+0000 7f017bfff700 1 -- 172.21.15.114:0/2872653666 --> [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01700ad9a0 con 0x7f01700aaed0 2023-10-18T14:03:00.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.180+0000 7f017bfff700 1 -- 172.21.15.114:0/2872653666 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f017c0ccfa0 con 0x7f01840ff750 2023-10-18T14:03:00.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.181+0000 7f01827fc700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f01700a1560 0x7f01700a3a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f016c005fd0 tx=0x7f016c00a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:00.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.181+0000 7f01837fe700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171] conn(0x7f01700aaed0 0x7f01700ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.181+0000 7f01837fe700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171] conn(0x7f01700aaed0 0x7f01700ad2f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:00.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.182+0000 7f017bfff700 1 -- 172.21.15.114:0/2872653666 <== osd.11 v2:172.21.15.172:6824/3903571171 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f01700ad9a0 con 0x7f01700aaed0 2023-10-18T14:03:00.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.202+0000 7f01893ea700 1 -- 172.21.15.114:0/2872653666 --> [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0184100df0 con 0x7f01700aaed0 2023-10-18T14:03:00.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.203+0000 7f017bfff700 1 -- 172.21.15.114:0/2872653666 <== osd.11 v2:172.21.15.172:6824/3903571171 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0184100df0 con 0x7f01700aaed0 2023-10-18T14:03:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.203+0000 7f01893ea700 1 -- 172.21.15.114:0/2872653666 >> [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171] conn(0x7f01700aaed0 msgr2=0x7f01700ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.203+0000 7f01893ea700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171] conn(0x7f01700aaed0 0x7f01700ad2f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.203+0000 7f01893ea700 1 -- 172.21.15.114:0/2872653666 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f01700a1560 msgr2=0x7f01700a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.203+0000 7f01893ea700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f01700a1560 0x7f01700a3a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f016c005fd0 tx=0x7f016c00a560 comp rx=0 tx=0).stop 2023-10-18T14:03:00.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.203+0000 7f01893ea700 1 -- 172.21.15.114:0/2872653666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01840ff750 msgr2=0x7f0184197ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.203+0000 7f01893ea700 1 --2- 172.21.15.114:0/2872653666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01840ff750 0x7f0184197ae0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f017c00ba50 tx=0x7f017c00be10 comp rx=0 tx=0).stop 2023-10-18T14:03:00.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.203+0000 7f01837fe700 1 -- 172.21.15.114:0/2872653666 reap_dead start 2023-10-18T14:03:00.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.203+0000 7f01893ea700 1 -- 172.21.15.114:0/2872653666 shutdown_connections 2023-10-18T14:03:00.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.203+0000 7f01893ea700 1 -- 172.21.15.114:0/2872653666 >> 172.21.15.114:0/2872653666 conn(0x7f0184075790 msgr2=0x7f01840fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:00.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.203+0000 7f01893ea700 1 -- 172.21.15.114:0/2872653666 shutdown_connections 2023-10-18T14:03:00.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.203+0000 7f01893ea700 1 -- 172.21.15.114:0/2872653666 wait complete. 2023-10-18T14:03:00.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.828+0000 7fc81d733700 1 -- 172.21.15.114:0/1541970454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc818068190 msgr2=0x7fc818068570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.828+0000 7fc81d733700 1 --2- 172.21.15.114:0/1541970454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc818068190 0x7fc818068570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc808009990 tx=0x7fc808009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.828+0000 7fc81d733700 1 -- 172.21.15.114:0/1541970454 shutdown_connections 2023-10-18T14:03:00.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.828+0000 7fc81d733700 1 --2- 172.21.15.114:0/1541970454 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc81810d300 0x7fc81810f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.828+0000 7fc81d733700 1 --2- 172.21.15.114:0/1541970454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc818068190 0x7fc818068570 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.828+0000 7fc81d733700 1 --2- 172.21.15.114:0/1541970454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc818068ab0 0x7fc81810cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.828+0000 7fc81d733700 1 -- 172.21.15.114:0/1541970454 >> 172.21.15.114:0/1541970454 conn(0x7fc818075790 msgr2=0x7fc818075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:00.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.828+0000 7fc81d733700 1 -- 172.21.15.114:0/1541970454 shutdown_connections 2023-10-18T14:03:00.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.828+0000 7fc81d733700 1 -- 172.21.15.114:0/1541970454 wait complete. 2023-10-18T14:03:00.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.829+0000 7fc81d733700 1 Processor -- start 2023-10-18T14:03:00.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.829+0000 7fc81d733700 1 -- start start 2023-10-18T14:03:00.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc81d733700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc818068190 0x7fc818198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc81d733700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc818068ab0 0x7fc818199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc81d733700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc81810d300 0x7fc81819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc81d733700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81819dd20 con 0x7fc818068190 2023-10-18T14:03:00.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc81d733700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81819de90 con 0x7fc818068ab0 2023-10-18T14:03:00.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc81d733700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81819e050 con 0x7fc81810d300 2023-10-18T14:03:00.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc8177fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc81810d300 0x7fc81819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc8177fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc81810d300 0x7fc81819d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:46632/0 (socket says 172.21.15.114:46632) 2023-10-18T14:03:00.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc8177fe700 1 -- 172.21.15.114:0/2759370827 learned_addr learned my addr 172.21.15.114:0/2759370827 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:00.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc8167fc700 1 --2- 172.21.15.114:0/2759370827 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc818068ab0 0x7fc818199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc8177fe700 1 -- 172.21.15.114:0/2759370827 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc818068ab0 msgr2=0x7fc818199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc8177fe700 1 --2- 172.21.15.114:0/2759370827 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc818068ab0 0x7fc818199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc8177fe700 1 -- 172.21.15.114:0/2759370827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc818068190 msgr2=0x7fc818198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc8177fe700 1 --2- 172.21.15.114:0/2759370827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc818068190 0x7fc818198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.830+0000 7fc8177fe700 1 -- 172.21.15.114:0/2759370827 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8080095f0 con 0x7fc81810d300 2023-10-18T14:03:00.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.831+0000 7fc8177fe700 1 --2- 172.21.15.114:0/2759370827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc81810d300 0x7fc81819d710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc8100094f0 tx=0x7fc81000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:00.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.831+0000 7fc7fffff700 1 -- 172.21.15.114:0/2759370827 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81000ddd0 con 0x7fc81810d300 2023-10-18T14:03:00.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.831+0000 7fc7fffff700 1 -- 172.21.15.114:0/2759370827 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc81000f040 con 0x7fc81810d300 2023-10-18T14:03:00.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.831+0000 7fc7fffff700 1 -- 172.21.15.114:0/2759370827 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810015400 con 0x7fc81810d300 2023-10-18T14:03:00.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.833+0000 7fc81d733700 1 -- 172.21.15.114:0/2759370827 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81819e330 con 0x7fc81810d300 2023-10-18T14:03:00.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.833+0000 7fc81d733700 1 -- 172.21.15.114:0/2759370827 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81806a3e0 con 0x7fc81810d300 2023-10-18T14:03:00.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.833+0000 7fc81d733700 1 -- 172.21.15.114:0/2759370827 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc818112bf0 con 0x7fc81810d300 2023-10-18T14:03:00.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.835+0000 7fc7fffff700 1 -- 172.21.15.114:0/2759370827 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fc810004c40 con 0x7fc81810d300 2023-10-18T14:03:00.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.835+0000 7fc7fffff700 1 --2- 172.21.15.114:0/2759370827 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc8000b25f0 0x7fc8000b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.835+0000 7fc816ffd700 1 --2- 172.21.15.114:0/2759370827 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc8000b25f0 0x7fc8000b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.835+0000 7fc7fffff700 1 -- 172.21.15.114:0/2759370827 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fc8100cd2a0 con 0x7fc81810d300 2023-10-18T14:03:00.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.835+0000 7fc7fffff700 1 --2- 172.21.15.114:0/2759370827 >> [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386] conn(0x7fc8000bbf60 0x7fc8000be380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.835+0000 7fc7fffff700 1 -- 172.21.15.114:0/2759370827 --> [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8000bea30 con 0x7fc8000bbf60 2023-10-18T14:03:00.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.835+0000 7fc7fffff700 1 -- 172.21.15.114:0/2759370827 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8100cd6b0 con 0x7fc81810d300 2023-10-18T14:03:00.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.836+0000 7fc8167fc700 1 --2- 172.21.15.114:0/2759370827 >> [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386] conn(0x7fc8000bbf60 0x7fc8000be380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.836+0000 7fc816ffd700 1 --2- 172.21.15.114:0/2759370827 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc8000b25f0 0x7fc8000b4ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8080098e0 tx=0x7fc808005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:00.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.836+0000 7fc8167fc700 1 --2- 172.21.15.114:0/2759370827 >> [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386] conn(0x7fc8000bbf60 0x7fc8000be380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:00.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.837+0000 7fc7fffff700 1 -- 172.21.15.114:0/2759370827 <== osd.3 v2:172.21.15.114:6810/4089132386 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc8000bea30 con 0x7fc8000bbf60 2023-10-18T14:03:00.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.853+0000 7fc81d733700 1 -- 172.21.15.114:0/2759370827 --> [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc8180ffd30 con 0x7fc8000bbf60 2023-10-18T14:03:00.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.853+0000 7fc7fffff700 1 -- 172.21.15.114:0/2759370827 <== osd.3 v2:172.21.15.114:6810/4089132386 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc8180ffd30 con 0x7fc8000bbf60 2023-10-18T14:03:00.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.854+0000 7fc81d733700 1 -- 172.21.15.114:0/2759370827 >> [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386] conn(0x7fc8000bbf60 msgr2=0x7fc8000be380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.854+0000 7fc81d733700 1 --2- 172.21.15.114:0/2759370827 >> [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386] conn(0x7fc8000bbf60 0x7fc8000be380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.854+0000 7fc81d733700 1 -- 172.21.15.114:0/2759370827 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc8000b25f0 msgr2=0x7fc8000b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.854+0000 7fc81d733700 1 --2- 172.21.15.114:0/2759370827 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc8000b25f0 0x7fc8000b4ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8080098e0 tx=0x7fc808005fb0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.854+0000 7fc81d733700 1 -- 172.21.15.114:0/2759370827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc81810d300 msgr2=0x7fc81819d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.854+0000 7fc81d733700 1 --2- 172.21.15.114:0/2759370827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc81810d300 0x7fc81819d710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc8100094f0 tx=0x7fc81000d3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.854+0000 7fc8177fe700 1 -- 172.21.15.114:0/2759370827 reap_dead start 2023-10-18T14:03:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.854+0000 7fc81d733700 1 -- 172.21.15.114:0/2759370827 shutdown_connections 2023-10-18T14:03:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.854+0000 7fc81d733700 1 -- 172.21.15.114:0/2759370827 >> 172.21.15.114:0/2759370827 conn(0x7fc818075790 msgr2=0x7fc81810e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.854+0000 7fc81d733700 1 -- 172.21.15.114:0/2759370827 shutdown_connections 2023-10-18T14:03:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:02:58.854+0000 7fc81d733700 1 -- 172.21.15.114:0/2759370827 wait complete. 2023-10-18T14:03:00.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:00 smithi114 ceph-mon[99494]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-18T14:03:00.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.878+0000 7fe67a95b700 1 -- 172.21.15.114:0/1654642550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe674068190 msgr2=0x7fe6740685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.878+0000 7fe67a95b700 1 --2- 172.21.15.114:0/1654642550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe674068190 0x7fe6740685f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe668009990 tx=0x7fe668009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.878+0000 7fe67a95b700 1 -- 172.21.15.114:0/1654642550 shutdown_connections 2023-10-18T14:03:00.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.878+0000 7fe67a95b700 1 --2- 172.21.15.114:0/1654642550 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe674068b30 0x7fe67410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.878+0000 7fe67a95b700 1 --2- 172.21.15.114:0/1654642550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6741067a0 0x7fe674106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.878+0000 7fe67a95b700 1 --2- 172.21.15.114:0/1654642550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe674068190 0x7fe6740685f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.878+0000 7fe67a95b700 1 -- 172.21.15.114:0/1654642550 >> 172.21.15.114:0/1654642550 conn(0x7fe674075790 msgr2=0x7fe674075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:00.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.878+0000 7fe67a95b700 1 -- 172.21.15.114:0/1654642550 shutdown_connections 2023-10-18T14:03:00.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.878+0000 7fe67a95b700 1 -- 172.21.15.114:0/1654642550 wait complete. 2023-10-18T14:03:00.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe67a95b700 1 Processor -- start 2023-10-18T14:03:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe67a95b700 1 -- start start 2023-10-18T14:03:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe67a95b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe674068190 0x7fe67419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe67a95b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe674068b30 0x7fe67419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe67a95b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6741067a0 0x7fe674196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe67a95b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe674197190 con 0x7fe6741067a0 2023-10-18T14:03:00.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe67a95b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe674197300 con 0x7fe674068b30 2023-10-18T14:03:00.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe67a95b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6741974c0 con 0x7fe674068190 2023-10-18T14:03:00.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe678ef8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6741067a0 0x7fe674196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe678ef8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6741067a0 0x7fe674196b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42740/0 (socket says 172.21.15.114:42740) 2023-10-18T14:03:00.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe678ef8700 1 -- 172.21.15.114:0/3958983632 learned_addr learned my addr 172.21.15.114:0/3958983632 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:00.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe673fff700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe674068190 0x7fe67419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe6737fe700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe674068b30 0x7fe67419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe678ef8700 1 -- 172.21.15.114:0/3958983632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe674068190 msgr2=0x7fe67419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe678ef8700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe674068190 0x7fe67419c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.879+0000 7fe678ef8700 1 -- 172.21.15.114:0/3958983632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe674068b30 msgr2=0x7fe67419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.880+0000 7fe678ef8700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe674068b30 0x7fe67419cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.880+0000 7fe678ef8700 1 -- 172.21.15.114:0/3958983632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680095f0 con 0x7fe6741067a0 2023-10-18T14:03:00.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.880+0000 7fe6737fe700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe674068b30 0x7fe67419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:00.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.880+0000 7fe678ef8700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6741067a0 0x7fe674196b30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00b970 tx=0x7fe66c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:00.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.880+0000 7fe6717fa700 1 -- 172.21.15.114:0/3958983632 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00c930 con 0x7fe6741067a0 2023-10-18T14:03:00.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.880+0000 7fe6717fa700 1 -- 172.21.15.114:0/3958983632 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe66c014440 con 0x7fe6741067a0 2023-10-18T14:03:00.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.880+0000 7fe6717fa700 1 -- 172.21.15.114:0/3958983632 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c0075d0 con 0x7fe6741067a0 2023-10-18T14:03:00.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.880+0000 7fe67a95b700 1 -- 172.21.15.114:0/3958983632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6741977a0 con 0x7fe6741067a0 2023-10-18T14:03:00.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.880+0000 7fe67a95b700 1 -- 172.21.15.114:0/3958983632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6741a39e0 con 0x7fe6741067a0 2023-10-18T14:03:00.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.881+0000 7fe67a95b700 1 -- 172.21.15.114:0/3958983632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe674110a70 con 0x7fe6741067a0 2023-10-18T14:03:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.882+0000 7fe6717fa700 1 -- 172.21.15.114:0/3958983632 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fe66c0145b0 con 0x7fe6741067a0 2023-10-18T14:03:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.883+0000 7fe6717fa700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe65c0a15e0 0x7fe65c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.883+0000 7fe673fff700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe65c0a15e0 0x7fe65c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.883+0000 7fe6717fa700 1 -- 172.21.15.114:0/3958983632 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fe66c006e40 con 0x7fe6741067a0 2023-10-18T14:03:00.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.883+0000 7fe6717fa700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341] conn(0x7fe65c0aaf50 0x7fe65c0ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:00.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.883+0000 7fe6717fa700 1 -- 172.21.15.114:0/3958983632 --> [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe65c0ada20 con 0x7fe65c0aaf50 2023-10-18T14:03:00.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.883+0000 7fe6717fa700 1 -- 172.21.15.114:0/3958983632 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe66c0cce80 con 0x7fe6741067a0 2023-10-18T14:03:00.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.883+0000 7fe673fff700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe65c0a15e0 0x7fe65c0a3aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe664009a10 tx=0x7fe664009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:00.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.883+0000 7fe6737fe700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341] conn(0x7fe65c0aaf50 0x7fe65c0ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:00.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.884+0000 7fe6737fe700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341] conn(0x7fe65c0aaf50 0x7fe65c0ad370 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:00.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.885+0000 7fe6717fa700 1 -- 172.21.15.114:0/3958983632 <== osd.10 v2:172.21.15.158:6824/1713443341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fe65c0ada20 con 0x7fe65c0aaf50 2023-10-18T14:03:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.917+0000 7fe67a95b700 1 -- 172.21.15.114:0/3958983632 --> [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe674060ef0 con 0x7fe65c0aaf50 2023-10-18T14:03:00.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.918+0000 7fe6717fa700 1 -- 172.21.15.114:0/3958983632 <== osd.10 v2:172.21.15.158:6824/1713443341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe674060ef0 con 0x7fe65c0aaf50 2023-10-18T14:03:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.918+0000 7fe67a95b700 1 -- 172.21.15.114:0/3958983632 >> [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341] conn(0x7fe65c0aaf50 msgr2=0x7fe65c0ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.918+0000 7fe67a95b700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341] conn(0x7fe65c0aaf50 0x7fe65c0ad370 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.918+0000 7fe67a95b700 1 -- 172.21.15.114:0/3958983632 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe65c0a15e0 msgr2=0x7fe65c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.918+0000 7fe67a95b700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe65c0a15e0 0x7fe65c0a3aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe664009a10 tx=0x7fe664009190 comp rx=0 tx=0).stop 2023-10-18T14:03:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.918+0000 7fe67a95b700 1 -- 172.21.15.114:0/3958983632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6741067a0 msgr2=0x7fe674196b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.918+0000 7fe67a95b700 1 --2- 172.21.15.114:0/3958983632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6741067a0 0x7fe674196b30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00b970 tx=0x7fe66c00bc80 comp rx=0 tx=0).stop 2023-10-18T14:03:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.918+0000 7fe678ef8700 1 -- 172.21.15.114:0/3958983632 reap_dead start 2023-10-18T14:03:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.918+0000 7fe67a95b700 1 -- 172.21.15.114:0/3958983632 shutdown_connections 2023-10-18T14:03:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.918+0000 7fe67a95b700 1 -- 172.21.15.114:0/3958983632 >> 172.21.15.114:0/3958983632 conn(0x7fe674075790 msgr2=0x7fe6740fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:00.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.918+0000 7fe67a95b700 1 -- 172.21.15.114:0/3958983632 shutdown_connections 2023-10-18T14:03:00.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.918+0000 7fe67a95b700 1 -- 172.21.15.114:0/3958983632 wait complete. 2023-10-18T14:03:01.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:00 smithi158 ceph-mon[103317]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-18T14:03:01.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:00 smithi172 ceph-mon[103574]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-18T14:03:01.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.963+0000 7f480b482700 1 -- 172.21.15.114:0/2090537478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48041056b0 msgr2=0x7f4804105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.963+0000 7f480b482700 1 --2- 172.21.15.114:0/2090537478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48041056b0 0x7f4804105a90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4800009990 tx=0x7f4800009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.963+0000 7f480b482700 1 -- 172.21.15.114:0/2090537478 shutdown_connections 2023-10-18T14:03:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.963+0000 7f480b482700 1 --2- 172.21.15.114:0/2090537478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4804100110 0x7f480410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.963+0000 7f480b482700 1 --2- 172.21.15.114:0/2090537478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48041056b0 0x7f4804105a90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:01.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.963+0000 7f480b482700 1 --2- 172.21.15.114:0/2090537478 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48040ff750 0x7f48040ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:01.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.963+0000 7f480b482700 1 -- 172.21.15.114:0/2090537478 >> 172.21.15.114:0/2090537478 conn(0x7f4804075790 msgr2=0x7f4804075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:01.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.963+0000 7f480b482700 1 -- 172.21.15.114:0/2090537478 shutdown_connections 2023-10-18T14:03:01.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.963+0000 7f480b482700 1 -- 172.21.15.114:0/2090537478 wait complete. 2023-10-18T14:03:01.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.964+0000 7f480b482700 1 Processor -- start 2023-10-18T14:03:01.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.964+0000 7f480b482700 1 -- start start 2023-10-18T14:03:01.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.964+0000 7f480b482700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48040ff750 0x7f480419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:01.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.964+0000 7f480b482700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4804100110 0x7f480419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:01.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.964+0000 7f480b482700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48041056b0 0x7f4804195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.964+0000 7f480b482700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4804195ff0 con 0x7f48041056b0 2023-10-18T14:03:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.964+0000 7f480b482700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4804196160 con 0x7f48040ff750 2023-10-18T14:03:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.964+0000 7f480b482700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4804196320 con 0x7f4804100110 2023-10-18T14:03:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.964+0000 7f4809a1f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48041056b0 0x7f4804195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.964+0000 7f4809a1f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48041056b0 0x7f4804195990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42756/0 (socket says 172.21.15.114:42756) 2023-10-18T14:03:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.964+0000 7f4809a1f700 1 -- 172.21.15.114:0/563417640 learned_addr learned my addr 172.21.15.114:0/563417640 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.964+0000 7f4808a1d700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4804100110 0x7f480419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.965+0000 7f480921e700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48040ff750 0x7f480419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.965+0000 7f4809a1f700 1 -- 172.21.15.114:0/563417640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4804100110 msgr2=0x7f480419bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.965+0000 7f4809a1f700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4804100110 0x7f480419bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:01.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.965+0000 7f4809a1f700 1 -- 172.21.15.114:0/563417640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48040ff750 msgr2=0x7f480419b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:01.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.965+0000 7f4809a1f700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48040ff750 0x7f480419b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:01.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.965+0000 7f4809a1f700 1 -- 172.21.15.114:0/563417640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48000095f0 con 0x7f48041056b0 2023-10-18T14:03:01.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.965+0000 7f480921e700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48040ff750 0x7f480419b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:01.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.965+0000 7f4809a1f700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48041056b0 0x7f4804195990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00ada0 tx=0x7f47fc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.965+0000 7f47fa7fc700 1 -- 172.21.15.114:0/563417640 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc00f070 con 0x7f48041056b0 2023-10-18T14:03:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.965+0000 7f47fa7fc700 1 -- 172.21.15.114:0/563417640 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47fc007b30 con 0x7f48041056b0 2023-10-18T14:03:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.965+0000 7f480b482700 1 -- 172.21.15.114:0/563417640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4804196600 con 0x7f48041056b0 2023-10-18T14:03:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.965+0000 7f47fa7fc700 1 -- 172.21.15.114:0/563417640 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc0053e0 con 0x7f48041056b0 2023-10-18T14:03:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.965+0000 7f480b482700 1 -- 172.21.15.114:0/563417640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48041a27f0 con 0x7f48041056b0 2023-10-18T14:03:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.966+0000 7f480b482700 1 -- 172.21.15.114:0/563417640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f480410f910 con 0x7f48041056b0 2023-10-18T14:03:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.967+0000 7f47fa7fc700 1 -- 172.21.15.114:0/563417640 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f47fc00c980 con 0x7f48041056b0 2023-10-18T14:03:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.968+0000 7f47fa7fc700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47f00a1560 0x7f47f00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.968+0000 7f480921e700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47f00a1560 0x7f47f00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.968+0000 7f47fa7fc700 1 -- 172.21.15.114:0/563417640 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f47fc0cce60 con 0x7f48041056b0 2023-10-18T14:03:01.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.968+0000 7f47fa7fc700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562] conn(0x7f47f00aaed0 0x7f47f00ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:01.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.968+0000 7f47fa7fc700 1 -- 172.21.15.114:0/563417640 --> [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47f00ad9a0 con 0x7f47f00aaed0 2023-10-18T14:03:01.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.968+0000 7f47fa7fc700 1 -- 172.21.15.114:0/563417640 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47fc0cd1d0 con 0x7f48041056b0 2023-10-18T14:03:01.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.968+0000 7f480921e700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47f00a1560 0x7f47f00a3a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f480000b5c0 tx=0x7f4800005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:01.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.968+0000 7f4808a1d700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562] conn(0x7f47f00aaed0 0x7f47f00ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:01.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.969+0000 7f4808a1d700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562] conn(0x7f47f00aaed0 0x7f47f00ad2f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:01.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.969+0000 7f47fa7fc700 1 -- 172.21.15.114:0/563417640 <== osd.5 v2:172.21.15.172:6808/2859282562 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f47f00ad9a0 con 0x7f47f00aaed0 2023-10-18T14:03:01.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.985+0000 7f480b482700 1 -- 172.21.15.114:0/563417640 --> [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4804060ef0 con 0x7f47f00aaed0 2023-10-18T14:03:01.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.986+0000 7f47fa7fc700 1 -- 172.21.15.114:0/563417640 <== osd.5 v2:172.21.15.172:6808/2859282562 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4804060ef0 con 0x7f47f00aaed0 2023-10-18T14:03:01.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.986+0000 7f480b482700 1 -- 172.21.15.114:0/563417640 >> [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562] conn(0x7f47f00aaed0 msgr2=0x7f47f00ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:01.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.986+0000 7f480b482700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562] conn(0x7f47f00aaed0 0x7f47f00ad2f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:01.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.986+0000 7f480b482700 1 -- 172.21.15.114:0/563417640 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47f00a1560 msgr2=0x7f47f00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:01.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.986+0000 7f480b482700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47f00a1560 0x7f47f00a3a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f480000b5c0 tx=0x7f4800005fb0 comp rx=0 tx=0).stop 2023-10-18T14:03:01.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.986+0000 7f480b482700 1 -- 172.21.15.114:0/563417640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48041056b0 msgr2=0x7f4804195990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:01.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.986+0000 7f480b482700 1 --2- 172.21.15.114:0/563417640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48041056b0 0x7f4804195990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00ada0 tx=0x7f47fc00c330 comp rx=0 tx=0).stop 2023-10-18T14:03:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.986+0000 7f4809a1f700 1 -- 172.21.15.114:0/563417640 reap_dead start 2023-10-18T14:03:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.986+0000 7f480b482700 1 -- 172.21.15.114:0/563417640 shutdown_connections 2023-10-18T14:03:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.986+0000 7f480b482700 1 -- 172.21.15.114:0/563417640 >> 172.21.15.114:0/563417640 conn(0x7f4804075790 msgr2=0x7f48040fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.986+0000 7f480b482700 1 -- 172.21.15.114:0/563417640 shutdown_connections 2023-10-18T14:03:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:00.986+0000 7f480b482700 1 -- 172.21.15.114:0/563417640 wait complete. 2023-10-18T14:03:01.282 INFO:teuthology.orchestra.run.smithi114.stdout:111669149745 2023-10-18T14:03:01.282 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-18T14:03:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:167503724586 2023-10-18T14:03:01.937 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-18T14:03:02.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.189+0000 7f8121b0d700 1 -- 172.21.15.114:0/1269860810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f811c0ff6e0 msgr2=0x7f811c0ffb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:02.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.189+0000 7f8121b0d700 1 --2- 172.21.15.114:0/1269860810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f811c0ff6e0 0x7f811c0ffb60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f810c009990 tx=0x7f810c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.189+0000 7f8121b0d700 1 -- 172.21.15.114:0/1269860810 shutdown_connections 2023-10-18T14:03:02.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.189+0000 7f8121b0d700 1 --2- 172.21.15.114:0/1269860810 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f811c1000a0 0x7f811c10c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.189+0000 7f8121b0d700 1 --2- 172.21.15.114:0/1269860810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f811c1045b0 0x7f811c104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.189+0000 7f8121b0d700 1 --2- 172.21.15.114:0/1269860810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f811c0ff6e0 0x7f811c0ffb60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.189+0000 7f8121b0d700 1 -- 172.21.15.114:0/1269860810 >> 172.21.15.114:0/1269860810 conn(0x7f811c0766c0 msgr2=0x7f811c076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:02.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.189+0000 7f8121b0d700 1 -- 172.21.15.114:0/1269860810 shutdown_connections 2023-10-18T14:03:02.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.189+0000 7f8121b0d700 1 -- 172.21.15.114:0/1269860810 wait complete. 2023-10-18T14:03:02.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f8121b0d700 1 Processor -- start 2023-10-18T14:03:02.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f8121b0d700 1 -- start start 2023-10-18T14:03:02.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f8121b0d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f811c0ff6e0 0x7f811c19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:02.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f8121b0d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f811c1000a0 0x7f811c19be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f8121b0d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f811c1045b0 0x7f811c195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f8121b0d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c1960c0 con 0x7f811c1045b0 2023-10-18T14:03:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f8121b0d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c196230 con 0x7f811c0ff6e0 2023-10-18T14:03:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f8121b0d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c1963f0 con 0x7f811c1000a0 2023-10-18T14:03:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f811bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f811c1045b0 0x7f811c195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f811bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f811c1045b0 0x7f811c195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42772/0 (socket says 172.21.15.114:42772) 2023-10-18T14:03:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f811bfff700 1 -- 172.21.15.114:0/1990379448 learned_addr learned my addr 172.21.15.114:0/1990379448 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f811bfff700 1 -- 172.21.15.114:0/1990379448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f811c1000a0 msgr2=0x7f811c19be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f811bfff700 1 --2- 172.21.15.114:0/1990379448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f811c1000a0 0x7f811c19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f811bfff700 1 -- 172.21.15.114:0/1990379448 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f811c0ff6e0 msgr2=0x7f811c19b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f811b7fe700 1 --2- 172.21.15.114:0/1990379448 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f811c0ff6e0 0x7f811c19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:02.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f811bfff700 1 --2- 172.21.15.114:0/1990379448 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f811c0ff6e0 0x7f811c19b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f811bfff700 1 -- 172.21.15.114:0/1990379448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c0095f0 con 0x7f811c1045b0 2023-10-18T14:03:02.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.190+0000 7f811bfff700 1 --2- 172.21.15.114:0/1990379448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f811c1045b0 0x7f811c195a60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8114007f10 tx=0x7f811400f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:02.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.191+0000 7f8118ff9700 1 -- 172.21.15.114:0/1990379448 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114003c00 con 0x7f811c1045b0 2023-10-18T14:03:02.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.191+0000 7f8121b0d700 1 -- 172.21.15.114:0/1990379448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811c1966d0 con 0x7f811c1045b0 2023-10-18T14:03:02.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.191+0000 7f8118ff9700 1 -- 172.21.15.114:0/1990379448 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f811400fea0 con 0x7f811c1045b0 2023-10-18T14:03:02.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.191+0000 7f8118ff9700 1 -- 172.21.15.114:0/1990379448 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114012790 con 0x7f811c1045b0 2023-10-18T14:03:02.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.191+0000 7f8121b0d700 1 -- 172.21.15.114:0/1990379448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c068c10 con 0x7f811c1045b0 2023-10-18T14:03:02.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.191+0000 7f8121b0d700 1 -- 172.21.15.114:0/1990379448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f811c10f9a0 con 0x7f811c1045b0 2023-10-18T14:03:02.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.193+0000 7f8118ff9700 1 -- 172.21.15.114:0/1990379448 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f81140128f0 con 0x7f811c1045b0 2023-10-18T14:03:02.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.193+0000 7f8118ff9700 1 --2- 172.21.15.114:0/1990379448 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f81040a1560 0x7f81040a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:02.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.193+0000 7f811b7fe700 1 --2- 172.21.15.114:0/1990379448 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f81040a1560 0x7f81040a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:02.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.193+0000 7f8118ff9700 1 -- 172.21.15.114:0/1990379448 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f81140cf5e0 con 0x7f811c1045b0 2023-10-18T14:03:02.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.193+0000 7f8118ff9700 1 --2- 172.21.15.114:0/1990379448 >> [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640] conn(0x7f81040aaed0 0x7f81040ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:02.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.193+0000 7f8118ff9700 1 -- 172.21.15.114:0/1990379448 --> [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81040ad9a0 con 0x7f81040aaed0 2023-10-18T14:03:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.194+0000 7f8118ff9700 1 -- 172.21.15.114:0/1990379448 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81140cf9f0 con 0x7f811c1045b0 2023-10-18T14:03:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.194+0000 7f811b7fe700 1 --2- 172.21.15.114:0/1990379448 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f81040a1560 0x7f81040a3a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8110006fd0 tx=0x7f8110008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.194+0000 7f811affd700 1 --2- 172.21.15.114:0/1990379448 >> [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640] conn(0x7f81040aaed0 0x7f81040ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.194+0000 7f811affd700 1 --2- 172.21.15.114:0/1990379448 >> [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640] conn(0x7f81040aaed0 0x7f81040ad2f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:02.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.195+0000 7f8118ff9700 1 -- 172.21.15.114:0/1990379448 <== osd.8 v2:172.21.15.172:6816/881849640 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f81040ad9a0 con 0x7f81040aaed0 2023-10-18T14:03:02.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.211+0000 7f8121b0d700 1 -- 172.21.15.114:0/1990379448 --> [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f811c0690f0 con 0x7f81040aaed0 2023-10-18T14:03:02.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.212+0000 7f8118ff9700 1 -- 172.21.15.114:0/1990379448 <== osd.8 v2:172.21.15.172:6816/881849640 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f811c0690f0 con 0x7f81040aaed0 2023-10-18T14:03:02.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.212+0000 7f8121b0d700 1 -- 172.21.15.114:0/1990379448 >> [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640] conn(0x7f81040aaed0 msgr2=0x7f81040ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:02.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.212+0000 7f8121b0d700 1 --2- 172.21.15.114:0/1990379448 >> [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640] conn(0x7f81040aaed0 0x7f81040ad2f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.212+0000 7f8121b0d700 1 -- 172.21.15.114:0/1990379448 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f81040a1560 msgr2=0x7f81040a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:02.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.212+0000 7f8121b0d700 1 --2- 172.21.15.114:0/1990379448 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f81040a1560 0x7f81040a3a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8110006fd0 tx=0x7f8110008040 comp rx=0 tx=0).stop 2023-10-18T14:03:02.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.212+0000 7f8121b0d700 1 -- 172.21.15.114:0/1990379448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f811c1045b0 msgr2=0x7f811c195a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:02.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.212+0000 7f8121b0d700 1 --2- 172.21.15.114:0/1990379448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f811c1045b0 0x7f811c195a60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8114007f10 tx=0x7f811400f5c0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.212+0000 7f811bfff700 1 -- 172.21.15.114:0/1990379448 reap_dead start 2023-10-18T14:03:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.212+0000 7f8121b0d700 1 -- 172.21.15.114:0/1990379448 shutdown_connections 2023-10-18T14:03:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.212+0000 7f8121b0d700 1 -- 172.21.15.114:0/1990379448 >> 172.21.15.114:0/1990379448 conn(0x7f811c0766c0 msgr2=0x7f811c0fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.212+0000 7f8121b0d700 1 -- 172.21.15.114:0/1990379448 shutdown_connections 2023-10-18T14:03:02.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.212+0000 7f8121b0d700 1 -- 172.21.15.114:0/1990379448 wait complete. 2023-10-18T14:03:02.459 INFO:teuthology.orchestra.run.smithi114.stdout:279172874265 2023-10-18T14:03:02.459 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-18T14:03:02.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.549+0000 7f76d4a3a700 1 -- 172.21.15.114:0/4197100696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76d0073340 msgr2=0x7f76d010cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:02.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.549+0000 7f76d4a3a700 1 --2- 172.21.15.114:0/4197100696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76d0073340 0x7f76d010cd10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009990 tx=0x7f76c4009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.549+0000 7f76d4a3a700 1 -- 172.21.15.114:0/4197100696 shutdown_connections 2023-10-18T14:03:02.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.549+0000 7f76d4a3a700 1 --2- 172.21.15.114:0/4197100696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76d010d250 0x7f76d010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.549+0000 7f76d4a3a700 1 --2- 172.21.15.114:0/4197100696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f76d0072a20 0x7f76d0072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.549+0000 7f76d4a3a700 1 --2- 172.21.15.114:0/4197100696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76d0073340 0x7f76d010cd10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.549+0000 7f76d4a3a700 1 -- 172.21.15.114:0/4197100696 >> 172.21.15.114:0/4197100696 conn(0x7f76d00779e0 msgr2=0x7f76d0077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:02.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.549+0000 7f76d4a3a700 1 -- 172.21.15.114:0/4197100696 shutdown_connections 2023-10-18T14:03:02.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.549+0000 7f76d4a3a700 1 -- 172.21.15.114:0/4197100696 wait complete. 2023-10-18T14:03:02.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.550+0000 7f76d4a3a700 1 Processor -- start 2023-10-18T14:03:02.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.550+0000 7f76d4a3a700 1 -- start start 2023-10-18T14:03:02.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76d4a3a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f76d0072a20 0x7f76d0198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:02.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76d4a3a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76d0073340 0x7f76d0199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:02.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76d4a3a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76d010d250 0x7f76d019d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:02.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76d4a3a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d019ddf0 con 0x7f76d010d250 2023-10-18T14:03:02.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76d4a3a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d019df60 con 0x7f76d0072a20 2023-10-18T14:03:02.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76d4a3a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d019e120 con 0x7f76d0073340 2023-10-18T14:03:02.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76ced9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76d010d250 0x7f76d019d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:02.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76ced9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76d010d250 0x7f76d019d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42788/0 (socket says 172.21.15.114:42788) 2023-10-18T14:03:02.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76ced9d700 1 -- 172.21.15.114:0/755910763 learned_addr learned my addr 172.21.15.114:0/755910763 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:02.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76ce59c700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f76d0072a20 0x7f76d0198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:02.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76ced9d700 1 -- 172.21.15.114:0/755910763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76d0073340 msgr2=0x7f76d0199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:02.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76cdd9b700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76d0073340 0x7f76d0199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:02.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76ced9d700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76d0073340 0x7f76d0199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76ced9d700 1 -- 172.21.15.114:0/755910763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f76d0072a20 msgr2=0x7f76d0198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:02.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76ced9d700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f76d0072a20 0x7f76d0198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76ced9d700 1 -- 172.21.15.114:0/755910763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c40095f0 con 0x7f76d010d250 2023-10-18T14:03:02.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76ce59c700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f76d0072a20 0x7f76d0198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:02.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76ced9d700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76d010d250 0x7f76d019d7e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f76c8007ee0 tx=0x7f76c800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:02.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76bf7fe700 1 -- 172.21.15.114:0/755910763 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c800ddd0 con 0x7f76d010d250 2023-10-18T14:03:02.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76d4a3a700 1 -- 172.21.15.114:0/755910763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d019e400 con 0x7f76d010d250 2023-10-18T14:03:02.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76bf7fe700 1 -- 172.21.15.114:0/755910763 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76c800f040 con 0x7f76d010d250 2023-10-18T14:03:02.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76bf7fe700 1 -- 172.21.15.114:0/755910763 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c8005a40 con 0x7f76d010d250 2023-10-18T14:03:02.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.551+0000 7f76d4a3a700 1 -- 172.21.15.114:0/755910763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d01a5c60 con 0x7f76d010d250 2023-10-18T14:03:02.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.552+0000 7f76d4a3a700 1 -- 172.21.15.114:0/755910763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76d0112ca0 con 0x7f76d010d250 2023-10-18T14:03:02.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.554+0000 7f76bf7fe700 1 -- 172.21.15.114:0/755910763 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f76c8004ad0 con 0x7f76d010d250 2023-10-18T14:03:02.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.554+0000 7f76bf7fe700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76b80a1560 0x7f76b80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:02.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.554+0000 7f76ce59c700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76b80a1560 0x7f76b80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:02.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.554+0000 7f76bf7fe700 1 -- 172.21.15.114:0/755910763 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f76c80cd340 con 0x7f76d010d250 2023-10-18T14:03:02.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.554+0000 7f76bf7fe700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303] conn(0x7f76b80aaed0 0x7f76b80ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:02.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.554+0000 7f76bf7fe700 1 -- 172.21.15.114:0/755910763 --> [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76b80ad9a0 con 0x7f76b80aaed0 2023-10-18T14:03:02.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.554+0000 7f76bf7fe700 1 -- 172.21.15.114:0/755910763 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76c80cd750 con 0x7f76d010d250 2023-10-18T14:03:02.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.555+0000 7f76ce59c700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76b80a1560 0x7f76b80a3a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f76c0005950 tx=0x7f76c0005f50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:02.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.555+0000 7f76cdd9b700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303] conn(0x7f76b80aaed0 0x7f76b80ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:02.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.555+0000 7f76cdd9b700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303] conn(0x7f76b80aaed0 0x7f76b80ad2f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:02.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.556+0000 7f76bf7fe700 1 -- 172.21.15.114:0/755910763 <== osd.7 v2:172.21.15.158:6816/1215333303 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f76b80ad9a0 con 0x7f76b80aaed0 2023-10-18T14:03:02.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.572+0000 7f76d4a3a700 1 -- 172.21.15.114:0/755910763 --> [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76d00740b0 con 0x7f76b80aaed0 2023-10-18T14:03:02.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.573+0000 7f76bf7fe700 1 -- 172.21.15.114:0/755910763 <== osd.7 v2:172.21.15.158:6816/1215333303 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f76d00740b0 con 0x7f76b80aaed0 2023-10-18T14:03:02.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.573+0000 7f76d4a3a700 1 -- 172.21.15.114:0/755910763 >> [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303] conn(0x7f76b80aaed0 msgr2=0x7f76b80ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:02.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.573+0000 7f76d4a3a700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303] conn(0x7f76b80aaed0 0x7f76b80ad2f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.573+0000 7f76d4a3a700 1 -- 172.21.15.114:0/755910763 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76b80a1560 msgr2=0x7f76b80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:02.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.573+0000 7f76d4a3a700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76b80a1560 0x7f76b80a3a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f76c0005950 tx=0x7f76c0005f50 comp rx=0 tx=0).stop 2023-10-18T14:03:02.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.573+0000 7f76d4a3a700 1 -- 172.21.15.114:0/755910763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76d010d250 msgr2=0x7f76d019d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:02.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.573+0000 7f76d4a3a700 1 --2- 172.21.15.114:0/755910763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76d010d250 0x7f76d019d7e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f76c8007ee0 tx=0x7f76c800d3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:02.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.573+0000 7f76ced9d700 1 -- 172.21.15.114:0/755910763 reap_dead start 2023-10-18T14:03:02.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.574+0000 7f76d4a3a700 1 -- 172.21.15.114:0/755910763 shutdown_connections 2023-10-18T14:03:02.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.574+0000 7f76d4a3a700 1 -- 172.21.15.114:0/755910763 >> 172.21.15.114:0/755910763 conn(0x7f76d00779e0 msgr2=0x7f76d00fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:02.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.574+0000 7f76d4a3a700 1 -- 172.21.15.114:0/755910763 shutdown_connections 2023-10-18T14:03:02.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:02.574+0000 7f76d4a3a700 1 -- 172.21.15.114:0/755910763 wait complete. 2023-10-18T14:03:02.794 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:02 smithi114 ceph-mon[99494]: pgmap v248: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-10-18T14:03:02.949 INFO:teuthology.orchestra.run.smithi114.stdout:300647710740 2023-10-18T14:03:02.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-18T14:03:03.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:02 smithi158 ceph-mon[103317]: pgmap v248: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-10-18T14:03:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.032+0000 7f690a8d6700 1 -- 172.21.15.114:0/702980835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69041008a0 msgr2=0x7f6904100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.032+0000 7f690a8d6700 1 --2- 172.21.15.114:0/702980835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69041008a0 0x7f6904100d20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009990 tx=0x7f68f8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:03.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.032+0000 7f690a8d6700 1 -- 172.21.15.114:0/702980835 shutdown_connections 2023-10-18T14:03:03.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.032+0000 7f690a8d6700 1 --2- 172.21.15.114:0/702980835 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6904101260 0x7f690410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:03.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.032+0000 7f690a8d6700 1 --2- 172.21.15.114:0/702980835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69041057c0 0x7f6904105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:03.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.032+0000 7f690a8d6700 1 --2- 172.21.15.114:0/702980835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69041008a0 0x7f6904100d20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:03.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.032+0000 7f690a8d6700 1 -- 172.21.15.114:0/702980835 >> 172.21.15.114:0/702980835 conn(0x7f69040779e0 msgr2=0x7f6904077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:03.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.032+0000 7f690a8d6700 1 -- 172.21.15.114:0/702980835 shutdown_connections 2023-10-18T14:03:03.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.032+0000 7f690a8d6700 1 -- 172.21.15.114:0/702980835 wait complete. 2023-10-18T14:03:03.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.033+0000 7f690a8d6700 1 Processor -- start 2023-10-18T14:03:03.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.033+0000 7f690a8d6700 1 -- start start 2023-10-18T14:03:03.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.033+0000 7f690a8d6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69041008a0 0x7f6904196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:03.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.033+0000 7f690a8d6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6904101260 0x7f6904197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.033+0000 7f690a8d6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69041057c0 0x7f690419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.033+0000 7f690a8d6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690419ab40 con 0x7f6904101260 2023-10-18T14:03:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.033+0000 7f690a8d6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690419acb0 con 0x7f69041008a0 2023-10-18T14:03:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.033+0000 7f690a8d6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690419ae70 con 0x7f69041057c0 2023-10-18T14:03:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.033+0000 7f69037fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6904101260 0x7f6904197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:03.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.033+0000 7f69037fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6904101260 0x7f6904197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42802/0 (socket says 172.21.15.114:42802) 2023-10-18T14:03:03.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f69037fe700 1 -- 172.21.15.114:0/1607679233 learned_addr learned my addr 172.21.15.114:0/1607679233 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:03.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f6908e73700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69041057c0 0x7f690419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:03.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f6903fff700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69041008a0 0x7f6904196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:03.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f69037fe700 1 -- 172.21.15.114:0/1607679233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69041057c0 msgr2=0x7f690419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:03.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f69037fe700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69041057c0 0x7f690419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:03.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f69037fe700 1 -- 172.21.15.114:0/1607679233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69041008a0 msgr2=0x7f6904196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:03.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f69037fe700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f69041008a0 0x7f6904196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:03.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f69037fe700 1 -- 172.21.15.114:0/1607679233 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f80095f0 con 0x7f6904101260 2023-10-18T14:03:03.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f69037fe700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6904101260 0x7f6904197240 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f68f8000c00 tx=0x7f68f800f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:03.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f69017fa700 1 -- 172.21.15.114:0/1607679233 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f801d070 con 0x7f6904101260 2023-10-18T14:03:03.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f69017fa700 1 -- 172.21.15.114:0/1607679233 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68f800fd30 con 0x7f6904101260 2023-10-18T14:03:03.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f690a8d6700 1 -- 172.21.15.114:0/1607679233 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690419b0f0 con 0x7f6904101260 2023-10-18T14:03:03.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f69017fa700 1 -- 172.21.15.114:0/1607679233 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f8017630 con 0x7f6904101260 2023-10-18T14:03:03.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.034+0000 7f690a8d6700 1 -- 172.21.15.114:0/1607679233 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690419b3c0 con 0x7f6904101260 2023-10-18T14:03:03.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.035+0000 7f68eaffd700 1 -- 172.21.15.114:0/1607679233 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68e4000fc0 con 0x7f6904101260 2023-10-18T14:03:03.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.036+0000 7f69017fa700 1 -- 172.21.15.114:0/1607679233 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f68f8017790 con 0x7f6904101260 2023-10-18T14:03:03.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.037+0000 7f69017fa700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f68ec0a1560 0x7f68ec0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:03.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.037+0000 7f6903fff700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f68ec0a1560 0x7f68ec0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:03.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.037+0000 7f69017fa700 1 -- 172.21.15.114:0/1607679233 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f68f80ce7d0 con 0x7f6904101260 2023-10-18T14:03:03.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.037+0000 7f69017fa700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851] conn(0x7f68ec0aaed0 0x7f68ec0ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:03.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.037+0000 7f69017fa700 1 -- 172.21.15.114:0/1607679233 --> [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68ec0ad9a0 con 0x7f68ec0aaed0 2023-10-18T14:03:03.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.037+0000 7f69017fa700 1 -- 172.21.15.114:0/1607679233 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68f80cebe0 con 0x7f6904101260 2023-10-18T14:03:03.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.037+0000 7f6903fff700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f68ec0a1560 0x7f68ec0a3a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f68f4006fd0 tx=0x7f68f4008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:03.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.038+0000 7f6908e73700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851] conn(0x7f68ec0aaed0 0x7f68ec0ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:03.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.038+0000 7f6908e73700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851] conn(0x7f68ec0aaed0 0x7f68ec0ad2f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:03.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.039+0000 7f69017fa700 1 -- 172.21.15.114:0/1607679233 <== osd.4 v2:172.21.15.158:6808/1567841851 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f68ec0ad9a0 con 0x7f68ec0aaed0 2023-10-18T14:03:03.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.055+0000 7f68eaffd700 1 -- 172.21.15.114:0/1607679233 --> [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f68e4002d40 con 0x7f68ec0aaed0 2023-10-18T14:03:03.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.055+0000 7f69017fa700 1 -- 172.21.15.114:0/1607679233 <== osd.4 v2:172.21.15.158:6808/1567841851 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f68e4002d40 con 0x7f68ec0aaed0 2023-10-18T14:03:03.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.056+0000 7f68eaffd700 1 -- 172.21.15.114:0/1607679233 >> [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851] conn(0x7f68ec0aaed0 msgr2=0x7f68ec0ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:03.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.056+0000 7f68eaffd700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851] conn(0x7f68ec0aaed0 0x7f68ec0ad2f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:03.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.056+0000 7f68eaffd700 1 -- 172.21.15.114:0/1607679233 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f68ec0a1560 msgr2=0x7f68ec0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.056+0000 7f68eaffd700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f68ec0a1560 0x7f68ec0a3a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f68f4006fd0 tx=0x7f68f4008040 comp rx=0 tx=0).stop 2023-10-18T14:03:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.056+0000 7f68eaffd700 1 -- 172.21.15.114:0/1607679233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6904101260 msgr2=0x7f6904197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.056+0000 7f68eaffd700 1 --2- 172.21.15.114:0/1607679233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6904101260 0x7f6904197240 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f68f8000c00 tx=0x7f68f800f7d0 comp rx=0 tx=0).stop 2023-10-18T14:03:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.056+0000 7f6908e73700 1 -- 172.21.15.114:0/1607679233 reap_dead start 2023-10-18T14:03:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.056+0000 7f68eaffd700 1 -- 172.21.15.114:0/1607679233 shutdown_connections 2023-10-18T14:03:03.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.056+0000 7f68eaffd700 1 -- 172.21.15.114:0/1607679233 >> 172.21.15.114:0/1607679233 conn(0x7f69040779e0 msgr2=0x7f69040fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:03.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.056+0000 7f68eaffd700 1 -- 172.21.15.114:0/1607679233 shutdown_connections 2023-10-18T14:03:03.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:03.056+0000 7f68eaffd700 1 -- 172.21.15.114:0/1607679233 wait complete. 2023-10-18T14:03:03.063 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:02 smithi172 ceph-mon[103574]: pgmap v248: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-10-18T14:03:03.287 INFO:teuthology.orchestra.run.smithi114.stdout:335007449105 2023-10-18T14:03:03.288 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-18T14:03:03.297 INFO:teuthology.orchestra.run.smithi114.stdout:249108103197 2023-10-18T14:03:03.297 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-18T14:03:03.640 INFO:teuthology.orchestra.run.smithi114.stdout:219043332130 2023-10-18T14:03:03.640 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-18T14:03:04.332 INFO:teuthology.orchestra.run.smithi114.stdout:146028888111 2023-10-18T14:03:04.332 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-18T14:03:04.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.418+0000 7fb609027700 1 -- 172.21.15.114:0/585386696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb604100110 msgr2=0x7fb60410c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:04.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.418+0000 7fb609027700 1 --2- 172.21.15.114:0/585386696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb604100110 0x7fb60410c580 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00b0a0 tx=0x7fb5fc00b3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.418+0000 7fb609027700 1 -- 172.21.15.114:0/585386696 shutdown_connections 2023-10-18T14:03:04.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.418+0000 7fb609027700 1 --2- 172.21.15.114:0/585386696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb604100110 0x7fb60410c580 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.418+0000 7fb609027700 1 --2- 172.21.15.114:0/585386696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6041056b0 0x7fb604105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.419+0000 7fb609027700 1 --2- 172.21.15.114:0/585386696 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6040ff750 0x7fb6040ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.419+0000 7fb609027700 1 -- 172.21.15.114:0/585386696 >> 172.21.15.114:0/585386696 conn(0x7fb604075790 msgr2=0x7fb604075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:04.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.419+0000 7fb609027700 1 -- 172.21.15.114:0/585386696 shutdown_connections 2023-10-18T14:03:04.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.419+0000 7fb609027700 1 -- 172.21.15.114:0/585386696 wait complete. 2023-10-18T14:03:04.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.419+0000 7fb609027700 1 Processor -- start 2023-10-18T14:03:04.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb609027700 1 -- start start 2023-10-18T14:03:04.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb609027700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6040ff750 0x7fb60419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:04.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb609027700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb604100110 0x7fb60419bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:04.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb609027700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6041056b0 0x7fb604195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:04.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb609027700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb604196180 con 0x7fb6041056b0 2023-10-18T14:03:04.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb609027700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6041962f0 con 0x7fb604100110 2023-10-18T14:03:04.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb609027700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6041964b0 con 0x7fb6040ff750 2023-10-18T14:03:04.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb60359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6041056b0 0x7fb604195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:04.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb60359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6041056b0 0x7fb604195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42818/0 (socket says 172.21.15.114:42818) 2023-10-18T14:03:04.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb60359e700 1 -- 172.21.15.114:0/2508515089 learned_addr learned my addr 172.21.15.114:0/2508515089 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:04.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb602d9d700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6040ff750 0x7fb60419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb60259c700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb604100110 0x7fb60419bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb60359e700 1 -- 172.21.15.114:0/2508515089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6040ff750 msgr2=0x7fb60419b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb60359e700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6040ff750 0x7fb60419b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb60359e700 1 -- 172.21.15.114:0/2508515089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb604100110 msgr2=0x7fb60419bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb60359e700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb604100110 0x7fb60419bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.420+0000 7fb60359e700 1 -- 172.21.15.114:0/2508515089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc009d00 con 0x7fb6041056b0 2023-10-18T14:03:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.421+0000 7fb60359e700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6041056b0 0x7fb604195b20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00b830 tx=0x7fb5fc0077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.421+0000 7fb5ebfff700 1 -- 172.21.15.114:0/2508515089 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00e040 con 0x7fb6041056b0 2023-10-18T14:03:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.421+0000 7fb609027700 1 -- 172.21.15.114:0/2508515089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb604196730 con 0x7fb6041056b0 2023-10-18T14:03:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.421+0000 7fb5ebfff700 1 -- 172.21.15.114:0/2508515089 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5fc004e60 con 0x7fb6041056b0 2023-10-18T14:03:04.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.421+0000 7fb5ebfff700 1 -- 172.21.15.114:0/2508515089 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0053c0 con 0x7fb6041056b0 2023-10-18T14:03:04.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.421+0000 7fb609027700 1 -- 172.21.15.114:0/2508515089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6041a29d0 con 0x7fb6041056b0 2023-10-18T14:03:04.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.422+0000 7fb609027700 1 -- 172.21.15.114:0/2508515089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb604100df0 con 0x7fb6041056b0 2023-10-18T14:03:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.423+0000 7fb5ebfff700 1 -- 172.21.15.114:0/2508515089 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fb5fc01b450 con 0x7fb6041056b0 2023-10-18T14:03:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.423+0000 7fb5ebfff700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb5ec0a1560 0x7fb5ec0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.424+0000 7fb602d9d700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb5ec0a1560 0x7fb5ec0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.424+0000 7fb5ebfff700 1 -- 172.21.15.114:0/2508515089 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fb5fc0ceee0 con 0x7fb6041056b0 2023-10-18T14:03:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.424+0000 7fb5ebfff700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113] conn(0x7fb5ec0aaed0 0x7fb5ec0ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.424+0000 7fb5ebfff700 1 -- 172.21.15.114:0/2508515089 --> [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5ec0ad9a0 con 0x7fb5ec0aaed0 2023-10-18T14:03:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.424+0000 7fb5ebfff700 1 -- 172.21.15.114:0/2508515089 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5fc0cf2f0 con 0x7fb6041056b0 2023-10-18T14:03:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.424+0000 7fb602d9d700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb5ec0a1560 0x7fb5ec0a3a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009a10 tx=0x7fb5f4009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.424+0000 7fb60259c700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113] conn(0x7fb5ec0aaed0 0x7fb5ec0ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.425+0000 7fb60259c700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113] conn(0x7fb5ec0aaed0 0x7fb5ec0ad2f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.425+0000 7fb5ebfff700 1 -- 172.21.15.114:0/2508515089 <== osd.2 v2:172.21.15.172:6800/4209325113 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb5ec0ad9a0 con 0x7fb5ec0aaed0 2023-10-18T14:03:04.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.444+0000 7fb609027700 1 -- 172.21.15.114:0/2508515089 --> [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb604060e70 con 0x7fb5ec0aaed0 2023-10-18T14:03:04.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.445+0000 7fb5ebfff700 1 -- 172.21.15.114:0/2508515089 <== osd.2 v2:172.21.15.172:6800/4209325113 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb604060e70 con 0x7fb5ec0aaed0 2023-10-18T14:03:04.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.445+0000 7fb609027700 1 -- 172.21.15.114:0/2508515089 >> [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113] conn(0x7fb5ec0aaed0 msgr2=0x7fb5ec0ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:04.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.445+0000 7fb609027700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113] conn(0x7fb5ec0aaed0 0x7fb5ec0ad2f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.446+0000 7fb609027700 1 -- 172.21.15.114:0/2508515089 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb5ec0a1560 msgr2=0x7fb5ec0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:04.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.446+0000 7fb609027700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb5ec0a1560 0x7fb5ec0a3a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009a10 tx=0x7fb5f4009190 comp rx=0 tx=0).stop 2023-10-18T14:03:04.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.446+0000 7fb609027700 1 -- 172.21.15.114:0/2508515089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6041056b0 msgr2=0x7fb604195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:04.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.446+0000 7fb609027700 1 --2- 172.21.15.114:0/2508515089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6041056b0 0x7fb604195b20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00b830 tx=0x7fb5fc0077f0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.446+0000 7fb60359e700 1 -- 172.21.15.114:0/2508515089 reap_dead start 2023-10-18T14:03:04.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.446+0000 7fb609027700 1 -- 172.21.15.114:0/2508515089 shutdown_connections 2023-10-18T14:03:04.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.447+0000 7fb609027700 1 -- 172.21.15.114:0/2508515089 >> 172.21.15.114:0/2508515089 conn(0x7fb604075790 msgr2=0x7fb6040fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:04.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.447+0000 7fb609027700 1 -- 172.21.15.114:0/2508515089 shutdown_connections 2023-10-18T14:03:04.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.447+0000 7fb609027700 1 -- 172.21.15.114:0/2508515089 wait complete. 2023-10-18T14:03:04.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:04 smithi172 ceph-mon[103574]: pgmap v249: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-18T14:03:04.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:04 smithi114 ceph-mon[99494]: pgmap v249: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-18T14:03:04.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.685+0000 7f97f26d4700 1 -- 172.21.15.114:0/3138973519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec0ffb30 msgr2=0x7f97ec10d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:04.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.685+0000 7f97f26d4700 1 --2- 172.21.15.114:0/3138973519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec0ffb30 0x7f97ec10d5c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f97e400b0a0 tx=0x7f97e400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.685+0000 7f97f26d4700 1 -- 172.21.15.114:0/3138973519 shutdown_connections 2023-10-18T14:03:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.685+0000 7f97f26d4700 1 --2- 172.21.15.114:0/3138973519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec0ffb30 0x7f97ec10d5c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.685+0000 7f97f26d4700 1 --2- 172.21.15.114:0/3138973519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97ec1058d0 0x7f97ec105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.685+0000 7f97f26d4700 1 --2- 172.21.15.114:0/3138973519 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97ec0ff190 0x7f97ec0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.685+0000 7f97f26d4700 1 -- 172.21.15.114:0/3138973519 >> 172.21.15.114:0/3138973519 conn(0x7f97ec074a10 msgr2=0x7f97ec074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:04.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.685+0000 7f97f26d4700 1 -- 172.21.15.114:0/3138973519 shutdown_connections 2023-10-18T14:03:04.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.685+0000 7f97f26d4700 1 -- 172.21.15.114:0/3138973519 wait complete. 2023-10-18T14:03:04.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.686+0000 7f97f26d4700 1 Processor -- start 2023-10-18T14:03:04.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.686+0000 7f97f26d4700 1 -- start start 2023-10-18T14:03:04.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.686+0000 7f97f26d4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec0ff190 0x7f97ec100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:04.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.686+0000 7f97f26d4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97ec0ffb30 0x7f97ec1008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:04.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.686+0000 7f97f26d4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97ec1058d0 0x7f97ec100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:04.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.686+0000 7f97f26d4700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1a50b0 con 0x7f97ec0ff190 2023-10-18T14:03:04.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.686+0000 7f97f26d4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1a5220 con 0x7f97ec1058d0 2023-10-18T14:03:04.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.686+0000 7f97f26d4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1a53e0 con 0x7f97ec0ffb30 2023-10-18T14:03:04.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec0ff190 0x7f97ec100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:04.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec0ff190 0x7f97ec100370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42830/0 (socket says 172.21.15.114:42830) 2023-10-18T14:03:04.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97ebfff700 1 -- 172.21.15.114:0/1973228860 learned_addr learned my addr 172.21.15.114:0/1973228860 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:04.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97f0c71700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97ec1058d0 0x7f97ec100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:04.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97eb7fe700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97ec0ffb30 0x7f97ec1008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:04.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97ebfff700 1 -- 172.21.15.114:0/1973228860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97ec0ffb30 msgr2=0x7f97ec1008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:04.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97ebfff700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97ec0ffb30 0x7f97ec1008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97ebfff700 1 -- 172.21.15.114:0/1973228860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97ec1058d0 msgr2=0x7f97ec100df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:04.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97ebfff700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f97ec1058d0 0x7f97ec100df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97ebfff700 1 -- 172.21.15.114:0/1973228860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4009d00 con 0x7f97ec0ff190 2023-10-18T14:03:04.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97ebfff700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec0ff190 0x7f97ec100370 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00c990 tx=0x7f97dc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:04.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97e97fa700 1 -- 172.21.15.114:0/1973228860 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc007940 con 0x7f97ec0ff190 2023-10-18T14:03:04.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97e97fa700 1 -- 172.21.15.114:0/1973228860 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97dc00f450 con 0x7f97ec0ff190 2023-10-18T14:03:04.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97f26d4700 1 -- 172.21.15.114:0/1973228860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ec1a56c0 con 0x7f97ec0ff190 2023-10-18T14:03:04.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97e97fa700 1 -- 172.21.15.114:0/1973228860 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc018660 con 0x7f97ec0ff190 2023-10-18T14:03:04.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.687+0000 7f97f26d4700 1 -- 172.21.15.114:0/1973228860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec1a5bc0 con 0x7f97ec0ff190 2023-10-18T14:03:04.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.688+0000 7f97f26d4700 1 -- 172.21.15.114:0/1973228860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97ec110a50 con 0x7f97ec0ff190 2023-10-18T14:03:04.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.689+0000 7f97e97fa700 1 -- 172.21.15.114:0/1973228860 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f97dc00f8c0 con 0x7f97ec0ff190 2023-10-18T14:03:04.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.690+0000 7f97e97fa700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f97d40a1560 0x7f97d40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:04.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.690+0000 7f97eb7fe700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f97d40a1560 0x7f97d40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:04.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.690+0000 7f97e97fa700 1 -- 172.21.15.114:0/1973228860 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f97dc0ccff0 con 0x7f97ec0ff190 2023-10-18T14:03:04.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.690+0000 7f97e97fa700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344] conn(0x7f97d40aaed0 0x7f97d40ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:04.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.690+0000 7f97e97fa700 1 -- 172.21.15.114:0/1973228860 --> [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97d40ad9a0 con 0x7f97d40aaed0 2023-10-18T14:03:04.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.690+0000 7f97e97fa700 1 -- 172.21.15.114:0/1973228860 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97dc0cd400 con 0x7f97ec0ff190 2023-10-18T14:03:04.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.690+0000 7f97f0c71700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344] conn(0x7f97d40aaed0 0x7f97d40ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:04.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.690+0000 7f97eb7fe700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f97d40a1560 0x7f97d40a3a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f97ec101a50 tx=0x7f97e000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:04.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.690+0000 7f97f0c71700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344] conn(0x7f97d40aaed0 0x7f97d40ad2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:04.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.691+0000 7f97e97fa700 1 -- 172.21.15.114:0/1973228860 <== osd.0 v2:172.21.15.114:6802/3519372344 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f97d40ad9a0 con 0x7f97d40aaed0 2023-10-18T14:03:04.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.707+0000 7f97f26d4700 1 -- 172.21.15.114:0/1973228860 --> [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f97ec067c30 con 0x7f97d40aaed0 2023-10-18T14:03:04.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.707+0000 7f97e97fa700 1 -- 172.21.15.114:0/1973228860 <== osd.0 v2:172.21.15.114:6802/3519372344 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f97ec067c30 con 0x7f97d40aaed0 2023-10-18T14:03:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.707+0000 7f97f26d4700 1 -- 172.21.15.114:0/1973228860 >> [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344] conn(0x7f97d40aaed0 msgr2=0x7f97d40ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.707+0000 7f97f26d4700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344] conn(0x7f97d40aaed0 0x7f97d40ad2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.707+0000 7f97f26d4700 1 -- 172.21.15.114:0/1973228860 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f97d40a1560 msgr2=0x7f97d40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.707+0000 7f97f26d4700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f97d40a1560 0x7f97d40a3a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f97ec101a50 tx=0x7f97e000b410 comp rx=0 tx=0).stop 2023-10-18T14:03:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.707+0000 7f97f26d4700 1 -- 172.21.15.114:0/1973228860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec0ff190 msgr2=0x7f97ec100370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:04.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.707+0000 7f97f26d4700 1 --2- 172.21.15.114:0/1973228860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ec0ff190 0x7f97ec100370 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00c990 tx=0x7f97dc00cca0 comp rx=0 tx=0).stop 2023-10-18T14:03:04.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.707+0000 7f97f0c71700 1 -- 172.21.15.114:0/1973228860 reap_dead start 2023-10-18T14:03:04.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.707+0000 7f97f26d4700 1 -- 172.21.15.114:0/1973228860 shutdown_connections 2023-10-18T14:03:04.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.707+0000 7f97f26d4700 1 -- 172.21.15.114:0/1973228860 >> 172.21.15.114:0/1973228860 conn(0x7f97ec074a10 msgr2=0x7f97ec0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:04.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.707+0000 7f97f26d4700 1 -- 172.21.15.114:0/1973228860 shutdown_connections 2023-10-18T14:03:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:04.707+0000 7f97f26d4700 1 -- 172.21.15.114:0/1973228860 wait complete. 2023-10-18T14:03:04.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:04 smithi158 ceph-mon[103317]: pgmap v249: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-18T14:03:05.244 INFO:teuthology.orchestra.run.smithi114.stdout:38654705727 2023-10-18T14:03:05.245 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-18T14:03:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:05.371 INFO:teuthology.orchestra.run.smithi114.stdout:81604378680 2023-10-18T14:03:05.371 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-18T14:03:05.404 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:05.708 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:05.734 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:06.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.311+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/2028212257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b780ff820 msgr2=0x7f4b780ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:06.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.311+0000 7f4b7e5a2700 1 --2- 172.21.15.114:0/2028212257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b780ff820 0x7f4b780ffc00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009990 tx=0x7f4b74009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:06.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.311+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/2028212257 shutdown_connections 2023-10-18T14:03:06.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.311+0000 7f4b7e5a2700 1 --2- 172.21.15.114:0/2028212257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b781017f0 0x7f4b7810c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.311+0000 7f4b7e5a2700 1 --2- 172.21.15.114:0/2028212257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b780ff820 0x7f4b780ffc00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.311+0000 7f4b7e5a2700 1 --2- 172.21.15.114:0/2028212257 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b78100140 0x7f4b781010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.311+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/2028212257 >> 172.21.15.114:0/2028212257 conn(0x7f4b780fb030 msgr2=0x7f4b780fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.311+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/2028212257 shutdown_connections 2023-10-18T14:03:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.311+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/2028212257 wait complete. 2023-10-18T14:03:06.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7e5a2700 1 Processor -- start 2023-10-18T14:03:06.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7e5a2700 1 -- start start 2023-10-18T14:03:06.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7e5a2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b780ff820 0x7f4b7819b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:06.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7e5a2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b78100140 0x7f4b7819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:06.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7e5a2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b781017f0 0x7f4b78195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:06.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7e5a2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78195e90 con 0x7f4b78100140 2023-10-18T14:03:06.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7e5a2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78196000 con 0x7f4b781017f0 2023-10-18T14:03:06.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7e5a2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b781961c0 con 0x7f4b780ff820 2023-10-18T14:03:06.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7cd9f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b78100140 0x7f4b7819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:06.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7cd9f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b78100140 0x7f4b7819bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42846/0 (socket says 172.21.15.114:42846) 2023-10-18T14:03:06.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7cd9f700 1 -- 172.21.15.114:0/3428072613 learned_addr learned my addr 172.21.15.114:0/3428072613 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:06.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7d5a0700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b780ff820 0x7f4b7819b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:06.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7cd9f700 1 -- 172.21.15.114:0/3428072613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b780ff820 msgr2=0x7f4b7819b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:06.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7cd9f700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b780ff820 0x7f4b7819b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:06.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7cd9f700 1 -- 172.21.15.114:0/3428072613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b781017f0 msgr2=0x7f4b78195820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:06.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7cd9f700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b781017f0 0x7f4b78195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:06.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7cd9f700 1 -- 172.21.15.114:0/3428072613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740095f0 con 0x7f4b78100140 2023-10-18T14:03:06.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.312+0000 7f4b7d5a0700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b780ff820 0x7f4b7819b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:06.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.313+0000 7f4b7cd9f700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b78100140 0x7f4b7819bc20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4b68007b50 tx=0x7f4b68007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:06.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.313+0000 7f4b6e7fc700 1 -- 172.21.15.114:0/3428072613 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68011070 con 0x7f4b78100140 2023-10-18T14:03:06.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.313+0000 7f4b6e7fc700 1 -- 172.21.15.114:0/3428072613 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b6800c2e0 con 0x7f4b78100140 2023-10-18T14:03:06.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.313+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/3428072613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b781964a0 con 0x7f4b78100140 2023-10-18T14:03:06.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.313+0000 7f4b6e7fc700 1 -- 172.21.15.114:0/3428072613 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6800a9e0 con 0x7f4b78100140 2023-10-18T14:03:06.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.313+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/3428072613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b78068360 con 0x7f4b78100140 2023-10-18T14:03:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.314+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/3428072613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b7810f800 con 0x7f4b78100140 2023-10-18T14:03:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.315+0000 7f4b6e7fc700 1 -- 172.21.15.114:0/3428072613 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f4b6800ec20 con 0x7f4b78100140 2023-10-18T14:03:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.315+0000 7f4b6e7fc700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4b640a15e0 0x7f4b640a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.316+0000 7f4b7d5a0700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4b640a15e0 0x7f4b640a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.316+0000 7f4b6e7fc700 1 -- 172.21.15.114:0/3428072613 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f4b680ce830 con 0x7f4b78100140 2023-10-18T14:03:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.316+0000 7f4b6e7fc700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982] conn(0x7f4b640aaf50 0x7f4b640ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.316+0000 7f4b6e7fc700 1 -- 172.21.15.114:0/3428072613 --> [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b640ada20 con 0x7f4b640aaf50 2023-10-18T14:03:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.316+0000 7f4b6e7fc700 1 -- 172.21.15.114:0/3428072613 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b680cec40 con 0x7f4b78100140 2023-10-18T14:03:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.316+0000 7f4b7dda1700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982] conn(0x7f4b640aaf50 0x7f4b640ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.316+0000 7f4b7d5a0700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4b640a15e0 0x7f4b640a3aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400b2e0 tx=0x7f4b74005e80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.316+0000 7f4b7dda1700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982] conn(0x7f4b640aaf50 0x7f4b640ad370 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.317+0000 7f4b6e7fc700 1 -- 172.21.15.114:0/3428072613 <== osd.6 v2:172.21.15.114:6818/3292046982 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4b640ada20 con 0x7f4b640aaf50 2023-10-18T14:03:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.334+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/3428072613 --> [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4b780687c0 con 0x7f4b640aaf50 2023-10-18T14:03:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.335+0000 7f4b6e7fc700 1 -- 172.21.15.114:0/3428072613 <== osd.6 v2:172.21.15.114:6818/3292046982 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4b780687c0 con 0x7f4b640aaf50 2023-10-18T14:03:06.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.335+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/3428072613 >> [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982] conn(0x7f4b640aaf50 msgr2=0x7f4b640ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:06.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.335+0000 7f4b7e5a2700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982] conn(0x7f4b640aaf50 0x7f4b640ad370 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.335+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/3428072613 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4b640a15e0 msgr2=0x7f4b640a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.335+0000 7f4b7e5a2700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4b640a15e0 0x7f4b640a3aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400b2e0 tx=0x7f4b74005e80 comp rx=0 tx=0).stop 2023-10-18T14:03:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.335+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/3428072613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b78100140 msgr2=0x7f4b7819bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.335+0000 7f4b7e5a2700 1 --2- 172.21.15.114:0/3428072613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b78100140 0x7f4b7819bc20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4b68007b50 tx=0x7f4b68007f10 comp rx=0 tx=0).stop 2023-10-18T14:03:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.335+0000 7f4b7dda1700 1 -- 172.21.15.114:0/3428072613 reap_dead start 2023-10-18T14:03:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.335+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/3428072613 shutdown_connections 2023-10-18T14:03:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.335+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/3428072613 >> 172.21.15.114:0/3428072613 conn(0x7f4b780fb030 msgr2=0x7f4b780fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.335+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/3428072613 shutdown_connections 2023-10-18T14:03:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:06.335+0000 7f4b7e5a2700 1 -- 172.21.15.114:0/3428072613 wait complete. 2023-10-18T14:03:06.792 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:06.876 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:06 smithi114 ceph-mon[99494]: pgmap v250: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-18T14:03:07.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:06 smithi158 ceph-mon[103317]: pgmap v250: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-18T14:03:07.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:06 smithi172 ceph-mon[103574]: pgmap v250: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-18T14:03:07.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2023-10-18T14:03:07.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-10-18T14:03:07.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-10-18T14:03:07.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2023-10-18T14:03:07.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-10-18T14:03:07.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2023-10-18T14:03:07.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:07 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-10-18T14:03:08.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2023-10-18T14:03:08.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-10-18T14:03:08.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-10-18T14:03:08.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2023-10-18T14:03:08.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-10-18T14:03:08.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2023-10-18T14:03:08.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:07 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-10-18T14:03:08.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2023-10-18T14:03:08.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-10-18T14:03:08.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-10-18T14:03:08.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2023-10-18T14:03:08.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-10-18T14:03:08.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2023-10-18T14:03:08.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:07 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-10-18T14:03:08.642 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:08 smithi114 ceph-mon[99494]: pgmap v251: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-18T14:03:08.642 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2023-10-18T14:03:08.642 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-10-18T14:03:08.642 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-10-18T14:03:08.643 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2023-10-18T14:03:08.643 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-10-18T14:03:08.643 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2023-10-18T14:03:08.643 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:08 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-10-18T14:03:08.643 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:08 smithi114 ceph-mon[99494]: osdmap e84: 12 total, 12 up, 12 in 2023-10-18T14:03:09.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:08 smithi158 ceph-mon[103317]: pgmap v251: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-18T14:03:09.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2023-10-18T14:03:09.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-10-18T14:03:09.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-10-18T14:03:09.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2023-10-18T14:03:09.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-10-18T14:03:09.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2023-10-18T14:03:09.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:08 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-10-18T14:03:09.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:08 smithi158 ceph-mon[103317]: osdmap e84: 12 total, 12 up, 12 in 2023-10-18T14:03:09.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:08 smithi172 ceph-mon[103574]: pgmap v251: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-18T14:03:09.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2023-10-18T14:03:09.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-10-18T14:03:09.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-10-18T14:03:09.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2023-10-18T14:03:09.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-10-18T14:03:09.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2023-10-18T14:03:09.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:08 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-10-18T14:03:09.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:08 smithi172 ceph-mon[103574]: osdmap e84: 12 total, 12 up, 12 in 2023-10-18T14:03:09.452 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:09.478 INFO:teuthology.orchestra.run.smithi114.stdout:197568495655 2023-10-18T14:03:09.478 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-18T14:03:09.664 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:09 smithi114 ceph-mon[99494]: osdmap e85: 12 total, 12 up, 12 in 2023-10-18T14:03:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.738+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3657062128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2c068190 msgr2=0x7f5b2c0685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.738+0000 7f5b31c0a700 1 --2- 172.21.15.114:0/3657062128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2c068190 0x7f5b2c0685f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009990 tx=0x7f5b1c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.738+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3657062128 shutdown_connections 2023-10-18T14:03:09.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.738+0000 7f5b31c0a700 1 --2- 172.21.15.114:0/3657062128 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b2c068b30 0x7f5b2c10d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.738+0000 7f5b31c0a700 1 --2- 172.21.15.114:0/3657062128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c1067c0 0x7f5b2c106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.738+0000 7f5b31c0a700 1 --2- 172.21.15.114:0/3657062128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2c068190 0x7f5b2c0685f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.738+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3657062128 >> 172.21.15.114:0/3657062128 conn(0x7f5b2c075790 msgr2=0x7f5b2c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:09.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.738+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3657062128 shutdown_connections 2023-10-18T14:03:09.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.738+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3657062128 wait complete. 2023-10-18T14:03:09.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.739+0000 7f5b31c0a700 1 Processor -- start 2023-10-18T14:03:09.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.739+0000 7f5b31c0a700 1 -- start start 2023-10-18T14:03:09.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.739+0000 7f5b31c0a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2c068190 0x7f5b2c196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:09.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.739+0000 7f5b31c0a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b2c068b30 0x7f5b2c197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:09.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.739+0000 7f5b31c0a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c1067c0 0x7f5b2c19b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:09.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.739+0000 7f5b31c0a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c19bb20 con 0x7f5b2c068190 2023-10-18T14:03:09.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.739+0000 7f5b31c0a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c19bc90 con 0x7f5b2c068b30 2023-10-18T14:03:09.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.739+0000 7f5b31c0a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c19be50 con 0x7f5b2c1067c0 2023-10-18T14:03:09.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.739+0000 7f5b2b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2c068190 0x7f5b2c196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:09.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.739+0000 7f5b2b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2c068190 0x7f5b2c196ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42860/0 (socket says 172.21.15.114:42860) 2023-10-18T14:03:09.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.739+0000 7f5b2b7fe700 1 -- 172.21.15.114:0/3687424609 learned_addr learned my addr 172.21.15.114:0/3687424609 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:09.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.740+0000 7f5b2bfff700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c1067c0 0x7f5b2c19b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:09.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.740+0000 7f5b2affd700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b2c068b30 0x7f5b2c197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:09.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.740+0000 7f5b2b7fe700 1 -- 172.21.15.114:0/3687424609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c1067c0 msgr2=0x7f5b2c19b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:09.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.740+0000 7f5b2b7fe700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c1067c0 0x7f5b2c19b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.740+0000 7f5b2b7fe700 1 -- 172.21.15.114:0/3687424609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b2c068b30 msgr2=0x7f5b2c197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:09.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.740+0000 7f5b2b7fe700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b2c068b30 0x7f5b2c197220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.740+0000 7f5b2b7fe700 1 -- 172.21.15.114:0/3687424609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c0095f0 con 0x7f5b2c068190 2023-10-18T14:03:09.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.740+0000 7f5b2b7fe700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2c068190 0x7f5b2c196ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400d950 tx=0x7f5b1400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:09.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.740+0000 7f5b28ff9700 1 -- 172.21.15.114:0/3687424609 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14009b40 con 0x7f5b2c068190 2023-10-18T14:03:09.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.740+0000 7f5b28ff9700 1 -- 172.21.15.114:0/3687424609 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b14009ca0 con 0x7f5b2c068190 2023-10-18T14:03:09.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.740+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3687424609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c19c130 con 0x7f5b2c068190 2023-10-18T14:03:09.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.740+0000 7f5b28ff9700 1 -- 172.21.15.114:0/3687424609 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1400f620 con 0x7f5b2c068190 2023-10-18T14:03:09.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.740+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3687424609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c1a39b0 con 0x7f5b2c068190 2023-10-18T14:03:09.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.741+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3687424609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c108de0 con 0x7f5b2c068190 2023-10-18T14:03:09.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.742+0000 7f5b28ff9700 1 -- 172.21.15.114:0/3687424609 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f5b14010460 con 0x7f5b2c068190 2023-10-18T14:03:09.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.743+0000 7f5b28ff9700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5b180a1560 0x7f5b180a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:09.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.743+0000 7f5b2affd700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5b180a1560 0x7f5b180a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:09.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.743+0000 7f5b28ff9700 1 -- 172.21.15.114:0/3687424609 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5b140cd320 con 0x7f5b2c068190 2023-10-18T14:03:09.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.743+0000 7f5b2affd700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5b180a1560 0x7f5b180a3a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c006010 tx=0x7f5b1c0036c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:09.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.746+0000 7f5b28ff9700 1 -- 172.21.15.114:0/3687424609 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5b14096720 con 0x7f5b2c068190 2023-10-18T14:03:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.945+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3687424609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5b2c197f30 con 0x7f5b2c068190 2023-10-18T14:03:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.945+0000 7f5b28ff9700 1 -- 172.21.15.114:0/3687424609 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b14020020 con 0x7f5b2c068190 2023-10-18T14:03:09.950 INFO:teuthology.orchestra.run.smithi114.stdout:167503724588 2023-10-18T14:03:09.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.947+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3687424609 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5b180a1560 msgr2=0x7f5b180a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:09.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.947+0000 7f5b31c0a700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5b180a1560 0x7f5b180a3a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c006010 tx=0x7f5b1c0036c0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.947+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3687424609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2c068190 msgr2=0x7f5b2c196ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:09.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.947+0000 7f5b31c0a700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2c068190 0x7f5b2c196ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400d950 tx=0x7f5b1400dd10 comp rx=0 tx=0).stop 2023-10-18T14:03:09.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.947+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3687424609 shutdown_connections 2023-10-18T14:03:09.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.947+0000 7f5b31c0a700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5b180a1560 0x7f5b180a3a20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.947+0000 7f5b31c0a700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c1067c0 0x7f5b2c19b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.947+0000 7f5b31c0a700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2c068190 0x7f5b2c196ce0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.947+0000 7f5b31c0a700 1 --2- 172.21.15.114:0/3687424609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b2c068b30 0x7f5b2c197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.947+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3687424609 >> 172.21.15.114:0/3687424609 conn(0x7f5b2c075790 msgr2=0x7f5b2c0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:09.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.947+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3687424609 shutdown_connections 2023-10-18T14:03:09.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.947+0000 7f5b31c0a700 1 -- 172.21.15.114:0/3687424609 wait complete. 2023-10-18T14:03:09.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.954+0000 7f15cad9b700 1 -- 172.21.15.114:0/2842148175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15c41045b0 msgr2=0x7f15c4104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:09.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.954+0000 7f15cad9b700 1 --2- 172.21.15.114:0/2842148175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15c41045b0 0x7f15c4104990 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009990 tx=0x7f15b8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.954+0000 7f15cad9b700 1 -- 172.21.15.114:0/2842148175 shutdown_connections 2023-10-18T14:03:09.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.954+0000 7f15cad9b700 1 --2- 172.21.15.114:0/2842148175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c41000a0 0x7f15c410c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.954+0000 7f15cad9b700 1 --2- 172.21.15.114:0/2842148175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15c41045b0 0x7f15c4104990 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.954+0000 7f15cad9b700 1 --2- 172.21.15.114:0/2842148175 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c40ff6e0 0x7f15c40ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.954+0000 7f15cad9b700 1 -- 172.21.15.114:0/2842148175 >> 172.21.15.114:0/2842148175 conn(0x7f15c40766c0 msgr2=0x7f15c4076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:09.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.954+0000 7f15cad9b700 1 -- 172.21.15.114:0/2842148175 shutdown_connections 2023-10-18T14:03:09.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.954+0000 7f15cad9b700 1 -- 172.21.15.114:0/2842148175 wait complete. 2023-10-18T14:03:09.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.954+0000 7f15cad9b700 1 Processor -- start 2023-10-18T14:03:09.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.954+0000 7f15cad9b700 1 -- start start 2023-10-18T14:03:09.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.954+0000 7f15cad9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15c40ff6e0 0x7f15c419c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:09.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15cad9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c41000a0 0x7f15c419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:09.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15cad9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c41045b0 0x7f15c4196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:09.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15cad9b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4197080 con 0x7f15c40ff6e0 2023-10-18T14:03:09.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15cad9b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41971f0 con 0x7f15c41045b0 2023-10-18T14:03:09.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15cad9b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41973b0 con 0x7f15c41000a0 2023-10-18T14:03:09.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c8b37700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15c40ff6e0 0x7f15c419c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:09.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c8b37700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15c40ff6e0 0x7f15c419c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42874/0 (socket says 172.21.15.114:42874) 2023-10-18T14:03:09.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c8b37700 1 -- 172.21.15.114:0/445953820 learned_addr learned my addr 172.21.15.114:0/445953820 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:09.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c3fff700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c41000a0 0x7f15c419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:09.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c9338700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c41045b0 0x7f15c4196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:09.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c8b37700 1 -- 172.21.15.114:0/445953820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c41000a0 msgr2=0x7f15c419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:09.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c8b37700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c41000a0 0x7f15c419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c8b37700 1 -- 172.21.15.114:0/445953820 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c41045b0 msgr2=0x7f15c4196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:09.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c8b37700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c41045b0 0x7f15c4196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:09.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c8b37700 1 -- 172.21.15.114:0/445953820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80095f0 con 0x7f15c40ff6e0 2023-10-18T14:03:09.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c8b37700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15c40ff6e0 0x7f15c419c890 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009fd0 tx=0x7f15b800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:09.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c1ffb700 1 -- 172.21.15.114:0/445953820 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b801d070 con 0x7f15c40ff6e0 2023-10-18T14:03:09.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c1ffb700 1 -- 172.21.15.114:0/445953820 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15b8005050 con 0x7f15c40ff6e0 2023-10-18T14:03:09.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15cad9b700 1 -- 172.21.15.114:0/445953820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c4197630 con 0x7f15c40ff6e0 2023-10-18T14:03:09.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.955+0000 7f15c1ffb700 1 -- 172.21.15.114:0/445953820 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8004a90 con 0x7f15c40ff6e0 2023-10-18T14:03:09.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.956+0000 7f15cad9b700 1 -- 172.21.15.114:0/445953820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c4101360 con 0x7f15c40ff6e0 2023-10-18T14:03:09.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.957+0000 7f15cad9b700 1 -- 172.21.15.114:0/445953820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c4108c30 con 0x7f15c40ff6e0 2023-10-18T14:03:09.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.958+0000 7f15c1ffb700 1 -- 172.21.15.114:0/445953820 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f15b8004bf0 con 0x7f15c40ff6e0 2023-10-18T14:03:09.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.958+0000 7f15c1ffb700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f15b40a1560 0x7f15b40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:09.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.958+0000 7f15c1ffb700 1 -- 172.21.15.114:0/445953820 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f15b80ce070 con 0x7f15c40ff6e0 2023-10-18T14:03:09.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.958+0000 7f15c3fff700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f15b40a1560 0x7f15b40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:09.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.959+0000 7f15c3fff700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f15b40a1560 0x7f15b40a3a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f15c4197b90 tx=0x7f15b000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:09.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:09.962+0000 7f15c1ffb700 1 -- 172.21.15.114:0/445953820 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f15b8097600 con 0x7f15c40ff6e0 2023-10-18T14:03:10.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:09 smithi158 ceph-mon[103317]: osdmap e85: 12 total, 12 up, 12 in 2023-10-18T14:03:10.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:09 smithi172 ceph-mon[103574]: osdmap e85: 12 total, 12 up, 12 in 2023-10-18T14:03:10.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.192+0000 7f15cad9b700 1 -- 172.21.15.114:0/445953820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f15c404e4f0 con 0x7f15c40ff6e0 2023-10-18T14:03:10.196 INFO:teuthology.orchestra.run.smithi114.stdout:111669149748 2023-10-18T14:03:10.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.192+0000 7f15c1ffb700 1 -- 172.21.15.114:0/445953820 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15b809ac20 con 0x7f15c40ff6e0 2023-10-18T14:03:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.196+0000 7f15cad9b700 1 -- 172.21.15.114:0/445953820 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f15b40a1560 msgr2=0x7f15b40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.196+0000 7f15cad9b700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f15b40a1560 0x7f15b40a3a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f15c4197b90 tx=0x7f15b000b410 comp rx=0 tx=0).stop 2023-10-18T14:03:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.196+0000 7f15cad9b700 1 -- 172.21.15.114:0/445953820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15c40ff6e0 msgr2=0x7f15c419c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.196+0000 7f15cad9b700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15c40ff6e0 0x7f15c419c890 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009fd0 tx=0x7f15b800f670 comp rx=0 tx=0).stop 2023-10-18T14:03:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.196+0000 7f15cad9b700 1 -- 172.21.15.114:0/445953820 shutdown_connections 2023-10-18T14:03:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.196+0000 7f15cad9b700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f15b40a1560 0x7f15b40a3a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.196+0000 7f15cad9b700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c41045b0 0x7f15c4196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.196+0000 7f15cad9b700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15c40ff6e0 0x7f15c419c890 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.196+0000 7f15cad9b700 1 --2- 172.21.15.114:0/445953820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c41000a0 0x7f15c419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.196+0000 7f15cad9b700 1 -- 172.21.15.114:0/445953820 >> 172.21.15.114:0/445953820 conn(0x7f15c40766c0 msgr2=0x7f15c4068de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:10.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.196+0000 7f15cad9b700 1 -- 172.21.15.114:0/445953820 shutdown_connections 2023-10-18T14:03:10.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:10.196+0000 7f15cad9b700 1 -- 172.21.15.114:0/445953820 wait complete. 2023-10-18T14:03:10.924 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:10 smithi114 ceph-mon[99494]: pgmap v254: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-10-18T14:03:10.924 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:10 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3687424609' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-18T14:03:10.924 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:10 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/445953820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-18T14:03:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:10 smithi158 ceph-mon[103317]: pgmap v254: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-10-18T14:03:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:10 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3687424609' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-18T14:03:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:10 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/445953820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-18T14:03:11.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:10 smithi172 ceph-mon[103574]: pgmap v254: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-10-18T14:03:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:10 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3687424609' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-18T14:03:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:10 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/445953820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-18T14:03:11.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.203+0000 7efdc3da8700 1 -- 172.21.15.114:0/1223722148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdbc105750 msgr2=0x7efdbc105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:11.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.203+0000 7efdc3da8700 1 --2- 172.21.15.114:0/1223722148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdbc105750 0x7efdbc105b30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efdac009990 tx=0x7efdac009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.203+0000 7efdc3da8700 1 -- 172.21.15.114:0/1223722148 shutdown_connections 2023-10-18T14:03:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.203+0000 7efdc3da8700 1 --2- 172.21.15.114:0/1223722148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdbc100390 0x7efdbc10c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.203+0000 7efdc3da8700 1 --2- 172.21.15.114:0/1223722148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdbc105750 0x7efdbc105b30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.203+0000 7efdc3da8700 1 --2- 172.21.15.114:0/1223722148 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdbc0ff9d0 0x7efdbc0ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.203+0000 7efdc3da8700 1 -- 172.21.15.114:0/1223722148 >> 172.21.15.114:0/1223722148 conn(0x7efdbc076580 msgr2=0x7efdbc076990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.203+0000 7efdc3da8700 1 -- 172.21.15.114:0/1223722148 shutdown_connections 2023-10-18T14:03:11.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.203+0000 7efdc3da8700 1 -- 172.21.15.114:0/1223722148 wait complete. 2023-10-18T14:03:11.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc3da8700 1 Processor -- start 2023-10-18T14:03:11.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc3da8700 1 -- start start 2023-10-18T14:03:11.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc3da8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdbc0ff9d0 0x7efdbc19b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:11.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc3da8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdbc100390 0x7efdbc19bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:11.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc3da8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdbc105750 0x7efdbc1958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:11.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc3da8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc195f20 con 0x7efdbc105750 2023-10-18T14:03:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc3da8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc196090 con 0x7efdbc0ff9d0 2023-10-18T14:03:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc3da8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc196250 con 0x7efdbc100390 2023-10-18T14:03:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc2345700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdbc105750 0x7efdbc1958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc2345700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdbc105750 0x7efdbc1958c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42892/0 (socket says 172.21.15.114:42892) 2023-10-18T14:03:11.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc2345700 1 -- 172.21.15.114:0/346030092 learned_addr learned my addr 172.21.15.114:0/346030092 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:11.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc1343700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdbc100390 0x7efdbc19bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:11.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc1b44700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdbc0ff9d0 0x7efdbc19b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:11.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc2345700 1 -- 172.21.15.114:0/346030092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdbc100390 msgr2=0x7efdbc19bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:11.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc2345700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdbc100390 0x7efdbc19bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc2345700 1 -- 172.21.15.114:0/346030092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdbc0ff9d0 msgr2=0x7efdbc19b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:11.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc2345700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdbc0ff9d0 0x7efdbc19b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc2345700 1 -- 172.21.15.114:0/346030092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac0095f0 con 0x7efdbc105750 2023-10-18T14:03:11.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.204+0000 7efdc2345700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdbc105750 0x7efdbc1958c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efdb4007ee0 tx=0x7efdb400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:11.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.205+0000 7efdb2ffd700 1 -- 172.21.15.114:0/346030092 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4017070 con 0x7efdbc105750 2023-10-18T14:03:11.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.205+0000 7efdb2ffd700 1 -- 172.21.15.114:0/346030092 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efdb400f040 con 0x7efdbc105750 2023-10-18T14:03:11.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.205+0000 7efdc3da8700 1 -- 172.21.15.114:0/346030092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdbc196530 con 0x7efdbc105750 2023-10-18T14:03:11.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.205+0000 7efdb2ffd700 1 -- 172.21.15.114:0/346030092 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4005740 con 0x7efdbc105750 2023-10-18T14:03:11.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.205+0000 7efdc3da8700 1 -- 172.21.15.114:0/346030092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc1a2770 con 0x7efdbc105750 2023-10-18T14:03:11.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.206+0000 7efdc3da8700 1 -- 172.21.15.114:0/346030092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc107c00 con 0x7efdbc105750 2023-10-18T14:03:11.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.207+0000 7efdb2ffd700 1 -- 172.21.15.114:0/346030092 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7efdb400dc60 con 0x7efdbc105750 2023-10-18T14:03:11.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.208+0000 7efdb2ffd700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efda80a1560 0x7efda80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:11.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.208+0000 7efdb2ffd700 1 -- 172.21.15.114:0/346030092 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efdb40cce20 con 0x7efdbc105750 2023-10-18T14:03:11.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.209+0000 7efdc1b44700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efda80a1560 0x7efda80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:11.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.210+0000 7efdc1b44700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efda80a1560 0x7efda80a3a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efdac00b5c0 tx=0x7efdac01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:11.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.213+0000 7efdb2ffd700 1 -- 172.21.15.114:0/346030092 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efdb4096280 con 0x7efdbc105750 2023-10-18T14:03:11.218 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:11.258 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724586 got 167503724588 for osd.5 2023-10-18T14:03:11.258 DEBUG:teuthology.parallel:result is None 2023-10-18T14:03:11.263 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149745 got 111669149748 for osd.3 2023-10-18T14:03:11.263 DEBUG:teuthology.parallel:result is None 2023-10-18T14:03:11.411 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:11.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.439+0000 7efdc3da8700 1 -- 172.21.15.114:0/346030092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efdbc100e40 con 0x7efdbc105750 2023-10-18T14:03:11.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.439+0000 7efdb2ffd700 1 -- 172.21.15.114:0/346030092 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdb40998a0 con 0x7efdbc105750 2023-10-18T14:03:11.443 INFO:teuthology.orchestra.run.smithi114.stdout:60129542205 2023-10-18T14:03:11.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.441+0000 7efdc3da8700 1 -- 172.21.15.114:0/346030092 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efda80a1560 msgr2=0x7efda80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:11.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.441+0000 7efdc3da8700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efda80a1560 0x7efda80a3a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efdac00b5c0 tx=0x7efdac01a040 comp rx=0 tx=0).stop 2023-10-18T14:03:11.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.441+0000 7efdc3da8700 1 -- 172.21.15.114:0/346030092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdbc105750 msgr2=0x7efdbc1958c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:11.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.441+0000 7efdc3da8700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdbc105750 0x7efdbc1958c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efdb4007ee0 tx=0x7efdb400d3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.441+0000 7efdc3da8700 1 -- 172.21.15.114:0/346030092 shutdown_connections 2023-10-18T14:03:11.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.441+0000 7efdc3da8700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efda80a1560 0x7efda80a3a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.441+0000 7efdc3da8700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdbc105750 0x7efdbc1958c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.441+0000 7efdc3da8700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdbc0ff9d0 0x7efdbc19b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.441+0000 7efdc3da8700 1 --2- 172.21.15.114:0/346030092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdbc100390 0x7efdbc19bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.441+0000 7efdc3da8700 1 -- 172.21.15.114:0/346030092 >> 172.21.15.114:0/346030092 conn(0x7efdbc076580 msgr2=0x7efdbc0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:11.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.441+0000 7efdc3da8700 1 -- 172.21.15.114:0/346030092 shutdown_connections 2023-10-18T14:03:11.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.442+0000 7efdc3da8700 1 -- 172.21.15.114:0/346030092 wait complete. 2023-10-18T14:03:11.774 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:11 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/346030092' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-18T14:03:11.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.779+0000 7f20168ff700 1 -- 172.21.15.114:0/1226095813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20100ffc30 msgr2=0x7f2010100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:11.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.779+0000 7f20168ff700 1 --2- 172.21.15.114:0/1226095813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20100ffc30 0x7f2010100010 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2000009990 tx=0x7f2000009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.779+0000 7f20168ff700 1 -- 172.21.15.114:0/1226095813 shutdown_connections 2023-10-18T14:03:11.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.779+0000 7f20168ff700 1 --2- 172.21.15.114:0/1226095813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2010104a20 0x7f201010c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.779+0000 7f20168ff700 1 --2- 172.21.15.114:0/1226095813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20100ffc30 0x7f2010100010 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.779+0000 7f20168ff700 1 --2- 172.21.15.114:0/1226095813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20101005e0 0x7f20101042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.779+0000 7f20168ff700 1 -- 172.21.15.114:0/1226095813 >> 172.21.15.114:0/1226095813 conn(0x7f20100766a0 msgr2=0x7f2010076ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:11.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.780+0000 7f20168ff700 1 -- 172.21.15.114:0/1226095813 shutdown_connections 2023-10-18T14:03:11.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.780+0000 7f20168ff700 1 -- 172.21.15.114:0/1226095813 wait complete. 2023-10-18T14:03:11.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.780+0000 7f20168ff700 1 Processor -- start 2023-10-18T14:03:11.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.780+0000 7f20168ff700 1 -- start start 2023-10-18T14:03:11.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f20168ff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20100ffc30 0x7f20101a2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:11.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f20168ff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20101005e0 0x7f20101a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:11.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f20168ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2010104a20 0x7f2010107fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:11.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f20168ff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2010108670 con 0x7f20100ffc30 2023-10-18T14:03:11.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f20168ff700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20101087e0 con 0x7f20101005e0 2023-10-18T14:03:11.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f20168ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20101089a0 con 0x7f2010104a20 2023-10-18T14:03:11.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f200ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20100ffc30 0x7f20101a2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:11.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f200ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20100ffc30 0x7f20101a2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42902/0 (socket says 172.21.15.114:42902) 2023-10-18T14:03:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f200ffff700 1 -- 172.21.15.114:0/3199248934 learned_addr learned my addr 172.21.15.114:0/3199248934 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f200f7fe700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20101005e0 0x7f20101a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f2014e9c700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2010104a20 0x7f2010107fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f200ffff700 1 -- 172.21.15.114:0/3199248934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2010104a20 msgr2=0x7f2010107fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f200ffff700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2010104a20 0x7f2010107fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f200ffff700 1 -- 172.21.15.114:0/3199248934 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20101005e0 msgr2=0x7f20101a3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:11.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f200ffff700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20101005e0 0x7f20101a3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f200ffff700 1 -- 172.21.15.114:0/3199248934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000095f0 con 0x7f20100ffc30 2023-10-18T14:03:11.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f200ffff700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20100ffc30 0x7f20101a2ec0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2000004760 tx=0x7f2000004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:11.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.781+0000 7f200d7fa700 1 -- 172.21.15.114:0/3199248934 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200001d070 con 0x7f20100ffc30 2023-10-18T14:03:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.782+0000 7f200d7fa700 1 -- 172.21.15.114:0/3199248934 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f200000fb30 con 0x7f20100ffc30 2023-10-18T14:03:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.782+0000 7f200d7fa700 1 -- 172.21.15.114:0/3199248934 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000022db0 con 0x7f20100ffc30 2023-10-18T14:03:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.782+0000 7f20168ff700 1 -- 172.21.15.114:0/3199248934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2010108c20 con 0x7f20100ffc30 2023-10-18T14:03:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.782+0000 7f20168ff700 1 -- 172.21.15.114:0/3199248934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20101a9eb0 con 0x7f20100ffc30 2023-10-18T14:03:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.783+0000 7f20168ff700 1 -- 172.21.15.114:0/3199248934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2010110560 con 0x7f20100ffc30 2023-10-18T14:03:11.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.784+0000 7f200d7fa700 1 -- 172.21.15.114:0/3199248934 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f200000fca0 con 0x7f20100ffc30 2023-10-18T14:03:11.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.784+0000 7f200d7fa700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1ff80a1560 0x7f1ff80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:11.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.784+0000 7f200f7fe700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1ff80a1560 0x7f1ff80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:11.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.784+0000 7f200d7fa700 1 -- 172.21.15.114:0/3199248934 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f20000ce1e0 con 0x7f20100ffc30 2023-10-18T14:03:11.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.785+0000 7f200f7fe700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1ff80a1560 0x7f1ff80a3a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f20100ff9a0 tx=0x7f200400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:11.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.789+0000 7f200d7fa700 1 -- 172.21.15.114:0/3199248934 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f20000976d0 con 0x7f20100ffc30 2023-10-18T14:03:11.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.971+0000 7ff6ae780700 1 -- 172.21.15.114:0/2081444799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a81056b0 msgr2=0x7ff6a8105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:11.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.971+0000 7ff6ae780700 1 --2- 172.21.15.114:0/2081444799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a81056b0 0x7ff6a8105a90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff698009990 tx=0x7ff698009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.971+0000 7ff6ae780700 1 -- 172.21.15.114:0/2081444799 shutdown_connections 2023-10-18T14:03:11.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.971+0000 7ff6ae780700 1 --2- 172.21.15.114:0/2081444799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a8100110 0x7ff6a810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.971+0000 7ff6ae780700 1 --2- 172.21.15.114:0/2081444799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a81056b0 0x7ff6a8105a90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.971+0000 7ff6ae780700 1 --2- 172.21.15.114:0/2081444799 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6a80ff750 0x7ff6a80ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.971+0000 7ff6ae780700 1 -- 172.21.15.114:0/2081444799 >> 172.21.15.114:0/2081444799 conn(0x7ff6a8075790 msgr2=0x7ff6a8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:11.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.971+0000 7ff6ae780700 1 -- 172.21.15.114:0/2081444799 shutdown_connections 2023-10-18T14:03:11.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.971+0000 7ff6ae780700 1 -- 172.21.15.114:0/2081444799 wait complete. 2023-10-18T14:03:11.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.971+0000 7ff6ae780700 1 Processor -- start 2023-10-18T14:03:11.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.971+0000 7ff6ae780700 1 -- start start 2023-10-18T14:03:11.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6ae780700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6a80ff750 0x7ff6a8197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6ae780700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a8100110 0x7ff6a8197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6ae780700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a81056b0 0x7ff6a81a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6ae780700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a8198850 con 0x7ff6a81056b0 2023-10-18T14:03:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6ae780700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a81a3010 con 0x7ff6a80ff750 2023-10-18T14:03:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6ae780700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a81a3150 con 0x7ff6a8100110 2023-10-18T14:03:11.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6acd1d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a81056b0 0x7ff6a81a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:11.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6acd1d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a81056b0 0x7ff6a81a2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42920/0 (socket says 172.21.15.114:42920) 2023-10-18T14:03:11.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6acd1d700 1 -- 172.21.15.114:0/3629964457 learned_addr learned my addr 172.21.15.114:0/3629964457 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:11.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6a7fff700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6a80ff750 0x7ff6a8197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:11.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6a77fe700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a8100110 0x7ff6a8197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6acd1d700 1 -- 172.21.15.114:0/3629964457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a8100110 msgr2=0x7ff6a8197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6acd1d700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a8100110 0x7ff6a8197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6acd1d700 1 -- 172.21.15.114:0/3629964457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6a80ff750 msgr2=0x7ff6a8197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6acd1d700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6a80ff750 0x7ff6a8197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.972+0000 7ff6acd1d700 1 -- 172.21.15.114:0/3629964457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6980095f0 con 0x7ff6a81056b0 2023-10-18T14:03:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.973+0000 7ff6acd1d700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a81056b0 0x7ff6a81a2ad0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000ada0 tx=0x7ff6a000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:11.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.973+0000 7ff6a57fa700 1 -- 172.21.15.114:0/3629964457 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000f070 con 0x7ff6a81056b0 2023-10-18T14:03:11.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.973+0000 7ff6a57fa700 1 -- 172.21.15.114:0/3629964457 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6a0007b30 con 0x7ff6a81056b0 2023-10-18T14:03:11.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.973+0000 7ff6ae780700 1 -- 172.21.15.114:0/3629964457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a81a33d0 con 0x7ff6a81056b0 2023-10-18T14:03:11.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.973+0000 7ff6a57fa700 1 -- 172.21.15.114:0/3629964457 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0005280 con 0x7ff6a81056b0 2023-10-18T14:03:11.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.973+0000 7ff6ae780700 1 -- 172.21.15.114:0/3629964457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a81a38d0 con 0x7ff6a81056b0 2023-10-18T14:03:11.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.974+0000 7ff6ae780700 1 -- 172.21.15.114:0/3629964457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a8107cb0 con 0x7ff6a81056b0 2023-10-18T14:03:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.975+0000 7ff6a57fa700 1 -- 172.21.15.114:0/3629964457 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7ff6a000a090 con 0x7ff6a81056b0 2023-10-18T14:03:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.975+0000 7ff6a57fa700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff6900a1560 0x7ff6900a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.976+0000 7ff6a7fff700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff6900a1560 0x7ff6900a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.976+0000 7ff6a57fa700 1 -- 172.21.15.114:0/3629964457 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff6a00cc9f0 con 0x7ff6a81056b0 2023-10-18T14:03:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.976+0000 7ff6a7fff700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff6900a1560 0x7ff6900a3a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff69800b5c0 tx=0x7ff698005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.979+0000 7ff6a57fa700 1 -- 172.21.15.114:0/3629964457 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff6a0095ee0 con 0x7ff6a81056b0 2023-10-18T14:03:12.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.998+0000 7f20168ff700 1 -- 172.21.15.114:0/3199248934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2010068660 con 0x7f20100ffc30 2023-10-18T14:03:12.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:11.998+0000 7f200d7fa700 1 -- 172.21.15.114:0/3199248934 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f200009acf0 con 0x7f20100ffc30 2023-10-18T14:03:12.002 INFO:teuthology.orchestra.run.smithi114.stdout:219043332131 2023-10-18T14:03:12.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.000+0000 7f20168ff700 1 -- 172.21.15.114:0/3199248934 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1ff80a1560 msgr2=0x7f1ff80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.000+0000 7f20168ff700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1ff80a1560 0x7f1ff80a3a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f20100ff9a0 tx=0x7f200400b410 comp rx=0 tx=0).stop 2023-10-18T14:03:12.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.000+0000 7f20168ff700 1 -- 172.21.15.114:0/3199248934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20100ffc30 msgr2=0x7f20101a2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.000+0000 7f20168ff700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20100ffc30 0x7f20101a2ec0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2000004760 tx=0x7f2000004790 comp rx=0 tx=0).stop 2023-10-18T14:03:12.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.000+0000 7f20168ff700 1 -- 172.21.15.114:0/3199248934 shutdown_connections 2023-10-18T14:03:12.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.000+0000 7f20168ff700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1ff80a1560 0x7f1ff80a3a20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.000+0000 7f20168ff700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2010104a20 0x7f2010107fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.000+0000 7f20168ff700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20100ffc30 0x7f20101a2ec0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.000+0000 7f20168ff700 1 --2- 172.21.15.114:0/3199248934 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f20101005e0 0x7f20101a3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.000+0000 7f20168ff700 1 -- 172.21.15.114:0/3199248934 >> 172.21.15.114:0/3199248934 conn(0x7f20100766a0 msgr2=0x7f20100fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:12.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.001+0000 7f20168ff700 1 -- 172.21.15.114:0/3199248934 shutdown_connections 2023-10-18T14:03:12.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.001+0000 7f20168ff700 1 -- 172.21.15.114:0/3199248934 wait complete. 2023-10-18T14:03:12.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:11 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/346030092' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-18T14:03:12.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:11 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/346030092' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-18T14:03:12.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.187+0000 7ff6ae780700 1 -- 172.21.15.114:0/3629964457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7ff6a8068750 con 0x7ff6a81056b0 2023-10-18T14:03:12.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.188+0000 7ff6a57fa700 1 -- 172.21.15.114:0/3629964457 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff6a0099500 con 0x7ff6a81056b0 2023-10-18T14:03:12.192 INFO:teuthology.orchestra.run.smithi114.stdout:249108103199 2023-10-18T14:03:12.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.190+0000 7ff6ae780700 1 -- 172.21.15.114:0/3629964457 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff6900a1560 msgr2=0x7ff6900a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.190+0000 7ff6ae780700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff6900a1560 0x7ff6900a3a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff69800b5c0 tx=0x7ff698005fd0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.190+0000 7ff6ae780700 1 -- 172.21.15.114:0/3629964457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a81056b0 msgr2=0x7ff6a81a2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.190+0000 7ff6ae780700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a81056b0 0x7ff6a81a2ad0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000ada0 tx=0x7ff6a000c330 comp rx=0 tx=0).stop 2023-10-18T14:03:12.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.190+0000 7ff6ae780700 1 -- 172.21.15.114:0/3629964457 shutdown_connections 2023-10-18T14:03:12.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.190+0000 7ff6ae780700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff6900a1560 0x7ff6900a3a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.190+0000 7ff6ae780700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a81056b0 0x7ff6a81a2ad0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.190+0000 7ff6ae780700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff6a80ff750 0x7ff6a8197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.190+0000 7ff6ae780700 1 --2- 172.21.15.114:0/3629964457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a8100110 0x7ff6a8197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.190+0000 7ff6ae780700 1 -- 172.21.15.114:0/3629964457 >> 172.21.15.114:0/3629964457 conn(0x7ff6a8075790 msgr2=0x7ff6a80fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:12.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.190+0000 7ff6ae780700 1 -- 172.21.15.114:0/3629964457 shutdown_connections 2023-10-18T14:03:12.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.190+0000 7ff6ae780700 1 -- 172.21.15.114:0/3629964457 wait complete. 2023-10-18T14:03:12.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.304+0000 7f7da731c700 1 -- 172.21.15.114:0/2767695155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7da01056b0 msgr2=0x7f7da0105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.304+0000 7f7da731c700 1 --2- 172.21.15.114:0/2767695155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7da01056b0 0x7f7da0105a90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009990 tx=0x7f7d9c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.304+0000 7f7da731c700 1 -- 172.21.15.114:0/2767695155 shutdown_connections 2023-10-18T14:03:12.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.304+0000 7f7da731c700 1 --2- 172.21.15.114:0/2767695155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7da0100110 0x7f7da010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.304+0000 7f7da731c700 1 --2- 172.21.15.114:0/2767695155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7da01056b0 0x7f7da0105a90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.304+0000 7f7da731c700 1 --2- 172.21.15.114:0/2767695155 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7da00ff750 0x7f7da00ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.304+0000 7f7da731c700 1 -- 172.21.15.114:0/2767695155 >> 172.21.15.114:0/2767695155 conn(0x7f7da0075790 msgr2=0x7f7da0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:12.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.304+0000 7f7da731c700 1 -- 172.21.15.114:0/2767695155 shutdown_connections 2023-10-18T14:03:12.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.304+0000 7f7da731c700 1 -- 172.21.15.114:0/2767695155 wait complete. 2023-10-18T14:03:12.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da731c700 1 Processor -- start 2023-10-18T14:03:12.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da731c700 1 -- start start 2023-10-18T14:03:12.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da731c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7da00ff750 0x7f7da0101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:12.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da731c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7da0100110 0x7f7da01017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:12.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da731c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7da01056b0 0x7f7da0101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:12.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da731c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da01a4fb0 con 0x7f7da00ff750 2023-10-18T14:03:12.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da731c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da01a5120 con 0x7f7da0100110 2023-10-18T14:03:12.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da731c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da01a52e0 con 0x7f7da01056b0 2023-10-18T14:03:12.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da50b8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7da00ff750 0x7f7da0101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:12.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da50b8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7da00ff750 0x7f7da0101280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42930/0 (socket says 172.21.15.114:42930) 2023-10-18T14:03:12.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da50b8700 1 -- 172.21.15.114:0/567243981 learned_addr learned my addr 172.21.15.114:0/567243981 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:12.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da58b9700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7da01056b0 0x7f7da0101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:12.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da48b7700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7da0100110 0x7f7da01017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:12.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da50b8700 1 -- 172.21.15.114:0/567243981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7da01056b0 msgr2=0x7f7da0101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da50b8700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7da01056b0 0x7f7da0101d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da50b8700 1 -- 172.21.15.114:0/567243981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7da0100110 msgr2=0x7f7da01017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da50b8700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7da0100110 0x7f7da01017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da50b8700 1 -- 172.21.15.114:0/567243981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0095f0 con 0x7f7da00ff750 2023-10-18T14:03:12.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.305+0000 7f7da50b8700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7da00ff750 0x7f7da0101280 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0098e0 tx=0x7f7d9c00f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:12.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.306+0000 7f7d967fc700 1 -- 172.21.15.114:0/567243981 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c01d070 con 0x7f7da00ff750 2023-10-18T14:03:12.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.306+0000 7f7d967fc700 1 -- 172.21.15.114:0/567243981 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d9c00fb90 con 0x7f7da00ff750 2023-10-18T14:03:12.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.306+0000 7f7da731c700 1 -- 172.21.15.114:0/567243981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da01a5560 con 0x7f7da00ff750 2023-10-18T14:03:12.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.306+0000 7f7d967fc700 1 -- 172.21.15.114:0/567243981 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c017650 con 0x7f7da00ff750 2023-10-18T14:03:12.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.306+0000 7f7da731c700 1 -- 172.21.15.114:0/567243981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da01a5970 con 0x7f7da00ff750 2023-10-18T14:03:12.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.307+0000 7f7da731c700 1 -- 172.21.15.114:0/567243981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da0100df0 con 0x7f7da00ff750 2023-10-18T14:03:12.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.308+0000 7f7d967fc700 1 -- 172.21.15.114:0/567243981 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f7d9c00fd00 con 0x7f7da00ff750 2023-10-18T14:03:12.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.309+0000 7f7d967fc700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7d8c0a1560 0x7f7d8c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:12.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.309+0000 7f7da48b7700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7d8c0a1560 0x7f7d8c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:12.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.309+0000 7f7d967fc700 1 -- 172.21.15.114:0/567243981 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7d9c0ce460 con 0x7f7da00ff750 2023-10-18T14:03:12.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.309+0000 7f7da48b7700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7d8c0a1560 0x7f7d8c0a3a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7d90005950 tx=0x7f7d900058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:12.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.312+0000 7f7d967fc700 1 -- 172.21.15.114:0/567243981 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7d9c097950 con 0x7f7da00ff750 2023-10-18T14:03:12.510 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542203 got 60129542205 for osd.1 2023-10-18T14:03:12.510 DEBUG:teuthology.parallel:result is None 2023-10-18T14:03:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.521+0000 7f7da731c700 1 -- 172.21.15.114:0/567243981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f7da010f650 con 0x7f7da00ff750 2023-10-18T14:03:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.521+0000 7f7d967fc700 1 -- 172.21.15.114:0/567243981 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f7d9c09af70 con 0x7f7da00ff750 2023-10-18T14:03:12.525 INFO:teuthology.orchestra.run.smithi114.stdout:300647710742 2023-10-18T14:03:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.523+0000 7f7da731c700 1 -- 172.21.15.114:0/567243981 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7d8c0a1560 msgr2=0x7f7d8c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.523+0000 7f7da731c700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7d8c0a1560 0x7f7d8c0a3a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7d90005950 tx=0x7f7d900058e0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.523+0000 7f7da731c700 1 -- 172.21.15.114:0/567243981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7da00ff750 msgr2=0x7f7da0101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.523+0000 7f7da731c700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7da00ff750 0x7f7da0101280 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0098e0 tx=0x7f7d9c00f720 comp rx=0 tx=0).stop 2023-10-18T14:03:12.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.524+0000 7f7da731c700 1 -- 172.21.15.114:0/567243981 shutdown_connections 2023-10-18T14:03:12.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.524+0000 7f7da731c700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7d8c0a1560 0x7f7d8c0a3a20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.524+0000 7f7da731c700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7da01056b0 0x7f7da0101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.524+0000 7f7da731c700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7da00ff750 0x7f7da0101280 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.524+0000 7f7da731c700 1 --2- 172.21.15.114:0/567243981 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7da0100110 0x7f7da01017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.524+0000 7f7da731c700 1 -- 172.21.15.114:0/567243981 >> 172.21.15.114:0/567243981 conn(0x7f7da0075790 msgr2=0x7f7da0103560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:12.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.524+0000 7f7da731c700 1 -- 172.21.15.114:0/567243981 shutdown_connections 2023-10-18T14:03:12.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.524+0000 7f7da731c700 1 -- 172.21.15.114:0/567243981 wait complete. 2023-10-18T14:03:12.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:12 smithi114 ceph-mon[99494]: pgmap v255: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-18T14:03:12.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:12 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3199248934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-18T14:03:12.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:12 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3629964457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-18T14:03:12.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:12 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/567243981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-18T14:03:12.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.876+0000 7f6f7d001700 1 -- 172.21.15.114:0/2299937056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f781020f0 msgr2=0x7f6f7810a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.876+0000 7f6f7d001700 1 --2- 172.21.15.114:0/2299937056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f781020f0 0x7f6f7810a5e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c009990 tx=0x7f6f6c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.876+0000 7f6f7d001700 1 -- 172.21.15.114:0/2299937056 shutdown_connections 2023-10-18T14:03:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.876+0000 7f6f7d001700 1 --2- 172.21.15.114:0/2299937056 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f7810ac00 0x7f6f7810d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.876+0000 7f6f7d001700 1 --2- 172.21.15.114:0/2299937056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f781017d0 0x7f6f78101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.876+0000 7f6f7d001700 1 --2- 172.21.15.114:0/2299937056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f781020f0 0x7f6f7810a5e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.876+0000 7f6f7d001700 1 -- 172.21.15.114:0/2299937056 >> 172.21.15.114:0/2299937056 conn(0x7f6f780fb040 msgr2=0x7f6f780fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:12.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.876+0000 7f6f7d001700 1 -- 172.21.15.114:0/2299937056 shutdown_connections 2023-10-18T14:03:12.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.876+0000 7f6f7d001700 1 -- 172.21.15.114:0/2299937056 wait complete. 2023-10-18T14:03:12.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.877+0000 7f6f7d001700 1 Processor -- start 2023-10-18T14:03:12.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.877+0000 7f6f7d001700 1 -- start start 2023-10-18T14:03:12.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.877+0000 7f6f7d001700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f781017d0 0x7f6f780ff430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:12.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.877+0000 7f6f7d001700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f781020f0 0x7f6f780ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:12.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.877+0000 7f6f7d001700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f7810ac00 0x7f6f780ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:12.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.877+0000 7f6f7d001700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f781a4fb0 con 0x7f6f781020f0 2023-10-18T14:03:12.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.877+0000 7f6f7d001700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f781a5120 con 0x7f6f7810ac00 2023-10-18T14:03:12.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.877+0000 7f6f7d001700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f781a52e0 con 0x7f6f781017d0 2023-10-18T14:03:12.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f7659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f781020f0 0x7f6f780ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:12.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f7659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f781020f0 0x7f6f780ff970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42946/0 (socket says 172.21.15.114:42946) 2023-10-18T14:03:12.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f7659c700 1 -- 172.21.15.114:0/3540559886 learned_addr learned my addr 172.21.15.114:0/3540559886 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:12.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f76d9d700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f781017d0 0x7f6f780ff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:12.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f7759e700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f7810ac00 0x7f6f780ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:12.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f7659c700 1 -- 172.21.15.114:0/3540559886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f781017d0 msgr2=0x7f6f780ff430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f7659c700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f781017d0 0x7f6f780ff430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f7659c700 1 -- 172.21.15.114:0/3540559886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f7810ac00 msgr2=0x7f6f780ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f7659c700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f7810ac00 0x7f6f780ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f7659c700 1 -- 172.21.15.114:0/3540559886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c0095f0 con 0x7f6f781020f0 2023-10-18T14:03:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f7759e700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f7810ac00 0x7f6f780ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f7659c700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f781020f0 0x7f6f780ff970 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c000c00 tx=0x7f6f6c00f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f5ffff700 1 -- 172.21.15.114:0/3540559886 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c01d070 con 0x7f6f781020f0 2023-10-18T14:03:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f7d001700 1 -- 172.21.15.114:0/3540559886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f781a5560 con 0x7f6f781020f0 2023-10-18T14:03:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f5ffff700 1 -- 172.21.15.114:0/3540559886 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f6c00fc30 con 0x7f6f781020f0 2023-10-18T14:03:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f5ffff700 1 -- 172.21.15.114:0/3540559886 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c0176e0 con 0x7f6f781020f0 2023-10-18T14:03:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.878+0000 7f6f7d001700 1 -- 172.21.15.114:0/3540559886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f781a5a00 con 0x7f6f781020f0 2023-10-18T14:03:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.879+0000 7f6f7d001700 1 -- 172.21.15.114:0/3540559886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f78105d30 con 0x7f6f781020f0 2023-10-18T14:03:12.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.881+0000 7f6f5ffff700 1 -- 172.21.15.114:0/3540559886 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f6f6c0229c0 con 0x7f6f781020f0 2023-10-18T14:03:12.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.882+0000 7f6f5ffff700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6f600a1560 0x7f6f600a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:12.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.882+0000 7f6f76d9d700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6f600a1560 0x7f6f600a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.882+0000 7f6f5ffff700 1 -- 172.21.15.114:0/3540559886 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f6f6c0ce8a0 con 0x7f6f781020f0 2023-10-18T14:03:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.882+0000 7f6f76d9d700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6f600a1560 0x7f6f600a3a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009a10 tx=0x7f6f68009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.885+0000 7f6f5ffff700 1 -- 172.21.15.114:0/3540559886 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6f6c097d30 con 0x7f6f781020f0 2023-10-18T14:03:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.928+0000 7efe45f4e700 1 -- 172.21.15.114:0/1033491113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe401067a0 msgr2=0x7efe40106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.928+0000 7efe45f4e700 1 --2- 172.21.15.114:0/1033491113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe401067a0 0x7efe40106b80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efe30009990 tx=0x7efe30009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.928+0000 7efe45f4e700 1 -- 172.21.15.114:0/1033491113 shutdown_connections 2023-10-18T14:03:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.928+0000 7efe45f4e700 1 --2- 172.21.15.114:0/1033491113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe40068b30 0x7efe4010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.928+0000 7efe45f4e700 1 --2- 172.21.15.114:0/1033491113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe401067a0 0x7efe40106b80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.928+0000 7efe45f4e700 1 --2- 172.21.15.114:0/1033491113 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe40068190 0x7efe400685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.928+0000 7efe45f4e700 1 -- 172.21.15.114:0/1033491113 >> 172.21.15.114:0/1033491113 conn(0x7efe40075790 msgr2=0x7efe40075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:12.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.928+0000 7efe45f4e700 1 -- 172.21.15.114:0/1033491113 shutdown_connections 2023-10-18T14:03:12.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.928+0000 7efe45f4e700 1 -- 172.21.15.114:0/1033491113 wait complete. 2023-10-18T14:03:12.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.929+0000 7efe45f4e700 1 Processor -- start 2023-10-18T14:03:12.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.929+0000 7efe45f4e700 1 -- start start 2023-10-18T14:03:12.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.929+0000 7efe45f4e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe40068190 0x7efe400ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:12.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.929+0000 7efe45f4e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe40068b30 0x7efe400ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:12.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.929+0000 7efe45f4e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe401067a0 0x7efe401002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:12.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.929+0000 7efe45f4e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe401a4f40 con 0x7efe401067a0 2023-10-18T14:03:12.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.929+0000 7efe45f4e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe401a50b0 con 0x7efe40068b30 2023-10-18T14:03:12.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.929+0000 7efe45f4e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe401a5270 con 0x7efe40068190 2023-10-18T14:03:12.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.929+0000 7efe3ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe401067a0 0x7efe401002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:12.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.929+0000 7efe3ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe401067a0 0x7efe401002a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42962/0 (socket says 172.21.15.114:42962) 2023-10-18T14:03:12.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.929+0000 7efe3ffff700 1 -- 172.21.15.114:0/337697244 learned_addr learned my addr 172.21.15.114:0/337697244 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.929+0000 7efe3f7fe700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe40068190 0x7efe400ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.929+0000 7efe3effd700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe40068b30 0x7efe400ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.930+0000 7efe3ffff700 1 -- 172.21.15.114:0/337697244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe40068190 msgr2=0x7efe400ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.930+0000 7efe3ffff700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe40068190 0x7efe400ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.930+0000 7efe3ffff700 1 -- 172.21.15.114:0/337697244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe40068b30 msgr2=0x7efe400ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.930+0000 7efe3ffff700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe40068b30 0x7efe400ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.930+0000 7efe3ffff700 1 -- 172.21.15.114:0/337697244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe300095f0 con 0x7efe401067a0 2023-10-18T14:03:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.930+0000 7efe3effd700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe40068b30 0x7efe400ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.930+0000 7efe3ffff700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe401067a0 0x7efe401002a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efe3800ef30 tx=0x7efe3800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.930+0000 7efe3cff9700 1 -- 172.21.15.114:0/337697244 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38018070 con 0x7efe401067a0 2023-10-18T14:03:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.930+0000 7efe45f4e700 1 -- 172.21.15.114:0/337697244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe401a54f0 con 0x7efe401067a0 2023-10-18T14:03:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.930+0000 7efe3cff9700 1 -- 172.21.15.114:0/337697244 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe3800f040 con 0x7efe401067a0 2023-10-18T14:03:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.930+0000 7efe3cff9700 1 -- 172.21.15.114:0/337697244 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3800cdb0 con 0x7efe401067a0 2023-10-18T14:03:12.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.930+0000 7efe45f4e700 1 -- 172.21.15.114:0/337697244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe401a59a0 con 0x7efe401067a0 2023-10-18T14:03:12.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.931+0000 7efe45f4e700 1 -- 172.21.15.114:0/337697244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe40108d50 con 0x7efe401067a0 2023-10-18T14:03:12.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.932+0000 7efe3cff9700 1 -- 172.21.15.114:0/337697244 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7efe38003a00 con 0x7efe401067a0 2023-10-18T14:03:12.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.932+0000 7efe3cff9700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efe280a1560 0x7efe280a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:12.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.933+0000 7efe3cff9700 1 -- 172.21.15.114:0/337697244 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efe380ccb50 con 0x7efe401067a0 2023-10-18T14:03:12.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.933+0000 7efe3f7fe700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efe280a1560 0x7efe280a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:12.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.933+0000 7efe3f7fe700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efe280a1560 0x7efe280a3a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efe3000b2e0 tx=0x7efe30005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:12.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:12.937+0000 7efe3cff9700 1 -- 172.21.15.114:0/337697244 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efe38096040 con 0x7efe401067a0 2023-10-18T14:03:12.961 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332130 got 219043332131 for osd.7 2023-10-18T14:03:12.961 DEBUG:teuthology.parallel:result is None 2023-10-18T14:03:13.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:12 smithi158 ceph-mon[103317]: pgmap v255: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-18T14:03:13.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:12 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3199248934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-18T14:03:13.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:12 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3629964457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-18T14:03:13.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:12 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/567243981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-18T14:03:13.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:12 smithi172 ceph-mon[103574]: pgmap v255: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-18T14:03:13.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:12 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3199248934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-18T14:03:13.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:12 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3629964457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-18T14:03:13.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:12 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/567243981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-18T14:03:13.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.106+0000 7f6f7d001700 1 -- 172.21.15.114:0/3540559886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f6f7804e4c0 con 0x7f6f781020f0 2023-10-18T14:03:13.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.107+0000 7f6f5ffff700 1 -- 172.21.15.114:0/3540559886 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f6c0b9e60 con 0x7f6f781020f0 2023-10-18T14:03:13.111 INFO:teuthology.orchestra.run.smithi114.stdout:279172874268 2023-10-18T14:03:13.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.109+0000 7f6f7d001700 1 -- 172.21.15.114:0/3540559886 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6f600a1560 msgr2=0x7f6f600a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:13.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.109+0000 7f6f7d001700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6f600a1560 0x7f6f600a3a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009a10 tx=0x7f6f68009190 comp rx=0 tx=0).stop 2023-10-18T14:03:13.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.109+0000 7f6f7d001700 1 -- 172.21.15.114:0/3540559886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f781020f0 msgr2=0x7f6f780ff970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:13.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.109+0000 7f6f7d001700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f781020f0 0x7f6f780ff970 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c000c00 tx=0x7f6f6c00f700 comp rx=0 tx=0).stop 2023-10-18T14:03:13.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.109+0000 7f6f7d001700 1 -- 172.21.15.114:0/3540559886 shutdown_connections 2023-10-18T14:03:13.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.109+0000 7f6f7d001700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6f600a1560 0x7f6f600a3a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:13.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.109+0000 7f6f7d001700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f7810ac00 0x7f6f780ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:13.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.109+0000 7f6f7d001700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f781017d0 0x7f6f780ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:13.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.109+0000 7f6f7d001700 1 --2- 172.21.15.114:0/3540559886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f781020f0 0x7f6f780ff970 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:13.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.109+0000 7f6f7d001700 1 -- 172.21.15.114:0/3540559886 >> 172.21.15.114:0/3540559886 conn(0x7f6f780fb040 msgr2=0x7f6f780fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:13.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.109+0000 7f6f7d001700 1 -- 172.21.15.114:0/3540559886 shutdown_connections 2023-10-18T14:03:13.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.109+0000 7f6f7d001700 1 -- 172.21.15.114:0/3540559886 wait complete. 2023-10-18T14:03:13.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.167+0000 7efe45f4e700 1 -- 172.21.15.114:0/337697244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7efe40101ee0 con 0x7efe401067a0 2023-10-18T14:03:13.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.168+0000 7efe3cff9700 1 -- 172.21.15.114:0/337697244 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7efe380b9090 con 0x7efe401067a0 2023-10-18T14:03:13.172 INFO:teuthology.orchestra.run.smithi114.stdout:335007449107 2023-10-18T14:03:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.170+0000 7efe45f4e700 1 -- 172.21.15.114:0/337697244 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efe280a1560 msgr2=0x7efe280a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.170+0000 7efe45f4e700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efe280a1560 0x7efe280a3a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efe3000b2e0 tx=0x7efe30005960 comp rx=0 tx=0).stop 2023-10-18T14:03:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.170+0000 7efe45f4e700 1 -- 172.21.15.114:0/337697244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe401067a0 msgr2=0x7efe401002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.170+0000 7efe45f4e700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe401067a0 0x7efe401002a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efe3800ef30 tx=0x7efe3800c3a0 comp rx=0 tx=0).stop 2023-10-18T14:03:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.170+0000 7efe45f4e700 1 -- 172.21.15.114:0/337697244 shutdown_connections 2023-10-18T14:03:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.170+0000 7efe45f4e700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efe280a1560 0x7efe280a3a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.170+0000 7efe45f4e700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe401067a0 0x7efe401002a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.170+0000 7efe45f4e700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe40068190 0x7efe400ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.170+0000 7efe45f4e700 1 --2- 172.21.15.114:0/337697244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe40068b30 0x7efe400ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.170+0000 7efe45f4e700 1 -- 172.21.15.114:0/337697244 >> 172.21.15.114:0/337697244 conn(0x7efe40075790 msgr2=0x7efe400fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.170+0000 7efe45f4e700 1 -- 172.21.15.114:0/337697244 shutdown_connections 2023-10-18T14:03:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:13.170+0000 7efe45f4e700 1 -- 172.21.15.114:0/337697244 wait complete. 2023-10-18T14:03:13.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:13 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3540559886' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-18T14:03:13.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:13 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/337697244' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-18T14:03:14.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:13 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3540559886' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-18T14:03:14.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:13 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/337697244' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-18T14:03:14.058 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874265 got 279172874268 for osd.9 2023-10-18T14:03:14.058 DEBUG:teuthology.parallel:result is None 2023-10-18T14:03:14.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:13 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3540559886' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-18T14:03:14.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:13 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/337697244' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-18T14:03:14.455 INFO:tasks.cephadm.ceph_manager.ceph:need seq 335007449105 got 335007449107 for osd.11 2023-10-18T14:03:14.455 DEBUG:teuthology.parallel:result is None 2023-10-18T14:03:14.717 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710740 got 300647710742 for osd.10 2023-10-18T14:03:14.718 DEBUG:teuthology.parallel:result is None 2023-10-18T14:03:14.941 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:14 smithi114 ceph-mon[99494]: pgmap v256: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s; 22 B/s, 1 keys/s, 1 objects/s recovering 2023-10-18T14:03:15.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:14 smithi158 ceph-mon[103317]: pgmap v256: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s; 22 B/s, 1 keys/s, 1 objects/s recovering 2023-10-18T14:03:15.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:14 smithi172 ceph-mon[103574]: pgmap v256: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s; 22 B/s, 1 keys/s, 1 objects/s recovering 2023-10-18T14:03:15.132 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103197 got 249108103199 for osd.8 2023-10-18T14:03:15.133 DEBUG:teuthology.parallel:result is None 2023-10-18T14:03:15.136 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.394+0000 7f0941e8e700 1 -- 172.21.15.114:0/3788991678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f093c069880 msgr2=0x7f093c10d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.394+0000 7f0941e8e700 1 --2- 172.21.15.114:0/3788991678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f093c069880 0x7f093c10d680 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f093400b0a0 tx=0x7f093400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.394+0000 7f0941e8e700 1 -- 172.21.15.114:0/3788991678 shutdown_connections 2023-10-18T14:03:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.394+0000 7f0941e8e700 1 --2- 172.21.15.114:0/3788991678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f093c069880 0x7f093c10d680 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.394+0000 7f0941e8e700 1 --2- 172.21.15.114:0/3788991678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c106800 0x7f093c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.394+0000 7f0941e8e700 1 --2- 172.21.15.114:0/3788991678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f093c068ec0 0x7f093c069340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.394+0000 7f0941e8e700 1 -- 172.21.15.114:0/3788991678 >> 172.21.15.114:0/3788991678 conn(0x7f093c0765e0 msgr2=0x7f093c0769f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:15.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.394+0000 7f0941e8e700 1 -- 172.21.15.114:0/3788991678 shutdown_connections 2023-10-18T14:03:15.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.394+0000 7f0941e8e700 1 -- 172.21.15.114:0/3788991678 wait complete. 2023-10-18T14:03:15.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.395+0000 7f0941e8e700 1 Processor -- start 2023-10-18T14:03:15.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.395+0000 7f0941e8e700 1 -- start start 2023-10-18T14:03:15.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.395+0000 7f0941e8e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f093c068ec0 0x7f093c196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.395+0000 7f0941e8e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c069880 0x7f093c1973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.395+0000 7f0941e8e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f093c106800 0x7f093c19b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.395+0000 7f0941e8e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c19bd10 con 0x7f093c068ec0 2023-10-18T14:03:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.395+0000 7f0941e8e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c19be80 con 0x7f093c106800 2023-10-18T14:03:15.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.395+0000 7f0941e8e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c19c040 con 0x7f093c069880 2023-10-18T14:03:15.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.395+0000 7f093b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f093c068ec0 0x7f093c196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:15.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.395+0000 7f093b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f093c068ec0 0x7f093c196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42970/0 (socket says 172.21.15.114:42970) 2023-10-18T14:03:15.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.395+0000 7f093b7fe700 1 -- 172.21.15.114:0/1346618926 learned_addr learned my addr 172.21.15.114:0/1346618926 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:15.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.395+0000 7f093bfff700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f093c106800 0x7f093c19b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:15.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.395+0000 7f093affd700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c069880 0x7f093c1973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:15.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.396+0000 7f093b7fe700 1 -- 172.21.15.114:0/1346618926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c069880 msgr2=0x7f093c1973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:15.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.396+0000 7f093b7fe700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c069880 0x7f093c1973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.396+0000 7f093b7fe700 1 -- 172.21.15.114:0/1346618926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f093c106800 msgr2=0x7f093c19b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.396+0000 7f093b7fe700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f093c106800 0x7f093c19b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.396+0000 7f093b7fe700 1 -- 172.21.15.114:0/1346618926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0934009d00 con 0x7f093c068ec0 2023-10-18T14:03:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.396+0000 7f093b7fe700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f093c068ec0 0x7f093c196e60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f093000b530 tx=0x7f093000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.396+0000 7f0938ff9700 1 -- 172.21.15.114:0/1346618926 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0930011830 con 0x7f093c068ec0 2023-10-18T14:03:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.396+0000 7f0938ff9700 1 -- 172.21.15.114:0/1346618926 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0930011e50 con 0x7f093c068ec0 2023-10-18T14:03:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.396+0000 7f0941e8e700 1 -- 172.21.15.114:0/1346618926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093c19c320 con 0x7f093c068ec0 2023-10-18T14:03:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.396+0000 7f0938ff9700 1 -- 172.21.15.114:0/1346618926 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000f2e0 con 0x7f093c068ec0 2023-10-18T14:03:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.396+0000 7f0941e8e700 1 -- 172.21.15.114:0/1346618926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093c1a3b80 con 0x7f093c068ec0 2023-10-18T14:03:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.397+0000 7f0941e8e700 1 -- 172.21.15.114:0/1346618926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093c108d60 con 0x7f093c068ec0 2023-10-18T14:03:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.398+0000 7f0938ff9700 1 -- 172.21.15.114:0/1346618926 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f0930010580 con 0x7f093c068ec0 2023-10-18T14:03:15.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.398+0000 7f0938ff9700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f09240a1560 0x7f09240a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:15.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.399+0000 7f093affd700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f09240a1560 0x7f09240a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:15.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.399+0000 7f0938ff9700 1 -- 172.21.15.114:0/1346618926 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f09300cca10 con 0x7f093c068ec0 2023-10-18T14:03:15.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.399+0000 7f093affd700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f09240a1560 0x7f09240a3a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f092c006fd0 tx=0x7f092c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:15.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.403+0000 7f0938ff9700 1 -- 172.21.15.114:0/1346618926 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0930095f20 con 0x7f093c068ec0 2023-10-18T14:03:15.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.607+0000 7f0941e8e700 1 -- 172.21.15.114:0/1346618926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f093c198120 con 0x7f093c068ec0 2023-10-18T14:03:15.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.607+0000 7f0938ff9700 1 -- 172.21.15.114:0/1346618926 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0930015090 con 0x7f093c068ec0 2023-10-18T14:03:15.612 INFO:teuthology.orchestra.run.smithi114.stdout:146028888113 2023-10-18T14:03:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.610+0000 7f0941e8e700 1 -- 172.21.15.114:0/1346618926 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f09240a1560 msgr2=0x7f09240a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:15.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.610+0000 7f0941e8e700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f09240a1560 0x7f09240a3a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f092c006fd0 tx=0x7f092c008040 comp rx=0 tx=0).stop 2023-10-18T14:03:15.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.610+0000 7f0941e8e700 1 -- 172.21.15.114:0/1346618926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f093c068ec0 msgr2=0x7f093c196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:15.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.610+0000 7f0941e8e700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f093c068ec0 0x7f093c196e60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f093000b530 tx=0x7f093000b8f0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.610+0000 7f0941e8e700 1 -- 172.21.15.114:0/1346618926 shutdown_connections 2023-10-18T14:03:15.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.610+0000 7f0941e8e700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f09240a1560 0x7f09240a3a20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.610+0000 7f0941e8e700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f093c106800 0x7f093c19b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.610+0000 7f0941e8e700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f093c068ec0 0x7f093c196e60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.610+0000 7f0941e8e700 1 --2- 172.21.15.114:0/1346618926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c069880 0x7f093c1973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.610+0000 7f0941e8e700 1 -- 172.21.15.114:0/1346618926 >> 172.21.15.114:0/1346618926 conn(0x7f093c0765e0 msgr2=0x7f093c0fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:15.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.610+0000 7f0941e8e700 1 -- 172.21.15.114:0/1346618926 shutdown_connections 2023-10-18T14:03:15.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.610+0000 7f0941e8e700 1 -- 172.21.15.114:0/1346618926 wait complete. 2023-10-18T14:03:15.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.635+0000 7f05d4f75700 1 -- 172.21.15.114:0/3712686925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d0105690 msgr2=0x7f05d0105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:15.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.635+0000 7f05d4f75700 1 --2- 172.21.15.114:0/3712686925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d0105690 0x7f05d0105a70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009990 tx=0x7f05c0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.636+0000 7f05d4f75700 1 -- 172.21.15.114:0/3712686925 shutdown_connections 2023-10-18T14:03:15.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.636+0000 7f05d4f75700 1 --2- 172.21.15.114:0/3712686925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d0100110 0x7f05d010c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.636+0000 7f05d4f75700 1 --2- 172.21.15.114:0/3712686925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d0105690 0x7f05d0105a70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.636+0000 7f05d4f75700 1 --2- 172.21.15.114:0/3712686925 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05d00ff750 0x7f05d00ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.636+0000 7f05d4f75700 1 -- 172.21.15.114:0/3712686925 >> 172.21.15.114:0/3712686925 conn(0x7f05d00757d0 msgr2=0x7f05d0075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.636+0000 7f05d4f75700 1 -- 172.21.15.114:0/3712686925 shutdown_connections 2023-10-18T14:03:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.636+0000 7f05d4f75700 1 -- 172.21.15.114:0/3712686925 wait complete. 2023-10-18T14:03:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.636+0000 7f05d4f75700 1 Processor -- start 2023-10-18T14:03:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.636+0000 7f05d4f75700 1 -- start start 2023-10-18T14:03:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05d4f75700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d00ff750 0x7f05d019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05d4f75700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d0100110 0x7f05d019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05d4f75700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05d0105690 0x7f05d0196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05d4f75700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01970b0 con 0x7f05d00ff750 2023-10-18T14:03:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05d4f75700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0197220 con 0x7f05d0105690 2023-10-18T14:03:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05d4f75700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01973e0 con 0x7f05d0100110 2023-10-18T14:03:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05ce59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d00ff750 0x7f05d019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:15.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05ce59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d00ff750 0x7f05d019c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42984/0 (socket says 172.21.15.114:42984) 2023-10-18T14:03:15.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05ce59c700 1 -- 172.21.15.114:0/2328359778 learned_addr learned my addr 172.21.15.114:0/2328359778 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:15.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05ced9d700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05d0105690 0x7f05d0196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:15.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05cdd9b700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d0100110 0x7f05d019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:15.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05ce59c700 1 -- 172.21.15.114:0/2328359778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d0100110 msgr2=0x7f05d019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:15.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05ce59c700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d0100110 0x7f05d019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05ce59c700 1 -- 172.21.15.114:0/2328359778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05d0105690 msgr2=0x7f05d0196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:15.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05ce59c700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05d0105690 0x7f05d0196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05ce59c700 1 -- 172.21.15.114:0/2328359778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c00095f0 con 0x7f05d00ff750 2023-10-18T14:03:15.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05ced9d700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05d0105690 0x7f05d0196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:15.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05cdd9b700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d0100110 0x7f05d019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:15.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05ce59c700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d00ff750 0x7f05d019c910 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f05c0000c00 tx=0x7f05c000f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:15.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05bf7fe700 1 -- 172.21.15.114:0/2328359778 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c001d070 con 0x7f05d00ff750 2023-10-18T14:03:15.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.637+0000 7f05bf7fe700 1 -- 172.21.15.114:0/2328359778 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05c000fde0 con 0x7f05d00ff750 2023-10-18T14:03:15.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.638+0000 7f05d4f75700 1 -- 172.21.15.114:0/2328359778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d0197660 con 0x7f05d00ff750 2023-10-18T14:03:15.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.638+0000 7f05bf7fe700 1 -- 172.21.15.114:0/2328359778 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0017770 con 0x7f05d00ff750 2023-10-18T14:03:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.638+0000 7f05d4f75700 1 -- 172.21.15.114:0/2328359778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d01a3900 con 0x7f05d00ff750 2023-10-18T14:03:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.639+0000 7f05d4f75700 1 -- 172.21.15.114:0/2328359778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d0108ca0 con 0x7f05d00ff750 2023-10-18T14:03:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.639+0000 7f05bf7fe700 1 -- 172.21.15.114:0/2328359778 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f05c0022aa0 con 0x7f05d00ff750 2023-10-18T14:03:15.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.640+0000 7f05bf7fe700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f05b80a15e0 0x7f05b80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:15.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.640+0000 7f05cdd9b700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f05b80a15e0 0x7f05b80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:15.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.640+0000 7f05bf7fe700 1 -- 172.21.15.114:0/2328359778 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f05c00ce390 con 0x7f05d00ff750 2023-10-18T14:03:15.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.640+0000 7f05cdd9b700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f05b80a15e0 0x7f05b80a3aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05c4005fd0 tx=0x7f05c4005e20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:15.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.644+0000 7f05bf7fe700 1 -- 172.21.15.114:0/2328359778 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f05c005d100 con 0x7f05d00ff750 2023-10-18T14:03:15.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:15 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1346618926' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-18T14:03:15.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.849+0000 7f05d4f75700 1 -- 172.21.15.114:0/2328359778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f05d0100dd0 con 0x7f05d00ff750 2023-10-18T14:03:15.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.850+0000 7f05bf7fe700 1 -- 172.21.15.114:0/2328359778 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05c0027090 con 0x7f05d00ff750 2023-10-18T14:03:15.855 INFO:teuthology.orchestra.run.smithi114.stdout:81604378682 2023-10-18T14:03:15.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.852+0000 7f05d4f75700 1 -- 172.21.15.114:0/2328359778 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f05b80a15e0 msgr2=0x7f05b80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:15.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.852+0000 7f05d4f75700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f05b80a15e0 0x7f05b80a3aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05c4005fd0 tx=0x7f05c4005e20 comp rx=0 tx=0).stop 2023-10-18T14:03:15.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.852+0000 7f05d4f75700 1 -- 172.21.15.114:0/2328359778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d00ff750 msgr2=0x7f05d019c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:15.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.852+0000 7f05d4f75700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d00ff750 0x7f05d019c910 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f05c0000c00 tx=0x7f05c000f880 comp rx=0 tx=0).stop 2023-10-18T14:03:15.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.852+0000 7f05d4f75700 1 -- 172.21.15.114:0/2328359778 shutdown_connections 2023-10-18T14:03:15.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.852+0000 7f05d4f75700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f05b80a15e0 0x7f05b80a3aa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.852+0000 7f05d4f75700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f05d0105690 0x7f05d0196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.852+0000 7f05d4f75700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d00ff750 0x7f05d019c910 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.852+0000 7f05d4f75700 1 --2- 172.21.15.114:0/2328359778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d0100110 0x7f05d019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:15.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.852+0000 7f05d4f75700 1 -- 172.21.15.114:0/2328359778 >> 172.21.15.114:0/2328359778 conn(0x7f05d00757d0 msgr2=0x7f05d0069160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:15.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.852+0000 7f05d4f75700 1 -- 172.21.15.114:0/2328359778 shutdown_connections 2023-10-18T14:03:15.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:15.852+0000 7f05d4f75700 1 -- 172.21.15.114:0/2328359778 wait complete. 2023-10-18T14:03:16.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:15 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1346618926' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-18T14:03:16.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:15 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1346618926' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-18T14:03:16.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.107+0000 7f6c9011f700 1 -- 172.21.15.114:0/1202286705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c881008a0 msgr2=0x7f6c88100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:16.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.107+0000 7f6c9011f700 1 --2- 172.21.15.114:0/1202286705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c881008a0 0x7f6c88100d20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009990 tx=0x7f6c7c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:16.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.107+0000 7f6c9011f700 1 -- 172.21.15.114:0/1202286705 shutdown_connections 2023-10-18T14:03:16.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.107+0000 7f6c9011f700 1 --2- 172.21.15.114:0/1202286705 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c88101260 0x7f6c8810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:16.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.107+0000 7f6c9011f700 1 --2- 172.21.15.114:0/1202286705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c881057c0 0x7f6c88105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:16.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.107+0000 7f6c9011f700 1 --2- 172.21.15.114:0/1202286705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c881008a0 0x7f6c88100d20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:16.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.107+0000 7f6c9011f700 1 -- 172.21.15.114:0/1202286705 >> 172.21.15.114:0/1202286705 conn(0x7f6c880779e0 msgr2=0x7f6c88077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:16.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.107+0000 7f6c9011f700 1 -- 172.21.15.114:0/1202286705 shutdown_connections 2023-10-18T14:03:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.107+0000 7f6c9011f700 1 -- 172.21.15.114:0/1202286705 wait complete. 2023-10-18T14:03:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.108+0000 7f6c9011f700 1 Processor -- start 2023-10-18T14:03:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.108+0000 7f6c9011f700 1 -- start start 2023-10-18T14:03:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.108+0000 7f6c9011f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c881008a0 0x7f6c8819c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.108+0000 7f6c9011f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c88101260 0x7f6c8819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:16.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.108+0000 7f6c9011f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c881057c0 0x7f6c88196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:16.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.108+0000 7f6c9011f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88197110 con 0x7f6c88101260 2023-10-18T14:03:16.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.108+0000 7f6c9011f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88197280 con 0x7f6c881008a0 2023-10-18T14:03:16.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.108+0000 7f6c9011f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88197440 con 0x7f6c881057c0 2023-10-18T14:03:16.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.108+0000 7f6c8d6ba700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c88101260 0x7f6c8819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.108+0000 7f6c8d6ba700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c88101260 0x7f6c8819ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43000/0 (socket says 172.21.15.114:43000) 2023-10-18T14:03:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.108+0000 7f6c8d6ba700 1 -- 172.21.15.114:0/1440658741 learned_addr learned my addr 172.21.15.114:0/1440658741 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.108+0000 7f6c8debb700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c881008a0 0x7f6c8819c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.109+0000 7f6c8e6bc700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c881057c0 0x7f6c88196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.109+0000 7f6c8d6ba700 1 -- 172.21.15.114:0/1440658741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c881057c0 msgr2=0x7f6c88196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:16.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.109+0000 7f6c8d6ba700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c881057c0 0x7f6c88196ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:16.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.109+0000 7f6c8d6ba700 1 -- 172.21.15.114:0/1440658741 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c881008a0 msgr2=0x7f6c8819c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:16.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.109+0000 7f6c8d6ba700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c881008a0 0x7f6c8819c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:16.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.109+0000 7f6c8d6ba700 1 -- 172.21.15.114:0/1440658741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0095f0 con 0x7f6c88101260 2023-10-18T14:03:16.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.109+0000 7f6c8e6bc700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c881057c0 0x7f6c88196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:16.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.109+0000 7f6c8d6ba700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c88101260 0x7f6c8819ceb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c000c00 tx=0x7f6c7c00f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:16.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.109+0000 7f6c7affd700 1 -- 172.21.15.114:0/1440658741 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c01d070 con 0x7f6c88101260 2023-10-18T14:03:16.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.109+0000 7f6c7affd700 1 -- 172.21.15.114:0/1440658741 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c7c00fde0 con 0x7f6c88101260 2023-10-18T14:03:16.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.109+0000 7f6c7affd700 1 -- 172.21.15.114:0/1440658741 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c017770 con 0x7f6c88101260 2023-10-18T14:03:16.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.109+0000 7f6c9011f700 1 -- 172.21.15.114:0/1440658741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c881976c0 con 0x7f6c88101260 2023-10-18T14:03:16.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.109+0000 7f6c9011f700 1 -- 172.21.15.114:0/1440658741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c881a3960 con 0x7f6c88101260 2023-10-18T14:03:16.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.110+0000 7f6c9011f700 1 -- 172.21.15.114:0/1440658741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c88108d80 con 0x7f6c88101260 2023-10-18T14:03:16.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.111+0000 7f6c7affd700 1 -- 172.21.15.114:0/1440658741 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f6c7c022aa0 con 0x7f6c88101260 2023-10-18T14:03:16.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.111+0000 7f6c7affd700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6c740a15e0 0x7f6c740a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:16.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.111+0000 7f6c8debb700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6c740a15e0 0x7f6c740a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:16.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.111+0000 7f6c7affd700 1 -- 172.21.15.114:0/1440658741 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f6c7c0ce390 con 0x7f6c88101260 2023-10-18T14:03:16.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.112+0000 7f6c8debb700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6c740a15e0 0x7f6c740a3aa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c84006fd0 tx=0x7f6c84008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:16.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.116+0000 7f6c7affd700 1 -- 172.21.15.114:0/1440658741 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6c7c05d100 con 0x7f6c88101260 2023-10-18T14:03:16.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.316+0000 7f6c9011f700 1 -- 172.21.15.114:0/1440658741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6c88101f30 con 0x7f6c88101260 2023-10-18T14:03:16.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.316+0000 7f6c7affd700 1 -- 172.21.15.114:0/1440658741 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c7c027090 con 0x7f6c88101260 2023-10-18T14:03:16.321 INFO:teuthology.orchestra.run.smithi114.stdout:38654705729 2023-10-18T14:03:16.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.319+0000 7f6c9011f700 1 -- 172.21.15.114:0/1440658741 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6c740a15e0 msgr2=0x7f6c740a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.319+0000 7f6c9011f700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6c740a15e0 0x7f6c740a3aa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c84006fd0 tx=0x7f6c84008040 comp rx=0 tx=0).stop 2023-10-18T14:03:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.319+0000 7f6c9011f700 1 -- 172.21.15.114:0/1440658741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c88101260 msgr2=0x7f6c8819ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.319+0000 7f6c9011f700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c88101260 0x7f6c8819ceb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c000c00 tx=0x7f6c7c00f880 comp rx=0 tx=0).stop 2023-10-18T14:03:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.319+0000 7f6c9011f700 1 -- 172.21.15.114:0/1440658741 shutdown_connections 2023-10-18T14:03:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.319+0000 7f6c9011f700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6c740a15e0 0x7f6c740a3aa0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.319+0000 7f6c9011f700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c881057c0 0x7f6c88196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.319+0000 7f6c9011f700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6c881008a0 0x7f6c8819c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.319+0000 7f6c9011f700 1 --2- 172.21.15.114:0/1440658741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c88101260 0x7f6c8819ceb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.319+0000 7f6c9011f700 1 -- 172.21.15.114:0/1440658741 >> 172.21.15.114:0/1440658741 conn(0x7f6c880779e0 msgr2=0x7f6c880fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.319+0000 7f6c9011f700 1 -- 172.21.15.114:0/1440658741 shutdown_connections 2023-10-18T14:03:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:16.319+0000 7f6c9011f700 1 -- 172.21.15.114:0/1440658741 wait complete. 2023-10-18T14:03:16.664 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888111 got 146028888113 for osd.4 2023-10-18T14:03:16.664 DEBUG:teuthology.parallel:result is None 2023-10-18T14:03:16.871 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:16 smithi114 ceph-mon[99494]: pgmap v257: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s; 22 B/s, 1 keys/s, 1 objects/s recovering 2023-10-18T14:03:16.871 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:16 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2328359778' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-18T14:03:16.872 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:16 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1440658741' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-18T14:03:17.006 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705727 got 38654705729 for osd.0 2023-10-18T14:03:17.006 DEBUG:teuthology.parallel:result is None 2023-10-18T14:03:17.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:16 smithi158 ceph-mon[103317]: pgmap v257: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s; 22 B/s, 1 keys/s, 1 objects/s recovering 2023-10-18T14:03:17.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:16 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2328359778' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-18T14:03:17.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:16 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1440658741' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-18T14:03:17.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:16 smithi172 ceph-mon[103574]: pgmap v257: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s; 22 B/s, 1 keys/s, 1 objects/s recovering 2023-10-18T14:03:17.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:16 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2328359778' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-18T14:03:17.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:16 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1440658741' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-18T14:03:17.333 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378680 got 81604378682 for osd.2 2023-10-18T14:03:17.333 DEBUG:teuthology.parallel:result is None 2023-10-18T14:03:17.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.437+0000 7f58093c3700 1 -- 172.21.15.114:0/2676364175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58040ffe50 msgr2=0x7f58041002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:17.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.437+0000 7f58093c3700 1 --2- 172.21.15.114:0/2676364175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58040ffe50 0x7f58041002d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009990 tx=0x7f57ec009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:17.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.437+0000 7f58093c3700 1 -- 172.21.15.114:0/2676364175 shutdown_connections 2023-10-18T14:03:17.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.437+0000 7f58093c3700 1 --2- 172.21.15.114:0/2676364175 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5804100810 0x7f580410c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:17.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.437+0000 7f58093c3700 1 --2- 172.21.15.114:0/2676364175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58041056c0 0x7f5804105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:17.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.437+0000 7f58093c3700 1 --2- 172.21.15.114:0/2676364175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58040ffe50 0x7f58041002d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:17.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.437+0000 7f58093c3700 1 -- 172.21.15.114:0/2676364175 >> 172.21.15.114:0/2676364175 conn(0x7f5804075cf0 msgr2=0x7f58040fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:17.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.437+0000 7f58093c3700 1 -- 172.21.15.114:0/2676364175 shutdown_connections 2023-10-18T14:03:17.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.437+0000 7f58093c3700 1 -- 172.21.15.114:0/2676364175 wait complete. 2023-10-18T14:03:17.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f58093c3700 1 Processor -- start 2023-10-18T14:03:17.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f58093c3700 1 -- start start 2023-10-18T14:03:17.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f58093c3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58040ffe50 0x7f5804197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:17.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f58093c3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5804100810 0x7f5804197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:17.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f58093c3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58041056c0 0x7f58041a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:17.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f58093c3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5804198860 con 0x7f5804100810 2023-10-18T14:03:17.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f58093c3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58041a3020 con 0x7f58040ffe50 2023-10-18T14:03:17.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f58093c3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58041a3160 con 0x7f58041056c0 2023-10-18T14:03:17.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f57fbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5804100810 0x7f5804197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:17.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f57fbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5804100810 0x7f5804197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43012/0 (socket says 172.21.15.114:43012) 2023-10-18T14:03:17.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f57fbfff700 1 -- 172.21.15.114:0/442523529 learned_addr learned my addr 172.21.15.114:0/442523529 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:17.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f5802ffd700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58040ffe50 0x7f5804197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:17.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f58037fe700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58041056c0 0x7f58041a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:17.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f57fbfff700 1 -- 172.21.15.114:0/442523529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58041056c0 msgr2=0x7f58041a2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:17.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f57fbfff700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58041056c0 0x7f58041a2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:17.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f57fbfff700 1 -- 172.21.15.114:0/442523529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58040ffe50 msgr2=0x7f5804197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:17.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f57fbfff700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58040ffe50 0x7f5804197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:17.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f57fbfff700 1 -- 172.21.15.114:0/442523529 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ec0095f0 con 0x7f5804100810 2023-10-18T14:03:17.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f5802ffd700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58040ffe50 0x7f5804197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:17.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f58037fe700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58041056c0 0x7f58041a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:17.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f57fbfff700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5804100810 0x7f5804197fa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0095c0 tx=0x7f57ec00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:17.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.438+0000 7f5800ff9700 1 -- 172.21.15.114:0/442523529 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec01d070 con 0x7f5804100810 2023-10-18T14:03:17.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.439+0000 7f58093c3700 1 -- 172.21.15.114:0/442523529 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58041a3380 con 0x7f5804100810 2023-10-18T14:03:17.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.439+0000 7f5800ff9700 1 -- 172.21.15.114:0/442523529 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57ec0054f0 con 0x7f5804100810 2023-10-18T14:03:17.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.439+0000 7f5800ff9700 1 -- 172.21.15.114:0/442523529 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec004c40 con 0x7f5804100810 2023-10-18T14:03:17.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.439+0000 7f58093c3700 1 -- 172.21.15.114:0/442523529 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58041a3790 con 0x7f5804100810 2023-10-18T14:03:17.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.439+0000 7f58093c3700 1 -- 172.21.15.114:0/442523529 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5804107c50 con 0x7f5804100810 2023-10-18T14:03:17.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.441+0000 7f5800ff9700 1 -- 172.21.15.114:0/442523529 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f57ec00fc30 con 0x7f5804100810 2023-10-18T14:03:17.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.442+0000 7f5800ff9700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f57f00a1560 0x7f57f00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:17.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.442+0000 7f5802ffd700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f57f00a1560 0x7f57f00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:17.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.442+0000 7f5800ff9700 1 -- 172.21.15.114:0/442523529 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f57ec0ce200 con 0x7f5804100810 2023-10-18T14:03:17.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.442+0000 7f5802ffd700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f57f00a1560 0x7f57f00a3a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f57f4005e10 tx=0x7f57f4005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:17.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.445+0000 7f5800ff9700 1 -- 172.21.15.114:0/442523529 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f57ec0976f0 con 0x7f5804100810 2023-10-18T14:03:17.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.637+0000 7f58093c3700 1 -- 172.21.15.114:0/442523529 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5804100e60 con 0x7f5804100810 2023-10-18T14:03:17.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.637+0000 7f5800ff9700 1 -- 172.21.15.114:0/442523529 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57ec09ad10 con 0x7f5804100810 2023-10-18T14:03:17.641 INFO:teuthology.orchestra.run.smithi114.stdout:197568495657 2023-10-18T14:03:17.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.639+0000 7f58093c3700 1 -- 172.21.15.114:0/442523529 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f57f00a1560 msgr2=0x7f57f00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:17.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.639+0000 7f58093c3700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f57f00a1560 0x7f57f00a3a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f57f4005e10 tx=0x7f57f4005d60 comp rx=0 tx=0).stop 2023-10-18T14:03:17.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.639+0000 7f58093c3700 1 -- 172.21.15.114:0/442523529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5804100810 msgr2=0x7f5804197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:17.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.639+0000 7f58093c3700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5804100810 0x7f5804197fa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0095c0 tx=0x7f57ec00f740 comp rx=0 tx=0).stop 2023-10-18T14:03:17.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.639+0000 7f58093c3700 1 -- 172.21.15.114:0/442523529 shutdown_connections 2023-10-18T14:03:17.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.639+0000 7f58093c3700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f57f00a1560 0x7f57f00a3a20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:17.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.639+0000 7f58093c3700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58041056c0 0x7f58041a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:17.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.639+0000 7f58093c3700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f58040ffe50 0x7f5804197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:17.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.639+0000 7f58093c3700 1 --2- 172.21.15.114:0/442523529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5804100810 0x7f5804197fa0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:17.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.639+0000 7f58093c3700 1 -- 172.21.15.114:0/442523529 >> 172.21.15.114:0/442523529 conn(0x7f5804075cf0 msgr2=0x7f5804102560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:17.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.639+0000 7f58093c3700 1 -- 172.21.15.114:0/442523529 shutdown_connections 2023-10-18T14:03:17.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:17.639+0000 7f58093c3700 1 -- 172.21.15.114:0/442523529 wait complete. 2023-10-18T14:03:18.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:17 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/442523529' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-18T14:03:18.034 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:17 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/442523529' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-18T14:03:18.043 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495655 got 197568495657 for osd.6 2023-10-18T14:03:18.044 DEBUG:teuthology.parallel:result is None 2023-10-18T14:03:18.044 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-18T14:03:18.044 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph pg dump --format=json 2023-10-18T14:03:18.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:17 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/442523529' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-18T14:03:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:19.010 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:18 smithi114 ceph-mon[99494]: pgmap v258: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 205 B/s wr, 9 op/s; 18 B/s, 1 keys/s, 0 objects/s recovering 2023-10-18T14:03:19.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:18 smithi158 ceph-mon[103317]: pgmap v258: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 205 B/s wr, 9 op/s; 18 B/s, 1 keys/s, 0 objects/s recovering 2023-10-18T14:03:19.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:18 smithi172 ceph-mon[103574]: pgmap v258: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 205 B/s wr, 9 op/s; 18 B/s, 1 keys/s, 0 objects/s recovering 2023-10-18T14:03:19.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.831+0000 7fd916bfd700 1 -- 172.21.15.114:0/4281416833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9101058d0 msgr2=0x7fd910105cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:19.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.831+0000 7fd916bfd700 1 --2- 172.21.15.114:0/4281416833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9101058d0 0x7fd910105cb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd904009990 tx=0x7fd904009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:19.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.831+0000 7fd916bfd700 1 -- 172.21.15.114:0/4281416833 shutdown_connections 2023-10-18T14:03:19.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.831+0000 7fd916bfd700 1 --2- 172.21.15.114:0/4281416833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9100ffb30 0x7fd91010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:19.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.831+0000 7fd916bfd700 1 --2- 172.21.15.114:0/4281416833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9101058d0 0x7fd910105cb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:19.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.831+0000 7fd916bfd700 1 --2- 172.21.15.114:0/4281416833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9100ff190 0x7fd9100ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:19.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.831+0000 7fd916bfd700 1 -- 172.21.15.114:0/4281416833 >> 172.21.15.114:0/4281416833 conn(0x7fd910074a10 msgr2=0x7fd910074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:19.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.831+0000 7fd916bfd700 1 -- 172.21.15.114:0/4281416833 shutdown_connections 2023-10-18T14:03:19.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.831+0000 7fd916bfd700 1 -- 172.21.15.114:0/4281416833 wait complete. 2023-10-18T14:03:19.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd916bfd700 1 Processor -- start 2023-10-18T14:03:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd916bfd700 1 -- start start 2023-10-18T14:03:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd916bfd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9100ff190 0x7fd91019c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd916bfd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9100ffb30 0x7fd91019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd916bfd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9101058d0 0x7fd910196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd916bfd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9101970a0 con 0x7fd9100ffb30 2023-10-18T14:03:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd916bfd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd910197210 con 0x7fd9101058d0 2023-10-18T14:03:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd916bfd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9101973d0 con 0x7fd9100ff190 2023-10-18T14:03:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd90ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9100ffb30 0x7fd91019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd90ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9100ffb30 0x7fd91019ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43026/0 (socket says 172.21.15.114:43026) 2023-10-18T14:03:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd90ffff700 1 -- 172.21.15.114:0/2287565645 learned_addr learned my addr 172.21.15.114:0/2287565645 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd91519a700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9101058d0 0x7fd910196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:19.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd914999700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9100ff190 0x7fd91019c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:19.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd90ffff700 1 -- 172.21.15.114:0/2287565645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9100ff190 msgr2=0x7fd91019c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:19.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd90ffff700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9100ff190 0x7fd91019c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:19.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd90ffff700 1 -- 172.21.15.114:0/2287565645 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9101058d0 msgr2=0x7fd910196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:19.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd90ffff700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9101058d0 0x7fd910196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:19.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.832+0000 7fd90ffff700 1 -- 172.21.15.114:0/2287565645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9040095f0 con 0x7fd9100ffb30 2023-10-18T14:03:19.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.833+0000 7fd914999700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9100ff190 0x7fd91019c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:19.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.833+0000 7fd90ffff700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9100ffb30 0x7fd91019ce40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00d950 tx=0x7fd8fc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:19.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.833+0000 7fd90dffb700 1 -- 172.21.15.114:0/2287565645 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc009b40 con 0x7fd9100ffb30 2023-10-18T14:03:19.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.833+0000 7fd90dffb700 1 -- 172.21.15.114:0/2287565645 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8fc009ca0 con 0x7fd9100ffb30 2023-10-18T14:03:19.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.833+0000 7fd90dffb700 1 -- 172.21.15.114:0/2287565645 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc00f620 con 0x7fd9100ffb30 2023-10-18T14:03:19.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.833+0000 7fd916bfd700 1 -- 172.21.15.114:0/2287565645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9101976b0 con 0x7fd9100ffb30 2023-10-18T14:03:19.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.833+0000 7fd916bfd700 1 -- 172.21.15.114:0/2287565645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9101a38f0 con 0x7fd9100ffb30 2023-10-18T14:03:19.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.834+0000 7fd916bfd700 1 -- 172.21.15.114:0/2287565645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd910108d30 con 0x7fd9100ffb30 2023-10-18T14:03:19.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.835+0000 7fd90dffb700 1 -- 172.21.15.114:0/2287565645 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fd8fc010460 con 0x7fd9100ffb30 2023-10-18T14:03:19.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.835+0000 7fd90dffb700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd9000a1560 0x7fd9000a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:19.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.836+0000 7fd914999700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd9000a1560 0x7fd9000a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:19.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.836+0000 7fd90dffb700 1 -- 172.21.15.114:0/2287565645 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd8fc0cd320 con 0x7fd9100ffb30 2023-10-18T14:03:19.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.836+0000 7fd914999700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd9000a1560 0x7fd9000a3a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd90400b5c0 tx=0x7fd904005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:19.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:19.840+0000 7fd90dffb700 1 -- 172.21.15.114:0/2287565645 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd8fc096780 con 0x7fd9100ffb30 2023-10-18T14:03:20.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.026+0000 7fd916bfd700 1 -- 172.21.15.114:0/2287565645 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd910197f00 con 0x7fd9000a1560 2023-10-18T14:03:20.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.036+0000 7fd90dffb700 1 -- 172.21.15.114:0/2287565645 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341601 (secure 0 0 0) 0x7fd910197f00 con 0x7fd9000a1560 2023-10-18T14:03:20.043 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:20.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.039+0000 7fd916bfd700 1 -- 172.21.15.114:0/2287565645 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd9000a1560 msgr2=0x7fd9000a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:20.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.039+0000 7fd916bfd700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd9000a1560 0x7fd9000a3a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd90400b5c0 tx=0x7fd904005fb0 comp rx=0 tx=0).stop 2023-10-18T14:03:20.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.039+0000 7fd916bfd700 1 -- 172.21.15.114:0/2287565645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9100ffb30 msgr2=0x7fd91019ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:20.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.039+0000 7fd916bfd700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9100ffb30 0x7fd91019ce40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00d950 tx=0x7fd8fc00dd10 comp rx=0 tx=0).stop 2023-10-18T14:03:20.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.039+0000 7fd916bfd700 1 -- 172.21.15.114:0/2287565645 shutdown_connections 2023-10-18T14:03:20.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.039+0000 7fd916bfd700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd9000a1560 0x7fd9000a3a20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:20.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.039+0000 7fd916bfd700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9101058d0 0x7fd910196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:20.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.039+0000 7fd916bfd700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9100ff190 0x7fd91019c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:20.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.039+0000 7fd916bfd700 1 --2- 172.21.15.114:0/2287565645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9100ffb30 0x7fd91019ce40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:20.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.039+0000 7fd916bfd700 1 -- 172.21.15.114:0/2287565645 >> 172.21.15.114:0/2287565645 conn(0x7fd910074a10 msgr2=0x7fd9100fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:20.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.039+0000 7fd916bfd700 1 -- 172.21.15.114:0/2287565645 shutdown_connections 2023-10-18T14:03:20.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:20.039+0000 7fd916bfd700 1 -- 172.21.15.114:0/2287565645 wait complete. 2023-10-18T14:03:20.048 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T14:03:20.460 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2023-10-18T14:03:19.569417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656001,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":555,"num_read_kb":397,"num_write":412,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180916,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335716,"kb_used_data":11448,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606108,"statfs":{"total":1151940427776,"available":1151596654592,"internally_reserved":0,"allocated":11722752,"data_stored":7463477,"data_compressed":177861,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":51,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":180,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.942254"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631494+0000","last_change":"2023-10-18T14:02:32.447514+0000","last_active":"2023-10-18T14:03:07.631494+0000","last_peered":"2023-10-18T14:03:07.631494+0000","last_clean":"2023-10-18T14:03:07.631494+0000","last_became_active":"2023-10-18T14:02:32.447109+0000","last_became_peered":"2023-10-18T14:02:32.447109+0000","last_unstale":"2023-10-18T14:03:07.631494+0000","last_undegraded":"2023-10-18T14:03:07.631494+0000","last_fullsized":"2023-10-18T14:03:07.631494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:02:52.453371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631611+0000","last_change":"2023-10-18T14:02:32.457696+0000","last_active":"2023-10-18T14:03:07.631611+0000","last_peered":"2023-10-18T14:03:07.631611+0000","last_clean":"2023-10-18T14:03:07.631611+0000","last_became_active":"2023-10-18T14:02:32.457380+0000","last_became_peered":"2023-10-18T14:02:32.457380+0000","last_unstale":"2023-10-18T14:03:07.631611+0000","last_undegraded":"2023-10-18T14:03:07.631611+0000","last_fullsized":"2023-10-18T14:03:07.631611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:09:09.303044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632120+0000","last_change":"2023-10-18T14:02:32.450312+0000","last_active":"2023-10-18T14:03:07.632120+0000","last_peered":"2023-10-18T14:03:07.632120+0000","last_clean":"2023-10-18T14:03:07.632120+0000","last_became_active":"2023-10-18T14:02:32.449994+0000","last_became_peered":"2023-10-18T14:02:32.449994+0000","last_unstale":"2023-10-18T14:03:07.632120+0000","last_undegraded":"2023-10-18T14:03:07.632120+0000","last_fullsized":"2023-10-18T14:03:07.632120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:28:32.445958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628336+0000","last_change":"2023-10-18T14:02:32.450511+0000","last_active":"2023-10-18T14:03:07.628336+0000","last_peered":"2023-10-18T14:03:07.628336+0000","last_clean":"2023-10-18T14:03:07.628336+0000","last_became_active":"2023-10-18T14:02:32.450105+0000","last_became_peered":"2023-10-18T14:02:32.450105+0000","last_unstale":"2023-10-18T14:03:07.628336+0000","last_undegraded":"2023-10-18T14:03:07.628336+0000","last_fullsized":"2023-10-18T14:03:07.628336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:24:52.054236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630046+0000","last_change":"2023-10-18T14:02:32.447099+0000","last_active":"2023-10-18T14:03:07.630046+0000","last_peered":"2023-10-18T14:03:07.630046+0000","last_clean":"2023-10-18T14:03:07.630046+0000","last_became_active":"2023-10-18T14:02:32.446812+0000","last_became_peered":"2023-10-18T14:02:32.446812+0000","last_unstale":"2023-10-18T14:03:07.630046+0000","last_undegraded":"2023-10-18T14:03:07.630046+0000","last_fullsized":"2023-10-18T14:03:07.630046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:11:10.895149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632396+0000","last_change":"2023-10-18T14:02:32.444055+0000","last_active":"2023-10-18T14:03:07.632396+0000","last_peered":"2023-10-18T14:03:07.632396+0000","last_clean":"2023-10-18T14:03:07.632396+0000","last_became_active":"2023-10-18T14:02:32.443750+0000","last_became_peered":"2023-10-18T14:02:32.443750+0000","last_unstale":"2023-10-18T14:03:07.632396+0000","last_undegraded":"2023-10-18T14:03:07.632396+0000","last_fullsized":"2023-10-18T14:03:07.632396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:05:37.783713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630037+0000","last_change":"2023-10-18T14:02:32.462147+0000","last_active":"2023-10-18T14:03:07.630037+0000","last_peered":"2023-10-18T14:03:07.630037+0000","last_clean":"2023-10-18T14:03:07.630037+0000","last_became_active":"2023-10-18T14:02:32.461712+0000","last_became_peered":"2023-10-18T14:02:32.461712+0000","last_unstale":"2023-10-18T14:03:07.630037+0000","last_undegraded":"2023-10-18T14:03:07.630037+0000","last_fullsized":"2023-10-18T14:03:07.630037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:10:39.936092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631949+0000","last_change":"2023-10-18T14:02:32.449466+0000","last_active":"2023-10-18T14:03:07.631949+0000","last_peered":"2023-10-18T14:03:07.631949+0000","last_clean":"2023-10-18T14:03:07.631949+0000","last_became_active":"2023-10-18T14:02:32.449146+0000","last_became_peered":"2023-10-18T14:02:32.449146+0000","last_unstale":"2023-10-18T14:03:07.631949+0000","last_undegraded":"2023-10-18T14:03:07.631949+0000","last_fullsized":"2023-10-18T14:03:07.631949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:28.427003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634152+0000","last_change":"2023-10-18T14:02:32.448901+0000","last_active":"2023-10-18T14:03:07.634152+0000","last_peered":"2023-10-18T14:03:07.634152+0000","last_clean":"2023-10-18T14:03:07.634152+0000","last_became_active":"2023-10-18T14:02:32.448379+0000","last_became_peered":"2023-10-18T14:02:32.448379+0000","last_unstale":"2023-10-18T14:03:07.634152+0000","last_undegraded":"2023-10-18T14:03:07.634152+0000","last_fullsized":"2023-10-18T14:03:07.634152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:53:22.743915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632688+0000","last_change":"2023-10-18T14:02:32.446575+0000","last_active":"2023-10-18T14:03:07.632688+0000","last_peered":"2023-10-18T14:03:07.632688+0000","last_clean":"2023-10-18T14:03:07.632688+0000","last_became_active":"2023-10-18T14:02:32.445756+0000","last_became_peered":"2023-10-18T14:02:32.445756+0000","last_unstale":"2023-10-18T14:03:07.632688+0000","last_undegraded":"2023-10-18T14:03:07.632688+0000","last_fullsized":"2023-10-18T14:03:07.632688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:55.490373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630414+0000","last_change":"2023-10-18T14:02:32.460943+0000","last_active":"2023-10-18T14:03:07.630414+0000","last_peered":"2023-10-18T14:03:07.630414+0000","last_clean":"2023-10-18T14:03:07.630414+0000","last_became_active":"2023-10-18T14:02:32.460540+0000","last_became_peered":"2023-10-18T14:02:32.460540+0000","last_unstale":"2023-10-18T14:03:07.630414+0000","last_undegraded":"2023-10-18T14:03:07.630414+0000","last_fullsized":"2023-10-18T14:03:07.630414+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:44:59.309663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628177+0000","last_change":"2023-10-18T14:02:32.450665+0000","last_active":"2023-10-18T14:03:07.628177+0000","last_peered":"2023-10-18T14:03:07.628177+0000","last_clean":"2023-10-18T14:03:07.628177+0000","last_became_active":"2023-10-18T14:02:32.450286+0000","last_became_peered":"2023-10-18T14:02:32.450286+0000","last_unstale":"2023-10-18T14:03:07.628177+0000","last_undegraded":"2023-10-18T14:03:07.628177+0000","last_fullsized":"2023-10-18T14:03:07.628177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:01:17.874856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633946+0000","last_change":"2023-10-18T14:02:32.444129+0000","last_active":"2023-10-18T14:03:07.633946+0000","last_peered":"2023-10-18T14:03:07.633946+0000","last_clean":"2023-10-18T14:03:07.633946+0000","last_became_active":"2023-10-18T14:02:32.443898+0000","last_became_peered":"2023-10-18T14:02:32.443898+0000","last_unstale":"2023-10-18T14:03:07.633946+0000","last_undegraded":"2023-10-18T14:03:07.633946+0000","last_fullsized":"2023-10-18T14:03:07.633946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:20:35.391806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631518+0000","last_change":"2023-10-18T14:02:32.457637+0000","last_active":"2023-10-18T14:03:07.631518+0000","last_peered":"2023-10-18T14:03:07.631518+0000","last_clean":"2023-10-18T14:03:07.631518+0000","last_became_active":"2023-10-18T14:02:32.457345+0000","last_became_peered":"2023-10-18T14:02:32.457345+0000","last_unstale":"2023-10-18T14:03:07.631518+0000","last_undegraded":"2023-10-18T14:03:07.631518+0000","last_fullsized":"2023-10-18T14:03:07.631518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:18:47.579689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631487+0000","last_change":"2023-10-18T14:02:32.449765+0000","last_active":"2023-10-18T14:03:07.631487+0000","last_peered":"2023-10-18T14:03:07.631487+0000","last_clean":"2023-10-18T14:03:07.631487+0000","last_became_active":"2023-10-18T14:02:32.449467+0000","last_became_peered":"2023-10-18T14:02:32.449467+0000","last_unstale":"2023-10-18T14:03:07.631487+0000","last_undegraded":"2023-10-18T14:03:07.631487+0000","last_fullsized":"2023-10-18T14:03:07.631487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:09:15.324290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633644+0000","last_change":"2023-10-18T14:02:32.456634+0000","last_active":"2023-10-18T14:03:07.633644+0000","last_peered":"2023-10-18T14:03:07.633644+0000","last_clean":"2023-10-18T14:03:07.633644+0000","last_became_active":"2023-10-18T14:02:32.456336+0000","last_became_peered":"2023-10-18T14:02:32.456336+0000","last_unstale":"2023-10-18T14:03:07.633644+0000","last_undegraded":"2023-10-18T14:03:07.633644+0000","last_fullsized":"2023-10-18T14:03:07.633644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:29:47.973539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631514+0000","last_change":"2023-10-18T14:02:32.447357+0000","last_active":"2023-10-18T14:03:07.631514+0000","last_peered":"2023-10-18T14:03:07.631514+0000","last_clean":"2023-10-18T14:03:07.631514+0000","last_became_active":"2023-10-18T14:02:32.446756+0000","last_became_peered":"2023-10-18T14:02:32.446756+0000","last_unstale":"2023-10-18T14:03:07.631514+0000","last_undegraded":"2023-10-18T14:03:07.631514+0000","last_fullsized":"2023-10-18T14:03:07.631514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:13:22.467662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627607+0000","last_change":"2023-10-18T14:02:32.452786+0000","last_active":"2023-10-18T14:03:07.627607+0000","last_peered":"2023-10-18T14:03:07.627607+0000","last_clean":"2023-10-18T14:03:07.627607+0000","last_became_active":"2023-10-18T14:02:32.452551+0000","last_became_peered":"2023-10-18T14:02:32.452551+0000","last_unstale":"2023-10-18T14:03:07.627607+0000","last_undegraded":"2023-10-18T14:03:07.627607+0000","last_fullsized":"2023-10-18T14:03:07.627607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:07.709943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628230+0000","last_change":"2023-10-18T14:02:32.453264+0000","last_active":"2023-10-18T14:03:07.628230+0000","last_peered":"2023-10-18T14:03:07.628230+0000","last_clean":"2023-10-18T14:03:07.628230+0000","last_became_active":"2023-10-18T14:02:32.452948+0000","last_became_peered":"2023-10-18T14:02:32.452948+0000","last_unstale":"2023-10-18T14:03:07.628230+0000","last_undegraded":"2023-10-18T14:03:07.628230+0000","last_fullsized":"2023-10-18T14:03:07.628230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:00:55.243191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":66,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:14.343749+0000","last_change":"2023-10-18T14:02:31.843752+0000","last_active":"2023-10-18T14:03:14.343749+0000","last_peered":"2023-10-18T14:03:14.343749+0000","last_clean":"2023-10-18T14:03:14.343749+0000","last_became_active":"2023-10-18T14:02:31.843415+0000","last_became_peered":"2023-10-18T14:02:31.843415+0000","last_unstale":"2023-10-18T14:03:14.343749+0000","last_undegraded":"2023-10-18T14:03:14.343749+0000","last_fullsized":"2023-10-18T14:03:14.343749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:32:11.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633385+0000","last_change":"2023-10-18T14:02:32.458934+0000","last_active":"2023-10-18T14:03:07.633385+0000","last_peered":"2023-10-18T14:03:07.633385+0000","last_clean":"2023-10-18T14:03:07.633385+0000","last_became_active":"2023-10-18T14:02:32.458624+0000","last_became_peered":"2023-10-18T14:02:32.458624+0000","last_unstale":"2023-10-18T14:03:07.633385+0000","last_undegraded":"2023-10-18T14:03:07.633385+0000","last_fullsized":"2023-10-18T14:03:07.633385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:24:20.034637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633439+0000","last_change":"2023-10-18T14:02:31.842666+0000","last_active":"2023-10-18T14:03:07.633439+0000","last_peered":"2023-10-18T14:03:07.633439+0000","last_clean":"2023-10-18T14:03:07.633439+0000","last_became_active":"2023-10-18T14:02:31.842366+0000","last_became_peered":"2023-10-18T14:02:31.842366+0000","last_unstale":"2023-10-18T14:03:07.633439+0000","last_undegraded":"2023-10-18T14:03:07.633439+0000","last_fullsized":"2023-10-18T14:03:07.633439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:11:08.150402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631653+0000","last_change":"2023-10-18T14:02:32.453731+0000","last_active":"2023-10-18T14:03:07.631653+0000","last_peered":"2023-10-18T14:03:07.631653+0000","last_clean":"2023-10-18T14:03:07.631653+0000","last_became_active":"2023-10-18T14:02:32.453405+0000","last_became_peered":"2023-10-18T14:02:32.453405+0000","last_unstale":"2023-10-18T14:03:07.631653+0000","last_undegraded":"2023-10-18T14:03:07.631653+0000","last_fullsized":"2023-10-18T14:03:07.631653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:19:57.878074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631664+0000","last_change":"2023-10-18T14:02:31.851514+0000","last_active":"2023-10-18T14:03:07.631664+0000","last_peered":"2023-10-18T14:03:07.631664+0000","last_clean":"2023-10-18T14:03:07.631664+0000","last_became_active":"2023-10-18T14:02:31.851236+0000","last_became_peered":"2023-10-18T14:02:31.851236+0000","last_unstale":"2023-10-18T14:03:07.631664+0000","last_undegraded":"2023-10-18T14:03:07.631664+0000","last_fullsized":"2023-10-18T14:03:07.631664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:35:26.804135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634258+0000","last_change":"2023-10-18T14:02:32.460018+0000","last_active":"2023-10-18T14:03:07.634258+0000","last_peered":"2023-10-18T14:03:07.634258+0000","last_clean":"2023-10-18T14:03:07.634258+0000","last_became_active":"2023-10-18T14:02:32.459738+0000","last_became_peered":"2023-10-18T14:02:32.459738+0000","last_unstale":"2023-10-18T14:03:07.634258+0000","last_undegraded":"2023-10-18T14:03:07.634258+0000","last_fullsized":"2023-10-18T14:03:07.634258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:48.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630318+0000","last_change":"2023-10-18T14:02:31.850112+0000","last_active":"2023-10-18T14:03:07.630318+0000","last_peered":"2023-10-18T14:03:07.630318+0000","last_clean":"2023-10-18T14:03:07.630318+0000","last_became_active":"2023-10-18T14:02:31.849515+0000","last_became_peered":"2023-10-18T14:02:31.849515+0000","last_unstale":"2023-10-18T14:03:07.630318+0000","last_undegraded":"2023-10-18T14:03:07.630318+0000","last_fullsized":"2023-10-18T14:03:07.630318+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:35:20.338900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633120+0000","last_change":"2023-10-18T14:02:32.459221+0000","last_active":"2023-10-18T14:03:07.633120+0000","last_peered":"2023-10-18T14:03:07.633120+0000","last_clean":"2023-10-18T14:03:07.633120+0000","last_became_active":"2023-10-18T14:02:32.458912+0000","last_became_peered":"2023-10-18T14:02:32.458912+0000","last_unstale":"2023-10-18T14:03:07.633120+0000","last_undegraded":"2023-10-18T14:03:07.633120+0000","last_fullsized":"2023-10-18T14:03:07.633120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:54:02.630861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:15.319751+0000","last_change":"2023-10-18T14:02:31.846754+0000","last_active":"2023-10-18T14:03:15.319751+0000","last_peered":"2023-10-18T14:03:15.319751+0000","last_clean":"2023-10-18T14:03:15.319751+0000","last_became_active":"2023-10-18T14:02:31.846450+0000","last_became_peered":"2023-10-18T14:02:31.846450+0000","last_unstale":"2023-10-18T14:03:15.319751+0000","last_undegraded":"2023-10-18T14:03:15.319751+0000","last_fullsized":"2023-10-18T14:03:15.319751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:11.929528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.638502+0000","last_change":"2023-10-18T14:03:08.638502+0000","last_active":"2023-10-18T14:03:08.638502+0000","last_peered":"2023-10-18T14:03:08.638502+0000","last_clean":"2023-10-18T14:03:08.638502+0000","last_became_active":"2023-10-18T14:03:08.638101+0000","last_became_peered":"2023-10-18T14:03:08.638101+0000","last_unstale":"2023-10-18T14:03:08.638502+0000","last_undegraded":"2023-10-18T14:03:08.638502+0000","last_fullsized":"2023-10-18T14:03:08.638502+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:56:47.297642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632268+0000","last_change":"2023-10-18T14:02:31.846135+0000","last_active":"2023-10-18T14:03:07.632268+0000","last_peered":"2023-10-18T14:03:07.632268+0000","last_clean":"2023-10-18T14:03:07.632268+0000","last_became_active":"2023-10-18T14:02:31.845800+0000","last_became_peered":"2023-10-18T14:02:31.845800+0000","last_unstale":"2023-10-18T14:03:07.632268+0000","last_undegraded":"2023-10-18T14:03:07.632268+0000","last_fullsized":"2023-10-18T14:03:07.632268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:22:55.945930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633140+0000","last_change":"2023-10-18T14:02:32.445803+0000","last_active":"2023-10-18T14:03:07.633140+0000","last_peered":"2023-10-18T14:03:07.633140+0000","last_clean":"2023-10-18T14:03:07.633140+0000","last_became_active":"2023-10-18T14:02:32.445489+0000","last_became_peered":"2023-10-18T14:02:32.445489+0000","last_unstale":"2023-10-18T14:03:07.633140+0000","last_undegraded":"2023-10-18T14:03:07.633140+0000","last_fullsized":"2023-10-18T14:03:07.633140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:38:46.101215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632990+0000","last_change":"2023-10-18T14:02:31.843827+0000","last_active":"2023-10-18T14:03:07.632990+0000","last_peered":"2023-10-18T14:03:07.632990+0000","last_clean":"2023-10-18T14:03:07.632990+0000","last_became_active":"2023-10-18T14:02:31.843533+0000","last_became_peered":"2023-10-18T14:02:31.843533+0000","last_unstale":"2023-10-18T14:03:07.632990+0000","last_undegraded":"2023-10-18T14:03:07.632990+0000","last_fullsized":"2023-10-18T14:03:07.632990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:00:03.832002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632031+0000","last_change":"2023-10-18T14:02:32.447400+0000","last_active":"2023-10-18T14:03:07.632031+0000","last_peered":"2023-10-18T14:03:07.632031+0000","last_clean":"2023-10-18T14:03:07.632031+0000","last_became_active":"2023-10-18T14:02:32.447024+0000","last_became_peered":"2023-10-18T14:02:32.447024+0000","last_unstale":"2023-10-18T14:03:07.632031+0000","last_undegraded":"2023-10-18T14:03:07.632031+0000","last_fullsized":"2023-10-18T14:03:07.632031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:49:37.596273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632467+0000","last_change":"2023-10-18T14:02:31.847527+0000","last_active":"2023-10-18T14:03:07.632467+0000","last_peered":"2023-10-18T14:03:07.632467+0000","last_clean":"2023-10-18T14:03:07.632467+0000","last_became_active":"2023-10-18T14:02:31.847249+0000","last_became_peered":"2023-10-18T14:02:31.847249+0000","last_unstale":"2023-10-18T14:03:07.632467+0000","last_undegraded":"2023-10-18T14:03:07.632467+0000","last_fullsized":"2023-10-18T14:03:07.632467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:11:34.217776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627384+0000","last_change":"2023-10-18T14:02:32.452268+0000","last_active":"2023-10-18T14:03:07.627384+0000","last_peered":"2023-10-18T14:03:07.627384+0000","last_clean":"2023-10-18T14:03:07.627384+0000","last_became_active":"2023-10-18T14:02:32.451338+0000","last_became_peered":"2023-10-18T14:02:32.451338+0000","last_unstale":"2023-10-18T14:03:07.627384+0000","last_undegraded":"2023-10-18T14:03:07.627384+0000","last_fullsized":"2023-10-18T14:03:07.627384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:17:11.743280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":93,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:14.317687+0000","last_change":"2023-10-18T14:02:31.841862+0000","last_active":"2023-10-18T14:03:14.317687+0000","last_peered":"2023-10-18T14:03:14.317687+0000","last_clean":"2023-10-18T14:03:14.317687+0000","last_became_active":"2023-10-18T14:02:31.841481+0000","last_became_peered":"2023-10-18T14:02:31.841481+0000","last_unstale":"2023-10-18T14:03:14.317687+0000","last_undegraded":"2023-10-18T14:03:14.317687+0000","last_fullsized":"2023-10-18T14:03:14.317687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:38:26.263626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":74,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633941+0000","last_change":"2023-10-18T14:02:32.447608+0000","last_active":"2023-10-18T14:03:07.633941+0000","last_peered":"2023-10-18T14:03:07.633941+0000","last_clean":"2023-10-18T14:03:07.633941+0000","last_became_active":"2023-10-18T14:02:32.447057+0000","last_became_peered":"2023-10-18T14:02:32.447057+0000","last_unstale":"2023-10-18T14:03:07.633941+0000","last_undegraded":"2023-10-18T14:03:07.633941+0000","last_fullsized":"2023-10-18T14:03:07.633941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:33:43.469496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630438+0000","last_change":"2023-10-18T14:02:31.849118+0000","last_active":"2023-10-18T14:03:07.630438+0000","last_peered":"2023-10-18T14:03:07.630438+0000","last_clean":"2023-10-18T14:03:07.630438+0000","last_became_active":"2023-10-18T14:02:31.848827+0000","last_became_peered":"2023-10-18T14:02:31.848827+0000","last_unstale":"2023-10-18T14:03:07.630438+0000","last_undegraded":"2023-10-18T14:03:07.630438+0000","last_fullsized":"2023-10-18T14:03:07.630438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:41:17.309102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631773+0000","last_change":"2023-10-18T14:02:32.447157+0000","last_active":"2023-10-18T14:03:07.631773+0000","last_peered":"2023-10-18T14:03:07.631773+0000","last_clean":"2023-10-18T14:03:07.631773+0000","last_became_active":"2023-10-18T14:02:32.446861+0000","last_became_peered":"2023-10-18T14:02:32.446861+0000","last_unstale":"2023-10-18T14:03:07.631773+0000","last_undegraded":"2023-10-18T14:03:07.631773+0000","last_fullsized":"2023-10-18T14:03:07.631773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:58:58.146931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633247+0000","last_change":"2023-10-18T14:02:31.838819+0000","last_active":"2023-10-18T14:03:07.633247+0000","last_peered":"2023-10-18T14:03:07.633247+0000","last_clean":"2023-10-18T14:03:07.633247+0000","last_became_active":"2023-10-18T14:02:31.838488+0000","last_became_peered":"2023-10-18T14:02:31.838488+0000","last_unstale":"2023-10-18T14:03:07.633247+0000","last_undegraded":"2023-10-18T14:03:07.633247+0000","last_fullsized":"2023-10-18T14:03:07.633247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:41:37.569792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633964+0000","last_change":"2023-10-18T14:02:32.455108+0000","last_active":"2023-10-18T14:03:07.633964+0000","last_peered":"2023-10-18T14:03:07.633964+0000","last_clean":"2023-10-18T14:03:07.633964+0000","last_became_active":"2023-10-18T14:02:32.454821+0000","last_became_peered":"2023-10-18T14:02:32.454821+0000","last_unstale":"2023-10-18T14:03:07.633964+0000","last_undegraded":"2023-10-18T14:03:07.633964+0000","last_fullsized":"2023-10-18T14:03:07.633964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:00:29.617633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":125,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:14.317734+0000","last_change":"2023-10-18T14:02:31.847241+0000","last_active":"2023-10-18T14:03:14.317734+0000","last_peered":"2023-10-18T14:03:14.317734+0000","last_clean":"2023-10-18T14:03:14.317734+0000","last_became_active":"2023-10-18T14:02:31.846786+0000","last_became_peered":"2023-10-18T14:02:31.846786+0000","last_unstale":"2023-10-18T14:03:14.317734+0000","last_undegraded":"2023-10-18T14:03:14.317734+0000","last_fullsized":"2023-10-18T14:03:14.317734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:53:47.539696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58575,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":97,"num_write":31,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630833+0000","last_change":"2023-10-18T14:02:32.458530+0000","last_active":"2023-10-18T14:03:07.630833+0000","last_peered":"2023-10-18T14:03:07.630833+0000","last_clean":"2023-10-18T14:03:07.630833+0000","last_became_active":"2023-10-18T14:02:32.458199+0000","last_became_peered":"2023-10-18T14:02:32.458199+0000","last_unstale":"2023-10-18T14:03:07.630833+0000","last_undegraded":"2023-10-18T14:03:07.630833+0000","last_fullsized":"2023-10-18T14:03:07.630833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:52:16.107456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.656760+0000","last_change":"2023-10-18T14:03:08.656457+0000","last_active":"2023-10-18T14:03:08.656760+0000","last_peered":"2023-10-18T14:03:08.656760+0000","last_clean":"2023-10-18T14:03:08.656760+0000","last_became_active":"2023-10-18T14:03:08.638227+0000","last_became_peered":"2023-10-18T14:03:08.638227+0000","last_unstale":"2023-10-18T14:03:08.656760+0000","last_undegraded":"2023-10-18T14:03:08.656760+0000","last_fullsized":"2023-10-18T14:03:08.656760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:28:29.502844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633370+0000","last_change":"2023-10-18T14:02:32.456404+0000","last_active":"2023-10-18T14:03:07.633370+0000","last_peered":"2023-10-18T14:03:07.633370+0000","last_clean":"2023-10-18T14:03:07.633370+0000","last_became_active":"2023-10-18T14:02:32.456128+0000","last_became_peered":"2023-10-18T14:02:32.456128+0000","last_unstale":"2023-10-18T14:03:07.633370+0000","last_undegraded":"2023-10-18T14:03:07.633370+0000","last_fullsized":"2023-10-18T14:03:07.633370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:23:41.315513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633298+0000","last_change":"2023-10-18T14:02:31.846871+0000","last_active":"2023-10-18T14:03:07.633298+0000","last_peered":"2023-10-18T14:03:07.633298+0000","last_clean":"2023-10-18T14:03:07.633298+0000","last_became_active":"2023-10-18T14:02:31.846570+0000","last_became_peered":"2023-10-18T14:02:31.846570+0000","last_unstale":"2023-10-18T14:03:07.633298+0000","last_undegraded":"2023-10-18T14:03:07.633298+0000","last_fullsized":"2023-10-18T14:03:07.633298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:38:46.096769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.632825+0000","last_change":"2023-10-18T14:03:08.632825+0000","last_active":"2023-10-18T14:03:08.632825+0000","last_peered":"2023-10-18T14:03:08.632825+0000","last_clean":"2023-10-18T14:03:08.632825+0000","last_became_active":"2023-10-18T14:03:08.632453+0000","last_became_peered":"2023-10-18T14:03:08.632453+0000","last_unstale":"2023-10-18T14:03:08.632825+0000","last_undegraded":"2023-10-18T14:03:08.632825+0000","last_fullsized":"2023-10-18T14:03:08.632825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:30.707828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":60,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:14.317765+0000","last_change":"2023-10-18T14:02:31.844367+0000","last_active":"2023-10-18T14:03:14.317765+0000","last_peered":"2023-10-18T14:03:14.317765+0000","last_clean":"2023-10-18T14:03:14.317765+0000","last_became_active":"2023-10-18T14:02:31.844060+0000","last_became_peered":"2023-10-18T14:02:31.844060+0000","last_unstale":"2023-10-18T14:03:14.317765+0000","last_undegraded":"2023-10-18T14:03:14.317765+0000","last_fullsized":"2023-10-18T14:03:14.317765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:06:09.656240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629934+0000","last_change":"2023-10-18T14:02:32.464529+0000","last_active":"2023-10-18T14:03:07.629934+0000","last_peered":"2023-10-18T14:03:07.629934+0000","last_clean":"2023-10-18T14:03:07.629934+0000","last_became_active":"2023-10-18T14:02:32.464232+0000","last_became_peered":"2023-10-18T14:02:32.464232+0000","last_unstale":"2023-10-18T14:03:07.629934+0000","last_undegraded":"2023-10-18T14:03:07.629934+0000","last_fullsized":"2023-10-18T14:03:07.629934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:10:43.011803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629881+0000","last_change":"2023-10-18T14:02:31.850537+0000","last_active":"2023-10-18T14:03:07.629881+0000","last_peered":"2023-10-18T14:03:07.629881+0000","last_clean":"2023-10-18T14:03:07.629881+0000","last_became_active":"2023-10-18T14:02:31.849391+0000","last_became_peered":"2023-10-18T14:02:31.849391+0000","last_unstale":"2023-10-18T14:03:07.629881+0000","last_undegraded":"2023-10-18T14:03:07.629881+0000","last_fullsized":"2023-10-18T14:03:07.629881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:19:31.270179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.635208+0000","last_change":"2023-10-18T14:03:08.635208+0000","last_active":"2023-10-18T14:03:08.635208+0000","last_peered":"2023-10-18T14:03:08.635208+0000","last_clean":"2023-10-18T14:03:08.635208+0000","last_became_active":"2023-10-18T14:03:08.634800+0000","last_became_peered":"2023-10-18T14:03:08.634800+0000","last_unstale":"2023-10-18T14:03:08.635208+0000","last_undegraded":"2023-10-18T14:03:08.635208+0000","last_fullsized":"2023-10-18T14:03:08.635208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:36:00.844237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631121+0000","last_change":"2023-10-18T14:02:31.850706+0000","last_active":"2023-10-18T14:03:07.631121+0000","last_peered":"2023-10-18T14:03:07.631121+0000","last_clean":"2023-10-18T14:03:07.631121+0000","last_became_active":"2023-10-18T14:02:31.849354+0000","last_became_peered":"2023-10-18T14:02:31.849354+0000","last_unstale":"2023-10-18T14:03:07.631121+0000","last_undegraded":"2023-10-18T14:03:07.631121+0000","last_fullsized":"2023-10-18T14:03:07.631121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:51:31.071528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631242+0000","last_change":"2023-10-18T14:02:32.454196+0000","last_active":"2023-10-18T14:03:07.631242+0000","last_peered":"2023-10-18T14:03:07.631242+0000","last_clean":"2023-10-18T14:03:07.631242+0000","last_became_active":"2023-10-18T14:02:32.453861+0000","last_became_peered":"2023-10-18T14:02:32.453861+0000","last_unstale":"2023-10-18T14:03:07.631242+0000","last_undegraded":"2023-10-18T14:03:07.631242+0000","last_fullsized":"2023-10-18T14:03:07.631242+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:43.217757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627432+0000","last_change":"2023-10-18T14:02:31.849707+0000","last_active":"2023-10-18T14:03:07.627432+0000","last_peered":"2023-10-18T14:03:07.627432+0000","last_clean":"2023-10-18T14:03:07.627432+0000","last_became_active":"2023-10-18T14:02:31.849442+0000","last_became_peered":"2023-10-18T14:02:31.849442+0000","last_unstale":"2023-10-18T14:03:07.627432+0000","last_undegraded":"2023-10-18T14:03:07.627432+0000","last_fullsized":"2023-10-18T14:03:07.627432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:39:15.669730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632631+0000","last_change":"2023-10-18T14:02:32.457433+0000","last_active":"2023-10-18T14:03:07.632631+0000","last_peered":"2023-10-18T14:03:07.632631+0000","last_clean":"2023-10-18T14:03:07.632631+0000","last_became_active":"2023-10-18T14:02:32.457057+0000","last_became_peered":"2023-10-18T14:02:32.457057+0000","last_unstale":"2023-10-18T14:03:07.632631+0000","last_undegraded":"2023-10-18T14:03:07.632631+0000","last_fullsized":"2023-10-18T14:03:07.632631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:53.088723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":60,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:16.347282+0000","last_change":"2023-10-18T14:02:31.848595+0000","last_active":"2023-10-18T14:03:16.347282+0000","last_peered":"2023-10-18T14:03:16.347282+0000","last_clean":"2023-10-18T14:03:16.347282+0000","last_became_active":"2023-10-18T14:02:31.847987+0000","last_became_peered":"2023-10-18T14:02:31.847987+0000","last_unstale":"2023-10-18T14:03:16.347282+0000","last_undegraded":"2023-10-18T14:03:16.347282+0000","last_fullsized":"2023-10-18T14:03:16.347282+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:03:34.356729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632829+0000","last_change":"2023-10-18T14:02:32.446514+0000","last_active":"2023-10-18T14:03:07.632829+0000","last_peered":"2023-10-18T14:03:07.632829+0000","last_clean":"2023-10-18T14:03:07.632829+0000","last_became_active":"2023-10-18T14:02:32.446015+0000","last_became_peered":"2023-10-18T14:02:32.446015+0000","last_unstale":"2023-10-18T14:03:07.632829+0000","last_undegraded":"2023-10-18T14:03:07.632829+0000","last_fullsized":"2023-10-18T14:03:07.632829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:21:09.897636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632600+0000","last_change":"2023-10-18T14:02:32.444969+0000","last_active":"2023-10-18T14:03:07.632600+0000","last_peered":"2023-10-18T14:03:07.632600+0000","last_clean":"2023-10-18T14:03:07.632600+0000","last_became_active":"2023-10-18T14:02:32.444592+0000","last_became_peered":"2023-10-18T14:02:32.444592+0000","last_unstale":"2023-10-18T14:03:07.632600+0000","last_undegraded":"2023-10-18T14:03:07.632600+0000","last_fullsized":"2023-10-18T14:03:07.632600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:02:58.377003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":61,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:16.319748+0000","last_change":"2023-10-18T14:02:31.847368+0000","last_active":"2023-10-18T14:03:16.319748+0000","last_peered":"2023-10-18T14:03:16.319748+0000","last_clean":"2023-10-18T14:03:16.319748+0000","last_became_active":"2023-10-18T14:02:31.847072+0000","last_became_peered":"2023-10-18T14:02:31.847072+0000","last_unstale":"2023-10-18T14:03:16.319748+0000","last_undegraded":"2023-10-18T14:03:16.319748+0000","last_fullsized":"2023-10-18T14:03:16.319748+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:28:24.771284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.632551+0000","last_change":"2023-10-18T14:03:08.632138+0000","last_active":"2023-10-18T14:03:08.632551+0000","last_peered":"2023-10-18T14:03:08.632551+0000","last_clean":"2023-10-18T14:03:08.632551+0000","last_became_active":"2023-10-18T14:03:08.631902+0000","last_became_peered":"2023-10-18T14:03:08.631902+0000","last_unstale":"2023-10-18T14:03:08.632551+0000","last_undegraded":"2023-10-18T14:03:08.632551+0000","last_fullsized":"2023-10-18T14:03:08.632551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:31:10.646568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628041+0000","last_change":"2023-10-18T14:02:31.843678+0000","last_active":"2023-10-18T14:03:07.628041+0000","last_peered":"2023-10-18T14:03:07.628041+0000","last_clean":"2023-10-18T14:03:07.628041+0000","last_became_active":"2023-10-18T14:02:31.843332+0000","last_became_peered":"2023-10-18T14:02:31.843332+0000","last_unstale":"2023-10-18T14:03:07.628041+0000","last_undegraded":"2023-10-18T14:03:07.628041+0000","last_fullsized":"2023-10-18T14:03:07.628041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:06:04.549859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":321,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630029+0000","last_change":"2023-10-18T14:01:34.022246+0000","last_active":"2023-10-18T14:03:07.630029+0000","last_peered":"2023-10-18T14:03:07.630029+0000","last_clean":"2023-10-18T14:03:07.630029+0000","last_became_active":"2023-10-18T14:01:34.021768+0000","last_became_peered":"2023-10-18T14:01:34.021768+0000","last_unstale":"2023-10-18T14:03:07.630029+0000","last_undegraded":"2023-10-18T14:03:07.630029+0000","last_fullsized":"2023-10-18T14:03:07.630029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_clean_scrub_stamp":"2023-10-18T13:58:44.223424+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:48.521087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632798+0000","last_change":"2023-10-18T14:02:32.440662+0000","last_active":"2023-10-18T14:03:07.632798+0000","last_peered":"2023-10-18T14:03:07.632798+0000","last_clean":"2023-10-18T14:03:07.632798+0000","last_became_active":"2023-10-18T14:02:32.440345+0000","last_became_peered":"2023-10-18T14:02:32.440345+0000","last_unstale":"2023-10-18T14:03:07.632798+0000","last_undegraded":"2023-10-18T14:03:07.632798+0000","last_fullsized":"2023-10-18T14:03:07.632798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:21.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630113+0000","last_change":"2023-10-18T14:02:31.850243+0000","last_active":"2023-10-18T14:03:07.630113+0000","last_peered":"2023-10-18T14:03:07.630113+0000","last_clean":"2023-10-18T14:03:07.630113+0000","last_became_active":"2023-10-18T14:02:31.849952+0000","last_became_peered":"2023-10-18T14:02:31.849952+0000","last_unstale":"2023-10-18T14:03:07.630113+0000","last_undegraded":"2023-10-18T14:03:07.630113+0000","last_fullsized":"2023-10-18T14:03:07.630113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:11:50.877219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.647452+0000","last_change":"2023-10-18T14:03:08.647076+0000","last_active":"2023-10-18T14:03:08.647452+0000","last_peered":"2023-10-18T14:03:08.647452+0000","last_clean":"2023-10-18T14:03:08.647452+0000","last_became_active":"2023-10-18T14:03:08.637530+0000","last_became_peered":"2023-10-18T14:03:08.637530+0000","last_unstale":"2023-10-18T14:03:08.647452+0000","last_undegraded":"2023-10-18T14:03:08.647452+0000","last_fullsized":"2023-10-18T14:03:08.647452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:33.344068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633493+0000","last_change":"2023-10-18T14:02:32.445046+0000","last_active":"2023-10-18T14:03:07.633493+0000","last_peered":"2023-10-18T14:03:07.633493+0000","last_clean":"2023-10-18T14:03:07.633493+0000","last_became_active":"2023-10-18T14:02:32.444827+0000","last_became_peered":"2023-10-18T14:02:32.444827+0000","last_unstale":"2023-10-18T14:03:07.633493+0000","last_undegraded":"2023-10-18T14:03:07.633493+0000","last_fullsized":"2023-10-18T14:03:07.633493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:26:11.024405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627694+0000","last_change":"2023-10-18T14:02:31.846888+0000","last_active":"2023-10-18T14:03:07.627694+0000","last_peered":"2023-10-18T14:03:07.627694+0000","last_clean":"2023-10-18T14:03:07.627694+0000","last_became_active":"2023-10-18T14:02:31.846591+0000","last_became_peered":"2023-10-18T14:02:31.846591+0000","last_unstale":"2023-10-18T14:03:07.627694+0000","last_undegraded":"2023-10-18T14:03:07.627694+0000","last_fullsized":"2023-10-18T14:03:07.627694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:48:03.683135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633530+0000","last_change":"2023-10-18T14:02:32.456951+0000","last_active":"2023-10-18T14:03:07.633530+0000","last_peered":"2023-10-18T14:03:07.633530+0000","last_clean":"2023-10-18T14:03:07.633530+0000","last_became_active":"2023-10-18T14:02:32.456588+0000","last_became_peered":"2023-10-18T14:02:32.456588+0000","last_unstale":"2023-10-18T14:03:07.633530+0000","last_undegraded":"2023-10-18T14:03:07.633530+0000","last_fullsized":"2023-10-18T14:03:07.633530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:51:51.335310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628601+0000","last_change":"2023-10-18T14:02:31.845258+0000","last_active":"2023-10-18T14:03:07.628601+0000","last_peered":"2023-10-18T14:03:07.628601+0000","last_clean":"2023-10-18T14:03:07.628601+0000","last_became_active":"2023-10-18T14:02:31.844933+0000","last_became_peered":"2023-10-18T14:02:31.844933+0000","last_unstale":"2023-10-18T14:03:07.628601+0000","last_undegraded":"2023-10-18T14:03:07.628601+0000","last_fullsized":"2023-10-18T14:03:07.628601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:51:46.765525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631689+0000","last_change":"2023-10-18T14:02:32.454955+0000","last_active":"2023-10-18T14:03:07.631689+0000","last_peered":"2023-10-18T14:03:07.631689+0000","last_clean":"2023-10-18T14:03:07.631689+0000","last_became_active":"2023-10-18T14:02:32.454689+0000","last_became_peered":"2023-10-18T14:02:32.454689+0000","last_unstale":"2023-10-18T14:03:07.631689+0000","last_undegraded":"2023-10-18T14:03:07.631689+0000","last_fullsized":"2023-10-18T14:03:07.631689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:57:20.461517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633726+0000","last_change":"2023-10-18T14:02:31.849273+0000","last_active":"2023-10-18T14:03:07.633726+0000","last_peered":"2023-10-18T14:03:07.633726+0000","last_clean":"2023-10-18T14:03:07.633726+0000","last_became_active":"2023-10-18T14:02:31.848985+0000","last_became_peered":"2023-10-18T14:02:31.848985+0000","last_unstale":"2023-10-18T14:03:07.633726+0000","last_undegraded":"2023-10-18T14:03:07.633726+0000","last_fullsized":"2023-10-18T14:03:07.633726+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:55:54.516857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629855+0000","last_change":"2023-10-18T14:02:32.449557+0000","last_active":"2023-10-18T14:03:07.629855+0000","last_peered":"2023-10-18T14:03:07.629855+0000","last_clean":"2023-10-18T14:03:07.629855+0000","last_became_active":"2023-10-18T14:02:32.449033+0000","last_became_peered":"2023-10-18T14:02:32.449033+0000","last_unstale":"2023-10-18T14:03:07.629855+0000","last_undegraded":"2023-10-18T14:03:07.629855+0000","last_fullsized":"2023-10-18T14:03:07.629855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:32.983379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632227+0000","last_change":"2023-10-18T14:02:31.846109+0000","last_active":"2023-10-18T14:03:07.632227+0000","last_peered":"2023-10-18T14:03:07.632227+0000","last_clean":"2023-10-18T14:03:07.632227+0000","last_became_active":"2023-10-18T14:02:31.845236+0000","last_became_peered":"2023-10-18T14:02:31.845236+0000","last_unstale":"2023-10-18T14:03:07.632227+0000","last_undegraded":"2023-10-18T14:03:07.632227+0000","last_fullsized":"2023-10-18T14:03:07.632227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:46.880974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631047+0000","last_change":"2023-10-18T14:02:32.446465+0000","last_active":"2023-10-18T14:03:07.631047+0000","last_peered":"2023-10-18T14:03:07.631047+0000","last_clean":"2023-10-18T14:03:07.631047+0000","last_became_active":"2023-10-18T14:02:32.446172+0000","last_became_peered":"2023-10-18T14:02:32.446172+0000","last_unstale":"2023-10-18T14:03:07.631047+0000","last_undegraded":"2023-10-18T14:03:07.631047+0000","last_fullsized":"2023-10-18T14:03:07.631047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:14:40.094870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628081+0000","last_change":"2023-10-18T14:02:31.851198+0000","last_active":"2023-10-18T14:03:07.628081+0000","last_peered":"2023-10-18T14:03:07.628081+0000","last_clean":"2023-10-18T14:03:07.628081+0000","last_became_active":"2023-10-18T14:02:31.850524+0000","last_became_peered":"2023-10-18T14:02:31.850524+0000","last_unstale":"2023-10-18T14:03:07.628081+0000","last_undegraded":"2023-10-18T14:03:07.628081+0000","last_fullsized":"2023-10-18T14:03:07.628081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:13:44.133077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633065+0000","last_change":"2023-10-18T14:02:32.446732+0000","last_active":"2023-10-18T14:03:07.633065+0000","last_peered":"2023-10-18T14:03:07.633065+0000","last_clean":"2023-10-18T14:03:07.633065+0000","last_became_active":"2023-10-18T14:02:32.446418+0000","last_became_peered":"2023-10-18T14:02:32.446418+0000","last_unstale":"2023-10-18T14:03:07.633065+0000","last_undegraded":"2023-10-18T14:03:07.633065+0000","last_fullsized":"2023-10-18T14:03:07.633065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:13.765988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630012+0000","last_change":"2023-10-18T14:02:31.852648+0000","last_active":"2023-10-18T14:03:07.630012+0000","last_peered":"2023-10-18T14:03:07.630012+0000","last_clean":"2023-10-18T14:03:07.630012+0000","last_became_active":"2023-10-18T14:02:31.852361+0000","last_became_peered":"2023-10-18T14:02:31.852361+0000","last_unstale":"2023-10-18T14:03:07.630012+0000","last_undegraded":"2023-10-18T14:03:07.630012+0000","last_fullsized":"2023-10-18T14:03:07.630012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:54:28.189196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630302+0000","last_change":"2023-10-18T14:02:32.464220+0000","last_active":"2023-10-18T14:03:07.630302+0000","last_peered":"2023-10-18T14:03:07.630302+0000","last_clean":"2023-10-18T14:03:07.630302+0000","last_became_active":"2023-10-18T14:02:32.463213+0000","last_became_peered":"2023-10-18T14:02:32.463213+0000","last_unstale":"2023-10-18T14:03:07.630302+0000","last_undegraded":"2023-10-18T14:03:07.630302+0000","last_fullsized":"2023-10-18T14:03:07.630302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:53.777086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:17.322667+0000","last_change":"2023-10-18T14:02:31.848305+0000","last_active":"2023-10-18T14:03:17.322667+0000","last_peered":"2023-10-18T14:03:17.322667+0000","last_clean":"2023-10-18T14:03:17.322667+0000","last_became_active":"2023-10-18T14:02:31.847739+0000","last_became_peered":"2023-10-18T14:02:31.847739+0000","last_unstale":"2023-10-18T14:03:17.322667+0000","last_undegraded":"2023-10-18T14:03:17.322667+0000","last_fullsized":"2023-10-18T14:03:17.322667+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:52:24.543703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630458+0000","last_change":"2023-10-18T14:02:32.460802+0000","last_active":"2023-10-18T14:03:07.630458+0000","last_peered":"2023-10-18T14:03:07.630458+0000","last_clean":"2023-10-18T14:03:07.630458+0000","last_became_active":"2023-10-18T14:02:32.460160+0000","last_became_peered":"2023-10-18T14:02:32.460160+0000","last_unstale":"2023-10-18T14:03:07.630458+0000","last_undegraded":"2023-10-18T14:03:07.630458+0000","last_fullsized":"2023-10-18T14:03:07.630458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:20:55.614142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633018+0000","last_change":"2023-10-18T14:02:31.845468+0000","last_active":"2023-10-18T14:03:07.633018+0000","last_peered":"2023-10-18T14:03:07.633018+0000","last_clean":"2023-10-18T14:03:07.633018+0000","last_became_active":"2023-10-18T14:02:31.845057+0000","last_became_peered":"2023-10-18T14:02:31.845057+0000","last_unstale":"2023-10-18T14:03:07.633018+0000","last_undegraded":"2023-10-18T14:03:07.633018+0000","last_fullsized":"2023-10-18T14:03:07.633018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:08:23.972051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630377+0000","last_change":"2023-10-18T14:02:32.462572+0000","last_active":"2023-10-18T14:03:07.630377+0000","last_peered":"2023-10-18T14:03:07.630377+0000","last_clean":"2023-10-18T14:03:07.630377+0000","last_became_active":"2023-10-18T14:02:32.462140+0000","last_became_peered":"2023-10-18T14:02:32.462140+0000","last_unstale":"2023-10-18T14:03:07.630377+0000","last_undegraded":"2023-10-18T14:03:07.630377+0000","last_fullsized":"2023-10-18T14:03:07.630377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:03:34.605932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633629+0000","last_change":"2023-10-18T14:02:31.847322+0000","last_active":"2023-10-18T14:03:07.633629+0000","last_peered":"2023-10-18T14:03:07.633629+0000","last_clean":"2023-10-18T14:03:07.633629+0000","last_became_active":"2023-10-18T14:02:31.847008+0000","last_became_peered":"2023-10-18T14:02:31.847008+0000","last_unstale":"2023-10-18T14:03:07.633629+0000","last_undegraded":"2023-10-18T14:03:07.633629+0000","last_fullsized":"2023-10-18T14:03:07.633629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:59:18.850165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630579+0000","last_change":"2023-10-18T14:02:32.461592+0000","last_active":"2023-10-18T14:03:07.630579+0000","last_peered":"2023-10-18T14:03:07.630579+0000","last_clean":"2023-10-18T14:03:07.630579+0000","last_became_active":"2023-10-18T14:02:32.461265+0000","last_became_peered":"2023-10-18T14:02:32.461265+0000","last_unstale":"2023-10-18T14:03:07.630579+0000","last_undegraded":"2023-10-18T14:03:07.630579+0000","last_fullsized":"2023-10-18T14:03:07.630579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:03.315431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631175+0000","last_change":"2023-10-18T14:02:32.445480+0000","last_active":"2023-10-18T14:03:07.631175+0000","last_peered":"2023-10-18T14:03:07.631175+0000","last_clean":"2023-10-18T14:03:07.631175+0000","last_became_active":"2023-10-18T14:02:32.443036+0000","last_became_peered":"2023-10-18T14:02:32.443036+0000","last_unstale":"2023-10-18T14:03:07.631175+0000","last_undegraded":"2023-10-18T14:03:07.631175+0000","last_fullsized":"2023-10-18T14:03:07.631175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:59:57.637358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628022+0000","last_change":"2023-10-18T14:02:32.456400+0000","last_active":"2023-10-18T14:03:07.628022+0000","last_peered":"2023-10-18T14:03:07.628022+0000","last_clean":"2023-10-18T14:03:07.628022+0000","last_became_active":"2023-10-18T14:02:32.456072+0000","last_became_peered":"2023-10-18T14:02:32.456072+0000","last_unstale":"2023-10-18T14:03:07.628022+0000","last_undegraded":"2023-10-18T14:03:07.628022+0000","last_fullsized":"2023-10-18T14:03:07.628022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:22:59.844454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627995+0000","last_change":"2023-10-18T14:02:32.448089+0000","last_active":"2023-10-18T14:03:07.627995+0000","last_peered":"2023-10-18T14:03:07.627995+0000","last_clean":"2023-10-18T14:03:07.627995+0000","last_became_active":"2023-10-18T14:02:32.447866+0000","last_became_peered":"2023-10-18T14:02:32.447866+0000","last_unstale":"2023-10-18T14:03:07.627995+0000","last_undegraded":"2023-10-18T14:03:07.627995+0000","last_fullsized":"2023-10-18T14:03:07.627995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:28:35.558009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631717+0000","last_change":"2023-10-18T14:02:32.444103+0000","last_active":"2023-10-18T14:03:07.631717+0000","last_peered":"2023-10-18T14:03:07.631717+0000","last_clean":"2023-10-18T14:03:07.631717+0000","last_became_active":"2023-10-18T14:02:32.443762+0000","last_became_peered":"2023-10-18T14:02:32.443762+0000","last_unstale":"2023-10-18T14:03:07.631717+0000","last_undegraded":"2023-10-18T14:03:07.631717+0000","last_fullsized":"2023-10-18T14:03:07.631717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:47.695764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633454+0000","last_change":"2023-10-18T14:02:32.449409+0000","last_active":"2023-10-18T14:03:07.633454+0000","last_peered":"2023-10-18T14:03:07.633454+0000","last_clean":"2023-10-18T14:03:07.633454+0000","last_became_active":"2023-10-18T14:02:32.449114+0000","last_became_peered":"2023-10-18T14:02:32.449114+0000","last_unstale":"2023-10-18T14:03:07.633454+0000","last_undegraded":"2023-10-18T14:03:07.633454+0000","last_fullsized":"2023-10-18T14:03:07.633454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:59:45.167577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631298+0000","last_change":"2023-10-18T14:02:32.452013+0000","last_active":"2023-10-18T14:03:07.631298+0000","last_peered":"2023-10-18T14:03:07.631298+0000","last_clean":"2023-10-18T14:03:07.631298+0000","last_became_active":"2023-10-18T14:02:32.451734+0000","last_became_peered":"2023-10-18T14:02:32.451734+0000","last_unstale":"2023-10-18T14:03:07.631298+0000","last_undegraded":"2023-10-18T14:03:07.631298+0000","last_fullsized":"2023-10-18T14:03:07.631298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:15:44.511378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629153+0000","last_change":"2023-10-18T14:02:32.445503+0000","last_active":"2023-10-18T14:03:07.629153+0000","last_peered":"2023-10-18T14:03:07.629153+0000","last_clean":"2023-10-18T14:03:07.629153+0000","last_became_active":"2023-10-18T14:02:32.445172+0000","last_became_peered":"2023-10-18T14:02:32.445172+0000","last_unstale":"2023-10-18T14:03:07.629153+0000","last_undegraded":"2023-10-18T14:03:07.629153+0000","last_fullsized":"2023-10-18T14:03:07.629153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:23:08.456949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633490+0000","last_change":"2023-10-18T14:02:32.459690+0000","last_active":"2023-10-18T14:03:07.633490+0000","last_peered":"2023-10-18T14:03:07.633490+0000","last_clean":"2023-10-18T14:03:07.633490+0000","last_became_active":"2023-10-18T14:02:32.459373+0000","last_became_peered":"2023-10-18T14:02:32.459373+0000","last_unstale":"2023-10-18T14:03:07.633490+0000","last_undegraded":"2023-10-18T14:03:07.633490+0000","last_fullsized":"2023-10-18T14:03:07.633490+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:36.092029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632468+0000","last_change":"2023-10-18T14:02:32.455076+0000","last_active":"2023-10-18T14:03:07.632468+0000","last_peered":"2023-10-18T14:03:07.632468+0000","last_clean":"2023-10-18T14:03:07.632468+0000","last_became_active":"2023-10-18T14:02:32.454750+0000","last_became_peered":"2023-10-18T14:02:32.454750+0000","last_unstale":"2023-10-18T14:03:07.632468+0000","last_undegraded":"2023-10-18T14:03:07.632468+0000","last_fullsized":"2023-10-18T14:03:07.632468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:08:00.855583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632303+0000","last_change":"2023-10-18T14:02:32.450714+0000","last_active":"2023-10-18T14:03:07.632303+0000","last_peered":"2023-10-18T14:03:07.632303+0000","last_clean":"2023-10-18T14:03:07.632303+0000","last_became_active":"2023-10-18T14:02:32.450429+0000","last_became_peered":"2023-10-18T14:02:32.450429+0000","last_unstale":"2023-10-18T14:03:07.632303+0000","last_undegraded":"2023-10-18T14:03:07.632303+0000","last_fullsized":"2023-10-18T14:03:07.632303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:43:21.746296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634401+0000","last_change":"2023-10-18T14:02:32.457392+0000","last_active":"2023-10-18T14:03:07.634401+0000","last_peered":"2023-10-18T14:03:07.634401+0000","last_clean":"2023-10-18T14:03:07.634401+0000","last_became_active":"2023-10-18T14:02:32.457072+0000","last_became_peered":"2023-10-18T14:02:32.457072+0000","last_unstale":"2023-10-18T14:03:07.634401+0000","last_undegraded":"2023-10-18T14:03:07.634401+0000","last_fullsized":"2023-10-18T14:03:07.634401+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:19:51.691351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634009+0000","last_change":"2023-10-18T14:02:32.457541+0000","last_active":"2023-10-18T14:03:07.634009+0000","last_peered":"2023-10-18T14:03:07.634009+0000","last_clean":"2023-10-18T14:03:07.634009+0000","last_became_active":"2023-10-18T14:02:32.457266+0000","last_became_peered":"2023-10-18T14:02:32.457266+0000","last_unstale":"2023-10-18T14:03:07.634009+0000","last_undegraded":"2023-10-18T14:03:07.634009+0000","last_fullsized":"2023-10-18T14:03:07.634009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:41:16.131463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.636413+0000","last_change":"2023-10-18T14:03:08.636413+0000","last_active":"2023-10-18T14:03:08.636413+0000","last_peered":"2023-10-18T14:03:08.636413+0000","last_clean":"2023-10-18T14:03:08.636413+0000","last_became_active":"2023-10-18T14:03:08.635985+0000","last_became_peered":"2023-10-18T14:03:08.635985+0000","last_unstale":"2023-10-18T14:03:08.636413+0000","last_undegraded":"2023-10-18T14:03:08.636413+0000","last_fullsized":"2023-10-18T14:03:08.636413+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:53:28.848373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250031,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65387,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":419,"num_read_kb":278,"num_write":229,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":180,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":196161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449109,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":459517,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.46899999999999997}]},{"osd":1,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.629}]},{"osd":2,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.374},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.68100000000000005}]},{"osd":5,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54700000000000004}]},{"osd":6,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.76300000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":9,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.71499999999999997}]},{"osd":10,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.70199999999999996}]}]},{"osd":10,"up_from":70,"seq":300647710743,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":1108616,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.371},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.40000000000000002}]},{"osd":2,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.61899999999999999}]},{"osd":3,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.503},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64400000000000002}]},{"osd":4,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.433}]},{"osd":5,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.72399999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65100000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.747}]},{"osd":9,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.55000000000000004}]},{"osd":11,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.84599999999999997}]}]},{"osd":9,"up_from":65,"seq":279172874269,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":459267,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.501},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.56899999999999995}]},{"osd":1,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.62},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.63}]},{"osd":3,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.66800000000000004}]},{"osd":4,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.70499999999999996}]},{"osd":5,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.73199999999999998,"15min":0.747},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36599999999999999,"5min":0.308,"15min":0.308},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.71699999999999997,"15min":0.73399999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.68200000000000005}]},{"osd":8,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75600000000000001,"15min":0.76800000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1080000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.75700000000000001}]},{"osd":10,"last update":"Wed Oct 18 14:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.748},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78300000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103201,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":459202,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.4380000000000002,"5min":2.4380000000000002,"15min":2.4380000000000002},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.68600000000000005}]},{"osd":2,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.41499999999999998},"min":{"1min":0.33500000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.73799999999999999}]},{"osd":3,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.65700000000000003,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":8.5980000000000008,"5min":8.5980000000000008,"15min":8.5980000000000008},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.60299999999999998,"15min":0.58199999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.6080000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":1.0720000000000001}]},{"osd":4,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.504,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.48599999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.38100000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.82599999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.73299999999999998,"15min":0.69499999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":7.4240000000000004,"5min":7.4240000000000004,"15min":7.4240000000000004},"last":1.022},{"interface":"front","average":{"1min":1.1639999999999999,"5min":0.77700000000000002,"15min":0.71299999999999997},"min":{"1min":0.49099999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":11.095000000000001,"5min":11.095000000000001,"15min":11.095000000000001},"last":0.89300000000000002}]},{"osd":7,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69999999999999996,"15min":0.68700000000000006},"min":{"1min":0.59499999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.95299999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.73899999999999999,"15min":0.72499999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0189999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":1.0389999999999999}]},{"osd":9,"last update":"Wed Oct 18 14:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.77200000000000002,"15min":0.74099999999999999},"min":{"1min":0.59599999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.101},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.76100000000000001,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":1.0600000000000001}]},{"osd":10,"last update":"Wed Oct 18 14:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.84699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":7,"up_from":51,"seq":219043332133,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1052168,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47599999999999998}]},{"osd":1,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.41199999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.441,"15min":0.437},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70299999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.63600000000000001}]},{"osd":3,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58899999999999997,"15min":0.58599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.745},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.376,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.66500000000000004}]},{"osd":5,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63600000000000001,"15min":0.624},"min":{"1min":0.439,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.54600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.86799999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91000000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.77800000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.58999999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.90600000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.78300000000000003},"min":{"1min":0.623,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.88500000000000001,"5min":1.514,"15min":1.514},"last":0.84699999999999998}]},{"osd":9,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.83299999999999996,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73799999999999999,"15min":0.745},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.84199999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.88}]},{"osd":10,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.91500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495658,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":458990,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.38300000000000001,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.372,"15min":0.34200000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.32100000000000001}]},{"osd":1,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70699999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.627},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.5},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.55800000000000005},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72399999999999998,"5min":1.476,"15min":1.476},"last":0.48799999999999999}]},{"osd":3,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40899999999999997,"15min":0.40000000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51800000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.434},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.39800000000000002}]},{"osd":4,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55400000000000005,"15min":0.52800000000000002},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56899999999999995,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77100000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66500000000000004}]},{"osd":5,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.622,"15min":0.60199999999999998},"min":{"1min":0.434,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.60699999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89200000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":1.0089999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.57999999999999996}]},{"osd":8,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92300000000000004,"5min":1.611,"15min":1.611},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.59699999999999998}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75900000000000001,"5min":1.415,"15min":1.415},"last":0.64700000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.68300000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":518472,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.80500000000000005,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.628}]},{"osd":2,"last update":"Wed Oct 18 14:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.57699999999999996,"15min":0.55000000000000004},"min":{"1min":0.42999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.86399999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.40799999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44900000000000001}]},{"osd":3,"last update":"Wed Oct 18 14:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.55200000000000005,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89500000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.5,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68200000000000005}]},{"osd":4,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.40600000000000003,"15min":0.38500000000000001},"min":{"1min":0.28999999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.46999999999999997,"15min":0.42899999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.49199999999999999}]},{"osd":5,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.45200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.56599999999999995,"15min":0.53500000000000003},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81299999999999994,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61399999999999999,"15min":0.57899999999999996},"min":{"1min":0.52400000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93100000000000005,"5min":1.127,"15min":1.127},"last":0.79900000000000004}]},{"osd":7,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76400000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.432}]},{"osd":8,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.57899999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63200000000000001,"15min":0.621},"min":{"1min":0.51900000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.59099999999999997}]},{"osd":9,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.73599999999999999,"15min":0.71599999999999997},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.746},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.052,"5min":1.165,"15min":1.165},"last":0.82399999999999995}]},{"osd":10,"last update":"Wed Oct 18 14:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":460323,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 14:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.496},"min":{"1min":0.41799999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.52600000000000002,"15min":0.48899999999999999},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Wed Oct 18 14:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.51000000000000001},"min":{"1min":0.40899999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.9870000000000001,"5min":0.81799999999999995,"15min":0.59799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":27.222999999999999,"5min":27.222999999999999,"15min":27.222999999999999},"last":0.47899999999999998}]},{"osd":3,"last update":"Wed Oct 18 14:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.40500000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.309,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Oct 18 14:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.39700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.62}]},{"osd":5,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67800000000000005,"5min":0.879,"15min":0.879},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.67300000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60699999999999998}]},{"osd":6,"last update":"Wed Oct 18 14:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.60199999999999998,"15min":0.54300000000000004},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":8.7010000000000005,"5min":8.7010000000000005,"15min":8.7010000000000005},"last":0.53400000000000003}]},{"osd":7,"last update":"Wed Oct 18 14:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60499999999999998}]},{"osd":8,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78300000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.70199999999999996,"15min":0.71199999999999997},"min":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89800000000000002,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64400000000000002}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":3.262,"5min":3.262,"15min":3.262},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.70499999999999996}]},{"osd":10,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.66500000000000004}]},{"osd":11,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.75700000000000001},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":27.154,"5min":27.154,"15min":27.154},"last":0.746}]}]},{"osd":2,"up_from":19,"seq":81604378683,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":518072,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.31,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.38600000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60799999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53000000000000003}]},{"osd":1,"last update":"Wed Oct 18 14:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.67400000000000004}]},{"osd":3,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.60299999999999998,"15min":0.56100000000000005},"min":{"1min":0.44700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":2.9119999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.61199999999999999,"15min":0.58599999999999997},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":2.8700000000000001}]},{"osd":4,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.745}]},{"osd":5,"last update":"Wed Oct 18 14:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.442,"15min":0.42999999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.45600000000000002,"15min":0.43099999999999999},"min":{"1min":0.312,"5min":0.308,"15min":0.308},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57799999999999996}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.34200000000000003}]},{"osd":8,"last update":"Wed Oct 18 14:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.56100000000000005,"15min":0.54400000000000004},"min":{"1min":0.42399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.61099999999999999,"15min":0.59299999999999997},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.77800000000000002}]},{"osd":9,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89300000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68700000000000006}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.92500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]}]},{"osd":3,"up_from":26,"seq":111669149750,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":458490,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.34899999999999998,"15min":0.32500000000000001},"min":{"1min":0.28199999999999997,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.56499999999999995,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.36699999999999999,"15min":0.35099999999999998},"min":{"1min":0.25800000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.41499999999999998}]},{"osd":1,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.51700000000000002},"min":{"1min":0.39400000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.78200000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54900000000000004,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56999999999999995}]},{"osd":2,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53600000000000003,"15min":0.52100000000000002},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70499999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.51800000000000002},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.65900000000000003,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.46999999999999997}]},{"osd":4,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84999999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed Oct 18 14:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40200000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70199999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.71099999999999997,"15min":0.67700000000000005},"min":{"1min":0.50800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78200000000000003,"5min":6.5,"15min":6.5},"last":0.58299999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.46999999999999997,"15min":0.48799999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.504,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.442},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74299999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.59499999999999997}]},{"osd":7,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.77500000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.76800000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.625}]},{"osd":8,"last update":"Wed Oct 18 14:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.56699999999999995}]},{"osd":9,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.58999999999999997,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.60899999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.66300000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60799999999999998}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":4,"up_from":34,"seq":146028888114,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":458845,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.42399999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.38400000000000001},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.39100000000000001,"15min":0.376},"min":{"1min":0.26000000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.39400000000000002}]},{"osd":2,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84399999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58199999999999996}]},{"osd":3,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.56499999999999995,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81999999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86699999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.47499999999999998}]},{"osd":5,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89500000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.629}]},{"osd":6,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.61299999999999999,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.55000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.55100000000000005}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55000000000000004,"15min":0.54100000000000004},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56599999999999995}]},{"osd":8,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.69799999999999995,"15min":0.68600000000000005},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.755},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.51600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.73799999999999999}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.75700000000000001,"15min":0.73899999999999999},"min":{"1min":0.55900000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.60199999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.65000000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.69799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":5,"up_from":39,"seq":167503724590,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":1051515,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.503,"15min":0.48099999999999998},"min":{"1min":0.36599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.499,"15min":0.48299999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58999999999999997}]},{"osd":1,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.38500000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.53500000000000003,"15min":0.51100000000000001},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.29499999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.379,"15min":0.36499999999999999},"min":{"1min":0.26400000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73499999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52900000000000003,"15min":0.51400000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74199999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.40300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70799999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46400000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.85999999999999999}]},{"osd":7,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76300000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.75700000000000001}]},{"osd":8,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.749,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.81499999999999995}]},{"osd":9,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.70799999999999996,"15min":0.69999999999999996},"min":{"1min":0.54200000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.90800000000000003}]},{"osd":10,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T14:03:20.468 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph pg dump --format=json 2023-10-18T14:03:21.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:20 smithi158 ceph-mon[103317]: pgmap v259: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s; 16 B/s, 0 keys/s, 0 objects/s recovering 2023-10-18T14:03:21.026 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:21.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:20 smithi172 ceph-mon[103574]: pgmap v259: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s; 16 B/s, 0 keys/s, 0 objects/s recovering 2023-10-18T14:03:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:20 smithi114 ceph-mon[99494]: pgmap v259: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 9 op/s; 16 B/s, 0 keys/s, 0 objects/s recovering 2023-10-18T14:03:21.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:21 smithi114 ceph-mon[99494]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:03:22.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:21 smithi158 ceph-mon[103317]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:03:22.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:21 smithi172 ceph-mon[103574]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:03:22.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.298+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/461801614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a8069880 msgr2=0x7fd3a810d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:22.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.298+0000 7fd3ad4bb700 1 --2- 172.21.15.114:0/461801614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a8069880 0x7fd3a810d6a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd3a000b0a0 tx=0x7fd3a000b3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:22.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.298+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/461801614 shutdown_connections 2023-10-18T14:03:22.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.298+0000 7fd3ad4bb700 1 --2- 172.21.15.114:0/461801614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a8069880 0x7fd3a810d6a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:22.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.298+0000 7fd3ad4bb700 1 --2- 172.21.15.114:0/461801614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a81067d0 0x7fd3a8106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:22.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.298+0000 7fd3ad4bb700 1 --2- 172.21.15.114:0/461801614 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3a8068ec0 0x7fd3a8069340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:22.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.298+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/461801614 >> 172.21.15.114:0/461801614 conn(0x7fd3a80765e0 msgr2=0x7fd3a80769f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:22.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.298+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/461801614 shutdown_connections 2023-10-18T14:03:22.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.298+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/461801614 wait complete. 2023-10-18T14:03:22.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.298+0000 7fd3ad4bb700 1 Processor -- start 2023-10-18T14:03:22.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3ad4bb700 1 -- start start 2023-10-18T14:03:22.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3ad4bb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a8068ec0 0x7fd3a819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:22.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3ad4bb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3a8069880 0x7fd3a819cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:22.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3ad4bb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a81067d0 0x7fd3a8196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:22.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3ad4bb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a8197270 con 0x7fd3a8068ec0 2023-10-18T14:03:22.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3ad4bb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a81973e0 con 0x7fd3a8069880 2023-10-18T14:03:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3ad4bb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a81975a0 con 0x7fd3a81067d0 2023-10-18T14:03:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3a6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a8068ec0 0x7fd3a819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3a6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a8068ec0 0x7fd3a819ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43038/0 (socket says 172.21.15.114:43038) 2023-10-18T14:03:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3a6ffd700 1 -- 172.21.15.114:0/1676332499 learned_addr learned my addr 172.21.15.114:0/1676332499 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3a67fc700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3a8069880 0x7fd3a819cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3a77fe700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a81067d0 0x7fd3a8196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3a6ffd700 1 -- 172.21.15.114:0/1676332499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a81067d0 msgr2=0x7fd3a8196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3a6ffd700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a81067d0 0x7fd3a8196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3a6ffd700 1 -- 172.21.15.114:0/1676332499 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3a8069880 msgr2=0x7fd3a819cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3a6ffd700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3a8069880 0x7fd3a819cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3a6ffd700 1 -- 172.21.15.114:0/1676332499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a0009d00 con 0x7fd3a8068ec0 2023-10-18T14:03:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3a67fc700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3a8069880 0x7fd3a819cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3a6ffd700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a8068ec0 0x7fd3a819ca10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00c9b0 tx=0x7fd39c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd38ffff700 1 -- 172.21.15.114:0/1676332499 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c007b00 con 0x7fd3a8068ec0 2023-10-18T14:03:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/1676332499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a8197880 con 0x7fd3a8068ec0 2023-10-18T14:03:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd38ffff700 1 -- 172.21.15.114:0/1676332499 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd39c007c60 con 0x7fd3a8068ec0 2023-10-18T14:03:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.299+0000 7fd38ffff700 1 -- 172.21.15.114:0/1676332499 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c018660 con 0x7fd3a8068ec0 2023-10-18T14:03:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.300+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/1676332499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a81a39e0 con 0x7fd3a8068ec0 2023-10-18T14:03:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.301+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/1676332499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a8108df0 con 0x7fd3a8068ec0 2023-10-18T14:03:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.301+0000 7fd38ffff700 1 -- 172.21.15.114:0/1676332499 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fd39c018880 con 0x7fd3a8068ec0 2023-10-18T14:03:22.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.302+0000 7fd38ffff700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3900a1560 0x7fd3900a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:22.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.302+0000 7fd3a67fc700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3900a1560 0x7fd3900a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.302+0000 7fd38ffff700 1 -- 172.21.15.114:0/1676332499 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd39c0ccf90 con 0x7fd3a8068ec0 2023-10-18T14:03:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.302+0000 7fd3a67fc700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3900a1560 0x7fd3900a3a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd398005950 tx=0x7fd3980058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.306+0000 7fd38ffff700 1 -- 172.21.15.114:0/1676332499 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd39c0963f0 con 0x7fd3a8068ec0 2023-10-18T14:03:22.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.492+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/1676332499 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3a8197fa0 con 0x7fd3900a1560 2023-10-18T14:03:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.502+0000 7fd38ffff700 1 -- 172.21.15.114:0/1676332499 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341633 (secure 0 0 0) 0x7fd3a8197fa0 con 0x7fd3900a1560 2023-10-18T14:03:22.509 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:22.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.505+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/1676332499 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3900a1560 msgr2=0x7fd3900a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:22.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.505+0000 7fd3ad4bb700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3900a1560 0x7fd3900a3a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd398005950 tx=0x7fd3980058e0 comp rx=0 tx=0).stop 2023-10-18T14:03:22.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.505+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/1676332499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a8068ec0 msgr2=0x7fd3a819ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:22.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.505+0000 7fd3ad4bb700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a8068ec0 0x7fd3a819ca10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00c9b0 tx=0x7fd39c00cd70 comp rx=0 tx=0).stop 2023-10-18T14:03:22.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.505+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/1676332499 shutdown_connections 2023-10-18T14:03:22.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.505+0000 7fd3ad4bb700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3900a1560 0x7fd3900a3a20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:22.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.505+0000 7fd3ad4bb700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a81067d0 0x7fd3a8196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:22.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.505+0000 7fd3ad4bb700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a8068ec0 0x7fd3a819ca10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:22.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.505+0000 7fd3ad4bb700 1 --2- 172.21.15.114:0/1676332499 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3a8069880 0x7fd3a819cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:22.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.505+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/1676332499 >> 172.21.15.114:0/1676332499 conn(0x7fd3a80765e0 msgr2=0x7fd3a80fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:22.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.505+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/1676332499 shutdown_connections 2023-10-18T14:03:22.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:22.505+0000 7fd3ad4bb700 1 -- 172.21.15.114:0/1676332499 wait complete. 2023-10-18T14:03:22.514 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T14:03:22.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:22 smithi114 ceph-mon[99494]: pgmap v260: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 10 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2023-10-18T14:03:22.868 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-10-18T14:03:21.569952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656001,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":585,"num_read_kb":417,"num_write":412,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180916,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335716,"kb_used_data":11448,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606108,"statfs":{"total":1151940427776,"available":1151596654592,"internally_reserved":0,"allocated":11722752,"data_stored":7463477,"data_compressed":177861,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":71,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":180,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003206"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631494+0000","last_change":"2023-10-18T14:02:32.447514+0000","last_active":"2023-10-18T14:03:07.631494+0000","last_peered":"2023-10-18T14:03:07.631494+0000","last_clean":"2023-10-18T14:03:07.631494+0000","last_became_active":"2023-10-18T14:02:32.447109+0000","last_became_peered":"2023-10-18T14:02:32.447109+0000","last_unstale":"2023-10-18T14:03:07.631494+0000","last_undegraded":"2023-10-18T14:03:07.631494+0000","last_fullsized":"2023-10-18T14:03:07.631494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:02:52.453371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631611+0000","last_change":"2023-10-18T14:02:32.457696+0000","last_active":"2023-10-18T14:03:07.631611+0000","last_peered":"2023-10-18T14:03:07.631611+0000","last_clean":"2023-10-18T14:03:07.631611+0000","last_became_active":"2023-10-18T14:02:32.457380+0000","last_became_peered":"2023-10-18T14:02:32.457380+0000","last_unstale":"2023-10-18T14:03:07.631611+0000","last_undegraded":"2023-10-18T14:03:07.631611+0000","last_fullsized":"2023-10-18T14:03:07.631611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:09:09.303044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632120+0000","last_change":"2023-10-18T14:02:32.450312+0000","last_active":"2023-10-18T14:03:07.632120+0000","last_peered":"2023-10-18T14:03:07.632120+0000","last_clean":"2023-10-18T14:03:07.632120+0000","last_became_active":"2023-10-18T14:02:32.449994+0000","last_became_peered":"2023-10-18T14:02:32.449994+0000","last_unstale":"2023-10-18T14:03:07.632120+0000","last_undegraded":"2023-10-18T14:03:07.632120+0000","last_fullsized":"2023-10-18T14:03:07.632120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:28:32.445958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628336+0000","last_change":"2023-10-18T14:02:32.450511+0000","last_active":"2023-10-18T14:03:07.628336+0000","last_peered":"2023-10-18T14:03:07.628336+0000","last_clean":"2023-10-18T14:03:07.628336+0000","last_became_active":"2023-10-18T14:02:32.450105+0000","last_became_peered":"2023-10-18T14:02:32.450105+0000","last_unstale":"2023-10-18T14:03:07.628336+0000","last_undegraded":"2023-10-18T14:03:07.628336+0000","last_fullsized":"2023-10-18T14:03:07.628336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:24:52.054236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630046+0000","last_change":"2023-10-18T14:02:32.447099+0000","last_active":"2023-10-18T14:03:07.630046+0000","last_peered":"2023-10-18T14:03:07.630046+0000","last_clean":"2023-10-18T14:03:07.630046+0000","last_became_active":"2023-10-18T14:02:32.446812+0000","last_became_peered":"2023-10-18T14:02:32.446812+0000","last_unstale":"2023-10-18T14:03:07.630046+0000","last_undegraded":"2023-10-18T14:03:07.630046+0000","last_fullsized":"2023-10-18T14:03:07.630046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:11:10.895149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632396+0000","last_change":"2023-10-18T14:02:32.444055+0000","last_active":"2023-10-18T14:03:07.632396+0000","last_peered":"2023-10-18T14:03:07.632396+0000","last_clean":"2023-10-18T14:03:07.632396+0000","last_became_active":"2023-10-18T14:02:32.443750+0000","last_became_peered":"2023-10-18T14:02:32.443750+0000","last_unstale":"2023-10-18T14:03:07.632396+0000","last_undegraded":"2023-10-18T14:03:07.632396+0000","last_fullsized":"2023-10-18T14:03:07.632396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:05:37.783713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630037+0000","last_change":"2023-10-18T14:02:32.462147+0000","last_active":"2023-10-18T14:03:07.630037+0000","last_peered":"2023-10-18T14:03:07.630037+0000","last_clean":"2023-10-18T14:03:07.630037+0000","last_became_active":"2023-10-18T14:02:32.461712+0000","last_became_peered":"2023-10-18T14:02:32.461712+0000","last_unstale":"2023-10-18T14:03:07.630037+0000","last_undegraded":"2023-10-18T14:03:07.630037+0000","last_fullsized":"2023-10-18T14:03:07.630037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:10:39.936092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631949+0000","last_change":"2023-10-18T14:02:32.449466+0000","last_active":"2023-10-18T14:03:07.631949+0000","last_peered":"2023-10-18T14:03:07.631949+0000","last_clean":"2023-10-18T14:03:07.631949+0000","last_became_active":"2023-10-18T14:02:32.449146+0000","last_became_peered":"2023-10-18T14:02:32.449146+0000","last_unstale":"2023-10-18T14:03:07.631949+0000","last_undegraded":"2023-10-18T14:03:07.631949+0000","last_fullsized":"2023-10-18T14:03:07.631949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:28.427003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634152+0000","last_change":"2023-10-18T14:02:32.448901+0000","last_active":"2023-10-18T14:03:07.634152+0000","last_peered":"2023-10-18T14:03:07.634152+0000","last_clean":"2023-10-18T14:03:07.634152+0000","last_became_active":"2023-10-18T14:02:32.448379+0000","last_became_peered":"2023-10-18T14:02:32.448379+0000","last_unstale":"2023-10-18T14:03:07.634152+0000","last_undegraded":"2023-10-18T14:03:07.634152+0000","last_fullsized":"2023-10-18T14:03:07.634152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:53:22.743915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632688+0000","last_change":"2023-10-18T14:02:32.446575+0000","last_active":"2023-10-18T14:03:07.632688+0000","last_peered":"2023-10-18T14:03:07.632688+0000","last_clean":"2023-10-18T14:03:07.632688+0000","last_became_active":"2023-10-18T14:02:32.445756+0000","last_became_peered":"2023-10-18T14:02:32.445756+0000","last_unstale":"2023-10-18T14:03:07.632688+0000","last_undegraded":"2023-10-18T14:03:07.632688+0000","last_fullsized":"2023-10-18T14:03:07.632688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:55.490373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630414+0000","last_change":"2023-10-18T14:02:32.460943+0000","last_active":"2023-10-18T14:03:07.630414+0000","last_peered":"2023-10-18T14:03:07.630414+0000","last_clean":"2023-10-18T14:03:07.630414+0000","last_became_active":"2023-10-18T14:02:32.460540+0000","last_became_peered":"2023-10-18T14:02:32.460540+0000","last_unstale":"2023-10-18T14:03:07.630414+0000","last_undegraded":"2023-10-18T14:03:07.630414+0000","last_fullsized":"2023-10-18T14:03:07.630414+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:44:59.309663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628177+0000","last_change":"2023-10-18T14:02:32.450665+0000","last_active":"2023-10-18T14:03:07.628177+0000","last_peered":"2023-10-18T14:03:07.628177+0000","last_clean":"2023-10-18T14:03:07.628177+0000","last_became_active":"2023-10-18T14:02:32.450286+0000","last_became_peered":"2023-10-18T14:02:32.450286+0000","last_unstale":"2023-10-18T14:03:07.628177+0000","last_undegraded":"2023-10-18T14:03:07.628177+0000","last_fullsized":"2023-10-18T14:03:07.628177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:01:17.874856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633946+0000","last_change":"2023-10-18T14:02:32.444129+0000","last_active":"2023-10-18T14:03:07.633946+0000","last_peered":"2023-10-18T14:03:07.633946+0000","last_clean":"2023-10-18T14:03:07.633946+0000","last_became_active":"2023-10-18T14:02:32.443898+0000","last_became_peered":"2023-10-18T14:02:32.443898+0000","last_unstale":"2023-10-18T14:03:07.633946+0000","last_undegraded":"2023-10-18T14:03:07.633946+0000","last_fullsized":"2023-10-18T14:03:07.633946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:20:35.391806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631518+0000","last_change":"2023-10-18T14:02:32.457637+0000","last_active":"2023-10-18T14:03:07.631518+0000","last_peered":"2023-10-18T14:03:07.631518+0000","last_clean":"2023-10-18T14:03:07.631518+0000","last_became_active":"2023-10-18T14:02:32.457345+0000","last_became_peered":"2023-10-18T14:02:32.457345+0000","last_unstale":"2023-10-18T14:03:07.631518+0000","last_undegraded":"2023-10-18T14:03:07.631518+0000","last_fullsized":"2023-10-18T14:03:07.631518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:18:47.579689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631487+0000","last_change":"2023-10-18T14:02:32.449765+0000","last_active":"2023-10-18T14:03:07.631487+0000","last_peered":"2023-10-18T14:03:07.631487+0000","last_clean":"2023-10-18T14:03:07.631487+0000","last_became_active":"2023-10-18T14:02:32.449467+0000","last_became_peered":"2023-10-18T14:02:32.449467+0000","last_unstale":"2023-10-18T14:03:07.631487+0000","last_undegraded":"2023-10-18T14:03:07.631487+0000","last_fullsized":"2023-10-18T14:03:07.631487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:09:15.324290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633644+0000","last_change":"2023-10-18T14:02:32.456634+0000","last_active":"2023-10-18T14:03:07.633644+0000","last_peered":"2023-10-18T14:03:07.633644+0000","last_clean":"2023-10-18T14:03:07.633644+0000","last_became_active":"2023-10-18T14:02:32.456336+0000","last_became_peered":"2023-10-18T14:02:32.456336+0000","last_unstale":"2023-10-18T14:03:07.633644+0000","last_undegraded":"2023-10-18T14:03:07.633644+0000","last_fullsized":"2023-10-18T14:03:07.633644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:29:47.973539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631514+0000","last_change":"2023-10-18T14:02:32.447357+0000","last_active":"2023-10-18T14:03:07.631514+0000","last_peered":"2023-10-18T14:03:07.631514+0000","last_clean":"2023-10-18T14:03:07.631514+0000","last_became_active":"2023-10-18T14:02:32.446756+0000","last_became_peered":"2023-10-18T14:02:32.446756+0000","last_unstale":"2023-10-18T14:03:07.631514+0000","last_undegraded":"2023-10-18T14:03:07.631514+0000","last_fullsized":"2023-10-18T14:03:07.631514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:13:22.467662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627607+0000","last_change":"2023-10-18T14:02:32.452786+0000","last_active":"2023-10-18T14:03:07.627607+0000","last_peered":"2023-10-18T14:03:07.627607+0000","last_clean":"2023-10-18T14:03:07.627607+0000","last_became_active":"2023-10-18T14:02:32.452551+0000","last_became_peered":"2023-10-18T14:02:32.452551+0000","last_unstale":"2023-10-18T14:03:07.627607+0000","last_undegraded":"2023-10-18T14:03:07.627607+0000","last_fullsized":"2023-10-18T14:03:07.627607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:07.709943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628230+0000","last_change":"2023-10-18T14:02:32.453264+0000","last_active":"2023-10-18T14:03:07.628230+0000","last_peered":"2023-10-18T14:03:07.628230+0000","last_clean":"2023-10-18T14:03:07.628230+0000","last_became_active":"2023-10-18T14:02:32.452948+0000","last_became_peered":"2023-10-18T14:02:32.452948+0000","last_unstale":"2023-10-18T14:03:07.628230+0000","last_undegraded":"2023-10-18T14:03:07.628230+0000","last_fullsized":"2023-10-18T14:03:07.628230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:00:55.243191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:19.350438+0000","last_change":"2023-10-18T14:02:31.843752+0000","last_active":"2023-10-18T14:03:19.350438+0000","last_peered":"2023-10-18T14:03:19.350438+0000","last_clean":"2023-10-18T14:03:19.350438+0000","last_became_active":"2023-10-18T14:02:31.843415+0000","last_became_peered":"2023-10-18T14:02:31.843415+0000","last_unstale":"2023-10-18T14:03:19.350438+0000","last_undegraded":"2023-10-18T14:03:19.350438+0000","last_fullsized":"2023-10-18T14:03:19.350438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:32:11.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633385+0000","last_change":"2023-10-18T14:02:32.458934+0000","last_active":"2023-10-18T14:03:07.633385+0000","last_peered":"2023-10-18T14:03:07.633385+0000","last_clean":"2023-10-18T14:03:07.633385+0000","last_became_active":"2023-10-18T14:02:32.458624+0000","last_became_peered":"2023-10-18T14:02:32.458624+0000","last_unstale":"2023-10-18T14:03:07.633385+0000","last_undegraded":"2023-10-18T14:03:07.633385+0000","last_fullsized":"2023-10-18T14:03:07.633385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:24:20.034637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633439+0000","last_change":"2023-10-18T14:02:31.842666+0000","last_active":"2023-10-18T14:03:07.633439+0000","last_peered":"2023-10-18T14:03:07.633439+0000","last_clean":"2023-10-18T14:03:07.633439+0000","last_became_active":"2023-10-18T14:02:31.842366+0000","last_became_peered":"2023-10-18T14:02:31.842366+0000","last_unstale":"2023-10-18T14:03:07.633439+0000","last_undegraded":"2023-10-18T14:03:07.633439+0000","last_fullsized":"2023-10-18T14:03:07.633439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:11:08.150402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631653+0000","last_change":"2023-10-18T14:02:32.453731+0000","last_active":"2023-10-18T14:03:07.631653+0000","last_peered":"2023-10-18T14:03:07.631653+0000","last_clean":"2023-10-18T14:03:07.631653+0000","last_became_active":"2023-10-18T14:02:32.453405+0000","last_became_peered":"2023-10-18T14:02:32.453405+0000","last_unstale":"2023-10-18T14:03:07.631653+0000","last_undegraded":"2023-10-18T14:03:07.631653+0000","last_fullsized":"2023-10-18T14:03:07.631653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:19:57.878074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631664+0000","last_change":"2023-10-18T14:02:31.851514+0000","last_active":"2023-10-18T14:03:07.631664+0000","last_peered":"2023-10-18T14:03:07.631664+0000","last_clean":"2023-10-18T14:03:07.631664+0000","last_became_active":"2023-10-18T14:02:31.851236+0000","last_became_peered":"2023-10-18T14:02:31.851236+0000","last_unstale":"2023-10-18T14:03:07.631664+0000","last_undegraded":"2023-10-18T14:03:07.631664+0000","last_fullsized":"2023-10-18T14:03:07.631664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:35:26.804135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634258+0000","last_change":"2023-10-18T14:02:32.460018+0000","last_active":"2023-10-18T14:03:07.634258+0000","last_peered":"2023-10-18T14:03:07.634258+0000","last_clean":"2023-10-18T14:03:07.634258+0000","last_became_active":"2023-10-18T14:02:32.459738+0000","last_became_peered":"2023-10-18T14:02:32.459738+0000","last_unstale":"2023-10-18T14:03:07.634258+0000","last_undegraded":"2023-10-18T14:03:07.634258+0000","last_fullsized":"2023-10-18T14:03:07.634258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:48.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630318+0000","last_change":"2023-10-18T14:02:31.850112+0000","last_active":"2023-10-18T14:03:07.630318+0000","last_peered":"2023-10-18T14:03:07.630318+0000","last_clean":"2023-10-18T14:03:07.630318+0000","last_became_active":"2023-10-18T14:02:31.849515+0000","last_became_peered":"2023-10-18T14:02:31.849515+0000","last_unstale":"2023-10-18T14:03:07.630318+0000","last_undegraded":"2023-10-18T14:03:07.630318+0000","last_fullsized":"2023-10-18T14:03:07.630318+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:35:20.338900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633120+0000","last_change":"2023-10-18T14:02:32.459221+0000","last_active":"2023-10-18T14:03:07.633120+0000","last_peered":"2023-10-18T14:03:07.633120+0000","last_clean":"2023-10-18T14:03:07.633120+0000","last_became_active":"2023-10-18T14:02:32.458912+0000","last_became_peered":"2023-10-18T14:02:32.458912+0000","last_unstale":"2023-10-18T14:03:07.633120+0000","last_undegraded":"2023-10-18T14:03:07.633120+0000","last_fullsized":"2023-10-18T14:03:07.633120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:54:02.630861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:15.319751+0000","last_change":"2023-10-18T14:02:31.846754+0000","last_active":"2023-10-18T14:03:15.319751+0000","last_peered":"2023-10-18T14:03:15.319751+0000","last_clean":"2023-10-18T14:03:15.319751+0000","last_became_active":"2023-10-18T14:02:31.846450+0000","last_became_peered":"2023-10-18T14:02:31.846450+0000","last_unstale":"2023-10-18T14:03:15.319751+0000","last_undegraded":"2023-10-18T14:03:15.319751+0000","last_fullsized":"2023-10-18T14:03:15.319751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:11.929528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.638502+0000","last_change":"2023-10-18T14:03:08.638502+0000","last_active":"2023-10-18T14:03:08.638502+0000","last_peered":"2023-10-18T14:03:08.638502+0000","last_clean":"2023-10-18T14:03:08.638502+0000","last_became_active":"2023-10-18T14:03:08.638101+0000","last_became_peered":"2023-10-18T14:03:08.638101+0000","last_unstale":"2023-10-18T14:03:08.638502+0000","last_undegraded":"2023-10-18T14:03:08.638502+0000","last_fullsized":"2023-10-18T14:03:08.638502+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:56:47.297642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632268+0000","last_change":"2023-10-18T14:02:31.846135+0000","last_active":"2023-10-18T14:03:07.632268+0000","last_peered":"2023-10-18T14:03:07.632268+0000","last_clean":"2023-10-18T14:03:07.632268+0000","last_became_active":"2023-10-18T14:02:31.845800+0000","last_became_peered":"2023-10-18T14:02:31.845800+0000","last_unstale":"2023-10-18T14:03:07.632268+0000","last_undegraded":"2023-10-18T14:03:07.632268+0000","last_fullsized":"2023-10-18T14:03:07.632268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:22:55.945930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633140+0000","last_change":"2023-10-18T14:02:32.445803+0000","last_active":"2023-10-18T14:03:07.633140+0000","last_peered":"2023-10-18T14:03:07.633140+0000","last_clean":"2023-10-18T14:03:07.633140+0000","last_became_active":"2023-10-18T14:02:32.445489+0000","last_became_peered":"2023-10-18T14:02:32.445489+0000","last_unstale":"2023-10-18T14:03:07.633140+0000","last_undegraded":"2023-10-18T14:03:07.633140+0000","last_fullsized":"2023-10-18T14:03:07.633140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:38:46.101215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632990+0000","last_change":"2023-10-18T14:02:31.843827+0000","last_active":"2023-10-18T14:03:07.632990+0000","last_peered":"2023-10-18T14:03:07.632990+0000","last_clean":"2023-10-18T14:03:07.632990+0000","last_became_active":"2023-10-18T14:02:31.843533+0000","last_became_peered":"2023-10-18T14:02:31.843533+0000","last_unstale":"2023-10-18T14:03:07.632990+0000","last_undegraded":"2023-10-18T14:03:07.632990+0000","last_fullsized":"2023-10-18T14:03:07.632990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:00:03.832002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632031+0000","last_change":"2023-10-18T14:02:32.447400+0000","last_active":"2023-10-18T14:03:07.632031+0000","last_peered":"2023-10-18T14:03:07.632031+0000","last_clean":"2023-10-18T14:03:07.632031+0000","last_became_active":"2023-10-18T14:02:32.447024+0000","last_became_peered":"2023-10-18T14:02:32.447024+0000","last_unstale":"2023-10-18T14:03:07.632031+0000","last_undegraded":"2023-10-18T14:03:07.632031+0000","last_fullsized":"2023-10-18T14:03:07.632031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:49:37.596273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632467+0000","last_change":"2023-10-18T14:02:31.847527+0000","last_active":"2023-10-18T14:03:07.632467+0000","last_peered":"2023-10-18T14:03:07.632467+0000","last_clean":"2023-10-18T14:03:07.632467+0000","last_became_active":"2023-10-18T14:02:31.847249+0000","last_became_peered":"2023-10-18T14:02:31.847249+0000","last_unstale":"2023-10-18T14:03:07.632467+0000","last_undegraded":"2023-10-18T14:03:07.632467+0000","last_fullsized":"2023-10-18T14:03:07.632467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:11:34.217776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627384+0000","last_change":"2023-10-18T14:02:32.452268+0000","last_active":"2023-10-18T14:03:07.627384+0000","last_peered":"2023-10-18T14:03:07.627384+0000","last_clean":"2023-10-18T14:03:07.627384+0000","last_became_active":"2023-10-18T14:02:32.451338+0000","last_became_peered":"2023-10-18T14:02:32.451338+0000","last_unstale":"2023-10-18T14:03:07.627384+0000","last_undegraded":"2023-10-18T14:03:07.627384+0000","last_fullsized":"2023-10-18T14:03:07.627384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:17:11.743280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":103,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:19.324827+0000","last_change":"2023-10-18T14:02:31.841862+0000","last_active":"2023-10-18T14:03:19.324827+0000","last_peered":"2023-10-18T14:03:19.324827+0000","last_clean":"2023-10-18T14:03:19.324827+0000","last_became_active":"2023-10-18T14:02:31.841481+0000","last_became_peered":"2023-10-18T14:02:31.841481+0000","last_unstale":"2023-10-18T14:03:19.324827+0000","last_undegraded":"2023-10-18T14:03:19.324827+0000","last_fullsized":"2023-10-18T14:03:19.324827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:38:26.263626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633941+0000","last_change":"2023-10-18T14:02:32.447608+0000","last_active":"2023-10-18T14:03:07.633941+0000","last_peered":"2023-10-18T14:03:07.633941+0000","last_clean":"2023-10-18T14:03:07.633941+0000","last_became_active":"2023-10-18T14:02:32.447057+0000","last_became_peered":"2023-10-18T14:02:32.447057+0000","last_unstale":"2023-10-18T14:03:07.633941+0000","last_undegraded":"2023-10-18T14:03:07.633941+0000","last_fullsized":"2023-10-18T14:03:07.633941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:33:43.469496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630438+0000","last_change":"2023-10-18T14:02:31.849118+0000","last_active":"2023-10-18T14:03:07.630438+0000","last_peered":"2023-10-18T14:03:07.630438+0000","last_clean":"2023-10-18T14:03:07.630438+0000","last_became_active":"2023-10-18T14:02:31.848827+0000","last_became_peered":"2023-10-18T14:02:31.848827+0000","last_unstale":"2023-10-18T14:03:07.630438+0000","last_undegraded":"2023-10-18T14:03:07.630438+0000","last_fullsized":"2023-10-18T14:03:07.630438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:41:17.309102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631773+0000","last_change":"2023-10-18T14:02:32.447157+0000","last_active":"2023-10-18T14:03:07.631773+0000","last_peered":"2023-10-18T14:03:07.631773+0000","last_clean":"2023-10-18T14:03:07.631773+0000","last_became_active":"2023-10-18T14:02:32.446861+0000","last_became_peered":"2023-10-18T14:02:32.446861+0000","last_unstale":"2023-10-18T14:03:07.631773+0000","last_undegraded":"2023-10-18T14:03:07.631773+0000","last_fullsized":"2023-10-18T14:03:07.631773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:58:58.146931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633247+0000","last_change":"2023-10-18T14:02:31.838819+0000","last_active":"2023-10-18T14:03:07.633247+0000","last_peered":"2023-10-18T14:03:07.633247+0000","last_clean":"2023-10-18T14:03:07.633247+0000","last_became_active":"2023-10-18T14:02:31.838488+0000","last_became_peered":"2023-10-18T14:02:31.838488+0000","last_unstale":"2023-10-18T14:03:07.633247+0000","last_undegraded":"2023-10-18T14:03:07.633247+0000","last_fullsized":"2023-10-18T14:03:07.633247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:41:37.569792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633964+0000","last_change":"2023-10-18T14:02:32.455108+0000","last_active":"2023-10-18T14:03:07.633964+0000","last_peered":"2023-10-18T14:03:07.633964+0000","last_clean":"2023-10-18T14:03:07.633964+0000","last_became_active":"2023-10-18T14:02:32.454821+0000","last_became_peered":"2023-10-18T14:02:32.454821+0000","last_unstale":"2023-10-18T14:03:07.633964+0000","last_undegraded":"2023-10-18T14:03:07.633964+0000","last_fullsized":"2023-10-18T14:03:07.633964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:00:29.617633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:19.324930+0000","last_change":"2023-10-18T14:02:31.847241+0000","last_active":"2023-10-18T14:03:19.324930+0000","last_peered":"2023-10-18T14:03:19.324930+0000","last_clean":"2023-10-18T14:03:19.324930+0000","last_became_active":"2023-10-18T14:02:31.846786+0000","last_became_peered":"2023-10-18T14:02:31.846786+0000","last_unstale":"2023-10-18T14:03:19.324930+0000","last_undegraded":"2023-10-18T14:03:19.324930+0000","last_fullsized":"2023-10-18T14:03:19.324930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:53:47.539696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58575,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":91,"num_read_kb":102,"num_write":31,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630833+0000","last_change":"2023-10-18T14:02:32.458530+0000","last_active":"2023-10-18T14:03:07.630833+0000","last_peered":"2023-10-18T14:03:07.630833+0000","last_clean":"2023-10-18T14:03:07.630833+0000","last_became_active":"2023-10-18T14:02:32.458199+0000","last_became_peered":"2023-10-18T14:02:32.458199+0000","last_unstale":"2023-10-18T14:03:07.630833+0000","last_undegraded":"2023-10-18T14:03:07.630833+0000","last_fullsized":"2023-10-18T14:03:07.630833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:52:16.107456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.656760+0000","last_change":"2023-10-18T14:03:08.656457+0000","last_active":"2023-10-18T14:03:08.656760+0000","last_peered":"2023-10-18T14:03:08.656760+0000","last_clean":"2023-10-18T14:03:08.656760+0000","last_became_active":"2023-10-18T14:03:08.638227+0000","last_became_peered":"2023-10-18T14:03:08.638227+0000","last_unstale":"2023-10-18T14:03:08.656760+0000","last_undegraded":"2023-10-18T14:03:08.656760+0000","last_fullsized":"2023-10-18T14:03:08.656760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:28:29.502844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633370+0000","last_change":"2023-10-18T14:02:32.456404+0000","last_active":"2023-10-18T14:03:07.633370+0000","last_peered":"2023-10-18T14:03:07.633370+0000","last_clean":"2023-10-18T14:03:07.633370+0000","last_became_active":"2023-10-18T14:02:32.456128+0000","last_became_peered":"2023-10-18T14:02:32.456128+0000","last_unstale":"2023-10-18T14:03:07.633370+0000","last_undegraded":"2023-10-18T14:03:07.633370+0000","last_fullsized":"2023-10-18T14:03:07.633370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:23:41.315513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633298+0000","last_change":"2023-10-18T14:02:31.846871+0000","last_active":"2023-10-18T14:03:07.633298+0000","last_peered":"2023-10-18T14:03:07.633298+0000","last_clean":"2023-10-18T14:03:07.633298+0000","last_became_active":"2023-10-18T14:02:31.846570+0000","last_became_peered":"2023-10-18T14:02:31.846570+0000","last_unstale":"2023-10-18T14:03:07.633298+0000","last_undegraded":"2023-10-18T14:03:07.633298+0000","last_fullsized":"2023-10-18T14:03:07.633298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:38:46.096769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.632825+0000","last_change":"2023-10-18T14:03:08.632825+0000","last_active":"2023-10-18T14:03:08.632825+0000","last_peered":"2023-10-18T14:03:08.632825+0000","last_clean":"2023-10-18T14:03:08.632825+0000","last_became_active":"2023-10-18T14:03:08.632453+0000","last_became_peered":"2023-10-18T14:03:08.632453+0000","last_unstale":"2023-10-18T14:03:08.632825+0000","last_undegraded":"2023-10-18T14:03:08.632825+0000","last_fullsized":"2023-10-18T14:03:08.632825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:30.707828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":65,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:19.324891+0000","last_change":"2023-10-18T14:02:31.844367+0000","last_active":"2023-10-18T14:03:19.324891+0000","last_peered":"2023-10-18T14:03:19.324891+0000","last_clean":"2023-10-18T14:03:19.324891+0000","last_became_active":"2023-10-18T14:02:31.844060+0000","last_became_peered":"2023-10-18T14:02:31.844060+0000","last_unstale":"2023-10-18T14:03:19.324891+0000","last_undegraded":"2023-10-18T14:03:19.324891+0000","last_fullsized":"2023-10-18T14:03:19.324891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:06:09.656240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629934+0000","last_change":"2023-10-18T14:02:32.464529+0000","last_active":"2023-10-18T14:03:07.629934+0000","last_peered":"2023-10-18T14:03:07.629934+0000","last_clean":"2023-10-18T14:03:07.629934+0000","last_became_active":"2023-10-18T14:02:32.464232+0000","last_became_peered":"2023-10-18T14:02:32.464232+0000","last_unstale":"2023-10-18T14:03:07.629934+0000","last_undegraded":"2023-10-18T14:03:07.629934+0000","last_fullsized":"2023-10-18T14:03:07.629934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:10:43.011803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629881+0000","last_change":"2023-10-18T14:02:31.850537+0000","last_active":"2023-10-18T14:03:07.629881+0000","last_peered":"2023-10-18T14:03:07.629881+0000","last_clean":"2023-10-18T14:03:07.629881+0000","last_became_active":"2023-10-18T14:02:31.849391+0000","last_became_peered":"2023-10-18T14:02:31.849391+0000","last_unstale":"2023-10-18T14:03:07.629881+0000","last_undegraded":"2023-10-18T14:03:07.629881+0000","last_fullsized":"2023-10-18T14:03:07.629881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:19:31.270179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.635208+0000","last_change":"2023-10-18T14:03:08.635208+0000","last_active":"2023-10-18T14:03:08.635208+0000","last_peered":"2023-10-18T14:03:08.635208+0000","last_clean":"2023-10-18T14:03:08.635208+0000","last_became_active":"2023-10-18T14:03:08.634800+0000","last_became_peered":"2023-10-18T14:03:08.634800+0000","last_unstale":"2023-10-18T14:03:08.635208+0000","last_undegraded":"2023-10-18T14:03:08.635208+0000","last_fullsized":"2023-10-18T14:03:08.635208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:36:00.844237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631121+0000","last_change":"2023-10-18T14:02:31.850706+0000","last_active":"2023-10-18T14:03:07.631121+0000","last_peered":"2023-10-18T14:03:07.631121+0000","last_clean":"2023-10-18T14:03:07.631121+0000","last_became_active":"2023-10-18T14:02:31.849354+0000","last_became_peered":"2023-10-18T14:02:31.849354+0000","last_unstale":"2023-10-18T14:03:07.631121+0000","last_undegraded":"2023-10-18T14:03:07.631121+0000","last_fullsized":"2023-10-18T14:03:07.631121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:51:31.071528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631242+0000","last_change":"2023-10-18T14:02:32.454196+0000","last_active":"2023-10-18T14:03:07.631242+0000","last_peered":"2023-10-18T14:03:07.631242+0000","last_clean":"2023-10-18T14:03:07.631242+0000","last_became_active":"2023-10-18T14:02:32.453861+0000","last_became_peered":"2023-10-18T14:02:32.453861+0000","last_unstale":"2023-10-18T14:03:07.631242+0000","last_undegraded":"2023-10-18T14:03:07.631242+0000","last_fullsized":"2023-10-18T14:03:07.631242+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:43.217757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627432+0000","last_change":"2023-10-18T14:02:31.849707+0000","last_active":"2023-10-18T14:03:07.627432+0000","last_peered":"2023-10-18T14:03:07.627432+0000","last_clean":"2023-10-18T14:03:07.627432+0000","last_became_active":"2023-10-18T14:02:31.849442+0000","last_became_peered":"2023-10-18T14:02:31.849442+0000","last_unstale":"2023-10-18T14:03:07.627432+0000","last_undegraded":"2023-10-18T14:03:07.627432+0000","last_fullsized":"2023-10-18T14:03:07.627432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:39:15.669730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632631+0000","last_change":"2023-10-18T14:02:32.457433+0000","last_active":"2023-10-18T14:03:07.632631+0000","last_peered":"2023-10-18T14:03:07.632631+0000","last_clean":"2023-10-18T14:03:07.632631+0000","last_became_active":"2023-10-18T14:02:32.457057+0000","last_became_peered":"2023-10-18T14:02:32.457057+0000","last_unstale":"2023-10-18T14:03:07.632631+0000","last_undegraded":"2023-10-18T14:03:07.632631+0000","last_fullsized":"2023-10-18T14:03:07.632631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:53.088723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":60,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:16.347282+0000","last_change":"2023-10-18T14:02:31.848595+0000","last_active":"2023-10-18T14:03:16.347282+0000","last_peered":"2023-10-18T14:03:16.347282+0000","last_clean":"2023-10-18T14:03:16.347282+0000","last_became_active":"2023-10-18T14:02:31.847987+0000","last_became_peered":"2023-10-18T14:02:31.847987+0000","last_unstale":"2023-10-18T14:03:16.347282+0000","last_undegraded":"2023-10-18T14:03:16.347282+0000","last_fullsized":"2023-10-18T14:03:16.347282+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:03:34.356729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632829+0000","last_change":"2023-10-18T14:02:32.446514+0000","last_active":"2023-10-18T14:03:07.632829+0000","last_peered":"2023-10-18T14:03:07.632829+0000","last_clean":"2023-10-18T14:03:07.632829+0000","last_became_active":"2023-10-18T14:02:32.446015+0000","last_became_peered":"2023-10-18T14:02:32.446015+0000","last_unstale":"2023-10-18T14:03:07.632829+0000","last_undegraded":"2023-10-18T14:03:07.632829+0000","last_fullsized":"2023-10-18T14:03:07.632829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:21:09.897636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632600+0000","last_change":"2023-10-18T14:02:32.444969+0000","last_active":"2023-10-18T14:03:07.632600+0000","last_peered":"2023-10-18T14:03:07.632600+0000","last_clean":"2023-10-18T14:03:07.632600+0000","last_became_active":"2023-10-18T14:02:32.444592+0000","last_became_peered":"2023-10-18T14:02:32.444592+0000","last_unstale":"2023-10-18T14:03:07.632600+0000","last_undegraded":"2023-10-18T14:03:07.632600+0000","last_fullsized":"2023-10-18T14:03:07.632600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:02:58.377003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":61,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:16.319748+0000","last_change":"2023-10-18T14:02:31.847368+0000","last_active":"2023-10-18T14:03:16.319748+0000","last_peered":"2023-10-18T14:03:16.319748+0000","last_clean":"2023-10-18T14:03:16.319748+0000","last_became_active":"2023-10-18T14:02:31.847072+0000","last_became_peered":"2023-10-18T14:02:31.847072+0000","last_unstale":"2023-10-18T14:03:16.319748+0000","last_undegraded":"2023-10-18T14:03:16.319748+0000","last_fullsized":"2023-10-18T14:03:16.319748+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:28:24.771284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.632551+0000","last_change":"2023-10-18T14:03:08.632138+0000","last_active":"2023-10-18T14:03:08.632551+0000","last_peered":"2023-10-18T14:03:08.632551+0000","last_clean":"2023-10-18T14:03:08.632551+0000","last_became_active":"2023-10-18T14:03:08.631902+0000","last_became_peered":"2023-10-18T14:03:08.631902+0000","last_unstale":"2023-10-18T14:03:08.632551+0000","last_undegraded":"2023-10-18T14:03:08.632551+0000","last_fullsized":"2023-10-18T14:03:08.632551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:31:10.646568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628041+0000","last_change":"2023-10-18T14:02:31.843678+0000","last_active":"2023-10-18T14:03:07.628041+0000","last_peered":"2023-10-18T14:03:07.628041+0000","last_clean":"2023-10-18T14:03:07.628041+0000","last_became_active":"2023-10-18T14:02:31.843332+0000","last_became_peered":"2023-10-18T14:02:31.843332+0000","last_unstale":"2023-10-18T14:03:07.628041+0000","last_undegraded":"2023-10-18T14:03:07.628041+0000","last_fullsized":"2023-10-18T14:03:07.628041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:06:04.549859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":321,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630029+0000","last_change":"2023-10-18T14:01:34.022246+0000","last_active":"2023-10-18T14:03:07.630029+0000","last_peered":"2023-10-18T14:03:07.630029+0000","last_clean":"2023-10-18T14:03:07.630029+0000","last_became_active":"2023-10-18T14:01:34.021768+0000","last_became_peered":"2023-10-18T14:01:34.021768+0000","last_unstale":"2023-10-18T14:03:07.630029+0000","last_undegraded":"2023-10-18T14:03:07.630029+0000","last_fullsized":"2023-10-18T14:03:07.630029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_clean_scrub_stamp":"2023-10-18T13:58:44.223424+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:48.521087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632798+0000","last_change":"2023-10-18T14:02:32.440662+0000","last_active":"2023-10-18T14:03:07.632798+0000","last_peered":"2023-10-18T14:03:07.632798+0000","last_clean":"2023-10-18T14:03:07.632798+0000","last_became_active":"2023-10-18T14:02:32.440345+0000","last_became_peered":"2023-10-18T14:02:32.440345+0000","last_unstale":"2023-10-18T14:03:07.632798+0000","last_undegraded":"2023-10-18T14:03:07.632798+0000","last_fullsized":"2023-10-18T14:03:07.632798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:21.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630113+0000","last_change":"2023-10-18T14:02:31.850243+0000","last_active":"2023-10-18T14:03:07.630113+0000","last_peered":"2023-10-18T14:03:07.630113+0000","last_clean":"2023-10-18T14:03:07.630113+0000","last_became_active":"2023-10-18T14:02:31.849952+0000","last_became_peered":"2023-10-18T14:02:31.849952+0000","last_unstale":"2023-10-18T14:03:07.630113+0000","last_undegraded":"2023-10-18T14:03:07.630113+0000","last_fullsized":"2023-10-18T14:03:07.630113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:11:50.877219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.647452+0000","last_change":"2023-10-18T14:03:08.647076+0000","last_active":"2023-10-18T14:03:08.647452+0000","last_peered":"2023-10-18T14:03:08.647452+0000","last_clean":"2023-10-18T14:03:08.647452+0000","last_became_active":"2023-10-18T14:03:08.637530+0000","last_became_peered":"2023-10-18T14:03:08.637530+0000","last_unstale":"2023-10-18T14:03:08.647452+0000","last_undegraded":"2023-10-18T14:03:08.647452+0000","last_fullsized":"2023-10-18T14:03:08.647452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:33.344068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633493+0000","last_change":"2023-10-18T14:02:32.445046+0000","last_active":"2023-10-18T14:03:07.633493+0000","last_peered":"2023-10-18T14:03:07.633493+0000","last_clean":"2023-10-18T14:03:07.633493+0000","last_became_active":"2023-10-18T14:02:32.444827+0000","last_became_peered":"2023-10-18T14:02:32.444827+0000","last_unstale":"2023-10-18T14:03:07.633493+0000","last_undegraded":"2023-10-18T14:03:07.633493+0000","last_fullsized":"2023-10-18T14:03:07.633493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:26:11.024405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627694+0000","last_change":"2023-10-18T14:02:31.846888+0000","last_active":"2023-10-18T14:03:07.627694+0000","last_peered":"2023-10-18T14:03:07.627694+0000","last_clean":"2023-10-18T14:03:07.627694+0000","last_became_active":"2023-10-18T14:02:31.846591+0000","last_became_peered":"2023-10-18T14:02:31.846591+0000","last_unstale":"2023-10-18T14:03:07.627694+0000","last_undegraded":"2023-10-18T14:03:07.627694+0000","last_fullsized":"2023-10-18T14:03:07.627694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:48:03.683135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633530+0000","last_change":"2023-10-18T14:02:32.456951+0000","last_active":"2023-10-18T14:03:07.633530+0000","last_peered":"2023-10-18T14:03:07.633530+0000","last_clean":"2023-10-18T14:03:07.633530+0000","last_became_active":"2023-10-18T14:02:32.456588+0000","last_became_peered":"2023-10-18T14:02:32.456588+0000","last_unstale":"2023-10-18T14:03:07.633530+0000","last_undegraded":"2023-10-18T14:03:07.633530+0000","last_fullsized":"2023-10-18T14:03:07.633530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:51:51.335310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628601+0000","last_change":"2023-10-18T14:02:31.845258+0000","last_active":"2023-10-18T14:03:07.628601+0000","last_peered":"2023-10-18T14:03:07.628601+0000","last_clean":"2023-10-18T14:03:07.628601+0000","last_became_active":"2023-10-18T14:02:31.844933+0000","last_became_peered":"2023-10-18T14:02:31.844933+0000","last_unstale":"2023-10-18T14:03:07.628601+0000","last_undegraded":"2023-10-18T14:03:07.628601+0000","last_fullsized":"2023-10-18T14:03:07.628601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:51:46.765525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631689+0000","last_change":"2023-10-18T14:02:32.454955+0000","last_active":"2023-10-18T14:03:07.631689+0000","last_peered":"2023-10-18T14:03:07.631689+0000","last_clean":"2023-10-18T14:03:07.631689+0000","last_became_active":"2023-10-18T14:02:32.454689+0000","last_became_peered":"2023-10-18T14:02:32.454689+0000","last_unstale":"2023-10-18T14:03:07.631689+0000","last_undegraded":"2023-10-18T14:03:07.631689+0000","last_fullsized":"2023-10-18T14:03:07.631689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:57:20.461517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633726+0000","last_change":"2023-10-18T14:02:31.849273+0000","last_active":"2023-10-18T14:03:07.633726+0000","last_peered":"2023-10-18T14:03:07.633726+0000","last_clean":"2023-10-18T14:03:07.633726+0000","last_became_active":"2023-10-18T14:02:31.848985+0000","last_became_peered":"2023-10-18T14:02:31.848985+0000","last_unstale":"2023-10-18T14:03:07.633726+0000","last_undegraded":"2023-10-18T14:03:07.633726+0000","last_fullsized":"2023-10-18T14:03:07.633726+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:55:54.516857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629855+0000","last_change":"2023-10-18T14:02:32.449557+0000","last_active":"2023-10-18T14:03:07.629855+0000","last_peered":"2023-10-18T14:03:07.629855+0000","last_clean":"2023-10-18T14:03:07.629855+0000","last_became_active":"2023-10-18T14:02:32.449033+0000","last_became_peered":"2023-10-18T14:02:32.449033+0000","last_unstale":"2023-10-18T14:03:07.629855+0000","last_undegraded":"2023-10-18T14:03:07.629855+0000","last_fullsized":"2023-10-18T14:03:07.629855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:32.983379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632227+0000","last_change":"2023-10-18T14:02:31.846109+0000","last_active":"2023-10-18T14:03:07.632227+0000","last_peered":"2023-10-18T14:03:07.632227+0000","last_clean":"2023-10-18T14:03:07.632227+0000","last_became_active":"2023-10-18T14:02:31.845236+0000","last_became_peered":"2023-10-18T14:02:31.845236+0000","last_unstale":"2023-10-18T14:03:07.632227+0000","last_undegraded":"2023-10-18T14:03:07.632227+0000","last_fullsized":"2023-10-18T14:03:07.632227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:46.880974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631047+0000","last_change":"2023-10-18T14:02:32.446465+0000","last_active":"2023-10-18T14:03:07.631047+0000","last_peered":"2023-10-18T14:03:07.631047+0000","last_clean":"2023-10-18T14:03:07.631047+0000","last_became_active":"2023-10-18T14:02:32.446172+0000","last_became_peered":"2023-10-18T14:02:32.446172+0000","last_unstale":"2023-10-18T14:03:07.631047+0000","last_undegraded":"2023-10-18T14:03:07.631047+0000","last_fullsized":"2023-10-18T14:03:07.631047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:14:40.094870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628081+0000","last_change":"2023-10-18T14:02:31.851198+0000","last_active":"2023-10-18T14:03:07.628081+0000","last_peered":"2023-10-18T14:03:07.628081+0000","last_clean":"2023-10-18T14:03:07.628081+0000","last_became_active":"2023-10-18T14:02:31.850524+0000","last_became_peered":"2023-10-18T14:02:31.850524+0000","last_unstale":"2023-10-18T14:03:07.628081+0000","last_undegraded":"2023-10-18T14:03:07.628081+0000","last_fullsized":"2023-10-18T14:03:07.628081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:13:44.133077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633065+0000","last_change":"2023-10-18T14:02:32.446732+0000","last_active":"2023-10-18T14:03:07.633065+0000","last_peered":"2023-10-18T14:03:07.633065+0000","last_clean":"2023-10-18T14:03:07.633065+0000","last_became_active":"2023-10-18T14:02:32.446418+0000","last_became_peered":"2023-10-18T14:02:32.446418+0000","last_unstale":"2023-10-18T14:03:07.633065+0000","last_undegraded":"2023-10-18T14:03:07.633065+0000","last_fullsized":"2023-10-18T14:03:07.633065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:13.765988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630012+0000","last_change":"2023-10-18T14:02:31.852648+0000","last_active":"2023-10-18T14:03:07.630012+0000","last_peered":"2023-10-18T14:03:07.630012+0000","last_clean":"2023-10-18T14:03:07.630012+0000","last_became_active":"2023-10-18T14:02:31.852361+0000","last_became_peered":"2023-10-18T14:02:31.852361+0000","last_unstale":"2023-10-18T14:03:07.630012+0000","last_undegraded":"2023-10-18T14:03:07.630012+0000","last_fullsized":"2023-10-18T14:03:07.630012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:54:28.189196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630302+0000","last_change":"2023-10-18T14:02:32.464220+0000","last_active":"2023-10-18T14:03:07.630302+0000","last_peered":"2023-10-18T14:03:07.630302+0000","last_clean":"2023-10-18T14:03:07.630302+0000","last_became_active":"2023-10-18T14:02:32.463213+0000","last_became_peered":"2023-10-18T14:02:32.463213+0000","last_unstale":"2023-10-18T14:03:07.630302+0000","last_undegraded":"2023-10-18T14:03:07.630302+0000","last_fullsized":"2023-10-18T14:03:07.630302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:53.777086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:17.322667+0000","last_change":"2023-10-18T14:02:31.848305+0000","last_active":"2023-10-18T14:03:17.322667+0000","last_peered":"2023-10-18T14:03:17.322667+0000","last_clean":"2023-10-18T14:03:17.322667+0000","last_became_active":"2023-10-18T14:02:31.847739+0000","last_became_peered":"2023-10-18T14:02:31.847739+0000","last_unstale":"2023-10-18T14:03:17.322667+0000","last_undegraded":"2023-10-18T14:03:17.322667+0000","last_fullsized":"2023-10-18T14:03:17.322667+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:52:24.543703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630458+0000","last_change":"2023-10-18T14:02:32.460802+0000","last_active":"2023-10-18T14:03:07.630458+0000","last_peered":"2023-10-18T14:03:07.630458+0000","last_clean":"2023-10-18T14:03:07.630458+0000","last_became_active":"2023-10-18T14:02:32.460160+0000","last_became_peered":"2023-10-18T14:02:32.460160+0000","last_unstale":"2023-10-18T14:03:07.630458+0000","last_undegraded":"2023-10-18T14:03:07.630458+0000","last_fullsized":"2023-10-18T14:03:07.630458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:20:55.614142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633018+0000","last_change":"2023-10-18T14:02:31.845468+0000","last_active":"2023-10-18T14:03:07.633018+0000","last_peered":"2023-10-18T14:03:07.633018+0000","last_clean":"2023-10-18T14:03:07.633018+0000","last_became_active":"2023-10-18T14:02:31.845057+0000","last_became_peered":"2023-10-18T14:02:31.845057+0000","last_unstale":"2023-10-18T14:03:07.633018+0000","last_undegraded":"2023-10-18T14:03:07.633018+0000","last_fullsized":"2023-10-18T14:03:07.633018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:08:23.972051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630377+0000","last_change":"2023-10-18T14:02:32.462572+0000","last_active":"2023-10-18T14:03:07.630377+0000","last_peered":"2023-10-18T14:03:07.630377+0000","last_clean":"2023-10-18T14:03:07.630377+0000","last_became_active":"2023-10-18T14:02:32.462140+0000","last_became_peered":"2023-10-18T14:02:32.462140+0000","last_unstale":"2023-10-18T14:03:07.630377+0000","last_undegraded":"2023-10-18T14:03:07.630377+0000","last_fullsized":"2023-10-18T14:03:07.630377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:03:34.605932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633629+0000","last_change":"2023-10-18T14:02:31.847322+0000","last_active":"2023-10-18T14:03:07.633629+0000","last_peered":"2023-10-18T14:03:07.633629+0000","last_clean":"2023-10-18T14:03:07.633629+0000","last_became_active":"2023-10-18T14:02:31.847008+0000","last_became_peered":"2023-10-18T14:02:31.847008+0000","last_unstale":"2023-10-18T14:03:07.633629+0000","last_undegraded":"2023-10-18T14:03:07.633629+0000","last_fullsized":"2023-10-18T14:03:07.633629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:59:18.850165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630579+0000","last_change":"2023-10-18T14:02:32.461592+0000","last_active":"2023-10-18T14:03:07.630579+0000","last_peered":"2023-10-18T14:03:07.630579+0000","last_clean":"2023-10-18T14:03:07.630579+0000","last_became_active":"2023-10-18T14:02:32.461265+0000","last_became_peered":"2023-10-18T14:02:32.461265+0000","last_unstale":"2023-10-18T14:03:07.630579+0000","last_undegraded":"2023-10-18T14:03:07.630579+0000","last_fullsized":"2023-10-18T14:03:07.630579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:03.315431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631175+0000","last_change":"2023-10-18T14:02:32.445480+0000","last_active":"2023-10-18T14:03:07.631175+0000","last_peered":"2023-10-18T14:03:07.631175+0000","last_clean":"2023-10-18T14:03:07.631175+0000","last_became_active":"2023-10-18T14:02:32.443036+0000","last_became_peered":"2023-10-18T14:02:32.443036+0000","last_unstale":"2023-10-18T14:03:07.631175+0000","last_undegraded":"2023-10-18T14:03:07.631175+0000","last_fullsized":"2023-10-18T14:03:07.631175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:59:57.637358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628022+0000","last_change":"2023-10-18T14:02:32.456400+0000","last_active":"2023-10-18T14:03:07.628022+0000","last_peered":"2023-10-18T14:03:07.628022+0000","last_clean":"2023-10-18T14:03:07.628022+0000","last_became_active":"2023-10-18T14:02:32.456072+0000","last_became_peered":"2023-10-18T14:02:32.456072+0000","last_unstale":"2023-10-18T14:03:07.628022+0000","last_undegraded":"2023-10-18T14:03:07.628022+0000","last_fullsized":"2023-10-18T14:03:07.628022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:22:59.844454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627995+0000","last_change":"2023-10-18T14:02:32.448089+0000","last_active":"2023-10-18T14:03:07.627995+0000","last_peered":"2023-10-18T14:03:07.627995+0000","last_clean":"2023-10-18T14:03:07.627995+0000","last_became_active":"2023-10-18T14:02:32.447866+0000","last_became_peered":"2023-10-18T14:02:32.447866+0000","last_unstale":"2023-10-18T14:03:07.627995+0000","last_undegraded":"2023-10-18T14:03:07.627995+0000","last_fullsized":"2023-10-18T14:03:07.627995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:28:35.558009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631717+0000","last_change":"2023-10-18T14:02:32.444103+0000","last_active":"2023-10-18T14:03:07.631717+0000","last_peered":"2023-10-18T14:03:07.631717+0000","last_clean":"2023-10-18T14:03:07.631717+0000","last_became_active":"2023-10-18T14:02:32.443762+0000","last_became_peered":"2023-10-18T14:02:32.443762+0000","last_unstale":"2023-10-18T14:03:07.631717+0000","last_undegraded":"2023-10-18T14:03:07.631717+0000","last_fullsized":"2023-10-18T14:03:07.631717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:47.695764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633454+0000","last_change":"2023-10-18T14:02:32.449409+0000","last_active":"2023-10-18T14:03:07.633454+0000","last_peered":"2023-10-18T14:03:07.633454+0000","last_clean":"2023-10-18T14:03:07.633454+0000","last_became_active":"2023-10-18T14:02:32.449114+0000","last_became_peered":"2023-10-18T14:02:32.449114+0000","last_unstale":"2023-10-18T14:03:07.633454+0000","last_undegraded":"2023-10-18T14:03:07.633454+0000","last_fullsized":"2023-10-18T14:03:07.633454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:59:45.167577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631298+0000","last_change":"2023-10-18T14:02:32.452013+0000","last_active":"2023-10-18T14:03:07.631298+0000","last_peered":"2023-10-18T14:03:07.631298+0000","last_clean":"2023-10-18T14:03:07.631298+0000","last_became_active":"2023-10-18T14:02:32.451734+0000","last_became_peered":"2023-10-18T14:02:32.451734+0000","last_unstale":"2023-10-18T14:03:07.631298+0000","last_undegraded":"2023-10-18T14:03:07.631298+0000","last_fullsized":"2023-10-18T14:03:07.631298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:15:44.511378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629153+0000","last_change":"2023-10-18T14:02:32.445503+0000","last_active":"2023-10-18T14:03:07.629153+0000","last_peered":"2023-10-18T14:03:07.629153+0000","last_clean":"2023-10-18T14:03:07.629153+0000","last_became_active":"2023-10-18T14:02:32.445172+0000","last_became_peered":"2023-10-18T14:02:32.445172+0000","last_unstale":"2023-10-18T14:03:07.629153+0000","last_undegraded":"2023-10-18T14:03:07.629153+0000","last_fullsized":"2023-10-18T14:03:07.629153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:23:08.456949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633490+0000","last_change":"2023-10-18T14:02:32.459690+0000","last_active":"2023-10-18T14:03:07.633490+0000","last_peered":"2023-10-18T14:03:07.633490+0000","last_clean":"2023-10-18T14:03:07.633490+0000","last_became_active":"2023-10-18T14:02:32.459373+0000","last_became_peered":"2023-10-18T14:02:32.459373+0000","last_unstale":"2023-10-18T14:03:07.633490+0000","last_undegraded":"2023-10-18T14:03:07.633490+0000","last_fullsized":"2023-10-18T14:03:07.633490+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:36.092029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632468+0000","last_change":"2023-10-18T14:02:32.455076+0000","last_active":"2023-10-18T14:03:07.632468+0000","last_peered":"2023-10-18T14:03:07.632468+0000","last_clean":"2023-10-18T14:03:07.632468+0000","last_became_active":"2023-10-18T14:02:32.454750+0000","last_became_peered":"2023-10-18T14:02:32.454750+0000","last_unstale":"2023-10-18T14:03:07.632468+0000","last_undegraded":"2023-10-18T14:03:07.632468+0000","last_fullsized":"2023-10-18T14:03:07.632468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:08:00.855583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632303+0000","last_change":"2023-10-18T14:02:32.450714+0000","last_active":"2023-10-18T14:03:07.632303+0000","last_peered":"2023-10-18T14:03:07.632303+0000","last_clean":"2023-10-18T14:03:07.632303+0000","last_became_active":"2023-10-18T14:02:32.450429+0000","last_became_peered":"2023-10-18T14:02:32.450429+0000","last_unstale":"2023-10-18T14:03:07.632303+0000","last_undegraded":"2023-10-18T14:03:07.632303+0000","last_fullsized":"2023-10-18T14:03:07.632303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:43:21.746296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634401+0000","last_change":"2023-10-18T14:02:32.457392+0000","last_active":"2023-10-18T14:03:07.634401+0000","last_peered":"2023-10-18T14:03:07.634401+0000","last_clean":"2023-10-18T14:03:07.634401+0000","last_became_active":"2023-10-18T14:02:32.457072+0000","last_became_peered":"2023-10-18T14:02:32.457072+0000","last_unstale":"2023-10-18T14:03:07.634401+0000","last_undegraded":"2023-10-18T14:03:07.634401+0000","last_fullsized":"2023-10-18T14:03:07.634401+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:19:51.691351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634009+0000","last_change":"2023-10-18T14:02:32.457541+0000","last_active":"2023-10-18T14:03:07.634009+0000","last_peered":"2023-10-18T14:03:07.634009+0000","last_clean":"2023-10-18T14:03:07.634009+0000","last_became_active":"2023-10-18T14:02:32.457266+0000","last_became_peered":"2023-10-18T14:02:32.457266+0000","last_unstale":"2023-10-18T14:03:07.634009+0000","last_undegraded":"2023-10-18T14:03:07.634009+0000","last_fullsized":"2023-10-18T14:03:07.634009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:41:16.131463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.636413+0000","last_change":"2023-10-18T14:03:08.636413+0000","last_active":"2023-10-18T14:03:08.636413+0000","last_peered":"2023-10-18T14:03:08.636413+0000","last_clean":"2023-10-18T14:03:08.636413+0000","last_became_active":"2023-10-18T14:03:08.635985+0000","last_became_peered":"2023-10-18T14:03:08.635985+0000","last_unstale":"2023-10-18T14:03:08.636413+0000","last_undegraded":"2023-10-18T14:03:08.636413+0000","last_fullsized":"2023-10-18T14:03:08.636413+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:53:28.848373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250031,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65387,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":449,"num_read_kb":298,"num_write":229,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":180,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":196161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449109,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":459517,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.46899999999999997}]},{"osd":1,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.629}]},{"osd":2,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.374},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.68100000000000005}]},{"osd":5,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54700000000000004}]},{"osd":6,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.76300000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":9,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.71499999999999997}]},{"osd":10,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.70199999999999996}]}]},{"osd":10,"up_from":70,"seq":300647710744,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":1108616,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.371},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.40000000000000002}]},{"osd":2,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.61899999999999999}]},{"osd":3,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.503},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64400000000000002}]},{"osd":4,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.433}]},{"osd":5,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.72399999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65100000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.747}]},{"osd":9,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.55000000000000004}]},{"osd":11,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.84599999999999997}]}]},{"osd":9,"up_from":65,"seq":279172874270,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":459267,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.501},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.28299999999999997}]},{"osd":1,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.499}]},{"osd":2,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58299999999999996}]},{"osd":3,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.34699999999999998}]},{"osd":4,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.42899999999999999}]},{"osd":5,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.73199999999999998,"15min":0.747},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.626},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36599999999999999,"5min":0.308,"15min":0.308},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.71699999999999997,"15min":0.73399999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.47199999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.63500000000000001}]},{"osd":8,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75600000000000001,"15min":0.76800000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1080000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.67000000000000004}]},{"osd":10,"last update":"Wed Oct 18 14:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.55600000000000005}]}]},{"osd":8,"up_from":58,"seq":249108103201,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":459202,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.4380000000000002,"5min":2.4380000000000002,"15min":2.4380000000000002},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.68600000000000005}]},{"osd":2,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.41499999999999998},"min":{"1min":0.33500000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.73799999999999999}]},{"osd":3,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.65700000000000003,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":8.5980000000000008,"5min":8.5980000000000008,"15min":8.5980000000000008},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.60299999999999998,"15min":0.58199999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.6080000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":1.0720000000000001}]},{"osd":4,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.504,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.48599999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.38100000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.82599999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.73299999999999998,"15min":0.69499999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":7.4240000000000004,"5min":7.4240000000000004,"15min":7.4240000000000004},"last":1.022},{"interface":"front","average":{"1min":1.1639999999999999,"5min":0.77700000000000002,"15min":0.71299999999999997},"min":{"1min":0.49099999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":11.095000000000001,"5min":11.095000000000001,"15min":11.095000000000001},"last":0.89300000000000002}]},{"osd":7,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69999999999999996,"15min":0.68700000000000006},"min":{"1min":0.59499999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.95299999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.73899999999999999,"15min":0.72499999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0189999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":1.0389999999999999}]},{"osd":9,"last update":"Wed Oct 18 14:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.77200000000000002,"15min":0.74099999999999999},"min":{"1min":0.59599999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.101},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.76100000000000001,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":1.0600000000000001}]},{"osd":10,"last update":"Wed Oct 18 14:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.84699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":7,"up_from":51,"seq":219043332133,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1052168,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47599999999999998}]},{"osd":1,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.41199999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.441,"15min":0.437},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70299999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.46200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.63600000000000001}]},{"osd":3,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58899999999999997,"15min":0.58599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.745},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.376,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.66500000000000004}]},{"osd":5,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63600000000000001,"15min":0.624},"min":{"1min":0.439,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.54600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.86799999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91000000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.77800000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.58999999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.90600000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.78300000000000003},"min":{"1min":0.623,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.88500000000000001,"5min":1.514,"15min":1.514},"last":0.84699999999999998}]},{"osd":9,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.83299999999999996,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73799999999999999,"15min":0.745},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.84199999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.88}]},{"osd":10,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.91500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495658,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":458990,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.38300000000000001,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.372,"15min":0.34200000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.32100000000000001}]},{"osd":1,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70699999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.627},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.5},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.55800000000000005},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72399999999999998,"5min":1.476,"15min":1.476},"last":0.48799999999999999}]},{"osd":3,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40899999999999997,"15min":0.40000000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51800000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.434},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.39800000000000002}]},{"osd":4,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55400000000000005,"15min":0.52800000000000002},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56899999999999995,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77100000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66500000000000004}]},{"osd":5,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.622,"15min":0.60199999999999998},"min":{"1min":0.434,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.60699999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89200000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":1.0089999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.57999999999999996}]},{"osd":8,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92300000000000004,"5min":1.611,"15min":1.611},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.59699999999999998}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75900000000000001,"5min":1.415,"15min":1.415},"last":0.64700000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.68300000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":518472,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.80500000000000005,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.628}]},{"osd":2,"last update":"Wed Oct 18 14:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.57699999999999996,"15min":0.55000000000000004},"min":{"1min":0.42999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.86399999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.40799999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44900000000000001}]},{"osd":3,"last update":"Wed Oct 18 14:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.55200000000000005,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89500000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.5,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68200000000000005}]},{"osd":4,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.40600000000000003,"15min":0.38500000000000001},"min":{"1min":0.28999999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.46999999999999997,"15min":0.42899999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.49199999999999999}]},{"osd":5,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.45200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.56599999999999995,"15min":0.53500000000000003},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81299999999999994,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61399999999999999,"15min":0.57899999999999996},"min":{"1min":0.52400000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93100000000000005,"5min":1.127,"15min":1.127},"last":0.79900000000000004}]},{"osd":7,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76400000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.432}]},{"osd":8,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.57899999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63200000000000001,"15min":0.621},"min":{"1min":0.51900000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.59099999999999997}]},{"osd":9,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.73599999999999999,"15min":0.71599999999999997},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.746},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.052,"5min":1.165,"15min":1.165},"last":0.82399999999999995}]},{"osd":10,"last update":"Wed Oct 18 14:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":460323,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 14:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.53400000000000003,"15min":0.496},"min":{"1min":0.41799999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.52600000000000002,"15min":0.48899999999999999},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Wed Oct 18 14:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.51000000000000001},"min":{"1min":0.40899999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.9870000000000001,"5min":0.81799999999999995,"15min":0.59799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":27.222999999999999,"5min":27.222999999999999,"15min":27.222999999999999},"last":0.47899999999999998}]},{"osd":3,"last update":"Wed Oct 18 14:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.40500000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.309,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Oct 18 14:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.39700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.62}]},{"osd":5,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67800000000000005,"5min":0.879,"15min":0.879},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.67300000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60699999999999998}]},{"osd":6,"last update":"Wed Oct 18 14:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.60199999999999998,"15min":0.54300000000000004},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":8.7010000000000005,"5min":8.7010000000000005,"15min":8.7010000000000005},"last":0.53400000000000003}]},{"osd":7,"last update":"Wed Oct 18 14:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60499999999999998}]},{"osd":8,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78300000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.70199999999999996,"15min":0.71199999999999997},"min":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89800000000000002,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64400000000000002}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":3.262,"5min":3.262,"15min":3.262},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.70499999999999996}]},{"osd":10,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.66500000000000004}]},{"osd":11,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.75700000000000001},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":27.154,"5min":27.154,"15min":27.154},"last":0.746}]}]},{"osd":2,"up_from":19,"seq":81604378683,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":518072,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.31,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72399999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.38600000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60799999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53000000000000003}]},{"osd":1,"last update":"Wed Oct 18 14:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.67400000000000004}]},{"osd":3,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.60299999999999998,"15min":0.56100000000000005},"min":{"1min":0.44700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":2.9119999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.61199999999999999,"15min":0.58599999999999997},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":2.8700000000000001}]},{"osd":4,"last update":"Wed Oct 18 14:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.745}]},{"osd":5,"last update":"Wed Oct 18 14:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.442,"15min":0.42999999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.45600000000000002,"15min":0.43099999999999999},"min":{"1min":0.312,"5min":0.308,"15min":0.308},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63300000000000001}]},{"osd":6,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57799999999999996}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.34200000000000003}]},{"osd":8,"last update":"Wed Oct 18 14:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.56100000000000005,"15min":0.54400000000000004},"min":{"1min":0.42399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.61099999999999999,"15min":0.59299999999999997},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.77800000000000002}]},{"osd":9,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89300000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68700000000000006}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.92500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]}]},{"osd":3,"up_from":26,"seq":111669149750,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":458490,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.34899999999999998,"15min":0.32500000000000001},"min":{"1min":0.28199999999999997,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.56499999999999995,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.36699999999999999,"15min":0.35099999999999998},"min":{"1min":0.25800000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.41499999999999998}]},{"osd":1,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.51700000000000002},"min":{"1min":0.39400000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.78200000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54900000000000004,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56999999999999995}]},{"osd":2,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53600000000000003,"15min":0.52100000000000002},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70499999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.51800000000000002},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.65900000000000003,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.46999999999999997}]},{"osd":4,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84999999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55700000000000005}]},{"osd":5,"last update":"Wed Oct 18 14:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40200000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70199999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.71099999999999997,"15min":0.67700000000000005},"min":{"1min":0.50800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78200000000000003,"5min":6.5,"15min":6.5},"last":0.58299999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.46999999999999997,"15min":0.48799999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.504,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.442},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74299999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.59499999999999997}]},{"osd":7,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.77500000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.76800000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.625}]},{"osd":8,"last update":"Wed Oct 18 14:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.56699999999999995}]},{"osd":9,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.58999999999999997,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.60899999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.66300000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60799999999999998}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":4,"up_from":34,"seq":146028888115,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":458845,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.42399999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.38400000000000001},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.39100000000000001,"15min":0.376},"min":{"1min":0.26000000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.50700000000000001}]},{"osd":2,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84399999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58199999999999996}]},{"osd":3,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.56499999999999995,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81999999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86699999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.64600000000000002}]},{"osd":5,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89500000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.74199999999999999}]},{"osd":6,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.61299999999999999,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.55000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.83599999999999997}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55000000000000004,"15min":0.54100000000000004},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69399999999999995}]},{"osd":8,"last update":"Wed Oct 18 14:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.69799999999999995,"15min":0.68600000000000005},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.51600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.76600000000000001}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.75700000000000001,"15min":0.73899999999999999},"min":{"1min":0.55900000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.60199999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.90600000000000003}]},{"osd":10,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.81000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]}]},{"osd":5,"up_from":39,"seq":167503724590,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":1051515,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.503,"15min":0.48099999999999998},"min":{"1min":0.36599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.499,"15min":0.48299999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58999999999999997}]},{"osd":1,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.38500000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.53500000000000003,"15min":0.51100000000000001},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.29499999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.379,"15min":0.36499999999999999},"min":{"1min":0.26400000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73499999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52900000000000003,"15min":0.51400000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74199999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54800000000000004}]},{"osd":4,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.56399999999999995,"15min":0.53800000000000003},"min":{"1min":0.40300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70799999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46400000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.85999999999999999}]},{"osd":7,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76300000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.75700000000000001}]},{"osd":8,"last update":"Wed Oct 18 14:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.749,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.81499999999999995}]},{"osd":9,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.70799999999999996,"15min":0.69999999999999996},"min":{"1min":0.54200000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.90800000000000003}]},{"osd":10,"last update":"Wed Oct 18 14:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T14:03:22.882 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-18T14:03:22.882 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-18T14:03:22.883 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-18T14:03:22.883 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph health --format=json 2023-10-18T14:03:23.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:22 smithi158 ceph-mon[103317]: pgmap v260: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 10 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2023-10-18T14:03:23.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:22 smithi172 ceph-mon[103574]: pgmap v260: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 10 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2023-10-18T14:03:23.443 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:23.932 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:23 smithi114 ceph-mon[99494]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:03:24.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:23 smithi158 ceph-mon[103317]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:03:24.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:23 smithi172 ceph-mon[103574]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:03:24.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.621+0000 7f9a13b8d700 1 -- 172.21.15.114:0/2265126380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a0c1000a0 msgr2=0x7f9a0c10c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:24.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.621+0000 7f9a13b8d700 1 --2- 172.21.15.114:0/2265126380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a0c1000a0 0x7f9a0c10c540 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400b0a0 tx=0x7f9a0400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:24.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.621+0000 7f9a13b8d700 1 -- 172.21.15.114:0/2265126380 shutdown_connections 2023-10-18T14:03:24.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.621+0000 7f9a13b8d700 1 --2- 172.21.15.114:0/2265126380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a0c1000a0 0x7f9a0c10c540 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:24.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.621+0000 7f9a13b8d700 1 --2- 172.21.15.114:0/2265126380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a0c1045b0 0x7f9a0c104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:24.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.621+0000 7f9a13b8d700 1 --2- 172.21.15.114:0/2265126380 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a0c0ff6e0 0x7f9a0c0ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:24.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.621+0000 7f9a13b8d700 1 -- 172.21.15.114:0/2265126380 >> 172.21.15.114:0/2265126380 conn(0x7f9a0c0766c0 msgr2=0x7f9a0c076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:24.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.621+0000 7f9a13b8d700 1 -- 172.21.15.114:0/2265126380 shutdown_connections 2023-10-18T14:03:24.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.621+0000 7f9a13b8d700 1 -- 172.21.15.114:0/2265126380 wait complete. 2023-10-18T14:03:24.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a13b8d700 1 Processor -- start 2023-10-18T14:03:24.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a13b8d700 1 -- start start 2023-10-18T14:03:24.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a13b8d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a0c0ff6e0 0x7f9a0c197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:24.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a13b8d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a0c1000a0 0x7f9a0c1980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:24.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a13b8d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a0c1045b0 0x7f9a0c1a2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:24.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a13b8d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1989e0 con 0x7f9a0c1000a0 2023-10-18T14:03:24.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a13b8d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1a3170 con 0x7f9a0c0ff6e0 2023-10-18T14:03:24.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a13b8d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1a32e0 con 0x7f9a0c1045b0 2023-10-18T14:03:24.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a11128700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a0c1000a0 0x7f9a0c1980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:24.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a11128700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a0c1000a0 0x7f9a0c1980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43052/0 (socket says 172.21.15.114:43052) 2023-10-18T14:03:24.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a11128700 1 -- 172.21.15.114:0/3471012281 learned_addr learned my addr 172.21.15.114:0/3471012281 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:24.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a11929700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a0c0ff6e0 0x7f9a0c197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:24.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a1212a700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a0c1045b0 0x7f9a0c1a2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:24.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a11128700 1 -- 172.21.15.114:0/3471012281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a0c1045b0 msgr2=0x7f9a0c1a2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:24.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a11128700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a0c1045b0 0x7f9a0c1a2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:24.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a11128700 1 -- 172.21.15.114:0/3471012281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a0c0ff6e0 msgr2=0x7f9a0c197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:24.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a11128700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a0c0ff6e0 0x7f9a0c197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:24.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a11128700 1 -- 172.21.15.114:0/3471012281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04009d00 con 0x7f9a0c1000a0 2023-10-18T14:03:24.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a1212a700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a0c1045b0 0x7f9a0c1a2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:24.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.622+0000 7f9a11929700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a0c0ff6e0 0x7f9a0c197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:24.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.623+0000 7f9a11128700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a0c1000a0 0x7f9a0c1980f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800c9b0 tx=0x7f9a0800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:24.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.623+0000 7f99feffd700 1 -- 172.21.15.114:0/3471012281 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08011b60 con 0x7f9a0c1000a0 2023-10-18T14:03:24.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.623+0000 7f99feffd700 1 -- 172.21.15.114:0/3471012281 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a08011cc0 con 0x7f9a0c1000a0 2023-10-18T14:03:24.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.623+0000 7f9a13b8d700 1 -- 172.21.15.114:0/3471012281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c195a00 con 0x7f9a0c1000a0 2023-10-18T14:03:24.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.623+0000 7f99feffd700 1 -- 172.21.15.114:0/3471012281 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a080199e0 con 0x7f9a0c1000a0 2023-10-18T14:03:24.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.623+0000 7f9a13b8d700 1 -- 172.21.15.114:0/3471012281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c195f50 con 0x7f9a0c1000a0 2023-10-18T14:03:24.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.624+0000 7f9a13b8d700 1 -- 172.21.15.114:0/3471012281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c107c20 con 0x7f9a0c1000a0 2023-10-18T14:03:24.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.625+0000 7f99feffd700 1 -- 172.21.15.114:0/3471012281 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f9a08019b40 con 0x7f9a0c1000a0 2023-10-18T14:03:24.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.626+0000 7f99feffd700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f99f80a15e0 0x7f99f80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:24.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.626+0000 7f9a11929700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f99f80a15e0 0x7f99f80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:24.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.626+0000 7f99feffd700 1 -- 172.21.15.114:0/3471012281 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9a080d08d0 con 0x7f9a0c1000a0 2023-10-18T14:03:24.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.626+0000 7f9a11929700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f99f80a15e0 0x7f99f80a3aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9a00005fd0 tx=0x7f9a00005d40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:24.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.629+0000 7f99feffd700 1 -- 172.21.15.114:0/3471012281 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9a08053100 con 0x7f9a0c1000a0 2023-10-18T14:03:24.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:24 smithi114 ceph-mon[99494]: pgmap v261: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2023-10-18T14:03:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.863+0000 7f9a13b8d700 1 -- 172.21.15.114:0/3471012281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9a0c069020 con 0x7f9a0c1000a0 2023-10-18T14:03:24.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.864+0000 7f99feffd700 1 -- 172.21.15.114:0/3471012281 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9a08099e40 con 0x7f9a0c1000a0 2023-10-18T14:03:24.868 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:24.868 INFO:teuthology.orchestra.run.smithi114.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-18T14:03:24.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.866+0000 7f9a13b8d700 1 -- 172.21.15.114:0/3471012281 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f99f80a15e0 msgr2=0x7f99f80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:24.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.866+0000 7f9a13b8d700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f99f80a15e0 0x7f99f80a3aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9a00005fd0 tx=0x7f9a00005d40 comp rx=0 tx=0).stop 2023-10-18T14:03:24.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.866+0000 7f9a13b8d700 1 -- 172.21.15.114:0/3471012281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a0c1000a0 msgr2=0x7f9a0c1980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:24.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.866+0000 7f9a13b8d700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a0c1000a0 0x7f9a0c1980f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800c9b0 tx=0x7f9a0800cd70 comp rx=0 tx=0).stop 2023-10-18T14:03:24.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.866+0000 7f9a13b8d700 1 -- 172.21.15.114:0/3471012281 shutdown_connections 2023-10-18T14:03:24.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.866+0000 7f9a13b8d700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f99f80a15e0 0x7f99f80a3aa0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:24.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.866+0000 7f9a13b8d700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a0c1045b0 0x7f9a0c1a2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:24.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.866+0000 7f9a13b8d700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9a0c0ff6e0 0x7f9a0c197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:24.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.866+0000 7f9a13b8d700 1 --2- 172.21.15.114:0/3471012281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a0c1000a0 0x7f9a0c1980f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:24.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.866+0000 7f9a13b8d700 1 -- 172.21.15.114:0/3471012281 >> 172.21.15.114:0/3471012281 conn(0x7f9a0c0766c0 msgr2=0x7f9a0c0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:24.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.866+0000 7f9a13b8d700 1 -- 172.21.15.114:0/3471012281 shutdown_connections 2023-10-18T14:03:24.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:24.866+0000 7f9a13b8d700 1 -- 172.21.15.114:0/3471012281 wait complete. 2023-10-18T14:03:25.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:24 smithi158 ceph-mon[103317]: pgmap v261: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2023-10-18T14:03:25.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:24 smithi172 ceph-mon[103574]: pgmap v261: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2023-10-18T14:03:25.195 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-18T14:03:25.196 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:03:25.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.321+0000 7fe1ea51a700 1 -- 172.21.15.114:0/3539562367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e41028d0 msgr2=0x7fe1e4102d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:25.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.321+0000 7fe1ea51a700 1 --2- 172.21.15.114:0/3539562367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e41028d0 0x7fe1e4102d50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009990 tx=0x7fe1d4009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.321+0000 7fe1ea51a700 1 -- 172.21.15.114:0/3539562367 shutdown_connections 2023-10-18T14:03:25.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.321+0000 7fe1ea51a700 1 --2- 172.21.15.114:0/3539562367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1e4103290 0x7fe1e410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.321+0000 7fe1ea51a700 1 --2- 172.21.15.114:0/3539562367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e41088e0 0x7fe1e4108cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.321+0000 7fe1ea51a700 1 --2- 172.21.15.114:0/3539562367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e41028d0 0x7fe1e4102d50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.321+0000 7fe1ea51a700 1 -- 172.21.15.114:0/3539562367 >> 172.21.15.114:0/3539562367 conn(0x7fe1e40fe360 msgr2=0x7fe1e4100780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:25.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.321+0000 7fe1ea51a700 1 -- 172.21.15.114:0/3539562367 shutdown_connections 2023-10-18T14:03:25.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.321+0000 7fe1ea51a700 1 -- 172.21.15.114:0/3539562367 wait complete. 2023-10-18T14:03:25.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1ea51a700 1 Processor -- start 2023-10-18T14:03:25.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1ea51a700 1 -- start start 2023-10-18T14:03:25.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1ea51a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e41028d0 0x7fe1e4198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:25.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1ea51a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1e4103290 0x7fe1e41992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:25.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1ea51a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e41088e0 0x7fe1e419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:25.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1ea51a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e419dca0 con 0x7fe1e41028d0 2023-10-18T14:03:25.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1ea51a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e419de10 con 0x7fe1e4103290 2023-10-18T14:03:25.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1ea51a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e419dfd0 con 0x7fe1e41088e0 2023-10-18T14:03:25.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1e3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e41028d0 0x7fe1e4198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:25.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1e3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e41028d0 0x7fe1e4198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43062/0 (socket says 172.21.15.114:43062) 2023-10-18T14:03:25.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1e3fff700 1 -- 172.21.15.114:0/981855707 learned_addr learned my addr 172.21.15.114:0/981855707 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:25.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1e37fe700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1e4103290 0x7fe1e41992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:25.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1e8ab7700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e41088e0 0x7fe1e419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:25.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1e3fff700 1 -- 172.21.15.114:0/981855707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e41088e0 msgr2=0x7fe1e419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:25.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1e3fff700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e41088e0 0x7fe1e419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1e3fff700 1 -- 172.21.15.114:0/981855707 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1e4103290 msgr2=0x7fe1e41992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:25.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1e3fff700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1e4103290 0x7fe1e41992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.322+0000 7fe1e3fff700 1 -- 172.21.15.114:0/981855707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d40095f0 con 0x7fe1e41028d0 2023-10-18T14:03:25.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.323+0000 7fe1e3fff700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e41028d0 0x7fe1e4198d80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800b530 tx=0x7fe1d800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:25.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.323+0000 7fe1e17fa700 1 -- 172.21.15.114:0/981855707 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8011830 con 0x7fe1e41028d0 2023-10-18T14:03:25.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.323+0000 7fe1e17fa700 1 -- 172.21.15.114:0/981855707 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1d8011e50 con 0x7fe1e41028d0 2023-10-18T14:03:25.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.323+0000 7fe1ea51a700 1 -- 172.21.15.114:0/981855707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e419e2b0 con 0x7fe1e41028d0 2023-10-18T14:03:25.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.323+0000 7fe1e17fa700 1 -- 172.21.15.114:0/981855707 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800f2e0 con 0x7fe1e41028d0 2023-10-18T14:03:25.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.323+0000 7fe1ea51a700 1 -- 172.21.15.114:0/981855707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e41a5af0 con 0x7fe1e41028d0 2023-10-18T14:03:25.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.324+0000 7fe1ea51a700 1 -- 172.21.15.114:0/981855707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e410aef0 con 0x7fe1e41028d0 2023-10-18T14:03:25.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.325+0000 7fe1e17fa700 1 -- 172.21.15.114:0/981855707 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fe1d8010580 con 0x7fe1e41028d0 2023-10-18T14:03:25.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.325+0000 7fe1e17fa700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1cc0a1560 0x7fe1cc0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:25.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.325+0000 7fe1e37fe700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1cc0a1560 0x7fe1cc0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:25.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.325+0000 7fe1e17fa700 1 -- 172.21.15.114:0/981855707 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe1d80ccf10 con 0x7fe1e41028d0 2023-10-18T14:03:25.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.326+0000 7fe1e37fe700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1cc0a1560 0x7fe1cc0a3a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40095c0 tx=0x7fe1d4009510 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:25.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.329+0000 7fe1e17fa700 1 -- 172.21.15.114:0/981855707 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe1d8096480 con 0x7fe1e41028d0 2023-10-18T14:03:25.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.522+0000 7fe1ea51a700 1 -- 172.21.15.114:0/981855707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1e4104010 con 0x7fe1e41028d0 2023-10-18T14:03:25.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.524+0000 7fe1e17fa700 1 -- 172.21.15.114:0/981855707 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22907 (secure 0 0 0) 0x7fe1d8099aa0 con 0x7fe1e41028d0 2023-10-18T14:03:25.528 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:25.528 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":85,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:03:08.625359+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:03:25.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.526+0000 7fe1ea51a700 1 -- 172.21.15.114:0/981855707 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1cc0a1560 msgr2=0x7fe1cc0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:25.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.526+0000 7fe1ea51a700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1cc0a1560 0x7fe1cc0a3a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40095c0 tx=0x7fe1d4009510 comp rx=0 tx=0).stop 2023-10-18T14:03:25.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.526+0000 7fe1ea51a700 1 -- 172.21.15.114:0/981855707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e41028d0 msgr2=0x7fe1e4198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:25.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.526+0000 7fe1ea51a700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e41028d0 0x7fe1e4198d80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800b530 tx=0x7fe1d800b8f0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.526+0000 7fe1ea51a700 1 -- 172.21.15.114:0/981855707 shutdown_connections 2023-10-18T14:03:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.526+0000 7fe1ea51a700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1cc0a1560 0x7fe1cc0a3a20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.526+0000 7fe1ea51a700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e41088e0 0x7fe1e419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.526+0000 7fe1ea51a700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1e41028d0 0x7fe1e4198d80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.526+0000 7fe1ea51a700 1 --2- 172.21.15.114:0/981855707 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1e4103290 0x7fe1e41992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.526+0000 7fe1ea51a700 1 -- 172.21.15.114:0/981855707 >> 172.21.15.114:0/981855707 conn(0x7fe1e40fe360 msgr2=0x7fe1e40feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.526+0000 7fe1ea51a700 1 -- 172.21.15.114:0/981855707 shutdown_connections 2023-10-18T14:03:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.526+0000 7fe1ea51a700 1 -- 172.21.15.114:0/981855707 wait complete. 2023-10-18T14:03:25.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T13:58:43.813590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T14:02:30.693853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T14:02:31.426625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T14:03:25.543 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T14:03:25.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.664+0000 7fe1fc54a700 1 -- 172.21.15.114:0/537433141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1f40ff640 msgr2=0x7fe1f40ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:25.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.664+0000 7fe1fc54a700 1 --2- 172.21.15.114:0/537433141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1f40ff640 0x7fe1f40ffac0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009990 tx=0x7fe1f0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.664+0000 7fe1fc54a700 1 -- 172.21.15.114:0/537433141 shutdown_connections 2023-10-18T14:03:25.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.664+0000 7fe1fc54a700 1 --2- 172.21.15.114:0/537433141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1f4100000 0x7fe1f410c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.664+0000 7fe1fc54a700 1 --2- 172.21.15.114:0/537433141 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1f41056e0 0x7fe1f4105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.664+0000 7fe1fc54a700 1 --2- 172.21.15.114:0/537433141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1f40ff640 0x7fe1f40ffac0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.664+0000 7fe1fc54a700 1 -- 172.21.15.114:0/537433141 >> 172.21.15.114:0/537433141 conn(0x7fe1f40767f0 msgr2=0x7fe1f4076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:25.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.664+0000 7fe1fc54a700 1 -- 172.21.15.114:0/537433141 shutdown_connections 2023-10-18T14:03:25.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.664+0000 7fe1fc54a700 1 -- 172.21.15.114:0/537433141 wait complete. 2023-10-18T14:03:25.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.665+0000 7fe1fc54a700 1 Processor -- start 2023-10-18T14:03:25.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.665+0000 7fe1fc54a700 1 -- start start 2023-10-18T14:03:25.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.665+0000 7fe1fc54a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1f40ff640 0x7fe1f4101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:25.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.665+0000 7fe1fc54a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1f4100000 0x7fe1f41017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:25.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.665+0000 7fe1fc54a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1f41056e0 0x7fe1f4101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:25.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.665+0000 7fe1fc54a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f41a4f60 con 0x7fe1f40ff640 2023-10-18T14:03:25.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.665+0000 7fe1fc54a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f41a50d0 con 0x7fe1f4100000 2023-10-18T14:03:25.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.665+0000 7fe1fc54a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f41a5290 con 0x7fe1f41056e0 2023-10-18T14:03:25.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.665+0000 7fe1fa2e6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1f40ff640 0x7fe1f4101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:25.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.665+0000 7fe1fa2e6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1f40ff640 0x7fe1f4101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43074/0 (socket says 172.21.15.114:43074) 2023-10-18T14:03:25.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.665+0000 7fe1fa2e6700 1 -- 172.21.15.114:0/327240181 learned_addr learned my addr 172.21.15.114:0/327240181 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:25.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.665+0000 7fe1faae7700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1f41056e0 0x7fe1f4101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:25.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.666+0000 7fe1f9ae5700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1f4100000 0x7fe1f41017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:25.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.666+0000 7fe1fa2e6700 1 -- 172.21.15.114:0/327240181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1f41056e0 msgr2=0x7fe1f4101d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:25.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.666+0000 7fe1fa2e6700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1f41056e0 0x7fe1f4101d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.666+0000 7fe1fa2e6700 1 -- 172.21.15.114:0/327240181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1f4100000 msgr2=0x7fe1f41017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:25.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.666+0000 7fe1fa2e6700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1f4100000 0x7fe1f41017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.666+0000 7fe1fa2e6700 1 -- 172.21.15.114:0/327240181 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f00095f0 con 0x7fe1f40ff640 2023-10-18T14:03:25.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.666+0000 7fe1f9ae5700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1f4100000 0x7fe1f41017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:25.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.666+0000 7fe1fa2e6700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1f40ff640 0x7fe1f4101290 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400d980 tx=0x7fe1e400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:25.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.666+0000 7fe1eb7fe700 1 -- 172.21.15.114:0/327240181 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e400bb60 con 0x7fe1f40ff640 2023-10-18T14:03:25.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.666+0000 7fe1fc54a700 1 -- 172.21.15.114:0/327240181 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f41a5570 con 0x7fe1f40ff640 2023-10-18T14:03:25.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.666+0000 7fe1eb7fe700 1 -- 172.21.15.114:0/327240181 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1e4007640 con 0x7fe1f40ff640 2023-10-18T14:03:25.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.666+0000 7fe1eb7fe700 1 -- 172.21.15.114:0/327240181 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4004e90 con 0x7fe1f40ff640 2023-10-18T14:03:25.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.666+0000 7fe1fc54a700 1 -- 172.21.15.114:0/327240181 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f41a5ad0 con 0x7fe1f40ff640 2023-10-18T14:03:25.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.667+0000 7fe1fc54a700 1 -- 172.21.15.114:0/327240181 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f4100d30 con 0x7fe1f40ff640 2023-10-18T14:03:25.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.668+0000 7fe1eb7fe700 1 -- 172.21.15.114:0/327240181 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fe1e400bcc0 con 0x7fe1f40ff640 2023-10-18T14:03:25.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.668+0000 7fe1eb7fe700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1e00a15e0 0x7fe1e00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:25.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.669+0000 7fe1f9ae5700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1e00a15e0 0x7fe1e00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:25.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.669+0000 7fe1eb7fe700 1 -- 172.21.15.114:0/327240181 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe1e40cd340 con 0x7fe1f40ff640 2023-10-18T14:03:25.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.669+0000 7fe1f9ae5700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1e00a15e0 0x7fe1e00a3aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000b5c0 tx=0x7fe1f0005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:25.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.672+0000 7fe1eb7fe700 1 -- 172.21.15.114:0/327240181 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe1e4096740 con 0x7fe1f40ff640 2023-10-18T14:03:25.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:25 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3471012281' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-18T14:03:25.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:25 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/981855707' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:25.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.862+0000 7fe1fc54a700 1 -- 172.21.15.114:0/327240181 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1f410f570 con 0x7fe1f40ff640 2023-10-18T14:03:25.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.862+0000 7fe1eb7fe700 1 -- 172.21.15.114:0/327240181 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1e40160a0 con 0x7fe1f40ff640 2023-10-18T14:03:25.866 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T14:03:25.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.864+0000 7fe1fc54a700 1 -- 172.21.15.114:0/327240181 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1e00a15e0 msgr2=0x7fe1e00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:25.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.864+0000 7fe1fc54a700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1e00a15e0 0x7fe1e00a3aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000b5c0 tx=0x7fe1f0005fb0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.864+0000 7fe1fc54a700 1 -- 172.21.15.114:0/327240181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1f40ff640 msgr2=0x7fe1f4101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:25.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.864+0000 7fe1fc54a700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1f40ff640 0x7fe1f4101290 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400d980 tx=0x7fe1e400dd40 comp rx=0 tx=0).stop 2023-10-18T14:03:25.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.864+0000 7fe1fc54a700 1 -- 172.21.15.114:0/327240181 shutdown_connections 2023-10-18T14:03:25.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.864+0000 7fe1fc54a700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1e00a15e0 0x7fe1e00a3aa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.864+0000 7fe1fc54a700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1f41056e0 0x7fe1f4101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.864+0000 7fe1fc54a700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1f40ff640 0x7fe1f4101290 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.864+0000 7fe1fc54a700 1 --2- 172.21.15.114:0/327240181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe1f4100000 0x7fe1f41017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:25.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.864+0000 7fe1fc54a700 1 -- 172.21.15.114:0/327240181 >> 172.21.15.114:0/327240181 conn(0x7fe1f40767f0 msgr2=0x7fe1f4067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:25.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.865+0000 7fe1fc54a700 1 -- 172.21.15.114:0/327240181 shutdown_connections 2023-10-18T14:03:25.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:25.865+0000 7fe1fc54a700 1 -- 172.21.15.114:0/327240181 wait complete. 2023-10-18T14:03:25.881 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T14:03:26.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.001+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/2148379319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f8104630 msgr2=0x7ff5f8104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.001+0000 7ff5fdfb1700 1 --2- 172.21.15.114:0/2148379319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f8104630 0x7ff5f8104a10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009990 tx=0x7ff5ec009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.001+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/2148379319 shutdown_connections 2023-10-18T14:03:26.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.001+0000 7ff5fdfb1700 1 --2- 172.21.15.114:0/2148379319 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5f8105d20 0x7ff5f810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.001+0000 7ff5fdfb1700 1 --2- 172.21.15.114:0/2148379319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f8104630 0x7ff5f8104a10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.001+0000 7ff5fdfb1700 1 --2- 172.21.15.114:0/2148379319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f8105360 0x7ff5f81057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.001+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/2148379319 >> 172.21.15.114:0/2148379319 conn(0x7ff5f8074890 msgr2=0x7ff5f8074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:26.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.001+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/2148379319 shutdown_connections 2023-10-18T14:03:26.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.001+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/2148379319 wait complete. 2023-10-18T14:03:26.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.001+0000 7ff5fdfb1700 1 Processor -- start 2023-10-18T14:03:26.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5fdfb1700 1 -- start start 2023-10-18T14:03:26.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5fdfb1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f8104630 0x7ff5f8197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:26.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5fdfb1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5f8105360 0x7ff5f8197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:26.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5fdfb1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f8105d20 0x7ff5f81a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:26.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5fdfb1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f8198790 con 0x7ff5f8104630 2023-10-18T14:03:26.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5fdfb1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f81a2fe0 con 0x7ff5f8105360 2023-10-18T14:03:26.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5fdfb1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f81a3120 con 0x7ff5f8105d20 2023-10-18T14:03:26.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f8104630 0x7ff5f8197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:26.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f8104630 0x7ff5f8197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43088/0 (socket says 172.21.15.114:43088) 2023-10-18T14:03:26.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f77fe700 1 -- 172.21.15.114:0/517337007 learned_addr learned my addr 172.21.15.114:0/517337007 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:26.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f7fff700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f8105d20 0x7ff5f81a2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:26.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f6ffd700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5f8105360 0x7ff5f8197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:26.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f77fe700 1 -- 172.21.15.114:0/517337007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f8105d20 msgr2=0x7ff5f81a2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f77fe700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f8105d20 0x7ff5f81a2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f77fe700 1 -- 172.21.15.114:0/517337007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5f8105360 msgr2=0x7ff5f8197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f77fe700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5f8105360 0x7ff5f8197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f77fe700 1 -- 172.21.15.114:0/517337007 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec0095f0 con 0x7ff5f8104630 2023-10-18T14:03:26.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f6ffd700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5f8105360 0x7ff5f8197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:26.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f77fe700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f8104630 0x7ff5f8197a20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec000c00 tx=0x7ff5ec00f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:26.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f4ff9700 1 -- 172.21.15.114:0/517337007 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec01d070 con 0x7ff5f8104630 2023-10-18T14:03:26.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5f4ff9700 1 -- 172.21.15.114:0/517337007 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5ec00fd30 con 0x7ff5f8104630 2023-10-18T14:03:26.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.002+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/517337007 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f81a3320 con 0x7ff5f8104630 2023-10-18T14:03:26.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.003+0000 7ff5f4ff9700 1 -- 172.21.15.114:0/517337007 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec017630 con 0x7ff5f8104630 2023-10-18T14:03:26.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.003+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/517337007 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f81a3740 con 0x7ff5f8104630 2023-10-18T14:03:26.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.003+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/517337007 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f8107bc0 con 0x7ff5f8104630 2023-10-18T14:03:26.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.004+0000 7ff5f4ff9700 1 -- 172.21.15.114:0/517337007 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7ff5ec004830 con 0x7ff5f8104630 2023-10-18T14:03:26.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.005+0000 7ff5f4ff9700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff5e00a1560 0x7ff5e00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:26.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.005+0000 7ff5f6ffd700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff5e00a1560 0x7ff5e00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:26.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.005+0000 7ff5f4ff9700 1 -- 172.21.15.114:0/517337007 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff5ec0ce570 con 0x7ff5f8104630 2023-10-18T14:03:26.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.005+0000 7ff5f6ffd700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff5e00a1560 0x7ff5e00a3a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80ff8e0 tx=0x7ff5e8005f50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:26.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.008+0000 7ff5f4ff9700 1 -- 172.21.15.114:0/517337007 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff5ec097a60 con 0x7ff5f8104630 2023-10-18T14:03:26.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:25 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3471012281' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-18T14:03:26.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:25 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/981855707' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:26.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:25 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3471012281' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-18T14:03:26.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:25 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/981855707' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:26.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.199+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/517337007 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5f80ff690 con 0x7ff5f8104630 2023-10-18T14:03:26.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.200+0000 7ff5f4ff9700 1 -- 172.21.15.114:0/517337007 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5ec09b080 con 0x7ff5f8104630 2023-10-18T14:03:26.204 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T14:03:26.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.202+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/517337007 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff5e00a1560 msgr2=0x7ff5e00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.202+0000 7ff5fdfb1700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff5e00a1560 0x7ff5e00a3a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80ff8e0 tx=0x7ff5e8005f50 comp rx=0 tx=0).stop 2023-10-18T14:03:26.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.202+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/517337007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f8104630 msgr2=0x7ff5f8197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.202+0000 7ff5fdfb1700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f8104630 0x7ff5f8197a20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec000c00 tx=0x7ff5ec00f7d0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.202+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/517337007 shutdown_connections 2023-10-18T14:03:26.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.202+0000 7ff5fdfb1700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff5e00a1560 0x7ff5e00a3a20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.202+0000 7ff5fdfb1700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f8105d20 0x7ff5f81a2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.202+0000 7ff5fdfb1700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f8104630 0x7ff5f8197a20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.202+0000 7ff5fdfb1700 1 --2- 172.21.15.114:0/517337007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5f8105360 0x7ff5f8197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.202+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/517337007 >> 172.21.15.114:0/517337007 conn(0x7ff5f8074890 msgr2=0x7ff5f80fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:26.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.202+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/517337007 shutdown_connections 2023-10-18T14:03:26.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.202+0000 7ff5fdfb1700 1 -- 172.21.15.114:0/517337007 wait complete. 2023-10-18T14:03:26.218 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T14:03:26.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.339+0000 7fb3b2038700 1 -- 172.21.15.114:0/749262868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac104110 msgr2=0x7fb3ac10bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.339+0000 7fb3b2038700 1 --2- 172.21.15.114:0/749262868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac104110 0x7fb3ac10bc90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb3a400b0a0 tx=0x7fb3a400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.339+0000 7fb3b2038700 1 -- 172.21.15.114:0/749262868 shutdown_connections 2023-10-18T14:03:26.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.339+0000 7fb3b2038700 1 --2- 172.21.15.114:0/749262868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac104110 0x7fb3ac10bc90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.339+0000 7fb3b2038700 1 --2- 172.21.15.114:0/749262868 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ac0ff390 0x7fb3ac0ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.339+0000 7fb3b2038700 1 --2- 172.21.15.114:0/749262868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac0ffd40 0x7fb3ac1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.339+0000 7fb3b2038700 1 -- 172.21.15.114:0/749262868 >> 172.21.15.114:0/749262868 conn(0x7fb3ac074890 msgr2=0x7fb3ac074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:26.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.339+0000 7fb3b2038700 1 -- 172.21.15.114:0/749262868 shutdown_connections 2023-10-18T14:03:26.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.339+0000 7fb3b2038700 1 -- 172.21.15.114:0/749262868 wait complete. 2023-10-18T14:03:26.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.340+0000 7fb3b2038700 1 Processor -- start 2023-10-18T14:03:26.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.340+0000 7fb3b2038700 1 -- start start 2023-10-18T14:03:26.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.340+0000 7fb3b2038700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0ff390 0x7fb3ac100a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:26.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.340+0000 7fb3b2038700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac104110 0x7fb3ac100fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:26.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.340+0000 7fb3b2038700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ac101500 0x7fb3ac1a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:26.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.340+0000 7fb3b2038700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac1a54e0 con 0x7fb3ac0ff390 2023-10-18T14:03:26.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.340+0000 7fb3b2038700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac1a5650 con 0x7fb3ac101500 2023-10-18T14:03:26.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.340+0000 7fb3b2038700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac1a5810 con 0x7fb3ac104110 2023-10-18T14:03:26.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.340+0000 7fb3ab7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0ff390 0x7fb3ac100a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3ab7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0ff390 0x7fb3ac100a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43102/0 (socket says 172.21.15.114:43102) 2023-10-18T14:03:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3ab7fe700 1 -- 172.21.15.114:0/2588663004 learned_addr learned my addr 172.21.15.114:0/2588663004 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3aaffd700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac104110 0x7fb3ac100fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3abfff700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ac101500 0x7fb3ac1a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:26.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3ab7fe700 1 -- 172.21.15.114:0/2588663004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac104110 msgr2=0x7fb3ac100fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3ab7fe700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac104110 0x7fb3ac100fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3ab7fe700 1 -- 172.21.15.114:0/2588663004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ac101500 msgr2=0x7fb3ac1a4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3ab7fe700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ac101500 0x7fb3ac1a4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3ab7fe700 1 -- 172.21.15.114:0/2588663004 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a4009d00 con 0x7fb3ac0ff390 2023-10-18T14:03:26.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3aaffd700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac104110 0x7fb3ac100fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:26.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3ab7fe700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0ff390 0x7fb3ac100a80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00d950 tx=0x7fb39c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:26.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3a8ff9700 1 -- 172.21.15.114:0/2588663004 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c009b40 con 0x7fb3ac0ff390 2023-10-18T14:03:26.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3b2038700 1 -- 172.21.15.114:0/2588663004 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ac1a5af0 con 0x7fb3ac0ff390 2023-10-18T14:03:26.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3a8ff9700 1 -- 172.21.15.114:0/2588663004 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb39c009ca0 con 0x7fb3ac0ff390 2023-10-18T14:03:26.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3a8ff9700 1 -- 172.21.15.114:0/2588663004 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c00f620 con 0x7fb3ac0ff390 2023-10-18T14:03:26.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.341+0000 7fb3b2038700 1 -- 172.21.15.114:0/2588663004 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ac1a6050 con 0x7fb3ac0ff390 2023-10-18T14:03:26.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.342+0000 7fb3b2038700 1 -- 172.21.15.114:0/2588663004 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb398005310 con 0x7fb3ac0ff390 2023-10-18T14:03:26.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.343+0000 7fb3a8ff9700 1 -- 172.21.15.114:0/2588663004 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fb39c010460 con 0x7fb3ac0ff390 2023-10-18T14:03:26.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.343+0000 7fb3a8ff9700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb3940a1560 0x7fb3940a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:26.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.344+0000 7fb3aaffd700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb3940a1560 0x7fb3940a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:26.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.344+0000 7fb3a8ff9700 1 -- 172.21.15.114:0/2588663004 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb39c0cd290 con 0x7fb3ac0ff390 2023-10-18T14:03:26.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.344+0000 7fb3aaffd700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb3940a1560 0x7fb3940a3a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0005e10 tx=0x7fb3a0005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:26.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.347+0000 7fb3a8ff9700 1 -- 172.21.15.114:0/2588663004 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb39c0966f0 con 0x7fb3ac0ff390 2023-10-18T14:03:26.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.538+0000 7fb3b2038700 1 -- 172.21.15.114:0/2588663004 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb398005b40 con 0x7fb3ac0ff390 2023-10-18T14:03:26.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.539+0000 7fb3a8ff9700 1 -- 172.21.15.114:0/2588663004 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb39c016020 con 0x7fb3ac0ff390 2023-10-18T14:03:26.543 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T14:03:26.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.541+0000 7fb3b2038700 1 -- 172.21.15.114:0/2588663004 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb3940a1560 msgr2=0x7fb3940a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.541+0000 7fb3b2038700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb3940a1560 0x7fb3940a3a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0005e10 tx=0x7fb3a0005d60 comp rx=0 tx=0).stop 2023-10-18T14:03:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.541+0000 7fb3b2038700 1 -- 172.21.15.114:0/2588663004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0ff390 msgr2=0x7fb3ac100a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.541+0000 7fb3b2038700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0ff390 0x7fb3ac100a80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00d950 tx=0x7fb39c00dd10 comp rx=0 tx=0).stop 2023-10-18T14:03:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.541+0000 7fb3b2038700 1 -- 172.21.15.114:0/2588663004 shutdown_connections 2023-10-18T14:03:26.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.541+0000 7fb3b2038700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb3940a1560 0x7fb3940a3a20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.541+0000 7fb3b2038700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb3ac101500 0x7fb3ac1a4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.541+0000 7fb3b2038700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0ff390 0x7fb3ac100a80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.541+0000 7fb3b2038700 1 --2- 172.21.15.114:0/2588663004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac104110 0x7fb3ac100fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.541+0000 7fb3b2038700 1 -- 172.21.15.114:0/2588663004 >> 172.21.15.114:0/2588663004 conn(0x7fb3ac074890 msgr2=0x7fb3ac10c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:26.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.541+0000 7fb3b2038700 1 -- 172.21.15.114:0/2588663004 shutdown_connections 2023-10-18T14:03:26.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.541+0000 7fb3b2038700 1 -- 172.21.15.114:0/2588663004 wait complete. 2023-10-18T14:03:26.557 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:03:26.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.674+0000 7f799a490700 1 -- 172.21.15.114:0/1038948990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7994100730 msgr2=0x7f799410c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.674+0000 7f799a490700 1 --2- 172.21.15.114:0/1038948990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7994100730 0x7f799410c470 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f798c00b0d0 tx=0x7f798c00b3e0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.674+0000 7f799a490700 1 -- 172.21.15.114:0/1038948990 shutdown_connections 2023-10-18T14:03:26.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.674+0000 7f799a490700 1 --2- 172.21.15.114:0/1038948990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7994100730 0x7f799410c470 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.674+0000 7f799a490700 1 --2- 172.21.15.114:0/1038948990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79941056f0 0x7f7994105ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.674+0000 7f799a490700 1 --2- 172.21.15.114:0/1038948990 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79940ffd70 0x7f79941001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.674+0000 7f799a490700 1 -- 172.21.15.114:0/1038948990 >> 172.21.15.114:0/1038948990 conn(0x7f7994075b90 msgr2=0x7f79940fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:26.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.674+0000 7f799a490700 1 -- 172.21.15.114:0/1038948990 shutdown_connections 2023-10-18T14:03:26.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.674+0000 7f799a490700 1 -- 172.21.15.114:0/1038948990 wait complete. 2023-10-18T14:03:26.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f799a490700 1 Processor -- start 2023-10-18T14:03:26.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f799a490700 1 -- start start 2023-10-18T14:03:26.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f799a490700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79940ffd70 0x7f7994198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:26.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f799a490700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7994100730 0x7f7994199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:26.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f799a490700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79941056f0 0x7f799419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:26.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f799a490700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799419dd00 con 0x7f7994100730 2023-10-18T14:03:26.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f799a490700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799419de70 con 0x7f79940ffd70 2023-10-18T14:03:26.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f799a490700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799419e030 con 0x7f79941056f0 2023-10-18T14:03:26.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f79937fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7994100730 0x7f7994199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:26.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f79937fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7994100730 0x7f7994199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43118/0 (socket says 172.21.15.114:43118) 2023-10-18T14:03:26.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f79937fe700 1 -- 172.21.15.114:0/46161911 learned_addr learned my addr 172.21.15.114:0/46161911 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:26.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f7993fff700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79940ffd70 0x7f7994198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:26.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f79937fe700 1 -- 172.21.15.114:0/46161911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79941056f0 msgr2=0x7f799419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f7998a2d700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79941056f0 0x7f799419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:26.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f79937fe700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79941056f0 0x7f799419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f79937fe700 1 -- 172.21.15.114:0/46161911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79940ffd70 msgr2=0x7f7994198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.675+0000 7f79937fe700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79940ffd70 0x7f7994198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.676+0000 7f79937fe700 1 -- 172.21.15.114:0/46161911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c009d00 con 0x7f7994100730 2023-10-18T14:03:26.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.676+0000 7f7993fff700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79940ffd70 0x7f7994198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:26.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.676+0000 7f79937fe700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7994100730 0x7f7994199320 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f798800d950 tx=0x7f798800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:26.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.676+0000 7f79917fa700 1 -- 172.21.15.114:0/46161911 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7988009b40 con 0x7f7994100730 2023-10-18T14:03:26.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.676+0000 7f79917fa700 1 -- 172.21.15.114:0/46161911 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7988009ca0 con 0x7f7994100730 2023-10-18T14:03:26.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.676+0000 7f799a490700 1 -- 172.21.15.114:0/46161911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799419e310 con 0x7f7994100730 2023-10-18T14:03:26.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.676+0000 7f79917fa700 1 -- 172.21.15.114:0/46161911 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798800f620 con 0x7f7994100730 2023-10-18T14:03:26.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.676+0000 7f799a490700 1 -- 172.21.15.114:0/46161911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79941a5b50 con 0x7f7994100730 2023-10-18T14:03:26.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.677+0000 7f799a490700 1 -- 172.21.15.114:0/46161911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7994100d80 con 0x7f7994100730 2023-10-18T14:03:26.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.678+0000 7f79917fa700 1 -- 172.21.15.114:0/46161911 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f7988010460 con 0x7f7994100730 2023-10-18T14:03:26.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.678+0000 7f79917fa700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f797c0a1560 0x7f797c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:26.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.678+0000 7f7993fff700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f797c0a1560 0x7f797c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:26.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.679+0000 7f79917fa700 1 -- 172.21.15.114:0/46161911 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f79880cd320 con 0x7f7994100730 2023-10-18T14:03:26.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.679+0000 7f7993fff700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f797c0a1560 0x7f797c0a3a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7984005950 tx=0x7f7984005f50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:26.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.683+0000 7f79917fa700 1 -- 172.21.15.114:0/46161911 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7988096780 con 0x7f7994100730 2023-10-18T14:03:26.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:26 smithi114 ceph-mon[99494]: pgmap v262: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-18T14:03:26.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:26 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/327240181' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:26.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:26 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/517337007' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:26.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:26 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2588663004' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:26.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.918+0000 7f799a490700 1 -- 172.21.15.114:0/46161911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7994066ca0 con 0x7f7994100730 2023-10-18T14:03:26.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.919+0000 7f79917fa700 1 -- 172.21.15.114:0/46161911 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11390 (secure 0 0 0) 0x7f7988099da0 con 0x7f7994100730 2023-10-18T14:03:26.924 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:26.924 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:02:39.260198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:03:26.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.921+0000 7f799a490700 1 -- 172.21.15.114:0/46161911 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f797c0a1560 msgr2=0x7f797c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.921+0000 7f799a490700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f797c0a1560 0x7f797c0a3a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7984005950 tx=0x7f7984005f50 comp rx=0 tx=0).stop 2023-10-18T14:03:26.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.921+0000 7f799a490700 1 -- 172.21.15.114:0/46161911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7994100730 msgr2=0x7f7994199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:26.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.921+0000 7f799a490700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7994100730 0x7f7994199320 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f798800d950 tx=0x7f798800dd10 comp rx=0 tx=0).stop 2023-10-18T14:03:26.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.921+0000 7f799a490700 1 -- 172.21.15.114:0/46161911 shutdown_connections 2023-10-18T14:03:26.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.921+0000 7f799a490700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f797c0a1560 0x7f797c0a3a20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.921+0000 7f799a490700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79941056f0 0x7f799419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.921+0000 7f799a490700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f79940ffd70 0x7f7994198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.921+0000 7f799a490700 1 --2- 172.21.15.114:0/46161911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7994100730 0x7f7994199320 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:26.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.921+0000 7f799a490700 1 -- 172.21.15.114:0/46161911 >> 172.21.15.114:0/46161911 conn(0x7f7994075b90 msgr2=0x7f79940fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:26.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.922+0000 7f799a490700 1 -- 172.21.15.114:0/46161911 shutdown_connections 2023-10-18T14:03:26.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:26.922+0000 7f799a490700 1 -- 172.21.15.114:0/46161911 wait complete. 2023-10-18T14:03:26.928 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2023-10-18T14:03:26.938 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:03:27.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:26 smithi158 ceph-mon[103317]: pgmap v262: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-18T14:03:27.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:26 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/327240181' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:27.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:26 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/517337007' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:27.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:26 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2588663004' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:27.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.055+0000 7f105185d700 1 -- 172.21.15.114:0/2729513657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f104c100690 msgr2=0x7f104c100b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.055+0000 7f105185d700 1 --2- 172.21.15.114:0/2729513657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f104c100690 0x7f104c100b10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f103c009990 tx=0x7f103c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 -- 172.21.15.114:0/2729513657 shutdown_connections 2023-10-18T14:03:27.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 --2- 172.21.15.114:0/2729513657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f104c101050 0x7f104c10d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 --2- 172.21.15.114:0/2729513657 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f104c1066a0 0x7f104c106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 --2- 172.21.15.114:0/2729513657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f104c100690 0x7f104c100b10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 -- 172.21.15.114:0/2729513657 >> 172.21.15.114:0/2729513657 conn(0x7f104c0fc180 msgr2=0x7f104c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:27.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 -- 172.21.15.114:0/2729513657 shutdown_connections 2023-10-18T14:03:27.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 -- 172.21.15.114:0/2729513657 wait complete. 2023-10-18T14:03:27.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 Processor -- start 2023-10-18T14:03:27.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 -- start start 2023-10-18T14:03:27.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f104c100690 0x7f104c19c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:27.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f104c101050 0x7f104c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:27.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f104c1066a0 0x7f104c196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:27.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c197160 con 0x7f104c100690 2023-10-18T14:03:27.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c1972d0 con 0x7f104c1066a0 2023-10-18T14:03:27.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.056+0000 7f105185d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c197490 con 0x7f104c101050 2023-10-18T14:03:27.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f104affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f104c100690 0x7f104c19c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:27.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f104affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f104c100690 0x7f104c19c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43130/0 (socket says 172.21.15.114:43130) 2023-10-18T14:03:27.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f104affd700 1 -- 172.21.15.114:0/3601706306 learned_addr learned my addr 172.21.15.114:0/3601706306 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:27.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f104a7fc700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f104c101050 0x7f104c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:27.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f104b7fe700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f104c1066a0 0x7f104c196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:27.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f104affd700 1 -- 172.21.15.114:0/3601706306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f104c101050 msgr2=0x7f104c19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f104affd700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f104c101050 0x7f104c19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f104affd700 1 -- 172.21.15.114:0/3601706306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f104c1066a0 msgr2=0x7f104c196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f104affd700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f104c1066a0 0x7f104c196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f104affd700 1 -- 172.21.15.114:0/3601706306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c0095f0 con 0x7f104c100690 2023-10-18T14:03:27.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f104a7fc700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f104c101050 0x7f104c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:27.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f104b7fe700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f104c1066a0 0x7f104c196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:27.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f104affd700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f104c100690 0x7f104c19c8f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f104000b530 tx=0x7f104000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:27.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f105085b700 1 -- 172.21.15.114:0/3601706306 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040011830 con 0x7f104c100690 2023-10-18T14:03:27.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f105085b700 1 -- 172.21.15.114:0/3601706306 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1040011e50 con 0x7f104c100690 2023-10-18T14:03:27.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f105185d700 1 -- 172.21.15.114:0/3601706306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104c197770 con 0x7f104c100690 2023-10-18T14:03:27.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f105085b700 1 -- 172.21.15.114:0/3601706306 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104000f2e0 con 0x7f104c100690 2023-10-18T14:03:27.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.057+0000 7f105185d700 1 -- 172.21.15.114:0/3601706306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104c1a38c0 con 0x7f104c100690 2023-10-18T14:03:27.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.058+0000 7f105185d700 1 -- 172.21.15.114:0/3601706306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104c108cb0 con 0x7f104c100690 2023-10-18T14:03:27.070 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:26 smithi172 ceph-mon[103574]: pgmap v262: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-18T14:03:27.070 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:26 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/327240181' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:27.071 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:26 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/517337007' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:27.071 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:26 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2588663004' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:27.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.060+0000 7f105085b700 1 -- 172.21.15.114:0/3601706306 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f1040010580 con 0x7f104c100690 2023-10-18T14:03:27.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.060+0000 7f105085b700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f10340a15e0 0x7f10340a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:27.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.060+0000 7f104a7fc700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f10340a15e0 0x7f10340a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:27.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.060+0000 7f105085b700 1 -- 172.21.15.114:0/3601706306 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f10400cceb0 con 0x7f104c100690 2023-10-18T14:03:27.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.061+0000 7f104a7fc700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f10340a15e0 0x7f10340a3aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f103c006010 tx=0x7f103c00b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:27.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.064+0000 7f105085b700 1 -- 172.21.15.114:0/3601706306 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1040096420 con 0x7f104c100690 2023-10-18T14:03:27.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.256+0000 7f105185d700 1 -- 172.21.15.114:0/3601706306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f104c197e70 con 0x7f104c100690 2023-10-18T14:03:27.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.258+0000 7f105085b700 1 -- 172.21.15.114:0/3601706306 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22907 (secure 0 0 0) 0x7f1040015090 con 0x7f104c100690 2023-10-18T14:03:27.262 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:27.262 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":85,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:03:08.625359+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:03:27.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.260+0000 7f105185d700 1 -- 172.21.15.114:0/3601706306 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f10340a15e0 msgr2=0x7f10340a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.260+0000 7f105185d700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f10340a15e0 0x7f10340a3aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f103c006010 tx=0x7f103c00b540 comp rx=0 tx=0).stop 2023-10-18T14:03:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.260+0000 7f105185d700 1 -- 172.21.15.114:0/3601706306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f104c100690 msgr2=0x7f104c19c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.260+0000 7f105185d700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f104c100690 0x7f104c19c8f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f104000b530 tx=0x7f104000b8f0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.260+0000 7f105185d700 1 -- 172.21.15.114:0/3601706306 shutdown_connections 2023-10-18T14:03:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.260+0000 7f105185d700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f10340a15e0 0x7f10340a3aa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.260+0000 7f105185d700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f104c1066a0 0x7f104c196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.260+0000 7f105185d700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f104c100690 0x7f104c19c8f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.260+0000 7f105185d700 1 --2- 172.21.15.114:0/3601706306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f104c101050 0x7f104c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.260+0000 7f105185d700 1 -- 172.21.15.114:0/3601706306 >> 172.21.15.114:0/3601706306 conn(0x7f104c0fc180 msgr2=0x7f104c0fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.260+0000 7f105185d700 1 -- 172.21.15.114:0/3601706306 shutdown_connections 2023-10-18T14:03:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.260+0000 7f105185d700 1 -- 172.21.15.114:0/3601706306 wait complete. 2023-10-18T14:03:27.277 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T13:58:43.813590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T14:02:30.693853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T14:02:31.426625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T14:03:27.278 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T14:03:27.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.399+0000 7f481b462700 1 -- 172.21.15.114:0/4129797723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4814100700 msgr2=0x7f4814100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.399+0000 7f481b462700 1 --2- 172.21.15.114:0/4129797723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4814100700 0x7f4814100b80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4810009990 tx=0x7f4810009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.399+0000 7f481b462700 1 -- 172.21.15.114:0/4129797723 shutdown_connections 2023-10-18T14:03:27.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.399+0000 7f481b462700 1 --2- 172.21.15.114:0/4129797723 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48141010c0 0x7f481410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.399+0000 7f481b462700 1 --2- 172.21.15.114:0/4129797723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4814106710 0x7f4814106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.399+0000 7f481b462700 1 --2- 172.21.15.114:0/4129797723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4814100700 0x7f4814100b80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.400+0000 7f481b462700 1 -- 172.21.15.114:0/4129797723 >> 172.21.15.114:0/4129797723 conn(0x7f48140fc1f0 msgr2=0x7f48140fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:27.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.400+0000 7f481b462700 1 -- 172.21.15.114:0/4129797723 shutdown_connections 2023-10-18T14:03:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.400+0000 7f481b462700 1 -- 172.21.15.114:0/4129797723 wait complete. 2023-10-18T14:03:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.400+0000 7f481b462700 1 Processor -- start 2023-10-18T14:03:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.400+0000 7f481b462700 1 -- start start 2023-10-18T14:03:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.400+0000 7f481b462700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4814100700 0x7f481419c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.400+0000 7f481b462700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48141010c0 0x7f481419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.400+0000 7f481b462700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4814106710 0x7f48141969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:27.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.400+0000 7f481b462700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4814197000 con 0x7f4814106710 2023-10-18T14:03:27.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.400+0000 7f481b462700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4814197170 con 0x7f48141010c0 2023-10-18T14:03:27.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.400+0000 7f481b462700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4814197330 con 0x7f4814100700 2023-10-18T14:03:27.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f48199ff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4814106710 0x7f48141969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:27.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f48199ff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4814106710 0x7f48141969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43148/0 (socket says 172.21.15.114:43148) 2023-10-18T14:03:27.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f48199ff700 1 -- 172.21.15.114:0/140248497 learned_addr learned my addr 172.21.15.114:0/140248497 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:27.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f48191fe700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4814100700 0x7f481419c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:27.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f48189fd700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48141010c0 0x7f481419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:27.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f48199ff700 1 -- 172.21.15.114:0/140248497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4814100700 msgr2=0x7f481419c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f48199ff700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4814100700 0x7f481419c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f48199ff700 1 -- 172.21.15.114:0/140248497 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48141010c0 msgr2=0x7f481419cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f48199ff700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48141010c0 0x7f481419cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f48199ff700 1 -- 172.21.15.114:0/140248497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48100095f0 con 0x7f4814106710 2023-10-18T14:03:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f48191fe700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4814100700 0x7f481419c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f48189fd700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48141010c0 0x7f481419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f48199ff700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4814106710 0x7f48141969a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f480c007ee0 tx=0x7f480c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f480a7fc700 1 -- 172.21.15.114:0/140248497 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c00ddd0 con 0x7f4814106710 2023-10-18T14:03:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f480a7fc700 1 -- 172.21.15.114:0/140248497 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f480c00f040 con 0x7f4814106710 2023-10-18T14:03:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f481b462700 1 -- 172.21.15.114:0/140248497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4814197610 con 0x7f4814106710 2023-10-18T14:03:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f480a7fc700 1 -- 172.21.15.114:0/140248497 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c015400 con 0x7f4814106710 2023-10-18T14:03:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.401+0000 7f481b462700 1 -- 172.21.15.114:0/140248497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48141a3860 con 0x7f4814106710 2023-10-18T14:03:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.402+0000 7f481b462700 1 -- 172.21.15.114:0/140248497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4814108c90 con 0x7f4814106710 2023-10-18T14:03:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.403+0000 7f480a7fc700 1 -- 172.21.15.114:0/140248497 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f480c004000 con 0x7f4814106710 2023-10-18T14:03:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.404+0000 7f480a7fc700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f48000a1560 0x7f48000a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.404+0000 7f48191fe700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f48000a1560 0x7f48000a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.404+0000 7f480a7fc700 1 -- 172.21.15.114:0/140248497 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f480c0cd1c0 con 0x7f4814106710 2023-10-18T14:03:27.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.404+0000 7f48191fe700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f48000a1560 0x7f48000a3a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4804005e10 tx=0x7f4804005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:27.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.407+0000 7f480a7fc700 1 -- 172.21.15.114:0/140248497 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f480c0965c0 con 0x7f4814106710 2023-10-18T14:03:27.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.599+0000 7f481b462700 1 -- 172.21.15.114:0/140248497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4814197e60 con 0x7f4814106710 2023-10-18T14:03:27.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.599+0000 7f480a7fc700 1 -- 172.21.15.114:0/140248497 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f480c0230a0 con 0x7f4814106710 2023-10-18T14:03:27.603 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T14:03:27.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.601+0000 7f481b462700 1 -- 172.21.15.114:0/140248497 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f48000a1560 msgr2=0x7f48000a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.601+0000 7f481b462700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f48000a1560 0x7f48000a3a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4804005e10 tx=0x7f4804005d60 comp rx=0 tx=0).stop 2023-10-18T14:03:27.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.601+0000 7f481b462700 1 -- 172.21.15.114:0/140248497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4814106710 msgr2=0x7f48141969a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.601+0000 7f481b462700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4814106710 0x7f48141969a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f480c007ee0 tx=0x7f480c00d3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.601+0000 7f481b462700 1 -- 172.21.15.114:0/140248497 shutdown_connections 2023-10-18T14:03:27.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.601+0000 7f481b462700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f48000a1560 0x7f48000a3a20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.601+0000 7f481b462700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4814106710 0x7f48141969a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.601+0000 7f481b462700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4814100700 0x7f481419c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.601+0000 7f481b462700 1 --2- 172.21.15.114:0/140248497 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f48141010c0 0x7f481419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.601+0000 7f481b462700 1 -- 172.21.15.114:0/140248497 >> 172.21.15.114:0/140248497 conn(0x7f48140fc1f0 msgr2=0x7f48140fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:27.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.601+0000 7f481b462700 1 -- 172.21.15.114:0/140248497 shutdown_connections 2023-10-18T14:03:27.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.601+0000 7f481b462700 1 -- 172.21.15.114:0/140248497 wait complete. 2023-10-18T14:03:27.617 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T14:03:27.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 -- 172.21.15.114:0/755817549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febec0ff650 msgr2=0x7febec0ffad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 --2- 172.21.15.114:0/755817549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febec0ff650 0x7febec0ffad0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7febd8009990 tx=0x7febd8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 -- 172.21.15.114:0/755817549 shutdown_connections 2023-10-18T14:03:27.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 --2- 172.21.15.114:0/755817549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febec100010 0x7febec10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 --2- 172.21.15.114:0/755817549 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febec1056f0 0x7febec105ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 --2- 172.21.15.114:0/755817549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febec0ff650 0x7febec0ffad0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 -- 172.21.15.114:0/755817549 >> 172.21.15.114:0/755817549 conn(0x7febec076760 msgr2=0x7febec076b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:27.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 -- 172.21.15.114:0/755817549 shutdown_connections 2023-10-18T14:03:27.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 -- 172.21.15.114:0/755817549 wait complete. 2023-10-18T14:03:27.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 Processor -- start 2023-10-18T14:03:27.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 -- start start 2023-10-18T14:03:27.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febec0ff650 0x7febec19b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:27.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febec100010 0x7febec19be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:27.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febec1056f0 0x7febec1959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:27.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec196050 con 0x7febec100010 2023-10-18T14:03:27.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec1961c0 con 0x7febec0ff650 2023-10-18T14:03:27.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.739+0000 7febf3033700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec196380 con 0x7febec1056f0 2023-10-18T14:03:27.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febebfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febec100010 0x7febec19be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:27.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febebfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febec100010 0x7febec19be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43160/0 (socket says 172.21.15.114:43160) 2023-10-18T14:03:27.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febebfff700 1 -- 172.21.15.114:0/2264158164 learned_addr learned my addr 172.21.15.114:0/2264158164 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:27.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febf0dcf700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febec0ff650 0x7febec19b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:27.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febf15d0700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febec1056f0 0x7febec1959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:27.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febebfff700 1 -- 172.21.15.114:0/2264158164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febec1056f0 msgr2=0x7febec1959f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febebfff700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febec1056f0 0x7febec1959f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febebfff700 1 -- 172.21.15.114:0/2264158164 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febec0ff650 msgr2=0x7febec19b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febebfff700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febec0ff650 0x7febec19b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febebfff700 1 -- 172.21.15.114:0/2264158164 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd80095f0 con 0x7febec100010 2023-10-18T14:03:27.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febebfff700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febec100010 0x7febec19be00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7febd8005910 tx=0x7febd8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:27.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febe9ffb700 1 -- 172.21.15.114:0/2264158164 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd801d070 con 0x7febec100010 2023-10-18T14:03:27.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febe9ffb700 1 -- 172.21.15.114:0/2264158164 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febd8022470 con 0x7febec100010 2023-10-18T14:03:27.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febf3033700 1 -- 172.21.15.114:0/2264158164 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec196600 con 0x7febec100010 2023-10-18T14:03:27.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febe9ffb700 1 -- 172.21.15.114:0/2264158164 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8017650 con 0x7febec100010 2023-10-18T14:03:27.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.740+0000 7febf3033700 1 -- 172.21.15.114:0/2264158164 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec1a28b0 con 0x7febec100010 2023-10-18T14:03:27.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.741+0000 7febf3033700 1 -- 172.21.15.114:0/2264158164 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec107b90 con 0x7febec100010 2023-10-18T14:03:27.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.742+0000 7febe9ffb700 1 -- 172.21.15.114:0/2264158164 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7febd80225e0 con 0x7febec100010 2023-10-18T14:03:27.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.743+0000 7febe9ffb700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7febdc0a1560 0x7febdc0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:27.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.743+0000 7febf0dcf700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7febdc0a1560 0x7febdc0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:27.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.743+0000 7febe9ffb700 1 -- 172.21.15.114:0/2264158164 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7febd80ce2b0 con 0x7febec100010 2023-10-18T14:03:27.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.743+0000 7febf0dcf700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7febdc0a1560 0x7febdc0a3a20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7febe0009be0 tx=0x7febe0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:27.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.747+0000 7febe9ffb700 1 -- 172.21.15.114:0/2264158164 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7febd80977a0 con 0x7febec100010 2023-10-18T14:03:27.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.939+0000 7febf3033700 1 -- 172.21.15.114:0/2264158164 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7febec196eb0 con 0x7febec100010 2023-10-18T14:03:27.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.940+0000 7febe9ffb700 1 -- 172.21.15.114:0/2264158164 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7febd809adc0 con 0x7febec100010 2023-10-18T14:03:27.990 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T14:03:27.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.942+0000 7febf3033700 1 -- 172.21.15.114:0/2264158164 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7febdc0a1560 msgr2=0x7febdc0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.942+0000 7febf3033700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7febdc0a1560 0x7febdc0a3a20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7febe0009be0 tx=0x7febe0009260 comp rx=0 tx=0).stop 2023-10-18T14:03:27.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.942+0000 7febf3033700 1 -- 172.21.15.114:0/2264158164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febec100010 msgr2=0x7febec19be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:27.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.942+0000 7febf3033700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febec100010 0x7febec19be00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7febd8005910 tx=0x7febd8004730 comp rx=0 tx=0).stop 2023-10-18T14:03:27.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.942+0000 7febf3033700 1 -- 172.21.15.114:0/2264158164 shutdown_connections 2023-10-18T14:03:27.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.942+0000 7febf3033700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7febdc0a1560 0x7febdc0a3a20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.942+0000 7febf3033700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febec1056f0 0x7febec1959f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.942+0000 7febf3033700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7febec0ff650 0x7febec19b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.942+0000 7febf3033700 1 --2- 172.21.15.114:0/2264158164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febec100010 0x7febec19be00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:27.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.942+0000 7febf3033700 1 -- 172.21.15.114:0/2264158164 >> 172.21.15.114:0/2264158164 conn(0x7febec076760 msgr2=0x7febec0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:27.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.942+0000 7febf3033700 1 -- 172.21.15.114:0/2264158164 shutdown_connections 2023-10-18T14:03:27.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:27.942+0000 7febf3033700 1 -- 172.21.15.114:0/2264158164 wait complete. 2023-10-18T14:03:27.994 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:27 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/46161911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:27.994 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:27 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3601706306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:27.994 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:27 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/140248497' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:27.995 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T14:03:28.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:27 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/46161911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:28.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:27 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3601706306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:28.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:27 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/140248497' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:28.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:27 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/46161911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:28.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:27 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3601706306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:28.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:27 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/140248497' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:28.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.125+0000 7f6171c93700 1 -- 172.21.15.114:0/727480510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f616c105170 msgr2=0x7f616c1055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:28.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.125+0000 7f6171c93700 1 --2- 172.21.15.114:0/727480510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f616c105170 0x7f616c1055f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f615c0099c0 tx=0x7f615c009cd0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.125+0000 7f6171c93700 1 -- 172.21.15.114:0/727480510 shutdown_connections 2023-10-18T14:03:28.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.125+0000 7f6171c93700 1 --2- 172.21.15.114:0/727480510 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f616c105b30 0x7f616c10d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.125+0000 7f6171c93700 1 --2- 172.21.15.114:0/727480510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f616c067d40 0x7f616c068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.125+0000 7f6171c93700 1 --2- 172.21.15.114:0/727480510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f616c105170 0x7f616c1055f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.125+0000 7f6171c93700 1 -- 172.21.15.114:0/727480510 >> 172.21.15.114:0/727480510 conn(0x7f616c0767f0 msgr2=0x7f616c076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:28.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.125+0000 7f6171c93700 1 -- 172.21.15.114:0/727480510 shutdown_connections 2023-10-18T14:03:28.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.125+0000 7f6171c93700 1 -- 172.21.15.114:0/727480510 wait complete. 2023-10-18T14:03:28.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f6171c93700 1 Processor -- start 2023-10-18T14:03:28.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f6171c93700 1 -- start start 2023-10-18T14:03:28.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f6171c93700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f616c067d40 0x7f616c19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:28.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f6171c93700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f616c105170 0x7f616c19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:28.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f6171c93700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f616c105b30 0x7f616c196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:28.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f6171c93700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c197140 con 0x7f616c105170 2023-10-18T14:03:28.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f6171c93700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c1972b0 con 0x7f616c067d40 2023-10-18T14:03:28.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f6171c93700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c197470 con 0x7f616c105b30 2023-10-18T14:03:28.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f616affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f616c105170 0x7f616c19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:28.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f616affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f616c105170 0x7f616c19cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43174/0 (socket says 172.21.15.114:43174) 2023-10-18T14:03:28.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f616affd700 1 -- 172.21.15.114:0/3421164520 learned_addr learned my addr 172.21.15.114:0/3421164520 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:28.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f616b7fe700 1 --2- 172.21.15.114:0/3421164520 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f616c067d40 0x7f616c19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:28.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f616affd700 1 -- 172.21.15.114:0/3421164520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f616c105b30 msgr2=0x7f616c196ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:28.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f616affd700 1 --2- 172.21.15.114:0/3421164520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f616c105b30 0x7f616c196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f616affd700 1 -- 172.21.15.114:0/3421164520 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f616c067d40 msgr2=0x7f616c19c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:28.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f616affd700 1 --2- 172.21.15.114:0/3421164520 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f616c067d40 0x7f616c19c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.126+0000 7f616affd700 1 -- 172.21.15.114:0/3421164520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c0095f0 con 0x7f616c105170 2023-10-18T14:03:28.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.127+0000 7f616affd700 1 --2- 172.21.15.114:0/3421164520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f616c105170 0x7f616c19cef0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f615c009990 tx=0x7f615c0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:28.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.127+0000 7f6168ff9700 1 -- 172.21.15.114:0/3421164520 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c01d070 con 0x7f616c105170 2023-10-18T14:03:28.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.127+0000 7f6168ff9700 1 -- 172.21.15.114:0/3421164520 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f615c00fda0 con 0x7f616c105170 2023-10-18T14:03:28.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.127+0000 7f6171c93700 1 -- 172.21.15.114:0/3421164520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c1976f0 con 0x7f616c105170 2023-10-18T14:03:28.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.127+0000 7f6168ff9700 1 -- 172.21.15.114:0/3421164520 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c005300 con 0x7f616c105170 2023-10-18T14:03:28.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.127+0000 7f6171c93700 1 -- 172.21.15.114:0/3421164520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c1a39a0 con 0x7f616c105170 2023-10-18T14:03:28.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.128+0000 7f6171c93700 1 -- 172.21.15.114:0/3421164520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c108c20 con 0x7f616c105170 2023-10-18T14:03:28.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.129+0000 7f6168ff9700 1 -- 172.21.15.114:0/3421164520 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f615c004a00 con 0x7f616c105170 2023-10-18T14:03:28.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.129+0000 7f6168ff9700 1 --2- 172.21.15.114:0/3421164520 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f61540a1560 0x7f61540a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:28.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.129+0000 7f6168ff9700 1 -- 172.21.15.114:0/3421164520 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f615c0ce050 con 0x7f616c105170 2023-10-18T14:03:28.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.129+0000 7f616b7fe700 1 --2- 172.21.15.114:0/3421164520 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f61540a1560 0x7f61540a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:28.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.130+0000 7f616b7fe700 1 --2- 172.21.15.114:0/3421164520 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f61540a1560 0x7f61540a3a20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6160006fd0 tx=0x7f6160008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:28.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.133+0000 7f6168ff9700 1 -- 172.21.15.114:0/3421164520 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f615c097540 con 0x7f616c105170 2023-10-18T14:03:28.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.329+0000 7f6171c93700 1 -- 172.21.15.114:0/3421164520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f616c0675d0 con 0x7f616c105170 2023-10-18T14:03:28.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.329+0000 7f6168ff9700 1 -- 172.21.15.114:0/3421164520 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f615c09ab60 con 0x7f616c105170 2023-10-18T14:03:28.334 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T14:03:28.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.331+0000 7f6171c93700 1 -- 172.21.15.114:0/3421164520 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f61540a1560 msgr2=0x7f61540a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:28.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.331+0000 7f6171c93700 1 --2- 172.21.15.114:0/3421164520 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f61540a1560 0x7f61540a3a20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6160006fd0 tx=0x7f6160008040 comp rx=0 tx=0).stop 2023-10-18T14:03:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.331+0000 7f6171c93700 1 -- 172.21.15.114:0/3421164520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f616c105170 msgr2=0x7f616c19cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.331+0000 7f6171c93700 1 --2- 172.21.15.114:0/3421164520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f616c105170 0x7f616c19cef0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f615c009990 tx=0x7f615c0036f0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.332+0000 7f6171c93700 1 -- 172.21.15.114:0/3421164520 shutdown_connections 2023-10-18T14:03:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.332+0000 7f6171c93700 1 --2- 172.21.15.114:0/3421164520 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f61540a1560 0x7f61540a3a20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.332+0000 7f6171c93700 1 --2- 172.21.15.114:0/3421164520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f616c105b30 0x7f616c196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.332+0000 7f6171c93700 1 --2- 172.21.15.114:0/3421164520 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f616c067d40 0x7f616c19c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.332+0000 7f6171c93700 1 --2- 172.21.15.114:0/3421164520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f616c105170 0x7f616c19cef0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.332+0000 7f6171c93700 1 -- 172.21.15.114:0/3421164520 >> 172.21.15.114:0/3421164520 conn(0x7f616c0767f0 msgr2=0x7f616c0fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.332+0000 7f6171c93700 1 -- 172.21.15.114:0/3421164520 shutdown_connections 2023-10-18T14:03:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.332+0000 7f6171c93700 1 -- 172.21.15.114:0/3421164520 wait complete. 2023-10-18T14:03:28.348 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:03:28.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.468+0000 7f90f47be700 1 -- 172.21.15.114:0/1839650030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90ec0ff8d0 msgr2=0x7f90ec0ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:28.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.468+0000 7f90f47be700 1 --2- 172.21.15.114:0/1839650030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90ec0ff8d0 0x7f90ec0ffd50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009990 tx=0x7f90e8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.468+0000 7f90f47be700 1 -- 172.21.15.114:0/1839650030 shutdown_connections 2023-10-18T14:03:28.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.468+0000 7f90f47be700 1 --2- 172.21.15.114:0/1839650030 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90ec100290 0x7f90ec10c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.468+0000 7f90f47be700 1 --2- 172.21.15.114:0/1839650030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec105710 0x7f90ec105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.468+0000 7f90f47be700 1 --2- 172.21.15.114:0/1839650030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90ec0ff8d0 0x7f90ec0ffd50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.468+0000 7f90f47be700 1 -- 172.21.15.114:0/1839650030 >> 172.21.15.114:0/1839650030 conn(0x7f90ec076400 msgr2=0x7f90ec076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:28.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.468+0000 7f90f47be700 1 -- 172.21.15.114:0/1839650030 shutdown_connections 2023-10-18T14:03:28.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.468+0000 7f90f47be700 1 -- 172.21.15.114:0/1839650030 wait complete. 2023-10-18T14:03:28.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f47be700 1 Processor -- start 2023-10-18T14:03:28.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f47be700 1 -- start start 2023-10-18T14:03:28.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f47be700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90ec0ff8d0 0x7f90ec101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:28.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f47be700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90ec100290 0x7f90ec101750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:28.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f47be700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec105710 0x7f90ec101c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:28.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f47be700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec1a4f30 con 0x7f90ec100290 2023-10-18T14:03:28.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f47be700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec1a50a0 con 0x7f90ec0ff8d0 2023-10-18T14:03:28.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f47be700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec1a5260 con 0x7f90ec105710 2023-10-18T14:03:28.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f1d59700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90ec100290 0x7f90ec101750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:28.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f1d59700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90ec100290 0x7f90ec101750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43188/0 (socket says 172.21.15.114:43188) 2023-10-18T14:03:28.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f1d59700 1 -- 172.21.15.114:0/478415885 learned_addr learned my addr 172.21.15.114:0/478415885 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:28.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f1d59700 1 -- 172.21.15.114:0/478415885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec105710 msgr2=0x7f90ec101c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:28.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f2d5b700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec105710 0x7f90ec101c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:28.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f1d59700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec105710 0x7f90ec101c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f1d59700 1 -- 172.21.15.114:0/478415885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90ec0ff8d0 msgr2=0x7f90ec101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:28.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f1d59700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90ec0ff8d0 0x7f90ec101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f1d59700 1 -- 172.21.15.114:0/478415885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e80095f0 con 0x7f90ec100290 2023-10-18T14:03:28.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f2d5b700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec105710 0x7f90ec101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:28.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.469+0000 7f90f1d59700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90ec100290 0x7f90ec101750 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f90e8000c00 tx=0x7f90e800f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:28.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.470+0000 7f90e37fe700 1 -- 172.21.15.114:0/478415885 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e801d070 con 0x7f90ec100290 2023-10-18T14:03:28.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.470+0000 7f90e37fe700 1 -- 172.21.15.114:0/478415885 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90e800fca0 con 0x7f90ec100290 2023-10-18T14:03:28.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.470+0000 7f90f47be700 1 -- 172.21.15.114:0/478415885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec1a54e0 con 0x7f90ec100290 2023-10-18T14:03:28.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.470+0000 7f90e37fe700 1 -- 172.21.15.114:0/478415885 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8017750 con 0x7f90ec100290 2023-10-18T14:03:28.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.470+0000 7f90f47be700 1 -- 172.21.15.114:0/478415885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec1a59e0 con 0x7f90ec100290 2023-10-18T14:03:28.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.471+0000 7f90f47be700 1 -- 172.21.15.114:0/478415885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec100cc0 con 0x7f90ec100290 2023-10-18T14:03:28.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.472+0000 7f90e37fe700 1 -- 172.21.15.114:0/478415885 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f90e8022470 con 0x7f90ec100290 2023-10-18T14:03:28.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.472+0000 7f90e37fe700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f90d80a15e0 0x7f90d80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:28.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.472+0000 7f90f255a700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f90d80a15e0 0x7f90d80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:28.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.472+0000 7f90e37fe700 1 -- 172.21.15.114:0/478415885 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f90e80ce360 con 0x7f90ec100290 2023-10-18T14:03:28.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.473+0000 7f90f255a700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f90d80a15e0 0x7f90d80a3aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00a990 tx=0x7f90dc005c80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:28.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.477+0000 7f90e37fe700 1 -- 172.21.15.114:0/478415885 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f90e8097850 con 0x7f90ec100290 2023-10-18T14:03:28.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.714+0000 7f90f47be700 1 -- 172.21.15.114:0/478415885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90ec067530 con 0x7f90ec100290 2023-10-18T14:03:28.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.714+0000 7f90e37fe700 1 -- 172.21.15.114:0/478415885 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11390 (secure 0 0 0) 0x7f90e809ae70 con 0x7f90ec100290 2023-10-18T14:03:28.718 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:28.719 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:02:39.260198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:03:28.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.716+0000 7f90f47be700 1 -- 172.21.15.114:0/478415885 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f90d80a15e0 msgr2=0x7f90d80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:28.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.716+0000 7f90f47be700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f90d80a15e0 0x7f90d80a3aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00a990 tx=0x7f90dc005c80 comp rx=0 tx=0).stop 2023-10-18T14:03:28.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.716+0000 7f90f47be700 1 -- 172.21.15.114:0/478415885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90ec100290 msgr2=0x7f90ec101750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:28.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.716+0000 7f90f47be700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90ec100290 0x7f90ec101750 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f90e8000c00 tx=0x7f90e800f7b0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.716+0000 7f90f47be700 1 -- 172.21.15.114:0/478415885 shutdown_connections 2023-10-18T14:03:28.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.716+0000 7f90f47be700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f90d80a15e0 0x7f90d80a3aa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.716+0000 7f90f47be700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec105710 0x7f90ec101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.716+0000 7f90f47be700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90ec0ff8d0 0x7f90ec101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.716+0000 7f90f47be700 1 --2- 172.21.15.114:0/478415885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90ec100290 0x7f90ec101750 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.716+0000 7f90f47be700 1 -- 172.21.15.114:0/478415885 >> 172.21.15.114:0/478415885 conn(0x7f90ec076400 msgr2=0x7f90ec067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:28.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.716+0000 7f90f47be700 1 -- 172.21.15.114:0/478415885 shutdown_connections 2023-10-18T14:03:28.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.716+0000 7f90f47be700 1 -- 172.21.15.114:0/478415885 wait complete. 2023-10-18T14:03:28.723 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2023-10-18T14:03:28.733 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:03:28.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.849+0000 7fe841b27700 1 -- 172.21.15.114:0/724437984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe83c0ffd10 msgr2=0x7fe83c100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:28.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.849+0000 7fe841b27700 1 --2- 172.21.15.114:0/724437984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe83c0ffd10 0x7fe83c100190 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe8300099c0 tx=0x7fe830009cd0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.849+0000 7fe841b27700 1 -- 172.21.15.114:0/724437984 shutdown_connections 2023-10-18T14:03:28.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.849+0000 7fe841b27700 1 --2- 172.21.15.114:0/724437984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe83c1006d0 0x7fe83c10c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.849+0000 7fe841b27700 1 --2- 172.21.15.114:0/724437984 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe83c105660 0x7fe83c105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.849+0000 7fe841b27700 1 --2- 172.21.15.114:0/724437984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe83c0ffd10 0x7fe83c100190 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.849+0000 7fe841b27700 1 -- 172.21.15.114:0/724437984 >> 172.21.15.114:0/724437984 conn(0x7fe83c075b90 msgr2=0x7fe83c0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:28.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.849+0000 7fe841b27700 1 -- 172.21.15.114:0/724437984 shutdown_connections 2023-10-18T14:03:28.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.849+0000 7fe841b27700 1 -- 172.21.15.114:0/724437984 wait complete. 2023-10-18T14:03:28.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.850+0000 7fe841b27700 1 Processor -- start 2023-10-18T14:03:28.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.850+0000 7fe841b27700 1 -- start start 2023-10-18T14:03:28.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.850+0000 7fe841b27700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe83c0ffd10 0x7fe83c101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:28.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.850+0000 7fe841b27700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe83c1006d0 0x7fe83c101750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.850+0000 7fe841b27700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe83c105660 0x7fe83c101cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.850+0000 7fe841b27700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c1a4ed0 con 0x7fe83c105660 2023-10-18T14:03:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.850+0000 7fe841b27700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c1a5040 con 0x7fe83c0ffd10 2023-10-18T14:03:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.850+0000 7fe841b27700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c1a5200 con 0x7fe83c1006d0 2023-10-18T14:03:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.850+0000 7fe83bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe83c105660 0x7fe83c101cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:28.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.850+0000 7fe83bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe83c105660 0x7fe83c101cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43204/0 (socket says 172.21.15.114:43204) 2023-10-18T14:03:28.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.850+0000 7fe83bfff700 1 -- 172.21.15.114:0/3719797773 learned_addr learned my addr 172.21.15.114:0/3719797773 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:28.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe83affd700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe83c1006d0 0x7fe83c101750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:28.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe83b7fe700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe83c0ffd10 0x7fe83c101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:28.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe83bfff700 1 -- 172.21.15.114:0/3719797773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe83c1006d0 msgr2=0x7fe83c101750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:28.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe83bfff700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe83c1006d0 0x7fe83c101750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe83bfff700 1 -- 172.21.15.114:0/3719797773 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe83c0ffd10 msgr2=0x7fe83c101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:28.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe83bfff700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe83c0ffd10 0x7fe83c101210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:28.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe83bfff700 1 -- 172.21.15.114:0/3719797773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8300095f0 con 0x7fe83c105660 2023-10-18T14:03:28.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe83b7fe700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe83c0ffd10 0x7fe83c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe83bfff700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe83c105660 0x7fe83c101cb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe834007ee0 tx=0x7fe83400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe838ff9700 1 -- 172.21.15.114:0/3719797773 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834017070 con 0x7fe83c105660 2023-10-18T14:03:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe838ff9700 1 -- 172.21.15.114:0/3719797773 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe83400f040 con 0x7fe83c105660 2023-10-18T14:03:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe838ff9700 1 -- 172.21.15.114:0/3719797773 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834005740 con 0x7fe83c105660 2023-10-18T14:03:28.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe841b27700 1 -- 172.21.15.114:0/3719797773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c1a54e0 con 0x7fe83c105660 2023-10-18T14:03:28.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.851+0000 7fe841b27700 1 -- 172.21.15.114:0/3719797773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83c1a5970 con 0x7fe83c105660 2023-10-18T14:03:28.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.852+0000 7fe841b27700 1 -- 172.21.15.114:0/3719797773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83c100d20 con 0x7fe83c105660 2023-10-18T14:03:28.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.853+0000 7fe838ff9700 1 -- 172.21.15.114:0/3719797773 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fe83400dc60 con 0x7fe83c105660 2023-10-18T14:03:28.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.854+0000 7fe838ff9700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe8240a1560 0x7fe8240a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:28.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.854+0000 7fe83b7fe700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe8240a1560 0x7fe8240a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:28.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.854+0000 7fe838ff9700 1 -- 172.21.15.114:0/3719797773 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe8340cce20 con 0x7fe83c105660 2023-10-18T14:03:28.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.854+0000 7fe83b7fe700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe8240a1560 0x7fe8240a3a20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe82c005fd0 tx=0x7fe82c005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:28.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:28.858+0000 7fe838ff9700 1 -- 172.21.15.114:0/3719797773 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe834096280 con 0x7fe83c105660 2023-10-18T14:03:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:28 smithi158 ceph-mon[103317]: pgmap v263: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:28 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2264158164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:29.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:28 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3421164520' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:29.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.049+0000 7fe841b27700 1 -- 172.21.15.114:0/3719797773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe83c066ca0 con 0x7fe83c105660 2023-10-18T14:03:29.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.050+0000 7fe838ff9700 1 -- 172.21.15.114:0/3719797773 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22907 (secure 0 0 0) 0x7fe8340998a0 con 0x7fe83c105660 2023-10-18T14:03:29.054 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:29.055 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":85,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:03:08.625359+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:03:29.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.052+0000 7fe841b27700 1 -- 172.21.15.114:0/3719797773 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe8240a1560 msgr2=0x7fe8240a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.052+0000 7fe841b27700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe8240a1560 0x7fe8240a3a20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe82c005fd0 tx=0x7fe82c005db0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.052+0000 7fe841b27700 1 -- 172.21.15.114:0/3719797773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe83c105660 msgr2=0x7fe83c101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.052+0000 7fe841b27700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe83c105660 0x7fe83c101cb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe834007ee0 tx=0x7fe83400d3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.052+0000 7fe841b27700 1 -- 172.21.15.114:0/3719797773 shutdown_connections 2023-10-18T14:03:29.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.052+0000 7fe841b27700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe8240a1560 0x7fe8240a3a20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.052+0000 7fe841b27700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe83c105660 0x7fe83c101cb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.052+0000 7fe841b27700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe83c0ffd10 0x7fe83c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.052+0000 7fe841b27700 1 --2- 172.21.15.114:0/3719797773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe83c1006d0 0x7fe83c101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.053+0000 7fe841b27700 1 -- 172.21.15.114:0/3719797773 >> 172.21.15.114:0/3719797773 conn(0x7fe83c075b90 msgr2=0x7fe83c0fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.053+0000 7fe841b27700 1 -- 172.21.15.114:0/3719797773 shutdown_connections 2023-10-18T14:03:29.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.053+0000 7fe841b27700 1 -- 172.21.15.114:0/3719797773 wait complete. 2023-10-18T14:03:29.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:28 smithi172 ceph-mon[103574]: pgmap v263: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:29.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:28 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2264158164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:29.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:28 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3421164520' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:29.067 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:28 smithi114 ceph-mon[99494]: pgmap v263: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:29.068 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:28 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2264158164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:29.068 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:28 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3421164520' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:29.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:03:29.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.186+0000 7fb461739700 1 -- 172.21.15.114:0/4284257632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45c0ff620 msgr2=0x7fb45c0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.186+0000 7fb461739700 1 --2- 172.21.15.114:0/4284257632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45c0ff620 0x7fb45c0ffaa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009990 tx=0x7fb44c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.186+0000 7fb461739700 1 -- 172.21.15.114:0/4284257632 shutdown_connections 2023-10-18T14:03:29.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.186+0000 7fb461739700 1 --2- 172.21.15.114:0/4284257632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb45c0fffe0 0x7fb45c10c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.186+0000 7fb461739700 1 --2- 172.21.15.114:0/4284257632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb45c1057d0 0x7fb45c105bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.186+0000 7fb461739700 1 --2- 172.21.15.114:0/4284257632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45c0ff620 0x7fb45c0ffaa0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.186+0000 7fb461739700 1 -- 172.21.15.114:0/4284257632 >> 172.21.15.114:0/4284257632 conn(0x7fb45c076820 msgr2=0x7fb45c076c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.186+0000 7fb461739700 1 -- 172.21.15.114:0/4284257632 shutdown_connections 2023-10-18T14:03:29.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.186+0000 7fb461739700 1 -- 172.21.15.114:0/4284257632 wait complete. 2023-10-18T14:03:29.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.187+0000 7fb461739700 1 Processor -- start 2023-10-18T14:03:29.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.187+0000 7fb461739700 1 -- start start 2023-10-18T14:03:29.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.187+0000 7fb461739700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45c0ff620 0x7fb45c196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.187+0000 7fb461739700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb45c0fffe0 0x7fb45c197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.187+0000 7fb461739700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb45c1057d0 0x7fb45c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.187+0000 7fb461739700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c19aac0 con 0x7fb45c0ff620 2023-10-18T14:03:29.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.187+0000 7fb461739700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c19ac30 con 0x7fb45c1057d0 2023-10-18T14:03:29.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.187+0000 7fb461739700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c19adf0 con 0x7fb45c0fffe0 2023-10-18T14:03:29.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.187+0000 7fb45affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45c0ff620 0x7fb45c196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.187+0000 7fb45affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45c0ff620 0x7fb45c196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43214/0 (socket says 172.21.15.114:43214) 2023-10-18T14:03:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.187+0000 7fb45affd700 1 -- 172.21.15.114:0/3651804572 learned_addr learned my addr 172.21.15.114:0/3651804572 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.187+0000 7fb45b7fe700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb45c1057d0 0x7fb45c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.187+0000 7fb45a7fc700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb45c0fffe0 0x7fb45c197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.188+0000 7fb45affd700 1 -- 172.21.15.114:0/3651804572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb45c0fffe0 msgr2=0x7fb45c197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.188+0000 7fb45affd700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb45c0fffe0 0x7fb45c197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.188+0000 7fb45affd700 1 -- 172.21.15.114:0/3651804572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb45c1057d0 msgr2=0x7fb45c19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.188+0000 7fb45affd700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb45c1057d0 0x7fb45c19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.188+0000 7fb45affd700 1 -- 172.21.15.114:0/3651804572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c0095f0 con 0x7fb45c0ff620 2023-10-18T14:03:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.188+0000 7fb45a7fc700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb45c0fffe0 0x7fb45c197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.188+0000 7fb45b7fe700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb45c1057d0 0x7fb45c19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:29.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.188+0000 7fb45affd700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45c0ff620 0x7fb45c196d30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb44400b530 tx=0x7fb44400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.188+0000 7fb453fff700 1 -- 172.21.15.114:0/3651804572 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444011830 con 0x7fb45c0ff620 2023-10-18T14:03:29.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.188+0000 7fb453fff700 1 -- 172.21.15.114:0/3651804572 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb444011e50 con 0x7fb45c0ff620 2023-10-18T14:03:29.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.188+0000 7fb461739700 1 -- 172.21.15.114:0/3651804572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c19b0d0 con 0x7fb45c0ff620 2023-10-18T14:03:29.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.188+0000 7fb453fff700 1 -- 172.21.15.114:0/3651804572 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44400f2e0 con 0x7fb45c0ff620 2023-10-18T14:03:29.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.188+0000 7fb461739700 1 -- 172.21.15.114:0/3651804572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c1a3a30 con 0x7fb45c0ff620 2023-10-18T14:03:29.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.189+0000 7fb461739700 1 -- 172.21.15.114:0/3651804572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45c100d10 con 0x7fb45c0ff620 2023-10-18T14:03:29.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.190+0000 7fb453fff700 1 -- 172.21.15.114:0/3651804572 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fb444010580 con 0x7fb45c0ff620 2023-10-18T14:03:29.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.190+0000 7fb453fff700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb4480a1560 0x7fb4480a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.190+0000 7fb45a7fc700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb4480a1560 0x7fb4480a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.190+0000 7fb453fff700 1 -- 172.21.15.114:0/3651804572 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb4440ccf20 con 0x7fb45c0ff620 2023-10-18T14:03:29.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.191+0000 7fb45a7fc700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb4480a1560 0x7fb4480a3a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00b5c0 tx=0x7fb44c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.194+0000 7fb453fff700 1 -- 172.21.15.114:0/3651804572 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb444096490 con 0x7fb45c0ff620 2023-10-18T14:03:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.431+0000 7fb461739700 1 -- 172.21.15.114:0/3651804572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb45c197ff0 con 0x7fb45c0ff620 2023-10-18T14:03:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.432+0000 7fb453fff700 1 -- 172.21.15.114:0/3651804572 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11390 (secure 0 0 0) 0x7fb444015090 con 0x7fb45c0ff620 2023-10-18T14:03:29.436 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:29.436 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:02:39.260198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:03:29.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.434+0000 7fb461739700 1 -- 172.21.15.114:0/3651804572 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb4480a1560 msgr2=0x7fb4480a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.434+0000 7fb461739700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb4480a1560 0x7fb4480a3a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00b5c0 tx=0x7fb44c005fb0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.434+0000 7fb461739700 1 -- 172.21.15.114:0/3651804572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45c0ff620 msgr2=0x7fb45c196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.434+0000 7fb461739700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45c0ff620 0x7fb45c196d30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb44400b530 tx=0x7fb44400b8f0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.434+0000 7fb461739700 1 -- 172.21.15.114:0/3651804572 shutdown_connections 2023-10-18T14:03:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.434+0000 7fb461739700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb4480a1560 0x7fb4480a3a20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.434+0000 7fb461739700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb45c1057d0 0x7fb45c19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.434+0000 7fb461739700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45c0ff620 0x7fb45c196d30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.434+0000 7fb461739700 1 --2- 172.21.15.114:0/3651804572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb45c0fffe0 0x7fb45c197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.434+0000 7fb461739700 1 -- 172.21.15.114:0/3651804572 >> 172.21.15.114:0/3651804572 conn(0x7fb45c076820 msgr2=0x7fb45c103970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.434+0000 7fb461739700 1 -- 172.21.15.114:0/3651804572 shutdown_connections 2023-10-18T14:03:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.434+0000 7fb461739700 1 -- 172.21.15.114:0/3651804572 wait complete. 2023-10-18T14:03:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2023-10-18T14:03:29.450 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-18T14:02:32.251953+0000', 'modified': '2023-10-18T14:02:39.260198+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24616, 'mds_1': 24595, 'mds_2': 24583, 'mds_3': 24566, 'mds_4': 14820}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14808': {'gid': 14808, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.114:6839/2312997594', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6838', 'nonce': 2312997594}, {'type': 'v1', 'addr': '172.21.15.114:6839', 'nonce': 2312997594}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14820': {'gid': 14820, 'name': 'a', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.114:6841/2423071224', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6840', 'nonce': 2423071224}, {'type': 'v1', 'addr': '172.21.15.114:6841', 'nonce': 2423071224}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24506': {'gid': 24506, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.158:6833/2306126907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6832', 'nonce': 2306126907}, {'type': 'v1', 'addr': '172.21.15.158:6833', 'nonce': 2306126907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24524': {'gid': 24524, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.158:6835/2562572095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6834', 'nonce': 2562572095}, {'type': 'v1', 'addr': '172.21.15.158:6835', 'nonce': 2562572095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24539': {'gid': 24539, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.158:6837/1076778559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6836', 'nonce': 1076778559}, {'type': 'v1', 'addr': '172.21.15.158:6837', 'nonce': 1076778559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24544': {'gid': 24544, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6833/3053339885', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 3053339885}, {'type': 'v1', 'addr': '172.21.15.172:6833', 'nonce': 3053339885}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24566': {'gid': 24566, 'name': 'b', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.158:6839/2616400572', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6838', 'nonce': 2616400572}, {'type': 'v1', 'addr': '172.21.15.158:6839', 'nonce': 2616400572}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24583': {'gid': 24583, 'name': 'f', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.172:6835/2655563129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 2655563129}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 2655563129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24595': {'gid': 24595, 'name': 'c', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.172:6837/1821444438', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 1821444438}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 1821444438}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24616': {'gid': 24616, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.172:6839/2447269366', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 2447269366}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 2447269366}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-18T14:03:29.451 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-18T14:03:29.451 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-18T14:03:29.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.570+0000 7f33346e6700 1 -- 172.21.15.114:0/698599952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f332c106700 msgr2=0x7f332c106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.570+0000 7f33346e6700 1 --2- 172.21.15.114:0/698599952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f332c106700 0x7f332c106ae0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f331c0099c0 tx=0x7f331c009cd0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.570+0000 7f33346e6700 1 -- 172.21.15.114:0/698599952 shutdown_connections 2023-10-18T14:03:29.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.570+0000 7f33346e6700 1 --2- 172.21.15.114:0/698599952 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f332c069330 0x7f332c10d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.570+0000 7f33346e6700 1 --2- 172.21.15.114:0/698599952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f332c106700 0x7f332c106ae0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.570+0000 7f33346e6700 1 --2- 172.21.15.114:0/698599952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f332c068970 0x7f332c068df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.570+0000 7f33346e6700 1 -- 172.21.15.114:0/698599952 >> 172.21.15.114:0/698599952 conn(0x7f332c076430 msgr2=0x7f332c076840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.570+0000 7f33346e6700 1 -- 172.21.15.114:0/698599952 shutdown_connections 2023-10-18T14:03:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.570+0000 7f33346e6700 1 -- 172.21.15.114:0/698599952 wait complete. 2023-10-18T14:03:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.570+0000 7f33346e6700 1 Processor -- start 2023-10-18T14:03:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.570+0000 7f33346e6700 1 -- start start 2023-10-18T14:03:29.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f33346e6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f332c068970 0x7f332c19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f33346e6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f332c069330 0x7f332c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f33346e6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f332c106700 0x7f332c1969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f33346e6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c1971c0 con 0x7f332c106700 2023-10-18T14:03:29.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f33346e6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c197330 con 0x7f332c068970 2023-10-18T14:03:29.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f33346e6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c1974f0 con 0x7f332c069330 2023-10-18T14:03:29.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f3332c83700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f332c106700 0x7f332c1969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f3332c83700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f332c106700 0x7f332c1969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43232/0 (socket says 172.21.15.114:43232) 2023-10-18T14:03:29.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f3332c83700 1 -- 172.21.15.114:0/510929822 learned_addr learned my addr 172.21.15.114:0/510929822 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f3332482700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f332c068970 0x7f332c19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f3331c81700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f332c069330 0x7f332c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f3332c83700 1 -- 172.21.15.114:0/510929822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f332c069330 msgr2=0x7f332c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f3332c83700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f332c069330 0x7f332c19ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f3332c83700 1 -- 172.21.15.114:0/510929822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f332c068970 msgr2=0x7f332c19c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f3332c83700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f332c068970 0x7f332c19c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f3332c83700 1 -- 172.21.15.114:0/510929822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c0095f0 con 0x7f332c106700 2023-10-18T14:03:29.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f3332c83700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f332c106700 0x7f332c1969f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f332400b970 tx=0x7f332400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f33237fe700 1 -- 172.21.15.114:0/510929822 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400c9b0 con 0x7f332c106700 2023-10-18T14:03:29.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f33346e6700 1 -- 172.21.15.114:0/510929822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c1977d0 con 0x7f332c106700 2023-10-18T14:03:29.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f33237fe700 1 -- 172.21.15.114:0/510929822 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3324014440 con 0x7f332c106700 2023-10-18T14:03:29.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.571+0000 7f33237fe700 1 -- 172.21.15.114:0/510929822 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33240075d0 con 0x7f332c106700 2023-10-18T14:03:29.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.572+0000 7f33346e6700 1 -- 172.21.15.114:0/510929822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c1a38d0 con 0x7f332c106700 2023-10-18T14:03:29.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.574+0000 7f33237fe700 1 -- 172.21.15.114:0/510929822 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f33240145b0 con 0x7f332c106700 2023-10-18T14:03:29.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.575+0000 7f33237fe700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f33180a1560 0x7f33180a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.575+0000 7f3332482700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f33180a1560 0x7f33180a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.575+0000 7f33237fe700 1 -- 172.21.15.114:0/510929822 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f3324006e40 con 0x7f332c106700 2023-10-18T14:03:29.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.575+0000 7f3332482700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f33180a1560 0x7f33180a3a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f331c009f50 tx=0x7f331c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.575+0000 7f33408cfb80 1 Processor -- start 2023-10-18T14:03:29.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f33408cfb80 1 -- start start 2023-10-18T14:03:29.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f33408cfb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 0x558ab2b72f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f33408cfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 0x558ab2b6d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f33408cfb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b6da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f33408cfb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ab2ae0690 con 0x558ab2b6d580 2023-10-18T14:03:29.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f33408cfb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ab2ac6c10 con 0x558ab2b72b90 2023-10-18T14:03:29.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f33408cfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ab2ac4530 con 0x558ab2b734b0 2023-10-18T14:03:29.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f3332c83700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b6da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f3332c83700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b6da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43240/0 (socket says 172.21.15.114:43240) 2023-10-18T14:03:29.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f3332c83700 1 -- 172.21.15.114:0/1676140975 learned_addr learned my addr 172.21.15.114:0/1676140975 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f3332482700 1 --2- 172.21.15.114:0/1676140975 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 0x558ab2b72f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f3332c83700 1 -- 172.21.15.114:0/1676140975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 msgr2=0x558ab2b6d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f3332c83700 1 --2- 172.21.15.114:0/1676140975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 0x558ab2b6d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f3332c83700 1 -- 172.21.15.114:0/1676140975 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 msgr2=0x558ab2b72f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f3332c83700 1 --2- 172.21.15.114:0/1676140975 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 0x558ab2b72f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f3332c83700 1 -- 172.21.15.114:0/1676140975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ab2a7d3a0 con 0x558ab2b6d580 2023-10-18T14:03:29.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f3332482700 1 --2- 172.21.15.114:0/1676140975 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 0x558ab2b72f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:29.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f3332c83700 1 --2- 172.21.15.114:0/1676140975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b6da00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f33240a16b0 tx=0x7f33240994a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73dd319bae55af3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.576+0000 7f3320ff9700 1 -- 172.21.15.114:0/1676140975 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332409d9a0 con 0x558ab2b6d580 2023-10-18T14:03:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.577+0000 7f3320ff9700 1 -- 172.21.15.114:0/1676140975 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33240a1be0 con 0x558ab2b6d580 2023-10-18T14:03:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.577+0000 7f3320ff9700 1 -- 172.21.15.114:0/1676140975 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33240840b0 con 0x558ab2b6d580 2023-10-18T14:03:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.577+0000 7f33408cfb80 1 -- 172.21.15.114:0/1676140975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 msgr2=0x558ab2b6da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.577+0000 7f33408cfb80 1 --2- 172.21.15.114:0/1676140975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b6da00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f33240a16b0 tx=0x7f33240994a0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.577+0000 7f33408cfb80 1 -- 172.21.15.114:0/1676140975 shutdown_connections 2023-10-18T14:03:29.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.577+0000 7f33408cfb80 1 --2- 172.21.15.114:0/1676140975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b6da00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.577+0000 7f33408cfb80 1 --2- 172.21.15.114:0/1676140975 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 0x558ab2b72f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.577+0000 7f33408cfb80 1 --2- 172.21.15.114:0/1676140975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 0x558ab2b6d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.577+0000 7f33408cfb80 1 -- 172.21.15.114:0/1676140975 >> 172.21.15.114:0/1676140975 conn(0x558ab2ae16d0 msgr2=0x558ab2b67b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.577+0000 7f33408cfb80 1 -- 172.21.15.114:0/1676140975 shutdown_connections 2023-10-18T14:03:29.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.577+0000 7f33408cfb80 1 -- 172.21.15.114:0/1676140975 wait complete. 2023-10-18T14:03:29.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f33408cfb80 1 -- start start 2023-10-18T14:03:29.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f33408cfb80 1 Processor -- start 2023-10-18T14:03:29.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f33408cfb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b76830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f33408cfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b72b90 0x558ab2b76d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f33408cfb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b734b0 0x558ab2b772b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f33408cfb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ab2abfe20 con 0x558ab2b6d580 2023-10-18T14:03:29.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f33408cfb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ab2a5c6c0 con 0x558ab2b734b0 2023-10-18T14:03:29.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f33408cfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ab2a5c360 con 0x558ab2b72b90 2023-10-18T14:03:29.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f33408cfb80 10 client.0 _ll_register_callbacks cb 0x558ab29a6a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:29.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3332482700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b76830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3332482700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b76830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43242/0 (socket says 172.21.15.114:43242) 2023-10-18T14:03:29.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3332482700 1 -- 172.21.15.114:0/2464266678 learned_addr learned my addr 172.21.15.114:0/2464266678 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3332c83700 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b734b0 0x558ab2b772b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3331c81700 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b72b90 0x558ab2b76d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3332482700 1 -- 172.21.15.114:0/2464266678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b72b90 msgr2=0x558ab2b76d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3332482700 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b72b90 0x558ab2b76d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3332482700 1 -- 172.21.15.114:0/2464266678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b734b0 msgr2=0x558ab2b772b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3332482700 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b734b0 0x558ab2b772b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3332482700 1 -- 172.21.15.114:0/2464266678 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c1a38d0 con 0x558ab2b6d580 2023-10-18T14:03:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3331c81700 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b72b90 0x558ab2b76d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3332c83700 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b734b0 0x558ab2b772b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3332482700 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b76830 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f331c0099c0 tx=0x7f331c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f546c0fe1ee16 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.578+0000 7f3315ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f3315ffb700 1 -- 172.21.15.114:0/2464266678 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c004a10 con 0x558ab2b6d580 2023-10-18T14:03:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f3315ffb700 1 -- 172.21.15.114:0/2464266678 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f331c004b70 con 0x558ab2b6d580 2023-10-18T14:03:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f33408cfb80 1 -- 172.21.15.114:0/2464266678 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ab2ac4ea0 con 0x558ab2b6d580 2023-10-18T14:03:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f3315ffb700 1 -- 172.21.15.114:0/2464266678 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f331c004d30 con 0x558ab2b6d580 2023-10-18T14:03:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f33408cfb80 10 client.15237 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f33408cfb80 1 -- 172.21.15.114:0/2464266678 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558ab28ead90 con 0x558ab2b6d580 2023-10-18T14:03:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f3315ffb700 1 -- 172.21.15.114:0/2464266678 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f331c03d020 con 0x558ab2b6d580 2023-10-18T14:03:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f3315ffb700 1 -- 172.21.15.114:0/2464266678 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f331c02f440 con 0x558ab2b6d580 2023-10-18T14:03:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f33408cfb80 10 client.15237 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f33408cfb80 10 client.15237 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-18T14:03:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f33408cfb80 20 client.15237 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f33408cfb80 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x558ab2b86f20 0x558ab2b85970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f33408cfb80 4 client.15237 mds_command: new command op to 14820 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:03:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f33408cfb80 1 -- 172.21.15.114:0/2464266678 --> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ab2b3c860 con 0x558ab2b86f20 2023-10-18T14:03:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.579+0000 7f3331c81700 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x558ab2b86f20 0x558ab2b85970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f3331c81700 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x558ab2b86f20 0x558ab2b85970 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c314369bbbccb40a server_cookie=ac326d451480a2c4 in_seq=0 out_seq=0 2023-10-18T14:03:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f3315ffb700 10 client.15237 ms_handle_connect on v2:172.21.15.114:6840/2423071224 2023-10-18T14:03:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f3315ffb700 1 -- 172.21.15.114:0/2464266678 <== mds.4 v2:172.21.15.114:6840/2423071224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558ab2b3c860 con 0x558ab2b86f20 2023-10-18T14:03:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f3315ffb700 10 client.15237 handle_command_reply: tid=0 2023-10-18T14:03:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f33408cfb80 1 client.15237 shutdown 2023-10-18T14:03:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f33408cfb80 1 -- 172.21.15.114:0/2464266678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 msgr2=0x558ab2b76830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f33408cfb80 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b76830 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f331c0099c0 tx=0x7f331c009cd0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f33408cfb80 1 -- 172.21.15.114:0/2464266678 shutdown_connections 2023-10-18T14:03:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f33408cfb80 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x558ab2b86f20 0x558ab2b85970 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f33408cfb80 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b734b0 0x558ab2b772b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f33408cfb80 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b76830 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f3315ffb700 0 client.15237 ms_handle_reset on v2:172.21.15.114:6840/2423071224 2023-10-18T14:03:29.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f33408cfb80 1 --2- 172.21.15.114:0/2464266678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b72b90 0x558ab2b76d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f33408cfb80 1 -- 172.21.15.114:0/2464266678 >> 172.21.15.114:0/2464266678 conn(0x558ab2ae16d0 msgr2=0x558ab2b6c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f33408cfb80 1 -- 172.21.15.114:0/2464266678 shutdown_connections 2023-10-18T14:03:29.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.580+0000 7f33408cfb80 1 -- 172.21.15.114:0/2464266678 wait complete. 2023-10-18T14:03:29.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.581+0000 7f33408cfb80 20 client.15237 trim_cache size 0 max 16384 2023-10-18T14:03:29.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.598+0000 7f33408cfb80 1 Processor -- start 2023-10-18T14:03:29.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.598+0000 7f33408cfb80 1 -- start start 2023-10-18T14:03:29.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.598+0000 7f33408cfb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b8f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.598+0000 7f33408cfb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 0x558ab2b770d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.598+0000 7f33408cfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 0x558ab2b85970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.598+0000 7f33408cfb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ab29408d0 con 0x558ab2b6d580 2023-10-18T14:03:29.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.598+0000 7f33408cfb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ab2b77c90 con 0x558ab2b72b90 2023-10-18T14:03:29.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.598+0000 7f33408cfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ab2b83a20 con 0x558ab2b734b0 2023-10-18T14:03:29.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f3332482700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b8f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f3332482700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b8f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43250/0 (socket says 172.21.15.114:43250) 2023-10-18T14:03:29.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f3332482700 1 -- 172.21.15.114:0/1392902952 learned_addr learned my addr 172.21.15.114:0/1392902952 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f3332c83700 1 --2- 172.21.15.114:0/1392902952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 0x558ab2b85970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f3331c81700 1 --2- 172.21.15.114:0/1392902952 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 0x558ab2b770d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f3332482700 1 -- 172.21.15.114:0/1392902952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 msgr2=0x558ab2b85970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f3332482700 1 --2- 172.21.15.114:0/1392902952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 0x558ab2b85970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f3332482700 1 -- 172.21.15.114:0/1392902952 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 msgr2=0x558ab2b770d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f3332482700 1 --2- 172.21.15.114:0/1392902952 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 0x558ab2b770d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f3332482700 1 -- 172.21.15.114:0/1392902952 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ab28d3c10 con 0x558ab2b6d580 2023-10-18T14:03:29.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f3332c83700 1 --2- 172.21.15.114:0/1392902952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 0x558ab2b85970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:29.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f3332482700 1 --2- 172.21.15.114:0/1392902952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b8f890 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f331c000c00 tx=0x7f331c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3abc47395314d7f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f33217fa700 1 -- 172.21.15.114:0/1392902952 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c0059a0 con 0x558ab2b6d580 2023-10-18T14:03:29.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f33217fa700 1 -- 172.21.15.114:0/1392902952 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f331c03d070 con 0x558ab2b6d580 2023-10-18T14:03:29.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.599+0000 7f33217fa700 1 -- 172.21.15.114:0/1392902952 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c00f6c0 con 0x558ab2b6d580 2023-10-18T14:03:29.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 -- 172.21.15.114:0/1392902952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 msgr2=0x558ab2b8f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 --2- 172.21.15.114:0/1392902952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b8f890 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f331c000c00 tx=0x7f331c005e80 comp rx=0 tx=0).stop 2023-10-18T14:03:29.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 -- 172.21.15.114:0/1392902952 shutdown_connections 2023-10-18T14:03:29.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 --2- 172.21.15.114:0/1392902952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 0x558ab2b85970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 --2- 172.21.15.114:0/1392902952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b8f890 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 --2- 172.21.15.114:0/1392902952 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 0x558ab2b770d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 -- 172.21.15.114:0/1392902952 >> 172.21.15.114:0/1392902952 conn(0x558ab2ae16d0 msgr2=0x558ab2b75100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 -- 172.21.15.114:0/1392902952 shutdown_connections 2023-10-18T14:03:29.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 -- 172.21.15.114:0/1392902952 wait complete. 2023-10-18T14:03:29.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 -- start start 2023-10-18T14:03:29.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 Processor -- start 2023-10-18T14:03:29.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b72010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 0x558ab2b81e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 0x558ab2b823b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ab2b726f0 con 0x558ab2b6d580 2023-10-18T14:03:29.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ab2b828f0 con 0x558ab2b72b90 2023-10-18T14:03:29.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ab2b82ab0 con 0x558ab2b734b0 2023-10-18T14:03:29.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f33408cfb80 10 client.0 _ll_register_callbacks cb 0x558ab29a6a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:29.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f3332482700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b72010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f3332482700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b72010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43256/0 (socket says 172.21.15.114:43256) 2023-10-18T14:03:29.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.600+0000 7f3332482700 1 -- 172.21.15.114:0/3265709229 learned_addr learned my addr 172.21.15.114:0/3265709229 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3332c83700 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 0x558ab2b823b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3331c81700 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 0x558ab2b81e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3332482700 1 -- 172.21.15.114:0/3265709229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 msgr2=0x558ab2b823b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3332482700 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 0x558ab2b823b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3332482700 1 -- 172.21.15.114:0/3265709229 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 msgr2=0x558ab2b81e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3332482700 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 0x558ab2b81e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3332482700 1 -- 172.21.15.114:0/3265709229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ab28ead90 con 0x558ab2b6d580 2023-10-18T14:03:29.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3332c83700 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 0x558ab2b823b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:29.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3332482700 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b72010 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f331c02fb50 tx=0x7f331c02fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aac03f43bc0a5c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3315ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:29.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3315ffb700 1 -- 172.21.15.114:0/3265709229 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c004a10 con 0x558ab2b6d580 2023-10-18T14:03:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f33408cfb80 1 -- 172.21.15.114:0/3265709229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33240a1be0 con 0x558ab2b6d580 2023-10-18T14:03:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3315ffb700 1 -- 172.21.15.114:0/3265709229 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f331c03e080 con 0x558ab2b6d580 2023-10-18T14:03:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3315ffb700 1 -- 172.21.15.114:0/3265709229 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f331c004b70 con 0x558ab2b6d580 2023-10-18T14:03:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f33408cfb80 10 client.15243 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:29.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f33408cfb80 1 -- 172.21.15.114:0/3265709229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558ab2911200 con 0x558ab2b6d580 2023-10-18T14:03:29.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3315ffb700 1 -- 172.21.15.114:0/3265709229 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33240a1be0 con 0x558ab2b6d580 2023-10-18T14:03:29.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f3315ffb700 1 -- 172.21.15.114:0/3265709229 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f331c00f460 con 0x558ab2b6d580 2023-10-18T14:03:29.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f33408cfb80 10 client.15243 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:29.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f33408cfb80 10 client.15243 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-18T14:03:29.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f33408cfb80 20 client.15243 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:29.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f33408cfb80 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x558ab2bdf180 0x558ab2bdb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.601+0000 7f33408cfb80 4 client.15243 mds_command: new command op to 14820 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T14:03:29.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f33408cfb80 1 -- 172.21.15.114:0/3265709229 --> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558ab2ab8e00 con 0x558ab2bdf180 2023-10-18T14:03:29.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f3331c81700 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x558ab2bdf180 0x558ab2bdb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f3315ffb700 10 client.15243 ms_handle_connect on v2:172.21.15.114:6840/2423071224 2023-10-18T14:03:29.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f3331c81700 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x558ab2bdf180 0x558ab2bdb710 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f8bb598fc53705 server_cookie=19779978101b2076 in_seq=0 out_seq=0 2023-10-18T14:03:29.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f3315ffb700 1 -- 172.21.15.114:0/3265709229 <== mds.4 v2:172.21.15.114:6840/2423071224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x558ab2ab8e00 con 0x558ab2bdf180 2023-10-18T14:03:29.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f3315ffb700 10 client.15243 handle_command_reply: tid=0 2023-10-18T14:03:29.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f33408cfb80 1 client.15243 shutdown 2023-10-18T14:03:29.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f33408cfb80 1 -- 172.21.15.114:0/3265709229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 msgr2=0x558ab2b72010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f33408cfb80 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b72010 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f331c02fb50 tx=0x7f331c02fc80 comp rx=0 tx=0).stop 2023-10-18T14:03:29.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f33408cfb80 1 -- 172.21.15.114:0/3265709229 shutdown_connections 2023-10-18T14:03:29.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f33408cfb80 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x558ab2bdf180 0x558ab2bdb710 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f33408cfb80 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ab2b734b0 0x558ab2b823b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f3315ffb700 0 client.15243 ms_handle_reset on v2:172.21.15.114:6840/2423071224 2023-10-18T14:03:29.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f33408cfb80 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ab2b6d580 0x558ab2b72010 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f33408cfb80 1 --2- 172.21.15.114:0/3265709229 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558ab2b72b90 0x558ab2b81e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f33408cfb80 1 -- 172.21.15.114:0/3265709229 >> 172.21.15.114:0/3265709229 conn(0x558ab2ae16d0 msgr2=0x558ab2b85970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f33408cfb80 1 -- 172.21.15.114:0/3265709229 shutdown_connections 2023-10-18T14:03:29.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f33408cfb80 1 -- 172.21.15.114:0/3265709229 wait complete. 2023-10-18T14:03:29.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.602+0000 7f33408cfb80 20 client.15243 trim_cache size 0 max 16384 2023-10-18T14:03:29.628 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:03:29.628 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T14:03:29.628 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 4, 2023-10-18T14:03:29.628 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 14820, 2023-10-18T14:03:29.629 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-10-18T14:03:29.629 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-10-18T14:03:29.629 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-10-18T14:03:29.629 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 51.347008731999999, 2023-10-18T14:03:29.629 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 26, 2023-10-18T14:03:29.630 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 85, 2023-10-18T14:03:29.630 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 83, 2023-10-18T14:03:29.630 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 64.206074049999998 2023-10-18T14:03:29.630 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:03:29.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.603+0000 7f33346e6700 1 -- 172.21.15.114:0/510929822 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f33180a1560 msgr2=0x7f33180a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.603+0000 7f33346e6700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f33180a1560 0x7f33180a3a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f331c009f50 tx=0x7f331c005fb0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.603+0000 7f33346e6700 1 -- 172.21.15.114:0/510929822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f332c106700 msgr2=0x7f332c1969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.603+0000 7f33346e6700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f332c106700 0x7f332c1969f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f332400b970 tx=0x7f332400bd30 comp rx=0 tx=0).stop 2023-10-18T14:03:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.603+0000 7f33346e6700 1 -- 172.21.15.114:0/510929822 shutdown_connections 2023-10-18T14:03:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.603+0000 7f33346e6700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f33180a1560 0x7f33180a3a20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.603+0000 7f33346e6700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f332c106700 0x7f332c1969f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.603+0000 7f33346e6700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f332c068970 0x7f332c19c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.603+0000 7f33346e6700 1 --2- 172.21.15.114:0/510929822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f332c069330 0x7f332c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.603+0000 7f33346e6700 1 -- 172.21.15.114:0/510929822 >> 172.21.15.114:0/510929822 conn(0x7f332c076430 msgr2=0x7f332c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.603+0000 7f33346e6700 1 -- 172.21.15.114:0/510929822 shutdown_connections 2023-10-18T14:03:29.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.603+0000 7f33346e6700 1 -- 172.21.15.114:0/510929822 wait complete. 2023-10-18T14:03:29.634 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-18T14:03:29.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.758+0000 7f7213626700 1 -- 172.21.15.114:0/4054473650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f720c0ff8b0 msgr2=0x7f720c0ffd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.758+0000 7f7213626700 1 --2- 172.21.15.114:0/4054473650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f720c0ff8b0 0x7f720c0ffd30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7208009990 tx=0x7f7208009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.758+0000 7f7213626700 1 -- 172.21.15.114:0/4054473650 shutdown_connections 2023-10-18T14:03:29.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.758+0000 7f7213626700 1 --2- 172.21.15.114:0/4054473650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f720c100270 0x7f720c10c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.758+0000 7f7213626700 1 --2- 172.21.15.114:0/4054473650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f720c105690 0x7f720c105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.758+0000 7f7213626700 1 --2- 172.21.15.114:0/4054473650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f720c0ff8b0 0x7f720c0ffd30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.758+0000 7f7213626700 1 -- 172.21.15.114:0/4054473650 >> 172.21.15.114:0/4054473650 conn(0x7f720c076430 msgr2=0x7f720c076840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.758+0000 7f7213626700 1 -- 172.21.15.114:0/4054473650 shutdown_connections 2023-10-18T14:03:29.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.758+0000 7f7213626700 1 -- 172.21.15.114:0/4054473650 wait complete. 2023-10-18T14:03:29.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7213626700 1 Processor -- start 2023-10-18T14:03:29.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7213626700 1 -- start start 2023-10-18T14:03:29.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7213626700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f720c0ff8b0 0x7f720c197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7213626700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f720c100270 0x7f720c197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7213626700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f720c105690 0x7f720c1a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7213626700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c198730 con 0x7f720c100270 2023-10-18T14:03:29.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7213626700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c1a2f40 con 0x7f720c105690 2023-10-18T14:03:29.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7213626700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c1a3080 con 0x7f720c0ff8b0 2023-10-18T14:03:29.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7210bc1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f720c100270 0x7f720c197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7210bc1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f720c100270 0x7f720c197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43272/0 (socket says 172.21.15.114:43272) 2023-10-18T14:03:29.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7210bc1700 1 -- 172.21.15.114:0/3328250112 learned_addr learned my addr 172.21.15.114:0/3328250112 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f72113c2700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f720c0ff8b0 0x7f720c197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7211bc3700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f720c105690 0x7f720c1a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7210bc1700 1 -- 172.21.15.114:0/3328250112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f720c0ff8b0 msgr2=0x7f720c197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7210bc1700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f720c0ff8b0 0x7f720c197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7210bc1700 1 -- 172.21.15.114:0/3328250112 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f720c105690 msgr2=0x7f720c1a2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7210bc1700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f720c105690 0x7f720c1a2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7210bc1700 1 -- 172.21.15.114:0/3328250112 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72080095f0 con 0x7f720c100270 2023-10-18T14:03:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7211bc3700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f720c105690 0x7f720c1a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.759+0000 7f7210bc1700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f720c100270 0x7f720c197ec0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7208000c00 tx=0x7f720800f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.760+0000 7f72027fc700 1 -- 172.21.15.114:0/3328250112 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720801d070 con 0x7f720c100270 2023-10-18T14:03:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.760+0000 7f7213626700 1 -- 172.21.15.114:0/3328250112 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720c1a32b0 con 0x7f720c100270 2023-10-18T14:03:29.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.760+0000 7f72027fc700 1 -- 172.21.15.114:0/3328250112 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f720800fd30 con 0x7f720c100270 2023-10-18T14:03:29.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.760+0000 7f72027fc700 1 -- 172.21.15.114:0/3328250112 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7208017630 con 0x7f720c100270 2023-10-18T14:03:29.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.760+0000 7f7213626700 1 -- 172.21.15.114:0/3328250112 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720c195950 con 0x7f720c100270 2023-10-18T14:03:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.762+0000 7f72027fc700 1 -- 172.21.15.114:0/3328250112 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f72080177b0 con 0x7f720c100270 2023-10-18T14:03:29.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.762+0000 7f72027fc700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f71f80a5970 0x7f71f80a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.762+0000 7f72113c2700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f71f80a5970 0x7f71f80a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.762+0000 7f72027fc700 1 -- 172.21.15.114:0/3328250112 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f72080ce360 con 0x7f720c100270 2023-10-18T14:03:29.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.762+0000 7f72113c2700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f71f80a5970 0x7f71f80a7e30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00abd0 tx=0x7f71fc00a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.763+0000 7f721f80fb80 1 Processor -- start 2023-10-18T14:03:29.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.763+0000 7f721f80fb80 1 -- start start 2023-10-18T14:03:29.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.763+0000 7f721f80fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbdff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.763+0000 7f721f80fb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbda040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.763+0000 7f721f80fb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbda580 0x55b7ccbdaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.763+0000 7f721f80fb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ccb4d690 con 0x55b7ccbe04b0 2023-10-18T14:03:29.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.763+0000 7f721f80fb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ccb33c10 con 0x55b7ccbda580 2023-10-18T14:03:29.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.763+0000 7f721f80fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ccb31530 con 0x55b7ccbdfb90 2023-10-18T14:03:29.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.763+0000 7f7210bc1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbda040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.763+0000 7f7210bc1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbda040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43280/0 (socket says 172.21.15.114:43280) 2023-10-18T14:03:29.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.763+0000 7f7210bc1700 1 -- 172.21.15.114:0/2904360217 learned_addr learned my addr 172.21.15.114:0/2904360217 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.764+0000 7f72113c2700 1 --2- 172.21.15.114:0/2904360217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbdff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.764+0000 7f7211bc3700 1 --2- 172.21.15.114:0/2904360217 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbda580 0x55b7ccbdaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.764+0000 7f7210bc1700 1 -- 172.21.15.114:0/2904360217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbdfb90 msgr2=0x55b7ccbdff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.764+0000 7f7210bc1700 1 --2- 172.21.15.114:0/2904360217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbdff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.764+0000 7f7210bc1700 1 -- 172.21.15.114:0/2904360217 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbda580 msgr2=0x55b7ccbdaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.764+0000 7f7210bc1700 1 --2- 172.21.15.114:0/2904360217 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbda580 0x55b7ccbdaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.764+0000 7f7210bc1700 1 -- 172.21.15.114:0/2904360217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7ccaea3a0 con 0x55b7ccbe04b0 2023-10-18T14:03:29.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.764+0000 7f72113c2700 1 --2- 172.21.15.114:0/2904360217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbdff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:29.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.764+0000 7f7210bc1700 1 --2- 172.21.15.114:0/2904360217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbda040 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f72080a32e0 tx=0x7f720809b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de2abe2817cf40e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.764+0000 7f71f77fe700 1 -- 172.21.15.114:0/2904360217 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720809f660 con 0x55b7ccbe04b0 2023-10-18T14:03:29.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.764+0000 7f71f77fe700 1 -- 172.21.15.114:0/2904360217 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72080a3810 con 0x55b7ccbe04b0 2023-10-18T14:03:29.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.764+0000 7f71f77fe700 1 -- 172.21.15.114:0/2904360217 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72080a35e0 con 0x55b7ccbe04b0 2023-10-18T14:03:29.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.765+0000 7f721f80fb80 1 -- 172.21.15.114:0/2904360217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbe04b0 msgr2=0x55b7ccbda040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.765+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2904360217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbda040 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f72080a32e0 tx=0x7f720809b410 comp rx=0 tx=0).stop 2023-10-18T14:03:29.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.765+0000 7f721f80fb80 1 -- 172.21.15.114:0/2904360217 shutdown_connections 2023-10-18T14:03:29.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.765+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2904360217 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbda580 0x55b7ccbdaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.765+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2904360217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbdff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.765+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2904360217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbda040 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.765+0000 7f721f80fb80 1 -- 172.21.15.114:0/2904360217 >> 172.21.15.114:0/2904360217 conn(0x55b7ccb4e6d0 msgr2=0x55b7ccbd4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.765+0000 7f721f80fb80 1 -- 172.21.15.114:0/2904360217 shutdown_connections 2023-10-18T14:03:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.765+0000 7f721f80fb80 1 -- 172.21.15.114:0/2904360217 wait complete. 2023-10-18T14:03:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.765+0000 7f721f80fb80 1 -- start start 2023-10-18T14:03:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.765+0000 7f721f80fb80 1 Processor -- start 2023-10-18T14:03:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f721f80fb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 0x55b7ccbe63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f721f80fb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbe36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f721f80fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbe3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f721f80fb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ccb2ce20 con 0x55b7ccbda580 2023-10-18T14:03:29.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f721f80fb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ccac96c0 con 0x55b7ccbdfb90 2023-10-18T14:03:29.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f721f80fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ccac9360 con 0x55b7ccbe04b0 2023-10-18T14:03:29.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f721f80fb80 10 client.0 _ll_register_callbacks cb 0x55b7cca13a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:29.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f72113c2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 0x55b7ccbe63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f72113c2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 0x55b7ccbe63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43284/0 (socket says 172.21.15.114:43284) 2023-10-18T14:03:29.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f72113c2700 1 -- 172.21.15.114:0/3203785861 learned_addr learned my addr 172.21.15.114:0/3203785861 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f7210bc1700 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbe36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f7211bc3700 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbe3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f72113c2700 1 -- 172.21.15.114:0/3203785861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 msgr2=0x55b7ccbe3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f72113c2700 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbe3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f72113c2700 1 -- 172.21.15.114:0/3203785861 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbdfb90 msgr2=0x55b7ccbe36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f72113c2700 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbe36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f72113c2700 1 -- 172.21.15.114:0/3203785861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720c195950 con 0x55b7ccbda580 2023-10-18T14:03:29.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f7211bc3700 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbe3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:29.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f72113c2700 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 0x55b7ccbe63b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00ff60 tx=0x7f71fc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8487502c0d260434 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f71f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:29.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f71f4ff9700 1 -- 172.21.15.114:0/3203785861 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc027670 con 0x55b7ccbda580 2023-10-18T14:03:29.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f721f80fb80 1 -- 172.21.15.114:0/3203785861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7ccb31ea0 con 0x55b7ccbda580 2023-10-18T14:03:29.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f71f4ff9700 1 -- 172.21.15.114:0/3203785861 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f71fc010430 con 0x55b7ccbda580 2023-10-18T14:03:29.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f71f4ff9700 1 -- 172.21.15.114:0/3203785861 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71fc0277d0 con 0x55b7ccbda580 2023-10-18T14:03:29.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f721f80fb80 10 client.15255 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:29.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.766+0000 7f721f80fb80 1 -- 172.21.15.114:0/3203785861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b7cc957d90 con 0x55b7ccbda580 2023-10-18T14:03:29.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.767+0000 7f71f4ff9700 1 -- 172.21.15.114:0/3203785861 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b7ccb31ea0 con 0x55b7ccbda580 2023-10-18T14:03:29.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.767+0000 7f71f4ff9700 1 -- 172.21.15.114:0/3203785861 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f71fc010c50 con 0x55b7ccbda580 2023-10-18T14:03:29.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.767+0000 7f721f80fb80 10 client.15255 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:29.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.767+0000 7f721f80fb80 10 client.15255 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-18T14:03:29.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.767+0000 7f721f80fb80 20 client.15255 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:29.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.767+0000 7f721f80fb80 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b7ccbf3b30 0x55b7ccbf2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.767+0000 7f721f80fb80 4 client.15255 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:03:29.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.767+0000 7f721f80fb80 1 -- 172.21.15.114:0/3203785861 --> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7ccba9860 con 0x55b7ccbf3b30 2023-10-18T14:03:29.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.767+0000 7f7210bc1700 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b7ccbf3b30 0x55b7ccbf2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.768+0000 7f71f4ff9700 10 client.15255 ms_handle_connect on v2:172.21.15.158:6838/2616400572 2023-10-18T14:03:29.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.768+0000 7f7210bc1700 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b7ccbf3b30 0x55b7ccbf2680 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aded566939d574f2 server_cookie=dad52847553dac20 in_seq=0 out_seq=0 2023-10-18T14:03:29.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.768+0000 7f71f4ff9700 1 -- 172.21.15.114:0/3203785861 <== mds.3 v2:172.21.15.158:6838/2616400572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b7ccba9860 con 0x55b7ccbf3b30 2023-10-18T14:03:29.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.768+0000 7f71f4ff9700 10 client.15255 handle_command_reply: tid=0 2023-10-18T14:03:29.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.768+0000 7f721f80fb80 1 client.15255 shutdown 2023-10-18T14:03:29.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.769+0000 7f721f80fb80 1 -- 172.21.15.114:0/3203785861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 msgr2=0x55b7ccbe63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.769+0000 7f721f80fb80 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 0x55b7ccbe63b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00ff60 tx=0x7f71fc0047c0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.769+0000 7f721f80fb80 1 -- 172.21.15.114:0/3203785861 shutdown_connections 2023-10-18T14:03:29.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.769+0000 7f721f80fb80 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b7ccbf3b30 0x55b7ccbf2680 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.769+0000 7f721f80fb80 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbe3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.769+0000 7f71f4ff9700 0 client.15255 ms_handle_reset on v2:172.21.15.158:6838/2616400572 2023-10-18T14:03:29.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.769+0000 7f721f80fb80 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 0x55b7ccbe63b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.769+0000 7f721f80fb80 1 --2- 172.21.15.114:0/3203785861 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbe36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.769+0000 7f721f80fb80 1 -- 172.21.15.114:0/3203785861 >> 172.21.15.114:0/3203785861 conn(0x55b7ccb4e6d0 msgr2=0x55b7ccbd9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.769+0000 7f721f80fb80 1 -- 172.21.15.114:0/3203785861 shutdown_connections 2023-10-18T14:03:29.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.769+0000 7f721f80fb80 1 -- 172.21.15.114:0/3203785861 wait complete. 2023-10-18T14:03:29.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.769+0000 7f721f80fb80 20 client.15255 trim_cache size 0 max 16384 2023-10-18T14:03:29.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.786+0000 7f721f80fb80 1 Processor -- start 2023-10-18T14:03:29.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.786+0000 7f721f80fb80 1 -- start start 2023-10-18T14:03:29.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f721f80fb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 0x55b7ccbe1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f721f80fb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbe24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f721f80fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbf2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f721f80fb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7cc9ad8d0 con 0x55b7ccbda580 2023-10-18T14:03:29.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f721f80fb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ccae4720 con 0x55b7ccbdfb90 2023-10-18T14:03:29.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f721f80fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ccb2e0b0 con 0x55b7ccbe04b0 2023-10-18T14:03:29.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f72113c2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 0x55b7ccbe1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f72113c2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 0x55b7ccbe1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43292/0 (socket says 172.21.15.114:43292) 2023-10-18T14:03:29.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f72113c2700 1 -- 172.21.15.114:0/2504658346 learned_addr learned my addr 172.21.15.114:0/2504658346 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f72113c2700 1 -- 172.21.15.114:0/2504658346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 msgr2=0x55b7ccbf2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f72113c2700 1 --2- 172.21.15.114:0/2504658346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbf2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f7210bc1700 1 --2- 172.21.15.114:0/2504658346 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbe24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f72113c2700 1 -- 172.21.15.114:0/2504658346 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbdfb90 msgr2=0x55b7ccbe24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f72113c2700 1 --2- 172.21.15.114:0/2504658346 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbe24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f72113c2700 1 -- 172.21.15.114:0/2504658346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7cc940c10 con 0x55b7ccbda580 2023-10-18T14:03:29.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f72113c2700 1 --2- 172.21.15.114:0/2504658346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 0x55b7ccbe1f90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f71fc005d60 tx=0x7f71fc004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4988c8ed405cad88 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f71f7fff700 1 -- 172.21.15.114:0/2504658346 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc01e800 con 0x55b7ccbda580 2023-10-18T14:03:29.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f71f7fff700 1 -- 172.21.15.114:0/2504658346 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71fc00a3f0 con 0x55b7ccbda580 2023-10-18T14:03:29.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.787+0000 7f71f7fff700 1 -- 172.21.15.114:0/2504658346 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc027470 con 0x55b7ccbda580 2023-10-18T14:03:29.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.788+0000 7f721f80fb80 1 -- 172.21.15.114:0/2504658346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 msgr2=0x55b7ccbe1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.788+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2504658346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 0x55b7ccbe1f90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f71fc005d60 tx=0x7f71fc004700 comp rx=0 tx=0).stop 2023-10-18T14:03:29.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.788+0000 7f721f80fb80 1 -- 172.21.15.114:0/2504658346 shutdown_connections 2023-10-18T14:03:29.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.788+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2504658346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbf2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.788+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2504658346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbda580 0x55b7ccbe1f90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.788+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2504658346 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbe24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.788+0000 7f721f80fb80 1 -- 172.21.15.114:0/2504658346 >> 172.21.15.114:0/2504658346 conn(0x55b7ccb4e6d0 msgr2=0x55b7ccbd9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.788+0000 7f721f80fb80 1 -- 172.21.15.114:0/2504658346 shutdown_connections 2023-10-18T14:03:29.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.788+0000 7f721f80fb80 1 -- 172.21.15.114:0/2504658346 wait complete. 2023-10-18T14:03:29.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.788+0000 7f721f80fb80 1 -- start start 2023-10-18T14:03:29.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.788+0000 7f721f80fb80 1 Processor -- start 2023-10-18T14:03:29.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f721f80fb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbda580 0x55b7ccbde7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f721f80fb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbded10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f721f80fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbdf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f721f80fb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ccc476f0 con 0x55b7ccbdfb90 2023-10-18T14:03:29.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f721f80fb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ccc47860 con 0x55b7ccbda580 2023-10-18T14:03:29.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f721f80fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ccc47a20 con 0x55b7ccbe04b0 2023-10-18T14:03:29.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f721f80fb80 10 client.0 _ll_register_callbacks cb 0x55b7cca13a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:29.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f7210bc1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbded10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f7210bc1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbded10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43300/0 (socket says 172.21.15.114:43300) 2023-10-18T14:03:29.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f7210bc1700 1 -- 172.21.15.114:0/2638337771 learned_addr learned my addr 172.21.15.114:0/2638337771 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f72113c2700 1 --2- 172.21.15.114:0/2638337771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbda580 0x55b7ccbde7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f7211bc3700 1 --2- 172.21.15.114:0/2638337771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbdf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f7210bc1700 1 -- 172.21.15.114:0/2638337771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 msgr2=0x55b7ccbdf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f7210bc1700 1 --2- 172.21.15.114:0/2638337771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbdf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f7210bc1700 1 -- 172.21.15.114:0/2638337771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbda580 msgr2=0x55b7ccbde7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f7210bc1700 1 --2- 172.21.15.114:0/2638337771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbda580 0x55b7ccbde7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f7210bc1700 1 -- 172.21.15.114:0/2638337771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7cc957d90 con 0x55b7ccbdfb90 2023-10-18T14:03:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f7210bc1700 1 --2- 172.21.15.114:0/2638337771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbded10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f720809bdc0 tx=0x7f720809bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a792758263d4ec server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f71f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f71f4ff9700 1 -- 172.21.15.114:0/2638337771 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72080b9040 con 0x55b7ccbdfb90 2023-10-18T14:03:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f71f4ff9700 1 -- 172.21.15.114:0/2638337771 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f72080b8040 con 0x55b7ccbdfb90 2023-10-18T14:03:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f721f80fb80 1 -- 172.21.15.114:0/2638337771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f72080a3810 con 0x55b7ccbdfb90 2023-10-18T14:03:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f71f4ff9700 1 -- 172.21.15.114:0/2638337771 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f720809aa00 con 0x55b7ccbdfb90 2023-10-18T14:03:29.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.789+0000 7f721f80fb80 10 client.15261 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:29.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.790+0000 7f721f80fb80 1 -- 172.21.15.114:0/2638337771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b7cc97e200 con 0x55b7ccbdfb90 2023-10-18T14:03:29.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.790+0000 7f71f4ff9700 1 -- 172.21.15.114:0/2638337771 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72080a3810 con 0x55b7ccbdfb90 2023-10-18T14:03:29.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.790+0000 7f71f4ff9700 1 -- 172.21.15.114:0/2638337771 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f720809f170 con 0x55b7ccbdfb90 2023-10-18T14:03:29.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.790+0000 7f721f80fb80 10 client.15261 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.790+0000 7f721f80fb80 10 client.15261 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-18T14:03:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.790+0000 7f721f80fb80 20 client.15261 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.790+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2638337771 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b7ccbf3b30 0x55b7ccc48db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.790+0000 7f721f80fb80 4 client.15261 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T14:03:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.790+0000 7f721f80fb80 1 -- 172.21.15.114:0/2638337771 --> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b7ccb25e00 con 0x55b7ccbf3b30 2023-10-18T14:03:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.790+0000 7f72113c2700 1 --2- 172.21.15.114:0/2638337771 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b7ccbf3b30 0x55b7ccc48db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f71f4ff9700 10 client.15261 ms_handle_connect on v2:172.21.15.158:6838/2616400572 2023-10-18T14:03:29.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f72113c2700 1 --2- 172.21.15.114:0/2638337771 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b7ccbf3b30 0x55b7ccc48db0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=581f9068a006da58 server_cookie=99cbf14f5171d8c8 in_seq=0 out_seq=0 2023-10-18T14:03:29.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f71f4ff9700 1 -- 172.21.15.114:0/2638337771 <== mds.3 v2:172.21.15.158:6838/2616400572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55b7ccb25e00 con 0x55b7ccbf3b30 2023-10-18T14:03:29.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f71f4ff9700 10 client.15261 handle_command_reply: tid=0 2023-10-18T14:03:29.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f721f80fb80 1 client.15261 shutdown 2023-10-18T14:03:29.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f721f80fb80 1 -- 172.21.15.114:0/2638337771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbdfb90 msgr2=0x55b7ccbded10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2638337771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbded10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f720809bdc0 tx=0x7f720809bd50 comp rx=0 tx=0).stop 2023-10-18T14:03:29.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f721f80fb80 1 -- 172.21.15.114:0/2638337771 shutdown_connections 2023-10-18T14:03:29.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2638337771 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b7ccbf3b30 0x55b7ccc48db0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2638337771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b7ccbe04b0 0x55b7ccbdf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f71f4ff9700 0 client.15261 ms_handle_reset on v2:172.21.15.158:6838/2616400572 2023-10-18T14:03:29.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2638337771 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b7ccbda580 0x55b7ccbde7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f721f80fb80 1 --2- 172.21.15.114:0/2638337771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b7ccbdfb90 0x55b7ccbded10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f721f80fb80 1 -- 172.21.15.114:0/2638337771 >> 172.21.15.114:0/2638337771 conn(0x55b7ccb4e6d0 msgr2=0x55b7ccbe1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f721f80fb80 1 -- 172.21.15.114:0/2638337771 shutdown_connections 2023-10-18T14:03:29.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f721f80fb80 1 -- 172.21.15.114:0/2638337771 wait complete. 2023-10-18T14:03:29.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.791+0000 7f721f80fb80 20 client.15261 trim_cache size 0 max 16384 2023-10-18T14:03:29.815 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:03:29.815 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T14:03:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 3, 2023-10-18T14:03:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 24566, 2023-10-18T14:03:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-10-18T14:03:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-10-18T14:03:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-10-18T14:03:29.816 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 51.913709504000003, 2023-10-18T14:03:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 26, 2023-10-18T14:03:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 85, 2023-10-18T14:03:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 83, 2023-10-18T14:03:29.817 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 62.036678860999999 2023-10-18T14:03:29.817 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:03:29.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.792+0000 7f7213626700 1 -- 172.21.15.114:0/3328250112 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f71f80a5970 msgr2=0x7f71f80a7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.792+0000 7f7213626700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f71f80a5970 0x7f71f80a7e30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00abd0 tx=0x7f71fc00a380 comp rx=0 tx=0).stop 2023-10-18T14:03:29.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.792+0000 7f7213626700 1 -- 172.21.15.114:0/3328250112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f720c100270 msgr2=0x7f720c197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.792+0000 7f7213626700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f720c100270 0x7f720c197ec0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7208000c00 tx=0x7f720800f7d0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.792+0000 7f7213626700 1 -- 172.21.15.114:0/3328250112 shutdown_connections 2023-10-18T14:03:29.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.792+0000 7f7213626700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f71f80a5970 0x7f71f80a7e30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.792+0000 7f7213626700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f720c105690 0x7f720c1a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.792+0000 7f7213626700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f720c0ff8b0 0x7f720c197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.792+0000 7f7213626700 1 --2- 172.21.15.114:0/3328250112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f720c100270 0x7f720c197ec0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.792+0000 7f7213626700 1 -- 172.21.15.114:0/3328250112 >> 172.21.15.114:0/3328250112 conn(0x7f720c076430 msgr2=0x7f720c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.792+0000 7f7213626700 1 -- 172.21.15.114:0/3328250112 shutdown_connections 2023-10-18T14:03:29.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.792+0000 7f7213626700 1 -- 172.21.15.114:0/3328250112 wait complete. 2023-10-18T14:03:29.821 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-18T14:03:29.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.940+0000 7f47114e0700 1 -- 172.21.15.114:0/496563738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f470c100ae0 msgr2=0x7f470c10c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.940+0000 7f47114e0700 1 --2- 172.21.15.114:0/496563738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f470c100ae0 0x7f470c10c4b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f470400b0a0 tx=0x7f470400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.940+0000 7f47114e0700 1 -- 172.21.15.114:0/496563738 shutdown_connections 2023-10-18T14:03:29.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.940+0000 7f47114e0700 1 --2- 172.21.15.114:0/496563738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f470c100ae0 0x7f470c10c4b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.940+0000 7f47114e0700 1 --2- 172.21.15.114:0/496563738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f470c104620 0x7f470c104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.940+0000 7f47114e0700 1 --2- 172.21.15.114:0/496563738 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f470c100120 0x7f470c1005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.940+0000 7f47114e0700 1 -- 172.21.15.114:0/496563738 >> 172.21.15.114:0/496563738 conn(0x7f470c075960 msgr2=0x7f470c075d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.940+0000 7f47114e0700 1 -- 172.21.15.114:0/496563738 shutdown_connections 2023-10-18T14:03:29.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.940+0000 7f47114e0700 1 -- 172.21.15.114:0/496563738 wait complete. 2023-10-18T14:03:29.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.941+0000 7f47114e0700 1 Processor -- start 2023-10-18T14:03:29.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.941+0000 7f47114e0700 1 -- start start 2023-10-18T14:03:29.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.941+0000 7f47114e0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f470c100120 0x7f470c197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.941+0000 7f47114e0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f470c100ae0 0x7f470c198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.941+0000 7f47114e0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f470c104620 0x7f470c1a2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.941+0000 7f47114e0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c1988b0 con 0x7f470c100ae0 2023-10-18T14:03:29.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.941+0000 7f47114e0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c1a30e0 con 0x7f470c104620 2023-10-18T14:03:29.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.941+0000 7f47114e0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c1a3220 con 0x7f470c100120 2023-10-18T14:03:29.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.941+0000 7f470a7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f470c100ae0 0x7f470c198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.941+0000 7f470a7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f470c100ae0 0x7f470c198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43314/0 (socket says 172.21.15.114:43314) 2023-10-18T14:03:29.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f470a7fc700 1 -- 172.21.15.114:0/3041727460 learned_addr learned my addr 172.21.15.114:0/3041727460 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f470affd700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f470c100120 0x7f470c197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f470b7fe700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f470c104620 0x7f470c1a2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f470a7fc700 1 -- 172.21.15.114:0/3041727460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f470c100120 msgr2=0x7f470c197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f470a7fc700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f470c100120 0x7f470c197b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f470a7fc700 1 -- 172.21.15.114:0/3041727460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f470c104620 msgr2=0x7f470c1a2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f470a7fc700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f470c104620 0x7f470c1a2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f470a7fc700 1 -- 172.21.15.114:0/3041727460 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4704009d00 con 0x7f470c100ae0 2023-10-18T14:03:29.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f470a7fc700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f470c100ae0 0x7f470c198060 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f470000d9b0 tx=0x7f470000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f46f3fff700 1 -- 172.21.15.114:0/3041727460 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700004220 con 0x7f470c100ae0 2023-10-18T14:03:29.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f47114e0700 1 -- 172.21.15.114:0/3041727460 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470c1a3480 con 0x7f470c100ae0 2023-10-18T14:03:29.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f46f3fff700 1 -- 172.21.15.114:0/3041727460 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4700007640 con 0x7f470c100ae0 2023-10-18T14:03:29.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f46f3fff700 1 -- 172.21.15.114:0/3041727460 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700005590 con 0x7f470c100ae0 2023-10-18T14:03:29.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.942+0000 7f47114e0700 1 -- 172.21.15.114:0/3041727460 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470c1a3990 con 0x7f470c100ae0 2023-10-18T14:03:29.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.944+0000 7f46f3fff700 1 -- 172.21.15.114:0/3041727460 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f4700004750 con 0x7f470c100ae0 2023-10-18T14:03:29.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.945+0000 7f46f3fff700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f46f40a1560 0x7f46f40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.945+0000 7f470affd700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f46f40a1560 0x7f46f40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.945+0000 7f46f3fff700 1 -- 172.21.15.114:0/3041727460 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f47000cccf0 con 0x7f470c100ae0 2023-10-18T14:03:29.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.946+0000 7f470affd700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f46f40a1560 0x7f46f40a3a20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009a10 tx=0x7f46fc009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.946+0000 7f471d6c9b80 1 Processor -- start 2023-10-18T14:03:29.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.946+0000 7f471d6c9b80 1 -- start start 2023-10-18T14:03:29.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.946+0000 7f471d6c9b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 0x55cdddc7df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.946+0000 7f471d6c9b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7e4b0 0x55cdddc78040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.946+0000 7f471d6c9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc78580 0x55cdddc78a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.946+0000 7f471d6c9b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdddbeb690 con 0x55cdddc7db90 2023-10-18T14:03:29.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.946+0000 7f471d6c9b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdddbd1c10 con 0x55cdddc7e4b0 2023-10-18T14:03:29.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.946+0000 7f471d6c9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdddbcf530 con 0x55cdddc78580 2023-10-18T14:03:29.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.946+0000 7f470affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 0x55cdddc7df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.946+0000 7f470affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 0x55cdddc7df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43320/0 (socket says 172.21.15.114:43320) 2023-10-18T14:03:29.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.946+0000 7f470affd700 1 -- 172.21.15.114:0/2599652496 learned_addr learned my addr 172.21.15.114:0/2599652496 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.947+0000 7f470b7fe700 1 --2- 172.21.15.114:0/2599652496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc78580 0x55cdddc78a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.947+0000 7f470a7fc700 1 --2- 172.21.15.114:0/2599652496 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7e4b0 0x55cdddc78040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.947+0000 7f470affd700 1 -- 172.21.15.114:0/2599652496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc78580 msgr2=0x55cdddc78a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.947+0000 7f470affd700 1 --2- 172.21.15.114:0/2599652496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc78580 0x55cdddc78a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.947+0000 7f470affd700 1 -- 172.21.15.114:0/2599652496 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7e4b0 msgr2=0x55cdddc78040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.947+0000 7f470affd700 1 --2- 172.21.15.114:0/2599652496 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7e4b0 0x55cdddc78040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.947+0000 7f470affd700 1 -- 172.21.15.114:0/2599652496 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdddb883a0 con 0x55cdddc7db90 2023-10-18T14:03:29.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.947+0000 7f470b7fe700 1 --2- 172.21.15.114:0/2599652496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc78580 0x55cdddc78a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:29.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.947+0000 7f470a7fc700 1 --2- 172.21.15.114:0/2599652496 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7e4b0 0x55cdddc78040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:29.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.947+0000 7f470affd700 1 --2- 172.21.15.114:0/2599652496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 0x55cdddc7df70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00ea00 tx=0x7f46fc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cc890d3942f258 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.947+0000 7f46f17fa700 1 -- 172.21.15.114:0/2599652496 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc015480 con 0x55cdddc7db90 2023-10-18T14:03:29.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.947+0000 7f46f17fa700 1 -- 172.21.15.114:0/2599652496 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46fc015aa0 con 0x55cdddc7db90 2023-10-18T14:03:29.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.947+0000 7f46f17fa700 1 -- 172.21.15.114:0/2599652496 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc0139f0 con 0x55cdddc7db90 2023-10-18T14:03:29.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 -- 172.21.15.114:0/2599652496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 msgr2=0x55cdddc7df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/2599652496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 0x55cdddc7df70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00ea00 tx=0x7f46fc011000 comp rx=0 tx=0).stop 2023-10-18T14:03:29.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 -- 172.21.15.114:0/2599652496 shutdown_connections 2023-10-18T14:03:29.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/2599652496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc78580 0x55cdddc78a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/2599652496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 0x55cdddc7df70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/2599652496 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7e4b0 0x55cdddc78040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 -- 172.21.15.114:0/2599652496 >> 172.21.15.114:0/2599652496 conn(0x55cdddbec6d0 msgr2=0x55cdddc72b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 -- 172.21.15.114:0/2599652496 shutdown_connections 2023-10-18T14:03:29.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 -- 172.21.15.114:0/2599652496 wait complete. 2023-10-18T14:03:29.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 -- start start 2023-10-18T14:03:29.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 Processor -- start 2023-10-18T14:03:29.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc78580 0x55cdddc817c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc7db90 0x55cdddc81d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7e4b0 0x55cdddc82240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdddbcae20 con 0x55cdddc78580 2023-10-18T14:03:29.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdddb676c0 con 0x55cdddc7e4b0 2023-10-18T14:03:29.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdddb67360 con 0x55cdddc7db90 2023-10-18T14:03:29.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f471d6c9b80 10 client.0 _ll_register_callbacks cb 0x55cdddab1a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:29.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f470affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc78580 0x55cdddc817c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f470affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc78580 0x55cdddc817c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43326/0 (socket says 172.21.15.114:43326) 2023-10-18T14:03:29.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f470affd700 1 -- 172.21.15.114:0/1172451072 learned_addr learned my addr 172.21.15.114:0/1172451072 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.948+0000 7f470a7fc700 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc7db90 0x55cdddc81d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f470b7fe700 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7e4b0 0x55cdddc82240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f470affd700 1 -- 172.21.15.114:0/1172451072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc7db90 msgr2=0x55cdddc81d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f470affd700 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc7db90 0x55cdddc81d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f470affd700 1 -- 172.21.15.114:0/1172451072 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7e4b0 msgr2=0x55cdddc82240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f470affd700 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7e4b0 0x55cdddc82240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f470affd700 1 -- 172.21.15.114:0/1172451072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc00e6e0 con 0x55cdddc78580 2023-10-18T14:03:29.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f470b7fe700 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7e4b0 0x55cdddc82240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:29.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f470affd700 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc78580 0x55cdddc817c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009fd0 tx=0x7f46fc0094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da814f85d515ff5b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f46eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:29.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f46eeff5700 1 -- 172.21.15.114:0/1172451072 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc013ab0 con 0x55cdddc78580 2023-10-18T14:03:29.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f46eeff5700 1 -- 172.21.15.114:0/1172451072 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f46fc013c10 con 0x55cdddc78580 2023-10-18T14:03:29.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f471d6c9b80 1 -- 172.21.15.114:0/1172451072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cdddbcfea0 con 0x55cdddc78580 2023-10-18T14:03:29.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f46eeff5700 1 -- 172.21.15.114:0/1172451072 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46fc013dd0 con 0x55cdddc78580 2023-10-18T14:03:29.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f471d6c9b80 10 client.15273 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:29.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f471d6c9b80 1 -- 172.21.15.114:0/1172451072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cddd9f5d90 con 0x55cdddc78580 2023-10-18T14:03:29.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f46eeff5700 1 -- 172.21.15.114:0/1172451072 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cdddbcfea0 con 0x55cdddc78580 2023-10-18T14:03:29.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f46eeff5700 1 -- 172.21.15.114:0/1172451072 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f46fc028400 con 0x55cdddc78580 2023-10-18T14:03:29.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f471d6c9b80 10 client.15273 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:29.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f471d6c9b80 10 client.15273 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-18T14:03:29.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.949+0000 7f471d6c9b80 20 client.15273 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:29.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.950+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55cdddc91db0 0x55cdddc908f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.950+0000 7f471d6c9b80 4 client.15273 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:03:29.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.950+0000 7f471d6c9b80 1 -- 172.21.15.114:0/1172451072 --> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cdddc47860 con 0x55cdddc91db0 2023-10-18T14:03:29.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.950+0000 7f470a7fc700 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55cdddc91db0 0x55cdddc908f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.950+0000 7f46eeff5700 10 client.15273 ms_handle_connect on v2:172.21.15.172:6834/2655563129 2023-10-18T14:03:29.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.950+0000 7f470a7fc700 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55cdddc91db0 0x55cdddc908f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=76197bc5adb5da9f server_cookie=597d52b87f8fb539 in_seq=0 out_seq=0 2023-10-18T14:03:29.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f46eeff5700 1 -- 172.21.15.114:0/1172451072 <== mds.2 v2:172.21.15.172:6834/2655563129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cdddc47860 con 0x55cdddc91db0 2023-10-18T14:03:29.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f46eeff5700 10 client.15273 handle_command_reply: tid=0 2023-10-18T14:03:29.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f471d6c9b80 1 client.15273 shutdown 2023-10-18T14:03:29.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f471d6c9b80 1 -- 172.21.15.114:0/1172451072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc78580 msgr2=0x55cdddc817c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc78580 0x55cdddc817c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009fd0 tx=0x7f46fc0094c0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f471d6c9b80 1 -- 172.21.15.114:0/1172451072 shutdown_connections 2023-10-18T14:03:29.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55cdddc91db0 0x55cdddc908f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7e4b0 0x55cdddc82240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f46eeff5700 0 client.15273 ms_handle_reset on v2:172.21.15.172:6834/2655563129 2023-10-18T14:03:29.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc78580 0x55cdddc817c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/1172451072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc7db90 0x55cdddc81d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f471d6c9b80 1 -- 172.21.15.114:0/1172451072 >> 172.21.15.114:0/1172451072 conn(0x55cdddbec6d0 msgr2=0x55cdddc77030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f471d6c9b80 1 -- 172.21.15.114:0/1172451072 shutdown_connections 2023-10-18T14:03:29.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f471d6c9b80 1 -- 172.21.15.114:0/1172451072 wait complete. 2023-10-18T14:03:29.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.951+0000 7f471d6c9b80 20 client.15273 trim_cache size 0 max 16384 2023-10-18T14:03:29.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.968+0000 7f471d6c9b80 1 Processor -- start 2023-10-18T14:03:29.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.968+0000 7f471d6c9b80 1 -- start start 2023-10-18T14:03:29.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f471d6c9b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc78580 0x55cdddc7bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f471d6c9b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 0x55cdddc90f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f471d6c9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc7e4b0 0x55cdddc6cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f471d6c9b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cddda4b8d0 con 0x55cdddc7db90 2023-10-18T14:03:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f471d6c9b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdddb82720 con 0x55cdddc78580 2023-10-18T14:03:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f471d6c9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdddbc6f10 con 0x55cdddc7e4b0 2023-10-18T14:03:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f470a7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 0x55cdddc90f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f470a7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 0x55cdddc90f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43336/0 (socket says 172.21.15.114:43336) 2023-10-18T14:03:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f470a7fc700 1 -- 172.21.15.114:0/1561724948 learned_addr learned my addr 172.21.15.114:0/1561724948 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f470affd700 1 --2- 172.21.15.114:0/1561724948 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc78580 0x55cdddc7bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f470b7fe700 1 --2- 172.21.15.114:0/1561724948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc7e4b0 0x55cdddc6cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f470a7fc700 1 -- 172.21.15.114:0/1561724948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc7e4b0 msgr2=0x55cdddc6cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f470a7fc700 1 --2- 172.21.15.114:0/1561724948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc7e4b0 0x55cdddc6cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f470a7fc700 1 -- 172.21.15.114:0/1561724948 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc78580 msgr2=0x55cdddc7bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f470a7fc700 1 --2- 172.21.15.114:0/1561724948 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc78580 0x55cdddc7bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f470a7fc700 1 -- 172.21.15.114:0/1561724948 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cddd9dec10 con 0x55cdddc7db90 2023-10-18T14:03:29.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f470b7fe700 1 --2- 172.21.15.114:0/1561724948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc7e4b0 0x55cdddc6cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:29.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f470a7fc700 1 --2- 172.21.15.114:0/1561724948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 0x55cdddc90f70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f47000ca630 tx=0x7f4700021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e057c0bfc3967b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f46f1ffb700 1 -- 172.21.15.114:0/1561724948 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47000a21a0 con 0x55cdddc7db90 2023-10-18T14:03:29.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f46f1ffb700 1 -- 172.21.15.114:0/1561724948 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f470009c040 con 0x55cdddc7db90 2023-10-18T14:03:29.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.969+0000 7f46f1ffb700 1 -- 172.21.15.114:0/1561724948 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700099300 con 0x55cdddc7db90 2023-10-18T14:03:29.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 -- 172.21.15.114:0/1561724948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 msgr2=0x55cdddc90f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:29.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/1561724948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 0x55cdddc90f70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f47000ca630 tx=0x7f4700021000 comp rx=0 tx=0).stop 2023-10-18T14:03:29.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 -- 172.21.15.114:0/1561724948 shutdown_connections 2023-10-18T14:03:29.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/1561724948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc7e4b0 0x55cdddc6cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/1561724948 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc78580 0x55cdddc7bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/1561724948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7db90 0x55cdddc90f70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 -- 172.21.15.114:0/1561724948 >> 172.21.15.114:0/1561724948 conn(0x55cdddbec6d0 msgr2=0x55cdddc6c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:29.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 -- 172.21.15.114:0/1561724948 shutdown_connections 2023-10-18T14:03:29.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 -- 172.21.15.114:0/1561724948 wait complete. 2023-10-18T14:03:29.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 -- start start 2023-10-18T14:03:29.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 Processor -- start 2023-10-18T14:03:29.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc78580 0x55cdddc81070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7db90 0x55cdddc815b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7e4b0 0x55cdddce97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdddc81e70 con 0x55cdddc7e4b0 2023-10-18T14:03:29.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdddce9d20 con 0x55cdddc7db90 2023-10-18T14:03:29.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdddce9e60 con 0x55cdddc78580 2023-10-18T14:03:29.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.970+0000 7f471d6c9b80 10 client.0 _ll_register_callbacks cb 0x55cdddab1a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:29.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7e4b0 0x55cdddce97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470a7fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7db90 0x55cdddc815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470a7fc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7db90 0x55cdddc815b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:39486/0 (socket says 172.21.15.114:39486) 2023-10-18T14:03:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470a7fc700 1 -- 172.21.15.114:0/2755616708 learned_addr learned my addr 172.21.15.114:0/2755616708 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7e4b0 0x55cdddce97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43344/0 (socket says 172.21.15.114:43344) 2023-10-18T14:03:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470affd700 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc78580 0x55cdddc81070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470a7fc700 1 -- 172.21.15.114:0/2755616708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc78580 msgr2=0x55cdddc81070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470a7fc700 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc78580 0x55cdddc81070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470a7fc700 1 -- 172.21.15.114:0/2755616708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7e4b0 msgr2=0x55cdddce97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:29.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470a7fc700 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7e4b0 0x55cdddce97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:29.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470a7fc700 1 -- 172.21.15.114:0/2755616708 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470c1a3990 con 0x55cdddc7db90 2023-10-18T14:03:29.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470affd700 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc78580 0x55cdddc81070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:29.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470b7fe700 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7e4b0 0x55cdddce97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:03:29.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f470a7fc700 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7db90 0x55cdddc815b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4700099fd0 tx=0x7f470009e090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=924696b2e7878a54 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:29.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f46eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:03:29.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f46eeff5700 1 -- 172.21.15.114:0/2755616708 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700004380 con 0x55cdddc7db90 2023-10-18T14:03:29.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f471d6c9b80 1 -- 172.21.15.114:0/2755616708 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46fc015aa0 con 0x55cdddc7db90 2023-10-18T14:03:29.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f46eeff5700 1 -- 172.21.15.114:0/2755616708 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f4700099300 con 0x55cdddc7db90 2023-10-18T14:03:29.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f46eeff5700 1 -- 172.21.15.114:0/2755616708 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47000994c0 con 0x55cdddc7db90 2023-10-18T14:03:29.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f471d6c9b80 10 client.24785 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:29.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.971+0000 7f471d6c9b80 1 -- 172.21.15.114:0/2755616708 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cddda1c200 con 0x55cdddc7db90 2023-10-18T14:03:29.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.972+0000 7f46eeff5700 1 -- 172.21.15.114:0/2755616708 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46fc015aa0 con 0x55cdddc7db90 2023-10-18T14:03:29.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.972+0000 7f46eeff5700 1 -- 172.21.15.114:0/2755616708 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f470005fb90 con 0x55cdddc7db90 2023-10-18T14:03:29.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.972+0000 7f471d6c9b80 10 client.24785 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:29.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.972+0000 7f471d6c9b80 10 client.24785 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-18T14:03:29.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.972+0000 7f471d6c9b80 20 client.24785 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:29.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.972+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55cdddc91db0 0x55cdddceb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:29.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.972+0000 7f471d6c9b80 4 client.24785 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T14:03:29.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.972+0000 7f471d6c9b80 1 -- 172.21.15.114:0/2755616708 --> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cdddbc3e00 con 0x55cdddc91db0 2023-10-18T14:03:29.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.972+0000 7f470affd700 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55cdddc91db0 0x55cdddceb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:29.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.972+0000 7f46eeff5700 10 client.24785 ms_handle_connect on v2:172.21.15.172:6834/2655563129 2023-10-18T14:03:29.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.972+0000 7f470affd700 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55cdddc91db0 0x55cdddceb250 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c5c5acbd528c00fc server_cookie=67b82ff93bce4a8 in_seq=0 out_seq=0 2023-10-18T14:03:29.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f46eeff5700 1 -- 172.21.15.114:0/2755616708 <== mds.2 v2:172.21.15.172:6834/2655563129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55cdddbc3e00 con 0x55cdddc91db0 2023-10-18T14:03:30.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f46eeff5700 10 client.24785 handle_command_reply: tid=0 2023-10-18T14:03:30.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f471d6c9b80 1 client.24785 shutdown 2023-10-18T14:03:30.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f471d6c9b80 1 -- 172.21.15.114:0/2755616708 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7db90 msgr2=0x55cdddc815b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7db90 0x55cdddc815b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4700099fd0 tx=0x7f470009e090 comp rx=0 tx=0).stop 2023-10-18T14:03:30.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f471d6c9b80 1 -- 172.21.15.114:0/2755616708 shutdown_connections 2023-10-18T14:03:30.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55cdddc91db0 0x55cdddceb250 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cdddc7e4b0 0x55cdddce97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cdddc78580 0x55cdddc81070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f471d6c9b80 1 --2- 172.21.15.114:0/2755616708 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55cdddc7db90 0x55cdddc815b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f46eeff5700 0 client.24785 ms_handle_reset on v2:172.21.15.172:6834/2655563129 2023-10-18T14:03:30.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f471d6c9b80 1 -- 172.21.15.114:0/2755616708 >> 172.21.15.114:0/2755616708 conn(0x55cdddbec6d0 msgr2=0x55cdddc7bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f471d6c9b80 1 -- 172.21.15.114:0/2755616708 shutdown_connections 2023-10-18T14:03:30.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f471d6c9b80 1 -- 172.21.15.114:0/2755616708 wait complete. 2023-10-18T14:03:30.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f471d6c9b80 20 client.24785 trim_cache size 0 max 16384 2023-10-18T14:03:30.002 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:03:30.003 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T14:03:30.003 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 2, 2023-10-18T14:03:30.003 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 24583, 2023-10-18T14:03:30.003 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-10-18T14:03:30.003 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-10-18T14:03:30.004 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-10-18T14:03:30.004 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 53.104673697999999, 2023-10-18T14:03:30.004 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 26, 2023-10-18T14:03:30.004 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 85, 2023-10-18T14:03:30.004 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 83, 2023-10-18T14:03:30.004 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 76.036474708 2023-10-18T14:03:30.005 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:03:30.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f47114e0700 1 -- 172.21.15.114:0/3041727460 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f46f40a1560 msgr2=0x7f46f40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f47114e0700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f46f40a1560 0x7f46f40a3a20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009a10 tx=0x7f46fc009190 comp rx=0 tx=0).stop 2023-10-18T14:03:30.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f47114e0700 1 -- 172.21.15.114:0/3041727460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f470c100ae0 msgr2=0x7f470c198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f47114e0700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f470c100ae0 0x7f470c198060 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f470000d9b0 tx=0x7f470000dcc0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f47114e0700 1 -- 172.21.15.114:0/3041727460 shutdown_connections 2023-10-18T14:03:30.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f47114e0700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f46f40a1560 0x7f46f40a3a20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f47114e0700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f470c104620 0x7f470c1a2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f47114e0700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f470c100120 0x7f470c197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f47114e0700 1 --2- 172.21.15.114:0/3041727460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f470c100ae0 0x7f470c198060 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.973+0000 7f47114e0700 1 -- 172.21.15.114:0/3041727460 >> 172.21.15.114:0/3041727460 conn(0x7f470c075960 msgr2=0x7f470c0fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.974+0000 7f47114e0700 1 -- 172.21.15.114:0/3041727460 shutdown_connections 2023-10-18T14:03:30.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:29.974+0000 7f47114e0700 1 -- 172.21.15.114:0/3041727460 wait complete. 2023-10-18T14:03:30.008 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:29 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/478415885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:30.008 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:29 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3719797773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:30.008 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:29 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3651804572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:30.009 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-18T14:03:30.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:29 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/478415885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:30.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:29 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3719797773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:30.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:29 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3651804572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:30.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:29 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/478415885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:30.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:29 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3719797773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:30.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:29 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3651804572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.128+0000 7f90adffe700 1 -- 172.21.15.114:0/116759964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a80ffef0 msgr2=0x7f90a810c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.128+0000 7f90adffe700 1 --2- 172.21.15.114:0/116759964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a80ffef0 0x7f90a810c3b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f90a000b0d0 tx=0x7f90a000b3e0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.128+0000 7f90adffe700 1 -- 172.21.15.114:0/116759964 shutdown_connections 2023-10-18T14:03:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.128+0000 7f90adffe700 1 --2- 172.21.15.114:0/116759964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a80ffef0 0x7f90a810c3b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.128+0000 7f90adffe700 1 --2- 172.21.15.114:0/116759964 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90a81055f0 0x7f90a81059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.128+0000 7f90adffe700 1 --2- 172.21.15.114:0/116759964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90a80ff530 0x7f90a80ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.128+0000 7f90adffe700 1 -- 172.21.15.114:0/116759964 >> 172.21.15.114:0/116759964 conn(0x7f90a80fb020 msgr2=0x7f90a80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.128+0000 7f90adffe700 1 -- 172.21.15.114:0/116759964 shutdown_connections 2023-10-18T14:03:30.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.128+0000 7f90adffe700 1 -- 172.21.15.114:0/116759964 wait complete. 2023-10-18T14:03:30.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.128+0000 7f90adffe700 1 Processor -- start 2023-10-18T14:03:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90adffe700 1 -- start start 2023-10-18T14:03:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90adffe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90a80ff530 0x7f90a8197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90adffe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90a80ffef0 0x7f90a8197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90adffe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a81055f0 0x7f90a81a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90adffe700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8198780 con 0x7f90a81055f0 2023-10-18T14:03:30.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90adffe700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81a2f40 con 0x7f90a80ff530 2023-10-18T14:03:30.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90adffe700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81a3080 con 0x7f90a80ffef0 2023-10-18T14:03:30.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a81055f0 0x7f90a81a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a81055f0 0x7f90a81a2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43356/0 (socket says 172.21.15.114:43356) 2023-10-18T14:03:30.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a7fff700 1 -- 172.21.15.114:0/1469026034 learned_addr learned my addr 172.21.15.114:0/1469026034 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:30.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a6ffd700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90a80ffef0 0x7f90a8197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a77fe700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90a80ff530 0x7f90a8197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a7fff700 1 -- 172.21.15.114:0/1469026034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90a80ffef0 msgr2=0x7f90a8197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a7fff700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90a80ffef0 0x7f90a8197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a7fff700 1 -- 172.21.15.114:0/1469026034 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90a80ff530 msgr2=0x7f90a8197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a7fff700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90a80ff530 0x7f90a8197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a7fff700 1 -- 172.21.15.114:0/1469026034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a0009d00 con 0x7f90a81055f0 2023-10-18T14:03:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a6ffd700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90a80ffef0 0x7f90a8197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:30.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a77fe700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90a80ff530 0x7f90a8197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:30.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a7fff700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a81055f0 0x7f90a81a2a00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f90a000d010 tx=0x7f90a00094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:30.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a4ff9700 1 -- 172.21.15.114:0/1469026034 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a000e040 con 0x7f90a81055f0 2023-10-18T14:03:30.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a4ff9700 1 -- 172.21.15.114:0/1469026034 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90a0007950 con 0x7f90a81055f0 2023-10-18T14:03:30.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90adffe700 1 -- 172.21.15.114:0/1469026034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a81a32a0 con 0x7f90a81055f0 2023-10-18T14:03:30.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.129+0000 7f90a4ff9700 1 -- 172.21.15.114:0/1469026034 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a001b6d0 con 0x7f90a81055f0 2023-10-18T14:03:30.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.130+0000 7f90adffe700 1 -- 172.21.15.114:0/1469026034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a81a36c0 con 0x7f90a81055f0 2023-10-18T14:03:30.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.132+0000 7f90a4ff9700 1 -- 172.21.15.114:0/1469026034 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f90a0024410 con 0x7f90a81055f0 2023-10-18T14:03:30.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.132+0000 7f90a4ff9700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f90900a1560 0x7f90900a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.132+0000 7f90a4ff9700 1 -- 172.21.15.114:0/1469026034 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f90a00ce1b0 con 0x7f90a81055f0 2023-10-18T14:03:30.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.132+0000 7f90a77fe700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f90900a1560 0x7f90900a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90a77fe700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f90900a1560 0x7f90900a3a20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f909c005d90 tx=0x7f909c005d00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:30.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90ba1e7b80 1 Processor -- start 2023-10-18T14:03:30.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90ba1e7b80 1 -- start start 2023-10-18T14:03:30.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90ba1e7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e8cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90ba1e7b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e87040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90ba1e7b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e87580 0x55ffe3e87a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90ba1e7b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe3dfa690 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90ba1e7b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe3de0c10 con 0x55ffe3e87580 2023-10-18T14:03:30.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90ba1e7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe3dde530 con 0x55ffe3e8cb90 2023-10-18T14:03:30.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90a6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e87040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90a6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e87040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43362/0 (socket says 172.21.15.114:43362) 2023-10-18T14:03:30.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90a6ffd700 1 -- 172.21.15.114:0/1485299862 learned_addr learned my addr 172.21.15.114:0/1485299862 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:30.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90a77fe700 1 --2- 172.21.15.114:0/1485299862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e8cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90a6ffd700 1 -- 172.21.15.114:0/1485299862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 msgr2=0x55ffe3e8cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90a6ffd700 1 --2- 172.21.15.114:0/1485299862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e8cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90a6ffd700 1 -- 172.21.15.114:0/1485299862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e87580 msgr2=0x55ffe3e87a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90a6ffd700 1 --2- 172.21.15.114:0/1485299862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e87580 0x55ffe3e87a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90a6ffd700 1 -- 172.21.15.114:0/1485299862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffe3d973a0 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.133+0000 7f90a6ffd700 1 --2- 172.21.15.114:0/1485299862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e87040 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f909800bbe0 tx=0x7f909800bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2f66c2e54a3111 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.134+0000 7f908dffb700 1 -- 172.21.15.114:0/1485299862 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800ddb0 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.134+0000 7f908dffb700 1 -- 172.21.15.114:0/1485299862 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f909800b690 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.134+0000 7f908dffb700 1 -- 172.21.15.114:0/1485299862 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800f820 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.134+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/1485299862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 msgr2=0x55ffe3e87040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.134+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/1485299862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e87040 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f909800bbe0 tx=0x7f909800bef0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.134+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/1485299862 shutdown_connections 2023-10-18T14:03:30.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.134+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/1485299862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e87580 0x55ffe3e87a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.134+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/1485299862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e8cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.134+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/1485299862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e87040 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.134+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/1485299862 >> 172.21.15.114:0/1485299862 conn(0x55ffe3dfb6d0 msgr2=0x55ffe3e81b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.134+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/1485299862 shutdown_connections 2023-10-18T14:03:30.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.134+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/1485299862 wait complete. 2023-10-18T14:03:30.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.135+0000 7f90ba1e7b80 1 -- start start 2023-10-18T14:03:30.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.135+0000 7f90ba1e7b80 1 Processor -- start 2023-10-18T14:03:30.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.135+0000 7f90ba1e7b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e87580 0x55ffe3e93330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.135+0000 7f90ba1e7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e90670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.135+0000 7f90ba1e7b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e90c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.135+0000 7f90ba1e7b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe3dd9e20 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.135+0000 7f90ba1e7b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe3d766c0 con 0x55ffe3e87580 2023-10-18T14:03:30.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.135+0000 7f90ba1e7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe3d76360 con 0x55ffe3e8cb90 2023-10-18T14:03:30.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.135+0000 7f90a7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e90c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.135+0000 7f90ba1e7b80 10 client.0 _ll_register_callbacks cb 0x55ffe3cc0a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:30.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.135+0000 7f90a7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e90c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43370/0 (socket says 172.21.15.114:43370) 2023-10-18T14:03:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.135+0000 7f90a7fff700 1 -- 172.21.15.114:0/2634307822 learned_addr learned my addr 172.21.15.114:0/2634307822 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f90a6ffd700 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e90670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f90a77fe700 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e87580 0x55ffe3e93330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f90a7fff700 1 -- 172.21.15.114:0/2634307822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 msgr2=0x55ffe3e90670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f90a7fff700 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e90670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f90a7fff700 1 -- 172.21.15.114:0/2634307822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e87580 msgr2=0x55ffe3e93330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f90a7fff700 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e87580 0x55ffe3e93330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f90a7fff700 1 -- 172.21.15.114:0/2634307822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909800b810 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f90a77fe700 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e87580 0x55ffe3e93330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:30.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f90a7fff700 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e90c30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f90a000b420 tx=0x7f90a009ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae21b7b716c47fb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:30.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f9086ffd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:30.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f9086ffd700 1 -- 172.21.15.114:0/2634307822 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0003c00 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f9086ffd700 1 -- 172.21.15.114:0/2634307822 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f90a009ba60 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2634307822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ffe3e56860 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f9086ffd700 1 -- 172.21.15.114:0/2634307822 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90a0063050 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f90ba1e7b80 10 client.15291 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:30.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2634307822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ffe3c04d90 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f9086ffd700 1 -- 172.21.15.114:0/2634307822 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ffe3e56860 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f9086ffd700 1 -- 172.21.15.114:0/2634307822 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f90a00a31d0 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.136+0000 7f90ba1e7b80 10 client.15291 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:30.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.137+0000 7f90ba1e7b80 10 client.15291 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-18T14:03:30.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.137+0000 7f90ba1e7b80 20 client.15291 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:30.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.137+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55ffe3ea0ba0 0x55ffe3e9f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.137+0000 7f90ba1e7b80 4 client.15291 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:03:30.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.137+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2634307822 --> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ffe3dd2e00 con 0x55ffe3ea0ba0 2023-10-18T14:03:30.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.137+0000 7f90a77fe700 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55ffe3ea0ba0 0x55ffe3e9f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.137+0000 7f90a77fe700 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55ffe3ea0ba0 0x55ffe3e9f700 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=47fa84e3806c24b1 server_cookie=65502a4d4ed3932 in_seq=0 out_seq=0 2023-10-18T14:03:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.137+0000 7f9086ffd700 10 client.15291 ms_handle_connect on v2:172.21.15.172:6836/1821444438 2023-10-18T14:03:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f9086ffd700 1 -- 172.21.15.114:0/2634307822 <== mds.1 v2:172.21.15.172:6836/1821444438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ffe3dd2e00 con 0x55ffe3ea0ba0 2023-10-18T14:03:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f9086ffd700 10 client.15291 handle_command_reply: tid=0 2023-10-18T14:03:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f90ba1e7b80 1 client.15291 shutdown 2023-10-18T14:03:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2634307822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 msgr2=0x55ffe3e90c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e90c30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f90a000b420 tx=0x7f90a009ad40 comp rx=0 tx=0).stop 2023-10-18T14:03:30.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2634307822 shutdown_connections 2023-10-18T14:03:30.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e90c30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e87580 0x55ffe3e93330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55ffe3ea0ba0 0x55ffe3e9f700 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2634307822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e90670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2634307822 >> 172.21.15.114:0/2634307822 conn(0x55ffe3dfb6d0 msgr2=0x55ffe3e86030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f9086ffd700 0 client.15291 ms_handle_reset on v2:172.21.15.172:6836/1821444438 2023-10-18T14:03:30.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2634307822 shutdown_connections 2023-10-18T14:03:30.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2634307822 wait complete. 2023-10-18T14:03:30.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.138+0000 7f90ba1e7b80 20 client.15291 trim_cache size 0 max 16384 2023-10-18T14:03:30.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90ba1e7b80 1 Processor -- start 2023-10-18T14:03:30.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90ba1e7b80 1 -- start start 2023-10-18T14:03:30.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90ba1e7b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 0x55ffe3e8ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90ba1e7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e90be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90ba1e7b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e9f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90ba1e7b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe3e7caa0 con 0x55ffe3e87580 2023-10-18T14:03:30.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90ba1e7b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe3c5a8d0 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90ba1e7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe3ddb0b0 con 0x55ffe3e8cb90 2023-10-18T14:03:30.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90a77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 0x55ffe3e8ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90a77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 0x55ffe3e8ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43374/0 (socket says 172.21.15.114:43374) 2023-10-18T14:03:30.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90a77fe700 1 -- 172.21.15.114:0/2248743996 learned_addr learned my addr 172.21.15.114:0/2248743996 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:30.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90a77fe700 1 -- 172.21.15.114:0/2248743996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 msgr2=0x55ffe3e90be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90a77fe700 1 --2- 172.21.15.114:0/2248743996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e90be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90a77fe700 1 -- 172.21.15.114:0/2248743996 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e8d4b0 msgr2=0x55ffe3e9f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90a77fe700 1 --2- 172.21.15.114:0/2248743996 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e9f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90a77fe700 1 -- 172.21.15.114:0/2248743996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffe3bedc10 con 0x55ffe3e87580 2023-10-18T14:03:30.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f90a77fe700 1 --2- 172.21.15.114:0/2248743996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 0x55ffe3e8ade0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f909c0097e0 tx=0x7f909c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4648a4877d6cede server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:30.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.156+0000 7f908e7fc700 1 -- 172.21.15.114:0/2248743996 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c025040 con 0x55ffe3e87580 2023-10-18T14:03:30.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.157+0000 7f908e7fc700 1 -- 172.21.15.114:0/2248743996 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f909c011df0 con 0x55ffe3e87580 2023-10-18T14:03:30.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.157+0000 7f908e7fc700 1 -- 172.21.15.114:0/2248743996 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c026e70 con 0x55ffe3e87580 2023-10-18T14:03:30.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.157+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2248743996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 msgr2=0x55ffe3e8ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.157+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2248743996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 0x55ffe3e8ade0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f909c0097e0 tx=0x7f909c014000 comp rx=0 tx=0).stop 2023-10-18T14:03:30.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.157+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2248743996 shutdown_connections 2023-10-18T14:03:30.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.157+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2248743996 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e9f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.157+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2248743996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 0x55ffe3e8ade0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.157+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2248743996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e90be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.157+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2248743996 >> 172.21.15.114:0/2248743996 conn(0x55ffe3dfb6d0 msgr2=0x55ffe3e8a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.157+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2248743996 shutdown_connections 2023-10-18T14:03:30.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.157+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2248743996 wait complete. 2023-10-18T14:03:30.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.157+0000 7f90ba1e7b80 1 -- start start 2023-10-18T14:03:30.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90ba1e7b80 1 Processor -- start 2023-10-18T14:03:30.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90ba1e7b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 0x55ffe3e9bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90ba1e7b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e9c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90ba1e7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e9c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90ba1e7b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe3ef4600 con 0x55ffe3e87580 2023-10-18T14:03:30.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90ba1e7b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe3ef4770 con 0x55ffe3e8cb90 2023-10-18T14:03:30.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90ba1e7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe3ef4930 con 0x55ffe3e8d4b0 2023-10-18T14:03:30.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90ba1e7b80 10 client.0 _ll_register_callbacks cb 0x55ffe3cc0a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:30.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90a77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 0x55ffe3e9bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90a77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 0x55ffe3e9bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43380/0 (socket says 172.21.15.114:43380) 2023-10-18T14:03:30.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90a77fe700 1 -- 172.21.15.114:0/2261841452 learned_addr learned my addr 172.21.15.114:0/2261841452 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:30.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90a77fe700 1 -- 172.21.15.114:0/2261841452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8d4b0 msgr2=0x55ffe3e9c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90a77fe700 1 --2- 172.21.15.114:0/2261841452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e9c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90a77fe700 1 -- 172.21.15.114:0/2261841452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e8cb90 msgr2=0x55ffe3e9c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90a77fe700 1 --2- 172.21.15.114:0/2261841452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e9c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90a77fe700 1 -- 172.21.15.114:0/2261841452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909c00ed60 con 0x55ffe3e87580 2023-10-18T14:03:30.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f90a77fe700 1 --2- 172.21.15.114:0/2261841452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 0x55ffe3e9bea0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f909c006010 tx=0x7f909c026730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428b24786fe6516 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:30.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f9086ffd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:30.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f9086ffd700 1 -- 172.21.15.114:0/2261841452 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c025040 con 0x55ffe3e87580 2023-10-18T14:03:30.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.158+0000 7f9086ffd700 1 -- 172.21.15.114:0/2261841452 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f909c011b30 con 0x55ffe3e87580 2023-10-18T14:03:30.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.159+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2261841452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ffe3ddeea0 con 0x55ffe3e87580 2023-10-18T14:03:30.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.159+0000 7f9086ffd700 1 -- 172.21.15.114:0/2261841452 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f909c026590 con 0x55ffe3e87580 2023-10-18T14:03:30.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.159+0000 7f90ba1e7b80 10 client.15297 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:30.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.159+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2261841452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ffe3c2b200 con 0x55ffe3e87580 2023-10-18T14:03:30.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.159+0000 7f9086ffd700 1 -- 172.21.15.114:0/2261841452 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ffe3ddeea0 con 0x55ffe3e87580 2023-10-18T14:03:30.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.159+0000 7f9086ffd700 1 -- 172.21.15.114:0/2261841452 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f909c020ab0 con 0x55ffe3e87580 2023-10-18T14:03:30.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.159+0000 7f90ba1e7b80 10 client.15297 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:30.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.159+0000 7f90ba1e7b80 10 client.15297 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-18T14:03:30.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.159+0000 7f90ba1e7b80 20 client.15297 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:30.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.159+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2261841452 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55ffe3ef9b40 0x55ffe3ef5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.159+0000 7f90ba1e7b80 4 client.15297 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T14:03:30.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.159+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2261841452 --> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ffe3dd2b20 con 0x55ffe3ef9b40 2023-10-18T14:03:30.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.159+0000 7f90a6ffd700 1 --2- 172.21.15.114:0/2261841452 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55ffe3ef9b40 0x55ffe3ef5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f9086ffd700 10 client.15297 ms_handle_connect on v2:172.21.15.172:6836/1821444438 2023-10-18T14:03:30.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f90a6ffd700 1 --2- 172.21.15.114:0/2261841452 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55ffe3ef9b40 0x55ffe3ef5f00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd78167378370b8c server_cookie=1503e9d013c75d55 in_seq=0 out_seq=0 2023-10-18T14:03:30.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f9086ffd700 1 -- 172.21.15.114:0/2261841452 <== mds.1 v2:172.21.15.172:6836/1821444438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55ffe3dd2b20 con 0x55ffe3ef9b40 2023-10-18T14:03:30.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f9086ffd700 10 client.15297 handle_command_reply: tid=0 2023-10-18T14:03:30.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f90ba1e7b80 1 client.15297 shutdown 2023-10-18T14:03:30.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2261841452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 msgr2=0x55ffe3e9bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2261841452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 0x55ffe3e9bea0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f909c006010 tx=0x7f909c026730 comp rx=0 tx=0).stop 2023-10-18T14:03:30.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2261841452 shutdown_connections 2023-10-18T14:03:30.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2261841452 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55ffe3ef9b40 0x55ffe3ef5f00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2261841452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ffe3e8d4b0 0x55ffe3e9c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f9086ffd700 0 client.15297 ms_handle_reset on v2:172.21.15.172:6836/1821444438 2023-10-18T14:03:30.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2261841452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ffe3e87580 0x55ffe3e9bea0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f90ba1e7b80 1 --2- 172.21.15.114:0/2261841452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ffe3e8cb90 0x55ffe3e9c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.160+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2261841452 >> 172.21.15.114:0/2261841452 conn(0x55ffe3dfb6d0 msgr2=0x55ffe3e9f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2261841452 shutdown_connections 2023-10-18T14:03:30.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90ba1e7b80 1 -- 172.21.15.114:0/2261841452 wait complete. 2023-10-18T14:03:30.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90ba1e7b80 20 client.15297 trim_cache size 0 max 16384 2023-10-18T14:03:30.184 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:03:30.184 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T14:03:30.185 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 1, 2023-10-18T14:03:30.185 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 24595, 2023-10-18T14:03:30.185 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-10-18T14:03:30.185 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-10-18T14:03:30.185 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-10-18T14:03:30.186 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 54.297162782999997, 2023-10-18T14:03:30.186 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 26, 2023-10-18T14:03:30.186 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 85, 2023-10-18T14:03:30.186 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 83, 2023-10-18T14:03:30.186 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 73.882382749000001 2023-10-18T14:03:30.186 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:03:30.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90adffe700 1 -- 172.21.15.114:0/1469026034 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f90900a1560 msgr2=0x7f90900a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90adffe700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f90900a1560 0x7f90900a3a20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f909c005d90 tx=0x7f909c005d00 comp rx=0 tx=0).stop 2023-10-18T14:03:30.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90adffe700 1 -- 172.21.15.114:0/1469026034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a81055f0 msgr2=0x7f90a81a2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90adffe700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a81055f0 0x7f90a81a2a00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f90a000d010 tx=0x7f90a00094f0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90adffe700 1 -- 172.21.15.114:0/1469026034 shutdown_connections 2023-10-18T14:03:30.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90adffe700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f90900a1560 0x7f90900a3a20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90adffe700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a81055f0 0x7f90a81a2a00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90adffe700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90a80ff530 0x7f90a8197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90adffe700 1 --2- 172.21.15.114:0/1469026034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90a80ffef0 0x7f90a8197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90adffe700 1 -- 172.21.15.114:0/1469026034 >> 172.21.15.114:0/1469026034 conn(0x7f90a80fb020 msgr2=0x7f90a80fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90adffe700 1 -- 172.21.15.114:0/1469026034 shutdown_connections 2023-10-18T14:03:30.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.161+0000 7f90adffe700 1 -- 172.21.15.114:0/1469026034 wait complete. 2023-10-18T14:03:30.190 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-18T14:03:30.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.309+0000 7f0351c4f700 1 -- 172.21.15.114:0/894868967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c100270 msgr2=0x7f034c10c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.309+0000 7f0351c4f700 1 --2- 172.21.15.114:0/894868967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c100270 0x7f034c10c450 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f034400b0a0 tx=0x7f034400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.309+0000 7f0351c4f700 1 -- 172.21.15.114:0/894868967 shutdown_connections 2023-10-18T14:03:30.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.309+0000 7f0351c4f700 1 --2- 172.21.15.114:0/894868967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c100270 0x7f034c10c450 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.309+0000 7f0351c4f700 1 --2- 172.21.15.114:0/894868967 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f034c105690 0x7f034c105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.309+0000 7f0351c4f700 1 --2- 172.21.15.114:0/894868967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f034c0ff8b0 0x7f034c0ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.309+0000 7f0351c4f700 1 -- 172.21.15.114:0/894868967 >> 172.21.15.114:0/894868967 conn(0x7f034c076430 msgr2=0x7f034c076840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.309+0000 7f0351c4f700 1 -- 172.21.15.114:0/894868967 shutdown_connections 2023-10-18T14:03:30.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.309+0000 7f0351c4f700 1 -- 172.21.15.114:0/894868967 wait complete. 2023-10-18T14:03:30.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f0351c4f700 1 Processor -- start 2023-10-18T14:03:30.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f0351c4f700 1 -- start start 2023-10-18T14:03:30.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f0351c4f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f034c0ff8b0 0x7f034c197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f0351c4f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f034c100270 0x7f034c198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f0351c4f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c105690 0x7f034c1a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f0351c4f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c1989d0 con 0x7f034c105690 2023-10-18T14:03:30.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f0351c4f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c1a3180 con 0x7f034c0ff8b0 2023-10-18T14:03:30.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f0351c4f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c1a32c0 con 0x7f034c100270 2023-10-18T14:03:30.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f034bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c105690 0x7f034c1a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f034bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c105690 0x7f034c1a2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43398/0 (socket says 172.21.15.114:43398) 2023-10-18T14:03:30.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f034bfff700 1 -- 172.21.15.114:0/3385117857 learned_addr learned my addr 172.21.15.114:0/3385117857 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:30.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f034affd700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f034c100270 0x7f034c198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f034bfff700 1 -- 172.21.15.114:0/3385117857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f034c100270 msgr2=0x7f034c198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.311+0000 7f034bfff700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f034c100270 0x7f034c198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.311+0000 7f034bfff700 1 -- 172.21.15.114:0/3385117857 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f034c0ff8b0 msgr2=0x7f034c197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.310+0000 7f034b7fe700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f034c0ff8b0 0x7f034c197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.311+0000 7f034bfff700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f034c0ff8b0 0x7f034c197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.311+0000 7f034bfff700 1 -- 172.21.15.114:0/3385117857 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344009d00 con 0x7f034c105690 2023-10-18T14:03:30.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.311+0000 7f034affd700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f034c100270 0x7f034c198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:30.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.311+0000 7f034b7fe700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f034c0ff8b0 0x7f034c197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:30.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.311+0000 7f034bfff700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c105690 0x7f034c1a2c40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0344007870 tx=0x7f0344007950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:30.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.311+0000 7f0348ff9700 1 -- 172.21.15.114:0/3385117857 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400e040 con 0x7f034c105690 2023-10-18T14:03:30.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.311+0000 7f0348ff9700 1 -- 172.21.15.114:0/3385117857 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0344009440 con 0x7f034c105690 2023-10-18T14:03:30.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.311+0000 7f0348ff9700 1 -- 172.21.15.114:0/3385117857 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034401b6b0 con 0x7f034c105690 2023-10-18T14:03:30.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.311+0000 7f0351c4f700 1 -- 172.21.15.114:0/3385117857 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c1a3540 con 0x7f034c105690 2023-10-18T14:03:30.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.311+0000 7f0351c4f700 1 -- 172.21.15.114:0/3385117857 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034c1a39c0 con 0x7f034c105690 2023-10-18T14:03:30.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.313+0000 7f0348ff9700 1 -- 172.21.15.114:0/3385117857 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f034401d480 con 0x7f034c105690 2023-10-18T14:03:30.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.313+0000 7f0348ff9700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f03380a15e0 0x7f03380a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.314+0000 7f034b7fe700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f03380a15e0 0x7f03380a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.314+0000 7f0348ff9700 1 -- 172.21.15.114:0/3385117857 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f03440ce510 con 0x7f034c105690 2023-10-18T14:03:30.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.314+0000 7f034b7fe700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f03380a15e0 0x7f03380a3aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f033c007900 tx=0x7f033c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:30.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.314+0000 7f035de38b80 1 Processor -- start 2023-10-18T14:03:30.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.314+0000 7f035de38b80 1 -- start start 2023-10-18T14:03:30.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.314+0000 7f035de38b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9dfb90 0x55d26e9dff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.314+0000 7f035de38b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 0x55d26e9da040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.314+0000 7f035de38b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 0x55d26e9daa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.314+0000 7f035de38b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26e94d690 con 0x55d26e9e04b0 2023-10-18T14:03:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.314+0000 7f035de38b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26e933c10 con 0x55d26e9dfb90 2023-10-18T14:03:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.314+0000 7f035de38b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26e931530 con 0x55d26e9da580 2023-10-18T14:03:30.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f034affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 0x55d26e9da040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f034affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 0x55d26e9da040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43404/0 (socket says 172.21.15.114:43404) 2023-10-18T14:03:30.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f034affd700 1 -- 172.21.15.114:0/2756121529 learned_addr learned my addr 172.21.15.114:0/2756121529 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:30.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f034bfff700 1 --2- 172.21.15.114:0/2756121529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 0x55d26e9daa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f034b7fe700 1 --2- 172.21.15.114:0/2756121529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9dfb90 0x55d26e9dff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f034affd700 1 -- 172.21.15.114:0/2756121529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 msgr2=0x55d26e9daa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f034affd700 1 --2- 172.21.15.114:0/2756121529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 0x55d26e9daa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f034affd700 1 -- 172.21.15.114:0/2756121529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9dfb90 msgr2=0x55d26e9dff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f034affd700 1 --2- 172.21.15.114:0/2756121529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9dfb90 0x55d26e9dff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f034affd700 1 -- 172.21.15.114:0/2756121529 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d26e8ea3a0 con 0x55d26e9e04b0 2023-10-18T14:03:30.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f034affd700 1 --2- 172.21.15.114:0/2756121529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 0x55d26e9da040 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f033400bd30 tx=0x7f033400f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3544633d6678f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:30.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f0341ffb700 1 -- 172.21.15.114:0/2756121529 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033400fda0 con 0x55d26e9e04b0 2023-10-18T14:03:30.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f0341ffb700 1 -- 172.21.15.114:0/2756121529 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f033400be80 con 0x55d26e9e04b0 2023-10-18T14:03:30.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.315+0000 7f0341ffb700 1 -- 172.21.15.114:0/2756121529 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033401b750 con 0x55d26e9e04b0 2023-10-18T14:03:30.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.316+0000 7f035de38b80 1 -- 172.21.15.114:0/2756121529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 msgr2=0x55d26e9da040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.316+0000 7f035de38b80 1 --2- 172.21.15.114:0/2756121529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 0x55d26e9da040 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f033400bd30 tx=0x7f033400f640 comp rx=0 tx=0).stop 2023-10-18T14:03:30.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.316+0000 7f035de38b80 1 -- 172.21.15.114:0/2756121529 shutdown_connections 2023-10-18T14:03:30.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.316+0000 7f035de38b80 1 --2- 172.21.15.114:0/2756121529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 0x55d26e9daa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.316+0000 7f035de38b80 1 --2- 172.21.15.114:0/2756121529 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9dfb90 0x55d26e9dff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.316+0000 7f035de38b80 1 --2- 172.21.15.114:0/2756121529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 0x55d26e9da040 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.316+0000 7f035de38b80 1 -- 172.21.15.114:0/2756121529 >> 172.21.15.114:0/2756121529 conn(0x55d26e94e6d0 msgr2=0x55d26e9d4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.316+0000 7f035de38b80 1 -- 172.21.15.114:0/2756121529 shutdown_connections 2023-10-18T14:03:30.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.316+0000 7f035de38b80 1 -- 172.21.15.114:0/2756121529 wait complete. 2023-10-18T14:03:30.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.316+0000 7f035de38b80 1 -- start start 2023-10-18T14:03:30.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.316+0000 7f035de38b80 1 Processor -- start 2023-10-18T14:03:30.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f035de38b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 0x55d26e9e3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f035de38b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9dfb90 0x55d26e9e3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f035de38b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 0x55d26e9e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f035de38b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26e92ce20 con 0x55d26e9e04b0 2023-10-18T14:03:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f035de38b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26e8c96c0 con 0x55d26e9dfb90 2023-10-18T14:03:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f035de38b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26e8c9360 con 0x55d26e9da580 2023-10-18T14:03:30.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f035de38b80 10 client.0 _ll_register_callbacks cb 0x55d26e813a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:30.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f034bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 0x55d26e9e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f034bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 0x55d26e9e41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43412/0 (socket says 172.21.15.114:43412) 2023-10-18T14:03:30.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f034bfff700 1 -- 172.21.15.114:0/752130601 learned_addr learned my addr 172.21.15.114:0/752130601 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:30.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f034affd700 1 --2- 172.21.15.114:0/752130601 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9dfb90 0x55d26e9e3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f034b7fe700 1 --2- 172.21.15.114:0/752130601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 0x55d26e9e3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f034bfff700 1 -- 172.21.15.114:0/752130601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 msgr2=0x55d26e9e3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f034bfff700 1 --2- 172.21.15.114:0/752130601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 0x55d26e9e3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f034bfff700 1 -- 172.21.15.114:0/752130601 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9dfb90 msgr2=0x55d26e9e3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f034bfff700 1 --2- 172.21.15.114:0/752130601 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9dfb90 0x55d26e9e3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f034bfff700 1 -- 172.21.15.114:0/752130601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033400b960 con 0x55d26e9e04b0 2023-10-18T14:03:30.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f034bfff700 1 --2- 172.21.15.114:0/752130601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 0x55d26e9e41d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0344098130 tx=0x7f03440099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59290e37c8513b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:30.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f032affd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:30.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f032affd700 1 -- 172.21.15.114:0/752130601 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0344024360 con 0x55d26e9e04b0 2023-10-18T14:03:30.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f032affd700 1 -- 172.21.15.114:0/752130601 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f034409bdc0 con 0x55d26e9e04b0 2023-10-18T14:03:30.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.317+0000 7f035de38b80 1 -- 172.21.15.114:0/752130601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d26e9a9860 con 0x55d26e9e04b0 2023-10-18T14:03:30.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.318+0000 7f032affd700 1 -- 172.21.15.114:0/752130601 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f034409b6c0 con 0x55d26e9e04b0 2023-10-18T14:03:30.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.318+0000 7f035de38b80 10 client.15309 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:30.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.318+0000 7f035de38b80 1 -- 172.21.15.114:0/752130601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d26e757d90 con 0x55d26e9e04b0 2023-10-18T14:03:30.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.318+0000 7f032affd700 1 -- 172.21.15.114:0/752130601 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d26e9a9860 con 0x55d26e9e04b0 2023-10-18T14:03:30.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.318+0000 7f032affd700 1 -- 172.21.15.114:0/752130601 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f034409abb0 con 0x55d26e9e04b0 2023-10-18T14:03:30.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.318+0000 7f035de38b80 10 client.15309 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:30.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.318+0000 7f035de38b80 10 client.15309 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-18T14:03:30.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.318+0000 7f035de38b80 20 client.15309 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:30.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.318+0000 7f035de38b80 1 --2- 172.21.15.114:0/752130601 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d26e9f3c90 0x55d26e9f2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.318+0000 7f035de38b80 4 client.15309 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:03:30.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.318+0000 7f035de38b80 1 -- 172.21.15.114:0/752130601 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d26e925e00 con 0x55d26e9f3c90 2023-10-18T14:03:30.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.318+0000 7f034b7fe700 1 --2- 172.21.15.114:0/752130601 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d26e9f3c90 0x55d26e9f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.319+0000 7f032affd700 10 client.15309 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:03:30.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.319+0000 7f034b7fe700 1 --2- 172.21.15.114:0/752130601 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d26e9f3c90 0x55d26e9f2810 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67dfa49d77e3e0e server_cookie=d2cb071e53581307 in_seq=0 out_seq=0 2023-10-18T14:03:30.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.319+0000 7f032affd700 1 -- 172.21.15.114:0/752130601 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d26e925e00 con 0x55d26e9f3c90 2023-10-18T14:03:30.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.319+0000 7f032affd700 10 client.15309 handle_command_reply: tid=0 2023-10-18T14:03:30.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.319+0000 7f035de38b80 1 client.15309 shutdown 2023-10-18T14:03:30.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.320+0000 7f035de38b80 1 -- 172.21.15.114:0/752130601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 msgr2=0x55d26e9e41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.320+0000 7f035de38b80 1 --2- 172.21.15.114:0/752130601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 0x55d26e9e41d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0344098130 tx=0x7f03440099e0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.320+0000 7f035de38b80 1 -- 172.21.15.114:0/752130601 shutdown_connections 2023-10-18T14:03:30.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.320+0000 7f035de38b80 1 --2- 172.21.15.114:0/752130601 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d26e9f3c90 0x55d26e9f2810 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.320+0000 7f035de38b80 1 --2- 172.21.15.114:0/752130601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9e04b0 0x55d26e9e41d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.320+0000 7f035de38b80 1 --2- 172.21.15.114:0/752130601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 0x55d26e9e3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.320+0000 7f032affd700 0 client.15309 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:03:30.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.320+0000 7f035de38b80 1 --2- 172.21.15.114:0/752130601 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9dfb90 0x55d26e9e3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.320+0000 7f035de38b80 1 -- 172.21.15.114:0/752130601 >> 172.21.15.114:0/752130601 conn(0x55d26e94e6d0 msgr2=0x55d26e9d9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.320+0000 7f035de38b80 1 -- 172.21.15.114:0/752130601 shutdown_connections 2023-10-18T14:03:30.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.320+0000 7f035de38b80 1 -- 172.21.15.114:0/752130601 wait complete. 2023-10-18T14:03:30.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.320+0000 7f035de38b80 20 client.15309 trim_cache size 0 max 16384 2023-10-18T14:03:30.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.337+0000 7f035de38b80 1 Processor -- start 2023-10-18T14:03:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.337+0000 7f035de38b80 1 -- start start 2023-10-18T14:03:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f035de38b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 0x55d26e9f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f035de38b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9dfb90 0x55d26e9e3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f035de38b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9e04b0 0x55d26e9ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f035de38b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26e7ad8d0 con 0x55d26e9dfb90 2023-10-18T14:03:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f035de38b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26e9e6c40 con 0x55d26e9e04b0 2023-10-18T14:03:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f035de38b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26e925e00 con 0x55d26e9da580 2023-10-18T14:03:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f034affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9dfb90 0x55d26e9e3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f034affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9dfb90 0x55d26e9e3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43418/0 (socket says 172.21.15.114:43418) 2023-10-18T14:03:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f034affd700 1 -- 172.21.15.114:0/742478855 learned_addr learned my addr 172.21.15.114:0/742478855 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:30.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f034bfff700 1 --2- 172.21.15.114:0/742478855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9e04b0 0x55d26e9ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f034b7fe700 1 --2- 172.21.15.114:0/742478855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 0x55d26e9f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f034affd700 1 -- 172.21.15.114:0/742478855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 msgr2=0x55d26e9f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f034affd700 1 --2- 172.21.15.114:0/742478855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 0x55d26e9f2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f034affd700 1 -- 172.21.15.114:0/742478855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9e04b0 msgr2=0x55d26e9ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f034affd700 1 --2- 172.21.15.114:0/742478855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9e04b0 0x55d26e9ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f034affd700 1 -- 172.21.15.114:0/742478855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d26e740c10 con 0x55d26e9dfb90 2023-10-18T14:03:30.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f034affd700 1 --2- 172.21.15.114:0/742478855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9dfb90 0x55d26e9e3050 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f033400bd30 tx=0x7f0334000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41de756860637239 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:30.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f03427fc700 1 -- 172.21.15.114:0/742478855 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033400fda0 con 0x55d26e9dfb90 2023-10-18T14:03:30.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f03427fc700 1 -- 172.21.15.114:0/742478855 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0334021040 con 0x55d26e9dfb90 2023-10-18T14:03:30.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.338+0000 7f03427fc700 1 -- 172.21.15.114:0/742478855 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0334003be0 con 0x55d26e9dfb90 2023-10-18T14:03:30.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.339+0000 7f035de38b80 1 -- 172.21.15.114:0/742478855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9dfb90 msgr2=0x55d26e9e3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.339+0000 7f035de38b80 1 --2- 172.21.15.114:0/742478855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9dfb90 0x55d26e9e3050 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f033400bd30 tx=0x7f0334000bc0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.339+0000 7f035de38b80 1 -- 172.21.15.114:0/742478855 shutdown_connections 2023-10-18T14:03:30.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.339+0000 7f035de38b80 1 --2- 172.21.15.114:0/742478855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9e04b0 0x55d26e9ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.339+0000 7f035de38b80 1 --2- 172.21.15.114:0/742478855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9da580 0x55d26e9f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.339+0000 7f035de38b80 1 --2- 172.21.15.114:0/742478855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9dfb90 0x55d26e9e3050 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.339+0000 7f035de38b80 1 -- 172.21.15.114:0/742478855 >> 172.21.15.114:0/742478855 conn(0x55d26e94e6d0 msgr2=0x55d26e9ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.339+0000 7f035de38b80 1 -- 172.21.15.114:0/742478855 shutdown_connections 2023-10-18T14:03:30.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.339+0000 7f035de38b80 1 -- 172.21.15.114:0/742478855 wait complete. 2023-10-18T14:03:30.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.339+0000 7f035de38b80 1 -- start start 2023-10-18T14:03:30.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f035de38b80 1 Processor -- start 2023-10-18T14:03:30.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f035de38b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9da580 0x55d26e9e2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f035de38b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9dfb90 0x55d26e9e2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f035de38b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9e04b0 0x55d26e9e2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f035de38b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26ea4b840 con 0x55d26e9da580 2023-10-18T14:03:30.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f035de38b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26ea4b9b0 con 0x55d26e9e04b0 2023-10-18T14:03:30.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f035de38b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d26ea4bb70 con 0x55d26e9dfb90 2023-10-18T14:03:30.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f035de38b80 10 client.0 _ll_register_callbacks cb 0x55d26e813a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:30.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f034b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9da580 0x55d26e9e2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f034b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9da580 0x55d26e9e2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43422/0 (socket says 172.21.15.114:43422) 2023-10-18T14:03:30.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f034b7fe700 1 -- 172.21.15.114:0/404711315 learned_addr learned my addr 172.21.15.114:0/404711315 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:30.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f034affd700 1 --2- 172.21.15.114:0/404711315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9dfb90 0x55d26e9e2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f034bfff700 1 --2- 172.21.15.114:0/404711315 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9e04b0 0x55d26e9e2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f034b7fe700 1 -- 172.21.15.114:0/404711315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9dfb90 msgr2=0x55d26e9e2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f034b7fe700 1 --2- 172.21.15.114:0/404711315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9dfb90 0x55d26e9e2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f034b7fe700 1 -- 172.21.15.114:0/404711315 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9e04b0 msgr2=0x55d26e9e2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:30.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f034b7fe700 1 --2- 172.21.15.114:0/404711315 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9e04b0 0x55d26e9e2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f034b7fe700 1 -- 172.21.15.114:0/404711315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d26e8ea3a0 con 0x55d26e9da580 2023-10-18T14:03:30.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f034b7fe700 1 --2- 172.21.15.114:0/404711315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9da580 0x55d26e9e2040 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f033c0071b0 tx=0x7f033c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b6758a32e6fe77 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:30.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f032affd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:30.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.340+0000 7f032affd700 1 -- 172.21.15.114:0/404711315 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c013830 con 0x55d26e9da580 2023-10-18T14:03:30.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f032affd700 1 -- 172.21.15.114:0/404711315 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f033c013990 con 0x55d26e9da580 2023-10-18T14:03:30.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f035de38b80 1 -- 172.21.15.114:0/404711315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d26e931ea0 con 0x55d26e9da580 2023-10-18T14:03:30.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f032affd700 1 -- 172.21.15.114:0/404711315 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f033c013b50 con 0x55d26e9da580 2023-10-18T14:03:30.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f035de38b80 10 client.15315 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:30.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f035de38b80 1 -- 172.21.15.114:0/404711315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d26e77e200 con 0x55d26e9da580 2023-10-18T14:03:30.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f032affd700 1 -- 172.21.15.114:0/404711315 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d26e931ea0 con 0x55d26e9da580 2023-10-18T14:03:30.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f032affd700 1 -- 172.21.15.114:0/404711315 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f033c037400 con 0x55d26e9da580 2023-10-18T14:03:30.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f035de38b80 10 client.15315 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:30.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f035de38b80 10 client.15315 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-18T14:03:30.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f035de38b80 20 client.15315 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f035de38b80 1 --2- 172.21.15.114:0/404711315 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d26ea50f10 0x55d26ea4d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f035de38b80 4 client.15315 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T14:03:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f035de38b80 1 -- 172.21.15.114:0/404711315 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d26e925b20 con 0x55d26ea50f10 2023-10-18T14:03:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.341+0000 7f034affd700 1 --2- 172.21.15.114:0/404711315 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d26ea50f10 0x55d26ea4d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f032affd700 10 client.15315 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:03:30.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f034affd700 1 --2- 172.21.15.114:0/404711315 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d26ea50f10 0x55d26ea4d2f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d628d302cbd63c9 server_cookie=694d3c3c7628133f in_seq=0 out_seq=0 2023-10-18T14:03:30.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f032affd700 1 -- 172.21.15.114:0/404711315 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55d26e925b20 con 0x55d26ea50f10 2023-10-18T14:03:30.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f032affd700 10 client.15315 handle_command_reply: tid=0 2023-10-18T14:03:30.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f035de38b80 1 client.15315 shutdown 2023-10-18T14:03:30.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f035de38b80 1 -- 172.21.15.114:0/404711315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9da580 msgr2=0x55d26e9e2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f035de38b80 1 --2- 172.21.15.114:0/404711315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9da580 0x55d26e9e2040 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f033c0071b0 tx=0x7f033c004750 comp rx=0 tx=0).stop 2023-10-18T14:03:30.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f035de38b80 1 -- 172.21.15.114:0/404711315 shutdown_connections 2023-10-18T14:03:30.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f035de38b80 1 --2- 172.21.15.114:0/404711315 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d26ea50f10 0x55d26ea4d2f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f035de38b80 1 --2- 172.21.15.114:0/404711315 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d26e9e04b0 0x55d26e9e2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f032affd700 0 client.15315 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:03:30.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f035de38b80 1 --2- 172.21.15.114:0/404711315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d26e9da580 0x55d26e9e2040 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f035de38b80 1 --2- 172.21.15.114:0/404711315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d26e9dfb90 0x55d26e9e2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f035de38b80 1 -- 172.21.15.114:0/404711315 >> 172.21.15.114:0/404711315 conn(0x55d26e94e6d0 msgr2=0x55d26e9ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f035de38b80 1 -- 172.21.15.114:0/404711315 shutdown_connections 2023-10-18T14:03:30.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f035de38b80 1 -- 172.21.15.114:0/404711315 wait complete. 2023-10-18T14:03:30.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.342+0000 7f035de38b80 20 client.15315 trim_cache size 0 max 16384 2023-10-18T14:03:30.367 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:03:30.367 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T14:03:30.367 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-10-18T14:03:30.367 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 24616, 2023-10-18T14:03:30.368 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-10-18T14:03:30.368 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-10-18T14:03:30.368 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-10-18T14:03:30.368 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 57.500195494000003, 2023-10-18T14:03:30.368 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 26, 2023-10-18T14:03:30.368 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 85, 2023-10-18T14:03:30.369 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 83, 2023-10-18T14:03:30.369 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 69.414779972999995 2023-10-18T14:03:30.369 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:03:30.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.343+0000 7f0351c4f700 1 -- 172.21.15.114:0/3385117857 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f03380a15e0 msgr2=0x7f03380a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.343+0000 7f0351c4f700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f03380a15e0 0x7f03380a3aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f033c007900 tx=0x7f033c008040 comp rx=0 tx=0).stop 2023-10-18T14:03:30.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.343+0000 7f0351c4f700 1 -- 172.21.15.114:0/3385117857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c105690 msgr2=0x7f034c1a2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:30.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.343+0000 7f0351c4f700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c105690 0x7f034c1a2c40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0344007870 tx=0x7f0344007950 comp rx=0 tx=0).stop 2023-10-18T14:03:30.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.343+0000 7f0351c4f700 1 -- 172.21.15.114:0/3385117857 shutdown_connections 2023-10-18T14:03:30.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.343+0000 7f0351c4f700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f03380a15e0 0x7f03380a3aa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.343+0000 7f0351c4f700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c105690 0x7f034c1a2c40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.343+0000 7f0351c4f700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f034c0ff8b0 0x7f034c197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.343+0000 7f0351c4f700 1 --2- 172.21.15.114:0/3385117857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f034c100270 0x7f034c198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:30.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.343+0000 7f0351c4f700 1 -- 172.21.15.114:0/3385117857 >> 172.21.15.114:0/3385117857 conn(0x7f034c076430 msgr2=0x7f034c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:30.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.343+0000 7f0351c4f700 1 -- 172.21.15.114:0/3385117857 shutdown_connections 2023-10-18T14:03:30.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:30.343+0000 7f0351c4f700 1 -- 172.21.15.114:0/3385117857 wait complete. 2023-10-18T14:03:30.373 INFO:tasks.cephadm:Setup complete, yielding 2023-10-18T14:03:30.373 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-18T14:03:30.383 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T14:03:30.384 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-18T14:03:30.939 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:31.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:30 smithi158 ceph-mon[103317]: pgmap v264: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:31.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:30 smithi172 ceph-mon[103574]: pgmap v264: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:30 smithi114 ceph-mon[99494]: pgmap v264: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.155+0000 7fdcca067700 1 -- 172.21.15.114:0/1304792795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc41000a0 msgr2=0x7fdcc410c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.155+0000 7fdcca067700 1 --2- 172.21.15.114:0/1304792795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc41000a0 0x7fdcc410c540 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00b0a0 tx=0x7fdcbc00b3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.155+0000 7fdcca067700 1 -- 172.21.15.114:0/1304792795 shutdown_connections 2023-10-18T14:03:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.155+0000 7fdcca067700 1 --2- 172.21.15.114:0/1304792795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc41000a0 0x7fdcc410c540 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.155+0000 7fdcca067700 1 --2- 172.21.15.114:0/1304792795 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdcc41045b0 0x7fdcc4104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.155+0000 7fdcca067700 1 --2- 172.21.15.114:0/1304792795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc40ff6e0 0x7fdcc40ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.155+0000 7fdcca067700 1 -- 172.21.15.114:0/1304792795 >> 172.21.15.114:0/1304792795 conn(0x7fdcc40766c0 msgr2=0x7fdcc4076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.156+0000 7fdcca067700 1 -- 172.21.15.114:0/1304792795 shutdown_connections 2023-10-18T14:03:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.156+0000 7fdcca067700 1 -- 172.21.15.114:0/1304792795 wait complete. 2023-10-18T14:03:32.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.156+0000 7fdcca067700 1 Processor -- start 2023-10-18T14:03:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.156+0000 7fdcca067700 1 -- start start 2023-10-18T14:03:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.156+0000 7fdcca067700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc40ff6e0 0x7fdcc4197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.156+0000 7fdcca067700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc41000a0 0x7fdcc41981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcca067700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdcc41045b0 0x7fdcc41a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcca067700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4198a70 con 0x7fdcc41000a0 2023-10-18T14:03:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcca067700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc41a3230 con 0x7fdcc41045b0 2023-10-18T14:03:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcca067700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc41a3370 con 0x7fdcc40ff6e0 2023-10-18T14:03:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc2ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc41000a0 0x7fdcc41981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc2ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc41000a0 0x7fdcc41981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43438/0 (socket says 172.21.15.114:43438) 2023-10-18T14:03:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc2ffd700 1 -- 172.21.15.114:0/1990745763 learned_addr learned my addr 172.21.15.114:0/1990745763 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc3fff700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdcc41045b0 0x7fdcc41a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc37fe700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc40ff6e0 0x7fdcc4197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc2ffd700 1 -- 172.21.15.114:0/1990745763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc40ff6e0 msgr2=0x7fdcc4197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc2ffd700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc40ff6e0 0x7fdcc4197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc2ffd700 1 -- 172.21.15.114:0/1990745763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdcc41045b0 msgr2=0x7fdcc41a2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc2ffd700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdcc41045b0 0x7fdcc41a2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc2ffd700 1 -- 172.21.15.114:0/1990745763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc009d00 con 0x7fdcc41000a0 2023-10-18T14:03:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc2ffd700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc41000a0 0x7fdcc41981b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800b530 tx=0x7fdcb800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc0ff9700 1 -- 172.21.15.114:0/1990745763 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8011830 con 0x7fdcc41000a0 2023-10-18T14:03:32.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcca067700 1 -- 172.21.15.114:0/1990745763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc41a35f0 con 0x7fdcc41000a0 2023-10-18T14:03:32.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc0ff9700 1 -- 172.21.15.114:0/1990745763 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcb8011e50 con 0x7fdcc41000a0 2023-10-18T14:03:32.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcc0ff9700 1 -- 172.21.15.114:0/1990745763 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800f2e0 con 0x7fdcc41000a0 2023-10-18T14:03:32.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.157+0000 7fdcca067700 1 -- 172.21.15.114:0/1990745763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc41a3af0 con 0x7fdcc41000a0 2023-10-18T14:03:32.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.158+0000 7fdcca067700 1 -- 172.21.15.114:0/1990745763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc4107c20 con 0x7fdcc41000a0 2023-10-18T14:03:32.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.159+0000 7fdcc0ff9700 1 -- 172.21.15.114:0/1990745763 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fdcb8010380 con 0x7fdcc41000a0 2023-10-18T14:03:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.160+0000 7fdcc0ff9700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdcac0a1560 0x7fdcac0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.160+0000 7fdcc37fe700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdcac0a1560 0x7fdcac0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.160+0000 7fdcc0ff9700 1 -- 172.21.15.114:0/1990745763 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fdcb80cca20 con 0x7fdcc41000a0 2023-10-18T14:03:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.160+0000 7fdcc37fe700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdcac0a1560 0x7fdcac0a3a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4006fd0 tx=0x7fdcb4008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:32.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.164+0000 7fdcc0ff9700 1 -- 172.21.15.114:0/1990745763 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdcb8095f90 con 0x7fdcc41000a0 2023-10-18T14:03:32.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.370+0000 7fdcca067700 1 -- 172.21.15.114:0/1990745763 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcc4069020 con 0x7fdcac0a1560 2023-10-18T14:03:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.371+0000 7fdcc0ff9700 1 -- 172.21.15.114:0/1990745763 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fdcc4069020 con 0x7fdcac0a1560 2023-10-18T14:03:32.375 INFO:teuthology.orchestra.run.smithi114.stdout:Backend: cephadm 2023-10-18T14:03:32.375 INFO:teuthology.orchestra.run.smithi114.stdout:Available: Yes 2023-10-18T14:03:32.375 INFO:teuthology.orchestra.run.smithi114.stdout:Paused: No 2023-10-18T14:03:32.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.372+0000 7fdcca067700 1 -- 172.21.15.114:0/1990745763 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdcac0a1560 msgr2=0x7fdcac0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:32.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.372+0000 7fdcca067700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdcac0a1560 0x7fdcac0a3a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4006fd0 tx=0x7fdcb4008040 comp rx=0 tx=0).stop 2023-10-18T14:03:32.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.372+0000 7fdcca067700 1 -- 172.21.15.114:0/1990745763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc41000a0 msgr2=0x7fdcc41981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:32.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.372+0000 7fdcca067700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc41000a0 0x7fdcc41981b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800b530 tx=0x7fdcb800b840 comp rx=0 tx=0).stop 2023-10-18T14:03:32.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.373+0000 7fdcca067700 1 -- 172.21.15.114:0/1990745763 shutdown_connections 2023-10-18T14:03:32.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.373+0000 7fdcca067700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdcac0a1560 0x7fdcac0a3a20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:32.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.373+0000 7fdcca067700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdcc41045b0 0x7fdcc41a2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:32.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.373+0000 7fdcca067700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc40ff6e0 0x7fdcc4197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:32.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.373+0000 7fdcca067700 1 --2- 172.21.15.114:0/1990745763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc41000a0 0x7fdcc41981b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:32.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.373+0000 7fdcca067700 1 -- 172.21.15.114:0/1990745763 >> 172.21.15.114:0/1990745763 conn(0x7fdcc40766c0 msgr2=0x7fdcc40fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:32.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.373+0000 7fdcca067700 1 -- 172.21.15.114:0/1990745763 shutdown_connections 2023-10-18T14:03:32.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:32.373+0000 7fdcca067700 1 -- 172.21.15.114:0/1990745763 wait complete. 2023-10-18T14:03:32.793 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-18T14:03:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:32 smithi158 ceph-mon[103317]: pgmap v265: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-18T14:03:33.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:32 smithi172 ceph-mon[103574]: pgmap v265: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-18T14:03:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:32 smithi114 ceph-mon[99494]: pgmap v265: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-18T14:03:33.353 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:33.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:33 smithi114 ceph-mon[99494]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:34.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:33 smithi158 ceph-mon[103317]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:34.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:33 smithi172 ceph-mon[103574]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:34.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.537+0000 7f8e71da0700 1 -- 172.21.15.114:0/4216792352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e6c1058d0 msgr2=0x7f8e6c105cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:34.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.537+0000 7f8e71da0700 1 --2- 172.21.15.114:0/4216792352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e6c1058d0 0x7f8e6c105cb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009990 tx=0x7f8e5c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:34.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.537+0000 7f8e71da0700 1 -- 172.21.15.114:0/4216792352 shutdown_connections 2023-10-18T14:03:34.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.537+0000 7f8e71da0700 1 --2- 172.21.15.114:0/4216792352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e6c0ffb30 0x7f8e6c10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:34.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.537+0000 7f8e71da0700 1 --2- 172.21.15.114:0/4216792352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e6c1058d0 0x7f8e6c105cb0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:34.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.537+0000 7f8e71da0700 1 --2- 172.21.15.114:0/4216792352 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e6c0ff190 0x7f8e6c0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:34.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.538+0000 7f8e71da0700 1 -- 172.21.15.114:0/4216792352 >> 172.21.15.114:0/4216792352 conn(0x7f8e6c074a10 msgr2=0x7f8e6c074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:34.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.538+0000 7f8e71da0700 1 -- 172.21.15.114:0/4216792352 shutdown_connections 2023-10-18T14:03:34.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.538+0000 7f8e71da0700 1 -- 172.21.15.114:0/4216792352 wait complete. 2023-10-18T14:03:34.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.538+0000 7f8e71da0700 1 Processor -- start 2023-10-18T14:03:34.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.538+0000 7f8e71da0700 1 -- start start 2023-10-18T14:03:34.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.538+0000 7f8e71da0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e6c0ff190 0x7f8e6c100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:34.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.538+0000 7f8e71da0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e6c0ffb30 0x7f8e6c1008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:34.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e71da0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e6c1058d0 0x7f8e6c100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:34.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e71da0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c1a4f90 con 0x7f8e6c1058d0 2023-10-18T14:03:34.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e71da0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c1a5100 con 0x7f8e6c0ffb30 2023-10-18T14:03:34.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e71da0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c1a52c0 con 0x7f8e6c0ff190 2023-10-18T14:03:34.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e6bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e6c1058d0 0x7f8e6c100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:34.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e6bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e6c1058d0 0x7f8e6c100df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43454/0 (socket says 172.21.15.114:43454) 2023-10-18T14:03:34.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e6bfff700 1 -- 172.21.15.114:0/3417779593 learned_addr learned my addr 172.21.15.114:0/3417779593 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:34.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e6affd700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e6c0ffb30 0x7f8e6c1008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:34.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e6b7fe700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e6c0ff190 0x7f8e6c100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:34.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e6bfff700 1 -- 172.21.15.114:0/3417779593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e6c0ff190 msgr2=0x7f8e6c100370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:34.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e6bfff700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e6c0ff190 0x7f8e6c100370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:34.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e6bfff700 1 -- 172.21.15.114:0/3417779593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e6c0ffb30 msgr2=0x7f8e6c1008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:34.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e6bfff700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e6c0ffb30 0x7f8e6c1008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:34.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e6bfff700 1 -- 172.21.15.114:0/3417779593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c0095f0 con 0x7f8e6c1058d0 2023-10-18T14:03:34.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e6affd700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e6c0ffb30 0x7f8e6c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:03:34.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e6bfff700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e6c1058d0 0x7f8e6c100df0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8e640094f0 tx=0x7f8e6400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:34.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e68ff9700 1 -- 172.21.15.114:0/3417779593 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64004db0 con 0x7f8e6c1058d0 2023-10-18T14:03:34.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e71da0700 1 -- 172.21.15.114:0/3417779593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6c1a55a0 con 0x7f8e6c1058d0 2023-10-18T14:03:34.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e68ff9700 1 -- 172.21.15.114:0/3417779593 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e6400f040 con 0x7f8e6c1058d0 2023-10-18T14:03:34.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e68ff9700 1 -- 172.21.15.114:0/3417779593 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64005980 con 0x7f8e6c1058d0 2023-10-18T14:03:34.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.539+0000 7f8e71da0700 1 -- 172.21.15.114:0/3417779593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c1a5a50 con 0x7f8e6c1058d0 2023-10-18T14:03:34.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.540+0000 7f8e71da0700 1 -- 172.21.15.114:0/3417779593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6c108d30 con 0x7f8e6c1058d0 2023-10-18T14:03:34.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.541+0000 7f8e68ff9700 1 -- 172.21.15.114:0/3417779593 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f8e64005000 con 0x7f8e6c1058d0 2023-10-18T14:03:34.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.542+0000 7f8e68ff9700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8e540a1560 0x7f8e540a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:34.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.542+0000 7f8e68ff9700 1 -- 172.21.15.114:0/3417779593 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8e640cd040 con 0x7f8e6c1058d0 2023-10-18T14:03:34.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.542+0000 7f8e6b7fe700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8e540a1560 0x7f8e540a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:34.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.542+0000 7f8e6b7fe700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8e540a1560 0x7f8e540a3a20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c006010 tx=0x7f8e5c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:34.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.545+0000 7f8e68ff9700 1 -- 172.21.15.114:0/3417779593 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8e640964a0 con 0x7f8e6c1058d0 2023-10-18T14:03:34.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.756+0000 7f8e71da0700 1 -- 172.21.15.114:0/3417779593 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e6c101850 con 0x7f8e540a1560 2023-10-18T14:03:34.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.772+0000 7f8e68ff9700 1 -- 172.21.15.114:0/3417779593 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f8e6c101850 con 0x7f8e540a1560 2023-10-18T14:03:34.775 INFO:teuthology.orchestra.run.smithi114.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-18T14:03:34.775 INFO:teuthology.orchestra.run.smithi114.stdout:mds.a smithi114 running (69s) 60s ago 69s 13.5M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 dc0173111c4f 2023-10-18T14:03:34.775 INFO:teuthology.orchestra.run.smithi114.stdout:mds.b smithi158 running (67s) 60s ago 66s 16.0M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 1112236ce61f 2023-10-18T14:03:34.776 INFO:teuthology.orchestra.run.smithi114.stdout:mds.c smithi172 running (78s) 60s ago 78s 14.0M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 d80c468d469e 2023-10-18T14:03:34.776 INFO:teuthology.orchestra.run.smithi114.stdout:mds.d smithi114 running (85s) 60s ago 85s 15.7M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 069e54200366 2023-10-18T14:03:34.776 INFO:teuthology.orchestra.run.smithi114.stdout:mds.e smithi158 running (83s) 60s ago 82s 14.4M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 169cb03f9a54 2023-10-18T14:03:34.776 INFO:teuthology.orchestra.run.smithi114.stdout:mds.f smithi172 running (81s) 60s ago 80s 16.9M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 8dd87496bf30 2023-10-18T14:03:34.776 INFO:teuthology.orchestra.run.smithi114.stdout:mds.g smithi114 running (72s) 60s ago 71s 16.8M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 c17de26a1ec8 2023-10-18T14:03:34.777 INFO:teuthology.orchestra.run.smithi114.stdout:mds.h smithi158 running (76s) 60s ago 76s 14.1M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 0a33070de242 2023-10-18T14:03:34.777 INFO:teuthology.orchestra.run.smithi114.stdout:mds.i smithi172 running (74s) 60s ago 73s 16.8M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 1d9eb45cc857 2023-10-18T14:03:34.777 INFO:teuthology.orchestra.run.smithi114.stdout:mds.j smithi114 running (87s) 60s ago 87s 14.4M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 9693c209b522 2023-10-18T14:03:34.777 INFO:teuthology.orchestra.run.smithi114.stdout:mds.k smithi158 running (90s) 60s ago 89s 13.4M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 42c88d018479 2023-10-18T14:03:34.777 INFO:teuthology.orchestra.run.smithi114.stdout:mds.l smithi172 running (92s) 60s ago 91s 13.5M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 2118ca0add81 2023-10-18T14:03:34.778 INFO:teuthology.orchestra.run.smithi114.stdout:mgr.x smithi114 *:9283,8765 running (8m) 60s ago 8m 509M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 001ab3146b0b 2023-10-18T14:03:34.778 INFO:teuthology.orchestra.run.smithi114.stdout:mgr.y smithi158 *:8443,8765 running (6m) 60s ago 6m 450M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 fc0b81b40260 2023-10-18T14:03:34.778 INFO:teuthology.orchestra.run.smithi114.stdout:mgr.z smithi172 *:8443,8765 running (6m) 60s ago 6m 449M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 0e4a25f59a0f 2023-10-18T14:03:34.778 INFO:teuthology.orchestra.run.smithi114.stdout:mon.a smithi114 running (8m) 60s ago 8m 90.5M 2048M 18.0.0-6786-gf7420d7f 34f3475ed6c6 834e592ee781 2023-10-18T14:03:34.778 INFO:teuthology.orchestra.run.smithi114.stdout:mon.b smithi158 running (6m) 60s ago 6m 57.6M 2048M 18.0.0-6786-gf7420d7f 34f3475ed6c6 6623d8e16912 2023-10-18T14:03:34.779 INFO:teuthology.orchestra.run.smithi114.stdout:mon.c smithi172 running (6m) 60s ago 6m 54.2M 2048M 18.0.0-6786-gf7420d7f 34f3475ed6c6 5de49e101408 2023-10-18T14:03:34.779 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 smithi114 running (5m) 60s ago 5m 61.3M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 3e8d9d599d64 2023-10-18T14:03:34.779 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 smithi158 running (5m) 60s ago 5m 64.7M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 20bb7966805f 2023-10-18T14:03:34.779 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 smithi172 running (4m) 60s ago 4m 63.2M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 475ce901ae46 2023-10-18T14:03:34.779 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 smithi114 running (4m) 60s ago 4m 54.8M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 0ede898d1c87 2023-10-18T14:03:34.779 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 smithi158 running (4m) 60s ago 4m 53.1M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 4023b4b0de68 2023-10-18T14:03:34.780 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 smithi172 running (3m) 60s ago 3m 55.4M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 0aba15ac9332 2023-10-18T14:03:34.780 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 smithi114 running (3m) 60s ago 3m 49.4M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 55e88b32d3e4 2023-10-18T14:03:34.780 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 smithi158 running (3m) 60s ago 3m 57.5M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 ff386d4c2990 2023-10-18T14:03:34.780 INFO:teuthology.orchestra.run.smithi114.stdout:osd.8 smithi172 running (2m) 60s ago 2m 51.6M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 e8fa41efc2b9 2023-10-18T14:03:34.780 INFO:teuthology.orchestra.run.smithi114.stdout:osd.9 smithi114 running (2m) 60s ago 2m 51.0M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 dab7df1ab90d 2023-10-18T14:03:34.780 INFO:teuthology.orchestra.run.smithi114.stdout:osd.10 smithi158 running (2m) 60s ago 2m 50.3M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 b2c4c15069c3 2023-10-18T14:03:34.781 INFO:teuthology.orchestra.run.smithi114.stdout:osd.11 smithi172 running (110s) 60s ago 109s 44.2M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 70c2ae57aa2b 2023-10-18T14:03:34.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.774+0000 7f8e71da0700 1 -- 172.21.15.114:0/3417779593 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8e540a1560 msgr2=0x7f8e540a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:34.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.774+0000 7f8e71da0700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8e540a1560 0x7f8e540a3a20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c006010 tx=0x7f8e5c005960 comp rx=0 tx=0).stop 2023-10-18T14:03:34.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.774+0000 7f8e71da0700 1 -- 172.21.15.114:0/3417779593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e6c1058d0 msgr2=0x7f8e6c100df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:34.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.774+0000 7f8e71da0700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e6c1058d0 0x7f8e6c100df0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8e640094f0 tx=0x7f8e6400d3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:34.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.774+0000 7f8e71da0700 1 -- 172.21.15.114:0/3417779593 shutdown_connections 2023-10-18T14:03:34.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.774+0000 7f8e71da0700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8e540a1560 0x7f8e540a3a20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:34.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.774+0000 7f8e71da0700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e6c1058d0 0x7f8e6c100df0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:34.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.774+0000 7f8e71da0700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e6c0ff190 0x7f8e6c100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:34.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.774+0000 7f8e71da0700 1 --2- 172.21.15.114:0/3417779593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e6c0ffb30 0x7f8e6c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:34.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.774+0000 7f8e71da0700 1 -- 172.21.15.114:0/3417779593 >> 172.21.15.114:0/3417779593 conn(0x7f8e6c074a10 msgr2=0x7f8e6c0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:34.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.774+0000 7f8e71da0700 1 -- 172.21.15.114:0/3417779593 shutdown_connections 2023-10-18T14:03:34.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:34.774+0000 7f8e71da0700 1 -- 172.21.15.114:0/3417779593 wait complete. 2023-10-18T14:03:35.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:34 smithi158 ceph-mon[103317]: pgmap v266: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:35.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:34 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:03:35.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:34 smithi172 ceph-mon[103574]: pgmap v266: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:35.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:34 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:03:35.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:34 smithi114 ceph-mon[99494]: pgmap v266: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:35.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:34 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:03:35.202 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-18T14:03:35.867 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:36.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:35 smithi158 ceph-mon[103317]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:36.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:35 smithi172 ceph-mon[103574]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:36.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:35 smithi114 ceph-mon[99494]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:37.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:36 smithi158 ceph-mon[103317]: pgmap v267: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-18T14:03:37.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:36 smithi172 ceph-mon[103574]: pgmap v267: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-18T14:03:37.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:36 smithi114 ceph-mon[99494]: pgmap v267: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-18T14:03:37.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.291+0000 7f5294a9a700 1 -- 172.21.15.114:0/1222682110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52900ff750 msgr2=0x7f52900ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:37.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.291+0000 7f5294a9a700 1 --2- 172.21.15.114:0/1222682110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52900ff750 0x7f52900ffbd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5278009990 tx=0x7f5278009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:37.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.291+0000 7f5294a9a700 1 -- 172.21.15.114:0/1222682110 shutdown_connections 2023-10-18T14:03:37.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.291+0000 7f5294a9a700 1 --2- 172.21.15.114:0/1222682110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5290100110 0x7f529010c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:37.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.291+0000 7f5294a9a700 1 --2- 172.21.15.114:0/1222682110 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5290105690 0x7f5290105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:37.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.291+0000 7f5294a9a700 1 --2- 172.21.15.114:0/1222682110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52900ff750 0x7f52900ffbd0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:37.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.291+0000 7f5294a9a700 1 -- 172.21.15.114:0/1222682110 >> 172.21.15.114:0/1222682110 conn(0x7f52900757d0 msgr2=0x7f5290075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:37.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.291+0000 7f5294a9a700 1 -- 172.21.15.114:0/1222682110 shutdown_connections 2023-10-18T14:03:37.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.291+0000 7f5294a9a700 1 -- 172.21.15.114:0/1222682110 wait complete. 2023-10-18T14:03:37.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.292+0000 7f5294a9a700 1 Processor -- start 2023-10-18T14:03:37.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.292+0000 7f5294a9a700 1 -- start start 2023-10-18T14:03:37.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f5294a9a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52900ff750 0x7f52901979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:37.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f5294a9a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5290100110 0x7f5290197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:37.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f5294a9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5290105690 0x7f52901a2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:37.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f5294a9a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5290198800 con 0x7f52900ff750 2023-10-18T14:03:37.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f5294a9a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52901a2f90 con 0x7f5290100110 2023-10-18T14:03:37.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f5294a9a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52901a3100 con 0x7f5290105690 2023-10-18T14:03:37.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f528e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52900ff750 0x7f52901979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:37.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f528e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52900ff750 0x7f52901979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43464/0 (socket says 172.21.15.114:43464) 2023-10-18T14:03:37.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f528e59c700 1 -- 172.21.15.114:0/3103575088 learned_addr learned my addr 172.21.15.114:0/3103575088 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:37.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f5285d9b700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5290100110 0x7f5290197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:37.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f528ed9d700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5290105690 0x7f52901a2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:37.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f528e59c700 1 -- 172.21.15.114:0/3103575088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5290105690 msgr2=0x7f52901a2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:37.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f528e59c700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5290105690 0x7f52901a2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:37.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f528e59c700 1 -- 172.21.15.114:0/3103575088 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5290100110 msgr2=0x7f5290197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f528e59c700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5290100110 0x7f5290197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f528e59c700 1 -- 172.21.15.114:0/3103575088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52780095f0 con 0x7f52900ff750 2023-10-18T14:03:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f528ed9d700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5290105690 0x7f52901a2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f528e59c700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52900ff750 0x7f52901979d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f528000d950 tx=0x7f528000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f5287fff700 1 -- 172.21.15.114:0/3103575088 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280009940 con 0x7f52900ff750 2023-10-18T14:03:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f5294a9a700 1 -- 172.21.15.114:0/3103575088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52901a33e0 con 0x7f52900ff750 2023-10-18T14:03:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f5287fff700 1 -- 172.21.15.114:0/3103575088 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5280010460 con 0x7f52900ff750 2023-10-18T14:03:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f5287fff700 1 -- 172.21.15.114:0/3103575088 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528000f620 con 0x7f52900ff750 2023-10-18T14:03:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.293+0000 7f5294a9a700 1 -- 172.21.15.114:0/3103575088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52901a3900 con 0x7f52900ff750 2023-10-18T14:03:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.294+0000 7f5294a9a700 1 -- 172.21.15.114:0/3103575088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5290107cb0 con 0x7f52900ff750 2023-10-18T14:03:37.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.296+0000 7f5287fff700 1 -- 172.21.15.114:0/3103575088 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f52800108d0 con 0x7f52900ff750 2023-10-18T14:03:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.296+0000 7f5287fff700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f527c0a1560 0x7f527c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.297+0000 7f5285d9b700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f527c0a1560 0x7f527c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.297+0000 7f5287fff700 1 -- 172.21.15.114:0/3103575088 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f52800ccde0 con 0x7f52900ff750 2023-10-18T14:03:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.297+0000 7f5285d9b700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f527c0a1560 0x7f527c0a3a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f527800b5c0 tx=0x7f5278005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:37.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.299+0000 7f5287fff700 1 -- 172.21.15.114:0/3103575088 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f52800961e0 con 0x7f52900ff750 2023-10-18T14:03:37.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.517+0000 7f5294a9a700 1 -- 172.21.15.114:0/3103575088 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f52900693e0 con 0x7f527c0a1560 2023-10-18T14:03:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.526+0000 7f5287fff700 1 -- 172.21.15.114:0/3103575088 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f52900693e0 con 0x7f527c0a1560 2023-10-18T14:03:37.529 INFO:teuthology.orchestra.run.smithi114.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-18T14:03:37.529 INFO:teuthology.orchestra.run.smithi114.stdout:mds.all 12/12 63s ago 96s smithi114=a;smithi114=d;smithi114=g;smithi114=j;smithi158=b;smithi158=e;smithi158=h;smithi158=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2023-10-18T14:03:37.529 INFO:teuthology.orchestra.run.smithi114.stdout:mgr 3/3 63s ago 6m smithi114=x;smithi158=y;smithi172=z;count:3 2023-10-18T14:03:37.529 INFO:teuthology.orchestra.run.smithi114.stdout:mon 3/3 63s ago 6m smithi114:172.21.15.114=a;smithi158:172.21.15.158=b;smithi172:172.21.15.172=c;count:3 2023-10-18T14:03:37.529 INFO:teuthology.orchestra.run.smithi114.stdout:osd 12 63s ago - 2023-10-18T14:03:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.528+0000 7f5294a9a700 1 -- 172.21.15.114:0/3103575088 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f527c0a1560 msgr2=0x7f527c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.528+0000 7f5294a9a700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f527c0a1560 0x7f527c0a3a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f527800b5c0 tx=0x7f5278005960 comp rx=0 tx=0).stop 2023-10-18T14:03:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.528+0000 7f5294a9a700 1 -- 172.21.15.114:0/3103575088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52900ff750 msgr2=0x7f52901979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.528+0000 7f5294a9a700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52900ff750 0x7f52901979d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f528000d950 tx=0x7f528000dc60 comp rx=0 tx=0).stop 2023-10-18T14:03:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.528+0000 7f5294a9a700 1 -- 172.21.15.114:0/3103575088 shutdown_connections 2023-10-18T14:03:37.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.528+0000 7f5294a9a700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f527c0a1560 0x7f527c0a3a20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:37.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.528+0000 7f5294a9a700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5290105690 0x7f52901a2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:37.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.528+0000 7f5294a9a700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52900ff750 0x7f52901979d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:37.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.528+0000 7f5294a9a700 1 --2- 172.21.15.114:0/3103575088 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5290100110 0x7f5290197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:37.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.528+0000 7f5294a9a700 1 -- 172.21.15.114:0/3103575088 >> 172.21.15.114:0/3103575088 conn(0x7f52900757d0 msgr2=0x7f52900fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.528+0000 7f5294a9a700 1 -- 172.21.15.114:0/3103575088 shutdown_connections 2023-10-18T14:03:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:37.528+0000 7f5294a9a700 1 -- 172.21.15.114:0/3103575088 wait complete. 2023-10-18T14:03:37.924 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-18T14:03:38.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:38 smithi172 ceph-mon[103574]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:38.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:38 smithi172 ceph-mon[103574]: pgmap v268: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:38.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:38 smithi114 ceph-mon[99494]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:38.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:38 smithi114 ceph-mon[99494]: pgmap v268: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:38.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.488 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:38.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:38 smithi158 ceph-mon[103317]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:38.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:38 smithi158 ceph-mon[103317]: pgmap v268: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:38.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:38.523 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:39.283 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:39 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:03:39.284 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:39 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:03:39.284 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:39 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:39.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:39 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:03:39.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:39 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:03:39.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:39 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:39.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:39 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:03:39.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:39 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:03:39.522 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:39 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:03:39.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.802+0000 7f4a9d36e700 1 -- 172.21.15.114:0/166160511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a981056c0 msgr2=0x7f4a98105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:39.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.802+0000 7f4a9d36e700 1 --2- 172.21.15.114:0/166160511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a981056c0 0x7f4a98105aa0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009990 tx=0x7f4a8c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:39.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.802+0000 7f4a9d36e700 1 -- 172.21.15.114:0/166160511 shutdown_connections 2023-10-18T14:03:39.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.802+0000 7f4a9d36e700 1 --2- 172.21.15.114:0/166160511 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4a98100810 0x7f4a9810c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:39.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.802+0000 7f4a9d36e700 1 --2- 172.21.15.114:0/166160511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a981056c0 0x7f4a98105aa0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:39.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.802+0000 7f4a9d36e700 1 --2- 172.21.15.114:0/166160511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a980ffe50 0x7f4a981002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:39.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.802+0000 7f4a9d36e700 1 -- 172.21.15.114:0/166160511 >> 172.21.15.114:0/166160511 conn(0x7f4a98075cf0 msgr2=0x7f4a980fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:39.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.802+0000 7f4a9d36e700 1 -- 172.21.15.114:0/166160511 shutdown_connections 2023-10-18T14:03:39.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.802+0000 7f4a9d36e700 1 -- 172.21.15.114:0/166160511 wait complete. 2023-10-18T14:03:39.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.802+0000 7f4a9d36e700 1 Processor -- start 2023-10-18T14:03:39.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a9d36e700 1 -- start start 2023-10-18T14:03:39.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a9d36e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a980ffe50 0x7f4a981979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:39.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a9d36e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a98100810 0x7f4a98197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:39.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a9d36e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4a981056c0 0x7f4a981a2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:39.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a9d36e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a98198760 con 0x7f4a980ffe50 2023-10-18T14:03:39.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a9d36e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a981a2f90 con 0x7f4a981056c0 2023-10-18T14:03:39.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a9d36e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a981a30d0 con 0x7f4a98100810 2023-10-18T14:03:39.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a96ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a980ffe50 0x7f4a981979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:39.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a96ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a980ffe50 0x7f4a981979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43478/0 (socket says 172.21.15.114:43478) 2023-10-18T14:03:39.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a96ffd700 1 -- 172.21.15.114:0/3494765873 learned_addr learned my addr 172.21.15.114:0/3494765873 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:39.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a967fc700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a98100810 0x7f4a98197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:39.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a977fe700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4a981056c0 0x7f4a981a2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:39.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a96ffd700 1 -- 172.21.15.114:0/3494765873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a98100810 msgr2=0x7f4a98197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:39.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a96ffd700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a98100810 0x7f4a98197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a96ffd700 1 -- 172.21.15.114:0/3494765873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4a981056c0 msgr2=0x7f4a981a2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a96ffd700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4a981056c0 0x7f4a981a2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a96ffd700 1 -- 172.21.15.114:0/3494765873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8c0095f0 con 0x7f4a980ffe50 2023-10-18T14:03:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a977fe700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4a981056c0 0x7f4a981a2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.803+0000 7f4a96ffd700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a980ffe50 0x7f4a981979d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c000c00 tx=0x7f4a8c00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.804+0000 7f4a7ffff700 1 -- 172.21.15.114:0/3494765873 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c01d070 con 0x7f4a980ffe50 2023-10-18T14:03:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.804+0000 7f4a9d36e700 1 -- 172.21.15.114:0/3494765873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a981a32d0 con 0x7f4a980ffe50 2023-10-18T14:03:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.804+0000 7f4a7ffff700 1 -- 172.21.15.114:0/3494765873 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a8c022470 con 0x7f4a980ffe50 2023-10-18T14:03:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.804+0000 7f4a7ffff700 1 -- 172.21.15.114:0/3494765873 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c017650 con 0x7f4a980ffe50 2023-10-18T14:03:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.804+0000 7f4a9d36e700 1 -- 172.21.15.114:0/3494765873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a981a3740 con 0x7f4a980ffe50 2023-10-18T14:03:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.805+0000 7f4a9d36e700 1 -- 172.21.15.114:0/3494765873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a98107c50 con 0x7f4a980ffe50 2023-10-18T14:03:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.806+0000 7f4a7ffff700 1 -- 172.21.15.114:0/3494765873 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f4a8c0225e0 con 0x7f4a980ffe50 2023-10-18T14:03:39.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.806+0000 7f4a7ffff700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4a800a1560 0x7f4a800a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:39.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.806+0000 7f4a967fc700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4a800a1560 0x7f4a800a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:39.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.806+0000 7f4a7ffff700 1 -- 172.21.15.114:0/3494765873 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f4a8c0cdfc0 con 0x7f4a980ffe50 2023-10-18T14:03:39.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.807+0000 7f4a967fc700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4a800a1560 0x7f4a800a3a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4a980ff530 tx=0x7f4a8800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:39.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:39.810+0000 7f4a7ffff700 1 -- 172.21.15.114:0/3494765873 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4a8c0974b0 con 0x7f4a980ffe50 2023-10-18T14:03:40.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.006+0000 7f4a9d36e700 1 -- 172.21.15.114:0/3494765873 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a980ff2e0 con 0x7f4a800a1560 2023-10-18T14:03:40.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.008+0000 7f4a7ffff700 1 -- 172.21.15.114:0/3494765873 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f4a980ff2e0 con 0x7f4a800a1560 2023-10-18T14:03:40.011 INFO:teuthology.orchestra.run.smithi114.stdout:HOST ADDR LABELS STATUS 2023-10-18T14:03:40.011 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114 172.21.15.114 2023-10-18T14:03:40.011 INFO:teuthology.orchestra.run.smithi114.stdout:smithi158 172.21.15.158 2023-10-18T14:03:40.011 INFO:teuthology.orchestra.run.smithi114.stdout:smithi172 172.21.15.172 2023-10-18T14:03:40.011 INFO:teuthology.orchestra.run.smithi114.stdout:3 hosts in cluster 2023-10-18T14:03:40.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.010+0000 7f4a9d36e700 1 -- 172.21.15.114:0/3494765873 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4a800a1560 msgr2=0x7f4a800a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:40.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.010+0000 7f4a9d36e700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4a800a1560 0x7f4a800a3a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4a980ff530 tx=0x7f4a8800b410 comp rx=0 tx=0).stop 2023-10-18T14:03:40.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.010+0000 7f4a9d36e700 1 -- 172.21.15.114:0/3494765873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a980ffe50 msgr2=0x7f4a981979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:40.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.010+0000 7f4a9d36e700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a980ffe50 0x7f4a981979d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c000c00 tx=0x7f4a8c00f670 comp rx=0 tx=0).stop 2023-10-18T14:03:40.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.010+0000 7f4a9d36e700 1 -- 172.21.15.114:0/3494765873 shutdown_connections 2023-10-18T14:03:40.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.010+0000 7f4a9d36e700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4a800a1560 0x7f4a800a3a20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:40.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.010+0000 7f4a9d36e700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4a981056c0 0x7f4a981a2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:40.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.010+0000 7f4a9d36e700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a980ffe50 0x7f4a981979d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:40.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.010+0000 7f4a9d36e700 1 --2- 172.21.15.114:0/3494765873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a98100810 0x7f4a98197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:40.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.010+0000 7f4a9d36e700 1 -- 172.21.15.114:0/3494765873 >> 172.21.15.114:0/3494765873 conn(0x7f4a98075cf0 msgr2=0x7f4a98102600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:40.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.010+0000 7f4a9d36e700 1 -- 172.21.15.114:0/3494765873 shutdown_connections 2023-10-18T14:03:40.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:40.010+0000 7f4a9d36e700 1 -- 172.21.15.114:0/3494765873 wait complete. 2023-10-18T14:03:40.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:40 smithi172 ceph-mon[103574]: pgmap v269: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:40.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:40 smithi172 ceph-mon[103574]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:40.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:40 smithi114 ceph-mon[99494]: pgmap v269: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:40.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:40 smithi114 ceph-mon[99494]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:40.444 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-18T14:03:40.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:40 smithi158 ceph-mon[103317]: pgmap v269: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:40.521 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:40 smithi158 ceph-mon[103317]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:41.000 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.201+0000 7fce47ade700 1 -- 172.21.15.114:0/3772600619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce401002a0 msgr2=0x7fce40100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.201+0000 7fce47ade700 1 --2- 172.21.15.114:0/3772600619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce401002a0 0x7fce40100720 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009990 tx=0x7fce3c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.201+0000 7fce47ade700 1 -- 172.21.15.114:0/3772600619 shutdown_connections 2023-10-18T14:03:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.201+0000 7fce47ade700 1 --2- 172.21.15.114:0/3772600619 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce40100c60 0x7fce4010c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.201+0000 7fce47ade700 1 --2- 172.21.15.114:0/3772600619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce40104720 0x7fce40104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.201+0000 7fce47ade700 1 --2- 172.21.15.114:0/3772600619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce401002a0 0x7fce40100720 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.201+0000 7fce47ade700 1 -- 172.21.15.114:0/3772600619 >> 172.21.15.114:0/3772600619 conn(0x7fce40074a10 msgr2=0x7fce40074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:42.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.201+0000 7fce47ade700 1 -- 172.21.15.114:0/3772600619 shutdown_connections 2023-10-18T14:03:42.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.201+0000 7fce47ade700 1 -- 172.21.15.114:0/3772600619 wait complete. 2023-10-18T14:03:42.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce47ade700 1 Processor -- start 2023-10-18T14:03:42.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce47ade700 1 -- start start 2023-10-18T14:03:42.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce47ade700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce401002a0 0x7fce40106640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce47ade700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce40100c60 0x7fce40106b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce47ade700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce40104720 0x7fce401070c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce47ade700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce401a9470 con 0x7fce401002a0 2023-10-18T14:03:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce47ade700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce401a95b0 con 0x7fce40104720 2023-10-18T14:03:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce47ade700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce401a9770 con 0x7fce40100c60 2023-10-18T14:03:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce4587a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce401002a0 0x7fce40106640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce4587a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce401002a0 0x7fce40106640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43492/0 (socket says 172.21.15.114:43492) 2023-10-18T14:03:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce4587a700 1 -- 172.21.15.114:0/820192008 learned_addr learned my addr 172.21.15.114:0/820192008 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce4607b700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce40104720 0x7fce401070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce45079700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce40100c60 0x7fce40106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce4587a700 1 -- 172.21.15.114:0/820192008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce40100c60 msgr2=0x7fce40106b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce4587a700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce40100c60 0x7fce40106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce4587a700 1 -- 172.21.15.114:0/820192008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce40104720 msgr2=0x7fce401070c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce4587a700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce40104720 0x7fce401070c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce4587a700 1 -- 172.21.15.114:0/820192008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0095f0 con 0x7fce401002a0 2023-10-18T14:03:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce4607b700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce40104720 0x7fce401070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce4587a700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce401002a0 0x7fce40106640 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fce3000b530 tx=0x7fce3000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce36ffd700 1 -- 172.21.15.114:0/820192008 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce30011830 con 0x7fce401002a0 2023-10-18T14:03:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.202+0000 7fce36ffd700 1 -- 172.21.15.114:0/820192008 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce30011e50 con 0x7fce401002a0 2023-10-18T14:03:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.203+0000 7fce47ade700 1 -- 172.21.15.114:0/820192008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce401a9a50 con 0x7fce401002a0 2023-10-18T14:03:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.203+0000 7fce36ffd700 1 -- 172.21.15.114:0/820192008 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3000f2e0 con 0x7fce401002a0 2023-10-18T14:03:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.203+0000 7fce47ade700 1 -- 172.21.15.114:0/820192008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce401a9fa0 con 0x7fce401002a0 2023-10-18T14:03:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.203+0000 7fce47ade700 1 -- 172.21.15.114:0/820192008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce400fe7a0 con 0x7fce401002a0 2023-10-18T14:03:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.204+0000 7fce36ffd700 1 -- 172.21.15.114:0/820192008 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fce30010580 con 0x7fce401002a0 2023-10-18T14:03:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.205+0000 7fce36ffd700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fce2c0a15e0 0x7fce2c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:42.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.205+0000 7fce45079700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fce2c0a15e0 0x7fce2c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:42.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.205+0000 7fce36ffd700 1 -- 172.21.15.114:0/820192008 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fce300cc930 con 0x7fce401002a0 2023-10-18T14:03:42.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.205+0000 7fce45079700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fce2c0a15e0 0x7fce2c0a3aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fce3c003730 tx=0x7fce3c0036c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:42.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.209+0000 7fce36ffd700 1 -- 172.21.15.114:0/820192008 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fce30095ea0 con 0x7fce401002a0 2023-10-18T14:03:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.408+0000 7fce47ade700 1 -- 172.21.15.114:0/820192008 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fce40107ad0 con 0x7fce2c0a15e0 2023-10-18T14:03:42.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.410+0000 7fce36ffd700 1 -- 172.21.15.114:0/820192008 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fce40107ad0 con 0x7fce2c0a15e0 2023-10-18T14:03:42.413 INFO:teuthology.orchestra.run.smithi114.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-18T14:03:42.413 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WB400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-18T14:03:42.414 INFO:teuthology.orchestra.run.smithi114.stdout:smithi158 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7475005A480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-10-18T14:03:42.414 INFO:teuthology.orchestra.run.smithi114.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 111s ago Has a FileSystem, LVM detected 2023-10-18T14:03:42.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.412+0000 7fce47ade700 1 -- 172.21.15.114:0/820192008 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fce2c0a15e0 msgr2=0x7fce2c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:42.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.412+0000 7fce47ade700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fce2c0a15e0 0x7fce2c0a3aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fce3c003730 tx=0x7fce3c0036c0 comp rx=0 tx=0).stop 2023-10-18T14:03:42.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.412+0000 7fce47ade700 1 -- 172.21.15.114:0/820192008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce401002a0 msgr2=0x7fce40106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:42.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.412+0000 7fce47ade700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce401002a0 0x7fce40106640 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fce3000b530 tx=0x7fce3000b8f0 comp rx=0 tx=0).stop 2023-10-18T14:03:42.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.412+0000 7fce47ade700 1 -- 172.21.15.114:0/820192008 shutdown_connections 2023-10-18T14:03:42.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.412+0000 7fce47ade700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fce2c0a15e0 0x7fce2c0a3aa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:42.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.412+0000 7fce47ade700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fce40104720 0x7fce401070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:42.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.412+0000 7fce47ade700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce401002a0 0x7fce40106640 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:42.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.412+0000 7fce47ade700 1 --2- 172.21.15.114:0/820192008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce40100c60 0x7fce40106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:42.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.412+0000 7fce47ade700 1 -- 172.21.15.114:0/820192008 >> 172.21.15.114:0/820192008 conn(0x7fce40074a10 msgr2=0x7fce4010ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:42.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.412+0000 7fce47ade700 1 -- 172.21.15.114:0/820192008 shutdown_connections 2023-10-18T14:03:42.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:42.413+0000 7fce47ade700 1 -- 172.21.15.114:0/820192008 wait complete. 2023-10-18T14:03:42.813 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:42 smithi114 ceph-mon[99494]: pgmap v270: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-18T14:03:42.846 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-18T14:03:42.855 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T14:03:42.856 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-18T14:03:43.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:42 smithi158 ceph-mon[103317]: pgmap v270: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-18T14:03:43.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:42 smithi172 ceph-mon[103574]: pgmap v270: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-18T14:03:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:43.971 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:43 smithi114 ceph-mon[99494]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:44.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:43 smithi158 ceph-mon[103317]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:44.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:43 smithi172 ceph-mon[103574]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:03:44.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.667+0000 7f40a7fd7700 1 -- 172.21.15.114:0/2660769485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40a01008a0 msgr2=0x7f40a0100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:44.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.667+0000 7f40a7fd7700 1 --2- 172.21.15.114:0/2660769485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40a01008a0 0x7f40a0100d20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f409c009990 tx=0x7f409c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:44.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.668+0000 7f40a7fd7700 1 -- 172.21.15.114:0/2660769485 shutdown_connections 2023-10-18T14:03:44.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.668+0000 7f40a7fd7700 1 --2- 172.21.15.114:0/2660769485 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40a0101260 0x7f40a010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.668+0000 7f40a7fd7700 1 --2- 172.21.15.114:0/2660769485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a01057c0 0x7f40a0105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.668+0000 7f40a7fd7700 1 --2- 172.21.15.114:0/2660769485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40a01008a0 0x7f40a0100d20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.668+0000 7f40a7fd7700 1 -- 172.21.15.114:0/2660769485 >> 172.21.15.114:0/2660769485 conn(0x7f40a00779e0 msgr2=0x7f40a0077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.668+0000 7f40a7fd7700 1 -- 172.21.15.114:0/2660769485 shutdown_connections 2023-10-18T14:03:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.668+0000 7f40a7fd7700 1 -- 172.21.15.114:0/2660769485 wait complete. 2023-10-18T14:03:44.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.668+0000 7f40a7fd7700 1 Processor -- start 2023-10-18T14:03:44.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.668+0000 7f40a7fd7700 1 -- start start 2023-10-18T14:03:44.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a7fd7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40a01008a0 0x7f40a019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:44.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a7fd7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a0101260 0x7f40a019cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:44.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a7fd7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40a01057c0 0x7f40a0196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:44.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a7fd7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0197240 con 0x7f40a01008a0 2023-10-18T14:03:44.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a7fd7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a01973b0 con 0x7f40a01057c0 2023-10-18T14:03:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a7fd7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0197570 con 0x7f40a0101260 2023-10-18T14:03:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a5d73700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40a01008a0 0x7f40a019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a5d73700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40a01008a0 0x7f40a019ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43506/0 (socket says 172.21.15.114:43506) 2023-10-18T14:03:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a5d73700 1 -- 172.21.15.114:0/3052998301 learned_addr learned my addr 172.21.15.114:0/3052998301 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a5572700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a0101260 0x7f40a019cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a5d73700 1 -- 172.21.15.114:0/3052998301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a0101260 msgr2=0x7f40a019cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:44.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a5d73700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a0101260 0x7f40a019cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:44.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a6574700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40a01057c0 0x7f40a0196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:44.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a5d73700 1 -- 172.21.15.114:0/3052998301 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40a01057c0 msgr2=0x7f40a0196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:44.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a5d73700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40a01057c0 0x7f40a0196be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:44.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a5d73700 1 -- 172.21.15.114:0/3052998301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c0095f0 con 0x7f40a01008a0 2023-10-18T14:03:44.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f40a5d73700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40a01008a0 0x7f40a019ca50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f409400b500 tx=0x7f409400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:44.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f4092ffd700 1 -- 172.21.15.114:0/3052998301 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4094011830 con 0x7f40a01008a0 2023-10-18T14:03:44.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f4092ffd700 1 -- 172.21.15.114:0/3052998301 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4094011e50 con 0x7f40a01008a0 2023-10-18T14:03:44.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.669+0000 7f4092ffd700 1 -- 172.21.15.114:0/3052998301 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409400f2e0 con 0x7f40a01008a0 2023-10-18T14:03:44.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.670+0000 7f40a7fd7700 1 -- 172.21.15.114:0/3052998301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a0197850 con 0x7f40a01008a0 2023-10-18T14:03:44.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.670+0000 7f40a7fd7700 1 -- 172.21.15.114:0/3052998301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a01a3a40 con 0x7f40a01008a0 2023-10-18T14:03:44.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.670+0000 7f40a7fd7700 1 -- 172.21.15.114:0/3052998301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a0108d80 con 0x7f40a01008a0 2023-10-18T14:03:44.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.671+0000 7f4092ffd700 1 -- 172.21.15.114:0/3052998301 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f4094010580 con 0x7f40a01008a0 2023-10-18T14:03:44.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.672+0000 7f4092ffd700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f408c0a15e0 0x7f408c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:44.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.672+0000 7f40a5572700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f408c0a15e0 0x7f408c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:44.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.672+0000 7f4092ffd700 1 -- 172.21.15.114:0/3052998301 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f40940cce80 con 0x7f40a01008a0 2023-10-18T14:03:44.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.672+0000 7f40a5572700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f408c0a15e0 0x7f408c0a3aa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f409c00b5c0 tx=0x7f409c005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:44.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.675+0000 7f4092ffd700 1 -- 172.21.15.114:0/3052998301 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f40940963f0 con 0x7f40a01008a0 2023-10-18T14:03:44.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:44 smithi114 ceph-mon[99494]: pgmap v271: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:44.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.905+0000 7f40a7fd7700 1 -- 172.21.15.114:0/3052998301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f40a0101f30 con 0x7f40a01008a0 2023-10-18T14:03:44.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.906+0000 7f4092ffd700 1 -- 172.21.15.114:0/3052998301 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+2985 (secure 0 0 0) 0x7f4094015020 con 0x7f40a01008a0 2023-10-18T14:03:44.909 INFO:teuthology.orchestra.run.smithi114.stdout:e26 2023-10-18T14:03:44.909 INFO:teuthology.orchestra.run.smithi114.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-18T14:03:44.909 INFO:teuthology.orchestra.run.smithi114.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-18T14:03:44.910 INFO:teuthology.orchestra.run.smithi114.stdout:legacy client fscid: 1 2023-10-18T14:03:44.910 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:44.910 INFO:teuthology.orchestra.run.smithi114.stdout:Filesystem 'cephfs' (1) 2023-10-18T14:03:44.910 INFO:teuthology.orchestra.run.smithi114.stdout:fs_name cephfs 2023-10-18T14:03:44.910 INFO:teuthology.orchestra.run.smithi114.stdout:epoch 26 2023-10-18T14:03:44.911 INFO:teuthology.orchestra.run.smithi114.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-18T14:03:44.911 INFO:teuthology.orchestra.run.smithi114.stdout:created 2023-10-18T14:02:32.251953+0000 2023-10-18T14:03:44.911 INFO:teuthology.orchestra.run.smithi114.stdout:modified 2023-10-18T14:02:39.260198+0000 2023-10-18T14:03:44.911 INFO:teuthology.orchestra.run.smithi114.stdout:tableserver 0 2023-10-18T14:03:44.911 INFO:teuthology.orchestra.run.smithi114.stdout:root 0 2023-10-18T14:03:44.912 INFO:teuthology.orchestra.run.smithi114.stdout:session_timeout 300 2023-10-18T14:03:44.912 INFO:teuthology.orchestra.run.smithi114.stdout:session_autoclose 300 2023-10-18T14:03:44.912 INFO:teuthology.orchestra.run.smithi114.stdout:max_file_size 1099511627776 2023-10-18T14:03:44.912 INFO:teuthology.orchestra.run.smithi114.stdout:max_xattr_size 65536 2023-10-18T14:03:44.912 INFO:teuthology.orchestra.run.smithi114.stdout:required_client_features {} 2023-10-18T14:03:44.913 INFO:teuthology.orchestra.run.smithi114.stdout:last_failure 0 2023-10-18T14:03:44.913 INFO:teuthology.orchestra.run.smithi114.stdout:last_failure_osd_epoch 0 2023-10-18T14:03:44.913 INFO:teuthology.orchestra.run.smithi114.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-18T14:03:44.913 INFO:teuthology.orchestra.run.smithi114.stdout:max_mds 5 2023-10-18T14:03:44.913 INFO:teuthology.orchestra.run.smithi114.stdout:in 0,1,2,3,4 2023-10-18T14:03:44.914 INFO:teuthology.orchestra.run.smithi114.stdout:up {0=24616,1=24595,2=24583,3=24566,4=14820} 2023-10-18T14:03:44.914 INFO:teuthology.orchestra.run.smithi114.stdout:failed 2023-10-18T14:03:44.914 INFO:teuthology.orchestra.run.smithi114.stdout:damaged 2023-10-18T14:03:44.914 INFO:teuthology.orchestra.run.smithi114.stdout:stopped 2023-10-18T14:03:44.914 INFO:teuthology.orchestra.run.smithi114.stdout:data_pools [3] 2023-10-18T14:03:44.915 INFO:teuthology.orchestra.run.smithi114.stdout:metadata_pool 2 2023-10-18T14:03:44.915 INFO:teuthology.orchestra.run.smithi114.stdout:inline_data disabled 2023-10-18T14:03:44.915 INFO:teuthology.orchestra.run.smithi114.stdout:balancer 2023-10-18T14:03:44.915 INFO:teuthology.orchestra.run.smithi114.stdout:bal_rank_mask -1 2023-10-18T14:03:44.915 INFO:teuthology.orchestra.run.smithi114.stdout:standby_count_wanted 0 2023-10-18T14:03:44.916 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.i{0:24616} state up:active seq 4 addr [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] compat {c=[1],r=[1],i=[fff]}] 2023-10-18T14:03:44.916 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.l{0:24544} state up:standby-replay seq 1 addr [v2:172.21.15.172:6832/3053339885,v1:172.21.15.172:6833/3053339885] compat {c=[1],r=[1],i=[fff]}] 2023-10-18T14:03:44.916 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c{1:24595} state up:active seq 6 addr [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] compat {c=[1],r=[1],i=[fff]}] 2023-10-18T14:03:44.916 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.h{1:24539} state up:standby-replay seq 1 addr [v2:172.21.15.158:6836/1076778559,v1:172.21.15.158:6837/1076778559] compat {c=[1],r=[1],i=[fff]}] 2023-10-18T14:03:44.916 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.f{2:24583} state up:active seq 7 addr [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] compat {c=[1],r=[1],i=[fff]}] 2023-10-18T14:03:44.916 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.e{2:24524} state up:standby-replay seq 1 addr [v2:172.21.15.158:6834/2562572095,v1:172.21.15.158:6835/2562572095] compat {c=[1],r=[1],i=[fff]}] 2023-10-18T14:03:44.917 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b{3:24566} state up:active seq 4 addr [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] compat {c=[1],r=[1],i=[fff]}] 2023-10-18T14:03:44.917 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.k{3:24506} state up:standby-replay seq 1 addr [v2:172.21.15.158:6832/2306126907,v1:172.21.15.158:6833/2306126907] compat {c=[1],r=[1],i=[fff]}] 2023-10-18T14:03:44.917 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a{4:14820} state up:active seq 5 addr [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] compat {c=[1],r=[1],i=[fff]}] 2023-10-18T14:03:44.917 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.g{4:14808} state up:standby-replay seq 1 addr [v2:172.21.15.114:6838/2312997594,v1:172.21.15.114:6839/2312997594] compat {c=[1],r=[1],i=[fff]}] 2023-10-18T14:03:44.917 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:44.918 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:44.918 INFO:teuthology.orchestra.run.smithi114.stdout:Standby daemons: 2023-10-18T14:03:44.918 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:44.918 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.j{-1:14754} state up:standby seq 1 addr [v2:172.21.15.114:6834/1353369409,v1:172.21.15.114:6835/1353369409] compat {c=[1],r=[1],i=[fff]}] 2023-10-18T14:03:44.918 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d{-1:14760} state up:standby seq 1 addr [v2:172.21.15.114:6836/3590676300,v1:172.21.15.114:6837/3590676300] compat {c=[1],r=[1],i=[fff]}] 2023-10-18T14:03:44.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.907+0000 7f40a7fd7700 1 -- 172.21.15.114:0/3052998301 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f408c0a15e0 msgr2=0x7f408c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:44.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.907+0000 7f40a7fd7700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f408c0a15e0 0x7f408c0a3aa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f409c00b5c0 tx=0x7f409c005fd0 comp rx=0 tx=0).stop 2023-10-18T14:03:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.907+0000 7f40a7fd7700 1 -- 172.21.15.114:0/3052998301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40a01008a0 msgr2=0x7f40a019ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.907+0000 7f40a7fd7700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40a01008a0 0x7f40a019ca50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f409400b500 tx=0x7f409400b8c0 comp rx=0 tx=0).stop 2023-10-18T14:03:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.907+0000 7f40a7fd7700 1 -- 172.21.15.114:0/3052998301 shutdown_connections 2023-10-18T14:03:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.907+0000 7f40a7fd7700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f408c0a15e0 0x7f408c0a3aa0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.907+0000 7f40a7fd7700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40a01057c0 0x7f40a0196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.907+0000 7f40a7fd7700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40a01008a0 0x7f40a019ca50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.907+0000 7f40a7fd7700 1 --2- 172.21.15.114:0/3052998301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a0101260 0x7f40a019cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.908+0000 7f40a7fd7700 1 -- 172.21.15.114:0/3052998301 >> 172.21.15.114:0/3052998301 conn(0x7f40a00779e0 msgr2=0x7f40a00fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.908+0000 7f40a7fd7700 1 -- 172.21.15.114:0/3052998301 shutdown_connections 2023-10-18T14:03:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:44.908+0000 7f40a7fd7700 1 -- 172.21.15.114:0/3052998301 wait complete. 2023-10-18T14:03:44.922 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2023-10-18T14:03:45.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:44 smithi158 ceph-mon[103317]: pgmap v271: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:45.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:44 smithi172 ceph-mon[103574]: pgmap v271: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:45.274 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-18T14:03:45.831 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:46.018 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:45 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3052998301' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T14:03:46.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:45 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3052998301' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T14:03:46.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:45 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3052998301' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-18T14:03:47.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:46 smithi158 ceph-mon[103317]: pgmap v272: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-18T14:03:47.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.041+0000 7fc505b23700 1 -- 172.21.15.114:0/897240024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5001056b0 msgr2=0x7fc500105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:47.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.041+0000 7fc505b23700 1 --2- 172.21.15.114:0/897240024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5001056b0 0x7fc500105a90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0009990 tx=0x7fc4f0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.042+0000 7fc505b23700 1 -- 172.21.15.114:0/897240024 shutdown_connections 2023-10-18T14:03:47.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.042+0000 7fc505b23700 1 --2- 172.21.15.114:0/897240024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc500100110 0x7fc50010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.042+0000 7fc505b23700 1 --2- 172.21.15.114:0/897240024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5001056b0 0x7fc500105a90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.042+0000 7fc505b23700 1 --2- 172.21.15.114:0/897240024 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5000ff750 0x7fc5000ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.042+0000 7fc505b23700 1 -- 172.21.15.114:0/897240024 >> 172.21.15.114:0/897240024 conn(0x7fc500075790 msgr2=0x7fc500075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:47.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.042+0000 7fc505b23700 1 -- 172.21.15.114:0/897240024 shutdown_connections 2023-10-18T14:03:47.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.042+0000 7fc505b23700 1 -- 172.21.15.114:0/897240024 wait complete. 2023-10-18T14:03:47.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.042+0000 7fc505b23700 1 Processor -- start 2023-10-18T14:03:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc505b23700 1 -- start start 2023-10-18T14:03:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc505b23700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5000ff750 0x7fc500197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc505b23700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc500100110 0x7fc500198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc505b23700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5001056b0 0x7fc5001a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc505b23700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc500198900 con 0x7fc5001056b0 2023-10-18T14:03:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc505b23700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5001a30c0 con 0x7fc5000ff750 2023-10-18T14:03:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc505b23700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5001a3200 con 0x7fc500100110 2023-10-18T14:03:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc4fffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5001056b0 0x7fc5001a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc4fffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5001056b0 0x7fc5001a2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43524/0 (socket says 172.21.15.114:43524) 2023-10-18T14:03:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc4fffff700 1 -- 172.21.15.114:0/4100810520 learned_addr learned my addr 172.21.15.114:0/4100810520 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:47.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc4feffd700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc500100110 0x7fc500198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:47.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc4ff7fe700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5000ff750 0x7fc500197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:47.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc4fffff700 1 -- 172.21.15.114:0/4100810520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc500100110 msgr2=0x7fc500198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:47.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc4fffff700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc500100110 0x7fc500198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc4fffff700 1 -- 172.21.15.114:0/4100810520 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5000ff750 msgr2=0x7fc500197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:47.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc4fffff700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5000ff750 0x7fc500197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc4fffff700 1 -- 172.21.15.114:0/4100810520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f00095f0 con 0x7fc5001056b0 2023-10-18T14:03:47.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc4ff7fe700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5000ff750 0x7fc500197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:47.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.043+0000 7fc4fffff700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5001056b0 0x7fc5001a2b80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800b970 tx=0x7fc4f800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:47.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.044+0000 7fc4fcff9700 1 -- 172.21.15.114:0/4100810520 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f800c930 con 0x7fc5001056b0 2023-10-18T14:03:47.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.044+0000 7fc505b23700 1 -- 172.21.15.114:0/4100810520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5001a3480 con 0x7fc5001056b0 2023-10-18T14:03:47.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.044+0000 7fc4fcff9700 1 -- 172.21.15.114:0/4100810520 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4f8014440 con 0x7fc5001056b0 2023-10-18T14:03:47.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.044+0000 7fc4fcff9700 1 -- 172.21.15.114:0/4100810520 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f80075d0 con 0x7fc5001056b0 2023-10-18T14:03:47.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.044+0000 7fc505b23700 1 -- 172.21.15.114:0/4100810520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5001a3930 con 0x7fc5001056b0 2023-10-18T14:03:47.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.045+0000 7fc505b23700 1 -- 172.21.15.114:0/4100810520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc500107cb0 con 0x7fc5001056b0 2023-10-18T14:03:47.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.047+0000 7fc4fcff9700 1 -- 172.21.15.114:0/4100810520 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fc4f80145b0 con 0x7fc5001056b0 2023-10-18T14:03:47.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.047+0000 7fc4fcff9700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc4e80a1560 0x7fc4e80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.047+0000 7fc4ff7fe700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc4e80a1560 0x7fc4e80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.047+0000 7fc4fcff9700 1 -- 172.21.15.114:0/4100810520 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc4f8006e40 con 0x7fc5001056b0 2023-10-18T14:03:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.047+0000 7fc4ff7fe700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc4e80a1560 0x7fc4e80a3a20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000b5c0 tx=0x7fc4f0005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.051+0000 7fc4fcff9700 1 -- 172.21.15.114:0/4100810520 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc4f8095f90 con 0x7fc5001056b0 2023-10-18T14:03:47.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:46 smithi172 ceph-mon[103574]: pgmap v272: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-18T14:03:47.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:46 smithi114 ceph-mon[99494]: pgmap v272: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-18T14:03:47.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.241+0000 7fc505b23700 1 -- 172.21.15.114:0/4100810520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fc500100df0 con 0x7fc5001056b0 2023-10-18T14:03:47.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.242+0000 7fc4fcff9700 1 -- 172.21.15.114:0/4100810520 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) v1 ==== 56+0+5680 (secure 0 0 0) 0x7fc4f80995b0 con 0x7fc5001056b0 2023-10-18T14:03:47.245 INFO:teuthology.orchestra.run.smithi114.stdout:epoch 85 2023-10-18T14:03:47.245 INFO:teuthology.orchestra.run.smithi114.stdout:fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T14:03:47.245 INFO:teuthology.orchestra.run.smithi114.stdout:created 2023-10-18T13:55:08.086693+0000 2023-10-18T14:03:47.246 INFO:teuthology.orchestra.run.smithi114.stdout:modified 2023-10-18T14:03:08.625359+0000 2023-10-18T14:03:47.246 INFO:teuthology.orchestra.run.smithi114.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-18T14:03:47.246 INFO:teuthology.orchestra.run.smithi114.stdout:crush_version 26 2023-10-18T14:03:47.246 INFO:teuthology.orchestra.run.smithi114.stdout:full_ratio 0.95 2023-10-18T14:03:47.246 INFO:teuthology.orchestra.run.smithi114.stdout:backfillfull_ratio 0.9 2023-10-18T14:03:47.247 INFO:teuthology.orchestra.run.smithi114.stdout:nearfull_ratio 0.85 2023-10-18T14:03:47.247 INFO:teuthology.orchestra.run.smithi114.stdout:require_min_compat_client luminous 2023-10-18T14:03:47.247 INFO:teuthology.orchestra.run.smithi114.stdout:min_compat_client luminous 2023-10-18T14:03:47.247 INFO:teuthology.orchestra.run.smithi114.stdout:require_osd_release reef 2023-10-18T14:03:47.247 INFO:teuthology.orchestra.run.smithi114.stdout:stretch_mode_enabled false 2023-10-18T14:03:47.248 INFO:teuthology.orchestra.run.smithi114.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-18T14:03:47.248 INFO:teuthology.orchestra.run.smithi114.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-10-18T14:03:47.248 INFO:teuthology.orchestra.run.smithi114.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-10-18T14:03:47.248 INFO:teuthology.orchestra.run.smithi114.stdout:max_osd 12 2023-10-18T14:03:47.248 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 up in weight 1 up_from 9 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6802/3519372344,v1:172.21.15.114:6803/3519372344] [v2:172.21.15.114:6804/3519372344,v1:172.21.15.114:6805/3519372344] exists,up 15fe1db1-6a41-4299-9df5-a64a8851d78c 2023-10-18T14:03:47.249 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 up in weight 1 up_from 14 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.158:6800/1402372165,v1:172.21.15.158:6801/1402372165] [v2:172.21.15.158:6802/1402372165,v1:172.21.15.158:6803/1402372165] exists,up b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6 2023-10-18T14:03:47.249 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 up in weight 1 up_from 19 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/4209325113,v1:172.21.15.172:6801/4209325113] [v2:172.21.15.172:6802/4209325113,v1:172.21.15.172:6803/4209325113] exists,up 80de4181-f876-479e-a082-21a042f58b09 2023-10-18T14:03:47.249 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 up in weight 1 up_from 26 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6810/4089132386,v1:172.21.15.114:6811/4089132386] [v2:172.21.15.114:6812/4089132386,v1:172.21.15.114:6813/4089132386] exists,up 3dd2a81b-67be-449d-89e7-cbd3dd2f010b 2023-10-18T14:03:47.249 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 up in weight 1 up_from 34 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.158:6808/1567841851,v1:172.21.15.158:6809/1567841851] [v2:172.21.15.158:6810/1567841851,v1:172.21.15.158:6811/1567841851] exists,up 88faf89f-ba5c-4658-8744-a2dff1084f11 2023-10-18T14:03:47.249 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 up in weight 1 up_from 39 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6808/2859282562,v1:172.21.15.172:6809/2859282562] [v2:172.21.15.172:6810/2859282562,v1:172.21.15.172:6811/2859282562] exists,up bc3a8ec1-7475-444d-ad2c-98f52164c622 2023-10-18T14:03:47.250 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 up in weight 1 up_from 46 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6818/3292046982,v1:172.21.15.114:6819/3292046982] [v2:172.21.15.114:6820/3292046982,v1:172.21.15.114:6821/3292046982] exists,up 01b49bae-b64b-40ff-8931-4052c324a4ad 2023-10-18T14:03:47.250 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 up in weight 1 up_from 51 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.158:6816/1215333303,v1:172.21.15.158:6817/1215333303] [v2:172.21.15.158:6818/1215333303,v1:172.21.15.158:6819/1215333303] exists,up 30538b90-fa16-45be-a0a6-1afeb7551926 2023-10-18T14:03:47.250 INFO:teuthology.orchestra.run.smithi114.stdout:osd.8 up in weight 1 up_from 58 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6816/881849640,v1:172.21.15.172:6817/881849640] [v2:172.21.15.172:6818/881849640,v1:172.21.15.172:6819/881849640] exists,up c96c813e-f792-48c5-abf5-c11fc3a69a29 2023-10-18T14:03:47.250 INFO:teuthology.orchestra.run.smithi114.stdout:osd.9 up in weight 1 up_from 65 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6826/1353419633,v1:172.21.15.114:6827/1353419633] [v2:172.21.15.114:6828/1353419633,v1:172.21.15.114:6829/1353419633] exists,up 08e69155-0486-455e-8286-a8cff49f0f73 2023-10-18T14:03:47.250 INFO:teuthology.orchestra.run.smithi114.stdout:osd.10 up in weight 1 up_from 70 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.158:6824/1713443341,v1:172.21.15.158:6825/1713443341] [v2:172.21.15.158:6826/1713443341,v1:172.21.15.158:6827/1713443341] exists,up f0f75dcc-ae8d-401c-b2e9-bcde3eeee081 2023-10-18T14:03:47.250 INFO:teuthology.orchestra.run.smithi114.stdout:osd.11 up in weight 1 up_from 78 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6824/3903571171,v1:172.21.15.172:6825/3903571171] [v2:172.21.15.172:6826/3903571171,v1:172.21.15.172:6827/3903571171] exists,up a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee 2023-10-18T14:03:47.251 INFO:teuthology.orchestra.run.smithi114.stdout:pg_upmap_items 2.5 [8,11] 2023-10-18T14:03:47.251 INFO:teuthology.orchestra.run.smithi114.stdout:pg_upmap_items 2.13 [2,11] 2023-10-18T14:03:47.251 INFO:teuthology.orchestra.run.smithi114.stdout:pg_upmap_items 3.2 [3,9] 2023-10-18T14:03:47.251 INFO:teuthology.orchestra.run.smithi114.stdout:pg_upmap_items 3.11 [4,8] 2023-10-18T14:03:47.251 INFO:teuthology.orchestra.run.smithi114.stdout:pg_upmap_items 3.13 [4,9] 2023-10-18T14:03:47.252 INFO:teuthology.orchestra.run.smithi114.stdout:pg_upmap_items 3.1a [5,6] 2023-10-18T14:03:47.252 INFO:teuthology.orchestra.run.smithi114.stdout:pg_upmap_items 3.2c [4,9] 2023-10-18T14:03:47.252 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:6801/4083591617 expires 2023-10-19T13:57:07.487148+0000 2023-10-18T14:03:47.252 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:0/469095187 expires 2023-10-19T13:57:07.487148+0000 2023-10-18T14:03:47.252 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:0/3879995605 expires 2023-10-19T13:56:04.611113+0000 2023-10-18T14:03:47.253 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:0/599274026 expires 2023-10-19T13:56:04.611113+0000 2023-10-18T14:03:47.253 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:6800/4083591617 expires 2023-10-19T13:57:07.487148+0000 2023-10-18T14:03:47.253 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:0/2423419725 expires 2023-10-19T13:57:07.487148+0000 2023-10-18T14:03:47.253 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:6801/3236987300 expires 2023-10-19T13:56:04.611113+0000 2023-10-18T14:03:47.253 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:6800/1307090291 expires 2023-10-19T13:55:42.522304+0000 2023-10-18T14:03:47.253 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:0/1340157243 expires 2023-10-19T13:57:07.487148+0000 2023-10-18T14:03:47.254 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:0/1203420443 expires 2023-10-19T13:55:42.522304+0000 2023-10-18T14:03:47.254 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:6800/3236987300 expires 2023-10-19T13:56:04.611113+0000 2023-10-18T14:03:47.254 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:0/736541474 expires 2023-10-19T13:56:04.611113+0000 2023-10-18T14:03:47.254 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:6801/1307090291 expires 2023-10-19T13:55:42.522304+0000 2023-10-18T14:03:47.254 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:0/1121190039 expires 2023-10-19T13:55:42.522304+0000 2023-10-18T14:03:47.255 INFO:teuthology.orchestra.run.smithi114.stdout:blocklist 172.21.15.114:0/473909953 expires 2023-10-19T13:55:42.522304+0000 2023-10-18T14:03:47.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.244+0000 7fc505b23700 1 -- 172.21.15.114:0/4100810520 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc4e80a1560 msgr2=0x7fc4e80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:47.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.244+0000 7fc505b23700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc4e80a1560 0x7fc4e80a3a20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000b5c0 tx=0x7fc4f0005fb0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.244+0000 7fc505b23700 1 -- 172.21.15.114:0/4100810520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5001056b0 msgr2=0x7fc5001a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:47.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.244+0000 7fc505b23700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5001056b0 0x7fc5001a2b80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800b970 tx=0x7fc4f800bc80 comp rx=0 tx=0).stop 2023-10-18T14:03:47.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.244+0000 7fc505b23700 1 -- 172.21.15.114:0/4100810520 shutdown_connections 2023-10-18T14:03:47.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.244+0000 7fc505b23700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc4e80a1560 0x7fc4e80a3a20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.244+0000 7fc505b23700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5001056b0 0x7fc5001a2b80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.244+0000 7fc505b23700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc5000ff750 0x7fc500197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.244+0000 7fc505b23700 1 --2- 172.21.15.114:0/4100810520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc500100110 0x7fc500198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.244+0000 7fc505b23700 1 -- 172.21.15.114:0/4100810520 >> 172.21.15.114:0/4100810520 conn(0x7fc500075790 msgr2=0x7fc5000fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:47.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.244+0000 7fc505b23700 1 -- 172.21.15.114:0/4100810520 shutdown_connections 2023-10-18T14:03:47.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.244+0000 7fc505b23700 1 -- 172.21.15.114:0/4100810520 wait complete. 2023-10-18T14:03:47.685 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-18T14:03:47.696 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:03:47.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.817+0000 7fe292d92700 1 -- 172.21.15.114:0/1177882356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe28c1066c0 msgr2=0x7fe28c106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:47.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.817+0000 7fe292d92700 1 --2- 172.21.15.114:0/1177882356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe28c1066c0 0x7fe28c106aa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe280009990 tx=0x7fe280009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.817+0000 7fe292d92700 1 -- 172.21.15.114:0/1177882356 shutdown_connections 2023-10-18T14:03:47.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.817+0000 7fe292d92700 1 --2- 172.21.15.114:0/1177882356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe28c067fa0 0x7fe28c10d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.817+0000 7fe292d92700 1 --2- 172.21.15.114:0/1177882356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe28c1066c0 0x7fe28c106aa0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.817+0000 7fe292d92700 1 --2- 172.21.15.114:0/1177882356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe28c106fe0 0x7fe28c067870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.817+0000 7fe292d92700 1 -- 172.21.15.114:0/1177882356 >> 172.21.15.114:0/1177882356 conn(0x7fe28c076400 msgr2=0x7fe28c076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:47.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.817+0000 7fe292d92700 1 -- 172.21.15.114:0/1177882356 shutdown_connections 2023-10-18T14:03:47.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.817+0000 7fe292d92700 1 -- 172.21.15.114:0/1177882356 wait complete. 2023-10-18T14:03:47.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.817+0000 7fe292d92700 1 Processor -- start 2023-10-18T14:03:47.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.817+0000 7fe292d92700 1 -- start start 2023-10-18T14:03:47.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe292d92700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe28c067fa0 0x7fe28c19c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:47.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe292d92700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe28c1066c0 0x7fe28c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:47.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe292d92700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe28c106fe0 0x7fe28c196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:47.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe292d92700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1970c0 con 0x7fe28c067fa0 2023-10-18T14:03:47.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe292d92700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c197230 con 0x7fe28c1066c0 2023-10-18T14:03:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe292d92700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1973f0 con 0x7fe28c106fe0 2023-10-18T14:03:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe290b2e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe28c067fa0 0x7fe28c19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe290b2e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe28c067fa0 0x7fe28c19c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43534/0 (socket says 172.21.15.114:43534) 2023-10-18T14:03:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe290b2e700 1 -- 172.21.15.114:0/3295851223 learned_addr learned my addr 172.21.15.114:0/3295851223 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe28bfff700 1 --2- 172.21.15.114:0/3295851223 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe28c1066c0 0x7fe28c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:47.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe290b2e700 1 -- 172.21.15.114:0/3295851223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe28c106fe0 msgr2=0x7fe28c196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:47.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe290b2e700 1 --2- 172.21.15.114:0/3295851223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe28c106fe0 0x7fe28c196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe290b2e700 1 -- 172.21.15.114:0/3295851223 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe28c1066c0 msgr2=0x7fe28c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:47.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe290b2e700 1 --2- 172.21.15.114:0/3295851223 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe28c1066c0 0x7fe28c19ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:47.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe290b2e700 1 -- 172.21.15.114:0/3295851223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2800095f0 con 0x7fe28c067fa0 2023-10-18T14:03:47.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe290b2e700 1 --2- 172.21.15.114:0/3295851223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe28c067fa0 0x7fe28c19c930 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe280000c00 tx=0x7fe28000f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:47.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe289ffb700 1 -- 172.21.15.114:0/3295851223 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28001d070 con 0x7fe28c067fa0 2023-10-18T14:03:47.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe292d92700 1 -- 172.21.15.114:0/3295851223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c197670 con 0x7fe28c067fa0 2023-10-18T14:03:47.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe289ffb700 1 -- 172.21.15.114:0/3295851223 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe28000fde0 con 0x7fe28c067fa0 2023-10-18T14:03:47.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.818+0000 7fe289ffb700 1 -- 172.21.15.114:0/3295851223 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280017770 con 0x7fe28c067fa0 2023-10-18T14:03:47.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.819+0000 7fe292d92700 1 -- 172.21.15.114:0/3295851223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c1a3920 con 0x7fe28c067fa0 2023-10-18T14:03:47.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.820+0000 7fe292d92700 1 -- 172.21.15.114:0/3295851223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28c108c10 con 0x7fe28c067fa0 2023-10-18T14:03:47.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.820+0000 7fe289ffb700 1 -- 172.21.15.114:0/3295851223 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fe280022aa0 con 0x7fe28c067fa0 2023-10-18T14:03:47.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.821+0000 7fe289ffb700 1 --2- 172.21.15.114:0/3295851223 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe27c0a1560 0x7fe27c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:47.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.821+0000 7fe28bfff700 1 --2- 172.21.15.114:0/3295851223 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe27c0a1560 0x7fe27c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.821+0000 7fe289ffb700 1 -- 172.21.15.114:0/3295851223 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe2800ce460 con 0x7fe28c067fa0 2023-10-18T14:03:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.822+0000 7fe28bfff700 1 --2- 172.21.15.114:0/3295851223 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe27c0a1560 0x7fe27c0a3a20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe278006fd0 tx=0x7fe278008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:47.825+0000 7fe289ffb700 1 -- 172.21.15.114:0/3295851223 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe28005d100 con 0x7fe28c067fa0 2023-10-18T14:03:48.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.016+0000 7fe292d92700 1 -- 172.21.15.114:0/3295851223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe28c067560 con 0x7fe28c067fa0 2023-10-18T14:03:48.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:47 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/4100810520' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-18T14:03:48.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.018+0000 7fe289ffb700 1 -- 172.21.15.114:0/3295851223 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22907 (secure 0 0 0) 0x7fe280097950 con 0x7fe28c067fa0 2023-10-18T14:03:48.022 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:48.022 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":85,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:03:08.625359+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:03:48.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.020+0000 7fe292d92700 1 -- 172.21.15.114:0/3295851223 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe27c0a1560 msgr2=0x7fe27c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.020+0000 7fe292d92700 1 --2- 172.21.15.114:0/3295851223 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe27c0a1560 0x7fe27c0a3a20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe278006fd0 tx=0x7fe278008040 comp rx=0 tx=0).stop 2023-10-18T14:03:48.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.020+0000 7fe292d92700 1 -- 172.21.15.114:0/3295851223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe28c067fa0 msgr2=0x7fe28c19c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.020+0000 7fe292d92700 1 --2- 172.21.15.114:0/3295851223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe28c067fa0 0x7fe28c19c930 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe280000c00 tx=0x7fe28000f880 comp rx=0 tx=0).stop 2023-10-18T14:03:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.020+0000 7fe292d92700 1 -- 172.21.15.114:0/3295851223 shutdown_connections 2023-10-18T14:03:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.020+0000 7fe292d92700 1 --2- 172.21.15.114:0/3295851223 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe27c0a1560 0x7fe27c0a3a20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.020+0000 7fe292d92700 1 --2- 172.21.15.114:0/3295851223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe28c106fe0 0x7fe28c196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.020+0000 7fe292d92700 1 --2- 172.21.15.114:0/3295851223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe28c067fa0 0x7fe28c19c930 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.020+0000 7fe292d92700 1 --2- 172.21.15.114:0/3295851223 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe28c1066c0 0x7fe28c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.020+0000 7fe292d92700 1 -- 172.21.15.114:0/3295851223 >> 172.21.15.114:0/3295851223 conn(0x7fe28c076400 msgr2=0x7fe28c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:48.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.020+0000 7fe292d92700 1 -- 172.21.15.114:0/3295851223 shutdown_connections 2023-10-18T14:03:48.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.020+0000 7fe292d92700 1 -- 172.21.15.114:0/3295851223 wait complete. 2023-10-18T14:03:48.035 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:47 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/4100810520' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-18T14:03:48.036 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T13:58:43.813590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T14:02:30.693853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T14:02:31.426625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T14:03:48.037 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T14:03:48.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:47 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/4100810520' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-18T14:03:48.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.158+0000 7f0439e8d700 1 -- 172.21.15.114:0/3295050747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0434100700 msgr2=0x7f0434100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.158+0000 7f0439e8d700 1 --2- 172.21.15.114:0/3295050747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0434100700 0x7f0434100b80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0424009990 tx=0x7f0424009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.158+0000 7f0439e8d700 1 -- 172.21.15.114:0/3295050747 shutdown_connections 2023-10-18T14:03:48.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.158+0000 7f0439e8d700 1 --2- 172.21.15.114:0/3295050747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04341010c0 0x7f043410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.158+0000 7f0439e8d700 1 --2- 172.21.15.114:0/3295050747 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0434106710 0x7f0434106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.158+0000 7f0439e8d700 1 --2- 172.21.15.114:0/3295050747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0434100700 0x7f0434100b80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.158+0000 7f0439e8d700 1 -- 172.21.15.114:0/3295050747 >> 172.21.15.114:0/3295050747 conn(0x7f04340fc1d0 msgr2=0x7f04340fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:48.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.158+0000 7f0439e8d700 1 -- 172.21.15.114:0/3295050747 shutdown_connections 2023-10-18T14:03:48.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.158+0000 7f0439e8d700 1 -- 172.21.15.114:0/3295050747 wait complete. 2023-10-18T14:03:48.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0439e8d700 1 Processor -- start 2023-10-18T14:03:48.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0439e8d700 1 -- start start 2023-10-18T14:03:48.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0439e8d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0434100700 0x7f043419c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:48.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0439e8d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04341010c0 0x7f043419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:48.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0439e8d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0434106710 0x7f0434196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:48.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0439e8d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0434196fd0 con 0x7f04341010c0 2023-10-18T14:03:48.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0439e8d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0434197140 con 0x7f0434100700 2023-10-18T14:03:48.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0439e8d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0434197300 con 0x7f0434106710 2023-10-18T14:03:48.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0432ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04341010c0 0x7f043419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:48.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0432ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04341010c0 0x7f043419cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43550/0 (socket says 172.21.15.114:43550) 2023-10-18T14:03:48.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0432ffd700 1 -- 172.21.15.114:0/2177103515 learned_addr learned my addr 172.21.15.114:0/2177103515 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:48.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0433fff700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0434106710 0x7f0434196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:48.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0432ffd700 1 -- 172.21.15.114:0/2177103515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0434106710 msgr2=0x7f0434196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0432ffd700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0434106710 0x7f0434196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0432ffd700 1 -- 172.21.15.114:0/2177103515 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0434100700 msgr2=0x7f043419c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0432ffd700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0434100700 0x7f043419c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0432ffd700 1 -- 172.21.15.114:0/2177103515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04240095f0 con 0x7f04341010c0 2023-10-18T14:03:48.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0433fff700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0434106710 0x7f0434196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:48.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.159+0000 7f0432ffd700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04341010c0 0x7f043419cd80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f04240098e0 tx=0x7f042400f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:48.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.160+0000 7f0430ff9700 1 -- 172.21.15.114:0/2177103515 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042401d070 con 0x7f04341010c0 2023-10-18T14:03:48.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.160+0000 7f0439e8d700 1 -- 172.21.15.114:0/2177103515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0434197580 con 0x7f04341010c0 2023-10-18T14:03:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.160+0000 7f0430ff9700 1 -- 172.21.15.114:0/2177103515 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f042400fb90 con 0x7f04341010c0 2023-10-18T14:03:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.160+0000 7f0430ff9700 1 -- 172.21.15.114:0/2177103515 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424017650 con 0x7f04341010c0 2023-10-18T14:03:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.160+0000 7f0439e8d700 1 -- 172.21.15.114:0/2177103515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04341a3830 con 0x7f04341010c0 2023-10-18T14:03:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.160+0000 7f0439e8d700 1 -- 172.21.15.114:0/2177103515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0434108d20 con 0x7f04341010c0 2023-10-18T14:03:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.162+0000 7f0430ff9700 1 -- 172.21.15.114:0/2177103515 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f042400fd00 con 0x7f04341010c0 2023-10-18T14:03:48.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.162+0000 7f0430ff9700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f04200a1560 0x7f04200a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:48.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.162+0000 7f0430ff9700 1 -- 172.21.15.114:0/2177103515 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f04240ce3d0 con 0x7f04341010c0 2023-10-18T14:03:48.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.162+0000 7f04337fe700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f04200a1560 0x7f04200a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:48.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.163+0000 7f04337fe700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f04200a1560 0x7f04200a3a20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f041c00a8f0 tx=0x7f041c005bf0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:48.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.166+0000 7f0430ff9700 1 -- 172.21.15.114:0/2177103515 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f04240978c0 con 0x7f04341010c0 2023-10-18T14:03:48.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.361+0000 7f0439e8d700 1 -- 172.21.15.114:0/2177103515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0434197e30 con 0x7f04341010c0 2023-10-18T14:03:48.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.361+0000 7f0430ff9700 1 -- 172.21.15.114:0/2177103515 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f042409aee0 con 0x7f04341010c0 2023-10-18T14:03:48.366 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T14:03:48.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.364+0000 7f0439e8d700 1 -- 172.21.15.114:0/2177103515 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f04200a1560 msgr2=0x7f04200a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.364+0000 7f0439e8d700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f04200a1560 0x7f04200a3a20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f041c00a8f0 tx=0x7f041c005bf0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.364+0000 7f0439e8d700 1 -- 172.21.15.114:0/2177103515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04341010c0 msgr2=0x7f043419cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.364+0000 7f0439e8d700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04341010c0 0x7f043419cd80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f04240098e0 tx=0x7f042400f720 comp rx=0 tx=0).stop 2023-10-18T14:03:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.364+0000 7f0439e8d700 1 -- 172.21.15.114:0/2177103515 shutdown_connections 2023-10-18T14:03:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.364+0000 7f0439e8d700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f04200a1560 0x7f04200a3a20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.364+0000 7f0439e8d700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0434106710 0x7f0434196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.364+0000 7f0439e8d700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0434100700 0x7f043419c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.364+0000 7f0439e8d700 1 --2- 172.21.15.114:0/2177103515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04341010c0 0x7f043419cd80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.364+0000 7f0439e8d700 1 -- 172.21.15.114:0/2177103515 >> 172.21.15.114:0/2177103515 conn(0x7f04340fc1d0 msgr2=0x7f04340fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:48.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.364+0000 7f0439e8d700 1 -- 172.21.15.114:0/2177103515 shutdown_connections 2023-10-18T14:03:48.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.364+0000 7f0439e8d700 1 -- 172.21.15.114:0/2177103515 wait complete. 2023-10-18T14:03:48.380 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T14:03:48.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.500+0000 7f39bc5e9700 1 -- 172.21.15.114:0/3036586639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b41015b0 msgr2=0x7f39b4101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.500+0000 7f39bc5e9700 1 --2- 172.21.15.114:0/3036586639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b41015b0 0x7f39b4101990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009990 tx=0x7f39a4009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.500+0000 7f39bc5e9700 1 -- 172.21.15.114:0/3036586639 shutdown_connections 2023-10-18T14:03:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.500+0000 7f39bc5e9700 1 --2- 172.21.15.114:0/3036586639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39b41002b0 0x7f39b410c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.500+0000 7f39bc5e9700 1 --2- 172.21.15.114:0/3036586639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b41015b0 0x7f39b4101990 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.500+0000 7f39bc5e9700 1 --2- 172.21.15.114:0/3036586639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39b40ff8f0 0x7f39b40ffd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.500+0000 7f39bc5e9700 1 -- 172.21.15.114:0/3036586639 >> 172.21.15.114:0/3036586639 conn(0x7f39b4077570 msgr2=0x7f39b4077980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:48.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.500+0000 7f39bc5e9700 1 -- 172.21.15.114:0/3036586639 shutdown_connections 2023-10-18T14:03:48.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.500+0000 7f39bc5e9700 1 -- 172.21.15.114:0/3036586639 wait complete. 2023-10-18T14:03:48.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.501+0000 7f39bc5e9700 1 Processor -- start 2023-10-18T14:03:48.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.501+0000 7f39bc5e9700 1 -- start start 2023-10-18T14:03:48.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.501+0000 7f39bc5e9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39b40ff8f0 0x7f39b419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:48.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.501+0000 7f39bc5e9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39b41002b0 0x7f39b419be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:48.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.501+0000 7f39bc5e9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b41015b0 0x7f39b4195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:48.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.501+0000 7f39bc5e9700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b4196100 con 0x7f39b41015b0 2023-10-18T14:03:48.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.501+0000 7f39bc5e9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b4196270 con 0x7f39b41002b0 2023-10-18T14:03:48.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.501+0000 7f39bc5e9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b4196430 con 0x7f39b40ff8f0 2023-10-18T14:03:48.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.501+0000 7f39bab86700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b41015b0 0x7f39b4195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:48.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.501+0000 7f39bab86700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b41015b0 0x7f39b4195aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43566/0 (socket says 172.21.15.114:43566) 2023-10-18T14:03:48.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.501+0000 7f39bab86700 1 -- 172.21.15.114:0/860385507 learned_addr learned my addr 172.21.15.114:0/860385507 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:48.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.501+0000 7f39ba385700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39b40ff8f0 0x7f39b419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:48.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.502+0000 7f39b9b84700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39b41002b0 0x7f39b419be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:48.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.502+0000 7f39bab86700 1 -- 172.21.15.114:0/860385507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39b40ff8f0 msgr2=0x7f39b419b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.502+0000 7f39bab86700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39b40ff8f0 0x7f39b419b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.502+0000 7f39bab86700 1 -- 172.21.15.114:0/860385507 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39b41002b0 msgr2=0x7f39b419be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.502+0000 7f39bab86700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39b41002b0 0x7f39b419be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.502+0000 7f39bab86700 1 -- 172.21.15.114:0/860385507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a40095f0 con 0x7f39b41015b0 2023-10-18T14:03:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.502+0000 7f39b9b84700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39b41002b0 0x7f39b419be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.502+0000 7f39bab86700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b41015b0 0x7f39b4195aa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f39ac007ee0 tx=0x7f39ac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.502+0000 7f39ab7fe700 1 -- 172.21.15.114:0/860385507 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac017070 con 0x7f39b41015b0 2023-10-18T14:03:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.502+0000 7f39ab7fe700 1 -- 172.21.15.114:0/860385507 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39ac00f040 con 0x7f39b41015b0 2023-10-18T14:03:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.502+0000 7f39bc5e9700 1 -- 172.21.15.114:0/860385507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b4196710 con 0x7f39b41015b0 2023-10-18T14:03:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.502+0000 7f39ab7fe700 1 -- 172.21.15.114:0/860385507 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac005740 con 0x7f39b41015b0 2023-10-18T14:03:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.502+0000 7f39bc5e9700 1 -- 172.21.15.114:0/860385507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b41a2910 con 0x7f39b41015b0 2023-10-18T14:03:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.503+0000 7f39bc5e9700 1 -- 172.21.15.114:0/860385507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b4107d20 con 0x7f39b41015b0 2023-10-18T14:03:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.504+0000 7f39ab7fe700 1 -- 172.21.15.114:0/860385507 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f39ac00dc60 con 0x7f39b41015b0 2023-10-18T14:03:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.505+0000 7f39ab7fe700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f39a00a1560 0x7f39a00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.505+0000 7f39ba385700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f39a00a1560 0x7f39a00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.505+0000 7f39ab7fe700 1 -- 172.21.15.114:0/860385507 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f39ac0ccd10 con 0x7f39b41015b0 2023-10-18T14:03:48.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.505+0000 7f39ba385700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f39a00a1560 0x7f39a00a3a20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f39a400b5c0 tx=0x7f39a4005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:48.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.509+0000 7f39ab7fe700 1 -- 172.21.15.114:0/860385507 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f39ac096170 con 0x7f39b41015b0 2023-10-18T14:03:48.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.703+0000 7f39bc5e9700 1 -- 172.21.15.114:0/860385507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39b4196f10 con 0x7f39b41015b0 2023-10-18T14:03:48.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.703+0000 7f39ab7fe700 1 -- 172.21.15.114:0/860385507 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39ac099790 con 0x7f39b41015b0 2023-10-18T14:03:48.707 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T14:03:48.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.705+0000 7f39bc5e9700 1 -- 172.21.15.114:0/860385507 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f39a00a1560 msgr2=0x7f39a00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.705+0000 7f39bc5e9700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f39a00a1560 0x7f39a00a3a20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f39a400b5c0 tx=0x7f39a4005960 comp rx=0 tx=0).stop 2023-10-18T14:03:48.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.705+0000 7f39bc5e9700 1 -- 172.21.15.114:0/860385507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b41015b0 msgr2=0x7f39b4195aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.705+0000 7f39bc5e9700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b41015b0 0x7f39b4195aa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f39ac007ee0 tx=0x7f39ac00d3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.705+0000 7f39bc5e9700 1 -- 172.21.15.114:0/860385507 shutdown_connections 2023-10-18T14:03:48.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.705+0000 7f39bc5e9700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f39a00a1560 0x7f39a00a3a20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.705+0000 7f39bc5e9700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b41015b0 0x7f39b4195aa0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.705+0000 7f39bc5e9700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39b40ff8f0 0x7f39b419b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.705+0000 7f39bc5e9700 1 --2- 172.21.15.114:0/860385507 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f39b41002b0 0x7f39b419be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.705+0000 7f39bc5e9700 1 -- 172.21.15.114:0/860385507 >> 172.21.15.114:0/860385507 conn(0x7f39b4077570 msgr2=0x7f39b40fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:48.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.705+0000 7f39bc5e9700 1 -- 172.21.15.114:0/860385507 shutdown_connections 2023-10-18T14:03:48.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.705+0000 7f39bc5e9700 1 -- 172.21.15.114:0/860385507 wait complete. 2023-10-18T14:03:48.721 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T14:03:48.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.841+0000 7faae125c700 1 -- 172.21.15.114:0/665920998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faadc100000 msgr2=0x7faadc10c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.841+0000 7faae125c700 1 --2- 172.21.15.114:0/665920998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faadc100000 0x7faadc10c510 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7faad400b0a0 tx=0x7faad400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.841+0000 7faae125c700 1 -- 172.21.15.114:0/665920998 shutdown_connections 2023-10-18T14:03:48.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.841+0000 7faae125c700 1 --2- 172.21.15.114:0/665920998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faadc100000 0x7faadc10c510 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.841+0000 7faae125c700 1 --2- 172.21.15.114:0/665920998 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faadc105650 0x7faadc105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.841+0000 7faae125c700 1 --2- 172.21.15.114:0/665920998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faadc0ff640 0x7faadc0ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.841+0000 7faae125c700 1 -- 172.21.15.114:0/665920998 >> 172.21.15.114:0/665920998 conn(0x7faadc076790 msgr2=0x7faadc076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:48.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.841+0000 7faae125c700 1 -- 172.21.15.114:0/665920998 shutdown_connections 2023-10-18T14:03:48.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.841+0000 7faae125c700 1 -- 172.21.15.114:0/665920998 wait complete. 2023-10-18T14:03:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.842+0000 7faae125c700 1 Processor -- start 2023-10-18T14:03:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.842+0000 7faae125c700 1 -- start start 2023-10-18T14:03:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faae125c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faadc0ff640 0x7faadc19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faae125c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faadc100000 0x7faadc19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faae125c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faadc105650 0x7faadc195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faae125c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc195f90 con 0x7faadc100000 2023-10-18T14:03:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faae125c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc196100 con 0x7faadc105650 2023-10-18T14:03:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faae125c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc1962c0 con 0x7faadc0ff640 2023-10-18T14:03:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faada59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faadc100000 0x7faadc19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faada59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faadc100000 0x7faadc19bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43578/0 (socket says 172.21.15.114:43578) 2023-10-18T14:03:48.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faada59c700 1 -- 172.21.15.114:0/3686362163 learned_addr learned my addr 172.21.15.114:0/3686362163 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:48.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faadad9d700 1 --2- 172.21.15.114:0/3686362163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faadc0ff640 0x7faadc19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:48.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faada59c700 1 -- 172.21.15.114:0/3686362163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faadc0ff640 msgr2=0x7faadc19b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faada59c700 1 --2- 172.21.15.114:0/3686362163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faadc0ff640 0x7faadc19b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faada59c700 1 -- 172.21.15.114:0/3686362163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faadc105650 msgr2=0x7faadc195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:48.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faada59c700 1 --2- 172.21.15.114:0/3686362163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faadc105650 0x7faadc195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:48.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faada59c700 1 -- 172.21.15.114:0/3686362163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad4009d00 con 0x7faadc100000 2023-10-18T14:03:48.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faada59c700 1 --2- 172.21.15.114:0/3686362163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faadc100000 0x7faadc19bd40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faacc00e9a0 tx=0x7faacc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:48.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.843+0000 7faac3fff700 1 -- 172.21.15.114:0/3686362163 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc009790 con 0x7faadc100000 2023-10-18T14:03:48.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.844+0000 7faac3fff700 1 -- 172.21.15.114:0/3686362163 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faacc00cbd0 con 0x7faadc100000 2023-10-18T14:03:48.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.844+0000 7faae125c700 1 -- 172.21.15.114:0/3686362163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc1965a0 con 0x7faadc100000 2023-10-18T14:03:48.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.844+0000 7faac3fff700 1 -- 172.21.15.114:0/3686362163 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc018680 con 0x7faadc100000 2023-10-18T14:03:48.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.844+0000 7faae125c700 1 -- 172.21.15.114:0/3686362163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc1a27f0 con 0x7faadc100000 2023-10-18T14:03:48.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.844+0000 7faae125c700 1 -- 172.21.15.114:0/3686362163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc107c60 con 0x7faadc100000 2023-10-18T14:03:48.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.845+0000 7faac3fff700 1 -- 172.21.15.114:0/3686362163 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7faacc00cd40 con 0x7faadc100000 2023-10-18T14:03:48.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.846+0000 7faac3fff700 1 --2- 172.21.15.114:0/3686362163 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faac40a1560 0x7faac40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:48.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.846+0000 7faadad9d700 1 --2- 172.21.15.114:0/3686362163 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faac40a1560 0x7faac40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:48.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.846+0000 7faac3fff700 1 -- 172.21.15.114:0/3686362163 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7faacc014070 con 0x7faadc100000 2023-10-18T14:03:48.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.846+0000 7faadad9d700 1 --2- 172.21.15.114:0/3686362163 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faac40a1560 0x7faac40a3a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faad0005950 tx=0x7faad000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:48.849+0000 7faac3fff700 1 -- 172.21.15.114:0/3686362163 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faacc096940 con 0x7faadc100000 2023-10-18T14:03:49.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:48 smithi158 ceph-mon[103317]: pgmap v273: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:49.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:48 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3295851223' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:49.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:48 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2177103515' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:49.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.039+0000 7faae125c700 1 -- 172.21.15.114:0/3686362163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faadc196df0 con 0x7faadc100000 2023-10-18T14:03:49.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.040+0000 7faac3fff700 1 -- 172.21.15.114:0/3686362163 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7faacc099f60 con 0x7faadc100000 2023-10-18T14:03:49.044 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T14:03:49.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.041+0000 7faae125c700 1 -- 172.21.15.114:0/3686362163 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faac40a1560 msgr2=0x7faac40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.041+0000 7faae125c700 1 --2- 172.21.15.114:0/3686362163 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faac40a1560 0x7faac40a3a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faad0005950 tx=0x7faad000b410 comp rx=0 tx=0).stop 2023-10-18T14:03:49.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.041+0000 7faae125c700 1 -- 172.21.15.114:0/3686362163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faadc100000 msgr2=0x7faadc19bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.041+0000 7faae125c700 1 --2- 172.21.15.114:0/3686362163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faadc100000 0x7faadc19bd40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faacc00e9a0 tx=0x7faacc00ecb0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.042+0000 7faae125c700 1 -- 172.21.15.114:0/3686362163 shutdown_connections 2023-10-18T14:03:49.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.042+0000 7faae125c700 1 --2- 172.21.15.114:0/3686362163 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faac40a1560 0x7faac40a3a20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.042+0000 7faae125c700 1 --2- 172.21.15.114:0/3686362163 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faadc105650 0x7faadc195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.042+0000 7faae125c700 1 --2- 172.21.15.114:0/3686362163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faadc0ff640 0x7faadc19b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.042+0000 7faae125c700 1 --2- 172.21.15.114:0/3686362163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faadc100000 0x7faadc19bd40 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.042+0000 7faae125c700 1 -- 172.21.15.114:0/3686362163 >> 172.21.15.114:0/3686362163 conn(0x7faadc076790 msgr2=0x7faadc0fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:49.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.042+0000 7faae125c700 1 -- 172.21.15.114:0/3686362163 shutdown_connections 2023-10-18T14:03:49.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.042+0000 7faae125c700 1 -- 172.21.15.114:0/3686362163 wait complete. 2023-10-18T14:03:49.057 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:48 smithi114 ceph-mon[99494]: pgmap v273: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:49.057 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:48 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3295851223' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:49.057 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:48 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2177103515' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:49.058 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:03:49.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:48 smithi172 ceph-mon[103574]: pgmap v273: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:49.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:48 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3295851223' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:49.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:48 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2177103515' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.175+0000 7f9c2332b700 1 -- 172.21.15.114:0/3667189138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c1c105710 msgr2=0x7f9c1c105af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.175+0000 7f9c2332b700 1 --2- 172.21.15.114:0/3667189138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c1c105710 0x7f9c1c105af0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009990 tx=0x7f9c10009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.175+0000 7f9c2332b700 1 -- 172.21.15.114:0/3667189138 shutdown_connections 2023-10-18T14:03:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.175+0000 7f9c2332b700 1 --2- 172.21.15.114:0/3667189138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c1c100290 0x7f9c1c10c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.175+0000 7f9c2332b700 1 --2- 172.21.15.114:0/3667189138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c1c105710 0x7f9c1c105af0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.175+0000 7f9c2332b700 1 --2- 172.21.15.114:0/3667189138 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c1c0ff8d0 0x7f9c1c0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.175+0000 7f9c2332b700 1 -- 172.21.15.114:0/3667189138 >> 172.21.15.114:0/3667189138 conn(0x7f9c1c076400 msgr2=0x7f9c1c076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:49.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.175+0000 7f9c2332b700 1 -- 172.21.15.114:0/3667189138 shutdown_connections 2023-10-18T14:03:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.175+0000 7f9c2332b700 1 -- 172.21.15.114:0/3667189138 wait complete. 2023-10-18T14:03:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c2332b700 1 Processor -- start 2023-10-18T14:03:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c2332b700 1 -- start start 2023-10-18T14:03:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c2332b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c1c0ff8d0 0x7f9c1c19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c2332b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c1c100290 0x7f9c1c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c2332b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c1c105710 0x7f9c1c1968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c2332b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c196f20 con 0x7f9c1c0ff8d0 2023-10-18T14:03:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c2332b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c197090 con 0x7f9c1c105710 2023-10-18T14:03:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c2332b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c197250 con 0x7f9c1c100290 2023-10-18T14:03:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c210c7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c1c0ff8d0 0x7f9c1c19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:49.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c210c7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c1c0ff8d0 0x7f9c1c19c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43590/0 (socket says 172.21.15.114:43590) 2023-10-18T14:03:49.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c210c7700 1 -- 172.21.15.114:0/4035935494 learned_addr learned my addr 172.21.15.114:0/4035935494 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:49.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c208c6700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c1c100290 0x7f9c1c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:49.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c210c7700 1 -- 172.21.15.114:0/4035935494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c1c100290 msgr2=0x7f9c1c19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c210c7700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c1c100290 0x7f9c1c19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c210c7700 1 -- 172.21.15.114:0/4035935494 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c1c105710 msgr2=0x7f9c1c1968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c210c7700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c1c105710 0x7f9c1c1968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.176+0000 7f9c210c7700 1 -- 172.21.15.114:0/4035935494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c100095f0 con 0x7f9c1c0ff8d0 2023-10-18T14:03:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.177+0000 7f9c208c6700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c1c100290 0x7f9c1c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.177+0000 7f9c210c7700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c1c0ff8d0 0x7f9c1c19c790 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9c10000c00 tx=0x7f9c1000f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.177+0000 7f9c0e7fc700 1 -- 172.21.15.114:0/4035935494 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1001d070 con 0x7f9c1c0ff8d0 2023-10-18T14:03:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.177+0000 7f9c0e7fc700 1 -- 172.21.15.114:0/4035935494 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c1000fde0 con 0x7f9c1c0ff8d0 2023-10-18T14:03:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.177+0000 7f9c2332b700 1 -- 172.21.15.114:0/4035935494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1c1974d0 con 0x7f9c1c0ff8d0 2023-10-18T14:03:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.177+0000 7f9c0e7fc700 1 -- 172.21.15.114:0/4035935494 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10017770 con 0x7f9c1c0ff8d0 2023-10-18T14:03:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.177+0000 7f9c2332b700 1 -- 172.21.15.114:0/4035935494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1c1a3780 con 0x7f9c1c0ff8d0 2023-10-18T14:03:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.178+0000 7f9c2332b700 1 -- 172.21.15.114:0/4035935494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1c100cc0 con 0x7f9c1c0ff8d0 2023-10-18T14:03:49.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.179+0000 7f9c0e7fc700 1 -- 172.21.15.114:0/4035935494 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f9c10022aa0 con 0x7f9c1c0ff8d0 2023-10-18T14:03:49.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.179+0000 7f9c0e7fc700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9c080a1560 0x7f9c080a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:49.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.179+0000 7f9c0e7fc700 1 -- 172.21.15.114:0/4035935494 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9c100ce660 con 0x7f9c1c0ff8d0 2023-10-18T14:03:49.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.179+0000 7f9c208c6700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9c080a1560 0x7f9c080a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:49.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.180+0000 7f9c208c6700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9c080a1560 0x7f9c080a3a20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9c18005fd0 tx=0x7f9c18005dc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:49.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.183+0000 7f9c0e7fc700 1 -- 172.21.15.114:0/4035935494 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9c10097b50 con 0x7f9c1c0ff8d0 2023-10-18T14:03:49.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.421+0000 7f9c2332b700 1 -- 172.21.15.114:0/4035935494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c1c067530 con 0x7f9c1c0ff8d0 2023-10-18T14:03:49.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.421+0000 7f9c0e7fc700 1 -- 172.21.15.114:0/4035935494 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11390 (secure 0 0 0) 0x7f9c1009b170 con 0x7f9c1c0ff8d0 2023-10-18T14:03:49.427 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:49.428 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:02:39.260198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:03:49.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.423+0000 7f9c2332b700 1 -- 172.21.15.114:0/4035935494 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9c080a1560 msgr2=0x7f9c080a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.423+0000 7f9c2332b700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9c080a1560 0x7f9c080a3a20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9c18005fd0 tx=0x7f9c18005dc0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.424+0000 7f9c2332b700 1 -- 172.21.15.114:0/4035935494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c1c0ff8d0 msgr2=0x7f9c1c19c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.424+0000 7f9c2332b700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c1c0ff8d0 0x7f9c1c19c790 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9c10000c00 tx=0x7f9c1000f880 comp rx=0 tx=0).stop 2023-10-18T14:03:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.424+0000 7f9c2332b700 1 -- 172.21.15.114:0/4035935494 shutdown_connections 2023-10-18T14:03:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.424+0000 7f9c2332b700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9c080a1560 0x7f9c080a3a20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.424+0000 7f9c2332b700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c1c105710 0x7f9c1c1968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.424+0000 7f9c2332b700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c1c0ff8d0 0x7f9c1c19c790 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.424+0000 7f9c2332b700 1 --2- 172.21.15.114:0/4035935494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c1c100290 0x7f9c1c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.424+0000 7f9c2332b700 1 -- 172.21.15.114:0/4035935494 >> 172.21.15.114:0/4035935494 conn(0x7f9c1c076400 msgr2=0x7f9c1c103910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:49.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.424+0000 7f9c2332b700 1 -- 172.21.15.114:0/4035935494 shutdown_connections 2023-10-18T14:03:49.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.424+0000 7f9c2332b700 1 -- 172.21.15.114:0/4035935494 wait complete. 2023-10-18T14:03:49.431 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2023-10-18T14:03:49.440 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:03:49.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.558+0000 7f56c62a9700 1 -- 172.21.15.114:0/2575280961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56c0106720 msgr2=0x7f56c0106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.558+0000 7f56c62a9700 1 --2- 172.21.15.114:0/2575280961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56c0106720 0x7f56c0106b00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009990 tx=0x7f56b0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.558+0000 7f56c62a9700 1 -- 172.21.15.114:0/2575280961 shutdown_connections 2023-10-18T14:03:49.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.558+0000 7f56c62a9700 1 --2- 172.21.15.114:0/2575280961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56c00ff5a0 0x7f56c010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.558+0000 7f56c62a9700 1 --2- 172.21.15.114:0/2575280961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56c0106720 0x7f56c0106b00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.558+0000 7f56c62a9700 1 --2- 172.21.15.114:0/2575280961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56c00fec00 0x7f56c00ff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.558+0000 7f56c62a9700 1 -- 172.21.15.114:0/2575280961 >> 172.21.15.114:0/2575280961 conn(0x7f56c0075b90 msgr2=0x7f56c00fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:49.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.558+0000 7f56c62a9700 1 -- 172.21.15.114:0/2575280961 shutdown_connections 2023-10-18T14:03:49.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.558+0000 7f56c62a9700 1 -- 172.21.15.114:0/2575280961 wait complete. 2023-10-18T14:03:49.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.559+0000 7f56c62a9700 1 Processor -- start 2023-10-18T14:03:49.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.559+0000 7f56c62a9700 1 -- start start 2023-10-18T14:03:49.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56c62a9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56c00fec00 0x7f56c019c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:49.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56c62a9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56c00ff5a0 0x7f56c019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:49.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56c62a9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56c0106720 0x7f56c0196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:49.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56c62a9700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c0197100 con 0x7f56c00ff5a0 2023-10-18T14:03:49.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56c62a9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c0197270 con 0x7f56c0106720 2023-10-18T14:03:49.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56c62a9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c0197430 con 0x7f56c00fec00 2023-10-18T14:03:49.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56bf7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56c00ff5a0 0x7f56c019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:49.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56bf7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56c00ff5a0 0x7f56c019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43606/0 (socket says 172.21.15.114:43606) 2023-10-18T14:03:49.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56bf7fe700 1 -- 172.21.15.114:0/1770501337 learned_addr learned my addr 172.21.15.114:0/1770501337 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:49.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56bffff700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56c00fec00 0x7f56c019c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:49.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56c4846700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56c0106720 0x7f56c0196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:49.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56bf7fe700 1 -- 172.21.15.114:0/1770501337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56c00fec00 msgr2=0x7f56c019c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56bf7fe700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56c00fec00 0x7f56c019c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56bf7fe700 1 -- 172.21.15.114:0/1770501337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56c0106720 msgr2=0x7f56c0196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56bf7fe700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56c0106720 0x7f56c0196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56bf7fe700 1 -- 172.21.15.114:0/1770501337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b00095f0 con 0x7f56c00ff5a0 2023-10-18T14:03:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56c4846700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56c0106720 0x7f56c0196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56bf7fe700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56c00ff5a0 0x7f56c019ceb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f56b400c920 tx=0x7f56b400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56bd7fa700 1 -- 172.21.15.114:0/1770501337 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b4007b00 con 0x7f56c00ff5a0 2023-10-18T14:03:49.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56bd7fa700 1 -- 172.21.15.114:0/1770501337 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56b400ce70 con 0x7f56c00ff5a0 2023-10-18T14:03:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56c62a9700 1 -- 172.21.15.114:0/1770501337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c0197710 con 0x7f56c00ff5a0 2023-10-18T14:03:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.560+0000 7f56bd7fa700 1 -- 172.21.15.114:0/1770501337 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b40054e0 con 0x7f56c00ff5a0 2023-10-18T14:03:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.561+0000 7f56c62a9700 1 -- 172.21.15.114:0/1770501337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c01a3960 con 0x7f56c00ff5a0 2023-10-18T14:03:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.561+0000 7f56c62a9700 1 -- 172.21.15.114:0/1770501337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c0108cc0 con 0x7f56c00ff5a0 2023-10-18T14:03:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.562+0000 7f56bd7fa700 1 -- 172.21.15.114:0/1770501337 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f56b4004750 con 0x7f56c00ff5a0 2023-10-18T14:03:49.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.563+0000 7f56bd7fa700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f56a80a1560 0x7f56a80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:49.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.563+0000 7f56bffff700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f56a80a1560 0x7f56a80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:49.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.563+0000 7f56bd7fa700 1 -- 172.21.15.114:0/1770501337 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f56b40ccb50 con 0x7f56c00ff5a0 2023-10-18T14:03:49.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.563+0000 7f56bffff700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f56a80a1560 0x7f56a80a3a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f56b000b5c0 tx=0x7f56b0005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:49.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.567+0000 7f56bd7fa700 1 -- 172.21.15.114:0/1770501337 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f56b4095fb0 con 0x7f56c00ff5a0 2023-10-18T14:03:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.763+0000 7f56c62a9700 1 -- 172.21.15.114:0/1770501337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56c0101f20 con 0x7f56c00ff5a0 2023-10-18T14:03:49.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.764+0000 7f56bd7fa700 1 -- 172.21.15.114:0/1770501337 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22907 (secure 0 0 0) 0x7f56b401d090 con 0x7f56c00ff5a0 2023-10-18T14:03:49.769 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:49.769 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":85,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:03:08.625359+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:03:49.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.767+0000 7f56c62a9700 1 -- 172.21.15.114:0/1770501337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f56a80a1560 msgr2=0x7f56a80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.767+0000 7f56c62a9700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f56a80a1560 0x7f56a80a3a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f56b000b5c0 tx=0x7f56b0005fd0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.767+0000 7f56c62a9700 1 -- 172.21.15.114:0/1770501337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56c00ff5a0 msgr2=0x7f56c019ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.767+0000 7f56c62a9700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56c00ff5a0 0x7f56c019ceb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f56b400c920 tx=0x7f56b400cc30 comp rx=0 tx=0).stop 2023-10-18T14:03:49.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.767+0000 7f56c62a9700 1 -- 172.21.15.114:0/1770501337 shutdown_connections 2023-10-18T14:03:49.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.767+0000 7f56c62a9700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f56a80a1560 0x7f56a80a3a20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.767+0000 7f56c62a9700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56c0106720 0x7f56c0196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.767+0000 7f56c62a9700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56c00fec00 0x7f56c019c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.767+0000 7f56c62a9700 1 --2- 172.21.15.114:0/1770501337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56c00ff5a0 0x7f56c019ceb0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.767+0000 7f56c62a9700 1 -- 172.21.15.114:0/1770501337 >> 172.21.15.114:0/1770501337 conn(0x7f56c0075b90 msgr2=0x7f56c0103720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:49.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.767+0000 7f56c62a9700 1 -- 172.21.15.114:0/1770501337 shutdown_connections 2023-10-18T14:03:49.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.767+0000 7f56c62a9700 1 -- 172.21.15.114:0/1770501337 wait complete. 2023-10-18T14:03:49.782 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:49 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/860385507' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:49.782 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:49 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3686362163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:49.782 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:49 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/4035935494' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:49.784 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T13:58:43.813590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T14:02:30.693853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T14:02:31.426625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T14:03:49.784 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T14:03:49.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.905+0000 7f277aae7700 1 -- 172.21.15.114:0/4203531639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27740ffae0 msgr2=0x7f277410d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.905+0000 7f277aae7700 1 --2- 172.21.15.114:0/4203531639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27740ffae0 0x7f277410d5e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f276c00b0a0 tx=0x7f276c00b3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.905+0000 7f277aae7700 1 -- 172.21.15.114:0/4203531639 shutdown_connections 2023-10-18T14:03:49.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.905+0000 7f277aae7700 1 --2- 172.21.15.114:0/4203531639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27740ffae0 0x7f277410d5e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.905+0000 7f277aae7700 1 --2- 172.21.15.114:0/4203531639 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2774106860 0x7f2774106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.905+0000 7f277aae7700 1 --2- 172.21.15.114:0/4203531639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27740ff120 0x7f27740ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.905+0000 7f277aae7700 1 -- 172.21.15.114:0/4203531639 >> 172.21.15.114:0/4203531639 conn(0x7f2774074890 msgr2=0x7f2774074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.905+0000 7f277aae7700 1 -- 172.21.15.114:0/4203531639 shutdown_connections 2023-10-18T14:03:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.905+0000 7f277aae7700 1 -- 172.21.15.114:0/4203531639 wait complete. 2023-10-18T14:03:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.905+0000 7f277aae7700 1 Processor -- start 2023-10-18T14:03:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.905+0000 7f277aae7700 1 -- start start 2023-10-18T14:03:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f277aae7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27740ff120 0x7f277419c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f277aae7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27740ffae0 0x7f277419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f277aae7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2774106860 0x7f2774196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f277aae7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2774197130 con 0x7f27740ff120 2023-10-18T14:03:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f277aae7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27741972a0 con 0x7f27740ffae0 2023-10-18T14:03:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f277aae7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2774197460 con 0x7f2774106860 2023-10-18T14:03:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2778883700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27740ff120 0x7f277419c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2778883700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27740ff120 0x7f277419c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43618/0 (socket says 172.21.15.114:43618) 2023-10-18T14:03:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2778883700 1 -- 172.21.15.114:0/2051506472 learned_addr learned my addr 172.21.15.114:0/2051506472 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2773fff700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27740ffae0 0x7f277419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2779084700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2774106860 0x7f2774196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2778883700 1 -- 172.21.15.114:0/2051506472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2774106860 msgr2=0x7f2774196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2778883700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2774106860 0x7f2774196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2778883700 1 -- 172.21.15.114:0/2051506472 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27740ffae0 msgr2=0x7f277419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:49.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2778883700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27740ffae0 0x7f277419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:49.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2778883700 1 -- 172.21.15.114:0/2051506472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c009d00 con 0x7f27740ff120 2023-10-18T14:03:49.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2779084700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2774106860 0x7f2774196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:49.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2778883700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27740ff120 0x7f277419c9a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f276800d980 tx=0x7f276800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2771ffb700 1 -- 172.21.15.114:0/2051506472 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768004220 con 0x7f27740ff120 2023-10-18T14:03:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2771ffb700 1 -- 172.21.15.114:0/2051506472 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2768007640 con 0x7f27740ff120 2023-10-18T14:03:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f277aae7700 1 -- 172.21.15.114:0/2051506472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2774197740 con 0x7f27740ff120 2023-10-18T14:03:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.906+0000 7f2771ffb700 1 -- 172.21.15.114:0/2051506472 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768005610 con 0x7f27740ff120 2023-10-18T14:03:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.907+0000 7f277aae7700 1 -- 172.21.15.114:0/2051506472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27741a3990 con 0x7f27740ff120 2023-10-18T14:03:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.907+0000 7f277aae7700 1 -- 172.21.15.114:0/2051506472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2774108cc0 con 0x7f27740ff120 2023-10-18T14:03:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.908+0000 7f2771ffb700 1 -- 172.21.15.114:0/2051506472 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f2768004750 con 0x7f27740ff120 2023-10-18T14:03:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.909+0000 7f2771ffb700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f27640a1560 0x7f27640a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.909+0000 7f2771ffb700 1 -- 172.21.15.114:0/2051506472 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f27680cce50 con 0x7f27740ff120 2023-10-18T14:03:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.909+0000 7f2773fff700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f27640a1560 0x7f27640a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.909+0000 7f2773fff700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f27640a1560 0x7f27640a3a20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2774197c90 tx=0x7f2760009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:49.913+0000 7f2771ffb700 1 -- 172.21.15.114:0/2051506472 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f27680962b0 con 0x7f27740ff120 2023-10-18T14:03:50.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:49 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/860385507' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:50.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:49 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3686362163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:50.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:49 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/4035935494' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:50.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:49 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/860385507' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:50.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:49 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3686362163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:50.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:49 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/4035935494' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:50.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.106+0000 7f277aae7700 1 -- 172.21.15.114:0/2051506472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2774197f90 con 0x7f27740ff120 2023-10-18T14:03:50.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.107+0000 7f2771ffb700 1 -- 172.21.15.114:0/2051506472 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2768016020 con 0x7f27740ff120 2023-10-18T14:03:50.111 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T14:03:50.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.109+0000 7f277aae7700 1 -- 172.21.15.114:0/2051506472 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f27640a1560 msgr2=0x7f27640a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.109+0000 7f277aae7700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f27640a1560 0x7f27640a3a20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2774197c90 tx=0x7f2760009260 comp rx=0 tx=0).stop 2023-10-18T14:03:50.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.109+0000 7f277aae7700 1 -- 172.21.15.114:0/2051506472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27740ff120 msgr2=0x7f277419c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.109+0000 7f277aae7700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27740ff120 0x7f277419c9a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f276800d980 tx=0x7f276800dc90 comp rx=0 tx=0).stop 2023-10-18T14:03:50.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.109+0000 7f277aae7700 1 -- 172.21.15.114:0/2051506472 shutdown_connections 2023-10-18T14:03:50.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.109+0000 7f277aae7700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f27640a1560 0x7f27640a3a20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.109+0000 7f277aae7700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2774106860 0x7f2774196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.109+0000 7f277aae7700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27740ff120 0x7f277419c9a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.109+0000 7f277aae7700 1 --2- 172.21.15.114:0/2051506472 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27740ffae0 0x7f277419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.109+0000 7f277aae7700 1 -- 172.21.15.114:0/2051506472 >> 172.21.15.114:0/2051506472 conn(0x7f2774074890 msgr2=0x7f27740fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:50.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.109+0000 7f277aae7700 1 -- 172.21.15.114:0/2051506472 shutdown_connections 2023-10-18T14:03:50.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.109+0000 7f277aae7700 1 -- 172.21.15.114:0/2051506472 wait complete. 2023-10-18T14:03:50.125 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T14:03:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.244+0000 7ff4c301d700 1 -- 172.21.15.114:0/3262193851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc104730 msgr2=0x7ff4bc104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.244+0000 7ff4c301d700 1 --2- 172.21.15.114:0/3262193851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc104730 0x7ff4bc104b10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009990 tx=0x7ff4b0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.244+0000 7ff4c301d700 1 -- 172.21.15.114:0/3262193851 shutdown_connections 2023-10-18T14:03:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.244+0000 7ff4c301d700 1 --2- 172.21.15.114:0/3262193851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4bc100c10 0x7ff4bc10c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.244+0000 7ff4c301d700 1 --2- 172.21.15.114:0/3262193851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc104730 0x7ff4bc104b10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.244+0000 7ff4c301d700 1 --2- 172.21.15.114:0/3262193851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4bc100250 0x7ff4bc1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.244+0000 7ff4c301d700 1 -- 172.21.15.114:0/3262193851 >> 172.21.15.114:0/3262193851 conn(0x7ff4bc0749d0 msgr2=0x7ff4bc074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.244+0000 7ff4c301d700 1 -- 172.21.15.114:0/3262193851 shutdown_connections 2023-10-18T14:03:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.244+0000 7ff4c301d700 1 -- 172.21.15.114:0/3262193851 wait complete. 2023-10-18T14:03:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.245+0000 7ff4c301d700 1 Processor -- start 2023-10-18T14:03:50.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.245+0000 7ff4c301d700 1 -- start start 2023-10-18T14:03:50.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.245+0000 7ff4c301d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4bc100250 0x7ff4bc19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:50.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.245+0000 7ff4c301d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc100c10 0x7ff4bc19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:50.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.245+0000 7ff4c301d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4bc104730 0x7ff4bc1959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:50.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.245+0000 7ff4c301d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc196180 con 0x7ff4bc100c10 2023-10-18T14:03:50.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.245+0000 7ff4c301d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc1962f0 con 0x7ff4bc100250 2023-10-18T14:03:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.245+0000 7ff4c301d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc1964b0 con 0x7ff4bc104730 2023-10-18T14:03:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.245+0000 7ff4bbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc100c10 0x7ff4bc19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.245+0000 7ff4bbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc100c10 0x7ff4bc19be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43632/0 (socket says 172.21.15.114:43632) 2023-10-18T14:03:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.245+0000 7ff4bbfff700 1 -- 172.21.15.114:0/3658522219 learned_addr learned my addr 172.21.15.114:0/3658522219 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4c15ba700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4bc104730 0x7ff4bc1959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4c0db9700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4bc100250 0x7ff4bc19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4bbfff700 1 -- 172.21.15.114:0/3658522219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4bc104730 msgr2=0x7ff4bc1959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4bbfff700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4bc104730 0x7ff4bc1959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4bbfff700 1 -- 172.21.15.114:0/3658522219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4bc100250 msgr2=0x7ff4bc19b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4bbfff700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4bc100250 0x7ff4bc19b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4bbfff700 1 -- 172.21.15.114:0/3658522219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b00095f0 con 0x7ff4bc100c10 2023-10-18T14:03:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4c0db9700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4bc100250 0x7ff4bc19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4bbfff700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc100c10 0x7ff4bc19be50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800d950 tx=0x7ff4a800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4b9ffb700 1 -- 172.21.15.114:0/3658522219 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8009940 con 0x7ff4bc100c10 2023-10-18T14:03:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4b9ffb700 1 -- 172.21.15.114:0/3658522219 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff4a8010460 con 0x7ff4bc100c10 2023-10-18T14:03:50.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4b9ffb700 1 -- 172.21.15.114:0/3658522219 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800f620 con 0x7ff4bc100c10 2023-10-18T14:03:50.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4c301d700 1 -- 172.21.15.114:0/3658522219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc196790 con 0x7ff4bc100c10 2023-10-18T14:03:50.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.246+0000 7ff4c301d700 1 -- 172.21.15.114:0/3658522219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc1a2890 con 0x7ff4bc100c10 2023-10-18T14:03:50.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.247+0000 7ff4c301d700 1 -- 172.21.15.114:0/3658522219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc107cd0 con 0x7ff4bc100c10 2023-10-18T14:03:50.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.248+0000 7ff4b9ffb700 1 -- 172.21.15.114:0/3658522219 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7ff4a80108d0 con 0x7ff4bc100c10 2023-10-18T14:03:50.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.248+0000 7ff4b9ffb700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff4ac0a15e0 0x7ff4ac0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:50.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.249+0000 7ff4c0db9700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff4ac0a15e0 0x7ff4ac0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:50.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.249+0000 7ff4b9ffb700 1 -- 172.21.15.114:0/3658522219 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff4a80ccd60 con 0x7ff4bc100c10 2023-10-18T14:03:50.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.249+0000 7ff4c0db9700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff4ac0a15e0 0x7ff4ac0a3aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0006010 tx=0x7ff4b001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:50.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.253+0000 7ff4b9ffb700 1 -- 172.21.15.114:0/3658522219 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff4a80961c0 con 0x7ff4bc100c10 2023-10-18T14:03:50.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.445+0000 7ff4c301d700 1 -- 172.21.15.114:0/3658522219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4bc196e90 con 0x7ff4bc100c10 2023-10-18T14:03:50.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.445+0000 7ff4b9ffb700 1 -- 172.21.15.114:0/3658522219 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4a8016020 con 0x7ff4bc100c10 2023-10-18T14:03:50.450 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T14:03:50.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.448+0000 7ff4c301d700 1 -- 172.21.15.114:0/3658522219 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff4ac0a15e0 msgr2=0x7ff4ac0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.448+0000 7ff4c301d700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff4ac0a15e0 0x7ff4ac0a3aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0006010 tx=0x7ff4b001a040 comp rx=0 tx=0).stop 2023-10-18T14:03:50.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.448+0000 7ff4c301d700 1 -- 172.21.15.114:0/3658522219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc100c10 msgr2=0x7ff4bc19be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.448+0000 7ff4c301d700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc100c10 0x7ff4bc19be50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800d950 tx=0x7ff4a800dc60 comp rx=0 tx=0).stop 2023-10-18T14:03:50.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.448+0000 7ff4c301d700 1 -- 172.21.15.114:0/3658522219 shutdown_connections 2023-10-18T14:03:50.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.448+0000 7ff4c301d700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff4ac0a15e0 0x7ff4ac0a3aa0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.448+0000 7ff4c301d700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4bc104730 0x7ff4bc1959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.448+0000 7ff4c301d700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff4bc100250 0x7ff4bc19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.448+0000 7ff4c301d700 1 --2- 172.21.15.114:0/3658522219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc100c10 0x7ff4bc19be50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.448+0000 7ff4c301d700 1 -- 172.21.15.114:0/3658522219 >> 172.21.15.114:0/3658522219 conn(0x7ff4bc0749d0 msgr2=0x7ff4bc0fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:50.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.448+0000 7ff4c301d700 1 -- 172.21.15.114:0/3658522219 shutdown_connections 2023-10-18T14:03:50.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.448+0000 7ff4c301d700 1 -- 172.21.15.114:0/3658522219 wait complete. 2023-10-18T14:03:50.464 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T14:03:50.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.584+0000 7fd09d9f7700 1 -- 172.21.15.114:0/247015090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0980ff640 msgr2=0x7fd0980ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.584+0000 7fd09d9f7700 1 --2- 172.21.15.114:0/247015090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0980ff640 0x7fd0980ffac0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd088009990 tx=0x7fd088009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.584+0000 7fd09d9f7700 1 -- 172.21.15.114:0/247015090 shutdown_connections 2023-10-18T14:03:50.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.584+0000 7fd09d9f7700 1 --2- 172.21.15.114:0/247015090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd098100000 0x7fd09810c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.584+0000 7fd09d9f7700 1 --2- 172.21.15.114:0/247015090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd098105750 0x7fd098105b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.584+0000 7fd09d9f7700 1 --2- 172.21.15.114:0/247015090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0980ff640 0x7fd0980ffac0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.584+0000 7fd09d9f7700 1 -- 172.21.15.114:0/247015090 >> 172.21.15.114:0/247015090 conn(0x7fd0980767f0 msgr2=0x7fd098076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:50.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.584+0000 7fd09d9f7700 1 -- 172.21.15.114:0/247015090 shutdown_connections 2023-10-18T14:03:50.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.584+0000 7fd09d9f7700 1 -- 172.21.15.114:0/247015090 wait complete. 2023-10-18T14:03:50.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd09d9f7700 1 Processor -- start 2023-10-18T14:03:50.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd09d9f7700 1 -- start start 2023-10-18T14:03:50.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd09d9f7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0980ff640 0x7fd098197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:50.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd09d9f7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd098100000 0x7fd098198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:50.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd09d9f7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd098105750 0x7fd098198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:50.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd09d9f7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0981a2ed0 con 0x7fd098100000 2023-10-18T14:03:50.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd09d9f7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0981a3040 con 0x7fd098105750 2023-10-18T14:03:50.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd09d9f7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0981a3200 con 0x7fd0980ff640 2023-10-18T14:03:50.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd0967fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd098100000 0x7fd098198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:50.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd0967fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd098100000 0x7fd098198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43646/0 (socket says 172.21.15.114:43646) 2023-10-18T14:03:50.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd0967fc700 1 -- 172.21.15.114:0/2336485027 learned_addr learned my addr 172.21.15.114:0/2336485027 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:50.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd096ffd700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0980ff640 0x7fd098197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:50.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd0967fc700 1 -- 172.21.15.114:0/2336485027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0980ff640 msgr2=0x7fd098197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd0967fc700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0980ff640 0x7fd098197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd0967fc700 1 -- 172.21.15.114:0/2336485027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd098105750 msgr2=0x7fd098198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd0977fe700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd098105750 0x7fd098198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:50.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd0967fc700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd098105750 0x7fd098198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd0967fc700 1 -- 172.21.15.114:0/2336485027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0880095f0 con 0x7fd098100000 2023-10-18T14:03:50.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.585+0000 7fd096ffd700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0980ff640 0x7fd098197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:50.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.586+0000 7fd0967fc700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd098100000 0x7fd098198100 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd0880098e0 tx=0x7fd08800f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.586+0000 7fd09c9f5700 1 -- 172.21.15.114:0/2336485027 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08801d070 con 0x7fd098100000 2023-10-18T14:03:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.586+0000 7fd09c9f5700 1 -- 172.21.15.114:0/2336485027 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd08800fb90 con 0x7fd098100000 2023-10-18T14:03:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.586+0000 7fd09d9f7700 1 -- 172.21.15.114:0/2336485027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0981a3480 con 0x7fd098100000 2023-10-18T14:03:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.586+0000 7fd09c9f5700 1 -- 172.21.15.114:0/2336485027 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088017650 con 0x7fd098100000 2023-10-18T14:03:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.586+0000 7fd09d9f7700 1 -- 172.21.15.114:0/2336485027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0981a3960 con 0x7fd098100000 2023-10-18T14:03:50.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.587+0000 7fd09d9f7700 1 -- 172.21.15.114:0/2336485027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd098107d60 con 0x7fd098100000 2023-10-18T14:03:50.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.588+0000 7fd09c9f5700 1 -- 172.21.15.114:0/2336485027 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fd08800fd00 con 0x7fd098100000 2023-10-18T14:03:50.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.588+0000 7fd09c9f5700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd0800a1560 0x7fd0800a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:50.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.589+0000 7fd096ffd700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd0800a1560 0x7fd0800a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:50.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.589+0000 7fd09c9f5700 1 -- 172.21.15.114:0/2336485027 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd0880ce3d0 con 0x7fd098100000 2023-10-18T14:03:50.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.589+0000 7fd096ffd700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd0800a1560 0x7fd0800a3a20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0099d0 tx=0x7fd08c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:50.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.592+0000 7fd09c9f5700 1 -- 172.21.15.114:0/2336485027 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd0880978c0 con 0x7fd098100000 2023-10-18T14:03:50.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.786+0000 7fd09d9f7700 1 -- 172.21.15.114:0/2336485027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd098100d70 con 0x7fd098100000 2023-10-18T14:03:50.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.786+0000 7fd09c9f5700 1 -- 172.21.15.114:0/2336485027 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd08809aee0 con 0x7fd098100000 2023-10-18T14:03:50.790 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T14:03:50.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.788+0000 7fd09d9f7700 1 -- 172.21.15.114:0/2336485027 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd0800a1560 msgr2=0x7fd0800a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.788+0000 7fd09d9f7700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd0800a1560 0x7fd0800a3a20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0099d0 tx=0x7fd08c008040 comp rx=0 tx=0).stop 2023-10-18T14:03:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.788+0000 7fd09d9f7700 1 -- 172.21.15.114:0/2336485027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd098100000 msgr2=0x7fd098198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.788+0000 7fd09d9f7700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd098100000 0x7fd098198100 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd0880098e0 tx=0x7fd08800f720 comp rx=0 tx=0).stop 2023-10-18T14:03:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.788+0000 7fd09d9f7700 1 -- 172.21.15.114:0/2336485027 shutdown_connections 2023-10-18T14:03:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.788+0000 7fd09d9f7700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd0800a1560 0x7fd0800a3a20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.788+0000 7fd09d9f7700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd098105750 0x7fd098198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.788+0000 7fd09d9f7700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0980ff640 0x7fd098197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.788+0000 7fd09d9f7700 1 --2- 172.21.15.114:0/2336485027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd098100000 0x7fd098198100 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.788+0000 7fd09d9f7700 1 -- 172.21.15.114:0/2336485027 >> 172.21.15.114:0/2336485027 conn(0x7fd0980767f0 msgr2=0x7fd0980fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:50.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.788+0000 7fd09d9f7700 1 -- 172.21.15.114:0/2336485027 shutdown_connections 2023-10-18T14:03:50.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.788+0000 7fd09d9f7700 1 -- 172.21.15.114:0/2336485027 wait complete. 2023-10-18T14:03:50.803 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:50 smithi114 ceph-mon[99494]: pgmap v274: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:50.803 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:50 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1770501337' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:50.804 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:50 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2051506472' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:50.804 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:50 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3658522219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:50.805 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:03:50.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.922+0000 7fd78f0a6700 1 -- 172.21.15.114:0/2700861184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7880fffa0 msgr2=0x7fd788100380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.922+0000 7fd78f0a6700 1 --2- 172.21.15.114:0/2700861184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7880fffa0 0x7fd788100380 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0099c0 tx=0x7fd77c009cd0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.922+0000 7fd78f0a6700 1 -- 172.21.15.114:0/2700861184 shutdown_connections 2023-10-18T14:03:50.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.922+0000 7fd78f0a6700 1 --2- 172.21.15.114:0/2700861184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd788104950 0x7fd78810c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.922+0000 7fd78f0a6700 1 --2- 172.21.15.114:0/2700861184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7880fffa0 0x7fd788100380 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.922+0000 7fd78f0a6700 1 --2- 172.21.15.114:0/2700861184 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd788100950 0x7fd788104220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.922+0000 7fd78f0a6700 1 -- 172.21.15.114:0/2700861184 >> 172.21.15.114:0/2700861184 conn(0x7fd788075b90 msgr2=0x7fd7880fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:50.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.922+0000 7fd78f0a6700 1 -- 172.21.15.114:0/2700861184 shutdown_connections 2023-10-18T14:03:50.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.922+0000 7fd78f0a6700 1 -- 172.21.15.114:0/2700861184 wait complete. 2023-10-18T14:03:50.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78f0a6700 1 Processor -- start 2023-10-18T14:03:50.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78f0a6700 1 -- start start 2023-10-18T14:03:50.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78f0a6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7880fffa0 0x7fd788197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:50.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78f0a6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd788104950 0x7fd788197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:50.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78f0a6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd788198400 0x7fd7881a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:50.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78f0a6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7881a30e0 con 0x7fd788198400 2023-10-18T14:03:50.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78f0a6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7881a3250 con 0x7fd788104950 2023-10-18T14:03:50.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78f0a6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7881a3410 con 0x7fd7880fffa0 2023-10-18T14:03:50.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78d643700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd788198400 0x7fd7881a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:50.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78d643700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd788198400 0x7fd7881a2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43662/0 (socket says 172.21.15.114:43662) 2023-10-18T14:03:50.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78ce42700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7880fffa0 0x7fd788197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:50.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78d643700 1 -- 172.21.15.114:0/3927147119 learned_addr learned my addr 172.21.15.114:0/3927147119 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:50.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd787fff700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd788104950 0x7fd788197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:50.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78d643700 1 -- 172.21.15.114:0/3927147119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7880fffa0 msgr2=0x7fd788197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78d643700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7880fffa0 0x7fd788197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78d643700 1 -- 172.21.15.114:0/3927147119 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd788104950 msgr2=0x7fd788197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78d643700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd788104950 0x7fd788197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78d643700 1 -- 172.21.15.114:0/3927147119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c0095f0 con 0x7fd788198400 2023-10-18T14:03:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd787fff700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd788104950 0x7fd788197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd78d643700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd788198400 0x7fd7881a2a00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd78000ada0 tx=0x7fd78000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.923+0000 7fd785ffb700 1 -- 172.21.15.114:0/3927147119 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78000f070 con 0x7fd788198400 2023-10-18T14:03:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.924+0000 7fd78f0a6700 1 -- 172.21.15.114:0/3927147119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7881a36f0 con 0x7fd788198400 2023-10-18T14:03:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.924+0000 7fd785ffb700 1 -- 172.21.15.114:0/3927147119 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd780007b30 con 0x7fd788198400 2023-10-18T14:03:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.924+0000 7fd785ffb700 1 -- 172.21.15.114:0/3927147119 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7800053e0 con 0x7fd788198400 2023-10-18T14:03:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.924+0000 7fd78f0a6700 1 -- 172.21.15.114:0/3927147119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7881a3c00 con 0x7fd788198400 2023-10-18T14:03:50.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.925+0000 7fd78f0a6700 1 -- 172.21.15.114:0/3927147119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd788107b90 con 0x7fd788198400 2023-10-18T14:03:50.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.925+0000 7fd785ffb700 1 -- 172.21.15.114:0/3927147119 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fd78000c980 con 0x7fd788198400 2023-10-18T14:03:50.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.926+0000 7fd785ffb700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd7780a1560 0x7fd7780a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:50.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.926+0000 7fd78ce42700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd7780a1560 0x7fd7780a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:50.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.926+0000 7fd785ffb700 1 -- 172.21.15.114:0/3927147119 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd7800cc560 con 0x7fd788198400 2023-10-18T14:03:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.927+0000 7fd78ce42700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd7780a1560 0x7fd7780a3a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd77c000c00 tx=0x7fd77c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:50.931+0000 7fd785ffb700 1 -- 172.21.15.114:0/3927147119 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd780095a50 con 0x7fd788198400 2023-10-18T14:03:51.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:50 smithi158 ceph-mon[103317]: pgmap v274: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:51.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:50 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1770501337' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:51.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:50 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2051506472' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:51.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:50 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3658522219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:51.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:50 smithi172 ceph-mon[103574]: pgmap v274: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:51.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:50 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1770501337' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:51.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:50 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2051506472' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:51.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:50 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3658522219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:51.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.167+0000 7fd78f0a6700 1 -- 172.21.15.114:0/3927147119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd788066ca0 con 0x7fd788198400 2023-10-18T14:03:51.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.168+0000 7fd785ffb700 1 -- 172.21.15.114:0/3927147119 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11390 (secure 0 0 0) 0x7fd780099070 con 0x7fd788198400 2023-10-18T14:03:51.172 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:51.172 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:02:39.260198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:03:51.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.170+0000 7fd78f0a6700 1 -- 172.21.15.114:0/3927147119 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd7780a1560 msgr2=0x7fd7780a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.170+0000 7fd78f0a6700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd7780a1560 0x7fd7780a3a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd77c000c00 tx=0x7fd77c005fb0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.170+0000 7fd78f0a6700 1 -- 172.21.15.114:0/3927147119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd788198400 msgr2=0x7fd7881a2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.170+0000 7fd78f0a6700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd788198400 0x7fd7881a2a00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd78000ada0 tx=0x7fd78000c330 comp rx=0 tx=0).stop 2023-10-18T14:03:51.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.170+0000 7fd78f0a6700 1 -- 172.21.15.114:0/3927147119 shutdown_connections 2023-10-18T14:03:51.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.170+0000 7fd78f0a6700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd7780a1560 0x7fd7780a3a20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.170+0000 7fd78f0a6700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd788198400 0x7fd7881a2a00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.170+0000 7fd78f0a6700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7880fffa0 0x7fd788197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.170+0000 7fd78f0a6700 1 --2- 172.21.15.114:0/3927147119 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd788104950 0x7fd788197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.170+0000 7fd78f0a6700 1 -- 172.21.15.114:0/3927147119 >> 172.21.15.114:0/3927147119 conn(0x7fd788075b90 msgr2=0x7fd788102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.170+0000 7fd78f0a6700 1 -- 172.21.15.114:0/3927147119 shutdown_connections 2023-10-18T14:03:51.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.170+0000 7fd78f0a6700 1 -- 172.21.15.114:0/3927147119 wait complete. 2023-10-18T14:03:51.177 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2023-10-18T14:03:51.187 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:03:51.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.305+0000 7f431c242700 1 -- 172.21.15.114:0/3094406606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43141056a0 msgr2=0x7f4314105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.305+0000 7f431c242700 1 --2- 172.21.15.114:0/3094406606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43141056a0 0x7f4314105a80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4310009990 tx=0x7f4310009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.305+0000 7f431c242700 1 -- 172.21.15.114:0/3094406606 shutdown_connections 2023-10-18T14:03:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.305+0000 7f431c242700 1 --2- 172.21.15.114:0/3094406606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43140ffd50 0x7f431410c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.305+0000 7f431c242700 1 --2- 172.21.15.114:0/3094406606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43141056a0 0x7f4314105a80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.305+0000 7f431c242700 1 --2- 172.21.15.114:0/3094406606 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4314105fc0 0x7f43140ff620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.305+0000 7f431c242700 1 -- 172.21.15.114:0/3094406606 >> 172.21.15.114:0/3094406606 conn(0x7f4314076840 msgr2=0x7f4314076c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.305+0000 7f431c242700 1 -- 172.21.15.114:0/3094406606 shutdown_connections 2023-10-18T14:03:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.305+0000 7f431c242700 1 -- 172.21.15.114:0/3094406606 wait complete. 2023-10-18T14:03:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.305+0000 7f431c242700 1 Processor -- start 2023-10-18T14:03:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.305+0000 7f431c242700 1 -- start start 2023-10-18T14:03:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.305+0000 7f431c242700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43140ffd50 0x7f4314197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f431c242700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43141056a0 0x7f4314197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f431c242700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4314105fc0 0x7f43141a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f431c242700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4314198810 con 0x7f43141056a0 2023-10-18T14:03:51.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f431c242700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43141a3020 con 0x7f4314105fc0 2023-10-18T14:03:51.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f431c242700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43141a3160 con 0x7f43140ffd50 2023-10-18T14:03:51.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f43197dd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43141056a0 0x7f4314197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f43197dd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43141056a0 0x7f4314197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43674/0 (socket says 172.21.15.114:43674) 2023-10-18T14:03:51.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f43197dd700 1 -- 172.21.15.114:0/2614369573 learned_addr learned my addr 172.21.15.114:0/2614369573 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:51.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f4319fde700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43140ffd50 0x7f4314197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f431a7df700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4314105fc0 0x7f43141a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f43197dd700 1 -- 172.21.15.114:0/2614369573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43140ffd50 msgr2=0x7f4314197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f43197dd700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43140ffd50 0x7f4314197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f43197dd700 1 -- 172.21.15.114:0/2614369573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4314105fc0 msgr2=0x7f43141a2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f43197dd700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4314105fc0 0x7f43141a2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f43197dd700 1 -- 172.21.15.114:0/2614369573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43100095f0 con 0x7f43141056a0 2023-10-18T14:03:51.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f431a7df700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4314105fc0 0x7f43141a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:51.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f43197dd700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43141056a0 0x7f4314197fa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f430400b4d0 tx=0x7f430400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f430affd700 1 -- 172.21.15.114:0/2614369573 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304011830 con 0x7f43141056a0 2023-10-18T14:03:51.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f431c242700 1 -- 172.21.15.114:0/2614369573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43141a33f0 con 0x7f43141056a0 2023-10-18T14:03:51.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f430affd700 1 -- 172.21.15.114:0/2614369573 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4304011e50 con 0x7f43141056a0 2023-10-18T14:03:51.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f430affd700 1 -- 172.21.15.114:0/2614369573 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304010e50 con 0x7f43141056a0 2023-10-18T14:03:51.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.306+0000 7f431c242700 1 -- 172.21.15.114:0/2614369573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43141a3950 con 0x7f43141056a0 2023-10-18T14:03:51.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.307+0000 7f431c242700 1 -- 172.21.15.114:0/2614369573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4314107c00 con 0x7f43141056a0 2023-10-18T14:03:51.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.308+0000 7f430affd700 1 -- 172.21.15.114:0/2614369573 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f43040104f0 con 0x7f43141056a0 2023-10-18T14:03:51.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.309+0000 7f430affd700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f43000a1560 0x7f43000a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.309+0000 7f430affd700 1 -- 172.21.15.114:0/2614369573 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f43040cc9e0 con 0x7f43141056a0 2023-10-18T14:03:51.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.309+0000 7f4319fde700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f43000a1560 0x7f43000a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.309+0000 7f4319fde700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f43000a1560 0x7f43000a3a20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4310006010 tx=0x7f431000b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.313+0000 7f430affd700 1 -- 172.21.15.114:0/2614369573 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4304095f50 con 0x7f43141056a0 2023-10-18T14:03:51.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.507+0000 7f431c242700 1 -- 172.21.15.114:0/2614369573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f431410f660 con 0x7f43141056a0 2023-10-18T14:03:51.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.508+0000 7f430affd700 1 -- 172.21.15.114:0/2614369573 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22907 (secure 0 0 0) 0x7f4304015090 con 0x7f43141056a0 2023-10-18T14:03:51.512 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:51.513 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":85,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:03:08.625359+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:03:51.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.510+0000 7f431c242700 1 -- 172.21.15.114:0/2614369573 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f43000a1560 msgr2=0x7f43000a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.510+0000 7f431c242700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f43000a1560 0x7f43000a3a20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4310006010 tx=0x7f431000b540 comp rx=0 tx=0).stop 2023-10-18T14:03:51.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.510+0000 7f431c242700 1 -- 172.21.15.114:0/2614369573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43141056a0 msgr2=0x7f4314197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.510+0000 7f431c242700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43141056a0 0x7f4314197fa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f430400b4d0 tx=0x7f430400b890 comp rx=0 tx=0).stop 2023-10-18T14:03:51.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.510+0000 7f431c242700 1 -- 172.21.15.114:0/2614369573 shutdown_connections 2023-10-18T14:03:51.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.510+0000 7f431c242700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f43000a1560 0x7f43000a3a20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.510+0000 7f431c242700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4314105fc0 0x7f43141a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.510+0000 7f431c242700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43140ffd50 0x7f4314197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.510+0000 7f431c242700 1 --2- 172.21.15.114:0/2614369573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43141056a0 0x7f4314197fa0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.510+0000 7f431c242700 1 -- 172.21.15.114:0/2614369573 >> 172.21.15.114:0/2614369573 conn(0x7f4314076840 msgr2=0x7f43140fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.510+0000 7f431c242700 1 -- 172.21.15.114:0/2614369573 shutdown_connections 2023-10-18T14:03:51.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.510+0000 7f431c242700 1 -- 172.21.15.114:0/2614369573 wait complete. 2023-10-18T14:03:51.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-18T14:02:32.251953+0000', 'modified': '2023-10-18T14:02:39.260198+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24616, 'mds_1': 24595, 'mds_2': 24583, 'mds_3': 24566, 'mds_4': 14820}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14808': {'gid': 14808, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.114:6839/2312997594', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6838', 'nonce': 2312997594}, {'type': 'v1', 'addr': '172.21.15.114:6839', 'nonce': 2312997594}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14820': {'gid': 14820, 'name': 'a', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.114:6841/2423071224', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6840', 'nonce': 2423071224}, {'type': 'v1', 'addr': '172.21.15.114:6841', 'nonce': 2423071224}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24506': {'gid': 24506, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.158:6833/2306126907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6832', 'nonce': 2306126907}, {'type': 'v1', 'addr': '172.21.15.158:6833', 'nonce': 2306126907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24524': {'gid': 24524, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.158:6835/2562572095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6834', 'nonce': 2562572095}, {'type': 'v1', 'addr': '172.21.15.158:6835', 'nonce': 2562572095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24539': {'gid': 24539, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.158:6837/1076778559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6836', 'nonce': 1076778559}, {'type': 'v1', 'addr': '172.21.15.158:6837', 'nonce': 1076778559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24544': {'gid': 24544, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6833/3053339885', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 3053339885}, {'type': 'v1', 'addr': '172.21.15.172:6833', 'nonce': 3053339885}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24566': {'gid': 24566, 'name': 'b', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.158:6839/2616400572', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.158:6838', 'nonce': 2616400572}, {'type': 'v1', 'addr': '172.21.15.158:6839', 'nonce': 2616400572}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24583': {'gid': 24583, 'name': 'f', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.172:6835/2655563129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 2655563129}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 2655563129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24595': {'gid': 24595, 'name': 'c', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.172:6837/1821444438', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 1821444438}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 1821444438}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24616': {'gid': 24616, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.172:6839/2447269366', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 2447269366}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 2447269366}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-18T14:03:51.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-18T14:03:51.528 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-18T14:03:51.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.646+0000 7fc1e788d700 1 -- 172.21.15.114:0/2004439833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e0106e20 msgr2=0x7fc1e010d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.646+0000 7fc1e788d700 1 --2- 172.21.15.114:0/2004439833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e0106e20 0x7fc1e010d7a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800b0a0 tx=0x7fc1d800b3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.646+0000 7fc1e788d700 1 -- 172.21.15.114:0/2004439833 shutdown_connections 2023-10-18T14:03:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.646+0000 7fc1e788d700 1 --2- 172.21.15.114:0/2004439833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e0106e20 0x7fc1e010d7a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.646+0000 7fc1e788d700 1 --2- 172.21.15.114:0/2004439833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e01018a0 0x7fc1e0101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.646+0000 7fc1e788d700 1 --2- 172.21.15.114:0/2004439833 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc1e01021c0 0x7fc1e01066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.646+0000 7fc1e788d700 1 -- 172.21.15.114:0/2004439833 >> 172.21.15.114:0/2004439833 conn(0x7fc1e00fb0a0 msgr2=0x7fc1e00fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.646+0000 7fc1e788d700 1 -- 172.21.15.114:0/2004439833 shutdown_connections 2023-10-18T14:03:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.646+0000 7fc1e788d700 1 -- 172.21.15.114:0/2004439833 wait complete. 2023-10-18T14:03:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.646+0000 7fc1e788d700 1 Processor -- start 2023-10-18T14:03:51.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.646+0000 7fc1e788d700 1 -- start start 2023-10-18T14:03:51.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.646+0000 7fc1e788d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e01018a0 0x7fc1e0196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.646+0000 7fc1e788d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc1e01021c0 0x7fc1e0197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e788d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e0106e20 0x7fc1e019b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e788d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e019bde0 con 0x7fc1e0106e20 2023-10-18T14:03:51.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e788d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e019bf50 con 0x7fc1e01021c0 2023-10-18T14:03:51.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e788d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e019c110 con 0x7fc1e01018a0 2023-10-18T14:03:51.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e5e2a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e0106e20 0x7fc1e019b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e5e2a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e0106e20 0x7fc1e019b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43688/0 (socket says 172.21.15.114:43688) 2023-10-18T14:03:51.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e5e2a700 1 -- 172.21.15.114:0/2745494226 learned_addr learned my addr 172.21.15.114:0/2745494226 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:51.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e5629700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e01018a0 0x7fc1e0196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e4e28700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc1e01021c0 0x7fc1e0197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e5e2a700 1 -- 172.21.15.114:0/2745494226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e01018a0 msgr2=0x7fc1e0196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e5e2a700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e01018a0 0x7fc1e0196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e5e2a700 1 -- 172.21.15.114:0/2745494226 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc1e01021c0 msgr2=0x7fc1e0197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e5e2a700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc1e01021c0 0x7fc1e0197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e5e2a700 1 -- 172.21.15.114:0/2745494226 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8009d00 con 0x7fc1e0106e20 2023-10-18T14:03:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e4e28700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc1e01021c0 0x7fc1e0197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e5e2a700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e0106e20 0x7fc1e019b7a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800b830 tx=0x7fc1d80077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1d67fc700 1 -- 172.21.15.114:0/2745494226 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d800e040 con 0x7fc1e0106e20 2023-10-18T14:03:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1d67fc700 1 -- 172.21.15.114:0/2745494226 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1d8004e60 con 0x7fc1e0106e20 2023-10-18T14:03:51.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e788d700 1 -- 172.21.15.114:0/2745494226 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e019c390 con 0x7fc1e0106e20 2023-10-18T14:03:51.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1d67fc700 1 -- 172.21.15.114:0/2745494226 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80053c0 con 0x7fc1e0106e20 2023-10-18T14:03:51.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.647+0000 7fc1e788d700 1 -- 172.21.15.114:0/2745494226 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e01a3c30 con 0x7fc1e0106e20 2023-10-18T14:03:51.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.649+0000 7fc1d67fc700 1 -- 172.21.15.114:0/2745494226 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fc1d801b450 con 0x7fc1e0106e20 2023-10-18T14:03:51.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.650+0000 7fc1d67fc700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc1cc0a15e0 0x7fc1cc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.650+0000 7fc1e5629700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc1cc0a15e0 0x7fc1cc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.650+0000 7fc1d67fc700 1 -- 172.21.15.114:0/2745494226 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc1d80ce790 con 0x7fc1e0106e20 2023-10-18T14:03:51.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.650+0000 7fc1e5629700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc1cc0a15e0 0x7fc1cc0a3aa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009a10 tx=0x7fc1d0009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.651+0000 7fc1f3a76b80 1 Processor -- start 2023-10-18T14:03:51.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.651+0000 7fc1f3a76b80 1 -- start start 2023-10-18T14:03:51.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.651+0000 7fc1f3a76b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea2640 0x55fe2dea2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.651+0000 7fc1f3a76b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2f60 0x55fe2dea6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.651+0000 7fc1f3a76b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 0x55fe2dea7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.651+0000 7fc1f3a76b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe2de11690 con 0x55fe2dea70b0 2023-10-18T14:03:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.651+0000 7fc1f3a76b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe2ddf7c10 con 0x55fe2dea2f60 2023-10-18T14:03:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.651+0000 7fc1f3a76b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe2ddf5530 con 0x55fe2dea2640 2023-10-18T14:03:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.651+0000 7fc1e5e2a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 0x55fe2dea7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.651+0000 7fc1e5e2a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 0x55fe2dea7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43696/0 (socket says 172.21.15.114:43696) 2023-10-18T14:03:51.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.651+0000 7fc1e5e2a700 1 -- 172.21.15.114:0/2788416399 learned_addr learned my addr 172.21.15.114:0/2788416399 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:51.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.651+0000 7fc1e5629700 1 --2- 172.21.15.114:0/2788416399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea2640 0x55fe2dea2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.651+0000 7fc1e4e28700 1 --2- 172.21.15.114:0/2788416399 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2f60 0x55fe2dea6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.652+0000 7fc1e5e2a700 1 -- 172.21.15.114:0/2788416399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea2640 msgr2=0x55fe2dea2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.652+0000 7fc1e5e2a700 1 --2- 172.21.15.114:0/2788416399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea2640 0x55fe2dea2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.652+0000 7fc1e5e2a700 1 -- 172.21.15.114:0/2788416399 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2f60 msgr2=0x55fe2dea6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.652+0000 7fc1e5e2a700 1 --2- 172.21.15.114:0/2788416399 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2f60 0x55fe2dea6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.652+0000 7fc1e5e2a700 1 -- 172.21.15.114:0/2788416399 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe2ddae3a0 con 0x55fe2dea70b0 2023-10-18T14:03:51.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.652+0000 7fc1e5e2a700 1 --2- 172.21.15.114:0/2788416399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 0x55fe2dea7510 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80983b0 tx=0x7fc1d801bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba6cb1758251fe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.653+0000 7fc1cb7fe700 1 -- 172.21.15.114:0/2788416399 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d801a3b0 con 0x55fe2dea70b0 2023-10-18T14:03:51.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.653+0000 7fc1cb7fe700 1 -- 172.21.15.114:0/2788416399 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1d809c040 con 0x55fe2dea70b0 2023-10-18T14:03:51.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.653+0000 7fc1cb7fe700 1 -- 172.21.15.114:0/2788416399 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d801bb30 con 0x55fe2dea70b0 2023-10-18T14:03:51.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.654+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/2788416399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 msgr2=0x55fe2dea7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.654+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/2788416399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 0x55fe2dea7510 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80983b0 tx=0x7fc1d801bde0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.654+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/2788416399 shutdown_connections 2023-10-18T14:03:51.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.654+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/2788416399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 0x55fe2dea7510 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.654+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/2788416399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea2640 0x55fe2dea2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.654+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/2788416399 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2f60 0x55fe2dea6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.654+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/2788416399 >> 172.21.15.114:0/2788416399 conn(0x55fe2de126d0 msgr2=0x55fe2de98b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.654+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/2788416399 shutdown_connections 2023-10-18T14:03:51.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.654+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/2788416399 wait complete. 2023-10-18T14:03:51.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.654+0000 7fc1f3a76b80 1 -- start start 2023-10-18T14:03:51.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.654+0000 7fc1f3a76b80 1 Processor -- start 2023-10-18T14:03:51.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1f3a76b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea2640 0x55fe2deae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1f3a76b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2f60 0x55fe2deabb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1f3a76b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 0x55fe2deac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1f3a76b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe2ddf0e20 con 0x55fe2dea70b0 2023-10-18T14:03:51.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1f3a76b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe2dd8d6c0 con 0x55fe2dea2f60 2023-10-18T14:03:51.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1f3a76b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe2dd8d360 con 0x55fe2dea2640 2023-10-18T14:03:51.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1f3a76b80 10 client.0 _ll_register_callbacks cb 0x55fe2dcd7a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:51.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1e5e2a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 0x55fe2deac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1e5e2a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 0x55fe2deac2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43700/0 (socket says 172.21.15.114:43700) 2023-10-18T14:03:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1e5e2a700 1 -- 172.21.15.114:0/2772556165 learned_addr learned my addr 172.21.15.114:0/2772556165 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1e4e28700 1 --2- 172.21.15.114:0/2772556165 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2f60 0x55fe2deabb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1e5629700 1 --2- 172.21.15.114:0/2772556165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea2640 0x55fe2deae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1e5e2a700 1 -- 172.21.15.114:0/2772556165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea2640 msgr2=0x55fe2deae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1e5e2a700 1 --2- 172.21.15.114:0/2772556165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea2640 0x55fe2deae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1e5e2a700 1 -- 172.21.15.114:0/2772556165 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2f60 msgr2=0x55fe2deabb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1e5e2a700 1 --2- 172.21.15.114:0/2772556165 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2f60 0x55fe2deabb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1e5e2a700 1 -- 172.21.15.114:0/2772556165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e01a3c30 con 0x55fe2dea70b0 2023-10-18T14:03:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1e5e2a700 1 --2- 172.21.15.114:0/2772556165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 0x55fe2deac2b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80cc120 tx=0x7fc1d80cc520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a8f8cb422b2b05 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.655+0000 7fc1c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:51.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.657+0000 7fc1c8ff9700 1 -- 172.21.15.114:0/2772556165 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80a3c40 con 0x55fe2dea70b0 2023-10-18T14:03:51.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.657+0000 7fc1c8ff9700 1 -- 172.21.15.114:0/2772556165 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc1d809fa90 con 0x55fe2dea70b0 2023-10-18T14:03:51.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.657+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/2772556165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe2ddf5ea0 con 0x55fe2dea70b0 2023-10-18T14:03:51.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.657+0000 7fc1c8ff9700 1 -- 172.21.15.114:0/2772556165 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1d8099ce0 con 0x55fe2dea70b0 2023-10-18T14:03:51.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.658+0000 7fc1f3a76b80 10 client.15435 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:51.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.658+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/2772556165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fe2dc1bd90 con 0x55fe2dea70b0 2023-10-18T14:03:51.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.658+0000 7fc1c8ff9700 1 -- 172.21.15.114:0/2772556165 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fe2ddf5ea0 con 0x55fe2dea70b0 2023-10-18T14:03:51.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.658+0000 7fc1c8ff9700 1 -- 172.21.15.114:0/2772556165 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc1d80a37b0 con 0x55fe2dea70b0 2023-10-18T14:03:51.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.658+0000 7fc1f3a76b80 10 client.15435 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:51.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.658+0000 7fc1f3a76b80 10 client.15435 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-18T14:03:51.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.658+0000 7fc1f3a76b80 20 client.15435 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.658+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/2772556165 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55fe2debbac0 0x55fe2deba930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.658+0000 7fc1f3a76b80 4 client.15435 mds_command: new command op to 14820 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:03:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.658+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/2772556165 --> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe2de6d860 con 0x55fe2debbac0 2023-10-18T14:03:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.658+0000 7fc1e5629700 1 --2- 172.21.15.114:0/2772556165 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55fe2debbac0 0x55fe2deba930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.658+0000 7fc1c8ff9700 10 client.15435 ms_handle_connect on v2:172.21.15.114:6840/2423071224 2023-10-18T14:03:51.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.658+0000 7fc1e5629700 1 --2- 172.21.15.114:0/2772556165 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55fe2debbac0 0x55fe2deba930 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=60e583ddf4d42229 server_cookie=e9dfcb991fe3e742 in_seq=0 out_seq=0 2023-10-18T14:03:51.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1c8ff9700 1 -- 172.21.15.114:0/2772556165 <== mds.4 v2:172.21.15.114:6840/2423071224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fe2de6d860 con 0x55fe2debbac0 2023-10-18T14:03:51.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1c8ff9700 10 client.15435 handle_command_reply: tid=0 2023-10-18T14:03:51.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1f3a76b80 1 client.15435 shutdown 2023-10-18T14:03:51.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/2772556165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 msgr2=0x55fe2deac2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/2772556165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 0x55fe2deac2b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80cc120 tx=0x7fc1d80cc520 comp rx=0 tx=0).stop 2023-10-18T14:03:51.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/2772556165 shutdown_connections 2023-10-18T14:03:51.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/2772556165 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55fe2debbac0 0x55fe2deba930 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/2772556165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea70b0 0x55fe2deac2b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1c8ff9700 0 client.15435 ms_handle_reset on v2:172.21.15.114:6840/2423071224 2023-10-18T14:03:51.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/2772556165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea2640 0x55fe2deae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/2772556165 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2f60 0x55fe2deabb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/2772556165 >> 172.21.15.114:0/2772556165 conn(0x55fe2de126d0 msgr2=0x55fe2de9d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/2772556165 shutdown_connections 2023-10-18T14:03:51.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.659+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/2772556165 wait complete. 2023-10-18T14:03:51.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.660+0000 7fc1f3a76b80 20 client.15435 trim_cache size 0 max 16384 2023-10-18T14:03:51.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1f3a76b80 1 Processor -- start 2023-10-18T14:03:51.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1f3a76b80 1 -- start start 2023-10-18T14:03:51.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1f3a76b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2640 0x55fe2de93580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1f3a76b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2f60 0x55fe2deab450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1f3a76b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea70b0 0x55fe2dec4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1f3a76b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe2dc718d0 con 0x55fe2dea2f60 2023-10-18T14:03:51.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1f3a76b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe2ddf20b0 con 0x55fe2dea2640 2023-10-18T14:03:51.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1f3a76b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe2ddecf10 con 0x55fe2dea70b0 2023-10-18T14:03:51.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1e4e28700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2f60 0x55fe2deab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1e4e28700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2f60 0x55fe2deab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43708/0 (socket says 172.21.15.114:43708) 2023-10-18T14:03:51.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1e4e28700 1 -- 172.21.15.114:0/722047189 learned_addr learned my addr 172.21.15.114:0/722047189 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:51.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1e5e2a700 1 --2- 172.21.15.114:0/722047189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea70b0 0x55fe2dec4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1e4e28700 1 -- 172.21.15.114:0/722047189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea70b0 msgr2=0x55fe2dec4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1e4e28700 1 --2- 172.21.15.114:0/722047189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea70b0 0x55fe2dec4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1e4e28700 1 -- 172.21.15.114:0/722047189 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2640 msgr2=0x55fe2de93580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1e5629700 1 --2- 172.21.15.114:0/722047189 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2640 0x55fe2de93580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1e4e28700 1 --2- 172.21.15.114:0/722047189 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2640 0x55fe2de93580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1e4e28700 1 -- 172.21.15.114:0/722047189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe2dc04c10 con 0x55fe2dea2f60 2023-10-18T14:03:51.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1e5e2a700 1 --2- 172.21.15.114:0/722047189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea70b0 0x55fe2dec4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:51.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1e4e28700 1 --2- 172.21.15.114:0/722047189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2f60 0x55fe2deab450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc007770 tx=0x7fc1dc007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756f5871ec75734 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1cbfff700 1 -- 172.21.15.114:0/722047189 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc014740 con 0x55fe2dea2f60 2023-10-18T14:03:51.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1cbfff700 1 -- 172.21.15.114:0/722047189 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1dc014d60 con 0x55fe2dea2f60 2023-10-18T14:03:51.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.677+0000 7fc1cbfff700 1 -- 172.21.15.114:0/722047189 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc015c50 con 0x55fe2dea2f60 2023-10-18T14:03:51.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.678+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/722047189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2f60 msgr2=0x55fe2deab450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.678+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/722047189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2f60 0x55fe2deab450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc007770 tx=0x7fc1dc007a80 comp rx=0 tx=0).stop 2023-10-18T14:03:51.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.678+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/722047189 shutdown_connections 2023-10-18T14:03:51.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.678+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/722047189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2dea70b0 0x55fe2dec4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.678+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/722047189 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea2640 0x55fe2de93580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.678+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/722047189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2f60 0x55fe2deab450 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.678+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/722047189 >> 172.21.15.114:0/722047189 conn(0x55fe2de126d0 msgr2=0x55fe2dea94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.678+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/722047189 shutdown_connections 2023-10-18T14:03:51.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.678+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/722047189 wait complete. 2023-10-18T14:03:51.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.678+0000 7fc1f3a76b80 1 -- start start 2023-10-18T14:03:51.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1f3a76b80 1 Processor -- start 2023-10-18T14:03:51.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1f3a76b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2640 0x55fe2deada30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1f3a76b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea70b0 0x55fe2deadf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1f3a76b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2deae4b0 0x55fe2df0f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1f3a76b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe2df0fab0 con 0x55fe2dea2640 2023-10-18T14:03:51.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1f3a76b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe2df0fc20 con 0x55fe2dea70b0 2023-10-18T14:03:51.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1f3a76b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe2df0fde0 con 0x55fe2deae4b0 2023-10-18T14:03:51.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1f3a76b80 10 client.0 _ll_register_callbacks cb 0x55fe2dcd7a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:51.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1e5629700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2640 0x55fe2deada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1e5629700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2640 0x55fe2deada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43712/0 (socket says 172.21.15.114:43712) 2023-10-18T14:03:51.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1e5629700 1 -- 172.21.15.114:0/132057070 learned_addr learned my addr 172.21.15.114:0/132057070 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:51.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1e5e2a700 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2deae4b0 0x55fe2df0f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1e4e28700 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea70b0 0x55fe2deadf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1e5629700 1 -- 172.21.15.114:0/132057070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2deae4b0 msgr2=0x55fe2df0f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1e5629700 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2deae4b0 0x55fe2df0f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1e5629700 1 -- 172.21.15.114:0/132057070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea70b0 msgr2=0x55fe2deadf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1e5629700 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea70b0 0x55fe2deadf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1e5629700 1 -- 172.21.15.114:0/132057070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1dc00e040 con 0x55fe2dea2640 2023-10-18T14:03:51.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1e4e28700 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea70b0 0x55fe2deadf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:51.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1e5629700 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2640 0x55fe2deada30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55fe2debcb90 tx=0x7fc1d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee834f022366a35e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.679+0000 7fc1c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:51.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1c8ff9700 1 -- 172.21.15.114:0/132057070 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0005e70 con 0x55fe2dea2640 2023-10-18T14:03:51.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1c8ff9700 1 -- 172.21.15.114:0/132057070 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc1d00281b0 con 0x55fe2dea2640 2023-10-18T14:03:51.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/132057070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc1d809c040 con 0x55fe2dea2640 2023-10-18T14:03:51.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1c8ff9700 1 -- 172.21.15.114:0/132057070 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1d0028370 con 0x55fe2dea2640 2023-10-18T14:03:51.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1f3a76b80 10 client.15441 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:51.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/132057070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fe2dc42200 con 0x55fe2dea2640 2023-10-18T14:03:51.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1c8ff9700 1 -- 172.21.15.114:0/132057070 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1d809c040 con 0x55fe2dea2640 2023-10-18T14:03:51.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1c8ff9700 1 -- 172.21.15.114:0/132057070 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc1d0006340 con 0x55fe2dea2640 2023-10-18T14:03:51.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1f3a76b80 10 client.15441 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:51.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1f3a76b80 10 client.15441 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-18T14:03:51.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1f3a76b80 20 client.15441 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:51.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55fe2df15160 0x55fe2df11560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1f3a76b80 4 client.15441 mds_command: new command op to 14820 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T14:03:51.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/132057070 --> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fe2dde9e00 con 0x55fe2df15160 2023-10-18T14:03:51.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.680+0000 7fc1e4e28700 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55fe2df15160 0x55fe2df11560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1c8ff9700 10 client.15441 ms_handle_connect on v2:172.21.15.114:6840/2423071224 2023-10-18T14:03:51.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1e4e28700 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55fe2df15160 0x55fe2df11560 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7f156a39b18e2d5e server_cookie=8a8709d4a512ee90 in_seq=0 out_seq=0 2023-10-18T14:03:51.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1c8ff9700 1 -- 172.21.15.114:0/132057070 <== mds.4 v2:172.21.15.114:6840/2423071224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55fe2dde9e00 con 0x55fe2df15160 2023-10-18T14:03:51.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1c8ff9700 10 client.15441 handle_command_reply: tid=0 2023-10-18T14:03:51.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1f3a76b80 1 client.15441 shutdown 2023-10-18T14:03:51.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/132057070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2640 msgr2=0x55fe2deada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2640 0x55fe2deada30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55fe2debcb90 tx=0x7fc1d0004750 comp rx=0 tx=0).stop 2023-10-18T14:03:51.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/132057070 shutdown_connections 2023-10-18T14:03:51.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55fe2df15160 0x55fe2df11560 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe2deae4b0 0x55fe2df0f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fe2dea2640 0x55fe2deada30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1f3a76b80 1 --2- 172.21.15.114:0/132057070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fe2dea70b0 0x55fe2deadf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1c8ff9700 0 client.15441 ms_handle_reset on v2:172.21.15.114:6840/2423071224 2023-10-18T14:03:51.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/132057070 >> 172.21.15.114:0/132057070 conn(0x55fe2de126d0 msgr2=0x55fe2deba930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/132057070 shutdown_connections 2023-10-18T14:03:51.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1f3a76b80 1 -- 172.21.15.114:0/132057070 wait complete. 2023-10-18T14:03:51.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.681+0000 7fc1f3a76b80 20 client.15441 trim_cache size 0 max 16384 2023-10-18T14:03:51.703 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:03:51.703 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T14:03:51.703 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 4, 2023-10-18T14:03:51.704 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 14820, 2023-10-18T14:03:51.704 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-10-18T14:03:51.704 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-10-18T14:03:51.704 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-10-18T14:03:51.704 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 73.425760619000002, 2023-10-18T14:03:51.705 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 26, 2023-10-18T14:03:51.705 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 85, 2023-10-18T14:03:51.705 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 83, 2023-10-18T14:03:51.705 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 86.284825980999997 2023-10-18T14:03:51.705 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:03:51.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.682+0000 7fc1e788d700 1 -- 172.21.15.114:0/2745494226 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc1cc0a15e0 msgr2=0x7fc1cc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.682+0000 7fc1e788d700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc1cc0a15e0 0x7fc1cc0a3aa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009a10 tx=0x7fc1d0009190 comp rx=0 tx=0).stop 2023-10-18T14:03:51.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.682+0000 7fc1e788d700 1 -- 172.21.15.114:0/2745494226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e0106e20 msgr2=0x7fc1e019b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.682+0000 7fc1e788d700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e0106e20 0x7fc1e019b7a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800b830 tx=0x7fc1d80077f0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.682+0000 7fc1e788d700 1 -- 172.21.15.114:0/2745494226 shutdown_connections 2023-10-18T14:03:51.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.682+0000 7fc1e788d700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc1cc0a15e0 0x7fc1cc0a3aa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.682+0000 7fc1e788d700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e0106e20 0x7fc1e019b7a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.682+0000 7fc1e788d700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e01018a0 0x7fc1e0196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.682+0000 7fc1e788d700 1 --2- 172.21.15.114:0/2745494226 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc1e01021c0 0x7fc1e0197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.682+0000 7fc1e788d700 1 -- 172.21.15.114:0/2745494226 >> 172.21.15.114:0/2745494226 conn(0x7fc1e00fb0a0 msgr2=0x7fc1e00fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.682+0000 7fc1e788d700 1 -- 172.21.15.114:0/2745494226 shutdown_connections 2023-10-18T14:03:51.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.682+0000 7fc1e788d700 1 -- 172.21.15.114:0/2745494226 wait complete. 2023-10-18T14:03:51.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-18T14:03:51.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.827+0000 7f8320c77700 1 -- 172.21.15.114:0/2600438942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831c105640 msgr2=0x7f831c105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.827+0000 7f8320c77700 1 --2- 172.21.15.114:0/2600438942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831c105640 0x7f831c105a20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f830c00b0a0 tx=0x7f830c00b3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.828+0000 7f8320c77700 1 -- 172.21.15.114:0/2600438942 shutdown_connections 2023-10-18T14:03:51.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.828+0000 7f8320c77700 1 --2- 172.21.15.114:0/2600438942 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f831c0ffff0 0x7f831c10c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.828+0000 7f8320c77700 1 --2- 172.21.15.114:0/2600438942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831c105640 0x7f831c105a20 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.828+0000 7f8320c77700 1 --2- 172.21.15.114:0/2600438942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f831c0ff630 0x7f831c0ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.828+0000 7f8320c77700 1 -- 172.21.15.114:0/2600438942 >> 172.21.15.114:0/2600438942 conn(0x7f831c0fb120 msgr2=0x7f831c0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.828+0000 7f8320c77700 1 -- 172.21.15.114:0/2600438942 shutdown_connections 2023-10-18T14:03:51.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.828+0000 7f8320c77700 1 -- 172.21.15.114:0/2600438942 wait complete. 2023-10-18T14:03:51.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.828+0000 7f8320c77700 1 Processor -- start 2023-10-18T14:03:51.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.828+0000 7f8320c77700 1 -- start start 2023-10-18T14:03:51.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f8320c77700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f831c0ff630 0x7f831c101200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f8320c77700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f831c0ffff0 0x7f831c101740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f8320c77700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831c105640 0x7f831c101c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f8320c77700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c1a4ec0 con 0x7f831c105640 2023-10-18T14:03:51.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f8320c77700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c1a5030 con 0x7f831c0ffff0 2023-10-18T14:03:51.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f8320c77700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c1a51f0 con 0x7f831c0ff630 2023-10-18T14:03:51.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f831ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831c105640 0x7f831c101c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f831ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831c105640 0x7f831c101c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43728/0 (socket says 172.21.15.114:43728) 2023-10-18T14:03:51.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f831ad9d700 1 -- 172.21.15.114:0/985681016 learned_addr learned my addr 172.21.15.114:0/985681016 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:51.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f831a59c700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f831c0ff630 0x7f831c101200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f8319d9b700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f831c0ffff0 0x7f831c101740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f831ad9d700 1 -- 172.21.15.114:0/985681016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f831c0ff630 msgr2=0x7f831c101200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f831ad9d700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f831c0ff630 0x7f831c101200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f831ad9d700 1 -- 172.21.15.114:0/985681016 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f831c0ffff0 msgr2=0x7f831c101740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f831ad9d700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f831c0ffff0 0x7f831c101740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f831ad9d700 1 -- 172.21.15.114:0/985681016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c009d00 con 0x7f831c105640 2023-10-18T14:03:51.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f8319d9b700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f831c0ffff0 0x7f831c101740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:51.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f831ad9d700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831c105640 0x7f831c101c80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f831400c970 tx=0x7f831400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f830b7fe700 1 -- 172.21.15.114:0/985681016 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314007b00 con 0x7f831c105640 2023-10-18T14:03:51.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f8320c77700 1 -- 172.21.15.114:0/985681016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c1a54d0 con 0x7f831c105640 2023-10-18T14:03:51.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f830b7fe700 1 -- 172.21.15.114:0/985681016 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f831400ce60 con 0x7f831c105640 2023-10-18T14:03:51.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f830b7fe700 1 -- 172.21.15.114:0/985681016 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314005420 con 0x7f831c105640 2023-10-18T14:03:51.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.829+0000 7f8320c77700 1 -- 172.21.15.114:0/985681016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c1a59e0 con 0x7f831c105640 2023-10-18T14:03:51.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.831+0000 7f830b7fe700 1 -- 172.21.15.114:0/985681016 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f83140055c0 con 0x7f831c105640 2023-10-18T14:03:51.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.832+0000 7f830b7fe700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f83040a1560 0x7f83040a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.832+0000 7f831a59c700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f83040a1560 0x7f83040a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.832+0000 7f830b7fe700 1 -- 172.21.15.114:0/985681016 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f83140ccab0 con 0x7f831c105640 2023-10-18T14:03:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.832+0000 7f831a59c700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f83040a1560 0x7f83040a3a20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f830c009fd0 tx=0x7f830c00b7b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f832ce60b80 1 Processor -- start 2023-10-18T14:03:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f832ce60b80 1 -- start start 2023-10-18T14:03:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f832ce60b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ebb90 0x561de97ebf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f832ce60b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ec4b0 0x561de97e6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f832ce60b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97e6580 0x561de97e6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f832ce60b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de9759690 con 0x561de97ebb90 2023-10-18T14:03:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f832ce60b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de973fc10 con 0x561de97ec4b0 2023-10-18T14:03:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f832ce60b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de973d530 con 0x561de97e6580 2023-10-18T14:03:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f831a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ebb90 0x561de97ebf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f831a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ebb90 0x561de97ebf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43734/0 (socket says 172.21.15.114:43734) 2023-10-18T14:03:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f831a59c700 1 -- 172.21.15.114:0/3054440896 learned_addr learned my addr 172.21.15.114:0/3054440896 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:51.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f831ad9d700 1 --2- 172.21.15.114:0/3054440896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97e6580 0x561de97e6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f8319d9b700 1 --2- 172.21.15.114:0/3054440896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ec4b0 0x561de97e6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f831a59c700 1 -- 172.21.15.114:0/3054440896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97e6580 msgr2=0x561de97e6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f831a59c700 1 --2- 172.21.15.114:0/3054440896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97e6580 0x561de97e6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f831a59c700 1 -- 172.21.15.114:0/3054440896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ec4b0 msgr2=0x561de97e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f831a59c700 1 --2- 172.21.15.114:0/3054440896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ec4b0 0x561de97e6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.833+0000 7f831a59c700 1 -- 172.21.15.114:0/3054440896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561de96f63a0 con 0x561de97ebb90 2023-10-18T14:03:51.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.834+0000 7f831a59c700 1 --2- 172.21.15.114:0/3054440896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ebb90 0x561de97ebf70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f830c004c20 tx=0x7f830c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d43755ffa927a9b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.834+0000 7f8308ff9700 1 -- 172.21.15.114:0/3054440896 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00e040 con 0x561de97ebb90 2023-10-18T14:03:51.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.834+0000 7f8308ff9700 1 -- 172.21.15.114:0/3054440896 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f830c01c900 con 0x561de97ebb90 2023-10-18T14:03:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.834+0000 7f8308ff9700 1 -- 172.21.15.114:0/3054440896 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c028930 con 0x561de97ebb90 2023-10-18T14:03:51.848 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:51 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2336485027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:51.848 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:51 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3927147119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:51.849 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:51 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2614369573' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:51.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.835+0000 7f832ce60b80 1 -- 172.21.15.114:0/3054440896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ebb90 msgr2=0x561de97ebf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.835+0000 7f832ce60b80 1 --2- 172.21.15.114:0/3054440896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ebb90 0x561de97ebf70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f830c004c20 tx=0x7f830c01c000 comp rx=0 tx=0).stop 2023-10-18T14:03:51.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.835+0000 7f832ce60b80 1 -- 172.21.15.114:0/3054440896 shutdown_connections 2023-10-18T14:03:51.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.835+0000 7f832ce60b80 1 --2- 172.21.15.114:0/3054440896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97e6580 0x561de97e6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.835+0000 7f832ce60b80 1 --2- 172.21.15.114:0/3054440896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ebb90 0x561de97ebf70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.835+0000 7f832ce60b80 1 --2- 172.21.15.114:0/3054440896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ec4b0 0x561de97e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.835+0000 7f832ce60b80 1 -- 172.21.15.114:0/3054440896 >> 172.21.15.114:0/3054440896 conn(0x561de975a6d0 msgr2=0x561de97e0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.835+0000 7f832ce60b80 1 -- 172.21.15.114:0/3054440896 shutdown_connections 2023-10-18T14:03:51.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.835+0000 7f832ce60b80 1 -- 172.21.15.114:0/3054440896 wait complete. 2023-10-18T14:03:51.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.835+0000 7f832ce60b80 1 -- start start 2023-10-18T14:03:51.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.835+0000 7f832ce60b80 1 Processor -- start 2023-10-18T14:03:51.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.835+0000 7f832ce60b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 0x561de97f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f832ce60b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ebb90 0x561de97ef720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f832ce60b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97ec4b0 0x561de97efe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f832ce60b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de9738e20 con 0x561de97e6580 2023-10-18T14:03:51.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f832ce60b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de96d56c0 con 0x561de97ebb90 2023-10-18T14:03:51.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f832ce60b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de96d5360 con 0x561de97ec4b0 2023-10-18T14:03:51.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f832ce60b80 10 client.0 _ll_register_callbacks cb 0x561de961fa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:51.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f831a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 0x561de97f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f831a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 0x561de97f24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43740/0 (socket says 172.21.15.114:43740) 2023-10-18T14:03:51.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f831a59c700 1 -- 172.21.15.114:0/3943972547 learned_addr learned my addr 172.21.15.114:0/3943972547 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:51.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f8319d9b700 1 --2- 172.21.15.114:0/3943972547 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ebb90 0x561de97ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f831ad9d700 1 --2- 172.21.15.114:0/3943972547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97ec4b0 0x561de97efe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f831a59c700 1 -- 172.21.15.114:0/3943972547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97ec4b0 msgr2=0x561de97efe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f831a59c700 1 --2- 172.21.15.114:0/3943972547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97ec4b0 0x561de97efe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f831a59c700 1 -- 172.21.15.114:0/3943972547 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ebb90 msgr2=0x561de97ef720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f831a59c700 1 --2- 172.21.15.114:0/3943972547 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ebb90 0x561de97ef720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f831a59c700 1 -- 172.21.15.114:0/3943972547 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c10ce00 con 0x561de97e6580 2023-10-18T14:03:51.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f831a59c700 1 --2- 172.21.15.114:0/3943972547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 0x561de97f24a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f830c007ba0 tx=0x7f830c006160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536e9e5d3904fbb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f8301ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:51.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f8301ffb700 1 -- 172.21.15.114:0/3943972547 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00e070 con 0x561de97e6580 2023-10-18T14:03:51.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f8301ffb700 1 -- 172.21.15.114:0/3943972547 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f830c023040 con 0x561de97e6580 2023-10-18T14:03:51.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f832ce60b80 1 -- 172.21.15.114:0/3943972547 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561de973dea0 con 0x561de97e6580 2023-10-18T14:03:51.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f8301ffb700 1 -- 172.21.15.114:0/3943972547 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f830c003c00 con 0x561de97e6580 2023-10-18T14:03:51.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f832ce60b80 10 client.15453 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:51.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.836+0000 7f832ce60b80 1 -- 172.21.15.114:0/3943972547 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561de9563d90 con 0x561de97e6580 2023-10-18T14:03:51.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.837+0000 7f8301ffb700 1 -- 172.21.15.114:0/3943972547 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561de973dea0 con 0x561de97e6580 2023-10-18T14:03:51.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.837+0000 7f8301ffb700 1 -- 172.21.15.114:0/3943972547 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f830c0040d0 con 0x561de97e6580 2023-10-18T14:03:51.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.837+0000 7f832ce60b80 10 client.15453 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:51.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.837+0000 7f832ce60b80 10 client.15453 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-18T14:03:51.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.837+0000 7f832ce60b80 20 client.15453 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:51.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.837+0000 7f832ce60b80 1 --2- 172.21.15.114:0/3943972547 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x561de97ff8d0 0x561de97fe690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.837+0000 7f832ce60b80 4 client.15453 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:03:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.837+0000 7f832ce60b80 1 -- 172.21.15.114:0/3943972547 --> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561de97b5860 con 0x561de97ff8d0 2023-10-18T14:03:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.837+0000 7f8319d9b700 1 --2- 172.21.15.114:0/3943972547 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x561de97ff8d0 0x561de97fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f8301ffb700 10 client.15453 ms_handle_connect on v2:172.21.15.158:6838/2616400572 2023-10-18T14:03:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f8319d9b700 1 --2- 172.21.15.114:0/3943972547 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x561de97ff8d0 0x561de97fe690 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cf43f80231921bab server_cookie=d3cae4ea8bcd9505 in_seq=0 out_seq=0 2023-10-18T14:03:51.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f8301ffb700 1 -- 172.21.15.114:0/3943972547 <== mds.3 v2:172.21.15.158:6838/2616400572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561de97b5860 con 0x561de97ff8d0 2023-10-18T14:03:51.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f8301ffb700 10 client.15453 handle_command_reply: tid=0 2023-10-18T14:03:51.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f832ce60b80 1 client.15453 shutdown 2023-10-18T14:03:51.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f832ce60b80 1 -- 172.21.15.114:0/3943972547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 msgr2=0x561de97f24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f832ce60b80 1 --2- 172.21.15.114:0/3943972547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 0x561de97f24a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f830c007ba0 tx=0x7f830c006160 comp rx=0 tx=0).stop 2023-10-18T14:03:51.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f832ce60b80 1 -- 172.21.15.114:0/3943972547 shutdown_connections 2023-10-18T14:03:51.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f832ce60b80 1 --2- 172.21.15.114:0/3943972547 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x561de97ff8d0 0x561de97fe690 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f832ce60b80 1 --2- 172.21.15.114:0/3943972547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97ec4b0 0x561de97efe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f8301ffb700 0 client.15453 ms_handle_reset on v2:172.21.15.158:6838/2616400572 2023-10-18T14:03:51.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f832ce60b80 1 --2- 172.21.15.114:0/3943972547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 0x561de97f24a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f832ce60b80 1 --2- 172.21.15.114:0/3943972547 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ebb90 0x561de97ef720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f832ce60b80 1 -- 172.21.15.114:0/3943972547 >> 172.21.15.114:0/3943972547 conn(0x561de975a6d0 msgr2=0x561de97e5030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f832ce60b80 1 -- 172.21.15.114:0/3943972547 shutdown_connections 2023-10-18T14:03:51.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.838+0000 7f832ce60b80 1 -- 172.21.15.114:0/3943972547 wait complete. 2023-10-18T14:03:51.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.839+0000 7f832ce60b80 20 client.15453 trim_cache size 0 max 16384 2023-10-18T14:03:51.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f832ce60b80 1 Processor -- start 2023-10-18T14:03:51.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f832ce60b80 1 -- start start 2023-10-18T14:03:51.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f832ce60b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97e6580 0x561de97e9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f832ce60b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ebb90 0x561de9808240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f832ce60b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ec4b0 0x561de97f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f832ce60b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de95b98d0 con 0x561de97ec4b0 2023-10-18T14:03:51.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f832ce60b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de97b5860 con 0x561de97ebb90 2023-10-18T14:03:51.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f832ce60b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de97d9010 con 0x561de97e6580 2023-10-18T14:03:51.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f831ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ec4b0 0x561de97f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f831ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ec4b0 0x561de97f1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43752/0 (socket says 172.21.15.114:43752) 2023-10-18T14:03:51.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f831ad9d700 1 -- 172.21.15.114:0/1798485054 learned_addr learned my addr 172.21.15.114:0/1798485054 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:51.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f831a59c700 1 --2- 172.21.15.114:0/1798485054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97e6580 0x561de97e9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f8319d9b700 1 --2- 172.21.15.114:0/1798485054 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ebb90 0x561de9808240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f831ad9d700 1 -- 172.21.15.114:0/1798485054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97e6580 msgr2=0x561de97e9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f831ad9d700 1 --2- 172.21.15.114:0/1798485054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97e6580 0x561de97e9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f831ad9d700 1 -- 172.21.15.114:0/1798485054 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ebb90 msgr2=0x561de9808240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f831ad9d700 1 --2- 172.21.15.114:0/1798485054 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ebb90 0x561de9808240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f831ad9d700 1 -- 172.21.15.114:0/1798485054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561de954cc10 con 0x561de97ec4b0 2023-10-18T14:03:51.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f8319d9b700 1 --2- 172.21.15.114:0/1798485054 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ebb90 0x561de9808240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:51.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.857+0000 7f831ad9d700 1 --2- 172.21.15.114:0/1798485054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ec4b0 0x561de97f1fd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8314096640 tx=0x7f8314099530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d841557bf1baa5f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.858+0000 7f83097fa700 1 -- 172.21.15.114:0/1798485054 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314099bd0 con 0x561de97ec4b0 2023-10-18T14:03:51.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.858+0000 7f83097fa700 1 -- 172.21.15.114:0/1798485054 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f831409dd20 con 0x561de97ec4b0 2023-10-18T14:03:51.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.858+0000 7f83097fa700 1 -- 172.21.15.114:0/1798485054 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83140990c0 con 0x561de97ec4b0 2023-10-18T14:03:51.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.858+0000 7f832ce60b80 1 -- 172.21.15.114:0/1798485054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ec4b0 msgr2=0x561de97f1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.858+0000 7f832ce60b80 1 --2- 172.21.15.114:0/1798485054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ec4b0 0x561de97f1fd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8314096640 tx=0x7f8314099530 comp rx=0 tx=0).stop 2023-10-18T14:03:51.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.858+0000 7f832ce60b80 1 -- 172.21.15.114:0/1798485054 shutdown_connections 2023-10-18T14:03:51.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.858+0000 7f832ce60b80 1 --2- 172.21.15.114:0/1798485054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97ec4b0 0x561de97f1fd0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.858+0000 7f832ce60b80 1 --2- 172.21.15.114:0/1798485054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97e6580 0x561de97e9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.858+0000 7f832ce60b80 1 --2- 172.21.15.114:0/1798485054 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ebb90 0x561de9808240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.858+0000 7f832ce60b80 1 -- 172.21.15.114:0/1798485054 >> 172.21.15.114:0/1798485054 conn(0x561de975a6d0 msgr2=0x561de97e9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.858+0000 7f832ce60b80 1 -- 172.21.15.114:0/1798485054 shutdown_connections 2023-10-18T14:03:51.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.858+0000 7f832ce60b80 1 -- 172.21.15.114:0/1798485054 wait complete. 2023-10-18T14:03:51.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f832ce60b80 1 -- start start 2023-10-18T14:03:51.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f832ce60b80 1 Processor -- start 2023-10-18T14:03:51.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f832ce60b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 0x561de97e5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f832ce60b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97ebb90 0x561de97e5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f832ce60b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ec4b0 0x561de98532c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f832ce60b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de97e5e80 con 0x561de97e6580 2023-10-18T14:03:51.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f832ce60b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de9853800 con 0x561de97ec4b0 2023-10-18T14:03:51.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f832ce60b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561de9853940 con 0x561de97ebb90 2023-10-18T14:03:51.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f831a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 0x561de97e5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f832ce60b80 10 client.0 _ll_register_callbacks cb 0x561de961fa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:51.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f831a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 0x561de97e5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43754/0 (socket says 172.21.15.114:43754) 2023-10-18T14:03:51.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f831a59c700 1 -- 172.21.15.114:0/2436467337 learned_addr learned my addr 172.21.15.114:0/2436467337 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:51.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f831ad9d700 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ec4b0 0x561de98532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f8319d9b700 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97ebb90 0x561de97e5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.859+0000 7f831a59c700 1 -- 172.21.15.114:0/2436467337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97ebb90 msgr2=0x561de97e5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f831a59c700 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97ebb90 0x561de97e5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f831a59c700 1 -- 172.21.15.114:0/2436467337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ec4b0 msgr2=0x561de98532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:51.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f831a59c700 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ec4b0 0x561de98532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f831a59c700 1 -- 172.21.15.114:0/2436467337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c1a59e0 con 0x561de97e6580 2023-10-18T14:03:51.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f831ad9d700 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ec4b0 0x561de98532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:51.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f831a59c700 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 0x561de97e5030 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f830c004900 tx=0x7f830c004930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcab80a44c6f0b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:51.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f8301ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:51.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f8301ffb700 1 -- 172.21.15.114:0/2436467337 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00e050 con 0x561de97e6580 2023-10-18T14:03:51.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f8301ffb700 1 -- 172.21.15.114:0/2436467337 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f830c003e10 con 0x561de97e6580 2023-10-18T14:03:51.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f832ce60b80 1 -- 172.21.15.114:0/2436467337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f830c01c900 con 0x561de97e6580 2023-10-18T14:03:51.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f8301ffb700 1 -- 172.21.15.114:0/2436467337 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f830c01cb20 con 0x561de97e6580 2023-10-18T14:03:51.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f832ce60b80 10 client.15459 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:51.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f832ce60b80 1 -- 172.21.15.114:0/2436467337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561de958a200 con 0x561de97e6580 2023-10-18T14:03:51.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f8301ffb700 1 -- 172.21.15.114:0/2436467337 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f830c01c900 con 0x561de97e6580 2023-10-18T14:03:51.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f8301ffb700 1 -- 172.21.15.114:0/2436467337 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f830c028cf0 con 0x561de97e6580 2023-10-18T14:03:51.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f832ce60b80 10 client.15459 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:51.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f832ce60b80 10 client.15459 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-18T14:03:51.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f832ce60b80 20 client.15459 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:51.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f832ce60b80 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x561de98586f0 0x561de9854b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:51.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f832ce60b80 4 client.15459 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T14:03:51.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.860+0000 7f832ce60b80 1 -- 172.21.15.114:0/2436467337 --> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561de9731e00 con 0x561de98586f0 2023-10-18T14:03:51.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f8319d9b700 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x561de98586f0 0x561de9854b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:51.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f8301ffb700 10 client.15459 ms_handle_connect on v2:172.21.15.158:6838/2616400572 2023-10-18T14:03:51.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f8319d9b700 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x561de98586f0 0x561de9854b50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a4df56ff72169aaa server_cookie=70098ec7c6d558fb in_seq=0 out_seq=0 2023-10-18T14:03:51.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f8301ffb700 1 -- 172.21.15.114:0/2436467337 <== mds.3 v2:172.21.15.158:6838/2616400572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x561de9731e00 con 0x561de98586f0 2023-10-18T14:03:51.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f8301ffb700 10 client.15459 handle_command_reply: tid=0 2023-10-18T14:03:51.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f832ce60b80 1 client.15459 shutdown 2023-10-18T14:03:51.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f832ce60b80 1 -- 172.21.15.114:0/2436467337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 msgr2=0x561de97e5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f832ce60b80 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 0x561de97e5030 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f830c004900 tx=0x7f830c004930 comp rx=0 tx=0).stop 2023-10-18T14:03:51.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f832ce60b80 1 -- 172.21.15.114:0/2436467337 shutdown_connections 2023-10-18T14:03:51.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f832ce60b80 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x561de98586f0 0x561de9854b50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f832ce60b80 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561de97ec4b0 0x561de98532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f832ce60b80 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561de97e6580 0x561de97e5030 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f8301ffb700 0 client.15459 ms_handle_reset on v2:172.21.15.158:6838/2616400572 2023-10-18T14:03:51.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f832ce60b80 1 --2- 172.21.15.114:0/2436467337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561de97ebb90 0x561de97e5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f832ce60b80 1 -- 172.21.15.114:0/2436467337 >> 172.21.15.114:0/2436467337 conn(0x561de975a6d0 msgr2=0x561de97ea860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f832ce60b80 1 -- 172.21.15.114:0/2436467337 shutdown_connections 2023-10-18T14:03:51.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f832ce60b80 1 -- 172.21.15.114:0/2436467337 wait complete. 2023-10-18T14:03:51.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.861+0000 7f832ce60b80 20 client.15459 trim_cache size 0 max 16384 2023-10-18T14:03:51.886 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:03:51.886 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T14:03:51.887 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 3, 2023-10-18T14:03:51.887 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 24566, 2023-10-18T14:03:51.887 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-10-18T14:03:51.887 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-10-18T14:03:51.887 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-10-18T14:03:51.888 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 73.984040313999998, 2023-10-18T14:03:51.888 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 26, 2023-10-18T14:03:51.888 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 85, 2023-10-18T14:03:51.888 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 83, 2023-10-18T14:03:51.888 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 84.107011173000004 2023-10-18T14:03:51.889 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:03:51.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.862+0000 7f8320c77700 1 -- 172.21.15.114:0/985681016 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f83040a1560 msgr2=0x7f83040a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.862+0000 7f8320c77700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f83040a1560 0x7f83040a3a20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f830c009fd0 tx=0x7f830c00b7b0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.862+0000 7f8320c77700 1 -- 172.21.15.114:0/985681016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831c105640 msgr2=0x7f831c101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:51.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.862+0000 7f8320c77700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831c105640 0x7f831c101c80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f831400c970 tx=0x7f831400cc80 comp rx=0 tx=0).stop 2023-10-18T14:03:51.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.862+0000 7f8320c77700 1 -- 172.21.15.114:0/985681016 shutdown_connections 2023-10-18T14:03:51.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.862+0000 7f8320c77700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f83040a1560 0x7f83040a3a20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.862+0000 7f8320c77700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f831c105640 0x7f831c101c80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.862+0000 7f8320c77700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f831c0ff630 0x7f831c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.862+0000 7f8320c77700 1 --2- 172.21.15.114:0/985681016 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f831c0ffff0 0x7f831c101740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:51.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.862+0000 7f8320c77700 1 -- 172.21.15.114:0/985681016 >> 172.21.15.114:0/985681016 conn(0x7f831c0fb120 msgr2=0x7f831c1034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:51.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.862+0000 7f8320c77700 1 -- 172.21.15.114:0/985681016 shutdown_connections 2023-10-18T14:03:51.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:51.862+0000 7f8320c77700 1 -- 172.21.15.114:0/985681016 wait complete. 2023-10-18T14:03:51.892 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-18T14:03:52.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.011+0000 7efc2da7b700 1 -- 172.21.15.114:0/953240275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc281066b0 msgr2=0x7efc28106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.011+0000 7efc2da7b700 1 --2- 172.21.15.114:0/953240275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc281066b0 0x7efc28106a90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efc18009990 tx=0x7efc18009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.011+0000 7efc2da7b700 1 -- 172.21.15.114:0/953240275 shutdown_connections 2023-10-18T14:03:52.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.011+0000 7efc2da7b700 1 --2- 172.21.15.114:0/953240275 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc28101060 0x7efc2810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.011+0000 7efc2da7b700 1 --2- 172.21.15.114:0/953240275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc281066b0 0x7efc28106a90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.011+0000 7efc2da7b700 1 --2- 172.21.15.114:0/953240275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc281006a0 0x7efc28100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.011+0000 7efc2da7b700 1 -- 172.21.15.114:0/953240275 >> 172.21.15.114:0/953240275 conn(0x7efc280fc170 msgr2=0x7efc280fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.011+0000 7efc2da7b700 1 -- 172.21.15.114:0/953240275 shutdown_connections 2023-10-18T14:03:52.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.012+0000 7efc2da7b700 1 -- 172.21.15.114:0/953240275 wait complete. 2023-10-18T14:03:52.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.012+0000 7efc2da7b700 1 Processor -- start 2023-10-18T14:03:52.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.012+0000 7efc2da7b700 1 -- start start 2023-10-18T14:03:52.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.012+0000 7efc2da7b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc281006a0 0x7efc2819c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.012+0000 7efc2da7b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc28101060 0x7efc2819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.012+0000 7efc2da7b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc281066b0 0x7efc28196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.012+0000 7efc2da7b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc28196fc0 con 0x7efc281066b0 2023-10-18T14:03:52.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.012+0000 7efc2da7b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc28197130 con 0x7efc28101060 2023-10-18T14:03:52.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.012+0000 7efc2da7b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc281972f0 con 0x7efc281006a0 2023-10-18T14:03:52.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc27fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc281066b0 0x7efc28196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc27fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc281066b0 0x7efc28196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43772/0 (socket says 172.21.15.114:43772) 2023-10-18T14:03:52.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc27fff700 1 -- 172.21.15.114:0/2660606799 learned_addr learned my addr 172.21.15.114:0/2660606799 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc277fe700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc281006a0 0x7efc2819c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc26ffd700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc28101060 0x7efc2819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc27fff700 1 -- 172.21.15.114:0/2660606799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc281006a0 msgr2=0x7efc2819c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc27fff700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc281006a0 0x7efc2819c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc27fff700 1 -- 172.21.15.114:0/2660606799 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc28101060 msgr2=0x7efc2819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc27fff700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc28101060 0x7efc2819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc27fff700 1 -- 172.21.15.114:0/2660606799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc180095f0 con 0x7efc281066b0 2023-10-18T14:03:52.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc277fe700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc281006a0 0x7efc2819c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:52.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc27fff700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc281066b0 0x7efc28196960 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7efc2000ada0 tx=0x7efc2000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc24ff9700 1 -- 172.21.15.114:0/2660606799 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2000f070 con 0x7efc281066b0 2023-10-18T14:03:52.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc24ff9700 1 -- 172.21.15.114:0/2660606799 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc20007b30 con 0x7efc281066b0 2023-10-18T14:03:52.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc2da7b700 1 -- 172.21.15.114:0/2660606799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc281975d0 con 0x7efc281066b0 2023-10-18T14:03:52.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc24ff9700 1 -- 172.21.15.114:0/2660606799 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc20005440 con 0x7efc281066b0 2023-10-18T14:03:52.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.013+0000 7efc2da7b700 1 -- 172.21.15.114:0/2660606799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc281a3820 con 0x7efc281066b0 2023-10-18T14:03:52.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:51 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2336485027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:52.025 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:51 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3927147119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:52.025 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:51 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2614369573' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.015+0000 7efc24ff9700 1 -- 172.21.15.114:0/2660606799 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7efc20004ad0 con 0x7efc281066b0 2023-10-18T14:03:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.016+0000 7efc24ff9700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efc100a1560 0x7efc100a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.016+0000 7efc277fe700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efc100a1560 0x7efc100a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.016+0000 7efc24ff9700 1 -- 172.21.15.114:0/2660606799 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efc200cc680 con 0x7efc281066b0 2023-10-18T14:03:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.016+0000 7efc277fe700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efc100a1560 0x7efc100a3a20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efc18006010 tx=0x7efc1801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc39c64b80 1 Processor -- start 2023-10-18T14:03:52.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc39c64b80 1 -- start start 2023-10-18T14:03:52.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc39c64b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f70b90 0x5611a3f70f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc39c64b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f714b0 0x5611a3f6b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc39c64b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f6b580 0x5611a3f6ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc39c64b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3ede690 con 0x5611a3f6b580 2023-10-18T14:03:52.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc39c64b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3ec4c10 con 0x5611a3f70b90 2023-10-18T14:03:52.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc39c64b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3ec2530 con 0x5611a3f714b0 2023-10-18T14:03:52.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc27fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f6b580 0x5611a3f6ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc27fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f6b580 0x5611a3f6ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43780/0 (socket says 172.21.15.114:43780) 2023-10-18T14:03:52.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc27fff700 1 -- 172.21.15.114:0/2219489241 learned_addr learned my addr 172.21.15.114:0/2219489241 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc26ffd700 1 --2- 172.21.15.114:0/2219489241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f714b0 0x5611a3f6b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc277fe700 1 --2- 172.21.15.114:0/2219489241 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f70b90 0x5611a3f70f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc27fff700 1 -- 172.21.15.114:0/2219489241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f714b0 msgr2=0x5611a3f6b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc27fff700 1 --2- 172.21.15.114:0/2219489241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f714b0 0x5611a3f6b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc27fff700 1 -- 172.21.15.114:0/2219489241 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f70b90 msgr2=0x5611a3f70f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc27fff700 1 --2- 172.21.15.114:0/2219489241 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f70b90 0x5611a3f70f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc27fff700 1 -- 172.21.15.114:0/2219489241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611a3e7b3a0 con 0x5611a3f6b580 2023-10-18T14:03:52.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.017+0000 7efc27fff700 1 --2- 172.21.15.114:0/2219489241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f6b580 0x5611a3f6ba00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efc2000a0a0 tx=0x7efc20095c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6303d9d6179727ab server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.018+0000 7efc0dffb700 1 -- 172.21.15.114:0/2219489241 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200997d0 con 0x5611a3f6b580 2023-10-18T14:03:52.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.018+0000 7efc0dffb700 1 -- 172.21.15.114:0/2219489241 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc2009d920 con 0x5611a3f6b580 2023-10-18T14:03:52.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.018+0000 7efc0dffb700 1 -- 172.21.15.114:0/2219489241 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc20099a30 con 0x5611a3f6b580 2023-10-18T14:03:52.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.018+0000 7efc39c64b80 1 -- 172.21.15.114:0/2219489241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f6b580 msgr2=0x5611a3f6ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.018+0000 7efc39c64b80 1 --2- 172.21.15.114:0/2219489241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f6b580 0x5611a3f6ba00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efc2000a0a0 tx=0x7efc20095c40 comp rx=0 tx=0).stop 2023-10-18T14:03:52.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.018+0000 7efc39c64b80 1 -- 172.21.15.114:0/2219489241 shutdown_connections 2023-10-18T14:03:52.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.018+0000 7efc39c64b80 1 --2- 172.21.15.114:0/2219489241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f6b580 0x5611a3f6ba00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.018+0000 7efc39c64b80 1 --2- 172.21.15.114:0/2219489241 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f70b90 0x5611a3f70f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.018+0000 7efc39c64b80 1 --2- 172.21.15.114:0/2219489241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f714b0 0x5611a3f6b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.018+0000 7efc39c64b80 1 -- 172.21.15.114:0/2219489241 >> 172.21.15.114:0/2219489241 conn(0x5611a3edf6d0 msgr2=0x5611a3f65b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.018+0000 7efc39c64b80 1 -- 172.21.15.114:0/2219489241 shutdown_connections 2023-10-18T14:03:52.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.018+0000 7efc39c64b80 1 -- 172.21.15.114:0/2219489241 wait complete. 2023-10-18T14:03:52.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc39c64b80 1 -- start start 2023-10-18T14:03:52.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc39c64b80 1 Processor -- start 2023-10-18T14:03:52.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc39c64b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f6b580 0x5611a3f74850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc39c64b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 0x5611a3f74d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc39c64b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f714b0 0x5611a3f752d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc39c64b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3ebde20 con 0x5611a3f70b90 2023-10-18T14:03:52.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc39c64b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3e5a6c0 con 0x5611a3f714b0 2023-10-18T14:03:52.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc39c64b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3e5a360 con 0x5611a3f6b580 2023-10-18T14:03:52.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc39c64b80 10 client.0 _ll_register_callbacks cb 0x5611a3da4a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:52.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc26ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 0x5611a3f74d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc26ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 0x5611a3f74d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43784/0 (socket says 172.21.15.114:43784) 2023-10-18T14:03:52.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc26ffd700 1 -- 172.21.15.114:0/3742110974 learned_addr learned my addr 172.21.15.114:0/3742110974 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc27fff700 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f714b0 0x5611a3f752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.019+0000 7efc277fe700 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f6b580 0x5611a3f74850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc26ffd700 1 -- 172.21.15.114:0/3742110974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f6b580 msgr2=0x5611a3f74850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc26ffd700 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f6b580 0x5611a3f74850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc26ffd700 1 -- 172.21.15.114:0/3742110974 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f714b0 msgr2=0x5611a3f752d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc26ffd700 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f714b0 0x5611a3f752d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc26ffd700 1 -- 172.21.15.114:0/3742110974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc281a3820 con 0x5611a3f70b90 2023-10-18T14:03:52.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc277fe700 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f6b580 0x5611a3f74850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:52.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc26ffd700 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 0x5611a3f74d90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00bf50 tx=0x7efc1c00f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d2420bb296532d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:52.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc06ffd700 1 -- 172.21.15.114:0/3742110974 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c014460 con 0x5611a3f70b90 2023-10-18T14:03:52.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc06ffd700 1 -- 172.21.15.114:0/3742110974 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efc1c0145c0 con 0x5611a3f70b90 2023-10-18T14:03:52.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc39c64b80 1 -- 172.21.15.114:0/3742110974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611a3ec2ea0 con 0x5611a3f70b90 2023-10-18T14:03:52.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc06ffd700 1 -- 172.21.15.114:0/3742110974 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc1c014780 con 0x5611a3f70b90 2023-10-18T14:03:52.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc39c64b80 10 client.15471 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:52.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc39c64b80 1 -- 172.21.15.114:0/3742110974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5611a3ce8d90 con 0x5611a3f70b90 2023-10-18T14:03:52.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc06ffd700 1 -- 172.21.15.114:0/3742110974 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5611a3ec2ea0 con 0x5611a3f70b90 2023-10-18T14:03:52.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc06ffd700 1 -- 172.21.15.114:0/3742110974 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efc1c013a00 con 0x5611a3f70b90 2023-10-18T14:03:52.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc39c64b80 10 client.15471 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:52.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc39c64b80 10 client.15471 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-18T14:03:52.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc39c64b80 20 client.15471 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:52.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc39c64b80 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x5611a3f85090 0x5611a3f83af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc39c64b80 4 client.15471 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:03:52.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.020+0000 7efc39c64b80 1 -- 172.21.15.114:0/3742110974 --> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611a3f3a860 con 0x5611a3f85090 2023-10-18T14:03:52.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.021+0000 7efc277fe700 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x5611a3f85090 0x5611a3f83af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.021+0000 7efc06ffd700 10 client.15471 ms_handle_connect on v2:172.21.15.172:6834/2655563129 2023-10-18T14:03:52.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.021+0000 7efc277fe700 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x5611a3f85090 0x5611a3f83af0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=31c26220da67f6e1 server_cookie=649bfa93665156ef in_seq=0 out_seq=0 2023-10-18T14:03:52.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc06ffd700 1 -- 172.21.15.114:0/3742110974 <== mds.2 v2:172.21.15.172:6834/2655563129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5611a3f3a860 con 0x5611a3f85090 2023-10-18T14:03:52.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc06ffd700 10 client.15471 handle_command_reply: tid=0 2023-10-18T14:03:52.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc39c64b80 1 client.15471 shutdown 2023-10-18T14:03:52.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc39c64b80 1 -- 172.21.15.114:0/3742110974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 msgr2=0x5611a3f74d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc39c64b80 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 0x5611a3f74d90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00bf50 tx=0x7efc1c00f4c0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc39c64b80 1 -- 172.21.15.114:0/3742110974 shutdown_connections 2023-10-18T14:03:52.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc39c64b80 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x5611a3f85090 0x5611a3f83af0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc39c64b80 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f714b0 0x5611a3f752d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc06ffd700 0 client.15471 ms_handle_reset on v2:172.21.15.172:6834/2655563129 2023-10-18T14:03:52.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc39c64b80 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f6b580 0x5611a3f74850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc39c64b80 1 --2- 172.21.15.114:0/3742110974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 0x5611a3f74d90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc39c64b80 1 -- 172.21.15.114:0/3742110974 >> 172.21.15.114:0/3742110974 conn(0x5611a3edf6d0 msgr2=0x5611a3f6a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc39c64b80 1 -- 172.21.15.114:0/3742110974 shutdown_connections 2023-10-18T14:03:52.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc39c64b80 1 -- 172.21.15.114:0/3742110974 wait complete. 2023-10-18T14:03:52.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.022+0000 7efc39c64b80 20 client.15471 trim_cache size 0 max 16384 2023-10-18T14:03:52.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.039+0000 7efc39c64b80 1 Processor -- start 2023-10-18T14:03:52.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.039+0000 7efc39c64b80 1 -- start start 2023-10-18T14:03:52.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.039+0000 7efc39c64b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f6b580 0x5611a3f77090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.039+0000 7efc39c64b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f70b90 0x5611a3f84200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.039+0000 7efc39c64b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f714b0 0x5611a3f6e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.039+0000 7efc39c64b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3d3e8d0 con 0x5611a3f714b0 2023-10-18T14:03:52.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.039+0000 7efc39c64b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3e7c590 con 0x5611a3f6b580 2023-10-18T14:03:52.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.039+0000 7efc39c64b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3e644d0 con 0x5611a3f70b90 2023-10-18T14:03:52.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc27fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f714b0 0x5611a3f6e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc27fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f714b0 0x5611a3f6e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43794/0 (socket says 172.21.15.114:43794) 2023-10-18T14:03:52.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc27fff700 1 -- 172.21.15.114:0/3685582825 learned_addr learned my addr 172.21.15.114:0/3685582825 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc277fe700 1 --2- 172.21.15.114:0/3685582825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f6b580 0x5611a3f77090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc26ffd700 1 --2- 172.21.15.114:0/3685582825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f70b90 0x5611a3f84200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc27fff700 1 -- 172.21.15.114:0/3685582825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f70b90 msgr2=0x5611a3f84200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc27fff700 1 --2- 172.21.15.114:0/3685582825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f70b90 0x5611a3f84200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc27fff700 1 -- 172.21.15.114:0/3685582825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f6b580 msgr2=0x5611a3f77090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc27fff700 1 --2- 172.21.15.114:0/3685582825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f6b580 0x5611a3f77090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc27fff700 1 -- 172.21.15.114:0/3685582825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611a3cd1c10 con 0x5611a3f714b0 2023-10-18T14:03:52.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc26ffd700 1 --2- 172.21.15.114:0/3685582825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f70b90 0x5611a3f84200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:52.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc27fff700 1 --2- 172.21.15.114:0/3685582825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f714b0 0x5611a3f6e6d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efc200994d0 tx=0x7efc2000a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b5d89f966cf0b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc0e7fc700 1 -- 172.21.15.114:0/3685582825 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc20099850 con 0x5611a3f714b0 2023-10-18T14:03:52.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc0e7fc700 1 -- 172.21.15.114:0/3685582825 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc200b90b0 con 0x5611a3f714b0 2023-10-18T14:03:52.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.040+0000 7efc0e7fc700 1 -- 172.21.15.114:0/3685582825 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc20098cc0 con 0x5611a3f714b0 2023-10-18T14:03:52.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 -- 172.21.15.114:0/3685582825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f714b0 msgr2=0x5611a3f6e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 --2- 172.21.15.114:0/3685582825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f714b0 0x5611a3f6e6d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efc200994d0 tx=0x7efc2000a2e0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 -- 172.21.15.114:0/3685582825 shutdown_connections 2023-10-18T14:03:52.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 --2- 172.21.15.114:0/3685582825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f714b0 0x5611a3f6e6d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 --2- 172.21.15.114:0/3685582825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f6b580 0x5611a3f77090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 --2- 172.21.15.114:0/3685582825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f70b90 0x5611a3f84200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 -- 172.21.15.114:0/3685582825 >> 172.21.15.114:0/3685582825 conn(0x5611a3edf6d0 msgr2=0x5611a3f83af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 -- 172.21.15.114:0/3685582825 shutdown_connections 2023-10-18T14:03:52.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 -- 172.21.15.114:0/3685582825 wait complete. 2023-10-18T14:03:52.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 -- start start 2023-10-18T14:03:52.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 Processor -- start 2023-10-18T14:03:52.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f6b580 0x5611a3f744a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 0x5611a3f749e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f714b0 0x5611a3f74f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3fdcba0 con 0x5611a3f70b90 2023-10-18T14:03:52.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3fdcd10 con 0x5611a3f6b580 2023-10-18T14:03:52.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a3fdced0 con 0x5611a3f714b0 2023-10-18T14:03:52.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.041+0000 7efc39c64b80 10 client.0 _ll_register_callbacks cb 0x5611a3da4a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:52.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc26ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 0x5611a3f749e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc26ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 0x5611a3f749e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43798/0 (socket says 172.21.15.114:43798) 2023-10-18T14:03:52.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc26ffd700 1 -- 172.21.15.114:0/1441752896 learned_addr learned my addr 172.21.15.114:0/1441752896 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc277fe700 1 --2- 172.21.15.114:0/1441752896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f6b580 0x5611a3f744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc27fff700 1 --2- 172.21.15.114:0/1441752896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f714b0 0x5611a3f74f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc26ffd700 1 -- 172.21.15.114:0/1441752896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f714b0 msgr2=0x5611a3f74f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc26ffd700 1 --2- 172.21.15.114:0/1441752896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f714b0 0x5611a3f74f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc26ffd700 1 -- 172.21.15.114:0/1441752896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f6b580 msgr2=0x5611a3f744a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc26ffd700 1 --2- 172.21.15.114:0/1441752896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f6b580 0x5611a3f744a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc26ffd700 1 -- 172.21.15.114:0/1441752896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a3e7b3a0 con 0x5611a3f70b90 2023-10-18T14:03:52.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc26ffd700 1 --2- 172.21.15.114:0/1441752896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 0x5611a3f749e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00bf50 tx=0x7efc1c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc924e06a06edf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:52.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc06ffd700 1 -- 172.21.15.114:0/1441752896 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0135c0 con 0x5611a3f70b90 2023-10-18T14:03:52.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc06ffd700 1 -- 172.21.15.114:0/1441752896 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efc1c013720 con 0x5611a3f70b90 2023-10-18T14:03:52.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc39c64b80 1 -- 172.21.15.114:0/1441752896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc2009d920 con 0x5611a3f70b90 2023-10-18T14:03:52.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc06ffd700 1 -- 172.21.15.114:0/1441752896 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc1c0138e0 con 0x5611a3f70b90 2023-10-18T14:03:52.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc39c64b80 10 client.15477 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:52.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc39c64b80 1 -- 172.21.15.114:0/1441752896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5611a3d0f200 con 0x5611a3f70b90 2023-10-18T14:03:52.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.042+0000 7efc06ffd700 1 -- 172.21.15.114:0/1441752896 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc2009d920 con 0x5611a3f70b90 2023-10-18T14:03:52.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.043+0000 7efc06ffd700 1 -- 172.21.15.114:0/1441752896 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efc1c02d020 con 0x5611a3f70b90 2023-10-18T14:03:52.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.043+0000 7efc39c64b80 10 client.15477 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:52.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.043+0000 7efc39c64b80 10 client.15477 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-18T14:03:52.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.043+0000 7efc39c64b80 20 client.15477 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:52.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.043+0000 7efc39c64b80 1 --2- 172.21.15.114:0/1441752896 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x5611a3fe2200 0x5611a3fde660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.043+0000 7efc39c64b80 4 client.15477 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T14:03:52.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.043+0000 7efc39c64b80 1 -- 172.21.15.114:0/1441752896 --> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5611a3eb6e00 con 0x5611a3fe2200 2023-10-18T14:03:52.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.043+0000 7efc277fe700 1 --2- 172.21.15.114:0/1441752896 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x5611a3fe2200 0x5611a3fde660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.043+0000 7efc277fe700 1 --2- 172.21.15.114:0/1441752896 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x5611a3fe2200 0x5611a3fde660 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=29f710398eb8cb77 server_cookie=d177b57fce7e5e5a in_seq=0 out_seq=0 2023-10-18T14:03:52.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.043+0000 7efc06ffd700 10 client.15477 ms_handle_connect on v2:172.21.15.172:6834/2655563129 2023-10-18T14:03:52.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc06ffd700 1 -- 172.21.15.114:0/1441752896 <== mds.2 v2:172.21.15.172:6834/2655563129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5611a3eb6e00 con 0x5611a3fe2200 2023-10-18T14:03:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc06ffd700 10 client.15477 handle_command_reply: tid=0 2023-10-18T14:03:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc39c64b80 1 client.15477 shutdown 2023-10-18T14:03:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc39c64b80 1 -- 172.21.15.114:0/1441752896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 msgr2=0x5611a3f749e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc39c64b80 1 --2- 172.21.15.114:0/1441752896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 0x5611a3f749e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00bf50 tx=0x7efc1c0046d0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc39c64b80 1 -- 172.21.15.114:0/1441752896 shutdown_connections 2023-10-18T14:03:52.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc39c64b80 1 --2- 172.21.15.114:0/1441752896 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x5611a3fe2200 0x5611a3fde660 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc39c64b80 1 --2- 172.21.15.114:0/1441752896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611a3f714b0 0x5611a3f74f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc39c64b80 1 --2- 172.21.15.114:0/1441752896 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5611a3f6b580 0x5611a3f744a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc39c64b80 1 --2- 172.21.15.114:0/1441752896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5611a3f70b90 0x5611a3f749e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc06ffd700 0 client.15477 ms_handle_reset on v2:172.21.15.172:6834/2655563129 2023-10-18T14:03:52.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc39c64b80 1 -- 172.21.15.114:0/1441752896 >> 172.21.15.114:0/1441752896 conn(0x5611a3edf6d0 msgr2=0x5611a3f6e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc39c64b80 1 -- 172.21.15.114:0/1441752896 shutdown_connections 2023-10-18T14:03:52.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc39c64b80 1 -- 172.21.15.114:0/1441752896 wait complete. 2023-10-18T14:03:52.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc39c64b80 20 client.15477 trim_cache size 0 max 16384 2023-10-18T14:03:52.067 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:03:52.068 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T14:03:52.068 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 2, 2023-10-18T14:03:52.068 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 24583, 2023-10-18T14:03:52.068 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-10-18T14:03:52.068 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-10-18T14:03:52.068 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-10-18T14:03:52.069 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 75.175728837999998, 2023-10-18T14:03:52.069 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 26, 2023-10-18T14:03:52.069 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 85, 2023-10-18T14:03:52.069 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 83, 2023-10-18T14:03:52.069 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 98.107529370999998 2023-10-18T14:03:52.070 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:03:52.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc2da7b700 1 -- 172.21.15.114:0/2660606799 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efc100a1560 msgr2=0x7efc100a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc2da7b700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efc100a1560 0x7efc100a3a20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efc18006010 tx=0x7efc1801a040 comp rx=0 tx=0).stop 2023-10-18T14:03:52.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc2da7b700 1 -- 172.21.15.114:0/2660606799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc281066b0 msgr2=0x7efc28196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc2da7b700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc281066b0 0x7efc28196960 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7efc2000ada0 tx=0x7efc2000c330 comp rx=0 tx=0).stop 2023-10-18T14:03:52.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc2da7b700 1 -- 172.21.15.114:0/2660606799 shutdown_connections 2023-10-18T14:03:52.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc2da7b700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efc100a1560 0x7efc100a3a20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.044+0000 7efc2da7b700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc281066b0 0x7efc28196960 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.045+0000 7efc2da7b700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc281006a0 0x7efc2819c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.045+0000 7efc2da7b700 1 --2- 172.21.15.114:0/2660606799 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efc28101060 0x7efc2819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.045+0000 7efc2da7b700 1 -- 172.21.15.114:0/2660606799 >> 172.21.15.114:0/2660606799 conn(0x7efc280fc170 msgr2=0x7efc280fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.045+0000 7efc2da7b700 1 -- 172.21.15.114:0/2660606799 shutdown_connections 2023-10-18T14:03:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.045+0000 7efc2da7b700 1 -- 172.21.15.114:0/2660606799 wait complete. 2023-10-18T14:03:52.073 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-18T14:03:52.074 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:51 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2336485027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:52.075 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:51 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3927147119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:03:52.075 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:51 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2614369573' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:52.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.193+0000 7f076cf37700 1 -- 172.21.15.114:0/663019161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0768105640 msgr2=0x7f0768105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.193+0000 7f076cf37700 1 --2- 172.21.15.114:0/663019161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0768105640 0x7f0768105a20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0758009990 tx=0x7f0758009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.193+0000 7f076cf37700 1 -- 172.21.15.114:0/663019161 shutdown_connections 2023-10-18T14:03:52.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.193+0000 7f076cf37700 1 --2- 172.21.15.114:0/663019161 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f07680ffff0 0x7f076810c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.193+0000 7f076cf37700 1 --2- 172.21.15.114:0/663019161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0768105640 0x7f0768105a20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.193+0000 7f076cf37700 1 --2- 172.21.15.114:0/663019161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07680ff630 0x7f07680ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.193+0000 7f076cf37700 1 -- 172.21.15.114:0/663019161 >> 172.21.15.114:0/663019161 conn(0x7f07680fb120 msgr2=0x7f07680fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.193+0000 7f076cf37700 1 -- 172.21.15.114:0/663019161 shutdown_connections 2023-10-18T14:03:52.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.193+0000 7f076cf37700 1 -- 172.21.15.114:0/663019161 wait complete. 2023-10-18T14:03:52.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f076cf37700 1 Processor -- start 2023-10-18T14:03:52.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f076cf37700 1 -- start start 2023-10-18T14:03:52.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f076cf37700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f07680ff630 0x7f076819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f076cf37700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07680ffff0 0x7f076819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f076cf37700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0768105640 0x7f0768196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f076cf37700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07681970c0 con 0x7f0768105640 2023-10-18T14:03:52.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f076cf37700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0768197230 con 0x7f07680ff630 2023-10-18T14:03:52.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f076cf37700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07681973f0 con 0x7f07680ffff0 2023-10-18T14:03:52.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f0766d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0768105640 0x7f0768196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f0766d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0768105640 0x7f0768196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43814/0 (socket says 172.21.15.114:43814) 2023-10-18T14:03:52.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f0766d9d700 1 -- 172.21.15.114:0/4275337157 learned_addr learned my addr 172.21.15.114:0/4275337157 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f076659c700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f07680ff630 0x7f076819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f0765d9b700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07680ffff0 0x7f076819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f0766d9d700 1 -- 172.21.15.114:0/4275337157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07680ffff0 msgr2=0x7f076819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f0766d9d700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07680ffff0 0x7f076819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f0766d9d700 1 -- 172.21.15.114:0/4275337157 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f07680ff630 msgr2=0x7f076819c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f0766d9d700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f07680ff630 0x7f076819c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f0766d9d700 1 -- 172.21.15.114:0/4275337157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580095f0 con 0x7f0768105640 2023-10-18T14:03:52.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.194+0000 7f0765d9b700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07680ffff0 0x7f076819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:52.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.195+0000 7f0766d9d700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0768105640 0x7f0768196a60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0760007ee0 tx=0x7f076000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.195+0000 7f075f7fe700 1 -- 172.21.15.114:0/4275337157 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076000ddd0 con 0x7f0768105640 2023-10-18T14:03:52.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.195+0000 7f076cf37700 1 -- 172.21.15.114:0/4275337157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07681976d0 con 0x7f0768105640 2023-10-18T14:03:52.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.195+0000 7f075f7fe700 1 -- 172.21.15.114:0/4275337157 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f076000f040 con 0x7f0768105640 2023-10-18T14:03:52.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.195+0000 7f075f7fe700 1 -- 172.21.15.114:0/4275337157 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07600048e0 con 0x7f0768105640 2023-10-18T14:03:52.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.195+0000 7f076cf37700 1 -- 172.21.15.114:0/4275337157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07681a3920 con 0x7f0768105640 2023-10-18T14:03:52.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.197+0000 7f075f7fe700 1 -- 172.21.15.114:0/4275337157 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f0760003a00 con 0x7f0768105640 2023-10-18T14:03:52.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.197+0000 7f075f7fe700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f07540a1560 0x7f07540a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.197+0000 7f076659c700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f07540a1560 0x7f07540a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.197+0000 7f075f7fe700 1 -- 172.21.15.114:0/4275337157 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f07600cc800 con 0x7f0768105640 2023-10-18T14:03:52.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.198+0000 7f076659c700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f07540a1560 0x7f07540a3a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f075800b5c0 tx=0x7f0758005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.198+0000 7f0779120b80 1 Processor -- start 2023-10-18T14:03:52.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.198+0000 7f0779120b80 1 -- start start 2023-10-18T14:03:52.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f0779120b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 0x564eafce6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f0779120b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce74b0 0x564eafce1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f0779120b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce1580 0x564eafce1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f0779120b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eafc54690 con 0x564eafce6b90 2023-10-18T14:03:52.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f0779120b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eafc3ac10 con 0x564eafce74b0 2023-10-18T14:03:52.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f0779120b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eafc38530 con 0x564eafce1580 2023-10-18T14:03:52.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f076659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 0x564eafce6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f076659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 0x564eafce6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43818/0 (socket says 172.21.15.114:43818) 2023-10-18T14:03:52.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f076659c700 1 -- 172.21.15.114:0/1382900802 learned_addr learned my addr 172.21.15.114:0/1382900802 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f0765d9b700 1 --2- 172.21.15.114:0/1382900802 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce74b0 0x564eafce1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f0766d9d700 1 --2- 172.21.15.114:0/1382900802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce1580 0x564eafce1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f076659c700 1 -- 172.21.15.114:0/1382900802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce1580 msgr2=0x564eafce1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f076659c700 1 --2- 172.21.15.114:0/1382900802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce1580 0x564eafce1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f076659c700 1 -- 172.21.15.114:0/1382900802 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce74b0 msgr2=0x564eafce1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f076659c700 1 --2- 172.21.15.114:0/1382900802 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce74b0 0x564eafce1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f076659c700 1 -- 172.21.15.114:0/1382900802 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eafbf13a0 con 0x564eafce6b90 2023-10-18T14:03:52.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f0765d9b700 1 --2- 172.21.15.114:0/1382900802 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce74b0 0x564eafce1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:52.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f0766d9d700 1 --2- 172.21.15.114:0/1382900802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce1580 0x564eafce1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:52.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f076659c700 1 --2- 172.21.15.114:0/1382900802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 0x564eafce6f70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0758009990 tx=0x7f075801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857334bc074bc6c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f075cff9700 1 -- 172.21.15.114:0/1382900802 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758029070 con 0x564eafce6b90 2023-10-18T14:03:52.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f075cff9700 1 -- 172.21.15.114:0/1382900802 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f075801e040 con 0x564eafce6b90 2023-10-18T14:03:52.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.199+0000 7f075cff9700 1 -- 172.21.15.114:0/1382900802 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075800f920 con 0x564eafce6b90 2023-10-18T14:03:52.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.200+0000 7f0779120b80 1 -- 172.21.15.114:0/1382900802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 msgr2=0x564eafce6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.200+0000 7f0779120b80 1 --2- 172.21.15.114:0/1382900802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 0x564eafce6f70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0758009990 tx=0x7f075801f000 comp rx=0 tx=0).stop 2023-10-18T14:03:52.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.200+0000 7f0779120b80 1 -- 172.21.15.114:0/1382900802 shutdown_connections 2023-10-18T14:03:52.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.200+0000 7f0779120b80 1 --2- 172.21.15.114:0/1382900802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce1580 0x564eafce1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.200+0000 7f0779120b80 1 --2- 172.21.15.114:0/1382900802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 0x564eafce6f70 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.200+0000 7f0779120b80 1 --2- 172.21.15.114:0/1382900802 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce74b0 0x564eafce1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.200+0000 7f0779120b80 1 -- 172.21.15.114:0/1382900802 >> 172.21.15.114:0/1382900802 conn(0x564eafc556d0 msgr2=0x564eafcdbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.200+0000 7f0779120b80 1 -- 172.21.15.114:0/1382900802 shutdown_connections 2023-10-18T14:03:52.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.200+0000 7f0779120b80 1 -- 172.21.15.114:0/1382900802 wait complete. 2023-10-18T14:03:52.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0779120b80 1 -- start start 2023-10-18T14:03:52.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0779120b80 1 Processor -- start 2023-10-18T14:03:52.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0779120b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce1580 0x564eafced490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0779120b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 0x564eafcea780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0779120b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce74b0 0x564eafceaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0779120b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eafc33e20 con 0x564eafce6b90 2023-10-18T14:03:52.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0779120b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eafbd06c0 con 0x564eafce1580 2023-10-18T14:03:52.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0779120b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eafbd0360 con 0x564eafce74b0 2023-10-18T14:03:52.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0779120b80 10 client.0 _ll_register_callbacks cb 0x564eafb1aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:52.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0765d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 0x564eafcea780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0765d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 0x564eafcea780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43826/0 (socket says 172.21.15.114:43826) 2023-10-18T14:03:52.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0765d9b700 1 -- 172.21.15.114:0/1128176067 learned_addr learned my addr 172.21.15.114:0/1128176067 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f076659c700 1 --2- 172.21.15.114:0/1128176067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce1580 0x564eafced490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0765d9b700 1 -- 172.21.15.114:0/1128176067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce74b0 msgr2=0x564eafceaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0765d9b700 1 --2- 172.21.15.114:0/1128176067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce74b0 0x564eafceaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0765d9b700 1 -- 172.21.15.114:0/1128176067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce1580 msgr2=0x564eafced490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0765d9b700 1 --2- 172.21.15.114:0/1128176067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce1580 0x564eafced490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.201+0000 7f0765d9b700 1 -- 172.21.15.114:0/1128176067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076810ce00 con 0x564eafce6b90 2023-10-18T14:03:52.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f0765d9b700 1 --2- 172.21.15.114:0/1128176067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 0x564eafcea780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f075000e750 tx=0x7f075000eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa2836f7c3ec8f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f074dffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:52.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f074dffb700 1 -- 172.21.15.114:0/1128176067 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000f950 con 0x564eafce6b90 2023-10-18T14:03:52.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f074dffb700 1 -- 172.21.15.114:0/1128176067 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f075000fab0 con 0x564eafce6b90 2023-10-18T14:03:52.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f0779120b80 1 -- 172.21.15.114:0/1128176067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564eafc38ea0 con 0x564eafce6b90 2023-10-18T14:03:52.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f074dffb700 1 -- 172.21.15.114:0/1128176067 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f075000fc70 con 0x564eafce6b90 2023-10-18T14:03:52.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f0779120b80 10 client.15489 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:52.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f0779120b80 1 -- 172.21.15.114:0/1128176067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564eafa5ed90 con 0x564eafce6b90 2023-10-18T14:03:52.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f074dffb700 1 -- 172.21.15.114:0/1128176067 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564eafc38ea0 con 0x564eafce6b90 2023-10-18T14:03:52.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f074dffb700 1 -- 172.21.15.114:0/1128176067 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0750015340 con 0x564eafce6b90 2023-10-18T14:03:52.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f0779120b80 10 client.15489 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:52.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f0779120b80 10 client.15489 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-18T14:03:52.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f0779120b80 20 client.15489 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:52.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f0779120b80 1 --2- 172.21.15.114:0/1128176067 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x564eafcfaea0 0x564eafcf98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f0779120b80 4 client.15489 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:03:52.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.202+0000 7f0779120b80 1 -- 172.21.15.114:0/1128176067 --> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564eafcb0860 con 0x564eafcfaea0 2023-10-18T14:03:52.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.203+0000 7f076659c700 1 --2- 172.21.15.114:0/1128176067 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x564eafcfaea0 0x564eafcf98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.203+0000 7f074dffb700 10 client.15489 ms_handle_connect on v2:172.21.15.172:6836/1821444438 2023-10-18T14:03:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.203+0000 7f076659c700 1 --2- 172.21.15.114:0/1128176067 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x564eafcfaea0 0x564eafcf98c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=afd2c6c92ea912a4 server_cookie=d555df0b9bf8c724 in_seq=0 out_seq=0 2023-10-18T14:03:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f074dffb700 1 -- 172.21.15.114:0/1128176067 <== mds.1 v2:172.21.15.172:6836/1821444438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564eafcb0860 con 0x564eafcfaea0 2023-10-18T14:03:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f074dffb700 10 client.15489 handle_command_reply: tid=0 2023-10-18T14:03:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f0779120b80 1 client.15489 shutdown 2023-10-18T14:03:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f0779120b80 1 -- 172.21.15.114:0/1128176067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 msgr2=0x564eafcea780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f0779120b80 1 --2- 172.21.15.114:0/1128176067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 0x564eafcea780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f075000e750 tx=0x7f075000eb10 comp rx=0 tx=0).stop 2023-10-18T14:03:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f0779120b80 1 -- 172.21.15.114:0/1128176067 shutdown_connections 2023-10-18T14:03:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f0779120b80 1 --2- 172.21.15.114:0/1128176067 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x564eafcfaea0 0x564eafcf98c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f0779120b80 1 --2- 172.21.15.114:0/1128176067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce74b0 0x564eafceaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f0779120b80 1 --2- 172.21.15.114:0/1128176067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce1580 0x564eafced490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f0779120b80 1 --2- 172.21.15.114:0/1128176067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce6b90 0x564eafcea780 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f074dffb700 0 client.15489 ms_handle_reset on v2:172.21.15.172:6836/1821444438 2023-10-18T14:03:52.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f0779120b80 1 -- 172.21.15.114:0/1128176067 >> 172.21.15.114:0/1128176067 conn(0x564eafc556d0 msgr2=0x564eafce0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f0779120b80 1 -- 172.21.15.114:0/1128176067 shutdown_connections 2023-10-18T14:03:52.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f0779120b80 1 -- 172.21.15.114:0/1128176067 wait complete. 2023-10-18T14:03:52.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.204+0000 7f0779120b80 20 client.15489 trim_cache size 0 max 16384 2023-10-18T14:03:52.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.221+0000 7f0779120b80 1 Processor -- start 2023-10-18T14:03:52.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.221+0000 7f0779120b80 1 -- start start 2023-10-18T14:03:52.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0779120b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce1580 0x564eafcfa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0779120b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce6b90 0x564eafcea690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0779120b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 0x564eafd03810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0779120b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eafab48d0 con 0x564eafce74b0 2023-10-18T14:03:52.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0779120b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eafc350b0 con 0x564eafce1580 2023-10-18T14:03:52.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0779120b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eafc2ff10 con 0x564eafce6b90 2023-10-18T14:03:52.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0766d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 0x564eafd03810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0766d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 0x564eafd03810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43836/0 (socket says 172.21.15.114:43836) 2023-10-18T14:03:52.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0766d9d700 1 -- 172.21.15.114:0/2286272222 learned_addr learned my addr 172.21.15.114:0/2286272222 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0765d9b700 1 --2- 172.21.15.114:0/2286272222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce6b90 0x564eafcea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f076659c700 1 --2- 172.21.15.114:0/2286272222 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce1580 0x564eafcfa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0766d9d700 1 -- 172.21.15.114:0/2286272222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce6b90 msgr2=0x564eafcea690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0766d9d700 1 --2- 172.21.15.114:0/2286272222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce6b90 0x564eafcea690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0766d9d700 1 -- 172.21.15.114:0/2286272222 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce1580 msgr2=0x564eafcfa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0766d9d700 1 --2- 172.21.15.114:0/2286272222 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce1580 0x564eafcfa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0766d9d700 1 -- 172.21.15.114:0/2286272222 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eafa47c10 con 0x564eafce74b0 2023-10-18T14:03:52.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0765d9b700 1 --2- 172.21.15.114:0/2286272222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce6b90 0x564eafcea690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:52.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f076659c700 1 --2- 172.21.15.114:0/2286272222 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce1580 0x564eafcfa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:52.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f0766d9d700 1 --2- 172.21.15.114:0/2286272222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 0x564eafd03810 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0760096390 tx=0x7f0760099810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1644566867f8cc33 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f075d7fa700 1 -- 172.21.15.114:0/2286272222 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760099920 con 0x564eafce74b0 2023-10-18T14:03:52.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f075d7fa700 1 -- 172.21.15.114:0/2286272222 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f076009da70 con 0x564eafce74b0 2023-10-18T14:03:52.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.222+0000 7f075d7fa700 1 -- 172.21.15.114:0/2286272222 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07600b9070 con 0x564eafce74b0 2023-10-18T14:03:52.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 -- 172.21.15.114:0/2286272222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 msgr2=0x564eafd03810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 --2- 172.21.15.114:0/2286272222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 0x564eafd03810 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0760096390 tx=0x7f0760099810 comp rx=0 tx=0).stop 2023-10-18T14:03:52.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 -- 172.21.15.114:0/2286272222 shutdown_connections 2023-10-18T14:03:52.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 --2- 172.21.15.114:0/2286272222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 0x564eafd03810 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 --2- 172.21.15.114:0/2286272222 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce1580 0x564eafcfa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 --2- 172.21.15.114:0/2286272222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce6b90 0x564eafcea690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 -- 172.21.15.114:0/2286272222 >> 172.21.15.114:0/2286272222 conn(0x564eafc556d0 msgr2=0x564eafce4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 -- 172.21.15.114:0/2286272222 shutdown_connections 2023-10-18T14:03:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 -- 172.21.15.114:0/2286272222 wait complete. 2023-10-18T14:03:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 -- start start 2023-10-18T14:03:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 Processor -- start 2023-10-18T14:03:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce1580 0x564eafce7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce6b90 0x564eafce7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 0x564eafce8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eafd03d90 con 0x564eafce74b0 2023-10-18T14:03:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eafd4e890 con 0x564eafce6b90 2023-10-18T14:03:52.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eafd4e9d0 con 0x564eafce1580 2023-10-18T14:03:52.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.223+0000 7f0779120b80 10 client.0 _ll_register_callbacks cb 0x564eafb1aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:52.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f0766d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 0x564eafce8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f0766d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 0x564eafce8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43842/0 (socket says 172.21.15.114:43842) 2023-10-18T14:03:52.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f076659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce1580 0x564eafce7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f0766d9d700 1 -- 172.21.15.114:0/2902087978 learned_addr learned my addr 172.21.15.114:0/2902087978 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f0765d9b700 1 --2- 172.21.15.114:0/2902087978 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce6b90 0x564eafce7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f0766d9d700 1 -- 172.21.15.114:0/2902087978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce1580 msgr2=0x564eafce7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f0766d9d700 1 --2- 172.21.15.114:0/2902087978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce1580 0x564eafce7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f0766d9d700 1 -- 172.21.15.114:0/2902087978 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce6b90 msgr2=0x564eafce7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f0766d9d700 1 --2- 172.21.15.114:0/2902087978 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce6b90 0x564eafce7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f0766d9d700 1 -- 172.21.15.114:0/2902087978 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07681a3920 con 0x564eafce74b0 2023-10-18T14:03:52.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f0766d9d700 1 --2- 172.21.15.114:0/2902087978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 0x564eafce8310 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f07600ca190 tx=0x7f0760000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4f102d38246395 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f074dffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:52.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f074dffb700 1 -- 172.21.15.114:0/2902087978 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07600a1cb0 con 0x564eafce74b0 2023-10-18T14:03:52.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f0779120b80 1 -- 172.21.15.114:0/2902087978 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f075801e040 con 0x564eafce74b0 2023-10-18T14:03:52.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f074dffb700 1 -- 172.21.15.114:0/2902087978 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0760099920 con 0x564eafce74b0 2023-10-18T14:03:52.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f074dffb700 1 -- 172.21.15.114:0/2902087978 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07600ca360 con 0x564eafce74b0 2023-10-18T14:03:52.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f0779120b80 10 client.15495 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:52.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f0779120b80 1 -- 172.21.15.114:0/2902087978 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564eafa85200 con 0x564eafce74b0 2023-10-18T14:03:52.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.224+0000 7f074dffb700 1 -- 172.21.15.114:0/2902087978 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0760063020 con 0x564eafce74b0 2023-10-18T14:03:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.225+0000 7f074dffb700 1 -- 172.21.15.114:0/2902087978 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0760098e10 con 0x564eafce74b0 2023-10-18T14:03:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.225+0000 7f0779120b80 10 client.15495 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.225+0000 7f0779120b80 10 client.15495 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-18T14:03:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.225+0000 7f0779120b80 20 client.15495 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.225+0000 7f0779120b80 1 --2- 172.21.15.114:0/2902087978 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x564eafd539e0 0x564eafd4fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.225+0000 7f0779120b80 4 client.15495 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T14:03:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.225+0000 7f0779120b80 1 -- 172.21.15.114:0/2902087978 --> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564eafc2ce00 con 0x564eafd539e0 2023-10-18T14:03:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.225+0000 7f076659c700 1 --2- 172.21.15.114:0/2902087978 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x564eafd539e0 0x564eafd4fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.225+0000 7f074dffb700 10 client.15495 ms_handle_connect on v2:172.21.15.172:6836/1821444438 2023-10-18T14:03:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.225+0000 7f076659c700 1 --2- 172.21.15.114:0/2902087978 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x564eafd539e0 0x564eafd4fe80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=55436809a3ba4d4d server_cookie=8da7331f81804273 in_seq=0 out_seq=0 2023-10-18T14:03:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.225+0000 7f074dffb700 1 -- 172.21.15.114:0/2902087978 <== mds.1 v2:172.21.15.172:6836/1821444438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x564eafc2ce00 con 0x564eafd539e0 2023-10-18T14:03:52.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.225+0000 7f074dffb700 10 client.15495 handle_command_reply: tid=0 2023-10-18T14:03:52.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.225+0000 7f0779120b80 1 client.15495 shutdown 2023-10-18T14:03:52.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f0779120b80 1 -- 172.21.15.114:0/2902087978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 msgr2=0x564eafce8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f0779120b80 1 --2- 172.21.15.114:0/2902087978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 0x564eafce8310 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f07600ca190 tx=0x7f0760000f40 comp rx=0 tx=0).stop 2023-10-18T14:03:52.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f0779120b80 1 -- 172.21.15.114:0/2902087978 shutdown_connections 2023-10-18T14:03:52.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f0779120b80 1 --2- 172.21.15.114:0/2902087978 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564eafce74b0 0x564eafce8310 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f0779120b80 1 --2- 172.21.15.114:0/2902087978 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x564eafd539e0 0x564eafd4fe80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f0779120b80 1 --2- 172.21.15.114:0/2902087978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564eafce1580 0x564eafce7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f074dffb700 0 client.15495 ms_handle_reset on v2:172.21.15.172:6836/1821444438 2023-10-18T14:03:52.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f0779120b80 1 --2- 172.21.15.114:0/2902087978 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564eafce6b90 0x564eafce7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f0779120b80 1 -- 172.21.15.114:0/2902087978 >> 172.21.15.114:0/2902087978 conn(0x564eafc556d0 msgr2=0x564eafcd5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f0779120b80 1 -- 172.21.15.114:0/2902087978 shutdown_connections 2023-10-18T14:03:52.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f0779120b80 1 -- 172.21.15.114:0/2902087978 wait complete. 2023-10-18T14:03:52.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f0779120b80 20 client.15495 trim_cache size 0 max 16384 2023-10-18T14:03:52.252 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:03:52.252 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T14:03:52.252 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 1, 2023-10-18T14:03:52.252 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 24595, 2023-10-18T14:03:52.253 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-10-18T14:03:52.253 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-10-18T14:03:52.253 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-10-18T14:03:52.253 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 76.362396859, 2023-10-18T14:03:52.253 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 26, 2023-10-18T14:03:52.253 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 85, 2023-10-18T14:03:52.254 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 83, 2023-10-18T14:03:52.254 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 95.947616611000001 2023-10-18T14:03:52.254 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:03:52.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f076cf37700 1 -- 172.21.15.114:0/4275337157 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f07540a1560 msgr2=0x7f07540a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f076cf37700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f07540a1560 0x7f07540a3a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f075800b5c0 tx=0x7f0758005960 comp rx=0 tx=0).stop 2023-10-18T14:03:52.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f076cf37700 1 -- 172.21.15.114:0/4275337157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0768105640 msgr2=0x7f0768196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f076cf37700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0768105640 0x7f0768196a60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0760007ee0 tx=0x7f076000d3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f076cf37700 1 -- 172.21.15.114:0/4275337157 shutdown_connections 2023-10-18T14:03:52.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f076cf37700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f07540a1560 0x7f07540a3a20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f076cf37700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0768105640 0x7f0768196a60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f076cf37700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f07680ff630 0x7f076819c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f076cf37700 1 --2- 172.21.15.114:0/4275337157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07680ffff0 0x7f076819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f076cf37700 1 -- 172.21.15.114:0/4275337157 >> 172.21.15.114:0/4275337157 conn(0x7f07680fb120 msgr2=0x7f0768068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f076cf37700 1 -- 172.21.15.114:0/4275337157 shutdown_connections 2023-10-18T14:03:52.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.226+0000 7f076cf37700 1 -- 172.21.15.114:0/4275337157 wait complete. 2023-10-18T14:03:52.258 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-18T14:03:52.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.378+0000 7fd2ed782700 1 -- 172.21.15.114:0/4221943137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2e80ff600 msgr2=0x7fd2e80ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.378+0000 7fd2ed782700 1 --2- 172.21.15.114:0/4221943137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2e80ff600 0x7fd2e80ffa80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009990 tx=0x7fd2d8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.378+0000 7fd2ed782700 1 -- 172.21.15.114:0/4221943137 shutdown_connections 2023-10-18T14:03:52.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.378+0000 7fd2ed782700 1 --2- 172.21.15.114:0/4221943137 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2e80fffc0 0x7fd2e810c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.378+0000 7fd2ed782700 1 --2- 172.21.15.114:0/4221943137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e81056a0 0x7fd2e8105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.378+0000 7fd2ed782700 1 --2- 172.21.15.114:0/4221943137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2e80ff600 0x7fd2e80ffa80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.378+0000 7fd2ed782700 1 -- 172.21.15.114:0/4221943137 >> 172.21.15.114:0/4221943137 conn(0x7fd2e80fb130 msgr2=0x7fd2e80fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.378+0000 7fd2ed782700 1 -- 172.21.15.114:0/4221943137 shutdown_connections 2023-10-18T14:03:52.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.378+0000 7fd2ed782700 1 -- 172.21.15.114:0/4221943137 wait complete. 2023-10-18T14:03:52.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2ed782700 1 Processor -- start 2023-10-18T14:03:52.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2ed782700 1 -- start start 2023-10-18T14:03:52.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2ed782700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2e80ff600 0x7fd2e819b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2ed782700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2e80fffc0 0x7fd2e819bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2ed782700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e81056a0 0x7fd2e8195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2ed782700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8195eb0 con 0x7fd2e80fffc0 2023-10-18T14:03:52.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2ed782700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8196020 con 0x7fd2e80ff600 2023-10-18T14:03:52.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2ed782700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e81961e0 con 0x7fd2e81056a0 2023-10-18T14:03:52.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2e67fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2e80fffc0 0x7fd2e819bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2e67fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2e80fffc0 0x7fd2e819bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43854/0 (socket says 172.21.15.114:43854) 2023-10-18T14:03:52.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2e67fc700 1 -- 172.21.15.114:0/1918703404 learned_addr learned my addr 172.21.15.114:0/1918703404 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2e77fe700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e81056a0 0x7fd2e8195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2e67fc700 1 -- 172.21.15.114:0/1918703404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e81056a0 msgr2=0x7fd2e8195840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2e67fc700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e81056a0 0x7fd2e8195840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2e67fc700 1 -- 172.21.15.114:0/1918703404 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2e80ff600 msgr2=0x7fd2e819b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2e80ff600 0x7fd2e819b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2e67fc700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2e80ff600 0x7fd2e819b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.379+0000 7fd2e67fc700 1 -- 172.21.15.114:0/1918703404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d80095f0 con 0x7fd2e80fffc0 2023-10-18T14:03:52.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.380+0000 7fd2e67fc700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2e80fffc0 0x7fd2e819bc00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80098e0 tx=0x7fd2d800f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.380+0000 7fd2dffff700 1 -- 172.21.15.114:0/1918703404 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d801d070 con 0x7fd2e80fffc0 2023-10-18T14:03:52.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.380+0000 7fd2dffff700 1 -- 172.21.15.114:0/1918703404 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2d800fb90 con 0x7fd2e80fffc0 2023-10-18T14:03:52.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.380+0000 7fd2ed782700 1 -- 172.21.15.114:0/1918703404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e8196460 con 0x7fd2e80fffc0 2023-10-18T14:03:52.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.380+0000 7fd2dffff700 1 -- 172.21.15.114:0/1918703404 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8017650 con 0x7fd2e80fffc0 2023-10-18T14:03:52.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.380+0000 7fd2ed782700 1 -- 172.21.15.114:0/1918703404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e81a26b0 con 0x7fd2e80fffc0 2023-10-18T14:03:52.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.382+0000 7fd2dffff700 1 -- 172.21.15.114:0/1918703404 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fd2d800fd00 con 0x7fd2e80fffc0 2023-10-18T14:03:52.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.383+0000 7fd2dffff700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd2d40a1560 0x7fd2d40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.383+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd2d40a1560 0x7fd2d40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.383+0000 7fd2dffff700 1 -- 172.21.15.114:0/1918703404 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd2d80ce060 con 0x7fd2e80fffc0 2023-10-18T14:03:52.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.383+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd2d40a1560 0x7fd2d40a3a20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0005950 tx=0x7fd2d00058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2f996bb80 1 Processor -- start 2023-10-18T14:03:52.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2f996bb80 1 -- start start 2023-10-18T14:03:52.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2f996bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf61b90 0x564f0bf61f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2f996bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf624b0 0x564f0bf5c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2f996bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf5c580 0x564f0bf5ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2f996bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0becf690 con 0x564f0bf61b90 2023-10-18T14:03:52.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2f996bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0beb5c10 con 0x564f0bf5c580 2023-10-18T14:03:52.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2f996bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0beb3530 con 0x564f0bf624b0 2023-10-18T14:03:52.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2e6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf61b90 0x564f0bf61f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2e6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf61b90 0x564f0bf61f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43860/0 (socket says 172.21.15.114:43860) 2023-10-18T14:03:52.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/3411230007 learned_addr learned my addr 172.21.15.114:0/3411230007 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/3411230007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf624b0 msgr2=0x564f0bf5c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/3411230007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf624b0 0x564f0bf5c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/3411230007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf5c580 msgr2=0x564f0bf5ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2e77fe700 1 --2- 172.21.15.114:0/3411230007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf5c580 0x564f0bf5ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/3411230007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf5c580 0x564f0bf5ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.384+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/3411230007 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f0be6c3a0 con 0x564f0bf61b90 2023-10-18T14:03:52.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.385+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/3411230007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf61b90 0x564f0bf61f70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009740 tx=0x7fd2d0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477a9577e3ecec9b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.385+0000 7fd2dd7fa700 1 -- 172.21.15.114:0/3411230007 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0011b00 con 0x564f0bf61b90 2023-10-18T14:03:52.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.385+0000 7fd2dd7fa700 1 -- 172.21.15.114:0/3411230007 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2d0011c60 con 0x564f0bf61b90 2023-10-18T14:03:52.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.385+0000 7fd2dd7fa700 1 -- 172.21.15.114:0/3411230007 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0010630 con 0x564f0bf61b90 2023-10-18T14:03:52.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.385+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3411230007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf61b90 msgr2=0x564f0bf61f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.385+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3411230007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf61b90 0x564f0bf61f70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009740 tx=0x7fd2d0011000 comp rx=0 tx=0).stop 2023-10-18T14:03:52.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3411230007 shutdown_connections 2023-10-18T14:03:52.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3411230007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf5c580 0x564f0bf5ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3411230007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf61b90 0x564f0bf61f70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3411230007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf624b0 0x564f0bf5c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3411230007 >> 172.21.15.114:0/3411230007 conn(0x564f0bed06d0 msgr2=0x564f0bf56b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3411230007 shutdown_connections 2023-10-18T14:03:52.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3411230007 wait complete. 2023-10-18T14:03:52.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 -- start start 2023-10-18T14:03:52.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 Processor -- start 2023-10-18T14:03:52.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf5c580 0x564f0bf68e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf61b90 0x564f0bf69390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf624b0 0x564f0bf698d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0beaee20 con 0x564f0bf624b0 2023-10-18T14:03:52.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0be4b6c0 con 0x564f0bf61b90 2023-10-18T14:03:52.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0be4b360 con 0x564f0bf5c580 2023-10-18T14:03:52.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2f996bb80 10 client.0 _ll_register_callbacks cb 0x564f0bd95a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:52.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2e77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf624b0 0x564f0bf698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2e77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf624b0 0x564f0bf698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43870/0 (socket says 172.21.15.114:43870) 2023-10-18T14:03:52.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.386+0000 7fd2e77fe700 1 -- 172.21.15.114:0/3121016552 learned_addr learned my addr 172.21.15.114:0/3121016552 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/3121016552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf5c580 0x564f0bf68e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2e77fe700 1 -- 172.21.15.114:0/3121016552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf5c580 msgr2=0x564f0bf68e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2e77fe700 1 --2- 172.21.15.114:0/3121016552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf5c580 0x564f0bf68e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2e67fc700 1 --2- 172.21.15.114:0/3121016552 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf61b90 0x564f0bf69390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2e77fe700 1 -- 172.21.15.114:0/3121016552 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf61b90 msgr2=0x564f0bf69390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2e77fe700 1 --2- 172.21.15.114:0/3121016552 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf61b90 0x564f0bf69390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2e77fe700 1 -- 172.21.15.114:0/3121016552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d000e980 con 0x564f0bf624b0 2023-10-18T14:03:52.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2e77fe700 1 --2- 172.21.15.114:0/3121016552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf624b0 0x564f0bf698d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0007870 tx=0x7fd2e0007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca9dc00b4ae7a58 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2ce7fc700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:52.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2ce7fc700 1 -- 172.21.15.114:0/3121016552 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0003e10 con 0x564f0bf624b0 2023-10-18T14:03:52.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2ce7fc700 1 -- 172.21.15.114:0/3121016552 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd2e000f640 con 0x564f0bf624b0 2023-10-18T14:03:52.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3121016552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f0beb3ea0 con 0x564f0bf624b0 2023-10-18T14:03:52.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2ce7fc700 1 -- 172.21.15.114:0/3121016552 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2e000f800 con 0x564f0bf624b0 2023-10-18T14:03:52.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2f996bb80 10 client.15507 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:52.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3121016552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564f0bcd9d90 con 0x564f0bf624b0 2023-10-18T14:03:52.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2ce7fc700 1 -- 172.21.15.114:0/3121016552 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564f0beb3ea0 con 0x564f0bf624b0 2023-10-18T14:03:52.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2ce7fc700 1 -- 172.21.15.114:0/3121016552 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd2e00045c0 con 0x564f0bf624b0 2023-10-18T14:03:52.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2f996bb80 10 client.15507 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:52.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2f996bb80 10 client.15507 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-18T14:03:52.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2f996bb80 20 client.15507 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:52.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3121016552 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564f0bf78220 0x564f0bf76ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2f996bb80 4 client.15507 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:03:52.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.387+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3121016552 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f0bf2b860 con 0x564f0bf78220 2023-10-18T14:03:52.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.388+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/3121016552 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564f0bf78220 0x564f0bf76ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.388+0000 7fd2ce7fc700 10 client.15507 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:03:52.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.388+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/3121016552 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564f0bf78220 0x564f0bf76ce0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c38f2e474c150e9b server_cookie=dcc4f87b9c1abaca in_seq=0 out_seq=0 2023-10-18T14:03:52.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2ce7fc700 1 -- 172.21.15.114:0/3121016552 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564f0bf2b860 con 0x564f0bf78220 2023-10-18T14:03:52.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2ce7fc700 10 client.15507 handle_command_reply: tid=0 2023-10-18T14:03:52.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2f996bb80 1 client.15507 shutdown 2023-10-18T14:03:52.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3121016552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf624b0 msgr2=0x564f0bf698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3121016552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf624b0 0x564f0bf698d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0007870 tx=0x7fd2e0007c30 comp rx=0 tx=0).stop 2023-10-18T14:03:52.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3121016552 shutdown_connections 2023-10-18T14:03:52.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3121016552 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564f0bf78220 0x564f0bf76ce0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3121016552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf624b0 0x564f0bf698d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3121016552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf5c580 0x564f0bf68e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3121016552 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf61b90 0x564f0bf69390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2ce7fc700 0 client.15507 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:03:52.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3121016552 >> 172.21.15.114:0/3121016552 conn(0x564f0bed06d0 msgr2=0x564f0bf5b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3121016552 shutdown_connections 2023-10-18T14:03:52.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3121016552 wait complete. 2023-10-18T14:03:52.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.389+0000 7fd2f996bb80 20 client.15507 trim_cache size 0 max 16384 2023-10-18T14:03:52.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.406+0000 7fd2f996bb80 1 Processor -- start 2023-10-18T14:03:52.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.406+0000 7fd2f996bb80 1 -- start start 2023-10-18T14:03:52.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2f996bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 0x564f0bf611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2f996bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf61b90 0x564f0bf65120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2f996bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf624b0 0x564f0bf77360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2f996bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0bd2f8d0 con 0x564f0bf5c580 2023-10-18T14:03:52.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2f996bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0be66720 con 0x564f0bf624b0 2023-10-18T14:03:52.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2f996bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0beb00b0 con 0x564f0bf61b90 2023-10-18T14:03:52.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2e6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 0x564f0bf611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2e6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 0x564f0bf611c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43874/0 (socket says 172.21.15.114:43874) 2023-10-18T14:03:52.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/3711693724 learned_addr learned my addr 172.21.15.114:0/3711693724 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/3711693724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf61b90 msgr2=0x564f0bf65120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2e77fe700 1 --2- 172.21.15.114:0/3711693724 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf624b0 0x564f0bf77360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2e67fc700 1 --2- 172.21.15.114:0/3711693724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf61b90 0x564f0bf65120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/3711693724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf61b90 0x564f0bf65120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/3711693724 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf624b0 msgr2=0x564f0bf77360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/3711693724 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf624b0 0x564f0bf77360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/3711693724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f0bcc2c10 con 0x564f0bf5c580 2023-10-18T14:03:52.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2e67fc700 1 --2- 172.21.15.114:0/3711693724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf61b90 0x564f0bf65120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:52.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/3711693724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 0x564f0bf611c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd2d001edf0 tx=0x7fd2d001ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e2ae7432ce1e68 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2ddffb700 1 -- 172.21.15.114:0/3711693724 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00313a0 con 0x564f0bf5c580 2023-10-18T14:03:52.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2ddffb700 1 -- 172.21.15.114:0/3711693724 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2d0035070 con 0x564f0bf5c580 2023-10-18T14:03:52.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.407+0000 7fd2ddffb700 1 -- 172.21.15.114:0/3711693724 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0031db0 con 0x564f0bf5c580 2023-10-18T14:03:52.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.408+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3711693724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 msgr2=0x564f0bf611c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.408+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3711693724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 0x564f0bf611c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd2d001edf0 tx=0x7fd2d001ece0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.408+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3711693724 shutdown_connections 2023-10-18T14:03:52.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.408+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3711693724 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf624b0 0x564f0bf77360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.408+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3711693724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 0x564f0bf611c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.408+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/3711693724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf61b90 0x564f0bf65120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.408+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3711693724 >> 172.21.15.114:0/3711693724 conn(0x564f0bed06d0 msgr2=0x564f0bf5f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.408+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3711693724 shutdown_connections 2023-10-18T14:03:52.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.408+0000 7fd2f996bb80 1 -- 172.21.15.114:0/3711693724 wait complete. 2023-10-18T14:03:52.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.408+0000 7fd2f996bb80 1 -- start start 2023-10-18T14:03:52.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.408+0000 7fd2f996bb80 1 Processor -- start 2023-10-18T14:03:52.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2f996bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 0x564f0bf7d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2f996bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf61b90 0x564f0bf7d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2f996bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf624b0 0x564f0bf7de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2f996bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0bfcbcb0 con 0x564f0bf5c580 2023-10-18T14:03:52.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2f996bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0bfcbe20 con 0x564f0bf624b0 2023-10-18T14:03:52.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2f996bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0bfcbfe0 con 0x564f0bf61b90 2023-10-18T14:03:52.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2f996bb80 10 client.0 _ll_register_callbacks cb 0x564f0bd95a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:03:52.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2e6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 0x564f0bf7d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2e6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 0x564f0bf7d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43880/0 (socket says 172.21.15.114:43880) 2023-10-18T14:03:52.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/996556836 learned_addr learned my addr 172.21.15.114:0/996556836 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:52.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/996556836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf61b90 msgr2=0x564f0bf7d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/996556836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf61b90 0x564f0bf7d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/996556836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf624b0 msgr2=0x564f0bf7de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:03:52.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/996556836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf624b0 0x564f0bf7de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/996556836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f0be6c3a0 con 0x564f0bf5c580 2023-10-18T14:03:52.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/996556836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 0x564f0bf7d3e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd2d001edc0 tx=0x7fd2d0011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c7d1f6c03794a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:52.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2ce7fc700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:03:52.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2ce7fc700 1 -- 172.21.15.114:0/996556836 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0031a30 con 0x564f0bf5c580 2023-10-18T14:03:52.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2ce7fc700 1 -- 172.21.15.114:0/996556836 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd2d002e040 con 0x564f0bf5c580 2023-10-18T14:03:52.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.409+0000 7fd2f996bb80 1 -- 172.21.15.114:0/996556836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd2d0011c60 con 0x564f0bf5c580 2023-10-18T14:03:52.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.410+0000 7fd2ce7fc700 1 -- 172.21.15.114:0/996556836 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2d0031b90 con 0x564f0bf5c580 2023-10-18T14:03:52.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.410+0000 7fd2f996bb80 10 client.15513 fetch_fsmap learned FSMap version 26 2023-10-18T14:03:52.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.410+0000 7fd2f996bb80 1 -- 172.21.15.114:0/996556836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564f0bd00200 con 0x564f0bf5c580 2023-10-18T14:03:52.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.410+0000 7fd2ce7fc700 1 -- 172.21.15.114:0/996556836 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2d0011c60 con 0x564f0bf5c580 2023-10-18T14:03:52.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.410+0000 7fd2ce7fc700 1 -- 172.21.15.114:0/996556836 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd2d0005340 con 0x564f0bf5c580 2023-10-18T14:03:52.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.410+0000 7fd2f996bb80 10 client.15513 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:03:52.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.410+0000 7fd2f996bb80 10 client.15513 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-18T14:03:52.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.410+0000 7fd2f996bb80 20 client.15513 populate_metadata read hostname 'smithi114' 2023-10-18T14:03:52.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.410+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/996556836 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564f0bfd0e50 0x564f0bfcd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:52.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.410+0000 7fd2f996bb80 4 client.15513 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T14:03:52.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.410+0000 7fd2f996bb80 1 -- 172.21.15.114:0/996556836 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564f0bea7e00 con 0x564f0bfd0e50 2023-10-18T14:03:52.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.410+0000 7fd2e67fc700 1 --2- 172.21.15.114:0/996556836 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564f0bfd0e50 0x564f0bfcd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:52.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2ce7fc700 10 client.15513 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:03:52.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2e67fc700 1 --2- 172.21.15.114:0/996556836 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564f0bfd0e50 0x564f0bfcd200 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73bbd0a690114296 server_cookie=a4f4d76ff9074cc5 in_seq=0 out_seq=0 2023-10-18T14:03:52.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2ce7fc700 1 -- 172.21.15.114:0/996556836 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x564f0bea7e00 con 0x564f0bfd0e50 2023-10-18T14:03:52.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2ce7fc700 10 client.15513 handle_command_reply: tid=0 2023-10-18T14:03:52.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2f996bb80 1 client.15513 shutdown 2023-10-18T14:03:52.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2f996bb80 1 -- 172.21.15.114:0/996556836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 msgr2=0x564f0bf7d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/996556836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 0x564f0bf7d3e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd2d001edc0 tx=0x7fd2d0011b10 comp rx=0 tx=0).stop 2023-10-18T14:03:52.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2f996bb80 1 -- 172.21.15.114:0/996556836 shutdown_connections 2023-10-18T14:03:52.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/996556836 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564f0bfd0e50 0x564f0bfcd200 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/996556836 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564f0bf624b0 0x564f0bf7de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2ce7fc700 0 client.15513 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:03:52.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/996556836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564f0bf5c580 0x564f0bf7d3e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2f996bb80 1 --2- 172.21.15.114:0/996556836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f0bf61b90 0x564f0bf7d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2f996bb80 1 -- 172.21.15.114:0/996556836 >> 172.21.15.114:0/996556836 conn(0x564f0bed06d0 msgr2=0x564f0bf5fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2f996bb80 1 -- 172.21.15.114:0/996556836 shutdown_connections 2023-10-18T14:03:52.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2f996bb80 1 -- 172.21.15.114:0/996556836 wait complete. 2023-10-18T14:03:52.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.411+0000 7fd2f996bb80 20 client.15513 trim_cache size 0 max 16384 2023-10-18T14:03:52.434 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:03:52.434 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d734b050-6dbd-11ee-8db6-212e2dc638e7", 2023-10-18T14:03:52.434 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-10-18T14:03:52.435 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 24616, 2023-10-18T14:03:52.435 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-10-18T14:03:52.435 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-10-18T14:03:52.435 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-10-18T14:03:52.435 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 79.569342542000001, 2023-10-18T14:03:52.435 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 26, 2023-10-18T14:03:52.436 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 85, 2023-10-18T14:03:52.436 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 83, 2023-10-18T14:03:52.436 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 91.483927002000001 2023-10-18T14:03:52.436 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:03:52.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.412+0000 7fd2ed782700 1 -- 172.21.15.114:0/1918703404 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd2d40a1560 msgr2=0x7fd2d40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.412+0000 7fd2ed782700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd2d40a1560 0x7fd2d40a3a20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0005950 tx=0x7fd2d00058e0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.412+0000 7fd2ed782700 1 -- 172.21.15.114:0/1918703404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2e80fffc0 msgr2=0x7fd2e819bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:52.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.412+0000 7fd2ed782700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2e80fffc0 0x7fd2e819bc00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80098e0 tx=0x7fd2d800f720 comp rx=0 tx=0).stop 2023-10-18T14:03:52.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.412+0000 7fd2ed782700 1 -- 172.21.15.114:0/1918703404 shutdown_connections 2023-10-18T14:03:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.412+0000 7fd2ed782700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd2d40a1560 0x7fd2d40a3a20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.412+0000 7fd2ed782700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e81056a0 0x7fd2e8195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.412+0000 7fd2ed782700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2e80ff600 0x7fd2e819b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.412+0000 7fd2ed782700 1 --2- 172.21.15.114:0/1918703404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2e80fffc0 0x7fd2e819bc00 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.412+0000 7fd2ed782700 1 -- 172.21.15.114:0/1918703404 >> 172.21.15.114:0/1918703404 conn(0x7fd2e80fb130 msgr2=0x7fd2e80fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.412+0000 7fd2ed782700 1 -- 172.21.15.114:0/1918703404 shutdown_connections 2023-10-18T14:03:52.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:52.412+0000 7fd2ed782700 1 -- 172.21.15.114:0/1918703404 wait complete. 2023-10-18T14:03:52.440 INFO:teuthology.run_tasks:Running task kclient... 2023-10-18T14:03:52.462 INFO:tasks.kclient:Mounting kernel clients... 2023-10-18T14:03:52.463 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-18T14:03:52.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:52.464 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-10-18T14:03:52.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:52.481 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2023-10-18T14:03:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2023-10-18T14:03:52.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T14:03:52.551 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2023-10-18T14:03:52.551 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-18T14:03:52.552 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-18T14:03:52.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph fs ls 2023-10-18T14:03:52.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:52 smithi114 ceph-mon[99494]: pgmap v275: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-18T14:03:53.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:52 smithi158 ceph-mon[103317]: pgmap v275: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-18T14:03:53.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:52 smithi172 ceph-mon[103574]: pgmap v275: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-18T14:03:53.147 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:03:54.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.471+0000 7fd57dcb7700 1 -- 172.21.15.114:0/355509585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5781056b0 msgr2=0x7fd578105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:54.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.471+0000 7fd57dcb7700 1 --2- 172.21.15.114:0/355509585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5781056b0 0x7fd578105a90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd568009990 tx=0x7fd568009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:54.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.471+0000 7fd57dcb7700 1 -- 172.21.15.114:0/355509585 shutdown_connections 2023-10-18T14:03:54.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.471+0000 7fd57dcb7700 1 --2- 172.21.15.114:0/355509585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd578100110 0x7fd57810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:54.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.471+0000 7fd57dcb7700 1 --2- 172.21.15.114:0/355509585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5781056b0 0x7fd578105a90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:54.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.471+0000 7fd57dcb7700 1 --2- 172.21.15.114:0/355509585 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5780ff750 0x7fd5780ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:54.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.471+0000 7fd57dcb7700 1 -- 172.21.15.114:0/355509585 >> 172.21.15.114:0/355509585 conn(0x7fd578075790 msgr2=0x7fd578075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:54.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.471+0000 7fd57dcb7700 1 -- 172.21.15.114:0/355509585 shutdown_connections 2023-10-18T14:03:54.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.471+0000 7fd57dcb7700 1 -- 172.21.15.114:0/355509585 wait complete. 2023-10-18T14:03:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.471+0000 7fd57dcb7700 1 Processor -- start 2023-10-18T14:03:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.471+0000 7fd57dcb7700 1 -- start start 2023-10-18T14:03:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd57dcb7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5780ff750 0x7fd57819b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd57dcb7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd578100110 0x7fd57819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd57dcb7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5781056b0 0x7fd578195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd57dcb7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd578195f70 con 0x7fd5781056b0 2023-10-18T14:03:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd57dcb7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5781960e0 con 0x7fd5780ff750 2023-10-18T14:03:54.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd57dcb7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5781962a0 con 0x7fd578100110 2023-10-18T14:03:54.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd577fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5781056b0 0x7fd578195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:54.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd577fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5781056b0 0x7fd578195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43898/0 (socket says 172.21.15.114:43898) 2023-10-18T14:03:54.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd577fff700 1 -- 172.21.15.114:0/3256551746 learned_addr learned my addr 172.21.15.114:0/3256551746 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:54.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd5777fe700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5780ff750 0x7fd57819b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd576ffd700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd578100110 0x7fd57819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd577fff700 1 -- 172.21.15.114:0/3256551746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd578100110 msgr2=0x7fd57819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd577fff700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd578100110 0x7fd57819bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd577fff700 1 -- 172.21.15.114:0/3256551746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5780ff750 msgr2=0x7fd57819b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd577fff700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5780ff750 0x7fd57819b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd577fff700 1 -- 172.21.15.114:0/3256551746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680095f0 con 0x7fd5781056b0 2023-10-18T14:03:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd577fff700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5781056b0 0x7fd578195910 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd57000cfb0 tx=0x7fd57000e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd574ff9700 1 -- 172.21.15.114:0/3256551746 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570011070 con 0x7fd5781056b0 2023-10-18T14:03:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd57dcb7700 1 -- 172.21.15.114:0/3256551746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd578196580 con 0x7fd5781056b0 2023-10-18T14:03:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd574ff9700 1 -- 172.21.15.114:0/3256551746 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd570007b30 con 0x7fd5781056b0 2023-10-18T14:03:54.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd574ff9700 1 -- 172.21.15.114:0/3256551746 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57000adf0 con 0x7fd5781056b0 2023-10-18T14:03:54.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.472+0000 7fd57dcb7700 1 -- 172.21.15.114:0/3256551746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd578068360 con 0x7fd5781056b0 2023-10-18T14:03:54.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.473+0000 7fd57dcb7700 1 -- 172.21.15.114:0/3256551746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd578100df0 con 0x7fd5781056b0 2023-10-18T14:03:54.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.474+0000 7fd574ff9700 1 -- 172.21.15.114:0/3256551746 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fd57000c2e0 con 0x7fd5781056b0 2023-10-18T14:03:54.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.475+0000 7fd574ff9700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd5600a1560 0x7fd5600a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:54.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.475+0000 7fd5777fe700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd5600a1560 0x7fd5600a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:54.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.475+0000 7fd574ff9700 1 -- 172.21.15.114:0/3256551746 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd5700cf100 con 0x7fd5781056b0 2023-10-18T14:03:54.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.475+0000 7fd5777fe700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd5600a1560 0x7fd5600a3a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd568005850 tx=0x7fd56801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:54.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.479+0000 7fd574ff9700 1 -- 172.21.15.114:0/3256551746 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd570098500 con 0x7fd5781056b0 2023-10-18T14:03:54.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:54 smithi172 ceph-mon[103574]: pgmap v276: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:54.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:54 smithi114 ceph-mon[99494]: pgmap v276: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:54.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.712+0000 7fd57dcb7700 1 -- 172.21.15.114:0/3256551746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd57804e4c0 con 0x7fd5781056b0 2023-10-18T14:03:54.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.712+0000 7fd574ff9700 1 -- 172.21.15.114:0/3256551746 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd57009bb20 con 0x7fd5781056b0 2023-10-18T14:03:54.717 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-18T14:03:54.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.714+0000 7fd57dcb7700 1 -- 172.21.15.114:0/3256551746 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd5600a1560 msgr2=0x7fd5600a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:54.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.714+0000 7fd57dcb7700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd5600a1560 0x7fd5600a3a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd568005850 tx=0x7fd56801a040 comp rx=0 tx=0).stop 2023-10-18T14:03:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.714+0000 7fd57dcb7700 1 -- 172.21.15.114:0/3256551746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5781056b0 msgr2=0x7fd578195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.714+0000 7fd57dcb7700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5781056b0 0x7fd578195910 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd57000cfb0 tx=0x7fd57000e330 comp rx=0 tx=0).stop 2023-10-18T14:03:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.714+0000 7fd57dcb7700 1 -- 172.21.15.114:0/3256551746 shutdown_connections 2023-10-18T14:03:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.714+0000 7fd57dcb7700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd5600a1560 0x7fd5600a3a20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.714+0000 7fd57dcb7700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5781056b0 0x7fd578195910 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:54.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.714+0000 7fd57dcb7700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5780ff750 0x7fd57819b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:54.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.714+0000 7fd57dcb7700 1 --2- 172.21.15.114:0/3256551746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd578100110 0x7fd57819bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:54.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.714+0000 7fd57dcb7700 1 -- 172.21.15.114:0/3256551746 >> 172.21.15.114:0/3256551746 conn(0x7fd578075790 msgr2=0x7fd5780fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:54.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.715+0000 7fd57dcb7700 1 -- 172.21.15.114:0/3256551746 shutdown_connections 2023-10-18T14:03:54.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:54.715+0000 7fd57dcb7700 1 -- 172.21.15.114:0/3256551746 wait complete. 2023-10-18T14:03:54.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:54 smithi158 ceph-mon[103317]: pgmap v276: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:03:55.094 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-18T14:03:55.095 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T14:03:55.095 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-10-18T14:03:55.095 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-18T14:03:55.095 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-18T14:03:55.096 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-18T14:03:55.096 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-18T14:03:55.096 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T14:03:55.096 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-18T14:03:55.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:55.097 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-10-18T14:03:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T14:03:55.115 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T14:03:55.115 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T14:03:55.116 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T14:03:55.116 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-10-18T14:03:55.116 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T14:03:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T14:03:55.116 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-10-18T14:03:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T14:03:55.117 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-10-18T14:03:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T14:03:55.117 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-10-18T14:03:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T14:03:55.117 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-10-18T14:03:55.118 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-18T14:03:55.118 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 41809sec preferred_lft 41809sec 2023-10-18T14:03:55.118 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c9aa:5699:aa3d:ecf4/64 scope link noprefixroute 2023-10-18T14:03:55.118 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T14:03:55.119 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-18T14:03:55.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:55.119 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T14:03:55.119 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T14:03:55.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2023-10-18T14:03:55.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2023-10-18T14:03:55.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2023-10-18T14:03:55.121 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-18T14:03:55.121 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T14:03:55.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:55.277 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T14:03:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-10-18T14:03:55.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:55.306 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-10-18T14:03:55.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:55 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3256551746' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-18T14:03:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-10-18T14:03:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T14:03:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-18T14:03:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-18T14:03:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T14:03:55.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:55.366 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T14:03:55.366 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T14:03:55.366 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-18T14:03:55.367 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-18T14:03:55.367 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-18T14:03:55.367 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T14:03:55.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:55 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3256551746' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-18T14:03:55.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:55.675 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-10-18T14:03:55.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:55.692 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2023-10-18T14:03:55.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:55.748 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T14:03:55.749 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T14:03:55.749 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-18T14:03:55.749 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-18T14:03:55.750 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T14:03:55.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:55 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3256551746' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-18T14:03:55.843 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-18T14:03:55.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:55.844 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T14:03:55.844 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T14:03:55.844 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-18T14:03:55.845 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-18T14:03:55.845 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-18T14:03:55.845 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-18T14:03:55.845 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-18T14:03:55.846 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T14:03:56.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:56.057 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T14:03:56.057 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T14:03:56.058 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-10-18T14:03:56.058 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2023-10-18T14:03:56.058 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T14:03:56.156 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T14:03:56.157 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-18T14:03:56.173 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-18T14:03:56.174 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T14:03:56.174 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-18T14:03:56.230 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-10-18T14:03:56.230 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-10-18T14:03:56.231 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c 2023-10-18T14:03:56.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:56.231 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,nowsync 2023-10-18T14:03:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,nowsync 2023-10-18T14:03:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,nowsync". 2023-10-18T14:03:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T14:03:56.359 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:56 smithi114 ceph-mon[99494]: pgmap v277: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-18T14:03:56.451 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,nowsync 2023-10-18T14:03:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,nowsync". 2023-10-18T14:03:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T14:03:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.158:3300,172.21.15.172:3300" 2023-10-18T14:03:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:3300,172.21.15.158:3300,172.21.15.172:3300:/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c 2023-10-18T14:03:56.453 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,nowsync,key=0,fsid=d734b050-6dbd-11ee-8db6-212e2dc638e7" will pass to kernel 2023-10-18T14:03:56.455 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-18T14:03:56.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:56.456 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-18T14:03:56.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:56.510 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T14:03:56.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:56 smithi172 ceph-mon[103574]: pgmap v277: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-18T14:03:56.567 INFO:teuthology.orchestra.run.smithi114.stdout:client25030 2023-10-18T14:03:56.568 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T14:03:56.568 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T14:03:56.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:56.586 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T14:03:56.683 INFO:teuthology.orchestra.run.smithi114.stdout:client25030 2023-10-18T14:03:56.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:56.684 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T14:03:56.737 INFO:teuthology.orchestra.run.smithi114.stdout:client25030 2023-10-18T14:03:56.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:03:56.738 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7.client25030/status') 2023-10-18T14:03:56.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:56 smithi158 ceph-mon[103317]: pgmap v277: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-18T14:03:56.794 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.25030 (3)172.21.15.114:0/3509350751 2023-10-18T14:03:56.795 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2023-10-18T14:03:56.795 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2023-10-18T14:03:56.795 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2023-10-18T14:03:56.795 INFO:teuthology.orchestra.run.smithi114.stderr:72 bytes copied, 3.9465e-05 s, 1.8 MB/s 2023-10-18T14:03:56.796 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-18T14:03:56.806 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-18T14:03:56.843 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:03:56.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.963+0000 7fa181b44700 1 -- 172.21.15.114:0/2838861789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17c068d70 msgr2=0x7fa17c0691f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:56.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.963+0000 7fa181b44700 1 --2- 172.21.15.114:0/2838861789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17c068d70 0x7fa17c0691f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa164009990 tx=0x7fa164009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:56.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.963+0000 7fa181b44700 1 -- 172.21.15.114:0/2838861789 shutdown_connections 2023-10-18T14:03:56.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.963+0000 7fa181b44700 1 --2- 172.21.15.114:0/2838861789 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa17c069730 0x7fa17c10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:56.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.963+0000 7fa181b44700 1 --2- 172.21.15.114:0/2838861789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa17c106720 0x7fa17c106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:56.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.963+0000 7fa181b44700 1 --2- 172.21.15.114:0/2838861789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17c068d70 0x7fa17c0691f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:56.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.963+0000 7fa181b44700 1 -- 172.21.15.114:0/2838861789 >> 172.21.15.114:0/2838861789 conn(0x7fa17c0767e0 msgr2=0x7fa17c076bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:56.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.963+0000 7fa181b44700 1 -- 172.21.15.114:0/2838861789 shutdown_connections 2023-10-18T14:03:56.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.964+0000 7fa181b44700 1 -- 172.21.15.114:0/2838861789 wait complete. 2023-10-18T14:03:56.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.964+0000 7fa181b44700 1 Processor -- start 2023-10-18T14:03:56.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.964+0000 7fa181b44700 1 -- start start 2023-10-18T14:03:56.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.964+0000 7fa181b44700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa17c068d70 0x7fa17c198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:56.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.964+0000 7fa181b44700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17c069730 0x7fa17c199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:56.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.964+0000 7fa181b44700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa17c106720 0x7fa17c19d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:56.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.964+0000 7fa181b44700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c19de40 con 0x7fa17c069730 2023-10-18T14:03:56.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.964+0000 7fa181b44700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c19dfb0 con 0x7fa17c068d70 2023-10-18T14:03:56.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.964+0000 7fa181b44700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c19e170 con 0x7fa17c106720 2023-10-18T14:03:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa17affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17c069730 0x7fa17c199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa17affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17c069730 0x7fa17c199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43926/0 (socket says 172.21.15.114:43926) 2023-10-18T14:03:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa17affd700 1 -- 172.21.15.114:0/1025847515 learned_addr learned my addr 172.21.15.114:0/1025847515 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa17b7fe700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa17c068d70 0x7fa17c198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa17bfff700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa17c106720 0x7fa17c19d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa17affd700 1 -- 172.21.15.114:0/1025847515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa17c106720 msgr2=0x7fa17c19d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa17affd700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa17c106720 0x7fa17c19d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa17affd700 1 -- 172.21.15.114:0/1025847515 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa17c068d70 msgr2=0x7fa17c198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa17affd700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa17c068d70 0x7fa17c198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa17affd700 1 -- 172.21.15.114:0/1025847515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1640095f0 con 0x7fa17c069730 2023-10-18T14:03:56.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa17affd700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17c069730 0x7fa17c199460 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa1640095c0 tx=0x7fa16400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:56.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa178ff9700 1 -- 172.21.15.114:0/1025847515 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16401d070 con 0x7fa17c069730 2023-10-18T14:03:56.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa181b44700 1 -- 172.21.15.114:0/1025847515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17c19e3f0 con 0x7fa17c069730 2023-10-18T14:03:56.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa178ff9700 1 -- 172.21.15.114:0/1025847515 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa164005050 con 0x7fa17c069730 2023-10-18T14:03:56.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa178ff9700 1 -- 172.21.15.114:0/1025847515 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164004a70 con 0x7fa17c069730 2023-10-18T14:03:56.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.965+0000 7fa181b44700 1 -- 172.21.15.114:0/1025847515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17c1a5c90 con 0x7fa17c069730 2023-10-18T14:03:56.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.966+0000 7fa181b44700 1 -- 172.21.15.114:0/1025847515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17c101e40 con 0x7fa17c069730 2023-10-18T14:03:56.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.967+0000 7fa178ff9700 1 -- 172.21.15.114:0/1025847515 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fa1640051c0 con 0x7fa17c069730 2023-10-18T14:03:56.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.968+0000 7fa178ff9700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa1680a1560 0x7fa1680a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:56.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.968+0000 7fa17b7fe700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa1680a1560 0x7fa1680a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:56.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.968+0000 7fa178ff9700 1 -- 172.21.15.114:0/1025847515 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa1640ce140 con 0x7fa17c069730 2023-10-18T14:03:56.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.968+0000 7fa17b7fe700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa1680a1560 0x7fa1680a3a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa16c005950 tx=0x7fa16c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:56.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:56.971+0000 7fa178ff9700 1 -- 172.21.15.114:0/1025847515 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa1640975d0 con 0x7fa17c069730 2023-10-18T14:03:57.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.165+0000 7fa181b44700 1 -- 172.21.15.114:0/1025847515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa17c067980 con 0x7fa17c069730 2023-10-18T14:03:57.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.167+0000 7fa178ff9700 1 -- 172.21.15.114:0/1025847515 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22907 (secure 0 0 0) 0x7fa16409abf0 con 0x7fa17c069730 2023-10-18T14:03:57.171 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:57.172 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":85,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:03:08.625359+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:03:57.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.169+0000 7fa181b44700 1 -- 172.21.15.114:0/1025847515 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa1680a1560 msgr2=0x7fa1680a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.169+0000 7fa181b44700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa1680a1560 0x7fa1680a3a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa16c005950 tx=0x7fa16c00b410 comp rx=0 tx=0).stop 2023-10-18T14:03:57.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.169+0000 7fa181b44700 1 -- 172.21.15.114:0/1025847515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17c069730 msgr2=0x7fa17c199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.169+0000 7fa181b44700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17c069730 0x7fa17c199460 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa1640095c0 tx=0x7fa16400f690 comp rx=0 tx=0).stop 2023-10-18T14:03:57.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.169+0000 7fa181b44700 1 -- 172.21.15.114:0/1025847515 shutdown_connections 2023-10-18T14:03:57.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.169+0000 7fa181b44700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa1680a1560 0x7fa1680a3a20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.169+0000 7fa181b44700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa17c106720 0x7fa17c19d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.169+0000 7fa181b44700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa17c068d70 0x7fa17c198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.169+0000 7fa181b44700 1 --2- 172.21.15.114:0/1025847515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17c069730 0x7fa17c199460 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.169+0000 7fa181b44700 1 -- 172.21.15.114:0/1025847515 >> 172.21.15.114:0/1025847515 conn(0x7fa17c0767e0 msgr2=0x7fa17c10b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:57.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.169+0000 7fa181b44700 1 -- 172.21.15.114:0/1025847515 shutdown_connections 2023-10-18T14:03:57.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.169+0000 7fa181b44700 1 -- 172.21.15.114:0/1025847515 wait complete. 2023-10-18T14:03:57.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T13:58:43.813590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T14:02:30.693853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T14:02:31.426625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T14:03:57.186 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T14:03:57.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.309+0000 7fb2461c0700 1 -- 172.21.15.114:0/746386546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb240101940 msgr2=0x7fb240101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.309+0000 7fb2461c0700 1 --2- 172.21.15.114:0/746386546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb240101940 0x7fb240101d20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb230009990 tx=0x7fb230009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.309+0000 7fb2461c0700 1 -- 172.21.15.114:0/746386546 shutdown_connections 2023-10-18T14:03:57.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.309+0000 7fb2461c0700 1 --2- 172.21.15.114:0/746386546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb240106e00 0x7fb24010d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.309+0000 7fb2461c0700 1 --2- 172.21.15.114:0/746386546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb240101940 0x7fb240101d20 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.309+0000 7fb2461c0700 1 --2- 172.21.15.114:0/746386546 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb2401022f0 0x7fb240106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.309+0000 7fb2461c0700 1 -- 172.21.15.114:0/746386546 >> 172.21.15.114:0/746386546 conn(0x7fb2400fb0a0 msgr2=0x7fb2400fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:57.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.309+0000 7fb2461c0700 1 -- 172.21.15.114:0/746386546 shutdown_connections 2023-10-18T14:03:57.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.309+0000 7fb2461c0700 1 -- 172.21.15.114:0/746386546 wait complete. 2023-10-18T14:03:57.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.310+0000 7fb2461c0700 1 Processor -- start 2023-10-18T14:03:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.310+0000 7fb2461c0700 1 -- start start 2023-10-18T14:03:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.310+0000 7fb2461c0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb240101940 0x7fb24019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.310+0000 7fb2461c0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb240106e00 0x7fb24019cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.310+0000 7fb2461c0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb240196b10 0x7fb240196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.310+0000 7fb2461c0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb240197590 con 0x7fb240196b10 2023-10-18T14:03:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.310+0000 7fb2461c0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb240197700 con 0x7fb240101940 2023-10-18T14:03:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.310+0000 7fb2461c0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2401978c0 con 0x7fb240106e00 2023-10-18T14:03:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.310+0000 7fb23ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb240196b10 0x7fb240196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.310+0000 7fb23ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb240196b10 0x7fb240196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43942/0 (socket says 172.21.15.114:43942) 2023-10-18T14:03:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.310+0000 7fb23ffff700 1 -- 172.21.15.114:0/131334411 learned_addr learned my addr 172.21.15.114:0/131334411 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.310+0000 7fb23effd700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb240106e00 0x7fb24019cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.311+0000 7fb23f7fe700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb240101940 0x7fb24019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:57.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.311+0000 7fb23ffff700 1 -- 172.21.15.114:0/131334411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb240106e00 msgr2=0x7fb24019cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.311+0000 7fb23ffff700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb240106e00 0x7fb24019cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.311+0000 7fb23ffff700 1 -- 172.21.15.114:0/131334411 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb240101940 msgr2=0x7fb24019c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.311+0000 7fb23ffff700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb240101940 0x7fb24019c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.311+0000 7fb23ffff700 1 -- 172.21.15.114:0/131334411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2300095f0 con 0x7fb240196b10 2023-10-18T14:03:57.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.311+0000 7fb23f7fe700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb240101940 0x7fb24019c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:57.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.311+0000 7fb23ffff700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb240196b10 0x7fb240196fc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb238007ee0 tx=0x7fb23800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:57.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.311+0000 7fb23cff9700 1 -- 172.21.15.114:0/131334411 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238017070 con 0x7fb240196b10 2023-10-18T14:03:57.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.311+0000 7fb2461c0700 1 -- 172.21.15.114:0/131334411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2401a38b0 con 0x7fb240196b10 2023-10-18T14:03:57.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.311+0000 7fb23cff9700 1 -- 172.21.15.114:0/131334411 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb23800f040 con 0x7fb240196b10 2023-10-18T14:03:57.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.311+0000 7fb23cff9700 1 -- 172.21.15.114:0/131334411 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238005740 con 0x7fb240196b10 2023-10-18T14:03:57.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.311+0000 7fb2461c0700 1 -- 172.21.15.114:0/131334411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2401a3d90 con 0x7fb240196b10 2023-10-18T14:03:57.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.312+0000 7fb2461c0700 1 -- 172.21.15.114:0/131334411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb240108ea0 con 0x7fb240196b10 2023-10-18T14:03:57.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.313+0000 7fb23cff9700 1 -- 172.21.15.114:0/131334411 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fb23800dc60 con 0x7fb240196b10 2023-10-18T14:03:57.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.314+0000 7fb23cff9700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb22c0a1560 0x7fb22c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:57.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.314+0000 7fb23f7fe700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb22c0a1560 0x7fb22c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:57.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.314+0000 7fb23cff9700 1 -- 172.21.15.114:0/131334411 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb2380ccd90 con 0x7fb240196b10 2023-10-18T14:03:57.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.314+0000 7fb23f7fe700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb22c0a1560 0x7fb22c0a3a20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb230006010 tx=0x7fb23001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:57.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.317+0000 7fb23cff9700 1 -- 172.21.15.114:0/131334411 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb2380961f0 con 0x7fb240196b10 2023-10-18T14:03:57.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.509+0000 7fb2461c0700 1 -- 172.21.15.114:0/131334411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb240197fd0 con 0x7fb240196b10 2023-10-18T14:03:57.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.509+0000 7fb23cff9700 1 -- 172.21.15.114:0/131334411 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb238099810 con 0x7fb240196b10 2023-10-18T14:03:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T14:03:57.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.511+0000 7fb2461c0700 1 -- 172.21.15.114:0/131334411 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb22c0a1560 msgr2=0x7fb22c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.511+0000 7fb2461c0700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb22c0a1560 0x7fb22c0a3a20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb230006010 tx=0x7fb23001a040 comp rx=0 tx=0).stop 2023-10-18T14:03:57.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.511+0000 7fb2461c0700 1 -- 172.21.15.114:0/131334411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb240196b10 msgr2=0x7fb240196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.511+0000 7fb2461c0700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb240196b10 0x7fb240196fc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb238007ee0 tx=0x7fb23800d3b0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.511+0000 7fb2461c0700 1 -- 172.21.15.114:0/131334411 shutdown_connections 2023-10-18T14:03:57.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.511+0000 7fb2461c0700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb22c0a1560 0x7fb22c0a3a20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.511+0000 7fb2461c0700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb240196b10 0x7fb240196fc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.511+0000 7fb2461c0700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb240101940 0x7fb24019c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.511+0000 7fb2461c0700 1 --2- 172.21.15.114:0/131334411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb240106e00 0x7fb24019cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.511+0000 7fb2461c0700 1 -- 172.21.15.114:0/131334411 >> 172.21.15.114:0/131334411 conn(0x7fb2400fb0a0 msgr2=0x7fb2401049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:57.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.511+0000 7fb2461c0700 1 -- 172.21.15.114:0/131334411 shutdown_connections 2023-10-18T14:03:57.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.511+0000 7fb2461c0700 1 -- 172.21.15.114:0/131334411 wait complete. 2023-10-18T14:03:57.526 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:57 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1025847515' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:57.527 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T14:03:57.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:57 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1025847515' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:57.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.648+0000 7fd798799700 1 -- 172.21.15.114:0/2066522252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7901011e0 msgr2=0x7fd790101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.648+0000 7fd798799700 1 --2- 172.21.15.114:0/2066522252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7901011e0 0x7fd790101660 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd784009990 tx=0x7fd784009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.648+0000 7fd798799700 1 -- 172.21.15.114:0/2066522252 shutdown_connections 2023-10-18T14:03:57.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.648+0000 7fd798799700 1 --2- 172.21.15.114:0/2066522252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd790101ba0 0x7fd79010c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.648+0000 7fd798799700 1 --2- 172.21.15.114:0/2066522252 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd7900ff9d0 0x7fd7900ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.648+0000 7fd798799700 1 --2- 172.21.15.114:0/2066522252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7901011e0 0x7fd790101660 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.648+0000 7fd798799700 1 -- 172.21.15.114:0/2066522252 >> 172.21.15.114:0/2066522252 conn(0x7fd7900fb0a0 msgr2=0x7fd7900fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:57.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.649+0000 7fd798799700 1 -- 172.21.15.114:0/2066522252 shutdown_connections 2023-10-18T14:03:57.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.649+0000 7fd798799700 1 -- 172.21.15.114:0/2066522252 wait complete. 2023-10-18T14:03:57.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.649+0000 7fd798799700 1 Processor -- start 2023-10-18T14:03:57.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.649+0000 7fd798799700 1 -- start start 2023-10-18T14:03:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.649+0000 7fd798799700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7900ff9d0 0x7fd790197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.649+0000 7fd798799700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd7901011e0 0x7fd790197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.649+0000 7fd798799700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd790101ba0 0x7fd7901a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.649+0000 7fd798799700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7901988b0 con 0x7fd790101ba0 2023-10-18T14:03:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.649+0000 7fd798799700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7901a3070 con 0x7fd7901011e0 2023-10-18T14:03:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.649+0000 7fd798799700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7901a31b0 con 0x7fd7900ff9d0 2023-10-18T14:03:57.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.649+0000 7fd796d36700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd790101ba0 0x7fd7901a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:57.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.649+0000 7fd796d36700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd790101ba0 0x7fd7901a2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43956/0 (socket says 172.21.15.114:43956) 2023-10-18T14:03:57.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.649+0000 7fd796d36700 1 -- 172.21.15.114:0/3198918332 learned_addr learned my addr 172.21.15.114:0/3198918332 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:57.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.650+0000 7fd796535700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7900ff9d0 0x7fd790197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:57.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.650+0000 7fd795d34700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd7901011e0 0x7fd790197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:57.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.650+0000 7fd796d36700 1 -- 172.21.15.114:0/3198918332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7900ff9d0 msgr2=0x7fd790197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.650+0000 7fd796d36700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7900ff9d0 0x7fd790197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.650+0000 7fd796d36700 1 -- 172.21.15.114:0/3198918332 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd7901011e0 msgr2=0x7fd790197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.650+0000 7fd796d36700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd7901011e0 0x7fd790197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.650+0000 7fd796d36700 1 -- 172.21.15.114:0/3198918332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7840095f0 con 0x7fd790101ba0 2023-10-18T14:03:57.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.650+0000 7fd796d36700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd790101ba0 0x7fd7901a2b30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd78800ef30 tx=0x7fd78800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:57.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.650+0000 7fd7837fe700 1 -- 172.21.15.114:0/3198918332 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788018070 con 0x7fd790101ba0 2023-10-18T14:03:57.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.650+0000 7fd7837fe700 1 -- 172.21.15.114:0/3198918332 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd78800f040 con 0x7fd790101ba0 2023-10-18T14:03:57.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.650+0000 7fd7837fe700 1 -- 172.21.15.114:0/3198918332 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78800cd00 con 0x7fd790101ba0 2023-10-18T14:03:57.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.650+0000 7fd798799700 1 -- 172.21.15.114:0/3198918332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7901a3430 con 0x7fd790101ba0 2023-10-18T14:03:57.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.650+0000 7fd798799700 1 -- 172.21.15.114:0/3198918332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7901a38f0 con 0x7fd790101ba0 2023-10-18T14:03:57.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.651+0000 7fd798799700 1 -- 172.21.15.114:0/3198918332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd790107b60 con 0x7fd790101ba0 2023-10-18T14:03:57.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.652+0000 7fd7837fe700 1 -- 172.21.15.114:0/3198918332 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fd788003a00 con 0x7fd790101ba0 2023-10-18T14:03:57.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.653+0000 7fd7837fe700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd77c0a15e0 0x7fd77c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:57.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.653+0000 7fd7837fe700 1 -- 172.21.15.114:0/3198918332 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd7880cd430 con 0x7fd790101ba0 2023-10-18T14:03:57.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.653+0000 7fd796535700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd77c0a15e0 0x7fd77c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:57.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.653+0000 7fd796535700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd77c0a15e0 0x7fd77c0a3aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd78c005950 tx=0x7fd78c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:57.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.656+0000 7fd7837fe700 1 -- 172.21.15.114:0/3198918332 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd788096920 con 0x7fd790101ba0 2023-10-18T14:03:57.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:57 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1025847515' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:57.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.847+0000 7fd798799700 1 -- 172.21.15.114:0/3198918332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd790069050 con 0x7fd790101ba0 2023-10-18T14:03:57.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.847+0000 7fd7837fe700 1 -- 172.21.15.114:0/3198918332 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd788099f40 con 0x7fd790101ba0 2023-10-18T14:03:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T14:03:57.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.850+0000 7fd798799700 1 -- 172.21.15.114:0/3198918332 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd77c0a15e0 msgr2=0x7fd77c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.850+0000 7fd798799700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd77c0a15e0 0x7fd77c0a3aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd78c005950 tx=0x7fd78c00b410 comp rx=0 tx=0).stop 2023-10-18T14:03:57.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.850+0000 7fd798799700 1 -- 172.21.15.114:0/3198918332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd790101ba0 msgr2=0x7fd7901a2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.850+0000 7fd798799700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd790101ba0 0x7fd7901a2b30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd78800ef30 tx=0x7fd78800c3a0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.850+0000 7fd798799700 1 -- 172.21.15.114:0/3198918332 shutdown_connections 2023-10-18T14:03:57.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.850+0000 7fd798799700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd77c0a15e0 0x7fd77c0a3aa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.850+0000 7fd798799700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd790101ba0 0x7fd7901a2b30 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.850+0000 7fd798799700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7900ff9d0 0x7fd790197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.850+0000 7fd798799700 1 --2- 172.21.15.114:0/3198918332 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd7901011e0 0x7fd790197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.850+0000 7fd798799700 1 -- 172.21.15.114:0/3198918332 >> 172.21.15.114:0/3198918332 conn(0x7fd7900fb0a0 msgr2=0x7fd7900fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:57.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.850+0000 7fd798799700 1 -- 172.21.15.114:0/3198918332 shutdown_connections 2023-10-18T14:03:57.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.850+0000 7fd798799700 1 -- 172.21.15.114:0/3198918332 wait complete. 2023-10-18T14:03:57.865 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T14:03:57.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.986+0000 7ff3a520e700 1 -- 172.21.15.114:0/4189136633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a0100710 msgr2=0x7ff3a0100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.986+0000 7ff3a520e700 1 --2- 172.21.15.114:0/4189136633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a0100710 0x7ff3a0100b90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff394009990 tx=0x7ff394009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.986+0000 7ff3a520e700 1 -- 172.21.15.114:0/4189136633 shutdown_connections 2023-10-18T14:03:57.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.986+0000 7ff3a520e700 1 --2- 172.21.15.114:0/4189136633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a01010d0 0x7ff3a010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.986+0000 7ff3a520e700 1 --2- 172.21.15.114:0/4189136633 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3a0106720 0x7ff3a0106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.986+0000 7ff3a520e700 1 --2- 172.21.15.114:0/4189136633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a0100710 0x7ff3a0100b90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.986+0000 7ff3a520e700 1 -- 172.21.15.114:0/4189136633 >> 172.21.15.114:0/4189136633 conn(0x7ff3a00fc200 msgr2=0x7ff3a00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:57.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.986+0000 7ff3a520e700 1 -- 172.21.15.114:0/4189136633 shutdown_connections 2023-10-18T14:03:57.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.986+0000 7ff3a520e700 1 -- 172.21.15.114:0/4189136633 wait complete. 2023-10-18T14:03:57.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.987+0000 7ff3a520e700 1 Processor -- start 2023-10-18T14:03:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.987+0000 7ff3a520e700 1 -- start start 2023-10-18T14:03:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.987+0000 7ff3a520e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3a0100710 0x7ff3a0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.987+0000 7ff3a520e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a01010d0 0x7ff3a0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.987+0000 7ff3a520e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a0106720 0x7ff3a0073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.987+0000 7ff3a520e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a01a4f90 con 0x7ff3a01010d0 2023-10-18T14:03:57.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.987+0000 7ff3a520e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a01a5100 con 0x7ff3a0100710 2023-10-18T14:03:57.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.987+0000 7ff3a520e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a01a52c0 con 0x7ff3a0106720 2023-10-18T14:03:57.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff39e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a01010d0 0x7ff3a0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:57.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff39e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a01010d0 0x7ff3a0073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43968/0 (socket says 172.21.15.114:43968) 2023-10-18T14:03:57.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff39e59c700 1 -- 172.21.15.114:0/2164114650 learned_addr learned my addr 172.21.15.114:0/2164114650 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:57.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff39ed9d700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3a0100710 0x7ff3a0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:57.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff39f59e700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a0106720 0x7ff3a0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:57.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff39e59c700 1 -- 172.21.15.114:0/2164114650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a0106720 msgr2=0x7ff3a0073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff39e59c700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a0106720 0x7ff3a0073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff39e59c700 1 -- 172.21.15.114:0/2164114650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3a0100710 msgr2=0x7ff3a0072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:57.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff39e59c700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3a0100710 0x7ff3a0072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:57.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff39e59c700 1 -- 172.21.15.114:0/2164114650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3940095f0 con 0x7ff3a01010d0 2023-10-18T14:03:57.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff39e59c700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a01010d0 0x7ff3a0073030 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff394000c00 tx=0x7ff394004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:57.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff387fff700 1 -- 172.21.15.114:0/2164114650 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39401d070 con 0x7ff3a01010d0 2023-10-18T14:03:57.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff387fff700 1 -- 172.21.15.114:0/2164114650 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff394022470 con 0x7ff3a01010d0 2023-10-18T14:03:57.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff3a520e700 1 -- 172.21.15.114:0/2164114650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a01a5540 con 0x7ff3a01010d0 2023-10-18T14:03:57.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff387fff700 1 -- 172.21.15.114:0/2164114650 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394017650 con 0x7ff3a01010d0 2023-10-18T14:03:57.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.988+0000 7ff3a520e700 1 -- 172.21.15.114:0/2164114650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a01a5a20 con 0x7ff3a01010d0 2023-10-18T14:03:58.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.989+0000 7ff3a520e700 1 -- 172.21.15.114:0/2164114650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a0108d30 con 0x7ff3a01010d0 2023-10-18T14:03:58.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.990+0000 7ff387fff700 1 -- 172.21.15.114:0/2164114650 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7ff3940225e0 con 0x7ff3a01010d0 2023-10-18T14:03:58.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.991+0000 7ff387fff700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff3880a15e0 0x7ff3880a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:58.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.991+0000 7ff39ed9d700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff3880a15e0 0x7ff3880a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:58.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.991+0000 7ff387fff700 1 -- 172.21.15.114:0/2164114650 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff3940ce7f0 con 0x7ff3a01010d0 2023-10-18T14:03:58.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.991+0000 7ff39ed9d700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff3880a15e0 0x7ff3880a3aa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff390009a10 tx=0x7ff390009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:58.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:57.994+0000 7ff387fff700 1 -- 172.21.15.114:0/2164114650 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff394097c80 con 0x7ff3a01010d0 2023-10-18T14:03:58.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.187+0000 7ff3a520e700 1 -- 172.21.15.114:0/2164114650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3a0073fd0 con 0x7ff3a01010d0 2023-10-18T14:03:58.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.187+0000 7ff387fff700 1 -- 172.21.15.114:0/2164114650 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff39409b2a0 con 0x7ff3a01010d0 2023-10-18T14:03:58.192 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T14:03:58.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.190+0000 7ff3a520e700 1 -- 172.21.15.114:0/2164114650 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff3880a15e0 msgr2=0x7ff3880a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:58.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.190+0000 7ff3a520e700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff3880a15e0 0x7ff3880a3aa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff390009a10 tx=0x7ff390009190 comp rx=0 tx=0).stop 2023-10-18T14:03:58.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.190+0000 7ff3a520e700 1 -- 172.21.15.114:0/2164114650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a01010d0 msgr2=0x7ff3a0073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:58.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.190+0000 7ff3a520e700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a01010d0 0x7ff3a0073030 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff394000c00 tx=0x7ff394004730 comp rx=0 tx=0).stop 2023-10-18T14:03:58.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.190+0000 7ff3a520e700 1 -- 172.21.15.114:0/2164114650 shutdown_connections 2023-10-18T14:03:58.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.190+0000 7ff3a520e700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff3880a15e0 0x7ff3880a3aa0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.190+0000 7ff3a520e700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a0106720 0x7ff3a0073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.190+0000 7ff3a520e700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3a0100710 0x7ff3a0072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.190+0000 7ff3a520e700 1 --2- 172.21.15.114:0/2164114650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a01010d0 0x7ff3a0073030 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.190+0000 7ff3a520e700 1 -- 172.21.15.114:0/2164114650 >> 172.21.15.114:0/2164114650 conn(0x7ff3a00fc200 msgr2=0x7ff3a00fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:58.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.190+0000 7ff3a520e700 1 -- 172.21.15.114:0/2164114650 shutdown_connections 2023-10-18T14:03:58.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.190+0000 7ff3a520e700 1 -- 172.21.15.114:0/2164114650 wait complete. 2023-10-18T14:03:58.206 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:03:58.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.326+0000 7f5374b94700 1 -- 172.21.15.114:0/3801858343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5370105660 msgr2=0x7f5370105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:58.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.326+0000 7f5374b94700 1 --2- 172.21.15.114:0/3801858343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5370105660 0x7f5370105a40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5364009990 tx=0x7f5364009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.326+0000 7f5374b94700 1 -- 172.21.15.114:0/3801858343 shutdown_connections 2023-10-18T14:03:58.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.326+0000 7f5374b94700 1 --2- 172.21.15.114:0/3801858343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53700fffa0 0x7f537010c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.326+0000 7f5374b94700 1 --2- 172.21.15.114:0/3801858343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5370105660 0x7f5370105a40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.326+0000 7f5374b94700 1 --2- 172.21.15.114:0/3801858343 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f53700ff5e0 0x7f53700ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.326+0000 7f5374b94700 1 -- 172.21.15.114:0/3801858343 >> 172.21.15.114:0/3801858343 conn(0x7f5370076790 msgr2=0x7f5370076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:58.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.326+0000 7f5374b94700 1 -- 172.21.15.114:0/3801858343 shutdown_connections 2023-10-18T14:03:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.326+0000 7f5374b94700 1 -- 172.21.15.114:0/3801858343 wait complete. 2023-10-18T14:03:58.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f5374b94700 1 Processor -- start 2023-10-18T14:03:58.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f5374b94700 1 -- start start 2023-10-18T14:03:58.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f5374b94700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53700ff5e0 0x7f5370101260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f5374b94700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f53700fffa0 0x7f53701017a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f5374b94700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5370105660 0x7f5370101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f5374b94700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53701a4d60 con 0x7f53700ff5e0 2023-10-18T14:03:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f5374b94700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53701a4ed0 con 0x7f53700fffa0 2023-10-18T14:03:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f5374b94700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53701a5090 con 0x7f5370105660 2023-10-18T14:03:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f536e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53700ff5e0 0x7f5370101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f536e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53700ff5e0 0x7f5370101260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43980/0 (socket says 172.21.15.114:43980) 2023-10-18T14:03:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f536e59c700 1 -- 172.21.15.114:0/2009130266 learned_addr learned my addr 172.21.15.114:0/2009130266 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f536dd9b700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f53700fffa0 0x7f53701017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f536ed9d700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5370105660 0x7f5370101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f536e59c700 1 -- 172.21.15.114:0/2009130266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5370105660 msgr2=0x7f5370101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f536e59c700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5370105660 0x7f5370101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f536e59c700 1 -- 172.21.15.114:0/2009130266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f53700fffa0 msgr2=0x7f53701017a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f536e59c700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f53700fffa0 0x7f53701017a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f536e59c700 1 -- 172.21.15.114:0/2009130266 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53640095f0 con 0x7f53700ff5e0 2023-10-18T14:03:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f536ed9d700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5370105660 0x7f5370101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.327+0000 7f536e59c700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53700ff5e0 0x7f5370101260 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5364000c00 tx=0x7f536400f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.328+0000 7f535f7fe700 1 -- 172.21.15.114:0/2009130266 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536401d070 con 0x7f53700ff5e0 2023-10-18T14:03:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.328+0000 7f535f7fe700 1 -- 172.21.15.114:0/2009130266 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f536400fcc0 con 0x7f53700ff5e0 2023-10-18T14:03:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.328+0000 7f5374b94700 1 -- 172.21.15.114:0/2009130266 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53701a5370 con 0x7f53700ff5e0 2023-10-18T14:03:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.328+0000 7f535f7fe700 1 -- 172.21.15.114:0/2009130266 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364017650 con 0x7f53700ff5e0 2023-10-18T14:03:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.328+0000 7f5374b94700 1 -- 172.21.15.114:0/2009130266 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53701a5880 con 0x7f53700ff5e0 2023-10-18T14:03:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.329+0000 7f5374b94700 1 -- 172.21.15.114:0/2009130266 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5370100d00 con 0x7f53700ff5e0 2023-10-18T14:03:58.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.330+0000 7f535f7fe700 1 -- 172.21.15.114:0/2009130266 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f53640177b0 con 0x7f53700ff5e0 2023-10-18T14:03:58.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.330+0000 7f535f7fe700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f53580a1560 0x7f53580a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:58.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.330+0000 7f535f7fe700 1 -- 172.21.15.114:0/2009130266 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f53640ce340 con 0x7f53700ff5e0 2023-10-18T14:03:58.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.330+0000 7f536dd9b700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f53580a1560 0x7f53580a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.331+0000 7f536dd9b700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f53580a1560 0x7f53580a3a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5360005ea0 tx=0x7f5360005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.335+0000 7f535f7fe700 1 -- 172.21.15.114:0/2009130266 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5364097950 con 0x7f53700ff5e0 2023-10-18T14:03:58.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.527+0000 7f5374b94700 1 -- 172.21.15.114:0/2009130266 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5370066ca0 con 0x7f53700ff5e0 2023-10-18T14:03:58.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.529+0000 7f535f7fe700 1 -- 172.21.15.114:0/2009130266 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22907 (secure 0 0 0) 0x7f5364027090 con 0x7f53700ff5e0 2023-10-18T14:03:58.533 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:58.533 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":85,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:03:08.625359+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:03:58.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.531+0000 7f5374b94700 1 -- 172.21.15.114:0/2009130266 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f53580a1560 msgr2=0x7f53580a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:58.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.531+0000 7f5374b94700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f53580a1560 0x7f53580a3a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5360005ea0 tx=0x7f5360005e30 comp rx=0 tx=0).stop 2023-10-18T14:03:58.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.531+0000 7f5374b94700 1 -- 172.21.15.114:0/2009130266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53700ff5e0 msgr2=0x7f5370101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:58.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.531+0000 7f5374b94700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53700ff5e0 0x7f5370101260 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5364000c00 tx=0x7f536400f7a0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.531+0000 7f5374b94700 1 -- 172.21.15.114:0/2009130266 shutdown_connections 2023-10-18T14:03:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.531+0000 7f5374b94700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f53580a1560 0x7f53580a3a20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.531+0000 7f5374b94700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5370105660 0x7f5370101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.531+0000 7f5374b94700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53700ff5e0 0x7f5370101260 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.531+0000 7f5374b94700 1 --2- 172.21.15.114:0/2009130266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f53700fffa0 0x7f53701017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.531+0000 7f5374b94700 1 -- 172.21.15.114:0/2009130266 >> 172.21.15.114:0/2009130266 conn(0x7f5370076790 msgr2=0x7f53700fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:58.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.531+0000 7f5374b94700 1 -- 172.21.15.114:0/2009130266 shutdown_connections 2023-10-18T14:03:58.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.531+0000 7f5374b94700 1 -- 172.21.15.114:0/2009130266 wait complete. 2023-10-18T14:03:58.546 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:58 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/131334411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:58.546 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:58 smithi114 ceph-mon[99494]: pgmap v278: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-10-18T14:03:58.547 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:58 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3198918332' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:58.547 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:58 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2164114650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:58.548 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T13:58:43.813590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T14:02:30.693853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T14:02:31.426625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T14:03:58.549 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T14:03:58.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:58 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/131334411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:58.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:58 smithi172 ceph-mon[103574]: pgmap v278: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-10-18T14:03:58.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:58 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3198918332' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:58.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:58 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2164114650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:58.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.670+0000 7f932f0c1700 1 -- 172.21.15.114:0/2658646756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93280ff640 msgr2=0x7f93280ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:58.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.670+0000 7f932f0c1700 1 --2- 172.21.15.114:0/2658646756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93280ff640 0x7f93280ffac0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9314009990 tx=0x7f9314009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.670+0000 7f932f0c1700 1 -- 172.21.15.114:0/2658646756 shutdown_connections 2023-10-18T14:03:58.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.670+0000 7f932f0c1700 1 --2- 172.21.15.114:0/2658646756 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9328100000 0x7f932810c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.670+0000 7f932f0c1700 1 --2- 172.21.15.114:0/2658646756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93281056e0 0x7f9328105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.670+0000 7f932f0c1700 1 --2- 172.21.15.114:0/2658646756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93280ff640 0x7f93280ffac0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.670+0000 7f932f0c1700 1 -- 172.21.15.114:0/2658646756 >> 172.21.15.114:0/2658646756 conn(0x7f93280767f0 msgr2=0x7f9328076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:58.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.670+0000 7f932f0c1700 1 -- 172.21.15.114:0/2658646756 shutdown_connections 2023-10-18T14:03:58.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.670+0000 7f932f0c1700 1 -- 172.21.15.114:0/2658646756 wait complete. 2023-10-18T14:03:58.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932f0c1700 1 Processor -- start 2023-10-18T14:03:58.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932f0c1700 1 -- start start 2023-10-18T14:03:58.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932f0c1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93280ff640 0x7f932819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:58.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932f0c1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9328100000 0x7f932819bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:58.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932f0c1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93281056e0 0x7f93281958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:58.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932f0c1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9328195f50 con 0x7f93280ff640 2023-10-18T14:03:58.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932f0c1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93281960c0 con 0x7f93281056e0 2023-10-18T14:03:58.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932f0c1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9328196280 con 0x7f9328100000 2023-10-18T14:03:58.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932ce5d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93280ff640 0x7f932819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:58.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932ce5d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93280ff640 0x7f932819b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43994/0 (socket says 172.21.15.114:43994) 2023-10-18T14:03:58.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932ce5d700 1 -- 172.21.15.114:0/4201758402 learned_addr learned my addr 172.21.15.114:0/4201758402 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:58.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f9327fff700 1 --2- 172.21.15.114:0/4201758402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9328100000 0x7f932819bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:58.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932ce5d700 1 -- 172.21.15.114:0/4201758402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9328100000 msgr2=0x7f932819bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:58.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932ce5d700 1 --2- 172.21.15.114:0/4201758402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9328100000 0x7f932819bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932ce5d700 1 -- 172.21.15.114:0/4201758402 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93281056e0 msgr2=0x7f93281958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:58.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932ce5d700 1 --2- 172.21.15.114:0/4201758402 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93281056e0 0x7f93281958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932ce5d700 1 -- 172.21.15.114:0/4201758402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93140095f0 con 0x7f93280ff640 2023-10-18T14:03:58.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.671+0000 7f932ce5d700 1 --2- 172.21.15.114:0/4201758402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93280ff640 0x7f932819b7c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f931c00d950 tx=0x7f931c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:58.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.672+0000 7f9325ffb700 1 -- 172.21.15.114:0/4201758402 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c009940 con 0x7f93280ff640 2023-10-18T14:03:58.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.672+0000 7f9325ffb700 1 -- 172.21.15.114:0/4201758402 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f931c010460 con 0x7f93280ff640 2023-10-18T14:03:58.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.672+0000 7f932f0c1700 1 -- 172.21.15.114:0/4201758402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9328196560 con 0x7f93280ff640 2023-10-18T14:03:58.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.672+0000 7f9325ffb700 1 -- 172.21.15.114:0/4201758402 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c00f620 con 0x7f93280ff640 2023-10-18T14:03:58.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.672+0000 7f932f0c1700 1 -- 172.21.15.114:0/4201758402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93281a27b0 con 0x7f93280ff640 2023-10-18T14:03:58.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.673+0000 7f932f0c1700 1 -- 172.21.15.114:0/4201758402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9328107b80 con 0x7f93280ff640 2023-10-18T14:03:58.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.674+0000 7f9325ffb700 1 -- 172.21.15.114:0/4201758402 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f931c0108d0 con 0x7f93280ff640 2023-10-18T14:03:58.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.674+0000 7f9325ffb700 1 --2- 172.21.15.114:0/4201758402 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f93180a15e0 0x7f93180a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:58.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.674+0000 7f9327fff700 1 --2- 172.21.15.114:0/4201758402 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f93180a15e0 0x7f93180a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:58.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.675+0000 7f9325ffb700 1 -- 172.21.15.114:0/4201758402 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f931c0cccc0 con 0x7f93280ff640 2023-10-18T14:03:58.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.675+0000 7f9327fff700 1 --2- 172.21.15.114:0/4201758402 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f93180a15e0 0x7f93180a3aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f931400b5c0 tx=0x7f9314005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:58.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.679+0000 7f9325ffb700 1 -- 172.21.15.114:0/4201758402 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f931c096120 con 0x7f93280ff640 2023-10-18T14:03:58.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:58 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/131334411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:58.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:58 smithi158 ceph-mon[103317]: pgmap v278: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-10-18T14:03:58.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:58 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3198918332' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:58.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:58 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2164114650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:03:58.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.869+0000 7f932f0c1700 1 -- 172.21.15.114:0/4201758402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9328196db0 con 0x7f93280ff640 2023-10-18T14:03:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.869+0000 7f9325ffb700 1 -- 172.21.15.114:0/4201758402 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f931c0160a0 con 0x7f93280ff640 2023-10-18T14:03:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T14:03:58.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.871+0000 7f932f0c1700 1 -- 172.21.15.114:0/4201758402 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f93180a15e0 msgr2=0x7f93180a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.871+0000 7f932f0c1700 1 --2- 172.21.15.114:0/4201758402 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f93180a15e0 0x7f93180a3aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f931400b5c0 tx=0x7f9314005960 comp rx=0 tx=0).stop 2023-10-18T14:03:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.871+0000 7f932f0c1700 1 -- 172.21.15.114:0/4201758402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93280ff640 msgr2=0x7f932819b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.871+0000 7f932f0c1700 1 --2- 172.21.15.114:0/4201758402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93280ff640 0x7f932819b7c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f931c00d950 tx=0x7f931c00dc60 comp rx=0 tx=0).stop 2023-10-18T14:03:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.871+0000 7f932f0c1700 1 -- 172.21.15.114:0/4201758402 shutdown_connections 2023-10-18T14:03:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.871+0000 7f932f0c1700 1 --2- 172.21.15.114:0/4201758402 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f93180a15e0 0x7f93180a3aa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.871+0000 7f932f0c1700 1 --2- 172.21.15.114:0/4201758402 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93281056e0 0x7f93281958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.871+0000 7f932f0c1700 1 --2- 172.21.15.114:0/4201758402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93280ff640 0x7f932819b7c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.871+0000 7f932f0c1700 1 --2- 172.21.15.114:0/4201758402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9328100000 0x7f932819bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.871+0000 7f932f0c1700 1 -- 172.21.15.114:0/4201758402 >> 172.21.15.114:0/4201758402 conn(0x7f93280767f0 msgr2=0x7f93280fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.871+0000 7f932f0c1700 1 -- 172.21.15.114:0/4201758402 shutdown_connections 2023-10-18T14:03:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:58.871+0000 7f932f0c1700 1 -- 172.21.15.114:0/4201758402 wait complete. 2023-10-18T14:03:58.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T14:03:59.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.008+0000 7fd17ca1d700 1 -- 172.21.15.114:0/2042206844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd178100250 msgr2=0x7fd1781006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.008+0000 7fd17ca1d700 1 --2- 172.21.15.114:0/2042206844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd178100250 0x7fd1781006d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd168009990 tx=0x7fd168009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.008+0000 7fd17ca1d700 1 -- 172.21.15.114:0/2042206844 shutdown_connections 2023-10-18T14:03:59.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.008+0000 7fd17ca1d700 1 --2- 172.21.15.114:0/2042206844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd178100c10 0x7fd17810c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.008+0000 7fd17ca1d700 1 --2- 172.21.15.114:0/2042206844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd178104730 0x7fd178104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.008+0000 7fd17ca1d700 1 --2- 172.21.15.114:0/2042206844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd178100250 0x7fd1781006d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.008+0000 7fd17ca1d700 1 -- 172.21.15.114:0/2042206844 >> 172.21.15.114:0/2042206844 conn(0x7fd1780749d0 msgr2=0x7fd178074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:59.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.008+0000 7fd17ca1d700 1 -- 172.21.15.114:0/2042206844 shutdown_connections 2023-10-18T14:03:59.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.008+0000 7fd17ca1d700 1 -- 172.21.15.114:0/2042206844 wait complete. 2023-10-18T14:03:59.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.009+0000 7fd17ca1d700 1 Processor -- start 2023-10-18T14:03:59.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.009+0000 7fd17ca1d700 1 -- start start 2023-10-18T14:03:59.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.009+0000 7fd17ca1d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd178100250 0x7fd17819b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:59.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.009+0000 7fd17ca1d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd178100c10 0x7fd17819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:59.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.009+0000 7fd17ca1d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd178104730 0x7fd1781959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:59.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.009+0000 7fd17ca1d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd178196190 con 0x7fd178100c10 2023-10-18T14:03:59.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.009+0000 7fd17ca1d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd178196300 con 0x7fd178104730 2023-10-18T14:03:59.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.009+0000 7fd17ca1d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1781964c0 con 0x7fd178100250 2023-10-18T14:03:59.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.009+0000 7fd175d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd178100c10 0x7fd17819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:59.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.009+0000 7fd175d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd178100c10 0x7fd17819be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44010/0 (socket says 172.21.15.114:44010) 2023-10-18T14:03:59.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.009+0000 7fd175d9b700 1 -- 172.21.15.114:0/656059281 learned_addr learned my addr 172.21.15.114:0/656059281 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:59.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.009+0000 7fd17659c700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd178100250 0x7fd17819b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:59.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.010+0000 7fd176d9d700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd178104730 0x7fd1781959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:59.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.010+0000 7fd175d9b700 1 -- 172.21.15.114:0/656059281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd178100250 msgr2=0x7fd17819b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.010+0000 7fd175d9b700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd178100250 0x7fd17819b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.010+0000 7fd175d9b700 1 -- 172.21.15.114:0/656059281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd178104730 msgr2=0x7fd1781959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.010+0000 7fd175d9b700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd178104730 0x7fd1781959c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.010+0000 7fd175d9b700 1 -- 172.21.15.114:0/656059281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1680095f0 con 0x7fd178100c10 2023-10-18T14:03:59.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.010+0000 7fd176d9d700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd178104730 0x7fd1781959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:03:59.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.010+0000 7fd175d9b700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd178100c10 0x7fd17819be60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd168005910 tx=0x7fd168009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:59.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.010+0000 7fd1677fe700 1 -- 172.21.15.114:0/656059281 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16801d070 con 0x7fd178100c10 2023-10-18T14:03:59.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.010+0000 7fd1677fe700 1 -- 172.21.15.114:0/656059281 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd168022470 con 0x7fd178100c10 2023-10-18T14:03:59.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.010+0000 7fd1677fe700 1 -- 172.21.15.114:0/656059281 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd168017650 con 0x7fd178100c10 2023-10-18T14:03:59.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.010+0000 7fd17ca1d700 1 -- 172.21.15.114:0/656059281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd178196740 con 0x7fd178100c10 2023-10-18T14:03:59.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.010+0000 7fd17ca1d700 1 -- 172.21.15.114:0/656059281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1781a28a0 con 0x7fd178100c10 2023-10-18T14:03:59.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.011+0000 7fd17ca1d700 1 -- 172.21.15.114:0/656059281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd178107c80 con 0x7fd178100c10 2023-10-18T14:03:59.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.012+0000 7fd1677fe700 1 -- 172.21.15.114:0/656059281 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fd1680225e0 con 0x7fd178100c10 2023-10-18T14:03:59.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.013+0000 7fd1677fe700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd1600a15e0 0x7fd1600a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:59.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.013+0000 7fd17659c700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd1600a15e0 0x7fd1600a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:59.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.013+0000 7fd1677fe700 1 -- 172.21.15.114:0/656059281 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd1680ce330 con 0x7fd178100c10 2023-10-18T14:03:59.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.013+0000 7fd17659c700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd1600a15e0 0x7fd1600a3aa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd178075ee0 tx=0x7fd16c00d4b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:59.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.017+0000 7fd1677fe700 1 -- 172.21.15.114:0/656059281 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd168097820 con 0x7fd178100c10 2023-10-18T14:03:59.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.210+0000 7fd17ca1d700 1 -- 172.21.15.114:0/656059281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd178068930 con 0x7fd178100c10 2023-10-18T14:03:59.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.211+0000 7fd1677fe700 1 -- 172.21.15.114:0/656059281 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd16809ae40 con 0x7fd178100c10 2023-10-18T14:03:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T14:03:59.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.213+0000 7fd17ca1d700 1 -- 172.21.15.114:0/656059281 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd1600a15e0 msgr2=0x7fd1600a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.213+0000 7fd17ca1d700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd1600a15e0 0x7fd1600a3aa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd178075ee0 tx=0x7fd16c00d4b0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.213+0000 7fd17ca1d700 1 -- 172.21.15.114:0/656059281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd178100c10 msgr2=0x7fd17819be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.213+0000 7fd17ca1d700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd178100c10 0x7fd17819be60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd168005910 tx=0x7fd168009570 comp rx=0 tx=0).stop 2023-10-18T14:03:59.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.213+0000 7fd17ca1d700 1 -- 172.21.15.114:0/656059281 shutdown_connections 2023-10-18T14:03:59.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.213+0000 7fd17ca1d700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd1600a15e0 0x7fd1600a3aa0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.213+0000 7fd17ca1d700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd178104730 0x7fd1781959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.213+0000 7fd17ca1d700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd178100250 0x7fd17819b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.213+0000 7fd17ca1d700 1 --2- 172.21.15.114:0/656059281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd178100c10 0x7fd17819be60 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.213+0000 7fd17ca1d700 1 -- 172.21.15.114:0/656059281 >> 172.21.15.114:0/656059281 conn(0x7fd1780749d0 msgr2=0x7fd1780fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:59.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.213+0000 7fd17ca1d700 1 -- 172.21.15.114:0/656059281 shutdown_connections 2023-10-18T14:03:59.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.213+0000 7fd17ca1d700 1 -- 172.21.15.114:0/656059281 wait complete. 2023-10-18T14:03:59.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T14:03:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.352+0000 7f08f6175700 1 -- 172.21.15.114:0/489802976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f00ff680 msgr2=0x7f08f00ffb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.352+0000 7f08f6175700 1 --2- 172.21.15.114:0/489802976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f00ff680 0x7f08f00ffb00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009990 tx=0x7f08e0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.352+0000 7f08f6175700 1 -- 172.21.15.114:0/489802976 shutdown_connections 2023-10-18T14:03:59.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.352+0000 7f08f6175700 1 --2- 172.21.15.114:0/489802976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f0100040 0x7f08f010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.352+0000 7f08f6175700 1 --2- 172.21.15.114:0/489802976 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f08f0104560 0x7f08f0104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.352+0000 7f08f6175700 1 --2- 172.21.15.114:0/489802976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f00ff680 0x7f08f00ffb00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.352+0000 7f08f6175700 1 -- 172.21.15.114:0/489802976 >> 172.21.15.114:0/489802976 conn(0x7f08f0076820 msgr2=0x7f08f0076c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.352+0000 7f08f6175700 1 -- 172.21.15.114:0/489802976 shutdown_connections 2023-10-18T14:03:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.352+0000 7f08f6175700 1 -- 172.21.15.114:0/489802976 wait complete. 2023-10-18T14:03:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08f6175700 1 Processor -- start 2023-10-18T14:03:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08f6175700 1 -- start start 2023-10-18T14:03:59.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08f6175700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f08f00ff680 0x7f08f0197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:59.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08f6175700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f0100040 0x7f08f0197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:59.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08f6175700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0104560 0x7f08f01a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08f6175700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f01987c0 con 0x7f08f0104560 2023-10-18T14:03:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08f6175700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f01a2fd0 con 0x7f08f00ff680 2023-10-18T14:03:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08f6175700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f01a3110 con 0x7f08f0100040 2023-10-18T14:03:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08effff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0104560 0x7f08f01a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08effff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0104560 0x7f08f01a2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44026/0 (socket says 172.21.15.114:44026) 2023-10-18T14:03:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08effff700 1 -- 172.21.15.114:0/2059295510 learned_addr learned my addr 172.21.15.114:0/2059295510 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08eeffd700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f0100040 0x7f08f0197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08ef7fe700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f08f00ff680 0x7f08f0197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08effff700 1 -- 172.21.15.114:0/2059295510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f0100040 msgr2=0x7f08f0197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08effff700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f0100040 0x7f08f0197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08effff700 1 -- 172.21.15.114:0/2059295510 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f08f00ff680 msgr2=0x7f08f0197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08effff700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f08f00ff680 0x7f08f0197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.353+0000 7f08effff700 1 -- 172.21.15.114:0/2059295510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00095f0 con 0x7f08f0104560 2023-10-18T14:03:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.354+0000 7f08effff700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0104560 0x7f08f01a2a90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f08e800efc0 tx=0x7f08e800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.354+0000 7f08ecff9700 1 -- 172.21.15.114:0/2059295510 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8018070 con 0x7f08f0104560 2023-10-18T14:03:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.354+0000 7f08ecff9700 1 -- 172.21.15.114:0/2059295510 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08e800f040 con 0x7f08f0104560 2023-10-18T14:03:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.354+0000 7f08f6175700 1 -- 172.21.15.114:0/2059295510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f01a3340 con 0x7f08f0104560 2023-10-18T14:03:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.354+0000 7f08ecff9700 1 -- 172.21.15.114:0/2059295510 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800ccc0 con 0x7f08f0104560 2023-10-18T14:03:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.354+0000 7f08f6175700 1 -- 172.21.15.114:0/2059295510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f01a3820 con 0x7f08f0104560 2023-10-18T14:03:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.355+0000 7f08f6175700 1 -- 172.21.15.114:0/2059295510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f0107ba0 con 0x7f08f0104560 2023-10-18T14:03:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.356+0000 7f08ecff9700 1 -- 172.21.15.114:0/2059295510 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f08e8003a00 con 0x7f08f0104560 2023-10-18T14:03:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.356+0000 7f08ecff9700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f08dc0a15e0 0x7f08dc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.356+0000 7f08ecff9700 1 -- 172.21.15.114:0/2059295510 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f08e80cd360 con 0x7f08f0104560 2023-10-18T14:03:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.356+0000 7f08ef7fe700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f08dc0a15e0 0x7f08dc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.357+0000 7f08ef7fe700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f08dc0a15e0 0x7f08dc0a3aa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009bd0 tx=0x7f08d8009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.360+0000 7f08ecff9700 1 -- 172.21.15.114:0/2059295510 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f08e8096850 con 0x7f08f0104560 2023-10-18T14:03:59.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.549+0000 7f08f6175700 1 -- 172.21.15.114:0/2059295510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08f00679f0 con 0x7f08f0104560 2023-10-18T14:03:59.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.550+0000 7f08ecff9700 1 -- 172.21.15.114:0/2059295510 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08e8099e70 con 0x7f08f0104560 2023-10-18T14:03:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T14:03:59.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.552+0000 7f08f6175700 1 -- 172.21.15.114:0/2059295510 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f08dc0a15e0 msgr2=0x7f08dc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.552+0000 7f08f6175700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f08dc0a15e0 0x7f08dc0a3aa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009bd0 tx=0x7f08d8009260 comp rx=0 tx=0).stop 2023-10-18T14:03:59.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.552+0000 7f08f6175700 1 -- 172.21.15.114:0/2059295510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0104560 msgr2=0x7f08f01a2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.552+0000 7f08f6175700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0104560 0x7f08f01a2a90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f08e800efc0 tx=0x7f08e800c3a0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.552+0000 7f08f6175700 1 -- 172.21.15.114:0/2059295510 shutdown_connections 2023-10-18T14:03:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.552+0000 7f08f6175700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f08dc0a15e0 0x7f08dc0a3aa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.552+0000 7f08f6175700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0104560 0x7f08f01a2a90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.552+0000 7f08f6175700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f08f00ff680 0x7f08f0197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.552+0000 7f08f6175700 1 --2- 172.21.15.114:0/2059295510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f0100040 0x7f08f0197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.552+0000 7f08f6175700 1 -- 172.21.15.114:0/2059295510 >> 172.21.15.114:0/2059295510 conn(0x7f08f0076820 msgr2=0x7f08f0102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:59.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.552+0000 7f08f6175700 1 -- 172.21.15.114:0/2059295510 shutdown_connections 2023-10-18T14:03:59.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.552+0000 7f08f6175700 1 -- 172.21.15.114:0/2059295510 wait complete. 2023-10-18T14:03:59.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:59 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2009130266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:59.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:59 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/4201758402' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:59.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:03:59 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/656059281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:59.567 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:59 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2009130266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:59.567 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:59 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/4201758402' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:59.567 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:03:59 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/656059281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:59.568 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-18T14:03:59.569 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:03:59.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.686+0000 7fc31c876700 1 -- 172.21.15.114:0/149282154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3181006d0 msgr2=0x7fc31810c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.686+0000 7fc31c876700 1 --2- 172.21.15.114:0/149282154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3181006d0 0x7fc31810c420 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc31000b0d0 tx=0x7fc31000b3e0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.686+0000 7fc31c876700 1 -- 172.21.15.114:0/149282154 shutdown_connections 2023-10-18T14:03:59.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.686+0000 7fc31c876700 1 --2- 172.21.15.114:0/149282154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3181006d0 0x7fc31810c420 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.686+0000 7fc31c876700 1 --2- 172.21.15.114:0/149282154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc318105660 0x7fc318105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.686+0000 7fc31c876700 1 --2- 172.21.15.114:0/149282154 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3180ffd10 0x7fc318100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.686+0000 7fc31c876700 1 -- 172.21.15.114:0/149282154 >> 172.21.15.114:0/149282154 conn(0x7fc318075b90 msgr2=0x7fc3180fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:59.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.686+0000 7fc31c876700 1 -- 172.21.15.114:0/149282154 shutdown_connections 2023-10-18T14:03:59.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.686+0000 7fc31c876700 1 -- 172.21.15.114:0/149282154 wait complete. 2023-10-18T14:03:59.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc31c876700 1 Processor -- start 2023-10-18T14:03:59.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc31c876700 1 -- start start 2023-10-18T14:03:59.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc31c876700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3180ffd10 0x7fc31819c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:59.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc31c876700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3181006d0 0x7fc31819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:59.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc31c876700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc318105660 0x7fc3181969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:59.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc31c876700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc318197010 con 0x7fc318105660 2023-10-18T14:03:59.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc31c876700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc318197180 con 0x7fc3181006d0 2023-10-18T14:03:59.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc31c876700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc318197340 con 0x7fc3180ffd10 2023-10-18T14:03:59.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc316d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc318105660 0x7fc3181969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:59.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc316d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc318105660 0x7fc3181969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44040/0 (socket says 172.21.15.114:44040) 2023-10-18T14:03:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc316d9d700 1 -- 172.21.15.114:0/581303793 learned_addr learned my addr 172.21.15.114:0/581303793 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:03:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc31659c700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3180ffd10 0x7fc31819c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc315d9b700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3181006d0 0x7fc31819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc316d9d700 1 -- 172.21.15.114:0/581303793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3180ffd10 msgr2=0x7fc31819c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc316d9d700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3180ffd10 0x7fc31819c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc316d9d700 1 -- 172.21.15.114:0/581303793 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3181006d0 msgr2=0x7fc31819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc316d9d700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3181006d0 0x7fc31819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc316d9d700 1 -- 172.21.15.114:0/581303793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310009d00 con 0x7fc318105660 2023-10-18T14:03:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc315d9b700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3181006d0 0x7fc31819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:03:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.687+0000 7fc316d9d700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc318105660 0x7fc3181969b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc3100094c0 tx=0x7fc3100094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:59.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.688+0000 7fc3077fe700 1 -- 172.21.15.114:0/581303793 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31000e040 con 0x7fc318105660 2023-10-18T14:03:59.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.688+0000 7fc3077fe700 1 -- 172.21.15.114:0/581303793 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc31001d940 con 0x7fc318105660 2023-10-18T14:03:59.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.688+0000 7fc31c876700 1 -- 172.21.15.114:0/581303793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3181975c0 con 0x7fc318105660 2023-10-18T14:03:59.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.688+0000 7fc3077fe700 1 -- 172.21.15.114:0/581303793 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31001b9e0 con 0x7fc318105660 2023-10-18T14:03:59.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.688+0000 7fc31c876700 1 -- 172.21.15.114:0/581303793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3181a3800 con 0x7fc318105660 2023-10-18T14:03:59.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.689+0000 7fc31c876700 1 -- 172.21.15.114:0/581303793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc318100d20 con 0x7fc318105660 2023-10-18T14:03:59.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.690+0000 7fc3077fe700 1 -- 172.21.15.114:0/581303793 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fc31001d480 con 0x7fc318105660 2023-10-18T14:03:59.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.690+0000 7fc3077fe700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc3000a15e0 0x7fc3000a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:03:59.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.690+0000 7fc31659c700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc3000a15e0 0x7fc3000a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:03:59.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.690+0000 7fc3077fe700 1 -- 172.21.15.114:0/581303793 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc3100cee80 con 0x7fc318105660 2023-10-18T14:03:59.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.691+0000 7fc31659c700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc3000a15e0 0x7fc3000a3aa0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc318104660 tx=0x7fc30c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:03:59.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.694+0000 7fc3077fe700 1 -- 172.21.15.114:0/581303793 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc310060100 con 0x7fc318105660 2023-10-18T14:03:59.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:59 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2009130266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:03:59.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:59 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/4201758402' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:03:59.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:03:59 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/656059281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:03:59.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.933+0000 7fc31c876700 1 -- 172.21.15.114:0/581303793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc318066ca0 con 0x7fc318105660 2023-10-18T14:03:59.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.934+0000 7fc3077fe700 1 -- 172.21.15.114:0/581303793 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11390 (secure 0 0 0) 0x7fc310098370 con 0x7fc318105660 2023-10-18T14:03:59.938 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:03:59.938 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:02:39.260198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:03:59.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.936+0000 7fc31c876700 1 -- 172.21.15.114:0/581303793 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc3000a15e0 msgr2=0x7fc3000a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.936+0000 7fc31c876700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc3000a15e0 0x7fc3000a3aa0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc318104660 tx=0x7fc30c00b410 comp rx=0 tx=0).stop 2023-10-18T14:03:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.936+0000 7fc31c876700 1 -- 172.21.15.114:0/581303793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc318105660 msgr2=0x7fc3181969b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:03:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.936+0000 7fc31c876700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc318105660 0x7fc3181969b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc3100094c0 tx=0x7fc3100094f0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.936+0000 7fc31c876700 1 -- 172.21.15.114:0/581303793 shutdown_connections 2023-10-18T14:03:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.936+0000 7fc31c876700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc3000a15e0 0x7fc3000a3aa0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.936+0000 7fc31c876700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc318105660 0x7fc3181969b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.936+0000 7fc31c876700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3180ffd10 0x7fc31819c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.936+0000 7fc31c876700 1 --2- 172.21.15.114:0/581303793 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc3181006d0 0x7fc31819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:03:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.936+0000 7fc31c876700 1 -- 172.21.15.114:0/581303793 >> 172.21.15.114:0/581303793 conn(0x7fc318075b90 msgr2=0x7fc3180fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:03:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.936+0000 7fc31c876700 1 -- 172.21.15.114:0/581303793 shutdown_connections 2023-10-18T14:03:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:03:59.936+0000 7fc31c876700 1 -- 172.21.15.114:0/581303793 wait complete. 2023-10-18T14:03:59.943 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2023-10-18T14:03:59.952 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-18T14:03:59.952 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-18T14:03:59.953 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T14:04:00.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.070+0000 7fe5a22f3700 1 -- 172.21.15.114:0/3840378670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe59c100290 msgr2=0x7fe59c10c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:00.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.070+0000 7fe5a22f3700 1 --2- 172.21.15.114:0/3840378670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe59c100290 0x7fe59c10c420 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe59400b0a0 tx=0x7fe59400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.070+0000 7fe5a22f3700 1 -- 172.21.15.114:0/3840378670 shutdown_connections 2023-10-18T14:04:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.070+0000 7fe5a22f3700 1 --2- 172.21.15.114:0/3840378670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe59c100290 0x7fe59c10c420 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.070+0000 7fe5a22f3700 1 --2- 172.21.15.114:0/3840378670 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe59c105710 0x7fe59c105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.070+0000 7fe5a22f3700 1 --2- 172.21.15.114:0/3840378670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe59c0ff8d0 0x7fe59c0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.070+0000 7fe5a22f3700 1 -- 172.21.15.114:0/3840378670 >> 172.21.15.114:0/3840378670 conn(0x7fe59c076400 msgr2=0x7fe59c076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.070+0000 7fe5a22f3700 1 -- 172.21.15.114:0/3840378670 shutdown_connections 2023-10-18T14:04:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.070+0000 7fe5a22f3700 1 -- 172.21.15.114:0/3840378670 wait complete. 2023-10-18T14:04:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.071+0000 7fe5a22f3700 1 Processor -- start 2023-10-18T14:04:00.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.071+0000 7fe5a22f3700 1 -- start start 2023-10-18T14:04:00.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.071+0000 7fe5a22f3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe59c0ff8d0 0x7fe59c19b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:00.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.071+0000 7fe5a22f3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe59c100290 0x7fe59c19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:00.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.071+0000 7fe5a22f3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe59c105710 0x7fe59c195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:00.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.071+0000 7fe5a22f3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c195f70 con 0x7fe59c100290 2023-10-18T14:04:00.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.071+0000 7fe5a22f3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c1960e0 con 0x7fe59c0ff8d0 2023-10-18T14:04:00.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.071+0000 7fe5a22f3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c1962a0 con 0x7fe59c105710 2023-10-18T14:04:00.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.071+0000 7fe59b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe59c100290 0x7fe59c19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:00.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.071+0000 7fe59b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe59c100290 0x7fe59c19bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44058/0 (socket says 172.21.15.114:44058) 2023-10-18T14:04:00.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.071+0000 7fe59b7fe700 1 -- 172.21.15.114:0/2591149551 learned_addr learned my addr 172.21.15.114:0/2591149551 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:00.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.071+0000 7fe5a0890700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe59c105710 0x7fe59c195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:00.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.072+0000 7fe59bfff700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe59c0ff8d0 0x7fe59c19b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:00.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.072+0000 7fe59b7fe700 1 -- 172.21.15.114:0/2591149551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe59c105710 msgr2=0x7fe59c195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:00.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.072+0000 7fe59b7fe700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe59c105710 0x7fe59c195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.072+0000 7fe59b7fe700 1 -- 172.21.15.114:0/2591149551 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe59c0ff8d0 msgr2=0x7fe59c19b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:00.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.072+0000 7fe59b7fe700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe59c0ff8d0 0x7fe59c19b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.072+0000 7fe59b7fe700 1 -- 172.21.15.114:0/2591149551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe594009d00 con 0x7fe59c100290 2023-10-18T14:04:00.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.072+0000 7fe59b7fe700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe59c100290 0x7fe59c19bd20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe59000d950 tx=0x7fe59000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:00.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.072+0000 7fe5997fa700 1 -- 172.21.15.114:0/2591149551 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590009940 con 0x7fe59c100290 2023-10-18T14:04:00.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.072+0000 7fe5997fa700 1 -- 172.21.15.114:0/2591149551 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe590010460 con 0x7fe59c100290 2023-10-18T14:04:00.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.072+0000 7fe5997fa700 1 -- 172.21.15.114:0/2591149551 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59000f620 con 0x7fe59c100290 2023-10-18T14:04:00.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.072+0000 7fe5a22f3700 1 -- 172.21.15.114:0/2591149551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59c196580 con 0x7fe59c100290 2023-10-18T14:04:00.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.072+0000 7fe5a22f3700 1 -- 172.21.15.114:0/2591149551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59c1a27d0 con 0x7fe59c100290 2023-10-18T14:04:00.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.073+0000 7fe5a22f3700 1 -- 172.21.15.114:0/2591149551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59c107a80 con 0x7fe59c100290 2023-10-18T14:04:00.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.074+0000 7fe5997fa700 1 -- 172.21.15.114:0/2591149551 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fe5900108d0 con 0x7fe59c100290 2023-10-18T14:04:00.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.074+0000 7fe5997fa700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe5840a15e0 0x7fe5840a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:00.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.075+0000 7fe59bfff700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe5840a15e0 0x7fe5840a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:00.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.075+0000 7fe5997fa700 1 -- 172.21.15.114:0/2591149551 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe5900cce40 con 0x7fe59c100290 2023-10-18T14:04:00.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.075+0000 7fe59bfff700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe5840a15e0 0x7fe5840a3aa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe58c005fd0 tx=0x7fe58c00a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:00.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.079+0000 7fe5997fa700 1 -- 172.21.15.114:0/2591149551 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe590096240 con 0x7fe59c100290 2023-10-18T14:04:00.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.266+0000 7fe5a22f3700 1 -- 172.21.15.114:0/2591149551 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe59c196dd0 con 0x7fe5840a15e0 2023-10-18T14:04:00.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.277+0000 7fe5997fa700 1 -- 172.21.15.114:0/2591149551 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344837 (secure 0 0 0) 0x7fe59c196dd0 con 0x7fe5840a15e0 2023-10-18T14:04:00.285 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:04:00.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.280+0000 7fe5a22f3700 1 -- 172.21.15.114:0/2591149551 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe5840a15e0 msgr2=0x7fe5840a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:00.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.280+0000 7fe5a22f3700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe5840a15e0 0x7fe5840a3aa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe58c005fd0 tx=0x7fe58c00a560 comp rx=0 tx=0).stop 2023-10-18T14:04:00.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.280+0000 7fe5a22f3700 1 -- 172.21.15.114:0/2591149551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe59c100290 msgr2=0x7fe59c19bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:00.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.280+0000 7fe5a22f3700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe59c100290 0x7fe59c19bd20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe59000d950 tx=0x7fe59000dc60 comp rx=0 tx=0).stop 2023-10-18T14:04:00.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.280+0000 7fe5a22f3700 1 -- 172.21.15.114:0/2591149551 shutdown_connections 2023-10-18T14:04:00.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.280+0000 7fe5a22f3700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe5840a15e0 0x7fe5840a3aa0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.280+0000 7fe5a22f3700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe59c105710 0x7fe59c195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.280+0000 7fe5a22f3700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe59c0ff8d0 0x7fe59c19b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.280+0000 7fe5a22f3700 1 --2- 172.21.15.114:0/2591149551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe59c100290 0x7fe59c19bd20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.280+0000 7fe5a22f3700 1 -- 172.21.15.114:0/2591149551 >> 172.21.15.114:0/2591149551 conn(0x7fe59c076400 msgr2=0x7fe59c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:00.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.280+0000 7fe5a22f3700 1 -- 172.21.15.114:0/2591149551 shutdown_connections 2023-10-18T14:04:00.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.280+0000 7fe5a22f3700 1 -- 172.21.15.114:0/2591149551 wait complete. 2023-10-18T14:04:00.291 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T14:04:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2023-10-18T14:03:59.579516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656319,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":956,"num_read_kb":598,"num_write":413,"num_write_kb":3067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180916,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335696,"kb_used_data":11448,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606128,"statfs":{"total":1151940427776,"available":1151596675072,"internally_reserved":0,"allocated":11722752,"data_stored":7465067,"data_compressed":177861,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":318,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":56,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003129"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631494+0000","last_change":"2023-10-18T14:02:32.447514+0000","last_active":"2023-10-18T14:03:07.631494+0000","last_peered":"2023-10-18T14:03:07.631494+0000","last_clean":"2023-10-18T14:03:07.631494+0000","last_became_active":"2023-10-18T14:02:32.447109+0000","last_became_peered":"2023-10-18T14:02:32.447109+0000","last_unstale":"2023-10-18T14:03:07.631494+0000","last_undegraded":"2023-10-18T14:03:07.631494+0000","last_fullsized":"2023-10-18T14:03:07.631494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:02:52.453371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631611+0000","last_change":"2023-10-18T14:02:32.457696+0000","last_active":"2023-10-18T14:03:07.631611+0000","last_peered":"2023-10-18T14:03:07.631611+0000","last_clean":"2023-10-18T14:03:07.631611+0000","last_became_active":"2023-10-18T14:02:32.457380+0000","last_became_peered":"2023-10-18T14:02:32.457380+0000","last_unstale":"2023-10-18T14:03:07.631611+0000","last_undegraded":"2023-10-18T14:03:07.631611+0000","last_fullsized":"2023-10-18T14:03:07.631611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:09:09.303044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632120+0000","last_change":"2023-10-18T14:02:32.450312+0000","last_active":"2023-10-18T14:03:07.632120+0000","last_peered":"2023-10-18T14:03:07.632120+0000","last_clean":"2023-10-18T14:03:07.632120+0000","last_became_active":"2023-10-18T14:02:32.449994+0000","last_became_peered":"2023-10-18T14:02:32.449994+0000","last_unstale":"2023-10-18T14:03:07.632120+0000","last_undegraded":"2023-10-18T14:03:07.632120+0000","last_fullsized":"2023-10-18T14:03:07.632120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:28:32.445958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628336+0000","last_change":"2023-10-18T14:02:32.450511+0000","last_active":"2023-10-18T14:03:07.628336+0000","last_peered":"2023-10-18T14:03:07.628336+0000","last_clean":"2023-10-18T14:03:07.628336+0000","last_became_active":"2023-10-18T14:02:32.450105+0000","last_became_peered":"2023-10-18T14:02:32.450105+0000","last_unstale":"2023-10-18T14:03:07.628336+0000","last_undegraded":"2023-10-18T14:03:07.628336+0000","last_fullsized":"2023-10-18T14:03:07.628336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:24:52.054236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630046+0000","last_change":"2023-10-18T14:02:32.447099+0000","last_active":"2023-10-18T14:03:07.630046+0000","last_peered":"2023-10-18T14:03:07.630046+0000","last_clean":"2023-10-18T14:03:07.630046+0000","last_became_active":"2023-10-18T14:02:32.446812+0000","last_became_peered":"2023-10-18T14:02:32.446812+0000","last_unstale":"2023-10-18T14:03:07.630046+0000","last_undegraded":"2023-10-18T14:03:07.630046+0000","last_fullsized":"2023-10-18T14:03:07.630046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:11:10.895149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632396+0000","last_change":"2023-10-18T14:02:32.444055+0000","last_active":"2023-10-18T14:03:07.632396+0000","last_peered":"2023-10-18T14:03:07.632396+0000","last_clean":"2023-10-18T14:03:07.632396+0000","last_became_active":"2023-10-18T14:02:32.443750+0000","last_became_peered":"2023-10-18T14:02:32.443750+0000","last_unstale":"2023-10-18T14:03:07.632396+0000","last_undegraded":"2023-10-18T14:03:07.632396+0000","last_fullsized":"2023-10-18T14:03:07.632396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:05:37.783713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630037+0000","last_change":"2023-10-18T14:02:32.462147+0000","last_active":"2023-10-18T14:03:07.630037+0000","last_peered":"2023-10-18T14:03:07.630037+0000","last_clean":"2023-10-18T14:03:07.630037+0000","last_became_active":"2023-10-18T14:02:32.461712+0000","last_became_peered":"2023-10-18T14:02:32.461712+0000","last_unstale":"2023-10-18T14:03:07.630037+0000","last_undegraded":"2023-10-18T14:03:07.630037+0000","last_fullsized":"2023-10-18T14:03:07.630037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:10:39.936092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631949+0000","last_change":"2023-10-18T14:02:32.449466+0000","last_active":"2023-10-18T14:03:07.631949+0000","last_peered":"2023-10-18T14:03:07.631949+0000","last_clean":"2023-10-18T14:03:07.631949+0000","last_became_active":"2023-10-18T14:02:32.449146+0000","last_became_peered":"2023-10-18T14:02:32.449146+0000","last_unstale":"2023-10-18T14:03:07.631949+0000","last_undegraded":"2023-10-18T14:03:07.631949+0000","last_fullsized":"2023-10-18T14:03:07.631949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:28.427003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634152+0000","last_change":"2023-10-18T14:02:32.448901+0000","last_active":"2023-10-18T14:03:07.634152+0000","last_peered":"2023-10-18T14:03:07.634152+0000","last_clean":"2023-10-18T14:03:07.634152+0000","last_became_active":"2023-10-18T14:02:32.448379+0000","last_became_peered":"2023-10-18T14:02:32.448379+0000","last_unstale":"2023-10-18T14:03:07.634152+0000","last_undegraded":"2023-10-18T14:03:07.634152+0000","last_fullsized":"2023-10-18T14:03:07.634152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:53:22.743915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632688+0000","last_change":"2023-10-18T14:02:32.446575+0000","last_active":"2023-10-18T14:03:07.632688+0000","last_peered":"2023-10-18T14:03:07.632688+0000","last_clean":"2023-10-18T14:03:07.632688+0000","last_became_active":"2023-10-18T14:02:32.445756+0000","last_became_peered":"2023-10-18T14:02:32.445756+0000","last_unstale":"2023-10-18T14:03:07.632688+0000","last_undegraded":"2023-10-18T14:03:07.632688+0000","last_fullsized":"2023-10-18T14:03:07.632688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:55.490373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630414+0000","last_change":"2023-10-18T14:02:32.460943+0000","last_active":"2023-10-18T14:03:07.630414+0000","last_peered":"2023-10-18T14:03:07.630414+0000","last_clean":"2023-10-18T14:03:07.630414+0000","last_became_active":"2023-10-18T14:02:32.460540+0000","last_became_peered":"2023-10-18T14:02:32.460540+0000","last_unstale":"2023-10-18T14:03:07.630414+0000","last_undegraded":"2023-10-18T14:03:07.630414+0000","last_fullsized":"2023-10-18T14:03:07.630414+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:44:59.309663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628177+0000","last_change":"2023-10-18T14:02:32.450665+0000","last_active":"2023-10-18T14:03:07.628177+0000","last_peered":"2023-10-18T14:03:07.628177+0000","last_clean":"2023-10-18T14:03:07.628177+0000","last_became_active":"2023-10-18T14:02:32.450286+0000","last_became_peered":"2023-10-18T14:02:32.450286+0000","last_unstale":"2023-10-18T14:03:07.628177+0000","last_undegraded":"2023-10-18T14:03:07.628177+0000","last_fullsized":"2023-10-18T14:03:07.628177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:01:17.874856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633946+0000","last_change":"2023-10-18T14:02:32.444129+0000","last_active":"2023-10-18T14:03:07.633946+0000","last_peered":"2023-10-18T14:03:07.633946+0000","last_clean":"2023-10-18T14:03:07.633946+0000","last_became_active":"2023-10-18T14:02:32.443898+0000","last_became_peered":"2023-10-18T14:02:32.443898+0000","last_unstale":"2023-10-18T14:03:07.633946+0000","last_undegraded":"2023-10-18T14:03:07.633946+0000","last_fullsized":"2023-10-18T14:03:07.633946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:20:35.391806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631518+0000","last_change":"2023-10-18T14:02:32.457637+0000","last_active":"2023-10-18T14:03:07.631518+0000","last_peered":"2023-10-18T14:03:07.631518+0000","last_clean":"2023-10-18T14:03:07.631518+0000","last_became_active":"2023-10-18T14:02:32.457345+0000","last_became_peered":"2023-10-18T14:02:32.457345+0000","last_unstale":"2023-10-18T14:03:07.631518+0000","last_undegraded":"2023-10-18T14:03:07.631518+0000","last_fullsized":"2023-10-18T14:03:07.631518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:18:47.579689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631487+0000","last_change":"2023-10-18T14:02:32.449765+0000","last_active":"2023-10-18T14:03:07.631487+0000","last_peered":"2023-10-18T14:03:07.631487+0000","last_clean":"2023-10-18T14:03:07.631487+0000","last_became_active":"2023-10-18T14:02:32.449467+0000","last_became_peered":"2023-10-18T14:02:32.449467+0000","last_unstale":"2023-10-18T14:03:07.631487+0000","last_undegraded":"2023-10-18T14:03:07.631487+0000","last_fullsized":"2023-10-18T14:03:07.631487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:09:15.324290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633644+0000","last_change":"2023-10-18T14:02:32.456634+0000","last_active":"2023-10-18T14:03:07.633644+0000","last_peered":"2023-10-18T14:03:07.633644+0000","last_clean":"2023-10-18T14:03:07.633644+0000","last_became_active":"2023-10-18T14:02:32.456336+0000","last_became_peered":"2023-10-18T14:02:32.456336+0000","last_unstale":"2023-10-18T14:03:07.633644+0000","last_undegraded":"2023-10-18T14:03:07.633644+0000","last_fullsized":"2023-10-18T14:03:07.633644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:29:47.973539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631514+0000","last_change":"2023-10-18T14:02:32.447357+0000","last_active":"2023-10-18T14:03:07.631514+0000","last_peered":"2023-10-18T14:03:07.631514+0000","last_clean":"2023-10-18T14:03:07.631514+0000","last_became_active":"2023-10-18T14:02:32.446756+0000","last_became_peered":"2023-10-18T14:02:32.446756+0000","last_unstale":"2023-10-18T14:03:07.631514+0000","last_undegraded":"2023-10-18T14:03:07.631514+0000","last_fullsized":"2023-10-18T14:03:07.631514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:13:22.467662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627607+0000","last_change":"2023-10-18T14:02:32.452786+0000","last_active":"2023-10-18T14:03:07.627607+0000","last_peered":"2023-10-18T14:03:07.627607+0000","last_clean":"2023-10-18T14:03:07.627607+0000","last_became_active":"2023-10-18T14:02:32.452551+0000","last_became_peered":"2023-10-18T14:02:32.452551+0000","last_unstale":"2023-10-18T14:03:07.627607+0000","last_undegraded":"2023-10-18T14:03:07.627607+0000","last_fullsized":"2023-10-18T14:03:07.627607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:07.709943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628230+0000","last_change":"2023-10-18T14:02:32.453264+0000","last_active":"2023-10-18T14:03:07.628230+0000","last_peered":"2023-10-18T14:03:07.628230+0000","last_clean":"2023-10-18T14:03:07.628230+0000","last_became_active":"2023-10-18T14:02:32.452948+0000","last_became_peered":"2023-10-18T14:02:32.452948+0000","last_unstale":"2023-10-18T14:03:07.628230+0000","last_undegraded":"2023-10-18T14:03:07.628230+0000","last_fullsized":"2023-10-18T14:03:07.628230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:00:55.243191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":106,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:54.395703+0000","last_change":"2023-10-18T14:02:31.843752+0000","last_active":"2023-10-18T14:03:54.395703+0000","last_peered":"2023-10-18T14:03:54.395703+0000","last_clean":"2023-10-18T14:03:54.395703+0000","last_became_active":"2023-10-18T14:02:31.843415+0000","last_became_peered":"2023-10-18T14:02:31.843415+0000","last_unstale":"2023-10-18T14:03:54.395703+0000","last_undegraded":"2023-10-18T14:03:54.395703+0000","last_fullsized":"2023-10-18T14:03:54.395703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:32:11.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633385+0000","last_change":"2023-10-18T14:02:32.458934+0000","last_active":"2023-10-18T14:03:07.633385+0000","last_peered":"2023-10-18T14:03:07.633385+0000","last_clean":"2023-10-18T14:03:07.633385+0000","last_became_active":"2023-10-18T14:02:32.458624+0000","last_became_peered":"2023-10-18T14:02:32.458624+0000","last_unstale":"2023-10-18T14:03:07.633385+0000","last_undegraded":"2023-10-18T14:03:07.633385+0000","last_fullsized":"2023-10-18T14:03:07.633385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:24:20.034637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633439+0000","last_change":"2023-10-18T14:02:31.842666+0000","last_active":"2023-10-18T14:03:07.633439+0000","last_peered":"2023-10-18T14:03:07.633439+0000","last_clean":"2023-10-18T14:03:07.633439+0000","last_became_active":"2023-10-18T14:02:31.842366+0000","last_became_peered":"2023-10-18T14:02:31.842366+0000","last_unstale":"2023-10-18T14:03:07.633439+0000","last_undegraded":"2023-10-18T14:03:07.633439+0000","last_fullsized":"2023-10-18T14:03:07.633439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:11:08.150402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631653+0000","last_change":"2023-10-18T14:02:32.453731+0000","last_active":"2023-10-18T14:03:07.631653+0000","last_peered":"2023-10-18T14:03:07.631653+0000","last_clean":"2023-10-18T14:03:07.631653+0000","last_became_active":"2023-10-18T14:02:32.453405+0000","last_became_peered":"2023-10-18T14:02:32.453405+0000","last_unstale":"2023-10-18T14:03:07.631653+0000","last_undegraded":"2023-10-18T14:03:07.631653+0000","last_fullsized":"2023-10-18T14:03:07.631653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:19:57.878074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631664+0000","last_change":"2023-10-18T14:02:31.851514+0000","last_active":"2023-10-18T14:03:07.631664+0000","last_peered":"2023-10-18T14:03:07.631664+0000","last_clean":"2023-10-18T14:03:07.631664+0000","last_became_active":"2023-10-18T14:02:31.851236+0000","last_became_peered":"2023-10-18T14:02:31.851236+0000","last_unstale":"2023-10-18T14:03:07.631664+0000","last_undegraded":"2023-10-18T14:03:07.631664+0000","last_fullsized":"2023-10-18T14:03:07.631664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:35:26.804135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634258+0000","last_change":"2023-10-18T14:02:32.460018+0000","last_active":"2023-10-18T14:03:07.634258+0000","last_peered":"2023-10-18T14:03:07.634258+0000","last_clean":"2023-10-18T14:03:07.634258+0000","last_became_active":"2023-10-18T14:02:32.459738+0000","last_became_peered":"2023-10-18T14:02:32.459738+0000","last_unstale":"2023-10-18T14:03:07.634258+0000","last_undegraded":"2023-10-18T14:03:07.634258+0000","last_fullsized":"2023-10-18T14:03:07.634258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:48.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630318+0000","last_change":"2023-10-18T14:02:31.850112+0000","last_active":"2023-10-18T14:03:07.630318+0000","last_peered":"2023-10-18T14:03:07.630318+0000","last_clean":"2023-10-18T14:03:07.630318+0000","last_became_active":"2023-10-18T14:02:31.849515+0000","last_became_peered":"2023-10-18T14:02:31.849515+0000","last_unstale":"2023-10-18T14:03:07.630318+0000","last_undegraded":"2023-10-18T14:03:07.630318+0000","last_fullsized":"2023-10-18T14:03:07.630318+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:35:20.338900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633120+0000","last_change":"2023-10-18T14:02:32.459221+0000","last_active":"2023-10-18T14:03:07.633120+0000","last_peered":"2023-10-18T14:03:07.633120+0000","last_clean":"2023-10-18T14:03:07.633120+0000","last_became_active":"2023-10-18T14:02:32.458912+0000","last_became_peered":"2023-10-18T14:02:32.458912+0000","last_unstale":"2023-10-18T14:03:07.633120+0000","last_undegraded":"2023-10-18T14:03:07.633120+0000","last_fullsized":"2023-10-18T14:03:07.633120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:54:02.630861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":103,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:55.375788+0000","last_change":"2023-10-18T14:02:31.846754+0000","last_active":"2023-10-18T14:03:55.375788+0000","last_peered":"2023-10-18T14:03:55.375788+0000","last_clean":"2023-10-18T14:03:55.375788+0000","last_became_active":"2023-10-18T14:02:31.846450+0000","last_became_peered":"2023-10-18T14:02:31.846450+0000","last_unstale":"2023-10-18T14:03:55.375788+0000","last_undegraded":"2023-10-18T14:03:55.375788+0000","last_fullsized":"2023-10-18T14:03:55.375788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:11.929528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.638502+0000","last_change":"2023-10-18T14:03:08.638502+0000","last_active":"2023-10-18T14:03:08.638502+0000","last_peered":"2023-10-18T14:03:08.638502+0000","last_clean":"2023-10-18T14:03:08.638502+0000","last_became_active":"2023-10-18T14:03:08.638101+0000","last_became_peered":"2023-10-18T14:03:08.638101+0000","last_unstale":"2023-10-18T14:03:08.638502+0000","last_undegraded":"2023-10-18T14:03:08.638502+0000","last_fullsized":"2023-10-18T14:03:08.638502+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:56:47.297642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632268+0000","last_change":"2023-10-18T14:02:31.846135+0000","last_active":"2023-10-18T14:03:07.632268+0000","last_peered":"2023-10-18T14:03:07.632268+0000","last_clean":"2023-10-18T14:03:07.632268+0000","last_became_active":"2023-10-18T14:02:31.845800+0000","last_became_peered":"2023-10-18T14:02:31.845800+0000","last_unstale":"2023-10-18T14:03:07.632268+0000","last_undegraded":"2023-10-18T14:03:07.632268+0000","last_fullsized":"2023-10-18T14:03:07.632268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:22:55.945930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633140+0000","last_change":"2023-10-18T14:02:32.445803+0000","last_active":"2023-10-18T14:03:07.633140+0000","last_peered":"2023-10-18T14:03:07.633140+0000","last_clean":"2023-10-18T14:03:07.633140+0000","last_became_active":"2023-10-18T14:02:32.445489+0000","last_became_peered":"2023-10-18T14:02:32.445489+0000","last_unstale":"2023-10-18T14:03:07.633140+0000","last_undegraded":"2023-10-18T14:03:07.633140+0000","last_fullsized":"2023-10-18T14:03:07.633140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:38:46.101215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632990+0000","last_change":"2023-10-18T14:02:31.843827+0000","last_active":"2023-10-18T14:03:07.632990+0000","last_peered":"2023-10-18T14:03:07.632990+0000","last_clean":"2023-10-18T14:03:07.632990+0000","last_became_active":"2023-10-18T14:02:31.843533+0000","last_became_peered":"2023-10-18T14:02:31.843533+0000","last_unstale":"2023-10-18T14:03:07.632990+0000","last_undegraded":"2023-10-18T14:03:07.632990+0000","last_fullsized":"2023-10-18T14:03:07.632990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:00:03.832002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632031+0000","last_change":"2023-10-18T14:02:32.447400+0000","last_active":"2023-10-18T14:03:07.632031+0000","last_peered":"2023-10-18T14:03:07.632031+0000","last_clean":"2023-10-18T14:03:07.632031+0000","last_became_active":"2023-10-18T14:02:32.447024+0000","last_became_peered":"2023-10-18T14:02:32.447024+0000","last_unstale":"2023-10-18T14:03:07.632031+0000","last_undegraded":"2023-10-18T14:03:07.632031+0000","last_fullsized":"2023-10-18T14:03:07.632031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:49:37.596273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632467+0000","last_change":"2023-10-18T14:02:31.847527+0000","last_active":"2023-10-18T14:03:07.632467+0000","last_peered":"2023-10-18T14:03:07.632467+0000","last_clean":"2023-10-18T14:03:07.632467+0000","last_became_active":"2023-10-18T14:02:31.847249+0000","last_became_peered":"2023-10-18T14:02:31.847249+0000","last_unstale":"2023-10-18T14:03:07.632467+0000","last_undegraded":"2023-10-18T14:03:07.632467+0000","last_fullsized":"2023-10-18T14:03:07.632467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:11:34.217776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627384+0000","last_change":"2023-10-18T14:02:32.452268+0000","last_active":"2023-10-18T14:03:07.627384+0000","last_peered":"2023-10-18T14:03:07.627384+0000","last_clean":"2023-10-18T14:03:07.627384+0000","last_became_active":"2023-10-18T14:02:32.451338+0000","last_became_peered":"2023-10-18T14:02:32.451338+0000","last_unstale":"2023-10-18T14:03:07.627384+0000","last_undegraded":"2023-10-18T14:03:07.627384+0000","last_fullsized":"2023-10-18T14:03:07.627384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:17:11.743280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":173,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:54.373507+0000","last_change":"2023-10-18T14:02:31.841862+0000","last_active":"2023-10-18T14:03:54.373507+0000","last_peered":"2023-10-18T14:03:54.373507+0000","last_clean":"2023-10-18T14:03:54.373507+0000","last_became_active":"2023-10-18T14:02:31.841481+0000","last_became_peered":"2023-10-18T14:02:31.841481+0000","last_unstale":"2023-10-18T14:03:54.373507+0000","last_undegraded":"2023-10-18T14:03:54.373507+0000","last_fullsized":"2023-10-18T14:03:54.373507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:38:26.263626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":154,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633941+0000","last_change":"2023-10-18T14:02:32.447608+0000","last_active":"2023-10-18T14:03:07.633941+0000","last_peered":"2023-10-18T14:03:07.633941+0000","last_clean":"2023-10-18T14:03:07.633941+0000","last_became_active":"2023-10-18T14:02:32.447057+0000","last_became_peered":"2023-10-18T14:02:32.447057+0000","last_unstale":"2023-10-18T14:03:07.633941+0000","last_undegraded":"2023-10-18T14:03:07.633941+0000","last_fullsized":"2023-10-18T14:03:07.633941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:33:43.469496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630438+0000","last_change":"2023-10-18T14:02:31.849118+0000","last_active":"2023-10-18T14:03:07.630438+0000","last_peered":"2023-10-18T14:03:07.630438+0000","last_clean":"2023-10-18T14:03:07.630438+0000","last_became_active":"2023-10-18T14:02:31.848827+0000","last_became_peered":"2023-10-18T14:02:31.848827+0000","last_unstale":"2023-10-18T14:03:07.630438+0000","last_undegraded":"2023-10-18T14:03:07.630438+0000","last_fullsized":"2023-10-18T14:03:07.630438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:41:17.309102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631773+0000","last_change":"2023-10-18T14:02:32.447157+0000","last_active":"2023-10-18T14:03:07.631773+0000","last_peered":"2023-10-18T14:03:07.631773+0000","last_clean":"2023-10-18T14:03:07.631773+0000","last_became_active":"2023-10-18T14:02:32.446861+0000","last_became_peered":"2023-10-18T14:02:32.446861+0000","last_unstale":"2023-10-18T14:03:07.631773+0000","last_undegraded":"2023-10-18T14:03:07.631773+0000","last_fullsized":"2023-10-18T14:03:07.631773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:58:58.146931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633247+0000","last_change":"2023-10-18T14:02:31.838819+0000","last_active":"2023-10-18T14:03:07.633247+0000","last_peered":"2023-10-18T14:03:07.633247+0000","last_clean":"2023-10-18T14:03:07.633247+0000","last_became_active":"2023-10-18T14:02:31.838488+0000","last_became_peered":"2023-10-18T14:02:31.838488+0000","last_unstale":"2023-10-18T14:03:07.633247+0000","last_undegraded":"2023-10-18T14:03:07.633247+0000","last_fullsized":"2023-10-18T14:03:07.633247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:41:37.569792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633964+0000","last_change":"2023-10-18T14:02:32.455108+0000","last_active":"2023-10-18T14:03:07.633964+0000","last_peered":"2023-10-18T14:03:07.633964+0000","last_clean":"2023-10-18T14:03:07.633964+0000","last_became_active":"2023-10-18T14:02:32.454821+0000","last_became_peered":"2023-10-18T14:02:32.454821+0000","last_unstale":"2023-10-18T14:03:07.633964+0000","last_undegraded":"2023-10-18T14:03:07.633964+0000","last_fullsized":"2023-10-18T14:03:07.633964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:00:29.617633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":205,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:54.373604+0000","last_change":"2023-10-18T14:02:31.847241+0000","last_active":"2023-10-18T14:03:54.373604+0000","last_peered":"2023-10-18T14:03:54.373604+0000","last_clean":"2023-10-18T14:03:54.373604+0000","last_became_active":"2023-10-18T14:02:31.846786+0000","last_became_peered":"2023-10-18T14:02:31.846786+0000","last_unstale":"2023-10-18T14:03:54.373604+0000","last_undegraded":"2023-10-18T14:03:54.373604+0000","last_fullsized":"2023-10-18T14:03:54.373604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:53:47.539696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58575,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":161,"num_read_kb":137,"num_write":31,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630833+0000","last_change":"2023-10-18T14:02:32.458530+0000","last_active":"2023-10-18T14:03:07.630833+0000","last_peered":"2023-10-18T14:03:07.630833+0000","last_clean":"2023-10-18T14:03:07.630833+0000","last_became_active":"2023-10-18T14:02:32.458199+0000","last_became_peered":"2023-10-18T14:02:32.458199+0000","last_unstale":"2023-10-18T14:03:07.630833+0000","last_undegraded":"2023-10-18T14:03:07.630833+0000","last_fullsized":"2023-10-18T14:03:07.630833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:52:16.107456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.656760+0000","last_change":"2023-10-18T14:03:08.656457+0000","last_active":"2023-10-18T14:03:08.656760+0000","last_peered":"2023-10-18T14:03:08.656760+0000","last_clean":"2023-10-18T14:03:08.656760+0000","last_became_active":"2023-10-18T14:03:08.638227+0000","last_became_peered":"2023-10-18T14:03:08.638227+0000","last_unstale":"2023-10-18T14:03:08.656760+0000","last_undegraded":"2023-10-18T14:03:08.656760+0000","last_fullsized":"2023-10-18T14:03:08.656760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:28:29.502844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633370+0000","last_change":"2023-10-18T14:02:32.456404+0000","last_active":"2023-10-18T14:03:07.633370+0000","last_peered":"2023-10-18T14:03:07.633370+0000","last_clean":"2023-10-18T14:03:07.633370+0000","last_became_active":"2023-10-18T14:02:32.456128+0000","last_became_peered":"2023-10-18T14:02:32.456128+0000","last_unstale":"2023-10-18T14:03:07.633370+0000","last_undegraded":"2023-10-18T14:03:07.633370+0000","last_fullsized":"2023-10-18T14:03:07.633370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:23:41.315513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633298+0000","last_change":"2023-10-18T14:02:31.846871+0000","last_active":"2023-10-18T14:03:07.633298+0000","last_peered":"2023-10-18T14:03:07.633298+0000","last_clean":"2023-10-18T14:03:07.633298+0000","last_became_active":"2023-10-18T14:02:31.846570+0000","last_became_peered":"2023-10-18T14:02:31.846570+0000","last_unstale":"2023-10-18T14:03:07.633298+0000","last_undegraded":"2023-10-18T14:03:07.633298+0000","last_fullsized":"2023-10-18T14:03:07.633298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:38:46.096769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.632825+0000","last_change":"2023-10-18T14:03:08.632825+0000","last_active":"2023-10-18T14:03:08.632825+0000","last_peered":"2023-10-18T14:03:08.632825+0000","last_clean":"2023-10-18T14:03:08.632825+0000","last_became_active":"2023-10-18T14:03:08.632453+0000","last_became_peered":"2023-10-18T14:03:08.632453+0000","last_unstale":"2023-10-18T14:03:08.632825+0000","last_undegraded":"2023-10-18T14:03:08.632825+0000","last_fullsized":"2023-10-18T14:03:08.632825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:30.707828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":100,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:54.373805+0000","last_change":"2023-10-18T14:02:31.844367+0000","last_active":"2023-10-18T14:03:54.373805+0000","last_peered":"2023-10-18T14:03:54.373805+0000","last_clean":"2023-10-18T14:03:54.373805+0000","last_became_active":"2023-10-18T14:02:31.844060+0000","last_became_peered":"2023-10-18T14:02:31.844060+0000","last_unstale":"2023-10-18T14:03:54.373805+0000","last_undegraded":"2023-10-18T14:03:54.373805+0000","last_fullsized":"2023-10-18T14:03:54.373805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:06:09.656240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629934+0000","last_change":"2023-10-18T14:02:32.464529+0000","last_active":"2023-10-18T14:03:07.629934+0000","last_peered":"2023-10-18T14:03:07.629934+0000","last_clean":"2023-10-18T14:03:07.629934+0000","last_became_active":"2023-10-18T14:02:32.464232+0000","last_became_peered":"2023-10-18T14:02:32.464232+0000","last_unstale":"2023-10-18T14:03:07.629934+0000","last_undegraded":"2023-10-18T14:03:07.629934+0000","last_fullsized":"2023-10-18T14:03:07.629934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:10:43.011803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629881+0000","last_change":"2023-10-18T14:02:31.850537+0000","last_active":"2023-10-18T14:03:07.629881+0000","last_peered":"2023-10-18T14:03:07.629881+0000","last_clean":"2023-10-18T14:03:07.629881+0000","last_became_active":"2023-10-18T14:02:31.849391+0000","last_became_peered":"2023-10-18T14:02:31.849391+0000","last_unstale":"2023-10-18T14:03:07.629881+0000","last_undegraded":"2023-10-18T14:03:07.629881+0000","last_fullsized":"2023-10-18T14:03:07.629881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:19:31.270179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.635208+0000","last_change":"2023-10-18T14:03:08.635208+0000","last_active":"2023-10-18T14:03:08.635208+0000","last_peered":"2023-10-18T14:03:08.635208+0000","last_clean":"2023-10-18T14:03:08.635208+0000","last_became_active":"2023-10-18T14:03:08.634800+0000","last_became_peered":"2023-10-18T14:03:08.634800+0000","last_unstale":"2023-10-18T14:03:08.635208+0000","last_undegraded":"2023-10-18T14:03:08.635208+0000","last_fullsized":"2023-10-18T14:03:08.635208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:36:00.844237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631121+0000","last_change":"2023-10-18T14:02:31.850706+0000","last_active":"2023-10-18T14:03:07.631121+0000","last_peered":"2023-10-18T14:03:07.631121+0000","last_clean":"2023-10-18T14:03:07.631121+0000","last_became_active":"2023-10-18T14:02:31.849354+0000","last_became_peered":"2023-10-18T14:02:31.849354+0000","last_unstale":"2023-10-18T14:03:07.631121+0000","last_undegraded":"2023-10-18T14:03:07.631121+0000","last_fullsized":"2023-10-18T14:03:07.631121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:51:31.071528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631242+0000","last_change":"2023-10-18T14:02:32.454196+0000","last_active":"2023-10-18T14:03:07.631242+0000","last_peered":"2023-10-18T14:03:07.631242+0000","last_clean":"2023-10-18T14:03:07.631242+0000","last_became_active":"2023-10-18T14:02:32.453861+0000","last_became_peered":"2023-10-18T14:02:32.453861+0000","last_unstale":"2023-10-18T14:03:07.631242+0000","last_undegraded":"2023-10-18T14:03:07.631242+0000","last_fullsized":"2023-10-18T14:03:07.631242+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:43.217757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627432+0000","last_change":"2023-10-18T14:02:31.849707+0000","last_active":"2023-10-18T14:03:07.627432+0000","last_peered":"2023-10-18T14:03:07.627432+0000","last_clean":"2023-10-18T14:03:07.627432+0000","last_became_active":"2023-10-18T14:02:31.849442+0000","last_became_peered":"2023-10-18T14:02:31.849442+0000","last_unstale":"2023-10-18T14:03:07.627432+0000","last_undegraded":"2023-10-18T14:03:07.627432+0000","last_fullsized":"2023-10-18T14:03:07.627432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:39:15.669730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632631+0000","last_change":"2023-10-18T14:02:32.457433+0000","last_active":"2023-10-18T14:03:07.632631+0000","last_peered":"2023-10-18T14:03:07.632631+0000","last_clean":"2023-10-18T14:03:07.632631+0000","last_became_active":"2023-10-18T14:02:32.457057+0000","last_became_peered":"2023-10-18T14:02:32.457057+0000","last_unstale":"2023-10-18T14:03:07.632631+0000","last_undegraded":"2023-10-18T14:03:07.632631+0000","last_fullsized":"2023-10-18T14:03:07.632631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:53.088723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'6","reported_seq":102,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:57.400429+0000","last_change":"2023-10-18T14:02:31.848595+0000","last_active":"2023-10-18T14:03:57.400429+0000","last_peered":"2023-10-18T14:03:57.400429+0000","last_clean":"2023-10-18T14:03:57.400429+0000","last_became_active":"2023-10-18T14:02:31.847987+0000","last_became_peered":"2023-10-18T14:02:31.847987+0000","last_unstale":"2023-10-18T14:03:57.400429+0000","last_undegraded":"2023-10-18T14:03:57.400429+0000","last_fullsized":"2023-10-18T14:03:57.400429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:03:34.356729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":906,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632829+0000","last_change":"2023-10-18T14:02:32.446514+0000","last_active":"2023-10-18T14:03:07.632829+0000","last_peered":"2023-10-18T14:03:07.632829+0000","last_clean":"2023-10-18T14:03:07.632829+0000","last_became_active":"2023-10-18T14:02:32.446015+0000","last_became_peered":"2023-10-18T14:02:32.446015+0000","last_unstale":"2023-10-18T14:03:07.632829+0000","last_undegraded":"2023-10-18T14:03:07.632829+0000","last_fullsized":"2023-10-18T14:03:07.632829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:21:09.897636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632600+0000","last_change":"2023-10-18T14:02:32.444969+0000","last_active":"2023-10-18T14:03:07.632600+0000","last_peered":"2023-10-18T14:03:07.632600+0000","last_clean":"2023-10-18T14:03:07.632600+0000","last_became_active":"2023-10-18T14:02:32.444592+0000","last_became_peered":"2023-10-18T14:02:32.444592+0000","last_unstale":"2023-10-18T14:03:07.632600+0000","last_undegraded":"2023-10-18T14:03:07.632600+0000","last_fullsized":"2023-10-18T14:03:07.632600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:02:58.377003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":101,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:56.375918+0000","last_change":"2023-10-18T14:02:31.847368+0000","last_active":"2023-10-18T14:03:56.375918+0000","last_peered":"2023-10-18T14:03:56.375918+0000","last_clean":"2023-10-18T14:03:56.375918+0000","last_became_active":"2023-10-18T14:02:31.847072+0000","last_became_peered":"2023-10-18T14:02:31.847072+0000","last_unstale":"2023-10-18T14:03:56.375918+0000","last_undegraded":"2023-10-18T14:03:56.375918+0000","last_fullsized":"2023-10-18T14:03:56.375918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:28:24.771284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.632551+0000","last_change":"2023-10-18T14:03:08.632138+0000","last_active":"2023-10-18T14:03:08.632551+0000","last_peered":"2023-10-18T14:03:08.632551+0000","last_clean":"2023-10-18T14:03:08.632551+0000","last_became_active":"2023-10-18T14:03:08.631902+0000","last_became_peered":"2023-10-18T14:03:08.631902+0000","last_unstale":"2023-10-18T14:03:08.632551+0000","last_undegraded":"2023-10-18T14:03:08.632551+0000","last_fullsized":"2023-10-18T14:03:08.632551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:31:10.646568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628041+0000","last_change":"2023-10-18T14:02:31.843678+0000","last_active":"2023-10-18T14:03:07.628041+0000","last_peered":"2023-10-18T14:03:07.628041+0000","last_clean":"2023-10-18T14:03:07.628041+0000","last_became_active":"2023-10-18T14:02:31.843332+0000","last_became_peered":"2023-10-18T14:02:31.843332+0000","last_unstale":"2023-10-18T14:03:07.628041+0000","last_undegraded":"2023-10-18T14:03:07.628041+0000","last_fullsized":"2023-10-18T14:03:07.628041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:06:04.549859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":321,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630029+0000","last_change":"2023-10-18T14:01:34.022246+0000","last_active":"2023-10-18T14:03:07.630029+0000","last_peered":"2023-10-18T14:03:07.630029+0000","last_clean":"2023-10-18T14:03:07.630029+0000","last_became_active":"2023-10-18T14:01:34.021768+0000","last_became_peered":"2023-10-18T14:01:34.021768+0000","last_unstale":"2023-10-18T14:03:07.630029+0000","last_undegraded":"2023-10-18T14:03:07.630029+0000","last_fullsized":"2023-10-18T14:03:07.630029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_clean_scrub_stamp":"2023-10-18T13:58:44.223424+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:48.521087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632798+0000","last_change":"2023-10-18T14:02:32.440662+0000","last_active":"2023-10-18T14:03:07.632798+0000","last_peered":"2023-10-18T14:03:07.632798+0000","last_clean":"2023-10-18T14:03:07.632798+0000","last_became_active":"2023-10-18T14:02:32.440345+0000","last_became_peered":"2023-10-18T14:02:32.440345+0000","last_unstale":"2023-10-18T14:03:07.632798+0000","last_undegraded":"2023-10-18T14:03:07.632798+0000","last_fullsized":"2023-10-18T14:03:07.632798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:21.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630113+0000","last_change":"2023-10-18T14:02:31.850243+0000","last_active":"2023-10-18T14:03:07.630113+0000","last_peered":"2023-10-18T14:03:07.630113+0000","last_clean":"2023-10-18T14:03:07.630113+0000","last_became_active":"2023-10-18T14:02:31.849952+0000","last_became_peered":"2023-10-18T14:02:31.849952+0000","last_unstale":"2023-10-18T14:03:07.630113+0000","last_undegraded":"2023-10-18T14:03:07.630113+0000","last_fullsized":"2023-10-18T14:03:07.630113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:11:50.877219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.647452+0000","last_change":"2023-10-18T14:03:08.647076+0000","last_active":"2023-10-18T14:03:08.647452+0000","last_peered":"2023-10-18T14:03:08.647452+0000","last_clean":"2023-10-18T14:03:08.647452+0000","last_became_active":"2023-10-18T14:03:08.637530+0000","last_became_peered":"2023-10-18T14:03:08.637530+0000","last_unstale":"2023-10-18T14:03:08.647452+0000","last_undegraded":"2023-10-18T14:03:08.647452+0000","last_fullsized":"2023-10-18T14:03:08.647452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:33.344068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633493+0000","last_change":"2023-10-18T14:02:32.445046+0000","last_active":"2023-10-18T14:03:07.633493+0000","last_peered":"2023-10-18T14:03:07.633493+0000","last_clean":"2023-10-18T14:03:07.633493+0000","last_became_active":"2023-10-18T14:02:32.444827+0000","last_became_peered":"2023-10-18T14:02:32.444827+0000","last_unstale":"2023-10-18T14:03:07.633493+0000","last_undegraded":"2023-10-18T14:03:07.633493+0000","last_fullsized":"2023-10-18T14:03:07.633493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:26:11.024405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627694+0000","last_change":"2023-10-18T14:02:31.846888+0000","last_active":"2023-10-18T14:03:07.627694+0000","last_peered":"2023-10-18T14:03:07.627694+0000","last_clean":"2023-10-18T14:03:07.627694+0000","last_became_active":"2023-10-18T14:02:31.846591+0000","last_became_peered":"2023-10-18T14:02:31.846591+0000","last_unstale":"2023-10-18T14:03:07.627694+0000","last_undegraded":"2023-10-18T14:03:07.627694+0000","last_fullsized":"2023-10-18T14:03:07.627694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:48:03.683135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633530+0000","last_change":"2023-10-18T14:02:32.456951+0000","last_active":"2023-10-18T14:03:07.633530+0000","last_peered":"2023-10-18T14:03:07.633530+0000","last_clean":"2023-10-18T14:03:07.633530+0000","last_became_active":"2023-10-18T14:02:32.456588+0000","last_became_peered":"2023-10-18T14:02:32.456588+0000","last_unstale":"2023-10-18T14:03:07.633530+0000","last_undegraded":"2023-10-18T14:03:07.633530+0000","last_fullsized":"2023-10-18T14:03:07.633530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:51:51.335310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628601+0000","last_change":"2023-10-18T14:02:31.845258+0000","last_active":"2023-10-18T14:03:07.628601+0000","last_peered":"2023-10-18T14:03:07.628601+0000","last_clean":"2023-10-18T14:03:07.628601+0000","last_became_active":"2023-10-18T14:02:31.844933+0000","last_became_peered":"2023-10-18T14:02:31.844933+0000","last_unstale":"2023-10-18T14:03:07.628601+0000","last_undegraded":"2023-10-18T14:03:07.628601+0000","last_fullsized":"2023-10-18T14:03:07.628601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:51:46.765525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631689+0000","last_change":"2023-10-18T14:02:32.454955+0000","last_active":"2023-10-18T14:03:07.631689+0000","last_peered":"2023-10-18T14:03:07.631689+0000","last_clean":"2023-10-18T14:03:07.631689+0000","last_became_active":"2023-10-18T14:02:32.454689+0000","last_became_peered":"2023-10-18T14:02:32.454689+0000","last_unstale":"2023-10-18T14:03:07.631689+0000","last_undegraded":"2023-10-18T14:03:07.631689+0000","last_fullsized":"2023-10-18T14:03:07.631689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:57:20.461517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633726+0000","last_change":"2023-10-18T14:02:31.849273+0000","last_active":"2023-10-18T14:03:07.633726+0000","last_peered":"2023-10-18T14:03:07.633726+0000","last_clean":"2023-10-18T14:03:07.633726+0000","last_became_active":"2023-10-18T14:02:31.848985+0000","last_became_peered":"2023-10-18T14:02:31.848985+0000","last_unstale":"2023-10-18T14:03:07.633726+0000","last_undegraded":"2023-10-18T14:03:07.633726+0000","last_fullsized":"2023-10-18T14:03:07.633726+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:55:54.516857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629855+0000","last_change":"2023-10-18T14:02:32.449557+0000","last_active":"2023-10-18T14:03:07.629855+0000","last_peered":"2023-10-18T14:03:07.629855+0000","last_clean":"2023-10-18T14:03:07.629855+0000","last_became_active":"2023-10-18T14:02:32.449033+0000","last_became_peered":"2023-10-18T14:02:32.449033+0000","last_unstale":"2023-10-18T14:03:07.629855+0000","last_undegraded":"2023-10-18T14:03:07.629855+0000","last_fullsized":"2023-10-18T14:03:07.629855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:32.983379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632227+0000","last_change":"2023-10-18T14:02:31.846109+0000","last_active":"2023-10-18T14:03:07.632227+0000","last_peered":"2023-10-18T14:03:07.632227+0000","last_clean":"2023-10-18T14:03:07.632227+0000","last_became_active":"2023-10-18T14:02:31.845236+0000","last_became_peered":"2023-10-18T14:02:31.845236+0000","last_unstale":"2023-10-18T14:03:07.632227+0000","last_undegraded":"2023-10-18T14:03:07.632227+0000","last_fullsized":"2023-10-18T14:03:07.632227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:46.880974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631047+0000","last_change":"2023-10-18T14:02:32.446465+0000","last_active":"2023-10-18T14:03:07.631047+0000","last_peered":"2023-10-18T14:03:07.631047+0000","last_clean":"2023-10-18T14:03:07.631047+0000","last_became_active":"2023-10-18T14:02:32.446172+0000","last_became_peered":"2023-10-18T14:02:32.446172+0000","last_unstale":"2023-10-18T14:03:07.631047+0000","last_undegraded":"2023-10-18T14:03:07.631047+0000","last_fullsized":"2023-10-18T14:03:07.631047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:14:40.094870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628081+0000","last_change":"2023-10-18T14:02:31.851198+0000","last_active":"2023-10-18T14:03:07.628081+0000","last_peered":"2023-10-18T14:03:07.628081+0000","last_clean":"2023-10-18T14:03:07.628081+0000","last_became_active":"2023-10-18T14:02:31.850524+0000","last_became_peered":"2023-10-18T14:02:31.850524+0000","last_unstale":"2023-10-18T14:03:07.628081+0000","last_undegraded":"2023-10-18T14:03:07.628081+0000","last_fullsized":"2023-10-18T14:03:07.628081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:13:44.133077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633065+0000","last_change":"2023-10-18T14:02:32.446732+0000","last_active":"2023-10-18T14:03:07.633065+0000","last_peered":"2023-10-18T14:03:07.633065+0000","last_clean":"2023-10-18T14:03:07.633065+0000","last_became_active":"2023-10-18T14:02:32.446418+0000","last_became_peered":"2023-10-18T14:02:32.446418+0000","last_unstale":"2023-10-18T14:03:07.633065+0000","last_undegraded":"2023-10-18T14:03:07.633065+0000","last_fullsized":"2023-10-18T14:03:07.633065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:13.765988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630012+0000","last_change":"2023-10-18T14:02:31.852648+0000","last_active":"2023-10-18T14:03:07.630012+0000","last_peered":"2023-10-18T14:03:07.630012+0000","last_clean":"2023-10-18T14:03:07.630012+0000","last_became_active":"2023-10-18T14:02:31.852361+0000","last_became_peered":"2023-10-18T14:02:31.852361+0000","last_unstale":"2023-10-18T14:03:07.630012+0000","last_undegraded":"2023-10-18T14:03:07.630012+0000","last_fullsized":"2023-10-18T14:03:07.630012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:54:28.189196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630302+0000","last_change":"2023-10-18T14:02:32.464220+0000","last_active":"2023-10-18T14:03:07.630302+0000","last_peered":"2023-10-18T14:03:07.630302+0000","last_clean":"2023-10-18T14:03:07.630302+0000","last_became_active":"2023-10-18T14:02:32.463213+0000","last_became_peered":"2023-10-18T14:02:32.463213+0000","last_unstale":"2023-10-18T14:03:07.630302+0000","last_undegraded":"2023-10-18T14:03:07.630302+0000","last_fullsized":"2023-10-18T14:03:07.630302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:53.777086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":103,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:57.378914+0000","last_change":"2023-10-18T14:02:31.848305+0000","last_active":"2023-10-18T14:03:57.378914+0000","last_peered":"2023-10-18T14:03:57.378914+0000","last_clean":"2023-10-18T14:03:57.378914+0000","last_became_active":"2023-10-18T14:02:31.847739+0000","last_became_peered":"2023-10-18T14:02:31.847739+0000","last_unstale":"2023-10-18T14:03:57.378914+0000","last_undegraded":"2023-10-18T14:03:57.378914+0000","last_fullsized":"2023-10-18T14:03:57.378914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:52:24.543703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630458+0000","last_change":"2023-10-18T14:02:32.460802+0000","last_active":"2023-10-18T14:03:07.630458+0000","last_peered":"2023-10-18T14:03:07.630458+0000","last_clean":"2023-10-18T14:03:07.630458+0000","last_became_active":"2023-10-18T14:02:32.460160+0000","last_became_peered":"2023-10-18T14:02:32.460160+0000","last_unstale":"2023-10-18T14:03:07.630458+0000","last_undegraded":"2023-10-18T14:03:07.630458+0000","last_fullsized":"2023-10-18T14:03:07.630458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:20:55.614142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633018+0000","last_change":"2023-10-18T14:02:31.845468+0000","last_active":"2023-10-18T14:03:07.633018+0000","last_peered":"2023-10-18T14:03:07.633018+0000","last_clean":"2023-10-18T14:03:07.633018+0000","last_became_active":"2023-10-18T14:02:31.845057+0000","last_became_peered":"2023-10-18T14:02:31.845057+0000","last_unstale":"2023-10-18T14:03:07.633018+0000","last_undegraded":"2023-10-18T14:03:07.633018+0000","last_fullsized":"2023-10-18T14:03:07.633018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:08:23.972051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630377+0000","last_change":"2023-10-18T14:02:32.462572+0000","last_active":"2023-10-18T14:03:07.630377+0000","last_peered":"2023-10-18T14:03:07.630377+0000","last_clean":"2023-10-18T14:03:07.630377+0000","last_became_active":"2023-10-18T14:02:32.462140+0000","last_became_peered":"2023-10-18T14:02:32.462140+0000","last_unstale":"2023-10-18T14:03:07.630377+0000","last_undegraded":"2023-10-18T14:03:07.630377+0000","last_fullsized":"2023-10-18T14:03:07.630377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:03:34.605932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633629+0000","last_change":"2023-10-18T14:02:31.847322+0000","last_active":"2023-10-18T14:03:07.633629+0000","last_peered":"2023-10-18T14:03:07.633629+0000","last_clean":"2023-10-18T14:03:07.633629+0000","last_became_active":"2023-10-18T14:02:31.847008+0000","last_became_peered":"2023-10-18T14:02:31.847008+0000","last_unstale":"2023-10-18T14:03:07.633629+0000","last_undegraded":"2023-10-18T14:03:07.633629+0000","last_fullsized":"2023-10-18T14:03:07.633629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:59:18.850165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630579+0000","last_change":"2023-10-18T14:02:32.461592+0000","last_active":"2023-10-18T14:03:07.630579+0000","last_peered":"2023-10-18T14:03:07.630579+0000","last_clean":"2023-10-18T14:03:07.630579+0000","last_became_active":"2023-10-18T14:02:32.461265+0000","last_became_peered":"2023-10-18T14:02:32.461265+0000","last_unstale":"2023-10-18T14:03:07.630579+0000","last_undegraded":"2023-10-18T14:03:07.630579+0000","last_fullsized":"2023-10-18T14:03:07.630579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:03.315431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631175+0000","last_change":"2023-10-18T14:02:32.445480+0000","last_active":"2023-10-18T14:03:07.631175+0000","last_peered":"2023-10-18T14:03:07.631175+0000","last_clean":"2023-10-18T14:03:07.631175+0000","last_became_active":"2023-10-18T14:02:32.443036+0000","last_became_peered":"2023-10-18T14:02:32.443036+0000","last_unstale":"2023-10-18T14:03:07.631175+0000","last_undegraded":"2023-10-18T14:03:07.631175+0000","last_fullsized":"2023-10-18T14:03:07.631175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:59:57.637358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628022+0000","last_change":"2023-10-18T14:02:32.456400+0000","last_active":"2023-10-18T14:03:07.628022+0000","last_peered":"2023-10-18T14:03:07.628022+0000","last_clean":"2023-10-18T14:03:07.628022+0000","last_became_active":"2023-10-18T14:02:32.456072+0000","last_became_peered":"2023-10-18T14:02:32.456072+0000","last_unstale":"2023-10-18T14:03:07.628022+0000","last_undegraded":"2023-10-18T14:03:07.628022+0000","last_fullsized":"2023-10-18T14:03:07.628022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:22:59.844454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627995+0000","last_change":"2023-10-18T14:02:32.448089+0000","last_active":"2023-10-18T14:03:07.627995+0000","last_peered":"2023-10-18T14:03:07.627995+0000","last_clean":"2023-10-18T14:03:07.627995+0000","last_became_active":"2023-10-18T14:02:32.447866+0000","last_became_peered":"2023-10-18T14:02:32.447866+0000","last_unstale":"2023-10-18T14:03:07.627995+0000","last_undegraded":"2023-10-18T14:03:07.627995+0000","last_fullsized":"2023-10-18T14:03:07.627995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:28:35.558009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631717+0000","last_change":"2023-10-18T14:02:32.444103+0000","last_active":"2023-10-18T14:03:07.631717+0000","last_peered":"2023-10-18T14:03:07.631717+0000","last_clean":"2023-10-18T14:03:07.631717+0000","last_became_active":"2023-10-18T14:02:32.443762+0000","last_became_peered":"2023-10-18T14:02:32.443762+0000","last_unstale":"2023-10-18T14:03:07.631717+0000","last_undegraded":"2023-10-18T14:03:07.631717+0000","last_fullsized":"2023-10-18T14:03:07.631717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:47.695764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633454+0000","last_change":"2023-10-18T14:02:32.449409+0000","last_active":"2023-10-18T14:03:07.633454+0000","last_peered":"2023-10-18T14:03:07.633454+0000","last_clean":"2023-10-18T14:03:07.633454+0000","last_became_active":"2023-10-18T14:02:32.449114+0000","last_became_peered":"2023-10-18T14:02:32.449114+0000","last_unstale":"2023-10-18T14:03:07.633454+0000","last_undegraded":"2023-10-18T14:03:07.633454+0000","last_fullsized":"2023-10-18T14:03:07.633454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:59:45.167577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631298+0000","last_change":"2023-10-18T14:02:32.452013+0000","last_active":"2023-10-18T14:03:07.631298+0000","last_peered":"2023-10-18T14:03:07.631298+0000","last_clean":"2023-10-18T14:03:07.631298+0000","last_became_active":"2023-10-18T14:02:32.451734+0000","last_became_peered":"2023-10-18T14:02:32.451734+0000","last_unstale":"2023-10-18T14:03:07.631298+0000","last_undegraded":"2023-10-18T14:03:07.631298+0000","last_fullsized":"2023-10-18T14:03:07.631298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:15:44.511378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629153+0000","last_change":"2023-10-18T14:02:32.445503+0000","last_active":"2023-10-18T14:03:07.629153+0000","last_peered":"2023-10-18T14:03:07.629153+0000","last_clean":"2023-10-18T14:03:07.629153+0000","last_became_active":"2023-10-18T14:02:32.445172+0000","last_became_peered":"2023-10-18T14:02:32.445172+0000","last_unstale":"2023-10-18T14:03:07.629153+0000","last_undegraded":"2023-10-18T14:03:07.629153+0000","last_fullsized":"2023-10-18T14:03:07.629153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:23:08.456949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633490+0000","last_change":"2023-10-18T14:02:32.459690+0000","last_active":"2023-10-18T14:03:07.633490+0000","last_peered":"2023-10-18T14:03:07.633490+0000","last_clean":"2023-10-18T14:03:07.633490+0000","last_became_active":"2023-10-18T14:02:32.459373+0000","last_became_peered":"2023-10-18T14:02:32.459373+0000","last_unstale":"2023-10-18T14:03:07.633490+0000","last_undegraded":"2023-10-18T14:03:07.633490+0000","last_fullsized":"2023-10-18T14:03:07.633490+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:36.092029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632468+0000","last_change":"2023-10-18T14:02:32.455076+0000","last_active":"2023-10-18T14:03:07.632468+0000","last_peered":"2023-10-18T14:03:07.632468+0000","last_clean":"2023-10-18T14:03:07.632468+0000","last_became_active":"2023-10-18T14:02:32.454750+0000","last_became_peered":"2023-10-18T14:02:32.454750+0000","last_unstale":"2023-10-18T14:03:07.632468+0000","last_undegraded":"2023-10-18T14:03:07.632468+0000","last_fullsized":"2023-10-18T14:03:07.632468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:08:00.855583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632303+0000","last_change":"2023-10-18T14:02:32.450714+0000","last_active":"2023-10-18T14:03:07.632303+0000","last_peered":"2023-10-18T14:03:07.632303+0000","last_clean":"2023-10-18T14:03:07.632303+0000","last_became_active":"2023-10-18T14:02:32.450429+0000","last_became_peered":"2023-10-18T14:02:32.450429+0000","last_unstale":"2023-10-18T14:03:07.632303+0000","last_undegraded":"2023-10-18T14:03:07.632303+0000","last_fullsized":"2023-10-18T14:03:07.632303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:43:21.746296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634401+0000","last_change":"2023-10-18T14:02:32.457392+0000","last_active":"2023-10-18T14:03:07.634401+0000","last_peered":"2023-10-18T14:03:07.634401+0000","last_clean":"2023-10-18T14:03:07.634401+0000","last_became_active":"2023-10-18T14:02:32.457072+0000","last_became_peered":"2023-10-18T14:02:32.457072+0000","last_unstale":"2023-10-18T14:03:07.634401+0000","last_undegraded":"2023-10-18T14:03:07.634401+0000","last_fullsized":"2023-10-18T14:03:07.634401+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:19:51.691351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634009+0000","last_change":"2023-10-18T14:02:32.457541+0000","last_active":"2023-10-18T14:03:07.634009+0000","last_peered":"2023-10-18T14:03:07.634009+0000","last_clean":"2023-10-18T14:03:07.634009+0000","last_became_active":"2023-10-18T14:02:32.457266+0000","last_became_peered":"2023-10-18T14:02:32.457266+0000","last_unstale":"2023-10-18T14:03:07.634009+0000","last_undegraded":"2023-10-18T14:03:07.634009+0000","last_fullsized":"2023-10-18T14:03:07.634009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:41:16.131463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.636413+0000","last_change":"2023-10-18T14:03:08.636413+0000","last_active":"2023-10-18T14:03:08.636413+0000","last_peered":"2023-10-18T14:03:08.636413+0000","last_clean":"2023-10-18T14:03:08.636413+0000","last_became_active":"2023-10-18T14:03:08.635985+0000","last_became_peered":"2023-10-18T14:03:08.635985+0000","last_unstale":"2023-10-18T14:03:08.636413+0000","last_undegraded":"2023-10-18T14:03:08.636413+0000","last_fullsized":"2023-10-18T14:03:08.636413+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:53:28.848373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250031,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65705,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":820,"num_read_kb":479,"num_write":230,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":180,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":197751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449117,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":459517,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69899999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.47199999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.77400000000000002,"5min":1.226,"15min":1.226},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63200000000000001,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.76200000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.76200000000000001}]},{"osd":2,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79000000000000004,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45000000000000001},"min":{"1min":0.39100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":4,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.66300000000000003,"15min":0.65200000000000002},"min":{"1min":0.59799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.55800000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.012,"5min":1.119,"15min":1.119},"last":0.81000000000000005}]},{"osd":5,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.433,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.42799999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67200000000000004}]},{"osd":6,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.74399999999999999,"15min":0.73599999999999999},"min":{"1min":0.64300000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.54700000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91900000000000004,"5min":1.298,"15min":1.298},"last":0.88800000000000001}]},{"osd":8,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.75},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.83599999999999997}]},{"osd":9,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.748},"min":{"1min":0.59399999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88500000000000001,"5min":1.343,"15min":1.343},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.56399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.95399999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.90300000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.66000000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.96899999999999997,"5min":1.181,"15min":1.181},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.78300000000000003,"15min":0.78200000000000003},"min":{"1min":0.67600000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97899999999999998,"5min":1.482,"15min":1.482},"last":0.877}]}]},{"osd":10,"up_from":70,"seq":300647710751,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":1108616,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.68700000000000006}]},{"osd":1,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.32000000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59199999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.27800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.63400000000000001}]},{"osd":2,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78800000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71199999999999997}]},{"osd":3,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80800000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.746}]},{"osd":4,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.46600000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.433,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79200000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86299999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70599999999999996,"15min":0.70499999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95199999999999996,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.621}]},{"osd":6,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70999999999999996,"15min":0.71099999999999997},"min":{"1min":0.56200000000000006,"5min":0.378,"15min":0.378},"max":{"1min":0.878,"5min":1.006,"15min":1.006},"last":0.81499999999999995}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65100000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.621,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92000000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.61799999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.82899999999999996}]},{"osd":9,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.64100000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.53700000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90700000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.77700000000000002}]},{"osd":11,"last update":"Wed Oct 18 14:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.66500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92000000000000004,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.88900000000000001}]}]},{"osd":9,"up_from":65,"seq":279172874277,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":459267,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.501},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.32100000000000001}]},{"osd":1,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.495},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.48299999999999998}]},{"osd":2,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.30099999999999999}]},{"osd":4,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.52600000000000002}]},{"osd":5,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.73199999999999998,"15min":0.747},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36599999999999999,"5min":0.308,"15min":0.308},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.71699999999999997,"15min":0.73399999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59699999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.54200000000000004}]},{"osd":8,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75600000000000001,"15min":0.76800000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1080000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.67800000000000005}]},{"osd":10,"last update":"Wed Oct 18 14:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73899999999999999,"15min":0.75},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.70699999999999996}]}]},{"osd":8,"up_from":58,"seq":249108103209,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":459202,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70899999999999996,"5min":2.302,"15min":2.302},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54900000000000004,"15min":0.53500000000000003},"min":{"1min":0.39600000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69699999999999995,"5min":2.4380000000000002,"15min":2.4380000000000002},"last":0.53400000000000003}]},{"osd":1,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.61099999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.86299999999999999,"5min":0.875,"15min":0.875},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.64500000000000002,"15min":0.63100000000000001},"min":{"1min":0.54500000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.79600000000000004}]},{"osd":2,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.443,"15min":0.42099999999999999},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.44400000000000001},"min":{"1min":0.35199999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.67600000000000005}]},{"osd":3,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67000000000000004,"15min":0.61299999999999999},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3819999999999999,"5min":8.5980000000000008,"15min":8.5980000000000008},"last":0.623},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.58499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0720000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68600000000000005,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.65800000000000003,"15min":0.64300000000000002},"min":{"1min":0.59599999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85399999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.82599999999999996}]},{"osd":5,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.55400000000000005,"15min":0.52300000000000002},"min":{"1min":0.47799999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86099999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.55400000000000005},"min":{"1min":0.51500000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.95899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.89900000000000002}]},{"osd":6,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.751,"15min":0.70099999999999996},"min":{"1min":0.501,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.8819999999999999,"5min":7.4240000000000004,"15min":7.4240000000000004},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.72099999999999997},"min":{"1min":0.56599999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9259999999999999,"5min":11.095000000000001,"15min":11.095000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96299999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.76800000000000002,"15min":0.73499999999999999},"min":{"1min":0.63900000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.995}]},{"osd":9,"last update":"Wed Oct 18 14:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.77200000000000002,"15min":0.74099999999999999},"min":{"1min":0.59599999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.76100000000000001,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":0.91500000000000004}]},{"osd":10,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.81200000000000006,"15min":0.79200000000000004},"min":{"1min":0.73699999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.79500000000000004,"15min":0.78000000000000003},"min":{"1min":0.65300000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.93799999999999994}]},{"osd":11,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.92900000000000005}]}]},{"osd":7,"up_from":51,"seq":219043332141,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":1052486,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47599999999999998}]},{"osd":1,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.41499999999999998},"min":{"1min":0.35599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.625,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.45400000000000001,"15min":0.441},"min":{"1min":0.372,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.53300000000000003}]},{"osd":2,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80500000000000005,"5min":1.254,"15min":1.254},"last":0.67100000000000004}]},{"osd":3,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.748,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.46000000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59299999999999997}]},{"osd":4,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.51400000000000001,"15min":0.49199999999999999},"min":{"1min":0.38500000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.746,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.42399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68100000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.627,"15min":0.61299999999999999},"min":{"1min":0.48299999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.51400000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88600000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.88900000000000001}]},{"osd":6,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.66700000000000004,"15min":0.65100000000000002},"min":{"1min":0.52400000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.504,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.78000000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.70399999999999996}]},{"osd":8,"last update":"Wed Oct 18 14:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.55800000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.046,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79200000000000004,"15min":0.78700000000000003},"min":{"1min":0.70599999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.095,"5min":1.514,"15min":1.514},"last":0.93600000000000005}]},{"osd":9,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.83299999999999996,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.755},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73799999999999999,"15min":0.745},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.84199999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.73799999999999999}]},{"osd":10,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.66300000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72999999999999998,"15min":0.72299999999999998},"min":{"1min":0.504,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93200000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.82499999999999996}]},{"osd":11,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1,"5min":1,"15min":1},"last":0.84199999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495666,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":459308,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.38300000000000001,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.372,"15min":0.34200000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.32300000000000001}]},{"osd":1,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70699999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.5},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.67000000000000004}]},{"osd":2,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.55800000000000005},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72399999999999998,"5min":1.476,"15min":1.476},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40899999999999997,"15min":0.40000000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51800000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.434},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.46400000000000002}]},{"osd":4,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55400000000000005,"15min":0.52800000000000002},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56899999999999995,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77100000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.622,"15min":0.60199999999999998},"min":{"1min":0.434,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.63300000000000001}]},{"osd":7,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.45100000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.79400000000000004,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.64600000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.71299999999999997,"15min":0.747},"min":{"1min":0.52200000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77800000000000002,"5min":1.611,"15min":1.611},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.71099999999999997,"15min":0.72999999999999998},"min":{"1min":0.497,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77600000000000002,"5min":1.399,"15min":1.399},"last":0.62}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75900000000000001,"5min":1.415,"15min":1.415},"last":0.40400000000000003}]},{"osd":10,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72999999999999998,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76000000000000001,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.80500000000000005,"5min":1.448,"15min":1.448},"last":0.68100000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542215,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":519108,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51300000000000001,"15min":0.51200000000000001},"min":{"1min":0.35199999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.78600000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.38400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.85199999999999998,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.442}]},{"osd":2,"last update":"Wed Oct 18 14:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.60099999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91900000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.57999999999999996,"15min":0.54500000000000004},"min":{"1min":0.41899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.85499999999999998}]},{"osd":3,"last update":"Wed Oct 18 14:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.55200000000000005,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89500000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.5,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.54900000000000004}]},{"osd":4,"last update":"Wed Oct 18 14:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.438,"15min":0.39600000000000002},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.51000000000000001,"15min":0.442},"min":{"1min":0.36299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.60299999999999998},"min":{"1min":0.52500000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.63800000000000001,"15min":0.58599999999999997},"min":{"1min":0.57599999999999996,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.81299999999999994}]},{"osd":6,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.56599999999999995,"15min":0.53500000000000003},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81299999999999994,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.499},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61399999999999999,"15min":0.57899999999999996},"min":{"1min":0.52400000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93100000000000005,"5min":1.127,"15min":1.127},"last":0.63900000000000001}]},{"osd":7,"last update":"Wed Oct 18 14:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55600000000000005,"15min":0.53000000000000003},"min":{"1min":0.371,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.59099999999999997,"15min":0.55700000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68200000000000005}]},{"osd":8,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.72599999999999998,"15min":0.69199999999999995},"min":{"1min":0.57599999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.052,"5min":1.081,"15min":1.081},"last":0.875},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.66200000000000003,"15min":0.63100000000000001},"min":{"1min":0.59099999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.79700000000000004}]},{"osd":9,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.73599999999999999,"15min":0.71599999999999997},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.052,"5min":1.165,"15min":1.165},"last":0.83499999999999996}]},{"osd":10,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.64900000000000002,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.73999999999999999,"15min":0.72499999999999998},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.89800000000000002}]},{"osd":11,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.752},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.92400000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":460323,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 14:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56000000000000005,"15min":0.505},"min":{"1min":0.44800000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.41499999999999998},{"interface":"front","average":{"1min":1.925,"5min":0.81599999999999995,"15min":0.58599999999999997},"min":{"1min":0.35399999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":27.123000000000001,"5min":27.123000000000001,"15min":27.123000000000001},"last":0.40400000000000003}]},{"osd":2,"last update":"Wed Oct 18 14:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.51000000000000001},"min":{"1min":0.40899999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.9870000000000001,"5min":0.81799999999999995,"15min":0.59799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":27.222999999999999,"5min":27.222999999999999,"15min":27.222999999999999},"last":0.60099999999999998}]},{"osd":3,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Oct 18 14:03:30 2023","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":0.84399999999999997,"15min":0.65100000000000002},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":27.053999999999998,"5min":27.053999999999998,"15min":27.053999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.374}]},{"osd":5,"last update":"Wed Oct 18 14:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.47999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":2.0590000000000002,"5min":0.89200000000000002,"15min":0.69599999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":27.192,"5min":27.192,"15min":27.192},"last":0.55000000000000004}]},{"osd":6,"last update":"Wed Oct 18 14:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.60199999999999998,"15min":0.54300000000000004},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":8.7010000000000005,"5min":8.7010000000000005,"15min":8.7010000000000005},"last":0.312}]},{"osd":7,"last update":"Wed Oct 18 14:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60499999999999998}]},{"osd":8,"last update":"Wed Oct 18 14:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.50900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.56100000000000005},{"interface":"front","average":{"1min":2.121,"5min":0.98299999999999998,"15min":0.80500000000000005},"min":{"1min":0.497,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":26.992000000000001,"5min":26.992000000000001,"15min":26.992000000000001},"last":0.52600000000000002}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":3.262,"5min":3.262,"15min":3.262},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.51200000000000001}]},{"osd":10,"last update":"Wed Oct 18 14:03:30 2023","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":1.024,"15min":0.84799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":27.09,"5min":27.09,"15min":27.09},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":0.45600000000000002}]},{"osd":11,"last update":"Wed Oct 18 14:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.54300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.92200000000000004,"5min":1.55,"15min":1.55},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":1.8620000000000001,"15min":2.0590000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97599999999999998,"5min":27.154,"15min":27.154},"last":0.57499999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378691,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":518390,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73999999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.39400000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67800000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.626}]},{"osd":1,"last update":"Wed Oct 18 14:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.46999999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79200000000000004,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.58799999999999997,"15min":0.56000000000000005},"min":{"1min":0.46800000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.95699999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.88}]},{"osd":3,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.60299999999999998,"15min":0.56100000000000005},"min":{"1min":0.44700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.61199999999999999,"15min":0.58599999999999997},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.78500000000000003}]},{"osd":5,"last update":"Wed Oct 18 14:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.46300000000000002,"15min":0.437},"min":{"1min":0.34000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.503,"15min":0.44700000000000001},"min":{"1min":0.34799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53700000000000003}]},{"osd":6,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.34200000000000003}]},{"osd":8,"last update":"Wed Oct 18 14:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.59799999999999998,"15min":0.55600000000000005},"min":{"1min":0.434,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.64500000000000002,"15min":0.60399999999999998},"min":{"1min":0.46700000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.72099999999999997}]},{"osd":9,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.753},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89300000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.80500000000000005}]},{"osd":10,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.71499999999999997,"15min":0.69299999999999995},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.77600000000000002,"15min":0.754},"min":{"1min":0.72399999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.90500000000000003}]},{"osd":11,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.85299999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149758,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":458490,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.34899999999999998,"15min":0.32500000000000001},"min":{"1min":0.28199999999999997,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.56499999999999995,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.36699999999999999,"15min":0.35099999999999998},"min":{"1min":0.25800000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.51700000000000002},"min":{"1min":0.39400000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.78200000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54900000000000004,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53600000000000003,"15min":0.52100000000000002},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70499999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.51800000000000002},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.65900000000000003,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.65800000000000003}]},{"osd":4,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.44800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.75900000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.626}]},{"osd":5,"last update":"Wed Oct 18 14:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85199999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.70099999999999996,"15min":0.67300000000000004},"min":{"1min":0.45800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77500000000000002,"5min":6.5,"15min":6.5},"last":0.69599999999999995}]},{"osd":6,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.46999999999999997,"15min":0.48799999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.504,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.439},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74299999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.77900000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80500000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.63800000000000001}]},{"osd":8,"last update":"Wed Oct 18 14:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.56699999999999995}]},{"osd":9,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.58999999999999997,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.60899999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.66300000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60999999999999999}]},{"osd":10,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83399999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67800000000000005,"15min":0.68899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.749,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.73599999999999999}]},{"osd":11,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.70999999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888122,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":458845,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.42399999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Oct 18 14:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41499999999999998,"15min":0.38800000000000001},"min":{"1min":0.312,"5min":0.255,"15min":0.255},"max":{"1min":0.59599999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.38},"min":{"1min":0.27400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.54300000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Oct 18 14:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57499999999999996,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72099999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.61599999999999999}]},{"osd":3,"last update":"Wed Oct 18 14:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58199999999999996,"15min":0.55100000000000005},"min":{"1min":0.46700000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.57799999999999996,"15min":0.54200000000000004},"min":{"1min":0.40400000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":0.77200000000000002}]},{"osd":5,"last update":"Wed Oct 18 14:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.70499999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.61299999999999999,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.55000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.72299999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.60599999999999998,"15min":0.57599999999999996},"min":{"1min":0.53300000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86799999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.39300000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78800000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73799999999999999}]},{"osd":8,"last update":"Wed Oct 18 14:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.71799999999999997,"15min":0.69199999999999995},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97499999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89600000000000002,"5min":1.042,"15min":1.042},"last":0.79900000000000004}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.75700000000000001,"15min":0.73899999999999999},"min":{"1min":0.55900000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.60199999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.80900000000000005}]},{"osd":10,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77200000000000002,"15min":0.76600000000000001},"min":{"1min":0.66500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94199999999999995,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.46800000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.92100000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.82499999999999996}]},{"osd":11,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.871}]}]},{"osd":5,"up_from":39,"seq":167503724598,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":1051515,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51000000000000001,"15min":0.48299999999999998},"min":{"1min":0.34699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.71599999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.504,"15min":0.48499999999999999},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67200000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.436}]},{"osd":1,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.53400000000000003,"15min":0.499},"min":{"1min":0.36799999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.57599999999999996,"15min":0.52500000000000002},"min":{"1min":0.46600000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.73799999999999999}]},{"osd":2,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.41299999999999998,"15min":0.39000000000000001},"min":{"1min":0.34599999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.40699999999999997,"15min":0.375},"min":{"1min":0.29299999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40000000000000002}]},{"osd":3,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.36799999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.60499999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.503},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.51700000000000002},"min":{"1min":0.40799999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68500000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.60599999999999998,"15min":0.55200000000000005},"min":{"1min":0.52400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90200000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.57399999999999995,"15min":0.53200000000000003},"min":{"1min":0.55200000000000005,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77700000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.61899999999999999}]},{"osd":6,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46400000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.68100000000000005}]},{"osd":7,"last update":"Wed Oct 18 14:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.44,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78200000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65400000000000003}]},{"osd":8,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61099999999999999,"15min":0.60099999999999998},"min":{"1min":0.47999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66800000000000004}]},{"osd":9,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.70799999999999996,"15min":0.69999999999999996},"min":{"1min":0.54200000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.80000000000000004}]},{"osd":10,"last update":"Wed Oct 18 14:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.72199999999999998,"15min":0.70999999999999996},"min":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66400000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.79700000000000004,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T14:04:00.305 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T14:04:00.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.456+0000 7faa69a31700 1 -- 172.21.15.114:0/1344056705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa641006a0 msgr2=0x7faa64100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:00.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.456+0000 7faa69a31700 1 --2- 172.21.15.114:0/1344056705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa641006a0 0x7faa64100b20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009990 tx=0x7faa4c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.456+0000 7faa69a31700 1 -- 172.21.15.114:0/1344056705 shutdown_connections 2023-10-18T14:04:00.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.456+0000 7faa69a31700 1 --2- 172.21.15.114:0/1344056705 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa64101060 0x7faa6410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.456+0000 7faa69a31700 1 --2- 172.21.15.114:0/1344056705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa641066b0 0x7faa64106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.456+0000 7faa69a31700 1 --2- 172.21.15.114:0/1344056705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa641006a0 0x7faa64100b20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.456+0000 7faa69a31700 1 -- 172.21.15.114:0/1344056705 >> 172.21.15.114:0/1344056705 conn(0x7faa640fc1d0 msgr2=0x7faa640fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:00.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.456+0000 7faa69a31700 1 -- 172.21.15.114:0/1344056705 shutdown_connections 2023-10-18T14:04:00.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.456+0000 7faa69a31700 1 -- 172.21.15.114:0/1344056705 wait complete. 2023-10-18T14:04:00.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.456+0000 7faa69a31700 1 Processor -- start 2023-10-18T14:04:00.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.456+0000 7faa69a31700 1 -- start start 2023-10-18T14:04:00.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa69a31700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa641006a0 0x7faa6419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:00.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa69a31700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa64101060 0x7faa6419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:00.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa69a31700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa641066b0 0x7faa64194710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:00.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa69a31700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64194d70 con 0x7faa641006a0 2023-10-18T14:04:00.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa69a31700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64194ee0 con 0x7faa64101060 2023-10-18T14:04:00.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa69a31700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa641950a0 con 0x7faa641066b0 2023-10-18T14:04:00.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa62ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa641006a0 0x7faa6419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:00.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa62ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa641006a0 0x7faa6419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44070/0 (socket says 172.21.15.114:44070) 2023-10-18T14:04:00.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa62ffd700 1 -- 172.21.15.114:0/2879093686 learned_addr learned my addr 172.21.15.114:0/2879093686 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:00.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa637fe700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa641066b0 0x7faa64194710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:00.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa5a7fc700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa64101060 0x7faa6419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:00.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa62ffd700 1 -- 172.21.15.114:0/2879093686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa641066b0 msgr2=0x7faa64194710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:00.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa62ffd700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa641066b0 0x7faa64194710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa62ffd700 1 -- 172.21.15.114:0/2879093686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa64101060 msgr2=0x7faa6419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:00.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa62ffd700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa64101060 0x7faa6419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.457+0000 7faa62ffd700 1 -- 172.21.15.114:0/2879093686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0095f0 con 0x7faa641006a0 2023-10-18T14:04:00.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.458+0000 7faa62ffd700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa641006a0 0x7faa6419a5e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7faa5400e9a0 tx=0x7faa5400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:00.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.458+0000 7faa68a2f700 1 -- 172.21.15.114:0/2879093686 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54009790 con 0x7faa641006a0 2023-10-18T14:04:00.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.458+0000 7faa68a2f700 1 -- 172.21.15.114:0/2879093686 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa54010430 con 0x7faa641006a0 2023-10-18T14:04:00.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.458+0000 7faa69a31700 1 -- 172.21.15.114:0/2879093686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa64195380 con 0x7faa641006a0 2023-10-18T14:04:00.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.458+0000 7faa68a2f700 1 -- 172.21.15.114:0/2879093686 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54018680 con 0x7faa641006a0 2023-10-18T14:04:00.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.458+0000 7faa69a31700 1 -- 172.21.15.114:0/2879093686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa641a9de0 con 0x7faa641006a0 2023-10-18T14:04:00.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.459+0000 7faa69a31700 1 -- 172.21.15.114:0/2879093686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa64108c30 con 0x7faa641006a0 2023-10-18T14:04:00.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.460+0000 7faa68a2f700 1 -- 172.21.15.114:0/2879093686 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7faa540105a0 con 0x7faa641006a0 2023-10-18T14:04:00.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.461+0000 7faa68a2f700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faa500a1560 0x7faa500a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:00.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.461+0000 7faa5a7fc700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faa500a1560 0x7faa500a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:00.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.461+0000 7faa68a2f700 1 -- 172.21.15.114:0/2879093686 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7faa54014070 con 0x7faa641006a0 2023-10-18T14:04:00.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.461+0000 7faa5a7fc700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faa500a1560 0x7faa500a3a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faa64195e20 tx=0x7faa4c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:00.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.464+0000 7faa68a2f700 1 -- 172.21.15.114:0/2879093686 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faa54096710 con 0x7faa641006a0 2023-10-18T14:04:00.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:00 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2059295510' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:04:00.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:00 smithi172 ceph-mon[103574]: pgmap v279: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-18T14:04:00.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:00 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/581303793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:04:00.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:00 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2059295510' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:04:00.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:00 smithi114 ceph-mon[99494]: pgmap v279: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-18T14:04:00.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:00 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/581303793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:04:00.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.655+0000 7faa69a31700 1 -- 172.21.15.114:0/2879093686 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa64195bd0 con 0x7faa500a1560 2023-10-18T14:04:00.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.665+0000 7faa68a2f700 1 -- 172.21.15.114:0/2879093686 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344837 (secure 0 0 0) 0x7faa64195bd0 con 0x7faa500a1560 2023-10-18T14:04:00.672 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:04:00.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.668+0000 7faa69a31700 1 -- 172.21.15.114:0/2879093686 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faa500a1560 msgr2=0x7faa500a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:00.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.668+0000 7faa69a31700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faa500a1560 0x7faa500a3a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faa64195e20 tx=0x7faa4c005fb0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.668+0000 7faa69a31700 1 -- 172.21.15.114:0/2879093686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa641006a0 msgr2=0x7faa6419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.668+0000 7faa69a31700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa641006a0 0x7faa6419a5e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7faa5400e9a0 tx=0x7faa5400ecb0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.668+0000 7faa69a31700 1 -- 172.21.15.114:0/2879093686 shutdown_connections 2023-10-18T14:04:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.668+0000 7faa69a31700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7faa500a1560 0x7faa500a3a20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.668+0000 7faa69a31700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa641066b0 0x7faa64194710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.668+0000 7faa69a31700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa641006a0 0x7faa6419a5e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.668+0000 7faa69a31700 1 --2- 172.21.15.114:0/2879093686 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faa64101060 0x7faa6419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.668+0000 7faa69a31700 1 -- 172.21.15.114:0/2879093686 >> 172.21.15.114:0/2879093686 conn(0x7faa640fc1d0 msgr2=0x7faa640fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.668+0000 7faa69a31700 1 -- 172.21.15.114:0/2879093686 shutdown_connections 2023-10-18T14:04:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.668+0000 7faa69a31700 1 -- 172.21.15.114:0/2879093686 wait complete. 2023-10-18T14:04:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T14:04:00.686 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2023-10-18T14:03:59.579516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656319,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":956,"num_read_kb":598,"num_write":413,"num_write_kb":3067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180916,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335696,"kb_used_data":11448,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606128,"statfs":{"total":1151940427776,"available":1151596675072,"internally_reserved":0,"allocated":11722752,"data_stored":7465067,"data_compressed":177861,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":318,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":56,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003129"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631494+0000","last_change":"2023-10-18T14:02:32.447514+0000","last_active":"2023-10-18T14:03:07.631494+0000","last_peered":"2023-10-18T14:03:07.631494+0000","last_clean":"2023-10-18T14:03:07.631494+0000","last_became_active":"2023-10-18T14:02:32.447109+0000","last_became_peered":"2023-10-18T14:02:32.447109+0000","last_unstale":"2023-10-18T14:03:07.631494+0000","last_undegraded":"2023-10-18T14:03:07.631494+0000","last_fullsized":"2023-10-18T14:03:07.631494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:02:52.453371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631611+0000","last_change":"2023-10-18T14:02:32.457696+0000","last_active":"2023-10-18T14:03:07.631611+0000","last_peered":"2023-10-18T14:03:07.631611+0000","last_clean":"2023-10-18T14:03:07.631611+0000","last_became_active":"2023-10-18T14:02:32.457380+0000","last_became_peered":"2023-10-18T14:02:32.457380+0000","last_unstale":"2023-10-18T14:03:07.631611+0000","last_undegraded":"2023-10-18T14:03:07.631611+0000","last_fullsized":"2023-10-18T14:03:07.631611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:09:09.303044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632120+0000","last_change":"2023-10-18T14:02:32.450312+0000","last_active":"2023-10-18T14:03:07.632120+0000","last_peered":"2023-10-18T14:03:07.632120+0000","last_clean":"2023-10-18T14:03:07.632120+0000","last_became_active":"2023-10-18T14:02:32.449994+0000","last_became_peered":"2023-10-18T14:02:32.449994+0000","last_unstale":"2023-10-18T14:03:07.632120+0000","last_undegraded":"2023-10-18T14:03:07.632120+0000","last_fullsized":"2023-10-18T14:03:07.632120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:28:32.445958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628336+0000","last_change":"2023-10-18T14:02:32.450511+0000","last_active":"2023-10-18T14:03:07.628336+0000","last_peered":"2023-10-18T14:03:07.628336+0000","last_clean":"2023-10-18T14:03:07.628336+0000","last_became_active":"2023-10-18T14:02:32.450105+0000","last_became_peered":"2023-10-18T14:02:32.450105+0000","last_unstale":"2023-10-18T14:03:07.628336+0000","last_undegraded":"2023-10-18T14:03:07.628336+0000","last_fullsized":"2023-10-18T14:03:07.628336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:24:52.054236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630046+0000","last_change":"2023-10-18T14:02:32.447099+0000","last_active":"2023-10-18T14:03:07.630046+0000","last_peered":"2023-10-18T14:03:07.630046+0000","last_clean":"2023-10-18T14:03:07.630046+0000","last_became_active":"2023-10-18T14:02:32.446812+0000","last_became_peered":"2023-10-18T14:02:32.446812+0000","last_unstale":"2023-10-18T14:03:07.630046+0000","last_undegraded":"2023-10-18T14:03:07.630046+0000","last_fullsized":"2023-10-18T14:03:07.630046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:11:10.895149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632396+0000","last_change":"2023-10-18T14:02:32.444055+0000","last_active":"2023-10-18T14:03:07.632396+0000","last_peered":"2023-10-18T14:03:07.632396+0000","last_clean":"2023-10-18T14:03:07.632396+0000","last_became_active":"2023-10-18T14:02:32.443750+0000","last_became_peered":"2023-10-18T14:02:32.443750+0000","last_unstale":"2023-10-18T14:03:07.632396+0000","last_undegraded":"2023-10-18T14:03:07.632396+0000","last_fullsized":"2023-10-18T14:03:07.632396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:05:37.783713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630037+0000","last_change":"2023-10-18T14:02:32.462147+0000","last_active":"2023-10-18T14:03:07.630037+0000","last_peered":"2023-10-18T14:03:07.630037+0000","last_clean":"2023-10-18T14:03:07.630037+0000","last_became_active":"2023-10-18T14:02:32.461712+0000","last_became_peered":"2023-10-18T14:02:32.461712+0000","last_unstale":"2023-10-18T14:03:07.630037+0000","last_undegraded":"2023-10-18T14:03:07.630037+0000","last_fullsized":"2023-10-18T14:03:07.630037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:10:39.936092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631949+0000","last_change":"2023-10-18T14:02:32.449466+0000","last_active":"2023-10-18T14:03:07.631949+0000","last_peered":"2023-10-18T14:03:07.631949+0000","last_clean":"2023-10-18T14:03:07.631949+0000","last_became_active":"2023-10-18T14:02:32.449146+0000","last_became_peered":"2023-10-18T14:02:32.449146+0000","last_unstale":"2023-10-18T14:03:07.631949+0000","last_undegraded":"2023-10-18T14:03:07.631949+0000","last_fullsized":"2023-10-18T14:03:07.631949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:28.427003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634152+0000","last_change":"2023-10-18T14:02:32.448901+0000","last_active":"2023-10-18T14:03:07.634152+0000","last_peered":"2023-10-18T14:03:07.634152+0000","last_clean":"2023-10-18T14:03:07.634152+0000","last_became_active":"2023-10-18T14:02:32.448379+0000","last_became_peered":"2023-10-18T14:02:32.448379+0000","last_unstale":"2023-10-18T14:03:07.634152+0000","last_undegraded":"2023-10-18T14:03:07.634152+0000","last_fullsized":"2023-10-18T14:03:07.634152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:53:22.743915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632688+0000","last_change":"2023-10-18T14:02:32.446575+0000","last_active":"2023-10-18T14:03:07.632688+0000","last_peered":"2023-10-18T14:03:07.632688+0000","last_clean":"2023-10-18T14:03:07.632688+0000","last_became_active":"2023-10-18T14:02:32.445756+0000","last_became_peered":"2023-10-18T14:02:32.445756+0000","last_unstale":"2023-10-18T14:03:07.632688+0000","last_undegraded":"2023-10-18T14:03:07.632688+0000","last_fullsized":"2023-10-18T14:03:07.632688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:55.490373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630414+0000","last_change":"2023-10-18T14:02:32.460943+0000","last_active":"2023-10-18T14:03:07.630414+0000","last_peered":"2023-10-18T14:03:07.630414+0000","last_clean":"2023-10-18T14:03:07.630414+0000","last_became_active":"2023-10-18T14:02:32.460540+0000","last_became_peered":"2023-10-18T14:02:32.460540+0000","last_unstale":"2023-10-18T14:03:07.630414+0000","last_undegraded":"2023-10-18T14:03:07.630414+0000","last_fullsized":"2023-10-18T14:03:07.630414+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:44:59.309663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628177+0000","last_change":"2023-10-18T14:02:32.450665+0000","last_active":"2023-10-18T14:03:07.628177+0000","last_peered":"2023-10-18T14:03:07.628177+0000","last_clean":"2023-10-18T14:03:07.628177+0000","last_became_active":"2023-10-18T14:02:32.450286+0000","last_became_peered":"2023-10-18T14:02:32.450286+0000","last_unstale":"2023-10-18T14:03:07.628177+0000","last_undegraded":"2023-10-18T14:03:07.628177+0000","last_fullsized":"2023-10-18T14:03:07.628177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:01:17.874856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633946+0000","last_change":"2023-10-18T14:02:32.444129+0000","last_active":"2023-10-18T14:03:07.633946+0000","last_peered":"2023-10-18T14:03:07.633946+0000","last_clean":"2023-10-18T14:03:07.633946+0000","last_became_active":"2023-10-18T14:02:32.443898+0000","last_became_peered":"2023-10-18T14:02:32.443898+0000","last_unstale":"2023-10-18T14:03:07.633946+0000","last_undegraded":"2023-10-18T14:03:07.633946+0000","last_fullsized":"2023-10-18T14:03:07.633946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:20:35.391806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631518+0000","last_change":"2023-10-18T14:02:32.457637+0000","last_active":"2023-10-18T14:03:07.631518+0000","last_peered":"2023-10-18T14:03:07.631518+0000","last_clean":"2023-10-18T14:03:07.631518+0000","last_became_active":"2023-10-18T14:02:32.457345+0000","last_became_peered":"2023-10-18T14:02:32.457345+0000","last_unstale":"2023-10-18T14:03:07.631518+0000","last_undegraded":"2023-10-18T14:03:07.631518+0000","last_fullsized":"2023-10-18T14:03:07.631518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:18:47.579689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631487+0000","last_change":"2023-10-18T14:02:32.449765+0000","last_active":"2023-10-18T14:03:07.631487+0000","last_peered":"2023-10-18T14:03:07.631487+0000","last_clean":"2023-10-18T14:03:07.631487+0000","last_became_active":"2023-10-18T14:02:32.449467+0000","last_became_peered":"2023-10-18T14:02:32.449467+0000","last_unstale":"2023-10-18T14:03:07.631487+0000","last_undegraded":"2023-10-18T14:03:07.631487+0000","last_fullsized":"2023-10-18T14:03:07.631487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:09:15.324290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633644+0000","last_change":"2023-10-18T14:02:32.456634+0000","last_active":"2023-10-18T14:03:07.633644+0000","last_peered":"2023-10-18T14:03:07.633644+0000","last_clean":"2023-10-18T14:03:07.633644+0000","last_became_active":"2023-10-18T14:02:32.456336+0000","last_became_peered":"2023-10-18T14:02:32.456336+0000","last_unstale":"2023-10-18T14:03:07.633644+0000","last_undegraded":"2023-10-18T14:03:07.633644+0000","last_fullsized":"2023-10-18T14:03:07.633644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:29:47.973539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631514+0000","last_change":"2023-10-18T14:02:32.447357+0000","last_active":"2023-10-18T14:03:07.631514+0000","last_peered":"2023-10-18T14:03:07.631514+0000","last_clean":"2023-10-18T14:03:07.631514+0000","last_became_active":"2023-10-18T14:02:32.446756+0000","last_became_peered":"2023-10-18T14:02:32.446756+0000","last_unstale":"2023-10-18T14:03:07.631514+0000","last_undegraded":"2023-10-18T14:03:07.631514+0000","last_fullsized":"2023-10-18T14:03:07.631514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:13:22.467662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627607+0000","last_change":"2023-10-18T14:02:32.452786+0000","last_active":"2023-10-18T14:03:07.627607+0000","last_peered":"2023-10-18T14:03:07.627607+0000","last_clean":"2023-10-18T14:03:07.627607+0000","last_became_active":"2023-10-18T14:02:32.452551+0000","last_became_peered":"2023-10-18T14:02:32.452551+0000","last_unstale":"2023-10-18T14:03:07.627607+0000","last_undegraded":"2023-10-18T14:03:07.627607+0000","last_fullsized":"2023-10-18T14:03:07.627607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:07.709943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628230+0000","last_change":"2023-10-18T14:02:32.453264+0000","last_active":"2023-10-18T14:03:07.628230+0000","last_peered":"2023-10-18T14:03:07.628230+0000","last_clean":"2023-10-18T14:03:07.628230+0000","last_became_active":"2023-10-18T14:02:32.452948+0000","last_became_peered":"2023-10-18T14:02:32.452948+0000","last_unstale":"2023-10-18T14:03:07.628230+0000","last_undegraded":"2023-10-18T14:03:07.628230+0000","last_fullsized":"2023-10-18T14:03:07.628230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:00:55.243191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":106,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:54.395703+0000","last_change":"2023-10-18T14:02:31.843752+0000","last_active":"2023-10-18T14:03:54.395703+0000","last_peered":"2023-10-18T14:03:54.395703+0000","last_clean":"2023-10-18T14:03:54.395703+0000","last_became_active":"2023-10-18T14:02:31.843415+0000","last_became_peered":"2023-10-18T14:02:31.843415+0000","last_unstale":"2023-10-18T14:03:54.395703+0000","last_undegraded":"2023-10-18T14:03:54.395703+0000","last_fullsized":"2023-10-18T14:03:54.395703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:32:11.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633385+0000","last_change":"2023-10-18T14:02:32.458934+0000","last_active":"2023-10-18T14:03:07.633385+0000","last_peered":"2023-10-18T14:03:07.633385+0000","last_clean":"2023-10-18T14:03:07.633385+0000","last_became_active":"2023-10-18T14:02:32.458624+0000","last_became_peered":"2023-10-18T14:02:32.458624+0000","last_unstale":"2023-10-18T14:03:07.633385+0000","last_undegraded":"2023-10-18T14:03:07.633385+0000","last_fullsized":"2023-10-18T14:03:07.633385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:24:20.034637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633439+0000","last_change":"2023-10-18T14:02:31.842666+0000","last_active":"2023-10-18T14:03:07.633439+0000","last_peered":"2023-10-18T14:03:07.633439+0000","last_clean":"2023-10-18T14:03:07.633439+0000","last_became_active":"2023-10-18T14:02:31.842366+0000","last_became_peered":"2023-10-18T14:02:31.842366+0000","last_unstale":"2023-10-18T14:03:07.633439+0000","last_undegraded":"2023-10-18T14:03:07.633439+0000","last_fullsized":"2023-10-18T14:03:07.633439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:11:08.150402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631653+0000","last_change":"2023-10-18T14:02:32.453731+0000","last_active":"2023-10-18T14:03:07.631653+0000","last_peered":"2023-10-18T14:03:07.631653+0000","last_clean":"2023-10-18T14:03:07.631653+0000","last_became_active":"2023-10-18T14:02:32.453405+0000","last_became_peered":"2023-10-18T14:02:32.453405+0000","last_unstale":"2023-10-18T14:03:07.631653+0000","last_undegraded":"2023-10-18T14:03:07.631653+0000","last_fullsized":"2023-10-18T14:03:07.631653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:19:57.878074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631664+0000","last_change":"2023-10-18T14:02:31.851514+0000","last_active":"2023-10-18T14:03:07.631664+0000","last_peered":"2023-10-18T14:03:07.631664+0000","last_clean":"2023-10-18T14:03:07.631664+0000","last_became_active":"2023-10-18T14:02:31.851236+0000","last_became_peered":"2023-10-18T14:02:31.851236+0000","last_unstale":"2023-10-18T14:03:07.631664+0000","last_undegraded":"2023-10-18T14:03:07.631664+0000","last_fullsized":"2023-10-18T14:03:07.631664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:35:26.804135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634258+0000","last_change":"2023-10-18T14:02:32.460018+0000","last_active":"2023-10-18T14:03:07.634258+0000","last_peered":"2023-10-18T14:03:07.634258+0000","last_clean":"2023-10-18T14:03:07.634258+0000","last_became_active":"2023-10-18T14:02:32.459738+0000","last_became_peered":"2023-10-18T14:02:32.459738+0000","last_unstale":"2023-10-18T14:03:07.634258+0000","last_undegraded":"2023-10-18T14:03:07.634258+0000","last_fullsized":"2023-10-18T14:03:07.634258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:48.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630318+0000","last_change":"2023-10-18T14:02:31.850112+0000","last_active":"2023-10-18T14:03:07.630318+0000","last_peered":"2023-10-18T14:03:07.630318+0000","last_clean":"2023-10-18T14:03:07.630318+0000","last_became_active":"2023-10-18T14:02:31.849515+0000","last_became_peered":"2023-10-18T14:02:31.849515+0000","last_unstale":"2023-10-18T14:03:07.630318+0000","last_undegraded":"2023-10-18T14:03:07.630318+0000","last_fullsized":"2023-10-18T14:03:07.630318+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:35:20.338900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633120+0000","last_change":"2023-10-18T14:02:32.459221+0000","last_active":"2023-10-18T14:03:07.633120+0000","last_peered":"2023-10-18T14:03:07.633120+0000","last_clean":"2023-10-18T14:03:07.633120+0000","last_became_active":"2023-10-18T14:02:32.458912+0000","last_became_peered":"2023-10-18T14:02:32.458912+0000","last_unstale":"2023-10-18T14:03:07.633120+0000","last_undegraded":"2023-10-18T14:03:07.633120+0000","last_fullsized":"2023-10-18T14:03:07.633120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:54:02.630861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":103,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:55.375788+0000","last_change":"2023-10-18T14:02:31.846754+0000","last_active":"2023-10-18T14:03:55.375788+0000","last_peered":"2023-10-18T14:03:55.375788+0000","last_clean":"2023-10-18T14:03:55.375788+0000","last_became_active":"2023-10-18T14:02:31.846450+0000","last_became_peered":"2023-10-18T14:02:31.846450+0000","last_unstale":"2023-10-18T14:03:55.375788+0000","last_undegraded":"2023-10-18T14:03:55.375788+0000","last_fullsized":"2023-10-18T14:03:55.375788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:11.929528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.638502+0000","last_change":"2023-10-18T14:03:08.638502+0000","last_active":"2023-10-18T14:03:08.638502+0000","last_peered":"2023-10-18T14:03:08.638502+0000","last_clean":"2023-10-18T14:03:08.638502+0000","last_became_active":"2023-10-18T14:03:08.638101+0000","last_became_peered":"2023-10-18T14:03:08.638101+0000","last_unstale":"2023-10-18T14:03:08.638502+0000","last_undegraded":"2023-10-18T14:03:08.638502+0000","last_fullsized":"2023-10-18T14:03:08.638502+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:56:47.297642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632268+0000","last_change":"2023-10-18T14:02:31.846135+0000","last_active":"2023-10-18T14:03:07.632268+0000","last_peered":"2023-10-18T14:03:07.632268+0000","last_clean":"2023-10-18T14:03:07.632268+0000","last_became_active":"2023-10-18T14:02:31.845800+0000","last_became_peered":"2023-10-18T14:02:31.845800+0000","last_unstale":"2023-10-18T14:03:07.632268+0000","last_undegraded":"2023-10-18T14:03:07.632268+0000","last_fullsized":"2023-10-18T14:03:07.632268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:22:55.945930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633140+0000","last_change":"2023-10-18T14:02:32.445803+0000","last_active":"2023-10-18T14:03:07.633140+0000","last_peered":"2023-10-18T14:03:07.633140+0000","last_clean":"2023-10-18T14:03:07.633140+0000","last_became_active":"2023-10-18T14:02:32.445489+0000","last_became_peered":"2023-10-18T14:02:32.445489+0000","last_unstale":"2023-10-18T14:03:07.633140+0000","last_undegraded":"2023-10-18T14:03:07.633140+0000","last_fullsized":"2023-10-18T14:03:07.633140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:38:46.101215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632990+0000","last_change":"2023-10-18T14:02:31.843827+0000","last_active":"2023-10-18T14:03:07.632990+0000","last_peered":"2023-10-18T14:03:07.632990+0000","last_clean":"2023-10-18T14:03:07.632990+0000","last_became_active":"2023-10-18T14:02:31.843533+0000","last_became_peered":"2023-10-18T14:02:31.843533+0000","last_unstale":"2023-10-18T14:03:07.632990+0000","last_undegraded":"2023-10-18T14:03:07.632990+0000","last_fullsized":"2023-10-18T14:03:07.632990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:00:03.832002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632031+0000","last_change":"2023-10-18T14:02:32.447400+0000","last_active":"2023-10-18T14:03:07.632031+0000","last_peered":"2023-10-18T14:03:07.632031+0000","last_clean":"2023-10-18T14:03:07.632031+0000","last_became_active":"2023-10-18T14:02:32.447024+0000","last_became_peered":"2023-10-18T14:02:32.447024+0000","last_unstale":"2023-10-18T14:03:07.632031+0000","last_undegraded":"2023-10-18T14:03:07.632031+0000","last_fullsized":"2023-10-18T14:03:07.632031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:49:37.596273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632467+0000","last_change":"2023-10-18T14:02:31.847527+0000","last_active":"2023-10-18T14:03:07.632467+0000","last_peered":"2023-10-18T14:03:07.632467+0000","last_clean":"2023-10-18T14:03:07.632467+0000","last_became_active":"2023-10-18T14:02:31.847249+0000","last_became_peered":"2023-10-18T14:02:31.847249+0000","last_unstale":"2023-10-18T14:03:07.632467+0000","last_undegraded":"2023-10-18T14:03:07.632467+0000","last_fullsized":"2023-10-18T14:03:07.632467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:11:34.217776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627384+0000","last_change":"2023-10-18T14:02:32.452268+0000","last_active":"2023-10-18T14:03:07.627384+0000","last_peered":"2023-10-18T14:03:07.627384+0000","last_clean":"2023-10-18T14:03:07.627384+0000","last_became_active":"2023-10-18T14:02:32.451338+0000","last_became_peered":"2023-10-18T14:02:32.451338+0000","last_unstale":"2023-10-18T14:03:07.627384+0000","last_undegraded":"2023-10-18T14:03:07.627384+0000","last_fullsized":"2023-10-18T14:03:07.627384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:17:11.743280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":173,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:54.373507+0000","last_change":"2023-10-18T14:02:31.841862+0000","last_active":"2023-10-18T14:03:54.373507+0000","last_peered":"2023-10-18T14:03:54.373507+0000","last_clean":"2023-10-18T14:03:54.373507+0000","last_became_active":"2023-10-18T14:02:31.841481+0000","last_became_peered":"2023-10-18T14:02:31.841481+0000","last_unstale":"2023-10-18T14:03:54.373507+0000","last_undegraded":"2023-10-18T14:03:54.373507+0000","last_fullsized":"2023-10-18T14:03:54.373507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:38:26.263626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":154,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633941+0000","last_change":"2023-10-18T14:02:32.447608+0000","last_active":"2023-10-18T14:03:07.633941+0000","last_peered":"2023-10-18T14:03:07.633941+0000","last_clean":"2023-10-18T14:03:07.633941+0000","last_became_active":"2023-10-18T14:02:32.447057+0000","last_became_peered":"2023-10-18T14:02:32.447057+0000","last_unstale":"2023-10-18T14:03:07.633941+0000","last_undegraded":"2023-10-18T14:03:07.633941+0000","last_fullsized":"2023-10-18T14:03:07.633941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:33:43.469496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630438+0000","last_change":"2023-10-18T14:02:31.849118+0000","last_active":"2023-10-18T14:03:07.630438+0000","last_peered":"2023-10-18T14:03:07.630438+0000","last_clean":"2023-10-18T14:03:07.630438+0000","last_became_active":"2023-10-18T14:02:31.848827+0000","last_became_peered":"2023-10-18T14:02:31.848827+0000","last_unstale":"2023-10-18T14:03:07.630438+0000","last_undegraded":"2023-10-18T14:03:07.630438+0000","last_fullsized":"2023-10-18T14:03:07.630438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:41:17.309102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631773+0000","last_change":"2023-10-18T14:02:32.447157+0000","last_active":"2023-10-18T14:03:07.631773+0000","last_peered":"2023-10-18T14:03:07.631773+0000","last_clean":"2023-10-18T14:03:07.631773+0000","last_became_active":"2023-10-18T14:02:32.446861+0000","last_became_peered":"2023-10-18T14:02:32.446861+0000","last_unstale":"2023-10-18T14:03:07.631773+0000","last_undegraded":"2023-10-18T14:03:07.631773+0000","last_fullsized":"2023-10-18T14:03:07.631773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:58:58.146931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633247+0000","last_change":"2023-10-18T14:02:31.838819+0000","last_active":"2023-10-18T14:03:07.633247+0000","last_peered":"2023-10-18T14:03:07.633247+0000","last_clean":"2023-10-18T14:03:07.633247+0000","last_became_active":"2023-10-18T14:02:31.838488+0000","last_became_peered":"2023-10-18T14:02:31.838488+0000","last_unstale":"2023-10-18T14:03:07.633247+0000","last_undegraded":"2023-10-18T14:03:07.633247+0000","last_fullsized":"2023-10-18T14:03:07.633247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:41:37.569792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633964+0000","last_change":"2023-10-18T14:02:32.455108+0000","last_active":"2023-10-18T14:03:07.633964+0000","last_peered":"2023-10-18T14:03:07.633964+0000","last_clean":"2023-10-18T14:03:07.633964+0000","last_became_active":"2023-10-18T14:02:32.454821+0000","last_became_peered":"2023-10-18T14:02:32.454821+0000","last_unstale":"2023-10-18T14:03:07.633964+0000","last_undegraded":"2023-10-18T14:03:07.633964+0000","last_fullsized":"2023-10-18T14:03:07.633964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:00:29.617633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":205,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:54.373604+0000","last_change":"2023-10-18T14:02:31.847241+0000","last_active":"2023-10-18T14:03:54.373604+0000","last_peered":"2023-10-18T14:03:54.373604+0000","last_clean":"2023-10-18T14:03:54.373604+0000","last_became_active":"2023-10-18T14:02:31.846786+0000","last_became_peered":"2023-10-18T14:02:31.846786+0000","last_unstale":"2023-10-18T14:03:54.373604+0000","last_undegraded":"2023-10-18T14:03:54.373604+0000","last_fullsized":"2023-10-18T14:03:54.373604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:53:47.539696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58575,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":161,"num_read_kb":137,"num_write":31,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630833+0000","last_change":"2023-10-18T14:02:32.458530+0000","last_active":"2023-10-18T14:03:07.630833+0000","last_peered":"2023-10-18T14:03:07.630833+0000","last_clean":"2023-10-18T14:03:07.630833+0000","last_became_active":"2023-10-18T14:02:32.458199+0000","last_became_peered":"2023-10-18T14:02:32.458199+0000","last_unstale":"2023-10-18T14:03:07.630833+0000","last_undegraded":"2023-10-18T14:03:07.630833+0000","last_fullsized":"2023-10-18T14:03:07.630833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:52:16.107456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.656760+0000","last_change":"2023-10-18T14:03:08.656457+0000","last_active":"2023-10-18T14:03:08.656760+0000","last_peered":"2023-10-18T14:03:08.656760+0000","last_clean":"2023-10-18T14:03:08.656760+0000","last_became_active":"2023-10-18T14:03:08.638227+0000","last_became_peered":"2023-10-18T14:03:08.638227+0000","last_unstale":"2023-10-18T14:03:08.656760+0000","last_undegraded":"2023-10-18T14:03:08.656760+0000","last_fullsized":"2023-10-18T14:03:08.656760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:28:29.502844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633370+0000","last_change":"2023-10-18T14:02:32.456404+0000","last_active":"2023-10-18T14:03:07.633370+0000","last_peered":"2023-10-18T14:03:07.633370+0000","last_clean":"2023-10-18T14:03:07.633370+0000","last_became_active":"2023-10-18T14:02:32.456128+0000","last_became_peered":"2023-10-18T14:02:32.456128+0000","last_unstale":"2023-10-18T14:03:07.633370+0000","last_undegraded":"2023-10-18T14:03:07.633370+0000","last_fullsized":"2023-10-18T14:03:07.633370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:23:41.315513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633298+0000","last_change":"2023-10-18T14:02:31.846871+0000","last_active":"2023-10-18T14:03:07.633298+0000","last_peered":"2023-10-18T14:03:07.633298+0000","last_clean":"2023-10-18T14:03:07.633298+0000","last_became_active":"2023-10-18T14:02:31.846570+0000","last_became_peered":"2023-10-18T14:02:31.846570+0000","last_unstale":"2023-10-18T14:03:07.633298+0000","last_undegraded":"2023-10-18T14:03:07.633298+0000","last_fullsized":"2023-10-18T14:03:07.633298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:38:46.096769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.632825+0000","last_change":"2023-10-18T14:03:08.632825+0000","last_active":"2023-10-18T14:03:08.632825+0000","last_peered":"2023-10-18T14:03:08.632825+0000","last_clean":"2023-10-18T14:03:08.632825+0000","last_became_active":"2023-10-18T14:03:08.632453+0000","last_became_peered":"2023-10-18T14:03:08.632453+0000","last_unstale":"2023-10-18T14:03:08.632825+0000","last_undegraded":"2023-10-18T14:03:08.632825+0000","last_fullsized":"2023-10-18T14:03:08.632825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:30.707828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":100,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:54.373805+0000","last_change":"2023-10-18T14:02:31.844367+0000","last_active":"2023-10-18T14:03:54.373805+0000","last_peered":"2023-10-18T14:03:54.373805+0000","last_clean":"2023-10-18T14:03:54.373805+0000","last_became_active":"2023-10-18T14:02:31.844060+0000","last_became_peered":"2023-10-18T14:02:31.844060+0000","last_unstale":"2023-10-18T14:03:54.373805+0000","last_undegraded":"2023-10-18T14:03:54.373805+0000","last_fullsized":"2023-10-18T14:03:54.373805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:06:09.656240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629934+0000","last_change":"2023-10-18T14:02:32.464529+0000","last_active":"2023-10-18T14:03:07.629934+0000","last_peered":"2023-10-18T14:03:07.629934+0000","last_clean":"2023-10-18T14:03:07.629934+0000","last_became_active":"2023-10-18T14:02:32.464232+0000","last_became_peered":"2023-10-18T14:02:32.464232+0000","last_unstale":"2023-10-18T14:03:07.629934+0000","last_undegraded":"2023-10-18T14:03:07.629934+0000","last_fullsized":"2023-10-18T14:03:07.629934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:10:43.011803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629881+0000","last_change":"2023-10-18T14:02:31.850537+0000","last_active":"2023-10-18T14:03:07.629881+0000","last_peered":"2023-10-18T14:03:07.629881+0000","last_clean":"2023-10-18T14:03:07.629881+0000","last_became_active":"2023-10-18T14:02:31.849391+0000","last_became_peered":"2023-10-18T14:02:31.849391+0000","last_unstale":"2023-10-18T14:03:07.629881+0000","last_undegraded":"2023-10-18T14:03:07.629881+0000","last_fullsized":"2023-10-18T14:03:07.629881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:19:31.270179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.635208+0000","last_change":"2023-10-18T14:03:08.635208+0000","last_active":"2023-10-18T14:03:08.635208+0000","last_peered":"2023-10-18T14:03:08.635208+0000","last_clean":"2023-10-18T14:03:08.635208+0000","last_became_active":"2023-10-18T14:03:08.634800+0000","last_became_peered":"2023-10-18T14:03:08.634800+0000","last_unstale":"2023-10-18T14:03:08.635208+0000","last_undegraded":"2023-10-18T14:03:08.635208+0000","last_fullsized":"2023-10-18T14:03:08.635208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:36:00.844237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631121+0000","last_change":"2023-10-18T14:02:31.850706+0000","last_active":"2023-10-18T14:03:07.631121+0000","last_peered":"2023-10-18T14:03:07.631121+0000","last_clean":"2023-10-18T14:03:07.631121+0000","last_became_active":"2023-10-18T14:02:31.849354+0000","last_became_peered":"2023-10-18T14:02:31.849354+0000","last_unstale":"2023-10-18T14:03:07.631121+0000","last_undegraded":"2023-10-18T14:03:07.631121+0000","last_fullsized":"2023-10-18T14:03:07.631121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:51:31.071528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631242+0000","last_change":"2023-10-18T14:02:32.454196+0000","last_active":"2023-10-18T14:03:07.631242+0000","last_peered":"2023-10-18T14:03:07.631242+0000","last_clean":"2023-10-18T14:03:07.631242+0000","last_became_active":"2023-10-18T14:02:32.453861+0000","last_became_peered":"2023-10-18T14:02:32.453861+0000","last_unstale":"2023-10-18T14:03:07.631242+0000","last_undegraded":"2023-10-18T14:03:07.631242+0000","last_fullsized":"2023-10-18T14:03:07.631242+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:43.217757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627432+0000","last_change":"2023-10-18T14:02:31.849707+0000","last_active":"2023-10-18T14:03:07.627432+0000","last_peered":"2023-10-18T14:03:07.627432+0000","last_clean":"2023-10-18T14:03:07.627432+0000","last_became_active":"2023-10-18T14:02:31.849442+0000","last_became_peered":"2023-10-18T14:02:31.849442+0000","last_unstale":"2023-10-18T14:03:07.627432+0000","last_undegraded":"2023-10-18T14:03:07.627432+0000","last_fullsized":"2023-10-18T14:03:07.627432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:39:15.669730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632631+0000","last_change":"2023-10-18T14:02:32.457433+0000","last_active":"2023-10-18T14:03:07.632631+0000","last_peered":"2023-10-18T14:03:07.632631+0000","last_clean":"2023-10-18T14:03:07.632631+0000","last_became_active":"2023-10-18T14:02:32.457057+0000","last_became_peered":"2023-10-18T14:02:32.457057+0000","last_unstale":"2023-10-18T14:03:07.632631+0000","last_undegraded":"2023-10-18T14:03:07.632631+0000","last_fullsized":"2023-10-18T14:03:07.632631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:53.088723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'6","reported_seq":102,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:57.400429+0000","last_change":"2023-10-18T14:02:31.848595+0000","last_active":"2023-10-18T14:03:57.400429+0000","last_peered":"2023-10-18T14:03:57.400429+0000","last_clean":"2023-10-18T14:03:57.400429+0000","last_became_active":"2023-10-18T14:02:31.847987+0000","last_became_peered":"2023-10-18T14:02:31.847987+0000","last_unstale":"2023-10-18T14:03:57.400429+0000","last_undegraded":"2023-10-18T14:03:57.400429+0000","last_fullsized":"2023-10-18T14:03:57.400429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:03:34.356729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":906,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632829+0000","last_change":"2023-10-18T14:02:32.446514+0000","last_active":"2023-10-18T14:03:07.632829+0000","last_peered":"2023-10-18T14:03:07.632829+0000","last_clean":"2023-10-18T14:03:07.632829+0000","last_became_active":"2023-10-18T14:02:32.446015+0000","last_became_peered":"2023-10-18T14:02:32.446015+0000","last_unstale":"2023-10-18T14:03:07.632829+0000","last_undegraded":"2023-10-18T14:03:07.632829+0000","last_fullsized":"2023-10-18T14:03:07.632829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:21:09.897636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632600+0000","last_change":"2023-10-18T14:02:32.444969+0000","last_active":"2023-10-18T14:03:07.632600+0000","last_peered":"2023-10-18T14:03:07.632600+0000","last_clean":"2023-10-18T14:03:07.632600+0000","last_became_active":"2023-10-18T14:02:32.444592+0000","last_became_peered":"2023-10-18T14:02:32.444592+0000","last_unstale":"2023-10-18T14:03:07.632600+0000","last_undegraded":"2023-10-18T14:03:07.632600+0000","last_fullsized":"2023-10-18T14:03:07.632600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:02:58.377003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":101,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:56.375918+0000","last_change":"2023-10-18T14:02:31.847368+0000","last_active":"2023-10-18T14:03:56.375918+0000","last_peered":"2023-10-18T14:03:56.375918+0000","last_clean":"2023-10-18T14:03:56.375918+0000","last_became_active":"2023-10-18T14:02:31.847072+0000","last_became_peered":"2023-10-18T14:02:31.847072+0000","last_unstale":"2023-10-18T14:03:56.375918+0000","last_undegraded":"2023-10-18T14:03:56.375918+0000","last_fullsized":"2023-10-18T14:03:56.375918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:28:24.771284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.632551+0000","last_change":"2023-10-18T14:03:08.632138+0000","last_active":"2023-10-18T14:03:08.632551+0000","last_peered":"2023-10-18T14:03:08.632551+0000","last_clean":"2023-10-18T14:03:08.632551+0000","last_became_active":"2023-10-18T14:03:08.631902+0000","last_became_peered":"2023-10-18T14:03:08.631902+0000","last_unstale":"2023-10-18T14:03:08.632551+0000","last_undegraded":"2023-10-18T14:03:08.632551+0000","last_fullsized":"2023-10-18T14:03:08.632551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:31:10.646568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628041+0000","last_change":"2023-10-18T14:02:31.843678+0000","last_active":"2023-10-18T14:03:07.628041+0000","last_peered":"2023-10-18T14:03:07.628041+0000","last_clean":"2023-10-18T14:03:07.628041+0000","last_became_active":"2023-10-18T14:02:31.843332+0000","last_became_peered":"2023-10-18T14:02:31.843332+0000","last_unstale":"2023-10-18T14:03:07.628041+0000","last_undegraded":"2023-10-18T14:03:07.628041+0000","last_fullsized":"2023-10-18T14:03:07.628041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:06:04.549859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":321,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630029+0000","last_change":"2023-10-18T14:01:34.022246+0000","last_active":"2023-10-18T14:03:07.630029+0000","last_peered":"2023-10-18T14:03:07.630029+0000","last_clean":"2023-10-18T14:03:07.630029+0000","last_became_active":"2023-10-18T14:01:34.021768+0000","last_became_peered":"2023-10-18T14:01:34.021768+0000","last_unstale":"2023-10-18T14:03:07.630029+0000","last_undegraded":"2023-10-18T14:03:07.630029+0000","last_fullsized":"2023-10-18T14:03:07.630029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_clean_scrub_stamp":"2023-10-18T13:58:44.223424+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:48.521087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632798+0000","last_change":"2023-10-18T14:02:32.440662+0000","last_active":"2023-10-18T14:03:07.632798+0000","last_peered":"2023-10-18T14:03:07.632798+0000","last_clean":"2023-10-18T14:03:07.632798+0000","last_became_active":"2023-10-18T14:02:32.440345+0000","last_became_peered":"2023-10-18T14:02:32.440345+0000","last_unstale":"2023-10-18T14:03:07.632798+0000","last_undegraded":"2023-10-18T14:03:07.632798+0000","last_fullsized":"2023-10-18T14:03:07.632798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:21.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630113+0000","last_change":"2023-10-18T14:02:31.850243+0000","last_active":"2023-10-18T14:03:07.630113+0000","last_peered":"2023-10-18T14:03:07.630113+0000","last_clean":"2023-10-18T14:03:07.630113+0000","last_became_active":"2023-10-18T14:02:31.849952+0000","last_became_peered":"2023-10-18T14:02:31.849952+0000","last_unstale":"2023-10-18T14:03:07.630113+0000","last_undegraded":"2023-10-18T14:03:07.630113+0000","last_fullsized":"2023-10-18T14:03:07.630113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:11:50.877219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.647452+0000","last_change":"2023-10-18T14:03:08.647076+0000","last_active":"2023-10-18T14:03:08.647452+0000","last_peered":"2023-10-18T14:03:08.647452+0000","last_clean":"2023-10-18T14:03:08.647452+0000","last_became_active":"2023-10-18T14:03:08.637530+0000","last_became_peered":"2023-10-18T14:03:08.637530+0000","last_unstale":"2023-10-18T14:03:08.647452+0000","last_undegraded":"2023-10-18T14:03:08.647452+0000","last_fullsized":"2023-10-18T14:03:08.647452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:33.344068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633493+0000","last_change":"2023-10-18T14:02:32.445046+0000","last_active":"2023-10-18T14:03:07.633493+0000","last_peered":"2023-10-18T14:03:07.633493+0000","last_clean":"2023-10-18T14:03:07.633493+0000","last_became_active":"2023-10-18T14:02:32.444827+0000","last_became_peered":"2023-10-18T14:02:32.444827+0000","last_unstale":"2023-10-18T14:03:07.633493+0000","last_undegraded":"2023-10-18T14:03:07.633493+0000","last_fullsized":"2023-10-18T14:03:07.633493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:26:11.024405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627694+0000","last_change":"2023-10-18T14:02:31.846888+0000","last_active":"2023-10-18T14:03:07.627694+0000","last_peered":"2023-10-18T14:03:07.627694+0000","last_clean":"2023-10-18T14:03:07.627694+0000","last_became_active":"2023-10-18T14:02:31.846591+0000","last_became_peered":"2023-10-18T14:02:31.846591+0000","last_unstale":"2023-10-18T14:03:07.627694+0000","last_undegraded":"2023-10-18T14:03:07.627694+0000","last_fullsized":"2023-10-18T14:03:07.627694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:48:03.683135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633530+0000","last_change":"2023-10-18T14:02:32.456951+0000","last_active":"2023-10-18T14:03:07.633530+0000","last_peered":"2023-10-18T14:03:07.633530+0000","last_clean":"2023-10-18T14:03:07.633530+0000","last_became_active":"2023-10-18T14:02:32.456588+0000","last_became_peered":"2023-10-18T14:02:32.456588+0000","last_unstale":"2023-10-18T14:03:07.633530+0000","last_undegraded":"2023-10-18T14:03:07.633530+0000","last_fullsized":"2023-10-18T14:03:07.633530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:51:51.335310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628601+0000","last_change":"2023-10-18T14:02:31.845258+0000","last_active":"2023-10-18T14:03:07.628601+0000","last_peered":"2023-10-18T14:03:07.628601+0000","last_clean":"2023-10-18T14:03:07.628601+0000","last_became_active":"2023-10-18T14:02:31.844933+0000","last_became_peered":"2023-10-18T14:02:31.844933+0000","last_unstale":"2023-10-18T14:03:07.628601+0000","last_undegraded":"2023-10-18T14:03:07.628601+0000","last_fullsized":"2023-10-18T14:03:07.628601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:51:46.765525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631689+0000","last_change":"2023-10-18T14:02:32.454955+0000","last_active":"2023-10-18T14:03:07.631689+0000","last_peered":"2023-10-18T14:03:07.631689+0000","last_clean":"2023-10-18T14:03:07.631689+0000","last_became_active":"2023-10-18T14:02:32.454689+0000","last_became_peered":"2023-10-18T14:02:32.454689+0000","last_unstale":"2023-10-18T14:03:07.631689+0000","last_undegraded":"2023-10-18T14:03:07.631689+0000","last_fullsized":"2023-10-18T14:03:07.631689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:57:20.461517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633726+0000","last_change":"2023-10-18T14:02:31.849273+0000","last_active":"2023-10-18T14:03:07.633726+0000","last_peered":"2023-10-18T14:03:07.633726+0000","last_clean":"2023-10-18T14:03:07.633726+0000","last_became_active":"2023-10-18T14:02:31.848985+0000","last_became_peered":"2023-10-18T14:02:31.848985+0000","last_unstale":"2023-10-18T14:03:07.633726+0000","last_undegraded":"2023-10-18T14:03:07.633726+0000","last_fullsized":"2023-10-18T14:03:07.633726+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:55:54.516857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629855+0000","last_change":"2023-10-18T14:02:32.449557+0000","last_active":"2023-10-18T14:03:07.629855+0000","last_peered":"2023-10-18T14:03:07.629855+0000","last_clean":"2023-10-18T14:03:07.629855+0000","last_became_active":"2023-10-18T14:02:32.449033+0000","last_became_peered":"2023-10-18T14:02:32.449033+0000","last_unstale":"2023-10-18T14:03:07.629855+0000","last_undegraded":"2023-10-18T14:03:07.629855+0000","last_fullsized":"2023-10-18T14:03:07.629855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:32.983379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632227+0000","last_change":"2023-10-18T14:02:31.846109+0000","last_active":"2023-10-18T14:03:07.632227+0000","last_peered":"2023-10-18T14:03:07.632227+0000","last_clean":"2023-10-18T14:03:07.632227+0000","last_became_active":"2023-10-18T14:02:31.845236+0000","last_became_peered":"2023-10-18T14:02:31.845236+0000","last_unstale":"2023-10-18T14:03:07.632227+0000","last_undegraded":"2023-10-18T14:03:07.632227+0000","last_fullsized":"2023-10-18T14:03:07.632227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:46.880974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631047+0000","last_change":"2023-10-18T14:02:32.446465+0000","last_active":"2023-10-18T14:03:07.631047+0000","last_peered":"2023-10-18T14:03:07.631047+0000","last_clean":"2023-10-18T14:03:07.631047+0000","last_became_active":"2023-10-18T14:02:32.446172+0000","last_became_peered":"2023-10-18T14:02:32.446172+0000","last_unstale":"2023-10-18T14:03:07.631047+0000","last_undegraded":"2023-10-18T14:03:07.631047+0000","last_fullsized":"2023-10-18T14:03:07.631047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:14:40.094870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628081+0000","last_change":"2023-10-18T14:02:31.851198+0000","last_active":"2023-10-18T14:03:07.628081+0000","last_peered":"2023-10-18T14:03:07.628081+0000","last_clean":"2023-10-18T14:03:07.628081+0000","last_became_active":"2023-10-18T14:02:31.850524+0000","last_became_peered":"2023-10-18T14:02:31.850524+0000","last_unstale":"2023-10-18T14:03:07.628081+0000","last_undegraded":"2023-10-18T14:03:07.628081+0000","last_fullsized":"2023-10-18T14:03:07.628081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:13:44.133077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633065+0000","last_change":"2023-10-18T14:02:32.446732+0000","last_active":"2023-10-18T14:03:07.633065+0000","last_peered":"2023-10-18T14:03:07.633065+0000","last_clean":"2023-10-18T14:03:07.633065+0000","last_became_active":"2023-10-18T14:02:32.446418+0000","last_became_peered":"2023-10-18T14:02:32.446418+0000","last_unstale":"2023-10-18T14:03:07.633065+0000","last_undegraded":"2023-10-18T14:03:07.633065+0000","last_fullsized":"2023-10-18T14:03:07.633065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:13.765988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630012+0000","last_change":"2023-10-18T14:02:31.852648+0000","last_active":"2023-10-18T14:03:07.630012+0000","last_peered":"2023-10-18T14:03:07.630012+0000","last_clean":"2023-10-18T14:03:07.630012+0000","last_became_active":"2023-10-18T14:02:31.852361+0000","last_became_peered":"2023-10-18T14:02:31.852361+0000","last_unstale":"2023-10-18T14:03:07.630012+0000","last_undegraded":"2023-10-18T14:03:07.630012+0000","last_fullsized":"2023-10-18T14:03:07.630012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:54:28.189196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630302+0000","last_change":"2023-10-18T14:02:32.464220+0000","last_active":"2023-10-18T14:03:07.630302+0000","last_peered":"2023-10-18T14:03:07.630302+0000","last_clean":"2023-10-18T14:03:07.630302+0000","last_became_active":"2023-10-18T14:02:32.463213+0000","last_became_peered":"2023-10-18T14:02:32.463213+0000","last_unstale":"2023-10-18T14:03:07.630302+0000","last_undegraded":"2023-10-18T14:03:07.630302+0000","last_fullsized":"2023-10-18T14:03:07.630302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:53.777086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":103,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:57.378914+0000","last_change":"2023-10-18T14:02:31.848305+0000","last_active":"2023-10-18T14:03:57.378914+0000","last_peered":"2023-10-18T14:03:57.378914+0000","last_clean":"2023-10-18T14:03:57.378914+0000","last_became_active":"2023-10-18T14:02:31.847739+0000","last_became_peered":"2023-10-18T14:02:31.847739+0000","last_unstale":"2023-10-18T14:03:57.378914+0000","last_undegraded":"2023-10-18T14:03:57.378914+0000","last_fullsized":"2023-10-18T14:03:57.378914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:52:24.543703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630458+0000","last_change":"2023-10-18T14:02:32.460802+0000","last_active":"2023-10-18T14:03:07.630458+0000","last_peered":"2023-10-18T14:03:07.630458+0000","last_clean":"2023-10-18T14:03:07.630458+0000","last_became_active":"2023-10-18T14:02:32.460160+0000","last_became_peered":"2023-10-18T14:02:32.460160+0000","last_unstale":"2023-10-18T14:03:07.630458+0000","last_undegraded":"2023-10-18T14:03:07.630458+0000","last_fullsized":"2023-10-18T14:03:07.630458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:20:55.614142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633018+0000","last_change":"2023-10-18T14:02:31.845468+0000","last_active":"2023-10-18T14:03:07.633018+0000","last_peered":"2023-10-18T14:03:07.633018+0000","last_clean":"2023-10-18T14:03:07.633018+0000","last_became_active":"2023-10-18T14:02:31.845057+0000","last_became_peered":"2023-10-18T14:02:31.845057+0000","last_unstale":"2023-10-18T14:03:07.633018+0000","last_undegraded":"2023-10-18T14:03:07.633018+0000","last_fullsized":"2023-10-18T14:03:07.633018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:08:23.972051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630377+0000","last_change":"2023-10-18T14:02:32.462572+0000","last_active":"2023-10-18T14:03:07.630377+0000","last_peered":"2023-10-18T14:03:07.630377+0000","last_clean":"2023-10-18T14:03:07.630377+0000","last_became_active":"2023-10-18T14:02:32.462140+0000","last_became_peered":"2023-10-18T14:02:32.462140+0000","last_unstale":"2023-10-18T14:03:07.630377+0000","last_undegraded":"2023-10-18T14:03:07.630377+0000","last_fullsized":"2023-10-18T14:03:07.630377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:03:34.605932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633629+0000","last_change":"2023-10-18T14:02:31.847322+0000","last_active":"2023-10-18T14:03:07.633629+0000","last_peered":"2023-10-18T14:03:07.633629+0000","last_clean":"2023-10-18T14:03:07.633629+0000","last_became_active":"2023-10-18T14:02:31.847008+0000","last_became_peered":"2023-10-18T14:02:31.847008+0000","last_unstale":"2023-10-18T14:03:07.633629+0000","last_undegraded":"2023-10-18T14:03:07.633629+0000","last_fullsized":"2023-10-18T14:03:07.633629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:59:18.850165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630579+0000","last_change":"2023-10-18T14:02:32.461592+0000","last_active":"2023-10-18T14:03:07.630579+0000","last_peered":"2023-10-18T14:03:07.630579+0000","last_clean":"2023-10-18T14:03:07.630579+0000","last_became_active":"2023-10-18T14:02:32.461265+0000","last_became_peered":"2023-10-18T14:02:32.461265+0000","last_unstale":"2023-10-18T14:03:07.630579+0000","last_undegraded":"2023-10-18T14:03:07.630579+0000","last_fullsized":"2023-10-18T14:03:07.630579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:03.315431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631175+0000","last_change":"2023-10-18T14:02:32.445480+0000","last_active":"2023-10-18T14:03:07.631175+0000","last_peered":"2023-10-18T14:03:07.631175+0000","last_clean":"2023-10-18T14:03:07.631175+0000","last_became_active":"2023-10-18T14:02:32.443036+0000","last_became_peered":"2023-10-18T14:02:32.443036+0000","last_unstale":"2023-10-18T14:03:07.631175+0000","last_undegraded":"2023-10-18T14:03:07.631175+0000","last_fullsized":"2023-10-18T14:03:07.631175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:59:57.637358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628022+0000","last_change":"2023-10-18T14:02:32.456400+0000","last_active":"2023-10-18T14:03:07.628022+0000","last_peered":"2023-10-18T14:03:07.628022+0000","last_clean":"2023-10-18T14:03:07.628022+0000","last_became_active":"2023-10-18T14:02:32.456072+0000","last_became_peered":"2023-10-18T14:02:32.456072+0000","last_unstale":"2023-10-18T14:03:07.628022+0000","last_undegraded":"2023-10-18T14:03:07.628022+0000","last_fullsized":"2023-10-18T14:03:07.628022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:22:59.844454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627995+0000","last_change":"2023-10-18T14:02:32.448089+0000","last_active":"2023-10-18T14:03:07.627995+0000","last_peered":"2023-10-18T14:03:07.627995+0000","last_clean":"2023-10-18T14:03:07.627995+0000","last_became_active":"2023-10-18T14:02:32.447866+0000","last_became_peered":"2023-10-18T14:02:32.447866+0000","last_unstale":"2023-10-18T14:03:07.627995+0000","last_undegraded":"2023-10-18T14:03:07.627995+0000","last_fullsized":"2023-10-18T14:03:07.627995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:28:35.558009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631717+0000","last_change":"2023-10-18T14:02:32.444103+0000","last_active":"2023-10-18T14:03:07.631717+0000","last_peered":"2023-10-18T14:03:07.631717+0000","last_clean":"2023-10-18T14:03:07.631717+0000","last_became_active":"2023-10-18T14:02:32.443762+0000","last_became_peered":"2023-10-18T14:02:32.443762+0000","last_unstale":"2023-10-18T14:03:07.631717+0000","last_undegraded":"2023-10-18T14:03:07.631717+0000","last_fullsized":"2023-10-18T14:03:07.631717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:47.695764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633454+0000","last_change":"2023-10-18T14:02:32.449409+0000","last_active":"2023-10-18T14:03:07.633454+0000","last_peered":"2023-10-18T14:03:07.633454+0000","last_clean":"2023-10-18T14:03:07.633454+0000","last_became_active":"2023-10-18T14:02:32.449114+0000","last_became_peered":"2023-10-18T14:02:32.449114+0000","last_unstale":"2023-10-18T14:03:07.633454+0000","last_undegraded":"2023-10-18T14:03:07.633454+0000","last_fullsized":"2023-10-18T14:03:07.633454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:59:45.167577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631298+0000","last_change":"2023-10-18T14:02:32.452013+0000","last_active":"2023-10-18T14:03:07.631298+0000","last_peered":"2023-10-18T14:03:07.631298+0000","last_clean":"2023-10-18T14:03:07.631298+0000","last_became_active":"2023-10-18T14:02:32.451734+0000","last_became_peered":"2023-10-18T14:02:32.451734+0000","last_unstale":"2023-10-18T14:03:07.631298+0000","last_undegraded":"2023-10-18T14:03:07.631298+0000","last_fullsized":"2023-10-18T14:03:07.631298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:15:44.511378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629153+0000","last_change":"2023-10-18T14:02:32.445503+0000","last_active":"2023-10-18T14:03:07.629153+0000","last_peered":"2023-10-18T14:03:07.629153+0000","last_clean":"2023-10-18T14:03:07.629153+0000","last_became_active":"2023-10-18T14:02:32.445172+0000","last_became_peered":"2023-10-18T14:02:32.445172+0000","last_unstale":"2023-10-18T14:03:07.629153+0000","last_undegraded":"2023-10-18T14:03:07.629153+0000","last_fullsized":"2023-10-18T14:03:07.629153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:23:08.456949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633490+0000","last_change":"2023-10-18T14:02:32.459690+0000","last_active":"2023-10-18T14:03:07.633490+0000","last_peered":"2023-10-18T14:03:07.633490+0000","last_clean":"2023-10-18T14:03:07.633490+0000","last_became_active":"2023-10-18T14:02:32.459373+0000","last_became_peered":"2023-10-18T14:02:32.459373+0000","last_unstale":"2023-10-18T14:03:07.633490+0000","last_undegraded":"2023-10-18T14:03:07.633490+0000","last_fullsized":"2023-10-18T14:03:07.633490+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:36.092029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632468+0000","last_change":"2023-10-18T14:02:32.455076+0000","last_active":"2023-10-18T14:03:07.632468+0000","last_peered":"2023-10-18T14:03:07.632468+0000","last_clean":"2023-10-18T14:03:07.632468+0000","last_became_active":"2023-10-18T14:02:32.454750+0000","last_became_peered":"2023-10-18T14:02:32.454750+0000","last_unstale":"2023-10-18T14:03:07.632468+0000","last_undegraded":"2023-10-18T14:03:07.632468+0000","last_fullsized":"2023-10-18T14:03:07.632468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:08:00.855583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632303+0000","last_change":"2023-10-18T14:02:32.450714+0000","last_active":"2023-10-18T14:03:07.632303+0000","last_peered":"2023-10-18T14:03:07.632303+0000","last_clean":"2023-10-18T14:03:07.632303+0000","last_became_active":"2023-10-18T14:02:32.450429+0000","last_became_peered":"2023-10-18T14:02:32.450429+0000","last_unstale":"2023-10-18T14:03:07.632303+0000","last_undegraded":"2023-10-18T14:03:07.632303+0000","last_fullsized":"2023-10-18T14:03:07.632303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:43:21.746296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634401+0000","last_change":"2023-10-18T14:02:32.457392+0000","last_active":"2023-10-18T14:03:07.634401+0000","last_peered":"2023-10-18T14:03:07.634401+0000","last_clean":"2023-10-18T14:03:07.634401+0000","last_became_active":"2023-10-18T14:02:32.457072+0000","last_became_peered":"2023-10-18T14:02:32.457072+0000","last_unstale":"2023-10-18T14:03:07.634401+0000","last_undegraded":"2023-10-18T14:03:07.634401+0000","last_fullsized":"2023-10-18T14:03:07.634401+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:19:51.691351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634009+0000","last_change":"2023-10-18T14:02:32.457541+0000","last_active":"2023-10-18T14:03:07.634009+0000","last_peered":"2023-10-18T14:03:07.634009+0000","last_clean":"2023-10-18T14:03:07.634009+0000","last_became_active":"2023-10-18T14:02:32.457266+0000","last_became_peered":"2023-10-18T14:02:32.457266+0000","last_unstale":"2023-10-18T14:03:07.634009+0000","last_undegraded":"2023-10-18T14:03:07.634009+0000","last_fullsized":"2023-10-18T14:03:07.634009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:41:16.131463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.636413+0000","last_change":"2023-10-18T14:03:08.636413+0000","last_active":"2023-10-18T14:03:08.636413+0000","last_peered":"2023-10-18T14:03:08.636413+0000","last_clean":"2023-10-18T14:03:08.636413+0000","last_became_active":"2023-10-18T14:03:08.635985+0000","last_became_peered":"2023-10-18T14:03:08.635985+0000","last_unstale":"2023-10-18T14:03:08.636413+0000","last_undegraded":"2023-10-18T14:03:08.636413+0000","last_fullsized":"2023-10-18T14:03:08.636413+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:53:28.848373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250031,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65705,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":820,"num_read_kb":479,"num_write":230,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":180,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":197751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449117,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":459517,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69899999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.47199999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.77400000000000002,"5min":1.226,"15min":1.226},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63200000000000001,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.76200000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.76200000000000001}]},{"osd":2,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79000000000000004,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45000000000000001},"min":{"1min":0.39100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":4,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.66300000000000003,"15min":0.65200000000000002},"min":{"1min":0.59799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.55800000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.012,"5min":1.119,"15min":1.119},"last":0.81000000000000005}]},{"osd":5,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.433,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.42799999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67200000000000004}]},{"osd":6,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.74399999999999999,"15min":0.73599999999999999},"min":{"1min":0.64300000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.54700000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91900000000000004,"5min":1.298,"15min":1.298},"last":0.88800000000000001}]},{"osd":8,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.75},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.83599999999999997}]},{"osd":9,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.748},"min":{"1min":0.59399999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88500000000000001,"5min":1.343,"15min":1.343},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.56399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.95399999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.90300000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.66000000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.96899999999999997,"5min":1.181,"15min":1.181},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.78300000000000003,"15min":0.78200000000000003},"min":{"1min":0.67600000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97899999999999998,"5min":1.482,"15min":1.482},"last":0.877}]}]},{"osd":10,"up_from":70,"seq":300647710751,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":1108616,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.68700000000000006}]},{"osd":1,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.32000000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59199999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.27800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.63400000000000001}]},{"osd":2,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78800000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71199999999999997}]},{"osd":3,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80800000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.746}]},{"osd":4,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.46600000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.433,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79200000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86299999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70599999999999996,"15min":0.70499999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95199999999999996,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.621}]},{"osd":6,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70999999999999996,"15min":0.71099999999999997},"min":{"1min":0.56200000000000006,"5min":0.378,"15min":0.378},"max":{"1min":0.878,"5min":1.006,"15min":1.006},"last":0.81499999999999995}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65100000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.621,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92000000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.61799999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.82899999999999996}]},{"osd":9,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.64100000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.53700000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90700000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.77700000000000002}]},{"osd":11,"last update":"Wed Oct 18 14:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.66500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92000000000000004,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.88900000000000001}]}]},{"osd":9,"up_from":65,"seq":279172874277,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":459267,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.501},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.32100000000000001}]},{"osd":1,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.495},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.48299999999999998}]},{"osd":2,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.30099999999999999}]},{"osd":4,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.52600000000000002}]},{"osd":5,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.73199999999999998,"15min":0.747},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36599999999999999,"5min":0.308,"15min":0.308},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.71699999999999997,"15min":0.73399999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59699999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.54200000000000004}]},{"osd":8,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75600000000000001,"15min":0.76800000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1080000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.67800000000000005}]},{"osd":10,"last update":"Wed Oct 18 14:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73899999999999999,"15min":0.75},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.70699999999999996}]}]},{"osd":8,"up_from":58,"seq":249108103209,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":459202,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70899999999999996,"5min":2.302,"15min":2.302},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54900000000000004,"15min":0.53500000000000003},"min":{"1min":0.39600000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69699999999999995,"5min":2.4380000000000002,"15min":2.4380000000000002},"last":0.53400000000000003}]},{"osd":1,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.61099999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.86299999999999999,"5min":0.875,"15min":0.875},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.64500000000000002,"15min":0.63100000000000001},"min":{"1min":0.54500000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.79600000000000004}]},{"osd":2,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.443,"15min":0.42099999999999999},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.44400000000000001},"min":{"1min":0.35199999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.67600000000000005}]},{"osd":3,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67000000000000004,"15min":0.61299999999999999},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3819999999999999,"5min":8.5980000000000008,"15min":8.5980000000000008},"last":0.623},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.58499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0720000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68600000000000005,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.65800000000000003,"15min":0.64300000000000002},"min":{"1min":0.59599999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85399999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.82599999999999996}]},{"osd":5,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.55400000000000005,"15min":0.52300000000000002},"min":{"1min":0.47799999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86099999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.55400000000000005},"min":{"1min":0.51500000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.95899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.89900000000000002}]},{"osd":6,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.751,"15min":0.70099999999999996},"min":{"1min":0.501,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.8819999999999999,"5min":7.4240000000000004,"15min":7.4240000000000004},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.72099999999999997},"min":{"1min":0.56599999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9259999999999999,"5min":11.095000000000001,"15min":11.095000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96299999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.76800000000000002,"15min":0.73499999999999999},"min":{"1min":0.63900000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.995}]},{"osd":9,"last update":"Wed Oct 18 14:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.77200000000000002,"15min":0.74099999999999999},"min":{"1min":0.59599999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.76100000000000001,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":0.91500000000000004}]},{"osd":10,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.81200000000000006,"15min":0.79200000000000004},"min":{"1min":0.73699999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.79500000000000004,"15min":0.78000000000000003},"min":{"1min":0.65300000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.93799999999999994}]},{"osd":11,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.92900000000000005}]}]},{"osd":7,"up_from":51,"seq":219043332141,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":1052486,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47599999999999998}]},{"osd":1,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.41499999999999998},"min":{"1min":0.35599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.625,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.45400000000000001,"15min":0.441},"min":{"1min":0.372,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.53300000000000003}]},{"osd":2,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80500000000000005,"5min":1.254,"15min":1.254},"last":0.67100000000000004}]},{"osd":3,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.748,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.46000000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59299999999999997}]},{"osd":4,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.51400000000000001,"15min":0.49199999999999999},"min":{"1min":0.38500000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.746,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.42399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68100000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.627,"15min":0.61299999999999999},"min":{"1min":0.48299999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.51400000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88600000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.88900000000000001}]},{"osd":6,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.66700000000000004,"15min":0.65100000000000002},"min":{"1min":0.52400000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.504,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.78000000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.70399999999999996}]},{"osd":8,"last update":"Wed Oct 18 14:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.55800000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.046,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79200000000000004,"15min":0.78700000000000003},"min":{"1min":0.70599999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.095,"5min":1.514,"15min":1.514},"last":0.93600000000000005}]},{"osd":9,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.83299999999999996,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.755},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73799999999999999,"15min":0.745},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.84199999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.73799999999999999}]},{"osd":10,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.66300000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72999999999999998,"15min":0.72299999999999998},"min":{"1min":0.504,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93200000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.82499999999999996}]},{"osd":11,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1,"5min":1,"15min":1},"last":0.84199999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495666,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":459308,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.38300000000000001,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.372,"15min":0.34200000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.32300000000000001}]},{"osd":1,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70699999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.5},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.67000000000000004}]},{"osd":2,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.55800000000000005},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72399999999999998,"5min":1.476,"15min":1.476},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40899999999999997,"15min":0.40000000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51800000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.434},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.46400000000000002}]},{"osd":4,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55400000000000005,"15min":0.52800000000000002},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56899999999999995,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77100000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.622,"15min":0.60199999999999998},"min":{"1min":0.434,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.63300000000000001}]},{"osd":7,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.45100000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.79400000000000004,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.64600000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.71299999999999997,"15min":0.747},"min":{"1min":0.52200000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77800000000000002,"5min":1.611,"15min":1.611},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.71099999999999997,"15min":0.72999999999999998},"min":{"1min":0.497,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77600000000000002,"5min":1.399,"15min":1.399},"last":0.62}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75900000000000001,"5min":1.415,"15min":1.415},"last":0.40400000000000003}]},{"osd":10,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72999999999999998,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76000000000000001,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.80500000000000005,"5min":1.448,"15min":1.448},"last":0.68100000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542215,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":519108,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51300000000000001,"15min":0.51200000000000001},"min":{"1min":0.35199999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.78600000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.38400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.85199999999999998,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.442}]},{"osd":2,"last update":"Wed Oct 18 14:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.60099999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91900000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.57999999999999996,"15min":0.54500000000000004},"min":{"1min":0.41899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.85499999999999998}]},{"osd":3,"last update":"Wed Oct 18 14:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.55200000000000005,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89500000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.5,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.54900000000000004}]},{"osd":4,"last update":"Wed Oct 18 14:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.438,"15min":0.39600000000000002},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.51000000000000001,"15min":0.442},"min":{"1min":0.36299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.60299999999999998},"min":{"1min":0.52500000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.63800000000000001,"15min":0.58599999999999997},"min":{"1min":0.57599999999999996,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.81299999999999994}]},{"osd":6,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.56599999999999995,"15min":0.53500000000000003},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81299999999999994,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.499},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61399999999999999,"15min":0.57899999999999996},"min":{"1min":0.52400000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93100000000000005,"5min":1.127,"15min":1.127},"last":0.63900000000000001}]},{"osd":7,"last update":"Wed Oct 18 14:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55600000000000005,"15min":0.53000000000000003},"min":{"1min":0.371,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.59099999999999997,"15min":0.55700000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68200000000000005}]},{"osd":8,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.72599999999999998,"15min":0.69199999999999995},"min":{"1min":0.57599999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.052,"5min":1.081,"15min":1.081},"last":0.875},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.66200000000000003,"15min":0.63100000000000001},"min":{"1min":0.59099999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.79700000000000004}]},{"osd":9,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.73599999999999999,"15min":0.71599999999999997},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.052,"5min":1.165,"15min":1.165},"last":0.83499999999999996}]},{"osd":10,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.64900000000000002,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.73999999999999999,"15min":0.72499999999999998},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.89800000000000002}]},{"osd":11,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.752},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.92400000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":460323,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 14:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56000000000000005,"15min":0.505},"min":{"1min":0.44800000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.41499999999999998},{"interface":"front","average":{"1min":1.925,"5min":0.81599999999999995,"15min":0.58599999999999997},"min":{"1min":0.35399999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":27.123000000000001,"5min":27.123000000000001,"15min":27.123000000000001},"last":0.40400000000000003}]},{"osd":2,"last update":"Wed Oct 18 14:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.51000000000000001},"min":{"1min":0.40899999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.9870000000000001,"5min":0.81799999999999995,"15min":0.59799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":27.222999999999999,"5min":27.222999999999999,"15min":27.222999999999999},"last":0.60099999999999998}]},{"osd":3,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Oct 18 14:03:30 2023","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":0.84399999999999997,"15min":0.65100000000000002},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":27.053999999999998,"5min":27.053999999999998,"15min":27.053999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.374}]},{"osd":5,"last update":"Wed Oct 18 14:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.47999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":2.0590000000000002,"5min":0.89200000000000002,"15min":0.69599999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":27.192,"5min":27.192,"15min":27.192},"last":0.55000000000000004}]},{"osd":6,"last update":"Wed Oct 18 14:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.60199999999999998,"15min":0.54300000000000004},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":8.7010000000000005,"5min":8.7010000000000005,"15min":8.7010000000000005},"last":0.312}]},{"osd":7,"last update":"Wed Oct 18 14:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60499999999999998}]},{"osd":8,"last update":"Wed Oct 18 14:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.50900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.56100000000000005},{"interface":"front","average":{"1min":2.121,"5min":0.98299999999999998,"15min":0.80500000000000005},"min":{"1min":0.497,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":26.992000000000001,"5min":26.992000000000001,"15min":26.992000000000001},"last":0.52600000000000002}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":3.262,"5min":3.262,"15min":3.262},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.51200000000000001}]},{"osd":10,"last update":"Wed Oct 18 14:03:30 2023","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":1.024,"15min":0.84799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":27.09,"5min":27.09,"15min":27.09},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":0.45600000000000002}]},{"osd":11,"last update":"Wed Oct 18 14:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.54300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.92200000000000004,"5min":1.55,"15min":1.55},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":1.8620000000000001,"15min":2.0590000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97599999999999998,"5min":27.154,"15min":27.154},"last":0.57499999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378691,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":518390,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73999999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.39400000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67800000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.626}]},{"osd":1,"last update":"Wed Oct 18 14:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.46999999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79200000000000004,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.58799999999999997,"15min":0.56000000000000005},"min":{"1min":0.46800000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.95699999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.88}]},{"osd":3,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.60299999999999998,"15min":0.56100000000000005},"min":{"1min":0.44700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.61199999999999999,"15min":0.58599999999999997},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.78500000000000003}]},{"osd":5,"last update":"Wed Oct 18 14:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.46300000000000002,"15min":0.437},"min":{"1min":0.34000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.503,"15min":0.44700000000000001},"min":{"1min":0.34799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53700000000000003}]},{"osd":6,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.34200000000000003}]},{"osd":8,"last update":"Wed Oct 18 14:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.59799999999999998,"15min":0.55600000000000005},"min":{"1min":0.434,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.64500000000000002,"15min":0.60399999999999998},"min":{"1min":0.46700000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.72099999999999997}]},{"osd":9,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.753},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89300000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.80500000000000005}]},{"osd":10,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.71499999999999997,"15min":0.69299999999999995},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.77600000000000002,"15min":0.754},"min":{"1min":0.72399999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.90500000000000003}]},{"osd":11,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.85299999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149758,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":458490,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.34899999999999998,"15min":0.32500000000000001},"min":{"1min":0.28199999999999997,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.56499999999999995,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.36699999999999999,"15min":0.35099999999999998},"min":{"1min":0.25800000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.51700000000000002},"min":{"1min":0.39400000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.78200000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54900000000000004,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53600000000000003,"15min":0.52100000000000002},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70499999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.51800000000000002},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.65900000000000003,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.65800000000000003}]},{"osd":4,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.44800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.75900000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.626}]},{"osd":5,"last update":"Wed Oct 18 14:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85199999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.70099999999999996,"15min":0.67300000000000004},"min":{"1min":0.45800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77500000000000002,"5min":6.5,"15min":6.5},"last":0.69599999999999995}]},{"osd":6,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.46999999999999997,"15min":0.48799999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.504,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.439},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74299999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.77900000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80500000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.63800000000000001}]},{"osd":8,"last update":"Wed Oct 18 14:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.56699999999999995}]},{"osd":9,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.58999999999999997,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.60899999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.66300000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60999999999999999}]},{"osd":10,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83399999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67800000000000005,"15min":0.68899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.749,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.73599999999999999}]},{"osd":11,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.70999999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888122,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":458845,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.42399999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Oct 18 14:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41499999999999998,"15min":0.38800000000000001},"min":{"1min":0.312,"5min":0.255,"15min":0.255},"max":{"1min":0.59599999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.38},"min":{"1min":0.27400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.54300000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Oct 18 14:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57499999999999996,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72099999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.61599999999999999}]},{"osd":3,"last update":"Wed Oct 18 14:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58199999999999996,"15min":0.55100000000000005},"min":{"1min":0.46700000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.57799999999999996,"15min":0.54200000000000004},"min":{"1min":0.40400000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":0.77200000000000002}]},{"osd":5,"last update":"Wed Oct 18 14:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.70499999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.61299999999999999,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.55000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.72299999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.60599999999999998,"15min":0.57599999999999996},"min":{"1min":0.53300000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86799999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.39300000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78800000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73799999999999999}]},{"osd":8,"last update":"Wed Oct 18 14:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.71799999999999997,"15min":0.69199999999999995},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97499999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89600000000000002,"5min":1.042,"15min":1.042},"last":0.79900000000000004}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.75700000000000001,"15min":0.73899999999999999},"min":{"1min":0.55900000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.60199999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.80900000000000005}]},{"osd":10,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77200000000000002,"15min":0.76600000000000001},"min":{"1min":0.66500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94199999999999995,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.46800000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.92100000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.82499999999999996}]},{"osd":11,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.871}]}]},{"osd":5,"up_from":39,"seq":167503724598,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":1051515,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51000000000000001,"15min":0.48299999999999998},"min":{"1min":0.34699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.71599999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.504,"15min":0.48499999999999999},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67200000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.436}]},{"osd":1,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.53400000000000003,"15min":0.499},"min":{"1min":0.36799999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.57599999999999996,"15min":0.52500000000000002},"min":{"1min":0.46600000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.73799999999999999}]},{"osd":2,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.41299999999999998,"15min":0.39000000000000001},"min":{"1min":0.34599999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.40699999999999997,"15min":0.375},"min":{"1min":0.29299999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40000000000000002}]},{"osd":3,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.36799999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.60499999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.503},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.51700000000000002},"min":{"1min":0.40799999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68500000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.60599999999999998,"15min":0.55200000000000005},"min":{"1min":0.52400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90200000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.57399999999999995,"15min":0.53200000000000003},"min":{"1min":0.55200000000000005,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77700000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.61899999999999999}]},{"osd":6,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46400000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.68100000000000005}]},{"osd":7,"last update":"Wed Oct 18 14:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.44,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78200000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65400000000000003}]},{"osd":8,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61099999999999999,"15min":0.60099999999999998},"min":{"1min":0.47999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66800000000000004}]},{"osd":9,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.70799999999999996,"15min":0.69999999999999996},"min":{"1min":0.54200000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.80000000000000004}]},{"osd":10,"last update":"Wed Oct 18 14:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.72199999999999998,"15min":0.70999999999999996},"min":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66400000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.79700000000000004,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T14:04:00.695 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-18T14:04:00.695 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T14:04:00.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:00 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2059295510' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:04:00.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:00 smithi158 ceph-mon[103317]: pgmap v279: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-18T14:04:00.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:00 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/581303793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:04:00.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.842+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3815579132 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe948100730 msgr2=0x7fe94810c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:00.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.842+0000 7fe94e5f6700 1 --2- 172.21.15.114:0/3815579132 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe948100730 0x7fe94810c470 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe94000b0d0 tx=0x7fe94000b3e0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.842+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3815579132 shutdown_connections 2023-10-18T14:04:00.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.842+0000 7fe94e5f6700 1 --2- 172.21.15.114:0/3815579132 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe948100730 0x7fe94810c470 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.842+0000 7fe94e5f6700 1 --2- 172.21.15.114:0/3815579132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe9481056f0 0x7fe948105ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.842+0000 7fe94e5f6700 1 --2- 172.21.15.114:0/3815579132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9480ffd70 0x7fe9481001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.842+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3815579132 >> 172.21.15.114:0/3815579132 conn(0x7fe948075b90 msgr2=0x7fe9480fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:00.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.842+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3815579132 shutdown_connections 2023-10-18T14:04:00.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.842+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3815579132 wait complete. 2023-10-18T14:04:00.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.843+0000 7fe94e5f6700 1 Processor -- start 2023-10-18T14:04:00.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.843+0000 7fe94e5f6700 1 -- start start 2023-10-18T14:04:00.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe94e5f6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9480ffd70 0x7fe948197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:00.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe94e5f6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe948100730 0x7fe948197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:00.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe94e5f6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9481056f0 0x7fe9481a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:00.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe94e5f6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe948198780 con 0x7fe9480ffd70 2023-10-18T14:04:00.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe94e5f6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9481a2f40 con 0x7fe948100730 2023-10-18T14:04:00.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe94e5f6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9481a3080 con 0x7fe9481056f0 2023-10-18T14:04:00.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe947fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9480ffd70 0x7fe948197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:00.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe947fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9480ffd70 0x7fe948197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44084/0 (socket says 172.21.15.114:44084) 2023-10-18T14:04:00.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe947fff700 1 -- 172.21.15.114:0/3071966642 learned_addr learned my addr 172.21.15.114:0/3071966642 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:00.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe94cb93700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9481056f0 0x7fe9481a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:00.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe9477fe700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe948100730 0x7fe948197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:00.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe947fff700 1 -- 172.21.15.114:0/3071966642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9481056f0 msgr2=0x7fe9481a2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:00.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe947fff700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9481056f0 0x7fe9481a2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe947fff700 1 -- 172.21.15.114:0/3071966642 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe948100730 msgr2=0x7fe948197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:00.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe947fff700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe948100730 0x7fe948197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe947fff700 1 -- 172.21.15.114:0/3071966642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe940009d00 con 0x7fe9480ffd70 2023-10-18T14:04:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe9477fe700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe948100730 0x7fe948197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe947fff700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9480ffd70 0x7fe948197980 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe93800c990 tx=0x7fe93800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe9457fa700 1 -- 172.21.15.114:0/3071966642 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe938007b00 con 0x7fe9480ffd70 2023-10-18T14:04:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3071966642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9481a3360 con 0x7fe9480ffd70 2023-10-18T14:04:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe9457fa700 1 -- 172.21.15.114:0/3071966642 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe938007c60 con 0x7fe9480ffd70 2023-10-18T14:04:00.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.844+0000 7fe9457fa700 1 -- 172.21.15.114:0/3071966642 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe938018660 con 0x7fe9480ffd70 2023-10-18T14:04:00.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.845+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3071966642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9481a38c0 con 0x7fe9480ffd70 2023-10-18T14:04:00.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.845+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3071966642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe948107bc0 con 0x7fe9480ffd70 2023-10-18T14:04:00.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.846+0000 7fe9457fa700 1 -- 172.21.15.114:0/3071966642 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fe93800f450 con 0x7fe9480ffd70 2023-10-18T14:04:00.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.847+0000 7fe9457fa700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe9300a1560 0x7fe9300a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:00.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.847+0000 7fe9477fe700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe9300a1560 0x7fe9300a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:00.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.847+0000 7fe9457fa700 1 -- 172.21.15.114:0/3071966642 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe9380ccef0 con 0x7fe9480ffd70 2023-10-18T14:04:00.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.847+0000 7fe9477fe700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe9300a1560 0x7fe9300a3a20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe93c005d90 tx=0x7fe93c005d00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:00.851+0000 7fe9457fa700 1 -- 172.21.15.114:0/3071966642 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe938096350 con 0x7fe9480ffd70 2023-10-18T14:04:01.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.037+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3071966642 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9480ff260 con 0x7fe9300a1560 2023-10-18T14:04:01.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.047+0000 7fe9457fa700 1 -- 172.21.15.114:0/3071966642 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344837 (secure 0 0 0) 0x7fe9480ff260 con 0x7fe9300a1560 2023-10-18T14:04:01.058 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:04:01.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.051+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3071966642 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe9300a1560 msgr2=0x7fe9300a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.051+0000 7fe94e5f6700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe9300a1560 0x7fe9300a3a20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe93c005d90 tx=0x7fe93c005d00 comp rx=0 tx=0).stop 2023-10-18T14:04:01.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.051+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3071966642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9480ffd70 msgr2=0x7fe948197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.051+0000 7fe94e5f6700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9480ffd70 0x7fe948197980 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe93800c990 tx=0x7fe93800cd50 comp rx=0 tx=0).stop 2023-10-18T14:04:01.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.051+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3071966642 shutdown_connections 2023-10-18T14:04:01.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.051+0000 7fe94e5f6700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe9300a1560 0x7fe9300a3a20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.051+0000 7fe94e5f6700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9481056f0 0x7fe9481a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.051+0000 7fe94e5f6700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9480ffd70 0x7fe948197980 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.051+0000 7fe94e5f6700 1 --2- 172.21.15.114:0/3071966642 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe948100730 0x7fe948197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.051+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3071966642 >> 172.21.15.114:0/3071966642 conn(0x7fe948075b90 msgr2=0x7fe9480fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:01.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.051+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3071966642 shutdown_connections 2023-10-18T14:04:01.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.051+0000 7fe94e5f6700 1 -- 172.21.15.114:0/3071966642 wait complete. 2023-10-18T14:04:01.066 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T14:04:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2023-10-18T14:03:59.579516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656319,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":956,"num_read_kb":598,"num_write":413,"num_write_kb":3067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180916,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335696,"kb_used_data":11448,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606128,"statfs":{"total":1151940427776,"available":1151596675072,"internally_reserved":0,"allocated":11722752,"data_stored":7465067,"data_compressed":177861,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":318,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":56,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003129"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631494+0000","last_change":"2023-10-18T14:02:32.447514+0000","last_active":"2023-10-18T14:03:07.631494+0000","last_peered":"2023-10-18T14:03:07.631494+0000","last_clean":"2023-10-18T14:03:07.631494+0000","last_became_active":"2023-10-18T14:02:32.447109+0000","last_became_peered":"2023-10-18T14:02:32.447109+0000","last_unstale":"2023-10-18T14:03:07.631494+0000","last_undegraded":"2023-10-18T14:03:07.631494+0000","last_fullsized":"2023-10-18T14:03:07.631494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:02:52.453371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631611+0000","last_change":"2023-10-18T14:02:32.457696+0000","last_active":"2023-10-18T14:03:07.631611+0000","last_peered":"2023-10-18T14:03:07.631611+0000","last_clean":"2023-10-18T14:03:07.631611+0000","last_became_active":"2023-10-18T14:02:32.457380+0000","last_became_peered":"2023-10-18T14:02:32.457380+0000","last_unstale":"2023-10-18T14:03:07.631611+0000","last_undegraded":"2023-10-18T14:03:07.631611+0000","last_fullsized":"2023-10-18T14:03:07.631611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:09:09.303044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632120+0000","last_change":"2023-10-18T14:02:32.450312+0000","last_active":"2023-10-18T14:03:07.632120+0000","last_peered":"2023-10-18T14:03:07.632120+0000","last_clean":"2023-10-18T14:03:07.632120+0000","last_became_active":"2023-10-18T14:02:32.449994+0000","last_became_peered":"2023-10-18T14:02:32.449994+0000","last_unstale":"2023-10-18T14:03:07.632120+0000","last_undegraded":"2023-10-18T14:03:07.632120+0000","last_fullsized":"2023-10-18T14:03:07.632120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:28:32.445958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628336+0000","last_change":"2023-10-18T14:02:32.450511+0000","last_active":"2023-10-18T14:03:07.628336+0000","last_peered":"2023-10-18T14:03:07.628336+0000","last_clean":"2023-10-18T14:03:07.628336+0000","last_became_active":"2023-10-18T14:02:32.450105+0000","last_became_peered":"2023-10-18T14:02:32.450105+0000","last_unstale":"2023-10-18T14:03:07.628336+0000","last_undegraded":"2023-10-18T14:03:07.628336+0000","last_fullsized":"2023-10-18T14:03:07.628336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:24:52.054236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630046+0000","last_change":"2023-10-18T14:02:32.447099+0000","last_active":"2023-10-18T14:03:07.630046+0000","last_peered":"2023-10-18T14:03:07.630046+0000","last_clean":"2023-10-18T14:03:07.630046+0000","last_became_active":"2023-10-18T14:02:32.446812+0000","last_became_peered":"2023-10-18T14:02:32.446812+0000","last_unstale":"2023-10-18T14:03:07.630046+0000","last_undegraded":"2023-10-18T14:03:07.630046+0000","last_fullsized":"2023-10-18T14:03:07.630046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:11:10.895149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632396+0000","last_change":"2023-10-18T14:02:32.444055+0000","last_active":"2023-10-18T14:03:07.632396+0000","last_peered":"2023-10-18T14:03:07.632396+0000","last_clean":"2023-10-18T14:03:07.632396+0000","last_became_active":"2023-10-18T14:02:32.443750+0000","last_became_peered":"2023-10-18T14:02:32.443750+0000","last_unstale":"2023-10-18T14:03:07.632396+0000","last_undegraded":"2023-10-18T14:03:07.632396+0000","last_fullsized":"2023-10-18T14:03:07.632396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:05:37.783713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630037+0000","last_change":"2023-10-18T14:02:32.462147+0000","last_active":"2023-10-18T14:03:07.630037+0000","last_peered":"2023-10-18T14:03:07.630037+0000","last_clean":"2023-10-18T14:03:07.630037+0000","last_became_active":"2023-10-18T14:02:32.461712+0000","last_became_peered":"2023-10-18T14:02:32.461712+0000","last_unstale":"2023-10-18T14:03:07.630037+0000","last_undegraded":"2023-10-18T14:03:07.630037+0000","last_fullsized":"2023-10-18T14:03:07.630037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:10:39.936092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631949+0000","last_change":"2023-10-18T14:02:32.449466+0000","last_active":"2023-10-18T14:03:07.631949+0000","last_peered":"2023-10-18T14:03:07.631949+0000","last_clean":"2023-10-18T14:03:07.631949+0000","last_became_active":"2023-10-18T14:02:32.449146+0000","last_became_peered":"2023-10-18T14:02:32.449146+0000","last_unstale":"2023-10-18T14:03:07.631949+0000","last_undegraded":"2023-10-18T14:03:07.631949+0000","last_fullsized":"2023-10-18T14:03:07.631949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:28.427003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634152+0000","last_change":"2023-10-18T14:02:32.448901+0000","last_active":"2023-10-18T14:03:07.634152+0000","last_peered":"2023-10-18T14:03:07.634152+0000","last_clean":"2023-10-18T14:03:07.634152+0000","last_became_active":"2023-10-18T14:02:32.448379+0000","last_became_peered":"2023-10-18T14:02:32.448379+0000","last_unstale":"2023-10-18T14:03:07.634152+0000","last_undegraded":"2023-10-18T14:03:07.634152+0000","last_fullsized":"2023-10-18T14:03:07.634152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:53:22.743915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632688+0000","last_change":"2023-10-18T14:02:32.446575+0000","last_active":"2023-10-18T14:03:07.632688+0000","last_peered":"2023-10-18T14:03:07.632688+0000","last_clean":"2023-10-18T14:03:07.632688+0000","last_became_active":"2023-10-18T14:02:32.445756+0000","last_became_peered":"2023-10-18T14:02:32.445756+0000","last_unstale":"2023-10-18T14:03:07.632688+0000","last_undegraded":"2023-10-18T14:03:07.632688+0000","last_fullsized":"2023-10-18T14:03:07.632688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:55.490373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630414+0000","last_change":"2023-10-18T14:02:32.460943+0000","last_active":"2023-10-18T14:03:07.630414+0000","last_peered":"2023-10-18T14:03:07.630414+0000","last_clean":"2023-10-18T14:03:07.630414+0000","last_became_active":"2023-10-18T14:02:32.460540+0000","last_became_peered":"2023-10-18T14:02:32.460540+0000","last_unstale":"2023-10-18T14:03:07.630414+0000","last_undegraded":"2023-10-18T14:03:07.630414+0000","last_fullsized":"2023-10-18T14:03:07.630414+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:44:59.309663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628177+0000","last_change":"2023-10-18T14:02:32.450665+0000","last_active":"2023-10-18T14:03:07.628177+0000","last_peered":"2023-10-18T14:03:07.628177+0000","last_clean":"2023-10-18T14:03:07.628177+0000","last_became_active":"2023-10-18T14:02:32.450286+0000","last_became_peered":"2023-10-18T14:02:32.450286+0000","last_unstale":"2023-10-18T14:03:07.628177+0000","last_undegraded":"2023-10-18T14:03:07.628177+0000","last_fullsized":"2023-10-18T14:03:07.628177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:01:17.874856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633946+0000","last_change":"2023-10-18T14:02:32.444129+0000","last_active":"2023-10-18T14:03:07.633946+0000","last_peered":"2023-10-18T14:03:07.633946+0000","last_clean":"2023-10-18T14:03:07.633946+0000","last_became_active":"2023-10-18T14:02:32.443898+0000","last_became_peered":"2023-10-18T14:02:32.443898+0000","last_unstale":"2023-10-18T14:03:07.633946+0000","last_undegraded":"2023-10-18T14:03:07.633946+0000","last_fullsized":"2023-10-18T14:03:07.633946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:20:35.391806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631518+0000","last_change":"2023-10-18T14:02:32.457637+0000","last_active":"2023-10-18T14:03:07.631518+0000","last_peered":"2023-10-18T14:03:07.631518+0000","last_clean":"2023-10-18T14:03:07.631518+0000","last_became_active":"2023-10-18T14:02:32.457345+0000","last_became_peered":"2023-10-18T14:02:32.457345+0000","last_unstale":"2023-10-18T14:03:07.631518+0000","last_undegraded":"2023-10-18T14:03:07.631518+0000","last_fullsized":"2023-10-18T14:03:07.631518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:18:47.579689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631487+0000","last_change":"2023-10-18T14:02:32.449765+0000","last_active":"2023-10-18T14:03:07.631487+0000","last_peered":"2023-10-18T14:03:07.631487+0000","last_clean":"2023-10-18T14:03:07.631487+0000","last_became_active":"2023-10-18T14:02:32.449467+0000","last_became_peered":"2023-10-18T14:02:32.449467+0000","last_unstale":"2023-10-18T14:03:07.631487+0000","last_undegraded":"2023-10-18T14:03:07.631487+0000","last_fullsized":"2023-10-18T14:03:07.631487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:09:15.324290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633644+0000","last_change":"2023-10-18T14:02:32.456634+0000","last_active":"2023-10-18T14:03:07.633644+0000","last_peered":"2023-10-18T14:03:07.633644+0000","last_clean":"2023-10-18T14:03:07.633644+0000","last_became_active":"2023-10-18T14:02:32.456336+0000","last_became_peered":"2023-10-18T14:02:32.456336+0000","last_unstale":"2023-10-18T14:03:07.633644+0000","last_undegraded":"2023-10-18T14:03:07.633644+0000","last_fullsized":"2023-10-18T14:03:07.633644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:29:47.973539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631514+0000","last_change":"2023-10-18T14:02:32.447357+0000","last_active":"2023-10-18T14:03:07.631514+0000","last_peered":"2023-10-18T14:03:07.631514+0000","last_clean":"2023-10-18T14:03:07.631514+0000","last_became_active":"2023-10-18T14:02:32.446756+0000","last_became_peered":"2023-10-18T14:02:32.446756+0000","last_unstale":"2023-10-18T14:03:07.631514+0000","last_undegraded":"2023-10-18T14:03:07.631514+0000","last_fullsized":"2023-10-18T14:03:07.631514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:13:22.467662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627607+0000","last_change":"2023-10-18T14:02:32.452786+0000","last_active":"2023-10-18T14:03:07.627607+0000","last_peered":"2023-10-18T14:03:07.627607+0000","last_clean":"2023-10-18T14:03:07.627607+0000","last_became_active":"2023-10-18T14:02:32.452551+0000","last_became_peered":"2023-10-18T14:02:32.452551+0000","last_unstale":"2023-10-18T14:03:07.627607+0000","last_undegraded":"2023-10-18T14:03:07.627607+0000","last_fullsized":"2023-10-18T14:03:07.627607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:07.709943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628230+0000","last_change":"2023-10-18T14:02:32.453264+0000","last_active":"2023-10-18T14:03:07.628230+0000","last_peered":"2023-10-18T14:03:07.628230+0000","last_clean":"2023-10-18T14:03:07.628230+0000","last_became_active":"2023-10-18T14:02:32.452948+0000","last_became_peered":"2023-10-18T14:02:32.452948+0000","last_unstale":"2023-10-18T14:03:07.628230+0000","last_undegraded":"2023-10-18T14:03:07.628230+0000","last_fullsized":"2023-10-18T14:03:07.628230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:00:55.243191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":106,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:54.395703+0000","last_change":"2023-10-18T14:02:31.843752+0000","last_active":"2023-10-18T14:03:54.395703+0000","last_peered":"2023-10-18T14:03:54.395703+0000","last_clean":"2023-10-18T14:03:54.395703+0000","last_became_active":"2023-10-18T14:02:31.843415+0000","last_became_peered":"2023-10-18T14:02:31.843415+0000","last_unstale":"2023-10-18T14:03:54.395703+0000","last_undegraded":"2023-10-18T14:03:54.395703+0000","last_fullsized":"2023-10-18T14:03:54.395703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:32:11.385683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633385+0000","last_change":"2023-10-18T14:02:32.458934+0000","last_active":"2023-10-18T14:03:07.633385+0000","last_peered":"2023-10-18T14:03:07.633385+0000","last_clean":"2023-10-18T14:03:07.633385+0000","last_became_active":"2023-10-18T14:02:32.458624+0000","last_became_peered":"2023-10-18T14:02:32.458624+0000","last_unstale":"2023-10-18T14:03:07.633385+0000","last_undegraded":"2023-10-18T14:03:07.633385+0000","last_fullsized":"2023-10-18T14:03:07.633385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:24:20.034637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633439+0000","last_change":"2023-10-18T14:02:31.842666+0000","last_active":"2023-10-18T14:03:07.633439+0000","last_peered":"2023-10-18T14:03:07.633439+0000","last_clean":"2023-10-18T14:03:07.633439+0000","last_became_active":"2023-10-18T14:02:31.842366+0000","last_became_peered":"2023-10-18T14:02:31.842366+0000","last_unstale":"2023-10-18T14:03:07.633439+0000","last_undegraded":"2023-10-18T14:03:07.633439+0000","last_fullsized":"2023-10-18T14:03:07.633439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:11:08.150402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631653+0000","last_change":"2023-10-18T14:02:32.453731+0000","last_active":"2023-10-18T14:03:07.631653+0000","last_peered":"2023-10-18T14:03:07.631653+0000","last_clean":"2023-10-18T14:03:07.631653+0000","last_became_active":"2023-10-18T14:02:32.453405+0000","last_became_peered":"2023-10-18T14:02:32.453405+0000","last_unstale":"2023-10-18T14:03:07.631653+0000","last_undegraded":"2023-10-18T14:03:07.631653+0000","last_fullsized":"2023-10-18T14:03:07.631653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:19:57.878074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631664+0000","last_change":"2023-10-18T14:02:31.851514+0000","last_active":"2023-10-18T14:03:07.631664+0000","last_peered":"2023-10-18T14:03:07.631664+0000","last_clean":"2023-10-18T14:03:07.631664+0000","last_became_active":"2023-10-18T14:02:31.851236+0000","last_became_peered":"2023-10-18T14:02:31.851236+0000","last_unstale":"2023-10-18T14:03:07.631664+0000","last_undegraded":"2023-10-18T14:03:07.631664+0000","last_fullsized":"2023-10-18T14:03:07.631664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:35:26.804135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634258+0000","last_change":"2023-10-18T14:02:32.460018+0000","last_active":"2023-10-18T14:03:07.634258+0000","last_peered":"2023-10-18T14:03:07.634258+0000","last_clean":"2023-10-18T14:03:07.634258+0000","last_became_active":"2023-10-18T14:02:32.459738+0000","last_became_peered":"2023-10-18T14:02:32.459738+0000","last_unstale":"2023-10-18T14:03:07.634258+0000","last_undegraded":"2023-10-18T14:03:07.634258+0000","last_fullsized":"2023-10-18T14:03:07.634258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:48.176279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630318+0000","last_change":"2023-10-18T14:02:31.850112+0000","last_active":"2023-10-18T14:03:07.630318+0000","last_peered":"2023-10-18T14:03:07.630318+0000","last_clean":"2023-10-18T14:03:07.630318+0000","last_became_active":"2023-10-18T14:02:31.849515+0000","last_became_peered":"2023-10-18T14:02:31.849515+0000","last_unstale":"2023-10-18T14:03:07.630318+0000","last_undegraded":"2023-10-18T14:03:07.630318+0000","last_fullsized":"2023-10-18T14:03:07.630318+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:35:20.338900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633120+0000","last_change":"2023-10-18T14:02:32.459221+0000","last_active":"2023-10-18T14:03:07.633120+0000","last_peered":"2023-10-18T14:03:07.633120+0000","last_clean":"2023-10-18T14:03:07.633120+0000","last_became_active":"2023-10-18T14:02:32.458912+0000","last_became_peered":"2023-10-18T14:02:32.458912+0000","last_unstale":"2023-10-18T14:03:07.633120+0000","last_undegraded":"2023-10-18T14:03:07.633120+0000","last_fullsized":"2023-10-18T14:03:07.633120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:54:02.630861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":103,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:55.375788+0000","last_change":"2023-10-18T14:02:31.846754+0000","last_active":"2023-10-18T14:03:55.375788+0000","last_peered":"2023-10-18T14:03:55.375788+0000","last_clean":"2023-10-18T14:03:55.375788+0000","last_became_active":"2023-10-18T14:02:31.846450+0000","last_became_peered":"2023-10-18T14:02:31.846450+0000","last_unstale":"2023-10-18T14:03:55.375788+0000","last_undegraded":"2023-10-18T14:03:55.375788+0000","last_fullsized":"2023-10-18T14:03:55.375788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:11.929528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.638502+0000","last_change":"2023-10-18T14:03:08.638502+0000","last_active":"2023-10-18T14:03:08.638502+0000","last_peered":"2023-10-18T14:03:08.638502+0000","last_clean":"2023-10-18T14:03:08.638502+0000","last_became_active":"2023-10-18T14:03:08.638101+0000","last_became_peered":"2023-10-18T14:03:08.638101+0000","last_unstale":"2023-10-18T14:03:08.638502+0000","last_undegraded":"2023-10-18T14:03:08.638502+0000","last_fullsized":"2023-10-18T14:03:08.638502+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:56:47.297642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632268+0000","last_change":"2023-10-18T14:02:31.846135+0000","last_active":"2023-10-18T14:03:07.632268+0000","last_peered":"2023-10-18T14:03:07.632268+0000","last_clean":"2023-10-18T14:03:07.632268+0000","last_became_active":"2023-10-18T14:02:31.845800+0000","last_became_peered":"2023-10-18T14:02:31.845800+0000","last_unstale":"2023-10-18T14:03:07.632268+0000","last_undegraded":"2023-10-18T14:03:07.632268+0000","last_fullsized":"2023-10-18T14:03:07.632268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:22:55.945930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633140+0000","last_change":"2023-10-18T14:02:32.445803+0000","last_active":"2023-10-18T14:03:07.633140+0000","last_peered":"2023-10-18T14:03:07.633140+0000","last_clean":"2023-10-18T14:03:07.633140+0000","last_became_active":"2023-10-18T14:02:32.445489+0000","last_became_peered":"2023-10-18T14:02:32.445489+0000","last_unstale":"2023-10-18T14:03:07.633140+0000","last_undegraded":"2023-10-18T14:03:07.633140+0000","last_fullsized":"2023-10-18T14:03:07.633140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:38:46.101215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632990+0000","last_change":"2023-10-18T14:02:31.843827+0000","last_active":"2023-10-18T14:03:07.632990+0000","last_peered":"2023-10-18T14:03:07.632990+0000","last_clean":"2023-10-18T14:03:07.632990+0000","last_became_active":"2023-10-18T14:02:31.843533+0000","last_became_peered":"2023-10-18T14:02:31.843533+0000","last_unstale":"2023-10-18T14:03:07.632990+0000","last_undegraded":"2023-10-18T14:03:07.632990+0000","last_fullsized":"2023-10-18T14:03:07.632990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:00:03.832002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632031+0000","last_change":"2023-10-18T14:02:32.447400+0000","last_active":"2023-10-18T14:03:07.632031+0000","last_peered":"2023-10-18T14:03:07.632031+0000","last_clean":"2023-10-18T14:03:07.632031+0000","last_became_active":"2023-10-18T14:02:32.447024+0000","last_became_peered":"2023-10-18T14:02:32.447024+0000","last_unstale":"2023-10-18T14:03:07.632031+0000","last_undegraded":"2023-10-18T14:03:07.632031+0000","last_fullsized":"2023-10-18T14:03:07.632031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:49:37.596273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632467+0000","last_change":"2023-10-18T14:02:31.847527+0000","last_active":"2023-10-18T14:03:07.632467+0000","last_peered":"2023-10-18T14:03:07.632467+0000","last_clean":"2023-10-18T14:03:07.632467+0000","last_became_active":"2023-10-18T14:02:31.847249+0000","last_became_peered":"2023-10-18T14:02:31.847249+0000","last_unstale":"2023-10-18T14:03:07.632467+0000","last_undegraded":"2023-10-18T14:03:07.632467+0000","last_fullsized":"2023-10-18T14:03:07.632467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:11:34.217776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627384+0000","last_change":"2023-10-18T14:02:32.452268+0000","last_active":"2023-10-18T14:03:07.627384+0000","last_peered":"2023-10-18T14:03:07.627384+0000","last_clean":"2023-10-18T14:03:07.627384+0000","last_became_active":"2023-10-18T14:02:32.451338+0000","last_became_peered":"2023-10-18T14:02:32.451338+0000","last_unstale":"2023-10-18T14:03:07.627384+0000","last_undegraded":"2023-10-18T14:03:07.627384+0000","last_fullsized":"2023-10-18T14:03:07.627384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:17:11.743280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":173,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:54.373507+0000","last_change":"2023-10-18T14:02:31.841862+0000","last_active":"2023-10-18T14:03:54.373507+0000","last_peered":"2023-10-18T14:03:54.373507+0000","last_clean":"2023-10-18T14:03:54.373507+0000","last_became_active":"2023-10-18T14:02:31.841481+0000","last_became_peered":"2023-10-18T14:02:31.841481+0000","last_unstale":"2023-10-18T14:03:54.373507+0000","last_undegraded":"2023-10-18T14:03:54.373507+0000","last_fullsized":"2023-10-18T14:03:54.373507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:38:26.263626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":154,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633941+0000","last_change":"2023-10-18T14:02:32.447608+0000","last_active":"2023-10-18T14:03:07.633941+0000","last_peered":"2023-10-18T14:03:07.633941+0000","last_clean":"2023-10-18T14:03:07.633941+0000","last_became_active":"2023-10-18T14:02:32.447057+0000","last_became_peered":"2023-10-18T14:02:32.447057+0000","last_unstale":"2023-10-18T14:03:07.633941+0000","last_undegraded":"2023-10-18T14:03:07.633941+0000","last_fullsized":"2023-10-18T14:03:07.633941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:33:43.469496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630438+0000","last_change":"2023-10-18T14:02:31.849118+0000","last_active":"2023-10-18T14:03:07.630438+0000","last_peered":"2023-10-18T14:03:07.630438+0000","last_clean":"2023-10-18T14:03:07.630438+0000","last_became_active":"2023-10-18T14:02:31.848827+0000","last_became_peered":"2023-10-18T14:02:31.848827+0000","last_unstale":"2023-10-18T14:03:07.630438+0000","last_undegraded":"2023-10-18T14:03:07.630438+0000","last_fullsized":"2023-10-18T14:03:07.630438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:41:17.309102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631773+0000","last_change":"2023-10-18T14:02:32.447157+0000","last_active":"2023-10-18T14:03:07.631773+0000","last_peered":"2023-10-18T14:03:07.631773+0000","last_clean":"2023-10-18T14:03:07.631773+0000","last_became_active":"2023-10-18T14:02:32.446861+0000","last_became_peered":"2023-10-18T14:02:32.446861+0000","last_unstale":"2023-10-18T14:03:07.631773+0000","last_undegraded":"2023-10-18T14:03:07.631773+0000","last_fullsized":"2023-10-18T14:03:07.631773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:58:58.146931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633247+0000","last_change":"2023-10-18T14:02:31.838819+0000","last_active":"2023-10-18T14:03:07.633247+0000","last_peered":"2023-10-18T14:03:07.633247+0000","last_clean":"2023-10-18T14:03:07.633247+0000","last_became_active":"2023-10-18T14:02:31.838488+0000","last_became_peered":"2023-10-18T14:02:31.838488+0000","last_unstale":"2023-10-18T14:03:07.633247+0000","last_undegraded":"2023-10-18T14:03:07.633247+0000","last_fullsized":"2023-10-18T14:03:07.633247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:41:37.569792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633964+0000","last_change":"2023-10-18T14:02:32.455108+0000","last_active":"2023-10-18T14:03:07.633964+0000","last_peered":"2023-10-18T14:03:07.633964+0000","last_clean":"2023-10-18T14:03:07.633964+0000","last_became_active":"2023-10-18T14:02:32.454821+0000","last_became_peered":"2023-10-18T14:02:32.454821+0000","last_unstale":"2023-10-18T14:03:07.633964+0000","last_undegraded":"2023-10-18T14:03:07.633964+0000","last_fullsized":"2023-10-18T14:03:07.633964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:00:29.617633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":205,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:54.373604+0000","last_change":"2023-10-18T14:02:31.847241+0000","last_active":"2023-10-18T14:03:54.373604+0000","last_peered":"2023-10-18T14:03:54.373604+0000","last_clean":"2023-10-18T14:03:54.373604+0000","last_became_active":"2023-10-18T14:02:31.846786+0000","last_became_peered":"2023-10-18T14:02:31.846786+0000","last_unstale":"2023-10-18T14:03:54.373604+0000","last_undegraded":"2023-10-18T14:03:54.373604+0000","last_fullsized":"2023-10-18T14:03:54.373604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:53:47.539696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58575,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":161,"num_read_kb":137,"num_write":31,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630833+0000","last_change":"2023-10-18T14:02:32.458530+0000","last_active":"2023-10-18T14:03:07.630833+0000","last_peered":"2023-10-18T14:03:07.630833+0000","last_clean":"2023-10-18T14:03:07.630833+0000","last_became_active":"2023-10-18T14:02:32.458199+0000","last_became_peered":"2023-10-18T14:02:32.458199+0000","last_unstale":"2023-10-18T14:03:07.630833+0000","last_undegraded":"2023-10-18T14:03:07.630833+0000","last_fullsized":"2023-10-18T14:03:07.630833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:52:16.107456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.656760+0000","last_change":"2023-10-18T14:03:08.656457+0000","last_active":"2023-10-18T14:03:08.656760+0000","last_peered":"2023-10-18T14:03:08.656760+0000","last_clean":"2023-10-18T14:03:08.656760+0000","last_became_active":"2023-10-18T14:03:08.638227+0000","last_became_peered":"2023-10-18T14:03:08.638227+0000","last_unstale":"2023-10-18T14:03:08.656760+0000","last_undegraded":"2023-10-18T14:03:08.656760+0000","last_fullsized":"2023-10-18T14:03:08.656760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:28:29.502844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633370+0000","last_change":"2023-10-18T14:02:32.456404+0000","last_active":"2023-10-18T14:03:07.633370+0000","last_peered":"2023-10-18T14:03:07.633370+0000","last_clean":"2023-10-18T14:03:07.633370+0000","last_became_active":"2023-10-18T14:02:32.456128+0000","last_became_peered":"2023-10-18T14:02:32.456128+0000","last_unstale":"2023-10-18T14:03:07.633370+0000","last_undegraded":"2023-10-18T14:03:07.633370+0000","last_fullsized":"2023-10-18T14:03:07.633370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:23:41.315513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633298+0000","last_change":"2023-10-18T14:02:31.846871+0000","last_active":"2023-10-18T14:03:07.633298+0000","last_peered":"2023-10-18T14:03:07.633298+0000","last_clean":"2023-10-18T14:03:07.633298+0000","last_became_active":"2023-10-18T14:02:31.846570+0000","last_became_peered":"2023-10-18T14:02:31.846570+0000","last_unstale":"2023-10-18T14:03:07.633298+0000","last_undegraded":"2023-10-18T14:03:07.633298+0000","last_fullsized":"2023-10-18T14:03:07.633298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:38:46.096769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.632825+0000","last_change":"2023-10-18T14:03:08.632825+0000","last_active":"2023-10-18T14:03:08.632825+0000","last_peered":"2023-10-18T14:03:08.632825+0000","last_clean":"2023-10-18T14:03:08.632825+0000","last_became_active":"2023-10-18T14:03:08.632453+0000","last_became_peered":"2023-10-18T14:03:08.632453+0000","last_unstale":"2023-10-18T14:03:08.632825+0000","last_undegraded":"2023-10-18T14:03:08.632825+0000","last_fullsized":"2023-10-18T14:03:08.632825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:30.707828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":100,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:54.373805+0000","last_change":"2023-10-18T14:02:31.844367+0000","last_active":"2023-10-18T14:03:54.373805+0000","last_peered":"2023-10-18T14:03:54.373805+0000","last_clean":"2023-10-18T14:03:54.373805+0000","last_became_active":"2023-10-18T14:02:31.844060+0000","last_became_peered":"2023-10-18T14:02:31.844060+0000","last_unstale":"2023-10-18T14:03:54.373805+0000","last_undegraded":"2023-10-18T14:03:54.373805+0000","last_fullsized":"2023-10-18T14:03:54.373805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:06:09.656240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629934+0000","last_change":"2023-10-18T14:02:32.464529+0000","last_active":"2023-10-18T14:03:07.629934+0000","last_peered":"2023-10-18T14:03:07.629934+0000","last_clean":"2023-10-18T14:03:07.629934+0000","last_became_active":"2023-10-18T14:02:32.464232+0000","last_became_peered":"2023-10-18T14:02:32.464232+0000","last_unstale":"2023-10-18T14:03:07.629934+0000","last_undegraded":"2023-10-18T14:03:07.629934+0000","last_fullsized":"2023-10-18T14:03:07.629934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:10:43.011803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629881+0000","last_change":"2023-10-18T14:02:31.850537+0000","last_active":"2023-10-18T14:03:07.629881+0000","last_peered":"2023-10-18T14:03:07.629881+0000","last_clean":"2023-10-18T14:03:07.629881+0000","last_became_active":"2023-10-18T14:02:31.849391+0000","last_became_peered":"2023-10-18T14:02:31.849391+0000","last_unstale":"2023-10-18T14:03:07.629881+0000","last_undegraded":"2023-10-18T14:03:07.629881+0000","last_fullsized":"2023-10-18T14:03:07.629881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:19:31.270179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.635208+0000","last_change":"2023-10-18T14:03:08.635208+0000","last_active":"2023-10-18T14:03:08.635208+0000","last_peered":"2023-10-18T14:03:08.635208+0000","last_clean":"2023-10-18T14:03:08.635208+0000","last_became_active":"2023-10-18T14:03:08.634800+0000","last_became_peered":"2023-10-18T14:03:08.634800+0000","last_unstale":"2023-10-18T14:03:08.635208+0000","last_undegraded":"2023-10-18T14:03:08.635208+0000","last_fullsized":"2023-10-18T14:03:08.635208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:36:00.844237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631121+0000","last_change":"2023-10-18T14:02:31.850706+0000","last_active":"2023-10-18T14:03:07.631121+0000","last_peered":"2023-10-18T14:03:07.631121+0000","last_clean":"2023-10-18T14:03:07.631121+0000","last_became_active":"2023-10-18T14:02:31.849354+0000","last_became_peered":"2023-10-18T14:02:31.849354+0000","last_unstale":"2023-10-18T14:03:07.631121+0000","last_undegraded":"2023-10-18T14:03:07.631121+0000","last_fullsized":"2023-10-18T14:03:07.631121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:51:31.071528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631242+0000","last_change":"2023-10-18T14:02:32.454196+0000","last_active":"2023-10-18T14:03:07.631242+0000","last_peered":"2023-10-18T14:03:07.631242+0000","last_clean":"2023-10-18T14:03:07.631242+0000","last_became_active":"2023-10-18T14:02:32.453861+0000","last_became_peered":"2023-10-18T14:02:32.453861+0000","last_unstale":"2023-10-18T14:03:07.631242+0000","last_undegraded":"2023-10-18T14:03:07.631242+0000","last_fullsized":"2023-10-18T14:03:07.631242+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:43.217757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627432+0000","last_change":"2023-10-18T14:02:31.849707+0000","last_active":"2023-10-18T14:03:07.627432+0000","last_peered":"2023-10-18T14:03:07.627432+0000","last_clean":"2023-10-18T14:03:07.627432+0000","last_became_active":"2023-10-18T14:02:31.849442+0000","last_became_peered":"2023-10-18T14:02:31.849442+0000","last_unstale":"2023-10-18T14:03:07.627432+0000","last_undegraded":"2023-10-18T14:03:07.627432+0000","last_fullsized":"2023-10-18T14:03:07.627432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:39:15.669730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632631+0000","last_change":"2023-10-18T14:02:32.457433+0000","last_active":"2023-10-18T14:03:07.632631+0000","last_peered":"2023-10-18T14:03:07.632631+0000","last_clean":"2023-10-18T14:03:07.632631+0000","last_became_active":"2023-10-18T14:02:32.457057+0000","last_became_peered":"2023-10-18T14:02:32.457057+0000","last_unstale":"2023-10-18T14:03:07.632631+0000","last_undegraded":"2023-10-18T14:03:07.632631+0000","last_fullsized":"2023-10-18T14:03:07.632631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:53.088723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'6","reported_seq":102,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:57.400429+0000","last_change":"2023-10-18T14:02:31.848595+0000","last_active":"2023-10-18T14:03:57.400429+0000","last_peered":"2023-10-18T14:03:57.400429+0000","last_clean":"2023-10-18T14:03:57.400429+0000","last_became_active":"2023-10-18T14:02:31.847987+0000","last_became_peered":"2023-10-18T14:02:31.847987+0000","last_unstale":"2023-10-18T14:03:57.400429+0000","last_undegraded":"2023-10-18T14:03:57.400429+0000","last_fullsized":"2023-10-18T14:03:57.400429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:03:34.356729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":906,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632829+0000","last_change":"2023-10-18T14:02:32.446514+0000","last_active":"2023-10-18T14:03:07.632829+0000","last_peered":"2023-10-18T14:03:07.632829+0000","last_clean":"2023-10-18T14:03:07.632829+0000","last_became_active":"2023-10-18T14:02:32.446015+0000","last_became_peered":"2023-10-18T14:02:32.446015+0000","last_unstale":"2023-10-18T14:03:07.632829+0000","last_undegraded":"2023-10-18T14:03:07.632829+0000","last_fullsized":"2023-10-18T14:03:07.632829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:21:09.897636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632600+0000","last_change":"2023-10-18T14:02:32.444969+0000","last_active":"2023-10-18T14:03:07.632600+0000","last_peered":"2023-10-18T14:03:07.632600+0000","last_clean":"2023-10-18T14:03:07.632600+0000","last_became_active":"2023-10-18T14:02:32.444592+0000","last_became_peered":"2023-10-18T14:02:32.444592+0000","last_unstale":"2023-10-18T14:03:07.632600+0000","last_undegraded":"2023-10-18T14:03:07.632600+0000","last_fullsized":"2023-10-18T14:03:07.632600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:02:58.377003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":101,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:56.375918+0000","last_change":"2023-10-18T14:02:31.847368+0000","last_active":"2023-10-18T14:03:56.375918+0000","last_peered":"2023-10-18T14:03:56.375918+0000","last_clean":"2023-10-18T14:03:56.375918+0000","last_became_active":"2023-10-18T14:02:31.847072+0000","last_became_peered":"2023-10-18T14:02:31.847072+0000","last_unstale":"2023-10-18T14:03:56.375918+0000","last_undegraded":"2023-10-18T14:03:56.375918+0000","last_fullsized":"2023-10-18T14:03:56.375918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:28:24.771284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.632551+0000","last_change":"2023-10-18T14:03:08.632138+0000","last_active":"2023-10-18T14:03:08.632551+0000","last_peered":"2023-10-18T14:03:08.632551+0000","last_clean":"2023-10-18T14:03:08.632551+0000","last_became_active":"2023-10-18T14:03:08.631902+0000","last_became_peered":"2023-10-18T14:03:08.631902+0000","last_unstale":"2023-10-18T14:03:08.632551+0000","last_undegraded":"2023-10-18T14:03:08.632551+0000","last_fullsized":"2023-10-18T14:03:08.632551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:31:10.646568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628041+0000","last_change":"2023-10-18T14:02:31.843678+0000","last_active":"2023-10-18T14:03:07.628041+0000","last_peered":"2023-10-18T14:03:07.628041+0000","last_clean":"2023-10-18T14:03:07.628041+0000","last_became_active":"2023-10-18T14:02:31.843332+0000","last_became_peered":"2023-10-18T14:02:31.843332+0000","last_unstale":"2023-10-18T14:03:07.628041+0000","last_undegraded":"2023-10-18T14:03:07.628041+0000","last_fullsized":"2023-10-18T14:03:07.628041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:06:04.549859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":321,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630029+0000","last_change":"2023-10-18T14:01:34.022246+0000","last_active":"2023-10-18T14:03:07.630029+0000","last_peered":"2023-10-18T14:03:07.630029+0000","last_clean":"2023-10-18T14:03:07.630029+0000","last_became_active":"2023-10-18T14:01:34.021768+0000","last_became_peered":"2023-10-18T14:01:34.021768+0000","last_unstale":"2023-10-18T14:03:07.630029+0000","last_undegraded":"2023-10-18T14:03:07.630029+0000","last_fullsized":"2023-10-18T14:03:07.630029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T13:58:44.223424+0000","last_clean_scrub_stamp":"2023-10-18T13:58:44.223424+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:48.521087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632798+0000","last_change":"2023-10-18T14:02:32.440662+0000","last_active":"2023-10-18T14:03:07.632798+0000","last_peered":"2023-10-18T14:03:07.632798+0000","last_clean":"2023-10-18T14:03:07.632798+0000","last_became_active":"2023-10-18T14:02:32.440345+0000","last_became_peered":"2023-10-18T14:02:32.440345+0000","last_unstale":"2023-10-18T14:03:07.632798+0000","last_undegraded":"2023-10-18T14:03:07.632798+0000","last_fullsized":"2023-10-18T14:03:07.632798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:21.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630113+0000","last_change":"2023-10-18T14:02:31.850243+0000","last_active":"2023-10-18T14:03:07.630113+0000","last_peered":"2023-10-18T14:03:07.630113+0000","last_clean":"2023-10-18T14:03:07.630113+0000","last_became_active":"2023-10-18T14:02:31.849952+0000","last_became_peered":"2023-10-18T14:02:31.849952+0000","last_unstale":"2023-10-18T14:03:07.630113+0000","last_undegraded":"2023-10-18T14:03:07.630113+0000","last_fullsized":"2023-10-18T14:03:07.630113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:11:50.877219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.647452+0000","last_change":"2023-10-18T14:03:08.647076+0000","last_active":"2023-10-18T14:03:08.647452+0000","last_peered":"2023-10-18T14:03:08.647452+0000","last_clean":"2023-10-18T14:03:08.647452+0000","last_became_active":"2023-10-18T14:03:08.637530+0000","last_became_peered":"2023-10-18T14:03:08.637530+0000","last_unstale":"2023-10-18T14:03:08.647452+0000","last_undegraded":"2023-10-18T14:03:08.647452+0000","last_fullsized":"2023-10-18T14:03:08.647452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:33.344068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633493+0000","last_change":"2023-10-18T14:02:32.445046+0000","last_active":"2023-10-18T14:03:07.633493+0000","last_peered":"2023-10-18T14:03:07.633493+0000","last_clean":"2023-10-18T14:03:07.633493+0000","last_became_active":"2023-10-18T14:02:32.444827+0000","last_became_peered":"2023-10-18T14:02:32.444827+0000","last_unstale":"2023-10-18T14:03:07.633493+0000","last_undegraded":"2023-10-18T14:03:07.633493+0000","last_fullsized":"2023-10-18T14:03:07.633493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:26:11.024405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627694+0000","last_change":"2023-10-18T14:02:31.846888+0000","last_active":"2023-10-18T14:03:07.627694+0000","last_peered":"2023-10-18T14:03:07.627694+0000","last_clean":"2023-10-18T14:03:07.627694+0000","last_became_active":"2023-10-18T14:02:31.846591+0000","last_became_peered":"2023-10-18T14:02:31.846591+0000","last_unstale":"2023-10-18T14:03:07.627694+0000","last_undegraded":"2023-10-18T14:03:07.627694+0000","last_fullsized":"2023-10-18T14:03:07.627694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:48:03.683135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633530+0000","last_change":"2023-10-18T14:02:32.456951+0000","last_active":"2023-10-18T14:03:07.633530+0000","last_peered":"2023-10-18T14:03:07.633530+0000","last_clean":"2023-10-18T14:03:07.633530+0000","last_became_active":"2023-10-18T14:02:32.456588+0000","last_became_peered":"2023-10-18T14:02:32.456588+0000","last_unstale":"2023-10-18T14:03:07.633530+0000","last_undegraded":"2023-10-18T14:03:07.633530+0000","last_fullsized":"2023-10-18T14:03:07.633530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:51:51.335310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628601+0000","last_change":"2023-10-18T14:02:31.845258+0000","last_active":"2023-10-18T14:03:07.628601+0000","last_peered":"2023-10-18T14:03:07.628601+0000","last_clean":"2023-10-18T14:03:07.628601+0000","last_became_active":"2023-10-18T14:02:31.844933+0000","last_became_peered":"2023-10-18T14:02:31.844933+0000","last_unstale":"2023-10-18T14:03:07.628601+0000","last_undegraded":"2023-10-18T14:03:07.628601+0000","last_fullsized":"2023-10-18T14:03:07.628601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:51:46.765525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631689+0000","last_change":"2023-10-18T14:02:32.454955+0000","last_active":"2023-10-18T14:03:07.631689+0000","last_peered":"2023-10-18T14:03:07.631689+0000","last_clean":"2023-10-18T14:03:07.631689+0000","last_became_active":"2023-10-18T14:02:32.454689+0000","last_became_peered":"2023-10-18T14:02:32.454689+0000","last_unstale":"2023-10-18T14:03:07.631689+0000","last_undegraded":"2023-10-18T14:03:07.631689+0000","last_fullsized":"2023-10-18T14:03:07.631689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:57:20.461517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633726+0000","last_change":"2023-10-18T14:02:31.849273+0000","last_active":"2023-10-18T14:03:07.633726+0000","last_peered":"2023-10-18T14:03:07.633726+0000","last_clean":"2023-10-18T14:03:07.633726+0000","last_became_active":"2023-10-18T14:02:31.848985+0000","last_became_peered":"2023-10-18T14:02:31.848985+0000","last_unstale":"2023-10-18T14:03:07.633726+0000","last_undegraded":"2023-10-18T14:03:07.633726+0000","last_fullsized":"2023-10-18T14:03:07.633726+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:55:54.516857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629855+0000","last_change":"2023-10-18T14:02:32.449557+0000","last_active":"2023-10-18T14:03:07.629855+0000","last_peered":"2023-10-18T14:03:07.629855+0000","last_clean":"2023-10-18T14:03:07.629855+0000","last_became_active":"2023-10-18T14:02:32.449033+0000","last_became_peered":"2023-10-18T14:02:32.449033+0000","last_unstale":"2023-10-18T14:03:07.629855+0000","last_undegraded":"2023-10-18T14:03:07.629855+0000","last_fullsized":"2023-10-18T14:03:07.629855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:32.983379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632227+0000","last_change":"2023-10-18T14:02:31.846109+0000","last_active":"2023-10-18T14:03:07.632227+0000","last_peered":"2023-10-18T14:03:07.632227+0000","last_clean":"2023-10-18T14:03:07.632227+0000","last_became_active":"2023-10-18T14:02:31.845236+0000","last_became_peered":"2023-10-18T14:02:31.845236+0000","last_unstale":"2023-10-18T14:03:07.632227+0000","last_undegraded":"2023-10-18T14:03:07.632227+0000","last_fullsized":"2023-10-18T14:03:07.632227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:16:46.880974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631047+0000","last_change":"2023-10-18T14:02:32.446465+0000","last_active":"2023-10-18T14:03:07.631047+0000","last_peered":"2023-10-18T14:03:07.631047+0000","last_clean":"2023-10-18T14:03:07.631047+0000","last_became_active":"2023-10-18T14:02:32.446172+0000","last_became_peered":"2023-10-18T14:02:32.446172+0000","last_unstale":"2023-10-18T14:03:07.631047+0000","last_undegraded":"2023-10-18T14:03:07.631047+0000","last_fullsized":"2023-10-18T14:03:07.631047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:14:40.094870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628081+0000","last_change":"2023-10-18T14:02:31.851198+0000","last_active":"2023-10-18T14:03:07.628081+0000","last_peered":"2023-10-18T14:03:07.628081+0000","last_clean":"2023-10-18T14:03:07.628081+0000","last_became_active":"2023-10-18T14:02:31.850524+0000","last_became_peered":"2023-10-18T14:02:31.850524+0000","last_unstale":"2023-10-18T14:03:07.628081+0000","last_undegraded":"2023-10-18T14:03:07.628081+0000","last_fullsized":"2023-10-18T14:03:07.628081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:13:44.133077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633065+0000","last_change":"2023-10-18T14:02:32.446732+0000","last_active":"2023-10-18T14:03:07.633065+0000","last_peered":"2023-10-18T14:03:07.633065+0000","last_clean":"2023-10-18T14:03:07.633065+0000","last_became_active":"2023-10-18T14:02:32.446418+0000","last_became_peered":"2023-10-18T14:02:32.446418+0000","last_unstale":"2023-10-18T14:03:07.633065+0000","last_undegraded":"2023-10-18T14:03:07.633065+0000","last_fullsized":"2023-10-18T14:03:07.633065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:13.765988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630012+0000","last_change":"2023-10-18T14:02:31.852648+0000","last_active":"2023-10-18T14:03:07.630012+0000","last_peered":"2023-10-18T14:03:07.630012+0000","last_clean":"2023-10-18T14:03:07.630012+0000","last_became_active":"2023-10-18T14:02:31.852361+0000","last_became_peered":"2023-10-18T14:02:31.852361+0000","last_unstale":"2023-10-18T14:03:07.630012+0000","last_undegraded":"2023-10-18T14:03:07.630012+0000","last_fullsized":"2023-10-18T14:03:07.630012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:54:28.189196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630302+0000","last_change":"2023-10-18T14:02:32.464220+0000","last_active":"2023-10-18T14:03:07.630302+0000","last_peered":"2023-10-18T14:03:07.630302+0000","last_clean":"2023-10-18T14:03:07.630302+0000","last_became_active":"2023-10-18T14:02:32.463213+0000","last_became_peered":"2023-10-18T14:02:32.463213+0000","last_unstale":"2023-10-18T14:03:07.630302+0000","last_undegraded":"2023-10-18T14:03:07.630302+0000","last_fullsized":"2023-10-18T14:03:07.630302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:53.777086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":103,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:57.378914+0000","last_change":"2023-10-18T14:02:31.848305+0000","last_active":"2023-10-18T14:03:57.378914+0000","last_peered":"2023-10-18T14:03:57.378914+0000","last_clean":"2023-10-18T14:03:57.378914+0000","last_became_active":"2023-10-18T14:02:31.847739+0000","last_became_peered":"2023-10-18T14:02:31.847739+0000","last_unstale":"2023-10-18T14:03:57.378914+0000","last_undegraded":"2023-10-18T14:03:57.378914+0000","last_fullsized":"2023-10-18T14:03:57.378914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:52:24.543703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630458+0000","last_change":"2023-10-18T14:02:32.460802+0000","last_active":"2023-10-18T14:03:07.630458+0000","last_peered":"2023-10-18T14:03:07.630458+0000","last_clean":"2023-10-18T14:03:07.630458+0000","last_became_active":"2023-10-18T14:02:32.460160+0000","last_became_peered":"2023-10-18T14:02:32.460160+0000","last_unstale":"2023-10-18T14:03:07.630458+0000","last_undegraded":"2023-10-18T14:03:07.630458+0000","last_fullsized":"2023-10-18T14:03:07.630458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:20:55.614142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633018+0000","last_change":"2023-10-18T14:02:31.845468+0000","last_active":"2023-10-18T14:03:07.633018+0000","last_peered":"2023-10-18T14:03:07.633018+0000","last_clean":"2023-10-18T14:03:07.633018+0000","last_became_active":"2023-10-18T14:02:31.845057+0000","last_became_peered":"2023-10-18T14:02:31.845057+0000","last_unstale":"2023-10-18T14:03:07.633018+0000","last_undegraded":"2023-10-18T14:03:07.633018+0000","last_fullsized":"2023-10-18T14:03:07.633018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:08:23.972051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630377+0000","last_change":"2023-10-18T14:02:32.462572+0000","last_active":"2023-10-18T14:03:07.630377+0000","last_peered":"2023-10-18T14:03:07.630377+0000","last_clean":"2023-10-18T14:03:07.630377+0000","last_became_active":"2023-10-18T14:02:32.462140+0000","last_became_peered":"2023-10-18T14:02:32.462140+0000","last_unstale":"2023-10-18T14:03:07.630377+0000","last_undegraded":"2023-10-18T14:03:07.630377+0000","last_fullsized":"2023-10-18T14:03:07.630377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:03:34.605932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633629+0000","last_change":"2023-10-18T14:02:31.847322+0000","last_active":"2023-10-18T14:03:07.633629+0000","last_peered":"2023-10-18T14:03:07.633629+0000","last_clean":"2023-10-18T14:03:07.633629+0000","last_became_active":"2023-10-18T14:02:31.847008+0000","last_became_peered":"2023-10-18T14:02:31.847008+0000","last_unstale":"2023-10-18T14:03:07.633629+0000","last_undegraded":"2023-10-18T14:03:07.633629+0000","last_fullsized":"2023-10-18T14:03:07.633629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:30.817792+0000","last_clean_scrub_stamp":"2023-10-18T14:02:30.817792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:59:18.850165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.630579+0000","last_change":"2023-10-18T14:02:32.461592+0000","last_active":"2023-10-18T14:03:07.630579+0000","last_peered":"2023-10-18T14:03:07.630579+0000","last_clean":"2023-10-18T14:03:07.630579+0000","last_became_active":"2023-10-18T14:02:32.461265+0000","last_became_peered":"2023-10-18T14:02:32.461265+0000","last_unstale":"2023-10-18T14:03:07.630579+0000","last_undegraded":"2023-10-18T14:03:07.630579+0000","last_fullsized":"2023-10-18T14:03:07.630579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:03.315431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631175+0000","last_change":"2023-10-18T14:02:32.445480+0000","last_active":"2023-10-18T14:03:07.631175+0000","last_peered":"2023-10-18T14:03:07.631175+0000","last_clean":"2023-10-18T14:03:07.631175+0000","last_became_active":"2023-10-18T14:02:32.443036+0000","last_became_peered":"2023-10-18T14:02:32.443036+0000","last_unstale":"2023-10-18T14:03:07.631175+0000","last_undegraded":"2023-10-18T14:03:07.631175+0000","last_fullsized":"2023-10-18T14:03:07.631175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:59:57.637358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.628022+0000","last_change":"2023-10-18T14:02:32.456400+0000","last_active":"2023-10-18T14:03:07.628022+0000","last_peered":"2023-10-18T14:03:07.628022+0000","last_clean":"2023-10-18T14:03:07.628022+0000","last_became_active":"2023-10-18T14:02:32.456072+0000","last_became_peered":"2023-10-18T14:02:32.456072+0000","last_unstale":"2023-10-18T14:03:07.628022+0000","last_undegraded":"2023-10-18T14:03:07.628022+0000","last_fullsized":"2023-10-18T14:03:07.628022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:22:59.844454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.627995+0000","last_change":"2023-10-18T14:02:32.448089+0000","last_active":"2023-10-18T14:03:07.627995+0000","last_peered":"2023-10-18T14:03:07.627995+0000","last_clean":"2023-10-18T14:03:07.627995+0000","last_became_active":"2023-10-18T14:02:32.447866+0000","last_became_peered":"2023-10-18T14:02:32.447866+0000","last_unstale":"2023-10-18T14:03:07.627995+0000","last_undegraded":"2023-10-18T14:03:07.627995+0000","last_fullsized":"2023-10-18T14:03:07.627995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T01:28:35.558009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631717+0000","last_change":"2023-10-18T14:02:32.444103+0000","last_active":"2023-10-18T14:03:07.631717+0000","last_peered":"2023-10-18T14:03:07.631717+0000","last_clean":"2023-10-18T14:03:07.631717+0000","last_became_active":"2023-10-18T14:02:32.443762+0000","last_became_peered":"2023-10-18T14:02:32.443762+0000","last_unstale":"2023-10-18T14:03:07.631717+0000","last_undegraded":"2023-10-18T14:03:07.631717+0000","last_fullsized":"2023-10-18T14:03:07.631717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:47.695764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633454+0000","last_change":"2023-10-18T14:02:32.449409+0000","last_active":"2023-10-18T14:03:07.633454+0000","last_peered":"2023-10-18T14:03:07.633454+0000","last_clean":"2023-10-18T14:03:07.633454+0000","last_became_active":"2023-10-18T14:02:32.449114+0000","last_became_peered":"2023-10-18T14:02:32.449114+0000","last_unstale":"2023-10-18T14:03:07.633454+0000","last_undegraded":"2023-10-18T14:03:07.633454+0000","last_fullsized":"2023-10-18T14:03:07.633454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:59:45.167577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.631298+0000","last_change":"2023-10-18T14:02:32.452013+0000","last_active":"2023-10-18T14:03:07.631298+0000","last_peered":"2023-10-18T14:03:07.631298+0000","last_clean":"2023-10-18T14:03:07.631298+0000","last_became_active":"2023-10-18T14:02:32.451734+0000","last_became_peered":"2023-10-18T14:02:32.451734+0000","last_unstale":"2023-10-18T14:03:07.631298+0000","last_undegraded":"2023-10-18T14:03:07.631298+0000","last_fullsized":"2023-10-18T14:03:07.631298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:15:44.511378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.629153+0000","last_change":"2023-10-18T14:02:32.445503+0000","last_active":"2023-10-18T14:03:07.629153+0000","last_peered":"2023-10-18T14:03:07.629153+0000","last_clean":"2023-10-18T14:03:07.629153+0000","last_became_active":"2023-10-18T14:02:32.445172+0000","last_became_peered":"2023-10-18T14:02:32.445172+0000","last_unstale":"2023-10-18T14:03:07.629153+0000","last_undegraded":"2023-10-18T14:03:07.629153+0000","last_fullsized":"2023-10-18T14:03:07.629153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:23:08.456949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.633490+0000","last_change":"2023-10-18T14:02:32.459690+0000","last_active":"2023-10-18T14:03:07.633490+0000","last_peered":"2023-10-18T14:03:07.633490+0000","last_clean":"2023-10-18T14:03:07.633490+0000","last_became_active":"2023-10-18T14:02:32.459373+0000","last_became_peered":"2023-10-18T14:02:32.459373+0000","last_unstale":"2023-10-18T14:03:07.633490+0000","last_undegraded":"2023-10-18T14:03:07.633490+0000","last_fullsized":"2023-10-18T14:03:07.633490+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:36.092029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632468+0000","last_change":"2023-10-18T14:02:32.455076+0000","last_active":"2023-10-18T14:03:07.632468+0000","last_peered":"2023-10-18T14:03:07.632468+0000","last_clean":"2023-10-18T14:03:07.632468+0000","last_became_active":"2023-10-18T14:02:32.454750+0000","last_became_peered":"2023-10-18T14:02:32.454750+0000","last_unstale":"2023-10-18T14:03:07.632468+0000","last_undegraded":"2023-10-18T14:03:07.632468+0000","last_fullsized":"2023-10-18T14:03:07.632468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:08:00.855583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.632303+0000","last_change":"2023-10-18T14:02:32.450714+0000","last_active":"2023-10-18T14:03:07.632303+0000","last_peered":"2023-10-18T14:03:07.632303+0000","last_clean":"2023-10-18T14:03:07.632303+0000","last_became_active":"2023-10-18T14:02:32.450429+0000","last_became_peered":"2023-10-18T14:02:32.450429+0000","last_unstale":"2023-10-18T14:03:07.632303+0000","last_undegraded":"2023-10-18T14:03:07.632303+0000","last_fullsized":"2023-10-18T14:03:07.632303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:43:21.746296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634401+0000","last_change":"2023-10-18T14:02:32.457392+0000","last_active":"2023-10-18T14:03:07.634401+0000","last_peered":"2023-10-18T14:03:07.634401+0000","last_clean":"2023-10-18T14:03:07.634401+0000","last_became_active":"2023-10-18T14:02:32.457072+0000","last_became_peered":"2023-10-18T14:02:32.457072+0000","last_unstale":"2023-10-18T14:03:07.634401+0000","last_undegraded":"2023-10-18T14:03:07.634401+0000","last_fullsized":"2023-10-18T14:03:07.634401+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:19:51.691351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-18T14:03:07.634009+0000","last_change":"2023-10-18T14:02:32.457541+0000","last_active":"2023-10-18T14:03:07.634009+0000","last_peered":"2023-10-18T14:03:07.634009+0000","last_clean":"2023-10-18T14:03:07.634009+0000","last_became_active":"2023-10-18T14:02:32.457266+0000","last_became_peered":"2023-10-18T14:02:32.457266+0000","last_unstale":"2023-10-18T14:03:07.634009+0000","last_undegraded":"2023-10-18T14:03:07.634009+0000","last_fullsized":"2023-10-18T14:03:07.634009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:41:16.131463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-18T14:03:08.636413+0000","last_change":"2023-10-18T14:03:08.636413+0000","last_active":"2023-10-18T14:03:08.636413+0000","last_peered":"2023-10-18T14:03:08.636413+0000","last_clean":"2023-10-18T14:03:08.636413+0000","last_became_active":"2023-10-18T14:03:08.635985+0000","last_became_peered":"2023-10-18T14:03:08.635985+0000","last_unstale":"2023-10-18T14:03:08.636413+0000","last_undegraded":"2023-10-18T14:03:08.636413+0000","last_fullsized":"2023-10-18T14:03:08.636413+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T14:02:31.825521+0000","last_clean_scrub_stamp":"2023-10-18T14:02:31.825521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:53:28.848373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250031,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65705,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":820,"num_read_kb":479,"num_write":230,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":180,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":197751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449117,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":459517,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69899999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.47199999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.77400000000000002,"5min":1.226,"15min":1.226},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63200000000000001,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.76200000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.76200000000000001}]},{"osd":2,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79000000000000004,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45000000000000001},"min":{"1min":0.39100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":4,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.66300000000000003,"15min":0.65200000000000002},"min":{"1min":0.59799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.55800000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.012,"5min":1.119,"15min":1.119},"last":0.81000000000000005}]},{"osd":5,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.433,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.42799999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67200000000000004}]},{"osd":6,"last update":"Wed Oct 18 14:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.74399999999999999,"15min":0.73599999999999999},"min":{"1min":0.64300000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.54700000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91900000000000004,"5min":1.298,"15min":1.298},"last":0.88800000000000001}]},{"osd":8,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.75},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.83599999999999997}]},{"osd":9,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.748},"min":{"1min":0.59399999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88500000000000001,"5min":1.343,"15min":1.343},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.56399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.95399999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.90300000000000002}]},{"osd":10,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.66000000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.96899999999999997,"5min":1.181,"15min":1.181},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.78300000000000003,"15min":0.78200000000000003},"min":{"1min":0.67600000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97899999999999998,"5min":1.482,"15min":1.482},"last":0.877}]}]},{"osd":10,"up_from":70,"seq":300647710751,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":1108616,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.68700000000000006}]},{"osd":1,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.32000000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59199999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.27800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.63400000000000001}]},{"osd":2,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78800000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71199999999999997}]},{"osd":3,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80800000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.746}]},{"osd":4,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.46600000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.433,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79200000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86299999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70599999999999996,"15min":0.70499999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95199999999999996,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.621}]},{"osd":6,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70999999999999996,"15min":0.71099999999999997},"min":{"1min":0.56200000000000006,"5min":0.378,"15min":0.378},"max":{"1min":0.878,"5min":1.006,"15min":1.006},"last":0.81499999999999995}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65100000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.621,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92000000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.61799999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.82899999999999996}]},{"osd":9,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.64100000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.53700000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90700000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.77700000000000002}]},{"osd":11,"last update":"Wed Oct 18 14:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.66500000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92000000000000004,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.88900000000000001}]}]},{"osd":9,"up_from":65,"seq":279172874277,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":459267,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.49199999999999999,"15min":0.501},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.32100000000000001}]},{"osd":1,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.495},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.48299999999999998}]},{"osd":2,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.30099999999999999}]},{"osd":4,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.52600000000000002}]},{"osd":5,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.73199999999999998,"15min":0.747},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36599999999999999,"5min":0.308,"15min":0.308},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.71699999999999997,"15min":0.73399999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59699999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.54200000000000004}]},{"osd":8,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75600000000000001,"15min":0.76800000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1080000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.67800000000000005}]},{"osd":10,"last update":"Wed Oct 18 14:03:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73899999999999999,"15min":0.75},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.70699999999999996}]}]},{"osd":8,"up_from":58,"seq":249108103209,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":459202,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70899999999999996,"5min":2.302,"15min":2.302},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54900000000000004,"15min":0.53500000000000003},"min":{"1min":0.39600000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69699999999999995,"5min":2.4380000000000002,"15min":2.4380000000000002},"last":0.53400000000000003}]},{"osd":1,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.61099999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.86299999999999999,"5min":0.875,"15min":0.875},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.64500000000000002,"15min":0.63100000000000001},"min":{"1min":0.54500000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.79600000000000004}]},{"osd":2,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.443,"15min":0.42099999999999999},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.44400000000000001},"min":{"1min":0.35199999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.67600000000000005}]},{"osd":3,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67000000000000004,"15min":0.61299999999999999},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3819999999999999,"5min":8.5980000000000008,"15min":8.5980000000000008},"last":0.623},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.58499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0720000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68600000000000005,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.65800000000000003,"15min":0.64300000000000002},"min":{"1min":0.59599999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85399999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.82599999999999996}]},{"osd":5,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.55400000000000005,"15min":0.52300000000000002},"min":{"1min":0.47799999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86099999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.55400000000000005},"min":{"1min":0.51500000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.95899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.89900000000000002}]},{"osd":6,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.751,"15min":0.70099999999999996},"min":{"1min":0.501,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.8819999999999999,"5min":7.4240000000000004,"15min":7.4240000000000004},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.72099999999999997},"min":{"1min":0.56599999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9259999999999999,"5min":11.095000000000001,"15min":11.095000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96299999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.76800000000000002,"15min":0.73499999999999999},"min":{"1min":0.63900000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.995}]},{"osd":9,"last update":"Wed Oct 18 14:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.77200000000000002,"15min":0.74099999999999999},"min":{"1min":0.59599999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.76100000000000001,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":0.91500000000000004}]},{"osd":10,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.81200000000000006,"15min":0.79200000000000004},"min":{"1min":0.73699999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.79500000000000004,"15min":0.78000000000000003},"min":{"1min":0.65300000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.93799999999999994}]},{"osd":11,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.92900000000000005}]}]},{"osd":7,"up_from":51,"seq":219043332141,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":1052486,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47599999999999998}]},{"osd":1,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.41499999999999998},"min":{"1min":0.35599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.625,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.45400000000000001,"15min":0.441},"min":{"1min":0.372,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.53300000000000003}]},{"osd":2,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80500000000000005,"5min":1.254,"15min":1.254},"last":0.67100000000000004}]},{"osd":3,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.748,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.46000000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59299999999999997}]},{"osd":4,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.51400000000000001,"15min":0.49199999999999999},"min":{"1min":0.38500000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.746,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.42399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68100000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.627,"15min":0.61299999999999999},"min":{"1min":0.48299999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.51400000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88600000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.88900000000000001}]},{"osd":6,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.66700000000000004,"15min":0.65100000000000002},"min":{"1min":0.52400000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.504,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.78000000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.70399999999999996}]},{"osd":8,"last update":"Wed Oct 18 14:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.55800000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.046,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79200000000000004,"15min":0.78700000000000003},"min":{"1min":0.70599999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.095,"5min":1.514,"15min":1.514},"last":0.93600000000000005}]},{"osd":9,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.83299999999999996,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.755},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73799999999999999,"15min":0.745},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.84199999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.73799999999999999}]},{"osd":10,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.66300000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72999999999999998,"15min":0.72299999999999998},"min":{"1min":0.504,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93200000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.82499999999999996}]},{"osd":11,"last update":"Wed Oct 18 14:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1,"5min":1,"15min":1},"last":0.84199999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495666,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":459308,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.38300000000000001,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.372,"15min":0.34200000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.32300000000000001}]},{"osd":1,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70699999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.5},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.67000000000000004}]},{"osd":2,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.55800000000000005},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72399999999999998,"5min":1.476,"15min":1.476},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40899999999999997,"15min":0.40000000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51800000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.434},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.46400000000000002}]},{"osd":4,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55400000000000005,"15min":0.52800000000000002},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56899999999999995,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77100000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.622,"15min":0.60199999999999998},"min":{"1min":0.434,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.63300000000000001}]},{"osd":7,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.67700000000000005,"15min":0.68999999999999995},"min":{"1min":0.45100000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.79400000000000004,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.64600000000000002}]},{"osd":8,"last update":"Wed Oct 18 14:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.71299999999999997,"15min":0.747},"min":{"1min":0.52200000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77800000000000002,"5min":1.611,"15min":1.611},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.71099999999999997,"15min":0.72999999999999998},"min":{"1min":0.497,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77600000000000002,"5min":1.399,"15min":1.399},"last":0.62}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75900000000000001,"5min":1.415,"15min":1.415},"last":0.40400000000000003}]},{"osd":10,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72999999999999998,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76000000000000001,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.80500000000000005,"5min":1.448,"15min":1.448},"last":0.68100000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542215,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":519108,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51300000000000001,"15min":0.51200000000000001},"min":{"1min":0.35199999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.78600000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.38400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.85199999999999998,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.442}]},{"osd":2,"last update":"Wed Oct 18 14:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.60099999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91900000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.57999999999999996,"15min":0.54500000000000004},"min":{"1min":0.41899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.85499999999999998}]},{"osd":3,"last update":"Wed Oct 18 14:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.55200000000000005,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89500000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.5,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.54900000000000004}]},{"osd":4,"last update":"Wed Oct 18 14:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.438,"15min":0.39600000000000002},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.51000000000000001,"15min":0.442},"min":{"1min":0.36299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63100000000000001,"15min":0.60299999999999998},"min":{"1min":0.52500000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.63800000000000001,"15min":0.58599999999999997},"min":{"1min":0.57599999999999996,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.81299999999999994}]},{"osd":6,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.56599999999999995,"15min":0.53500000000000003},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81299999999999994,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.499},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61399999999999999,"15min":0.57899999999999996},"min":{"1min":0.52400000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93100000000000005,"5min":1.127,"15min":1.127},"last":0.63900000000000001}]},{"osd":7,"last update":"Wed Oct 18 14:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55600000000000005,"15min":0.53000000000000003},"min":{"1min":0.371,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.59099999999999997,"15min":0.55700000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68200000000000005}]},{"osd":8,"last update":"Wed Oct 18 14:03:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.72599999999999998,"15min":0.69199999999999995},"min":{"1min":0.57599999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.052,"5min":1.081,"15min":1.081},"last":0.875},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.66200000000000003,"15min":0.63100000000000001},"min":{"1min":0.59099999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.79700000000000004}]},{"osd":9,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.73599999999999999,"15min":0.71599999999999997},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.052,"5min":1.165,"15min":1.165},"last":0.83499999999999996}]},{"osd":10,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.64900000000000002,"15min":0.63600000000000001},"min":{"1min":0.432,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.73999999999999999,"15min":0.72499999999999998},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.89800000000000002}]},{"osd":11,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.752},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.92400000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":460323,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 14:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56000000000000005,"15min":0.505},"min":{"1min":0.44800000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.41499999999999998},{"interface":"front","average":{"1min":1.925,"5min":0.81599999999999995,"15min":0.58599999999999997},"min":{"1min":0.35399999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":27.123000000000001,"5min":27.123000000000001,"15min":27.123000000000001},"last":0.40400000000000003}]},{"osd":2,"last update":"Wed Oct 18 14:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.51000000000000001},"min":{"1min":0.40899999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.9870000000000001,"5min":0.81799999999999995,"15min":0.59799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":27.222999999999999,"5min":27.222999999999999,"15min":27.222999999999999},"last":0.60099999999999998}]},{"osd":3,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Oct 18 14:03:30 2023","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":0.84399999999999997,"15min":0.65100000000000002},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":27.053999999999998,"5min":27.053999999999998,"15min":27.053999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.374}]},{"osd":5,"last update":"Wed Oct 18 14:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.47999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":2.0590000000000002,"5min":0.89200000000000002,"15min":0.69599999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":27.192,"5min":27.192,"15min":27.192},"last":0.55000000000000004}]},{"osd":6,"last update":"Wed Oct 18 14:03:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.60199999999999998,"15min":0.54300000000000004},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":8.7010000000000005,"5min":8.7010000000000005,"15min":8.7010000000000005},"last":0.312}]},{"osd":7,"last update":"Wed Oct 18 14:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60499999999999998}]},{"osd":8,"last update":"Wed Oct 18 14:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.50900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.56100000000000005},{"interface":"front","average":{"1min":2.121,"5min":0.98299999999999998,"15min":0.80500000000000005},"min":{"1min":0.497,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":26.992000000000001,"5min":26.992000000000001,"15min":26.992000000000001},"last":0.52600000000000002}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":3.262,"5min":3.262,"15min":3.262},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.51200000000000001}]},{"osd":10,"last update":"Wed Oct 18 14:03:30 2023","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":1.024,"15min":0.84799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":27.09,"5min":27.09,"15min":27.09},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":0.45600000000000002}]},{"osd":11,"last update":"Wed Oct 18 14:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.54300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.92200000000000004,"5min":1.55,"15min":1.55},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":1.8620000000000001,"15min":2.0590000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97599999999999998,"5min":27.154,"15min":27.154},"last":0.57499999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378691,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":518390,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73999999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.39400000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67800000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.626}]},{"osd":1,"last update":"Wed Oct 18 14:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.46999999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79200000000000004,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.58799999999999997,"15min":0.56000000000000005},"min":{"1min":0.46800000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.95699999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.88}]},{"osd":3,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.60299999999999998,"15min":0.56100000000000005},"min":{"1min":0.44700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.61199999999999999,"15min":0.58599999999999997},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.78500000000000003}]},{"osd":5,"last update":"Wed Oct 18 14:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.46300000000000002,"15min":0.437},"min":{"1min":0.34000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.503,"15min":0.44700000000000001},"min":{"1min":0.34799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53700000000000003}]},{"osd":6,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.34200000000000003}]},{"osd":8,"last update":"Wed Oct 18 14:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.59799999999999998,"15min":0.55600000000000005},"min":{"1min":0.434,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.64500000000000002,"15min":0.60399999999999998},"min":{"1min":0.46700000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.72099999999999997}]},{"osd":9,"last update":"Wed Oct 18 14:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.753},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89300000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.80500000000000005}]},{"osd":10,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.71499999999999997,"15min":0.69299999999999995},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.77600000000000002,"15min":0.754},"min":{"1min":0.72399999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.90500000000000003}]},{"osd":11,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.85299999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149758,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":458490,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.34899999999999998,"15min":0.32500000000000001},"min":{"1min":0.28199999999999997,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.56499999999999995,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.36699999999999999,"15min":0.35099999999999998},"min":{"1min":0.25800000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.51700000000000002},"min":{"1min":0.39400000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.78200000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54900000000000004,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53600000000000003,"15min":0.52100000000000002},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70499999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.51800000000000002},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.65900000000000003,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.65800000000000003}]},{"osd":4,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.44800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.75900000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.626}]},{"osd":5,"last update":"Wed Oct 18 14:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85199999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.70099999999999996,"15min":0.67300000000000004},"min":{"1min":0.45800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77500000000000002,"5min":6.5,"15min":6.5},"last":0.69599999999999995}]},{"osd":6,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.46999999999999997,"15min":0.48799999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.504,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.439},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74299999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.77900000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80500000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.63800000000000001}]},{"osd":8,"last update":"Wed Oct 18 14:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.56699999999999995}]},{"osd":9,"last update":"Wed Oct 18 14:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.58999999999999997,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.60899999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.66300000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60999999999999999}]},{"osd":10,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83399999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67800000000000005,"15min":0.68899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.749,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.73599999999999999}]},{"osd":11,"last update":"Wed Oct 18 14:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.70999999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888122,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":458845,"data_compressed":5775,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.42399999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Oct 18 14:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41499999999999998,"15min":0.38800000000000001},"min":{"1min":0.312,"5min":0.255,"15min":0.255},"max":{"1min":0.59599999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.38},"min":{"1min":0.27400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.54300000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Oct 18 14:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57499999999999996,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72099999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.61599999999999999}]},{"osd":3,"last update":"Wed Oct 18 14:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58199999999999996,"15min":0.55100000000000005},"min":{"1min":0.46700000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.57799999999999996,"15min":0.54200000000000004},"min":{"1min":0.40400000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":0.77200000000000002}]},{"osd":5,"last update":"Wed Oct 18 14:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.43099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.70499999999999996}]},{"osd":6,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.61299999999999999,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.55000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.72299999999999998}]},{"osd":7,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.60599999999999998,"15min":0.57599999999999996},"min":{"1min":0.53300000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86799999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.39300000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78800000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73799999999999999}]},{"osd":8,"last update":"Wed Oct 18 14:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.71799999999999997,"15min":0.69199999999999995},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97499999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89600000000000002,"5min":1.042,"15min":1.042},"last":0.79900000000000004}]},{"osd":9,"last update":"Wed Oct 18 14:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.75700000000000001,"15min":0.73899999999999999},"min":{"1min":0.55900000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.60199999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.80900000000000005}]},{"osd":10,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77200000000000002,"15min":0.76600000000000001},"min":{"1min":0.66500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94199999999999995,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.46800000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.92100000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.82499999999999996}]},{"osd":11,"last update":"Wed Oct 18 14:03:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.871}]}]},{"osd":5,"up_from":39,"seq":167503724598,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":1051515,"data_compressed":41962,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51000000000000001,"15min":0.48299999999999998},"min":{"1min":0.34699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.71599999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.504,"15min":0.48499999999999999},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67200000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.436}]},{"osd":1,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.53400000000000003,"15min":0.499},"min":{"1min":0.36799999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.57599999999999996,"15min":0.52500000000000002},"min":{"1min":0.46600000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.73799999999999999}]},{"osd":2,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.41299999999999998,"15min":0.39000000000000001},"min":{"1min":0.34599999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.40699999999999997,"15min":0.375},"min":{"1min":0.29299999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40000000000000002}]},{"osd":3,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.36799999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.60499999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.503},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.51700000000000002},"min":{"1min":0.40799999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68500000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.60599999999999998,"15min":0.55200000000000005},"min":{"1min":0.52400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90200000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.57399999999999995,"15min":0.53200000000000003},"min":{"1min":0.55200000000000005,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77700000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.61899999999999999}]},{"osd":6,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46400000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.68100000000000005}]},{"osd":7,"last update":"Wed Oct 18 14:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.44,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78200000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65400000000000003}]},{"osd":8,"last update":"Wed Oct 18 14:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61099999999999999,"15min":0.60099999999999998},"min":{"1min":0.47999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66800000000000004}]},{"osd":9,"last update":"Wed Oct 18 14:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.70799999999999996,"15min":0.69999999999999996},"min":{"1min":0.54200000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.80000000000000004}]},{"osd":10,"last update":"Wed Oct 18 14:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.72199999999999998,"15min":0.70999999999999996},"min":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66400000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.79700000000000004,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34548,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36187,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T14:04:01.082 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:04:01.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.225+0000 7f76f9f7a700 1 -- 172.21.15.114:0/1092157862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f40ff8d0 msgr2=0x7f76f40ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.225+0000 7f76f9f7a700 1 --2- 172.21.15.114:0/1092157862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f40ff8d0 0x7f76f40ffd50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009990 tx=0x7f76dc009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.225+0000 7f76f9f7a700 1 -- 172.21.15.114:0/1092157862 shutdown_connections 2023-10-18T14:04:01.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.225+0000 7f76f9f7a700 1 --2- 172.21.15.114:0/1092157862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f4100290 0x7f76f410c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.225+0000 7f76f9f7a700 1 --2- 172.21.15.114:0/1092157862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f76f4105710 0x7f76f4105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.225+0000 7f76f9f7a700 1 --2- 172.21.15.114:0/1092157862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f40ff8d0 0x7f76f40ffd50 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.225+0000 7f76f9f7a700 1 -- 172.21.15.114:0/1092157862 >> 172.21.15.114:0/1092157862 conn(0x7f76f4076400 msgr2=0x7f76f4076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:01.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.225+0000 7f76f9f7a700 1 -- 172.21.15.114:0/1092157862 shutdown_connections 2023-10-18T14:04:01.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.225+0000 7f76f9f7a700 1 -- 172.21.15.114:0/1092157862 wait complete. 2023-10-18T14:04:01.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.226+0000 7f76f9f7a700 1 Processor -- start 2023-10-18T14:04:01.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.226+0000 7f76f9f7a700 1 -- start start 2023-10-18T14:04:01.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.226+0000 7f76f9f7a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f40ff8d0 0x7f76f419b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:01.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.226+0000 7f76f9f7a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f76f4100290 0x7f76f419bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:01.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.226+0000 7f76f9f7a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f4105710 0x7f76f41957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:01.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.226+0000 7f76f9f7a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f4195e40 con 0x7f76f40ff8d0 2023-10-18T14:04:01.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.226+0000 7f76f9f7a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f4195fb0 con 0x7f76f4100290 2023-10-18T14:04:01.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.226+0000 7f76f9f7a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f4196170 con 0x7f76f4105710 2023-10-18T14:04:01.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.226+0000 7f76f37fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f40ff8d0 0x7f76f419b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:01.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.226+0000 7f76f37fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f40ff8d0 0x7f76f419b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44098/0 (socket says 172.21.15.114:44098) 2023-10-18T14:04:01.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.226+0000 7f76f37fe700 1 -- 172.21.15.114:0/4160819732 learned_addr learned my addr 172.21.15.114:0/4160819732 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:01.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.226+0000 7f76f2ffd700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f76f4100290 0x7f76f419bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:01.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.226+0000 7f76f3fff700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f4105710 0x7f76f41957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:01.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.227+0000 7f76f37fe700 1 -- 172.21.15.114:0/4160819732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f4105710 msgr2=0x7f76f41957d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.227+0000 7f76f37fe700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f4105710 0x7f76f41957d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.227+0000 7f76f37fe700 1 -- 172.21.15.114:0/4160819732 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f76f4100290 msgr2=0x7f76f419bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.227+0000 7f76f37fe700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f76f4100290 0x7f76f419bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.227+0000 7f76f37fe700 1 -- 172.21.15.114:0/4160819732 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc0095f0 con 0x7f76f40ff8d0 2023-10-18T14:04:01.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.227+0000 7f76f3fff700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f4105710 0x7f76f41957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:01.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.227+0000 7f76f37fe700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f40ff8d0 0x7f76f419b6a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f76e400d950 tx=0x7f76e400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:01.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.227+0000 7f76f0ff9700 1 -- 172.21.15.114:0/4160819732 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4009940 con 0x7f76f40ff8d0 2023-10-18T14:04:01.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.227+0000 7f76f9f7a700 1 -- 172.21.15.114:0/4160819732 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f4196450 con 0x7f76f40ff8d0 2023-10-18T14:04:01.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.227+0000 7f76f0ff9700 1 -- 172.21.15.114:0/4160819732 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76e4010460 con 0x7f76f40ff8d0 2023-10-18T14:04:01.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.227+0000 7f76f0ff9700 1 -- 172.21.15.114:0/4160819732 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e400f620 con 0x7f76f40ff8d0 2023-10-18T14:04:01.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.227+0000 7f76f9f7a700 1 -- 172.21.15.114:0/4160819732 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f41a2690 con 0x7f76f40ff8d0 2023-10-18T14:04:01.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.228+0000 7f76f9f7a700 1 -- 172.21.15.114:0/4160819732 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f4107a60 con 0x7f76f40ff8d0 2023-10-18T14:04:01.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.229+0000 7f76f0ff9700 1 -- 172.21.15.114:0/4160819732 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f76e40108d0 con 0x7f76f40ff8d0 2023-10-18T14:04:01.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.230+0000 7f76f0ff9700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76e00a15e0 0x7f76e00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:01.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.230+0000 7f76f2ffd700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76e00a15e0 0x7f76e00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:01.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.230+0000 7f76f0ff9700 1 -- 172.21.15.114:0/4160819732 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f76e40cd0a0 con 0x7f76f40ff8d0 2023-10-18T14:04:01.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.230+0000 7f76f2ffd700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76e00a15e0 0x7f76e00a3aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00b5c0 tx=0x7f76dc005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:01.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.234+0000 7f76f0ff9700 1 -- 172.21.15.114:0/4160819732 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f76e4096500 con 0x7f76f40ff8d0 2023-10-18T14:04:01.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:01 smithi114 ceph-mon[99494]: from='client.15579 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:04:01.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:01 smithi114 ceph-mon[99494]: from='client.15585 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:04:01.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.426+0000 7f76f9f7a700 1 -- 172.21.15.114:0/4160819732 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76f4196c90 con 0x7f76f40ff8d0 2023-10-18T14:04:01.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.428+0000 7f76f0ff9700 1 -- 172.21.15.114:0/4160819732 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22907 (secure 0 0 0) 0x7f76e4099b20 con 0x7f76f40ff8d0 2023-10-18T14:04:01.433 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:04:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":85,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:03:08.625359+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:04:01.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.430+0000 7f76f9f7a700 1 -- 172.21.15.114:0/4160819732 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76e00a15e0 msgr2=0x7f76e00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.430+0000 7f76f9f7a700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76e00a15e0 0x7f76e00a3aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00b5c0 tx=0x7f76dc005960 comp rx=0 tx=0).stop 2023-10-18T14:04:01.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.430+0000 7f76f9f7a700 1 -- 172.21.15.114:0/4160819732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f40ff8d0 msgr2=0x7f76f419b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.430+0000 7f76f9f7a700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f40ff8d0 0x7f76f419b6a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f76e400d950 tx=0x7f76e400dc60 comp rx=0 tx=0).stop 2023-10-18T14:04:01.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.430+0000 7f76f9f7a700 1 -- 172.21.15.114:0/4160819732 shutdown_connections 2023-10-18T14:04:01.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.430+0000 7f76f9f7a700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f76e00a15e0 0x7f76e00a3aa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.430+0000 7f76f9f7a700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f4105710 0x7f76f41957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.430+0000 7f76f9f7a700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f40ff8d0 0x7f76f419b6a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.430+0000 7f76f9f7a700 1 --2- 172.21.15.114:0/4160819732 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f76f4100290 0x7f76f419bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.430+0000 7f76f9f7a700 1 -- 172.21.15.114:0/4160819732 >> 172.21.15.114:0/4160819732 conn(0x7f76f4076400 msgr2=0x7f76f40fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:01.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.430+0000 7f76f9f7a700 1 -- 172.21.15.114:0/4160819732 shutdown_connections 2023-10-18T14:04:01.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.430+0000 7f76f9f7a700 1 -- 172.21.15.114:0/4160819732 wait complete. 2023-10-18T14:04:01.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T13:58:43.813590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T14:02:30.693853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T14:02:31.426625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T14:04:01.449 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T14:04:01.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:01 smithi172 ceph-mon[103574]: from='client.15579 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:04:01.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:01 smithi172 ceph-mon[103574]: from='client.15585 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:04:01.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.569+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1074951207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd00ff120 msgr2=0x7f0cd00ff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.569+0000 7f0cd4e53700 1 --2- 172.21.15.114:0/1074951207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd00ff120 0x7f0cd00ff5a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009990 tx=0x7f0cc0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.569+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1074951207 shutdown_connections 2023-10-18T14:04:01.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.569+0000 7f0cd4e53700 1 --2- 172.21.15.114:0/1074951207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0cd00ffae0 0x7f0cd010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.569+0000 7f0cd4e53700 1 --2- 172.21.15.114:0/1074951207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd0106860 0x7f0cd0106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.569+0000 7f0cd4e53700 1 --2- 172.21.15.114:0/1074951207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd00ff120 0x7f0cd00ff5a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.569+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1074951207 >> 172.21.15.114:0/1074951207 conn(0x7f0cd0074890 msgr2=0x7f0cd0074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:01.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.569+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1074951207 shutdown_connections 2023-10-18T14:04:01.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.569+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1074951207 wait complete. 2023-10-18T14:04:01.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cd4e53700 1 Processor -- start 2023-10-18T14:04:01.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cd4e53700 1 -- start start 2023-10-18T14:04:01.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cd4e53700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd00ff120 0x7f0cd019c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:01.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cd4e53700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0cd00ffae0 0x7f0cd019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:01.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cd4e53700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd0106860 0x7f0cd0196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:01.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cd4e53700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd01970b0 con 0x7f0cd00ff120 2023-10-18T14:04:01.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cd4e53700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0197220 con 0x7f0cd00ffae0 2023-10-18T14:04:01.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cd4e53700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd01973e0 con 0x7f0cd0106860 2023-10-18T14:04:01.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cce59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd00ff120 0x7f0cd019c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:01.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cce59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd00ff120 0x7f0cd019c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44112/0 (socket says 172.21.15.114:44112) 2023-10-18T14:04:01.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cce59c700 1 -- 172.21.15.114:0/1808951955 learned_addr learned my addr 172.21.15.114:0/1808951955 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:01.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cced9d700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd0106860 0x7f0cd0196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:01.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cce59c700 1 -- 172.21.15.114:0/1808951955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd0106860 msgr2=0x7f0cd0196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cce59c700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd0106860 0x7f0cd0196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cce59c700 1 -- 172.21.15.114:0/1808951955 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0cd00ffae0 msgr2=0x7f0cd019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cce59c700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0cd00ffae0 0x7f0cd019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cce59c700 1 -- 172.21.15.114:0/1808951955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00095f0 con 0x7f0cd00ff120 2023-10-18T14:04:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.570+0000 7f0cced9d700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd0106860 0x7f0cd0196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.571+0000 7f0cce59c700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd00ff120 0x7f0cd019c920 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400e9a0 tx=0x7f0cc400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.571+0000 7f0cbf7fe700 1 -- 172.21.15.114:0/1808951955 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4009790 con 0x7f0cd00ff120 2023-10-18T14:04:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.571+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1808951955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd01976c0 con 0x7f0cd00ff120 2023-10-18T14:04:01.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.571+0000 7f0cbf7fe700 1 -- 172.21.15.114:0/1808951955 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0cc400cbd0 con 0x7f0cd00ff120 2023-10-18T14:04:01.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.571+0000 7f0cbf7fe700 1 -- 172.21.15.114:0/1808951955 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4018680 con 0x7f0cd00ff120 2023-10-18T14:04:01.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.571+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1808951955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd01a3910 con 0x7f0cd00ff120 2023-10-18T14:04:01.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.572+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1808951955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd0108cc0 con 0x7f0cd00ff120 2023-10-18T14:04:01.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.573+0000 7f0cbf7fe700 1 -- 172.21.15.114:0/1808951955 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f0cc400cd40 con 0x7f0cd00ff120 2023-10-18T14:04:01.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.573+0000 7f0cbf7fe700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cb80a1560 0x7f0cb80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:01.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.573+0000 7f0cbf7fe700 1 -- 172.21.15.114:0/1808951955 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0cc4014070 con 0x7f0cd00ff120 2023-10-18T14:04:01.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.573+0000 7f0ccdd9b700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cb80a1560 0x7f0cb80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:01.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.574+0000 7f0ccdd9b700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cb80a1560 0x7f0cb80a3a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000b2e0 tx=0x7f0cc0005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:01.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.577+0000 7f0cbf7fe700 1 -- 172.21.15.114:0/1808951955 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0cc4096c10 con 0x7f0cd00ff120 2023-10-18T14:04:01.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:01 smithi158 ceph-mon[103317]: from='client.15579 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:04:01.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:01 smithi158 ceph-mon[103317]: from='client.15585 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:04:01.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.768+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1808951955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0cd0197f10 con 0x7f0cd00ff120 2023-10-18T14:04:01.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.769+0000 7f0cbf7fe700 1 -- 172.21.15.114:0/1808951955 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0cc409a230 con 0x7f0cd00ff120 2023-10-18T14:04:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T14:04:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.771+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1808951955 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cb80a1560 msgr2=0x7f0cb80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.771+0000 7f0cd4e53700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cb80a1560 0x7f0cb80a3a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000b2e0 tx=0x7f0cc0005fb0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.771+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1808951955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd00ff120 msgr2=0x7f0cd019c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.771+0000 7f0cd4e53700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd00ff120 0x7f0cd019c920 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400e9a0 tx=0x7f0cc400ed60 comp rx=0 tx=0).stop 2023-10-18T14:04:01.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.771+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1808951955 shutdown_connections 2023-10-18T14:04:01.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.771+0000 7f0cd4e53700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cb80a1560 0x7f0cb80a3a20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.771+0000 7f0cd4e53700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd0106860 0x7f0cd0196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.771+0000 7f0cd4e53700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd00ff120 0x7f0cd019c920 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.771+0000 7f0cd4e53700 1 --2- 172.21.15.114:0/1808951955 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0cd00ffae0 0x7f0cd019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.771+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1808951955 >> 172.21.15.114:0/1808951955 conn(0x7f0cd0074890 msgr2=0x7f0cd00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:01.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.771+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1808951955 shutdown_connections 2023-10-18T14:04:01.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.771+0000 7f0cd4e53700 1 -- 172.21.15.114:0/1808951955 wait complete. 2023-10-18T14:04:01.787 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T14:04:01.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.908+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2554329031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d5c100000 msgr2=0x7f1d5c10c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.908+0000 7f1d61bb1700 1 --2- 172.21.15.114:0/2554329031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d5c100000 0x7f1d5c10c4a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400b0a0 tx=0x7f1d5400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.908+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2554329031 shutdown_connections 2023-10-18T14:04:01.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.908+0000 7f1d61bb1700 1 --2- 172.21.15.114:0/2554329031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d5c100000 0x7f1d5c10c4a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.908+0000 7f1d61bb1700 1 --2- 172.21.15.114:0/2554329031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d5c1056e0 0x7f1d5c105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.908+0000 7f1d61bb1700 1 --2- 172.21.15.114:0/2554329031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d5c0ff640 0x7f1d5c0ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.908+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2554329031 >> 172.21.15.114:0/2554329031 conn(0x7f1d5c0767f0 msgr2=0x7f1d5c076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:01.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.908+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2554329031 shutdown_connections 2023-10-18T14:04:01.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.908+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2554329031 wait complete. 2023-10-18T14:04:01.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.908+0000 7f1d61bb1700 1 Processor -- start 2023-10-18T14:04:01.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d61bb1700 1 -- start start 2023-10-18T14:04:01.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d61bb1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d5c0ff640 0x7f1d5c197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:01.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d61bb1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d5c100000 0x7f1d5c198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:01.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d61bb1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d5c1056e0 0x7f1d5c1a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:01.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d61bb1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c1988e0 con 0x7f1d5c1056e0 2023-10-18T14:04:01.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d61bb1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c1a30c0 con 0x7f1d5c0ff640 2023-10-18T14:04:01.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d61bb1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c1a3200 con 0x7f1d5c100000 2023-10-18T14:04:01.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d5bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d5c1056e0 0x7f1d5c1a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:01.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d5bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d5c1056e0 0x7f1d5c1a2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44130/0 (socket says 172.21.15.114:44130) 2023-10-18T14:04:01.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d5bfff700 1 -- 172.21.15.114:0/2564237329 learned_addr learned my addr 172.21.15.114:0/2564237329 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:01.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d5affd700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d5c100000 0x7f1d5c198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:01.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d5b7fe700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d5c0ff640 0x7f1d5c197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:01.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d5bfff700 1 -- 172.21.15.114:0/2564237329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d5c100000 msgr2=0x7f1d5c198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d5bfff700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d5c100000 0x7f1d5c198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d5bfff700 1 -- 172.21.15.114:0/2564237329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d5c0ff640 msgr2=0x7f1d5c197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:01.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d5bfff700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d5c0ff640 0x7f1d5c197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:01.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d5bfff700 1 -- 172.21.15.114:0/2564237329 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d54009d00 con 0x7f1d5c1056e0 2023-10-18T14:04:01.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.909+0000 7f1d5b7fe700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d5c0ff640 0x7f1d5c197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:01.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.910+0000 7f1d5bfff700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d5c1056e0 0x7f1d5c1a2b80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1d540078e0 tx=0x7f1d54007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:01.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.910+0000 7f1d58ff9700 1 -- 172.21.15.114:0/2564237329 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5400e040 con 0x7f1d5c1056e0 2023-10-18T14:04:01.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.910+0000 7f1d58ff9700 1 -- 172.21.15.114:0/2564237329 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d5401d470 con 0x7f1d5c1056e0 2023-10-18T14:04:01.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.910+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2564237329 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5c1a3450 con 0x7f1d5c1056e0 2023-10-18T14:04:01.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.910+0000 7f1d58ff9700 1 -- 172.21.15.114:0/2564237329 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540052a0 con 0x7f1d5c1056e0 2023-10-18T14:04:01.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.910+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2564237329 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5c1a3960 con 0x7f1d5c1056e0 2023-10-18T14:04:01.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.911+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2564237329 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5c107b80 con 0x7f1d5c1056e0 2023-10-18T14:04:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.912+0000 7f1d58ff9700 1 -- 172.21.15.114:0/2564237329 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f1d5401d5e0 con 0x7f1d5c1056e0 2023-10-18T14:04:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.912+0000 7f1d58ff9700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1d440a1560 0x7f1d440a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.912+0000 7f1d5b7fe700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1d440a1560 0x7f1d440a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.912+0000 7f1d58ff9700 1 -- 172.21.15.114:0/2564237329 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f1d540ce2d0 con 0x7f1d5c1056e0 2023-10-18T14:04:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.913+0000 7f1d5b7fe700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1d440a1560 0x7f1d440a3a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1d50005e10 tx=0x7f1d50005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:01.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:01.917+0000 7f1d58ff9700 1 -- 172.21.15.114:0/2564237329 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1d540977c0 con 0x7f1d5c1056e0 2023-10-18T14:04:02.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.105+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2564237329 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d5c067da0 con 0x7f1d5c1056e0 2023-10-18T14:04:02.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.106+0000 7f1d58ff9700 1 -- 172.21.15.114:0/2564237329 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d5409ade0 con 0x7f1d5c1056e0 2023-10-18T14:04:02.110 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T14:04:02.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.107+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2564237329 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1d440a1560 msgr2=0x7f1d440a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.107+0000 7f1d61bb1700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1d440a1560 0x7f1d440a3a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1d50005e10 tx=0x7f1d50005d60 comp rx=0 tx=0).stop 2023-10-18T14:04:02.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.107+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2564237329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d5c1056e0 msgr2=0x7f1d5c1a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.108+0000 7f1d61bb1700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d5c1056e0 0x7f1d5c1a2b80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1d540078e0 tx=0x7f1d54007910 comp rx=0 tx=0).stop 2023-10-18T14:04:02.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.108+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2564237329 shutdown_connections 2023-10-18T14:04:02.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.108+0000 7f1d61bb1700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1d440a1560 0x7f1d440a3a20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.108+0000 7f1d61bb1700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d5c1056e0 0x7f1d5c1a2b80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.108+0000 7f1d61bb1700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d5c0ff640 0x7f1d5c197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.108+0000 7f1d61bb1700 1 --2- 172.21.15.114:0/2564237329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d5c100000 0x7f1d5c198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.108+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2564237329 >> 172.21.15.114:0/2564237329 conn(0x7f1d5c0767f0 msgr2=0x7f1d5c0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:02.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.108+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2564237329 shutdown_connections 2023-10-18T14:04:02.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.108+0000 7f1d61bb1700 1 -- 172.21.15.114:0/2564237329 wait complete. 2023-10-18T14:04:02.124 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T14:04:02.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.244+0000 7f9dd3522700 1 -- 172.21.15.114:0/108349746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dcc104e60 msgr2=0x7f9dcc105240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.244+0000 7f9dd3522700 1 --2- 172.21.15.114:0/108349746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dcc104e60 0x7f9dcc105240 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80099c0 tx=0x7f9dc8009cd0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.244+0000 7f9dd3522700 1 -- 172.21.15.114:0/108349746 shutdown_connections 2023-10-18T14:04:02.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.244+0000 7f9dd3522700 1 --2- 172.21.15.114:0/108349746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc0ffa50 0x7f9dcc10bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.244+0000 7f9dd3522700 1 --2- 172.21.15.114:0/108349746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dcc104e60 0x7f9dcc105240 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.244+0000 7f9dd3522700 1 --2- 172.21.15.114:0/108349746 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9dcc0ff090 0x7f9dcc0ff510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.244+0000 7f9dd3522700 1 -- 172.21.15.114:0/108349746 >> 172.21.15.114:0/108349746 conn(0x7f9dcc0749e0 msgr2=0x7f9dcc074df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:02.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.244+0000 7f9dd3522700 1 -- 172.21.15.114:0/108349746 shutdown_connections 2023-10-18T14:04:02.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.244+0000 7f9dd3522700 1 -- 172.21.15.114:0/108349746 wait complete. 2023-10-18T14:04:02.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd3522700 1 Processor -- start 2023-10-18T14:04:02.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd3522700 1 -- start start 2023-10-18T14:04:02.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd3522700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9dcc0ff090 0x7f9dcc100aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:02.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd3522700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dcc0ffa50 0x7f9dcc100fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:02.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd3522700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc104e60 0x7f9dcc101540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:02.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd3522700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc1a4fe0 con 0x7f9dcc0ffa50 2023-10-18T14:04:02.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd3522700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc1a5150 con 0x7f9dcc0ff090 2023-10-18T14:04:02.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd3522700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc1a5310 con 0x7f9dcc104e60 2023-10-18T14:04:02.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd0abd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dcc0ffa50 0x7f9dcc100fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:02.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd0abd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dcc0ffa50 0x7f9dcc100fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44142/0 (socket says 172.21.15.114:44142) 2023-10-18T14:04:02.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd0abd700 1 -- 172.21.15.114:0/2989273432 learned_addr learned my addr 172.21.15.114:0/2989273432 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:02.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd1abf700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc104e60 0x7f9dcc101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:02.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd12be700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9dcc0ff090 0x7f9dcc100aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:02.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.245+0000 7f9dd0abd700 1 -- 172.21.15.114:0/2989273432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc104e60 msgr2=0x7f9dcc101540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.246+0000 7f9dd0abd700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc104e60 0x7f9dcc101540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.246+0000 7f9dd0abd700 1 -- 172.21.15.114:0/2989273432 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9dcc0ff090 msgr2=0x7f9dcc100aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.246+0000 7f9dd0abd700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9dcc0ff090 0x7f9dcc100aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.246+0000 7f9dd0abd700 1 -- 172.21.15.114:0/2989273432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc80095f0 con 0x7f9dcc0ffa50 2023-10-18T14:04:02.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.246+0000 7f9dd12be700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9dcc0ff090 0x7f9dcc100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:02.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.246+0000 7f9dd0abd700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dcc0ffa50 0x7f9dcc100fe0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00d950 tx=0x7f9dbc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:02.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.246+0000 7f9dc27fc700 1 -- 172.21.15.114:0/2989273432 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc009b40 con 0x7f9dcc0ffa50 2023-10-18T14:04:02.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.246+0000 7f9dd3522700 1 -- 172.21.15.114:0/2989273432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc1a55f0 con 0x7f9dcc0ffa50 2023-10-18T14:04:02.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.246+0000 7f9dc27fc700 1 -- 172.21.15.114:0/2989273432 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9dbc009ca0 con 0x7f9dcc0ffa50 2023-10-18T14:04:02.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.246+0000 7f9dd3522700 1 -- 172.21.15.114:0/2989273432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc1a5b50 con 0x7f9dcc0ffa50 2023-10-18T14:04:02.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.246+0000 7f9dc27fc700 1 -- 172.21.15.114:0/2989273432 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc00f620 con 0x7f9dcc0ffa50 2023-10-18T14:04:02.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.247+0000 7f9dd3522700 1 -- 172.21.15.114:0/2989273432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db00052e0 con 0x7f9dcc0ffa50 2023-10-18T14:04:02.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.248+0000 7f9dc27fc700 1 -- 172.21.15.114:0/2989273432 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f9dbc010460 con 0x7f9dcc0ffa50 2023-10-18T14:04:02.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.248+0000 7f9dc27fc700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9db80a1560 0x7f9db80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:02.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.248+0000 7f9dd12be700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9db80a1560 0x7f9db80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:02.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.249+0000 7f9dc27fc700 1 -- 172.21.15.114:0/2989273432 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9dbc0cd330 con 0x7f9dcc0ffa50 2023-10-18T14:04:02.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.249+0000 7f9dd12be700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9db80a1560 0x7f9db80a3a20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8006010 tx=0x7f9dc8009f10 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:02.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.252+0000 7f9dc27fc700 1 -- 172.21.15.114:0/2989273432 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9dbc096790 con 0x7f9dcc0ffa50 2023-10-18T14:04:02.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.444+0000 7f9dd3522700 1 -- 172.21.15.114:0/2989273432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9db0005b10 con 0x7f9dcc0ffa50 2023-10-18T14:04:02.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.445+0000 7f9dc27fc700 1 -- 172.21.15.114:0/2989273432 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9dbc0200a0 con 0x7f9dcc0ffa50 2023-10-18T14:04:02.449 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T14:04:02.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.447+0000 7f9dd3522700 1 -- 172.21.15.114:0/2989273432 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9db80a1560 msgr2=0x7f9db80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.447+0000 7f9dd3522700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9db80a1560 0x7f9db80a3a20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8006010 tx=0x7f9dc8009f10 comp rx=0 tx=0).stop 2023-10-18T14:04:02.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.447+0000 7f9dd3522700 1 -- 172.21.15.114:0/2989273432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dcc0ffa50 msgr2=0x7f9dcc100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.447+0000 7f9dd3522700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dcc0ffa50 0x7f9dcc100fe0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00d950 tx=0x7f9dbc00dd10 comp rx=0 tx=0).stop 2023-10-18T14:04:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.447+0000 7f9dd3522700 1 -- 172.21.15.114:0/2989273432 shutdown_connections 2023-10-18T14:04:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.447+0000 7f9dd3522700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9db80a1560 0x7f9db80a3a20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.447+0000 7f9dd3522700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc104e60 0x7f9dcc101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.447+0000 7f9dd3522700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9dcc0ff090 0x7f9dcc100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.447+0000 7f9dd3522700 1 --2- 172.21.15.114:0/2989273432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dcc0ffa50 0x7f9dcc100fe0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.447+0000 7f9dd3522700 1 -- 172.21.15.114:0/2989273432 >> 172.21.15.114:0/2989273432 conn(0x7f9dcc0749e0 msgr2=0x7f9dcc10c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:02.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.448+0000 7f9dd3522700 1 -- 172.21.15.114:0/2989273432 shutdown_connections 2023-10-18T14:04:02.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.448+0000 7f9dd3522700 1 -- 172.21.15.114:0/2989273432 wait complete. 2023-10-18T14:04:02.463 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:02 smithi114 ceph-mon[99494]: from='client.15591 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:04:02.463 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:02 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/4160819732' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:04:02.463 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:02 smithi114 ceph-mon[99494]: pgmap v280: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-18T14:04:02.464 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:02 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1808951955' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:04:02.464 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:02 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2564237329' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:04:02.465 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:04:02.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:02 smithi172 ceph-mon[103574]: from='client.15591 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:04:02.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:02 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/4160819732' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:04:02.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:02 smithi172 ceph-mon[103574]: pgmap v280: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-18T14:04:02.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:02 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1808951955' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:04:02.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:02 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2564237329' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:04:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.584+0000 7f5ac5faa700 1 -- 172.21.15.114:0/1288523217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac0106fe0 msgr2=0x7f5ac0067870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.584+0000 7f5ac5faa700 1 --2- 172.21.15.114:0/1288523217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac0106fe0 0x7f5ac0067870 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009990 tx=0x7f5ab0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.584+0000 7f5ac5faa700 1 -- 172.21.15.114:0/1288523217 shutdown_connections 2023-10-18T14:04:02.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.584+0000 7f5ac5faa700 1 --2- 172.21.15.114:0/1288523217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ac0067fa0 0x7f5ac010d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.584+0000 7f5ac5faa700 1 --2- 172.21.15.114:0/1288523217 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ac01066c0 0x7f5ac0106aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.584+0000 7f5ac5faa700 1 --2- 172.21.15.114:0/1288523217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac0106fe0 0x7f5ac0067870 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.584+0000 7f5ac5faa700 1 -- 172.21.15.114:0/1288523217 >> 172.21.15.114:0/1288523217 conn(0x7f5ac0076400 msgr2=0x7f5ac0076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:02.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.584+0000 7f5ac5faa700 1 -- 172.21.15.114:0/1288523217 shutdown_connections 2023-10-18T14:04:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.584+0000 7f5ac5faa700 1 -- 172.21.15.114:0/1288523217 wait complete. 2023-10-18T14:04:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5ac5faa700 1 Processor -- start 2023-10-18T14:04:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5ac5faa700 1 -- start start 2023-10-18T14:04:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5ac5faa700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac0067fa0 0x7f5ac00ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5ac5faa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ac01066c0 0x7f5ac00ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5ac5faa700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ac0106fe0 0x7f5ac0100420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5ac5faa700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac01a4f80 con 0x7f5ac0067fa0 2023-10-18T14:04:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5ac5faa700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac01a50f0 con 0x7f5ac0106fe0 2023-10-18T14:04:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5ac5faa700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac01a52b0 con 0x7f5ac01066c0 2023-10-18T14:04:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5abf7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac0067fa0 0x7f5ac00ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5abf7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac0067fa0 0x7f5ac00ff9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44154/0 (socket says 172.21.15.114:44154) 2023-10-18T14:04:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5abf7fe700 1 -- 172.21.15.114:0/2583392522 learned_addr learned my addr 172.21.15.114:0/2583392522 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5abeffd700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ac01066c0 0x7f5ac00ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5abffff700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ac0106fe0 0x7f5ac0100420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5abf7fe700 1 -- 172.21.15.114:0/2583392522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ac01066c0 msgr2=0x7f5ac00ffee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5abf7fe700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ac01066c0 0x7f5ac00ffee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5abf7fe700 1 -- 172.21.15.114:0/2583392522 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ac0106fe0 msgr2=0x7f5ac0100420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5abf7fe700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ac0106fe0 0x7f5ac0100420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5abf7fe700 1 -- 172.21.15.114:0/2583392522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab00095f0 con 0x7f5ac0067fa0 2023-10-18T14:04:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.585+0000 7f5abf7fe700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac0067fa0 0x7f5ac00ff9a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c9b0 tx=0x7f5ab400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.586+0000 7f5abcff9700 1 -- 172.21.15.114:0/2583392522 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4007b00 con 0x7f5ac0067fa0 2023-10-18T14:04:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.586+0000 7f5abcff9700 1 -- 172.21.15.114:0/2583392522 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ab4007c60 con 0x7f5ac0067fa0 2023-10-18T14:04:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.586+0000 7f5abcff9700 1 -- 172.21.15.114:0/2583392522 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4018660 con 0x7f5ac0067fa0 2023-10-18T14:04:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.586+0000 7f5ac5faa700 1 -- 172.21.15.114:0/2583392522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac01a5590 con 0x7f5ac0067fa0 2023-10-18T14:04:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.586+0000 7f5ac5faa700 1 -- 172.21.15.114:0/2583392522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac01a5a50 con 0x7f5ac0067fa0 2023-10-18T14:04:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.587+0000 7f5ac5faa700 1 -- 172.21.15.114:0/2583392522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac0108c10 con 0x7f5ac0067fa0 2023-10-18T14:04:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.588+0000 7f5abcff9700 1 -- 172.21.15.114:0/2583392522 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f5ab400f450 con 0x7f5ac0067fa0 2023-10-18T14:04:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.588+0000 7f5abcff9700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5aa80a1560 0x7f5aa80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.589+0000 7f5abeffd700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5aa80a1560 0x7f5aa80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.589+0000 7f5abcff9700 1 -- 172.21.15.114:0/2583392522 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5ab40cd170 con 0x7f5ac0067fa0 2023-10-18T14:04:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.589+0000 7f5abeffd700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5aa80a1560 0x7f5aa80a3a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5ac01010d0 tx=0x7f5ab0005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.592+0000 7f5abcff9700 1 -- 172.21.15.114:0/2583392522 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5ab4096660 con 0x7f5ac0067fa0 2023-10-18T14:04:02.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:02 smithi158 ceph-mon[103317]: from='client.15591 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-18T14:04:02.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:02 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/4160819732' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:04:02.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:02 smithi158 ceph-mon[103317]: pgmap v280: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-18T14:04:02.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:02 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1808951955' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:04:02.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:02 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2564237329' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:04:02.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.826+0000 7f5ac5faa700 1 -- 172.21.15.114:0/2583392522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ac0101de0 con 0x7f5ac0067fa0 2023-10-18T14:04:02.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.826+0000 7f5abcff9700 1 -- 172.21.15.114:0/2583392522 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11390 (secure 0 0 0) 0x7f5ab4099c80 con 0x7f5ac0067fa0 2023-10-18T14:04:02.830 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:04:02.831 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:02:39.260198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:04:02.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.828+0000 7f5ac5faa700 1 -- 172.21.15.114:0/2583392522 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5aa80a1560 msgr2=0x7f5aa80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.828+0000 7f5ac5faa700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5aa80a1560 0x7f5aa80a3a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5ac01010d0 tx=0x7f5ab0005fd0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.828+0000 7f5ac5faa700 1 -- 172.21.15.114:0/2583392522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac0067fa0 msgr2=0x7f5ac00ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.828+0000 7f5ac5faa700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac0067fa0 0x7f5ac00ff9a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c9b0 tx=0x7f5ab400ccc0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.828+0000 7f5ac5faa700 1 -- 172.21.15.114:0/2583392522 shutdown_connections 2023-10-18T14:04:02.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.828+0000 7f5ac5faa700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5aa80a1560 0x7f5aa80a3a20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.828+0000 7f5ac5faa700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5ac0106fe0 0x7f5ac0100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.828+0000 7f5ac5faa700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac0067fa0 0x7f5ac00ff9a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.828+0000 7f5ac5faa700 1 --2- 172.21.15.114:0/2583392522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ac01066c0 0x7f5ac00ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.829+0000 7f5ac5faa700 1 -- 172.21.15.114:0/2583392522 >> 172.21.15.114:0/2583392522 conn(0x7f5ac0076400 msgr2=0x7f5ac00fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:02.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.829+0000 7f5ac5faa700 1 -- 172.21.15.114:0/2583392522 shutdown_connections 2023-10-18T14:04:02.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.829+0000 7f5ac5faa700 1 -- 172.21.15.114:0/2583392522 wait complete. 2023-10-18T14:04:02.835 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2023-10-18T14:04:02.845 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:04:02.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.962+0000 7f4c550e0700 1 -- 172.21.15.114:0/1689912603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c50101060 msgr2=0x7f4c5010d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.962+0000 7f4c550e0700 1 --2- 172.21.15.114:0/1689912603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c50101060 0x7f4c5010d570 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800b0a0 tx=0x7f4c4800b3b0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.962+0000 7f4c550e0700 1 -- 172.21.15.114:0/1689912603 shutdown_connections 2023-10-18T14:04:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.962+0000 7f4c550e0700 1 --2- 172.21.15.114:0/1689912603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c50101060 0x7f4c5010d570 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.962+0000 7f4c550e0700 1 --2- 172.21.15.114:0/1689912603 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c501066b0 0x7f4c50106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.962+0000 7f4c550e0700 1 --2- 172.21.15.114:0/1689912603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c501006a0 0x7f4c50100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.962+0000 7f4c550e0700 1 -- 172.21.15.114:0/1689912603 >> 172.21.15.114:0/1689912603 conn(0x7f4c500fc1d0 msgr2=0x7f4c500fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:02.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.962+0000 7f4c550e0700 1 -- 172.21.15.114:0/1689912603 shutdown_connections 2023-10-18T14:04:02.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.962+0000 7f4c550e0700 1 -- 172.21.15.114:0/1689912603 wait complete. 2023-10-18T14:04:02.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.963+0000 7f4c550e0700 1 Processor -- start 2023-10-18T14:04:02.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.963+0000 7f4c550e0700 1 -- start start 2023-10-18T14:04:02.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.963+0000 7f4c550e0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501006a0 0x7f4c5019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:02.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.963+0000 7f4c550e0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c50101060 0x7f4c5019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:02.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.963+0000 7f4c550e0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c501066b0 0x7f4c50196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:02.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.963+0000 7f4c550e0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50196ed0 con 0x7f4c501006a0 2023-10-18T14:04:02.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.963+0000 7f4c550e0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50197040 con 0x7f4c501066b0 2023-10-18T14:04:02.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.963+0000 7f4c550e0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50197200 con 0x7f4c50101060 2023-10-18T14:04:02.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c4ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501006a0 0x7f4c5019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:02.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c4ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501006a0 0x7f4c5019c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44168/0 (socket says 172.21.15.114:44168) 2023-10-18T14:04:02.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c4ed9d700 1 -- 172.21.15.114:0/1298038568 learned_addr learned my addr 172.21.15.114:0/1298038568 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:02.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c4e59c700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c50101060 0x7f4c5019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:02.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c4f59e700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c501066b0 0x7f4c50196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c4ed9d700 1 -- 172.21.15.114:0/1298038568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c50101060 msgr2=0x7f4c5019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c4ed9d700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c50101060 0x7f4c5019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c4ed9d700 1 -- 172.21.15.114:0/1298038568 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c501066b0 msgr2=0x7f4c50196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c4ed9d700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c501066b0 0x7f4c50196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:02.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c4ed9d700 1 -- 172.21.15.114:0/1298038568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c48009d00 con 0x7f4c501006a0 2023-10-18T14:04:02.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c4ed9d700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501006a0 0x7f4c5019c6d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000c9b0 tx=0x7f4c4000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:02.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c37fff700 1 -- 172.21.15.114:0/1298038568 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40007b00 con 0x7f4c501006a0 2023-10-18T14:04:02.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c550e0700 1 -- 172.21.15.114:0/1298038568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c501974e0 con 0x7f4c501006a0 2023-10-18T14:04:02.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c37fff700 1 -- 172.21.15.114:0/1298038568 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c4000ce50 con 0x7f4c501006a0 2023-10-18T14:04:02.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c37fff700 1 -- 172.21.15.114:0/1298038568 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40018660 con 0x7f4c501006a0 2023-10-18T14:04:02.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.964+0000 7f4c550e0700 1 -- 172.21.15.114:0/1298038568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c501a3700 con 0x7f4c501006a0 2023-10-18T14:04:02.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.965+0000 7f4c550e0700 1 -- 172.21.15.114:0/1298038568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c50108cc0 con 0x7f4c501006a0 2023-10-18T14:04:02.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.966+0000 7f4c37fff700 1 -- 172.21.15.114:0/1298038568 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f4c4000f450 con 0x7f4c501006a0 2023-10-18T14:04:02.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.967+0000 7f4c37fff700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4c380a15e0 0x7f4c380a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:02.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.967+0000 7f4c4e59c700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4c380a15e0 0x7f4c380a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:02.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.967+0000 7f4c37fff700 1 -- 172.21.15.114:0/1298038568 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f4c400cd170 con 0x7f4c501006a0 2023-10-18T14:04:02.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.967+0000 7f4c4e59c700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4c380a15e0 0x7f4c380a3aa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4c50197f50 tx=0x7f4c4400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:02.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:02.970+0000 7f4c37fff700 1 -- 172.21.15.114:0/1298038568 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4c40096600 con 0x7f4c501006a0 2023-10-18T14:04:03.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.163+0000 7f4c550e0700 1 -- 172.21.15.114:0/1298038568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c50197d00 con 0x7f4c501006a0 2023-10-18T14:04:03.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.165+0000 7f4c37fff700 1 -- 172.21.15.114:0/1298038568 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22907 (secure 0 0 0) 0x7f4c40007e60 con 0x7f4c501006a0 2023-10-18T14:04:03.169 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:04:03.169 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":85,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:03:08.625359+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:04:03.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.167+0000 7f4c550e0700 1 -- 172.21.15.114:0/1298038568 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4c380a15e0 msgr2=0x7f4c380a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.167+0000 7f4c550e0700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4c380a15e0 0x7f4c380a3aa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4c50197f50 tx=0x7f4c4400b410 comp rx=0 tx=0).stop 2023-10-18T14:04:03.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.167+0000 7f4c550e0700 1 -- 172.21.15.114:0/1298038568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501006a0 msgr2=0x7f4c5019c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.167+0000 7f4c550e0700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501006a0 0x7f4c5019c6d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000c9b0 tx=0x7f4c4000ccc0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.167+0000 7f4c550e0700 1 -- 172.21.15.114:0/1298038568 shutdown_connections 2023-10-18T14:04:03.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.167+0000 7f4c550e0700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4c380a15e0 0x7f4c380a3aa0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.167+0000 7f4c550e0700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4c501066b0 0x7f4c50196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.167+0000 7f4c550e0700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501006a0 0x7f4c5019c6d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.167+0000 7f4c550e0700 1 --2- 172.21.15.114:0/1298038568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c50101060 0x7f4c5019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.167+0000 7f4c550e0700 1 -- 172.21.15.114:0/1298038568 >> 172.21.15.114:0/1298038568 conn(0x7f4c500fc1d0 msgr2=0x7f4c500fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.167+0000 7f4c550e0700 1 -- 172.21.15.114:0/1298038568 shutdown_connections 2023-10-18T14:04:03.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.167+0000 7f4c550e0700 1 -- 172.21.15.114:0/1298038568 wait complete. 2023-10-18T14:04:03.183 DEBUG:tasks.fwd_scrub:Yielding 2023-10-18T14:04:03.184 INFO:teuthology.run_tasks:Running task exec... 2023-10-18T14:04:03.193 INFO:teuthology.task.exec:Executing custom commands... 2023-10-18T14:04:03.194 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T14:04:03.194 DEBUG:teuthology.orchestra.run.smithi114:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2023-10-18T14:04:03.195 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-18T14:04:03.195 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-18T14:04:03.195 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-18T14:04:03.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f5f73b97700 1 -- 172.21.15.114:0/1762349559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c100000 msgr2=0x7f5f6c10c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f5f73b97700 1 --2- 172.21.15.114:0/1762349559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c100000 0x7f5f6c10c4a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400b0a0 tx=0x7f5f6400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f5f73b97700 1 -- 172.21.15.114:0/1762349559 shutdown_connections 2023-10-18T14:04:03.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f5f73b97700 1 --2- 172.21.15.114:0/1762349559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c100000 0x7f5f6c10c4a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f5f73b97700 1 --2- 172.21.15.114:0/1762349559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f6c1056e0 0x7f5f6c105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f5f73b97700 1 --2- 172.21.15.114:0/1762349559 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f6c0ff640 0x7f5f6c0ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f5f73b97700 1 -- 172.21.15.114:0/1762349559 >> 172.21.15.114:0/1762349559 conn(0x7f5f6c0767f0 msgr2=0x7f5f6c076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f5f73b97700 1 -- 172.21.15.114:0/1762349559 shutdown_connections 2023-10-18T14:04:03.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f5f73b97700 1 -- 172.21.15.114:0/1762349559 wait complete. 2023-10-18T14:04:03.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f6f073c0700 1 -- 172.21.15.114:0/2300636045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f001066f0 msgr2=0x7f6f00106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f6f073c0700 1 --2- 172.21.15.114:0/2300636045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f001066f0 0x7f6f00106ad0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009990 tx=0x7f6efc009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f6f073c0700 1 -- 172.21.15.114:0/2300636045 shutdown_connections 2023-10-18T14:04:03.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f6f073c0700 1 --2- 172.21.15.114:0/2300636045 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f001010a0 0x7f6f0010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f6f073c0700 1 --2- 172.21.15.114:0/2300636045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f001066f0 0x7f6f00106ad0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f6f073c0700 1 --2- 172.21.15.114:0/2300636045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f001006e0 0x7f6f00100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f6f073c0700 1 -- 172.21.15.114:0/2300636045 >> 172.21.15.114:0/2300636045 conn(0x7f6f000fc1f0 msgr2=0x7f6f000fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f6f073c0700 1 -- 172.21.15.114:0/2300636045 shutdown_connections 2023-10-18T14:04:03.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f6f073c0700 1 -- 172.21.15.114:0/2300636045 wait complete. 2023-10-18T14:04:03.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f5f73b97700 1 Processor -- start 2023-10-18T14:04:03.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f5f73b97700 1 -- start start 2023-10-18T14:04:03.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.322+0000 7f5f73b97700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f6c0ff640 0x7f5f6c198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f73b97700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f6c100000 0x7f5f6c199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f73b97700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c1056e0 0x7f5f6c19d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f73b97700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c19de50 con 0x7f5f6c1056e0 2023-10-18T14:04:03.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f73b97700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c19dfc0 con 0x7f5f6c0ff640 2023-10-18T14:04:03.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f73b97700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c19e180 con 0x7f5f6c100000 2023-10-18T14:04:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f073c0700 1 Processor -- start 2023-10-18T14:04:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f72134700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c1056e0 0x7f5f6c19d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f72134700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c1056e0 0x7f5f6c19d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44190/0 (socket says 172.21.15.114:44190) 2023-10-18T14:04:03.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f72134700 1 -- 172.21.15.114:0/127200759 learned_addr learned my addr 172.21.15.114:0/127200759 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:03.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f073c0700 1 -- start start 2023-10-18T14:04:03.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f71132700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f6c100000 0x7f5f6c199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f71933700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f6c0ff640 0x7f5f6c198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f073c0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f001006e0 0x7f6f0019c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f073c0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f001010a0 0x7f6f0019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f72134700 1 -- 172.21.15.114:0/127200759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f6c100000 msgr2=0x7f5f6c199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f72134700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f6c100000 0x7f5f6c199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f073c0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f001066f0 0x7f6f00196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f073c0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00196ff0 con 0x7f6f001006e0 2023-10-18T14:04:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f72134700 1 -- 172.21.15.114:0/127200759 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f6c0ff640 msgr2=0x7f5f6c198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f72134700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f6c0ff640 0x7f5f6c198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f073c0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00197160 con 0x7f6f001066f0 2023-10-18T14:04:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f073c0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00197320 con 0x7f6f001010a0 2023-10-18T14:04:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f72134700 1 -- 172.21.15.114:0/127200759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f64009d00 con 0x7f5f6c1056e0 2023-10-18T14:04:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f0515c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f001006e0 0x7f6f0019c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f0515c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f001006e0 0x7f6f0019c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44192/0 (socket says 172.21.15.114:44192) 2023-10-18T14:04:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f0515c700 1 -- 172.21.15.114:0/1078251616 learned_addr learned my addr 172.21.15.114:0/1078251616 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f0495b700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f001010a0 0x7f6f0019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f0595d700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f001066f0 0x7f6f00196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f72134700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c1056e0 0x7f5f6c19d810 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400b070 tx=0x7f5f64007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f62ffd700 1 -- 172.21.15.114:0/127200759 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6400e040 con 0x7f5f6c1056e0 2023-10-18T14:04:03.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f62ffd700 1 -- 172.21.15.114:0/127200759 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f6401d470 con 0x7f5f6c1056e0 2023-10-18T14:04:03.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f73b97700 1 -- 172.21.15.114:0/127200759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6c19e400 con 0x7f5f6c1056e0 2023-10-18T14:04:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f62ffd700 1 -- 172.21.15.114:0/127200759 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640052a0 con 0x7f5f6c1056e0 2023-10-18T14:04:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f5f73b97700 1 -- 172.21.15.114:0/127200759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c1a5ca0 con 0x7f5f6c1056e0 2023-10-18T14:04:03.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f0515c700 1 -- 172.21.15.114:0/1078251616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f001010a0 msgr2=0x7f6f0019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f0515c700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f001010a0 0x7f6f0019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f0515c700 1 -- 172.21.15.114:0/1078251616 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f001066f0 msgr2=0x7f6f00196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f0515c700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f001066f0 0x7f6f00196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.323+0000 7f6f0515c700 1 -- 172.21.15.114:0/1078251616 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef8009c40 con 0x7f6f001006e0 2023-10-18T14:04:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.324+0000 7f6f0515c700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f001006e0 0x7f6f0019c860 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6efc005910 tx=0x7f6efc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.324+0000 7f6ef67fc700 1 -- 172.21.15.114:0/1078251616 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc01d070 con 0x7f6f001006e0 2023-10-18T14:04:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.324+0000 7f6ef67fc700 1 -- 172.21.15.114:0/1078251616 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6efc022470 con 0x7f6f001006e0 2023-10-18T14:04:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.324+0000 7f6ef67fc700 1 -- 172.21.15.114:0/1078251616 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc017650 con 0x7f6f001006e0 2023-10-18T14:04:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.324+0000 7f6f0495b700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f001010a0 0x7f6f0019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:04:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.324+0000 7f6f073c0700 1 -- 172.21.15.114:0/1078251616 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6efc0095f0 con 0x7f6f001006e0 2023-10-18T14:04:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.325+0000 7f6f073c0700 1 -- 172.21.15.114:0/1078251616 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f001a3670 con 0x7f6f001006e0 2023-10-18T14:04:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.326+0000 7f6f073c0700 1 -- 172.21.15.114:0/1078251616 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f00108ce0 con 0x7f6f001006e0 2023-10-18T14:04:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.326+0000 7f5f62ffd700 1 -- 172.21.15.114:0/127200759 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f5f6401d5e0 con 0x7f5f6c1056e0 2023-10-18T14:04:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.327+0000 7f5f62ffd700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5f580a15c0 0x7f5f580a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.327+0000 7f5f71933700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5f580a15c0 0x7f5f580a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.327+0000 7f5f62ffd700 1 -- 172.21.15.114:0/127200759 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5f640ce1f0 con 0x7f5f6c1056e0 2023-10-18T14:04:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.327+0000 7f6ef67fc700 1 -- 172.21.15.114:0/1078251616 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f6efc0225e0 con 0x7f6f001006e0 2023-10-18T14:04:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.327+0000 7f5f71933700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5f580a15c0 0x7f5f580a3a80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009bd0 tx=0x7f5f68009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.328+0000 7f6ef67fc700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6eec0a1560 0x7f6eec0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.328+0000 7f6f0495b700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6eec0a1560 0x7f6eec0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.328+0000 7f6ef67fc700 1 -- 172.21.15.114:0/1078251616 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f6efc0ce0b0 con 0x7f6f001006e0 2023-10-18T14:04:03.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.328+0000 7f5f7fd80b80 1 Processor -- start 2023-10-18T14:04:03.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.328+0000 7f5f7fd80b80 1 -- start start 2023-10-18T14:04:03.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.328+0000 7f6f0495b700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6eec0a1560 0x7f6eec0a3a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6f00197b50 tx=0x7f6ef0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.328+0000 7f5f7fd80b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.328+0000 7f5f7fd80b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464b9f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.328+0000 7f5f7fd80b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464b9fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.328+0000 7f5f7fd80b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e464b12760 con 0x55e464b9f650 2023-10-18T14:04:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.328+0000 7f5f7fd80b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e464af8ce0 con 0x55e464bad3f0 2023-10-18T14:04:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.328+0000 7f5f7fd80b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e464af6600 con 0x55e464badd10 2023-10-18T14:04:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.328+0000 7f5f72134700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464b9fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.329+0000 7f5f72134700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464b9fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44206/0 (socket says 172.21.15.114:44206) 2023-10-18T14:04:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.329+0000 7f5f72134700 1 -- 172.21.15.114:0/4028487632 learned_addr learned my addr 172.21.15.114:0/4028487632 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.329+0000 7f5f71933700 1 --2- 172.21.15.114:0/4028487632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.329+0000 7f5f71132700 1 --2- 172.21.15.114:0/4028487632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464b9f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.329+0000 7f5f72134700 1 -- 172.21.15.114:0/4028487632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 msgr2=0x55e464b9f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.329+0000 7f5f72134700 1 --2- 172.21.15.114:0/4028487632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464b9f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.329+0000 7f5f72134700 1 -- 172.21.15.114:0/4028487632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 msgr2=0x55e464bad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.329+0000 7f5f72134700 1 --2- 172.21.15.114:0/4028487632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.329+0000 7f5f72134700 1 -- 172.21.15.114:0/4028487632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e464aaf470 con 0x55e464b9f650 2023-10-18T14:04:03.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.329+0000 7f5f71933700 1 --2- 172.21.15.114:0/4028487632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:03.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.329+0000 7f5f72134700 1 --2- 172.21.15.114:0/4028487632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464b9fa90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5f6409b330 tx=0x7f5f6400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1076c9418b87545 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.332+0000 7f5f57fff700 1 -- 172.21.15.114:0/4028487632 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6409baa0 con 0x55e464b9f650 2023-10-18T14:04:03.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.333+0000 7f5f57fff700 1 -- 172.21.15.114:0/4028487632 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f640b1070 con 0x55e464b9f650 2023-10-18T14:04:03.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.333+0000 7f5f57fff700 1 -- 172.21.15.114:0/4028487632 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640cbe70 con 0x55e464b9f650 2023-10-18T14:04:03.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.333+0000 7f6ef67fc700 1 -- 172.21.15.114:0/1078251616 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6efc0975a0 con 0x7f6f001006e0 2023-10-18T14:04:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.333+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/4028487632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 msgr2=0x55e464b9fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.333+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/4028487632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464b9fa90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5f6409b330 tx=0x7f5f6400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.333+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/4028487632 shutdown_connections 2023-10-18T14:04:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.333+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/4028487632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464b9fa90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.333+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/4028487632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.333+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/4028487632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464b9f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.333+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/4028487632 >> 172.21.15.114:0/4028487632 conn(0x55e464b137a0 msgr2=0x55e464b99d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.334+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/4028487632 shutdown_connections 2023-10-18T14:04:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.334+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/4028487632 wait complete. 2023-10-18T14:04:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.334+0000 7f5f7fd80b80 1 -- start start 2023-10-18T14:04:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.334+0000 7f5f7fd80b80 1 Processor -- start 2023-10-18T14:04:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.334+0000 7f5f7fd80b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464bb3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.334+0000 7f5f7fd80b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bb1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.334+0000 7f5f7fd80b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464bb1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.334+0000 7f5f7fd80b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e464af1ef0 con 0x55e464b9f650 2023-10-18T14:04:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.334+0000 7f5f7fd80b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e464a8e790 con 0x55e464bad3f0 2023-10-18T14:04:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.334+0000 7f5f7fd80b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e464a8e430 con 0x55e464badd10 2023-10-18T14:04:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.334+0000 7f5f7fd80b80 10 client.0 _ll_register_callbacks cb 0x55e4649d8b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f71933700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464bb3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f71933700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464bb3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44208/0 (socket says 172.21.15.114:44208) 2023-10-18T14:04:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f71933700 1 -- 172.21.15.114:0/1866701200 learned_addr learned my addr 172.21.15.114:0/1866701200 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f72134700 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464bb1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f71132700 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bb1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f71933700 1 -- 172.21.15.114:0/1866701200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 msgr2=0x55e464bb1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f71933700 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464bb1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f71933700 1 -- 172.21.15.114:0/1866701200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 msgr2=0x55e464bb1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f71933700 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bb1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f71933700 1 -- 172.21.15.114:0/1866701200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c1a5ca0 con 0x55e464b9f650 2023-10-18T14:04:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f71132700 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bb1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:04:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f71933700 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464bb3cc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5f680116f0 tx=0x7f5f680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d82411e6efb374d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f557fa700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f557fa700 1 -- 172.21.15.114:0/1866701200 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6801f840 con 0x55e464b9f650 2023-10-18T14:04:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f557fa700 1 -- 172.21.15.114:0/1866701200 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5f68017070 con 0x55e464b9f650 2023-10-18T14:04:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/1866701200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e464af6f70 con 0x55e464b9f650 2023-10-18T14:04:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f557fa700 1 -- 172.21.15.114:0/1866701200 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f6801f9a0 con 0x55e464b9f650 2023-10-18T14:04:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.335+0000 7f5f7fd80b80 10 client.15645 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.336+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/1866701200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e46491ce60 con 0x55e464b9f650 2023-10-18T14:04:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.336+0000 7f5f557fa700 1 -- 172.21.15.114:0/1866701200 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e464af6f70 con 0x55e464b9f650 2023-10-18T14:04:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.336+0000 7f5f557fa700 1 -- 172.21.15.114:0/1866701200 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5f68032b40 con 0x55e464b9f650 2023-10-18T14:04:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.336+0000 7f5f7fd80b80 10 client.15645 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.336+0000 7f5f7fd80b80 10 client.15645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:03.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.336+0000 7f5f7fd80b80 20 client.15645 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:03.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.336+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e464bc1500 0x55e464bc3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.336+0000 7f5f7fd80b80 4 client.15645 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:03.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.336+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/1866701200 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e464b6e930 con 0x55e464bc1500 2023-10-18T14:04:03.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.336+0000 7f5f71132700 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e464bc1500 0x55e464bc3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.337+0000 7f5f557fa700 10 client.15645 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:03.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.337+0000 7f5f71132700 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e464bc1500 0x55e464bc3920 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d63e4b154e7120f7 server_cookie=a00ca3393b300ad6 in_seq=0 out_seq=0 2023-10-18T14:04:03.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.337+0000 7f5f557fa700 1 -- 172.21.15.114:0/1866701200 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e464b6e930 con 0x55e464bc1500 2023-10-18T14:04:03.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.337+0000 7f5f557fa700 10 client.15645 handle_command_reply: tid=0 2023-10-18T14:04:03.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.337+0000 7f5f7fd80b80 1 client.15645 shutdown 2023-10-18T14:04:03.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.337+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/1866701200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 msgr2=0x55e464bb3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.337+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464bb3cc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5f680116f0 tx=0x7f5f680047c0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.337+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/1866701200 shutdown_connections 2023-10-18T14:04:03.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.337+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e464bc1500 0x55e464bc3920 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.337+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464bb1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.337+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464bb3cc0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.337+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/1866701200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bb1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.337+0000 7f5f557fa700 0 client.15645 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:03.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.338+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/1866701200 >> 172.21.15.114:0/1866701200 conn(0x55e464b137a0 msgr2=0x55e464b9e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.338+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/1866701200 shutdown_connections 2023-10-18T14:04:03.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.338+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/1866701200 wait complete. 2023-10-18T14:04:03.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.338+0000 7f5f7fd80b80 20 client.15645 trim_cache size 0 max 16384 2023-10-18T14:04:03.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f7fd80b80 1 Processor -- start 2023-10-18T14:04:03.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f7fd80b80 1 -- start start 2023-10-18T14:04:03.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f7fd80b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464b9f650 0x55e464baf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f7fd80b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464bad3f0 0x55e464bb8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f7fd80b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464bb08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f7fd80b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4649729a0 con 0x55e464bad3f0 2023-10-18T14:04:03.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f7fd80b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e464b9b5f0 con 0x55e464b9f650 2023-10-18T14:04:03.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f7fd80b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e464bb1f60 con 0x55e464badd10 2023-10-18T14:04:03.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f71132700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464bad3f0 0x55e464bb8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f71132700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464bad3f0 0x55e464bb8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44218/0 (socket says 172.21.15.114:44218) 2023-10-18T14:04:03.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f71132700 1 -- 172.21.15.114:0/813075768 learned_addr learned my addr 172.21.15.114:0/813075768 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:03.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f72134700 1 --2- 172.21.15.114:0/813075768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464bb08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f71933700 1 --2- 172.21.15.114:0/813075768 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464b9f650 0x55e464baf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f71132700 1 -- 172.21.15.114:0/813075768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 msgr2=0x55e464bb08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f71132700 1 --2- 172.21.15.114:0/813075768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464bb08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f71132700 1 -- 172.21.15.114:0/813075768 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464b9f650 msgr2=0x55e464baf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f71132700 1 --2- 172.21.15.114:0/813075768 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464b9f650 0x55e464baf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f71132700 1 -- 172.21.15.114:0/813075768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e464bc8570 con 0x55e464bad3f0 2023-10-18T14:04:03.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f71933700 1 --2- 172.21.15.114:0/813075768 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464b9f650 0x55e464baf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:03.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.355+0000 7f5f71132700 1 --2- 172.21.15.114:0/813075768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464bad3f0 0x55e464bb8520 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x55e464bae190 tx=0x7f5f5c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4275738550437e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.356+0000 7f5f60d82700 1 -- 172.21.15.114:0/813075768 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c017040 con 0x55e464bad3f0 2023-10-18T14:04:03.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.356+0000 7f5f60d82700 1 -- 172.21.15.114:0/813075768 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f5c018040 con 0x55e464bad3f0 2023-10-18T14:04:03.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.356+0000 7f5f60d82700 1 -- 172.21.15.114:0/813075768 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c004b90 con 0x55e464bad3f0 2023-10-18T14:04:03.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.356+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/813075768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464bad3f0 msgr2=0x55e464bb8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.356+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/813075768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464bad3f0 0x55e464bb8520 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x55e464bae190 tx=0x7f5f5c009260 comp rx=0 tx=0).stop 2023-10-18T14:04:03.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.356+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/813075768 shutdown_connections 2023-10-18T14:04:03.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.356+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/813075768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464bb08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.356+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/813075768 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464b9f650 0x55e464baf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.356+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/813075768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464bad3f0 0x55e464bb8520 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.356+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/813075768 >> 172.21.15.114:0/813075768 conn(0x55e464b137a0 msgr2=0x55e464baf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.356+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/813075768 shutdown_connections 2023-10-18T14:04:03.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.356+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/813075768 wait complete. 2023-10-18T14:04:03.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f7fd80b80 1 -- start start 2023-10-18T14:04:03.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f7fd80b80 1 Processor -- start 2023-10-18T14:04:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f7fd80b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464bb7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f7fd80b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bb7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f7fd80b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464c0e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f7fd80b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e464c0e8d0 con 0x55e464b9f650 2023-10-18T14:04:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f7fd80b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e464c0ea40 con 0x55e464bad3f0 2023-10-18T14:04:03.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f7fd80b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e464c0ec00 con 0x55e464badd10 2023-10-18T14:04:03.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f7fd80b80 10 client.0 _ll_register_callbacks cb 0x55e4649d8b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:03.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f71933700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464bb7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f71933700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464bb7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44222/0 (socket says 172.21.15.114:44222) 2023-10-18T14:04:03.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f71933700 1 -- 172.21.15.114:0/723606521 learned_addr learned my addr 172.21.15.114:0/723606521 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:03.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f72134700 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464c0e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.357+0000 7f5f71132700 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bb7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f71933700 1 -- 172.21.15.114:0/723606521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 msgr2=0x55e464c0e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f71933700 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464c0e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f71933700 1 -- 172.21.15.114:0/723606521 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 msgr2=0x55e464bb7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f71933700 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bb7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f71933700 1 -- 172.21.15.114:0/723606521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5c021a00 con 0x55e464b9f650 2023-10-18T14:04:03.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f71132700 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bb7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:03.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f71933700 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464bb7760 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5f680116c0 tx=0x7f5f680099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea60695315c76bf server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f557fa700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:03.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f557fa700 1 -- 172.21.15.114:0/723606521 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6801fa50 con 0x55e464b9f650 2023-10-18T14:04:03.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f557fa700 1 -- 172.21.15.114:0/723606521 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5f68017050 con 0x55e464b9f650 2023-10-18T14:04:03.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/723606521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f640b1070 con 0x55e464b9f650 2023-10-18T14:04:03.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f557fa700 1 -- 172.21.15.114:0/723606521 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f6801fbb0 con 0x55e464b9f650 2023-10-18T14:04:03.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f7fd80b80 10 client.15651 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:03.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/723606521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e464905ce0 con 0x55e464b9f650 2023-10-18T14:04:03.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f557fa700 1 -- 172.21.15.114:0/723606521 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f640b1070 con 0x55e464b9f650 2023-10-18T14:04:03.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f557fa700 1 -- 172.21.15.114:0/723606521 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5f6801e520 con 0x55e464b9f650 2023-10-18T14:04:03.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f7fd80b80 10 client.15651 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:03.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f7fd80b80 10 client.15651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:03.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f7fd80b80 20 client.15651 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:03.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e464c17640 0x55e464c19a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f7fd80b80 4 client.15651 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-18T14:04:03.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.358+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/723606521 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55e464aeaed0 con 0x55e464c17640 2023-10-18T14:04:03.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.359+0000 7f5f71132700 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e464c17640 0x55e464c19a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.359+0000 7f5f557fa700 10 client.15651 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:03.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.359+0000 7f5f71132700 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e464c17640 0x55e464c19a60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4c7e93dae273e9d server_cookie=b1ed7f4ff6cf80d3 in_seq=0 out_seq=0 2023-10-18T14:04:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f557fa700 1 -- 172.21.15.114:0/723606521 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e464aeaed0 con 0x55e464c17640 2023-10-18T14:04:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f557fa700 10 client.15651 handle_command_reply: tid=0 2023-10-18T14:04:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f7fd80b80 1 client.15651 shutdown 2023-10-18T14:04:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/723606521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 msgr2=0x55e464bb7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464bb7760 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5f680116c0 tx=0x7f5f680099b0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/723606521 shutdown_connections 2023-10-18T14:04:03.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e464c17640 0x55e464c19a60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e464badd10 0x55e464c0e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e464b9f650 0x55e464bb7760 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f7fd80b80 1 --2- 172.21.15.114:0/723606521 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e464bad3f0 0x55e464bb7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/723606521 >> 172.21.15.114:0/723606521 conn(0x55e464b137a0 msgr2=0x55e464bb08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f557fa700 0 client.15651 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:03.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/723606521 shutdown_connections 2023-10-18T14:04:03.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f7fd80b80 1 -- 172.21.15.114:0/723606521 wait complete. 2023-10-18T14:04:03.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.361+0000 7f5f7fd80b80 20 client.15651 trim_cache size 0 max 16384 2023-10-18T14:04:03.394 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:04:03.394 INFO:teuthology.orchestra.run.smithi114.stdout: "return_code": 0, 2023-10-18T14:04:03.394 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_tag": "2fc15053-a85f-407c-8073-29d189c253b3", 2023-10-18T14:04:03.395 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": "asynchronous" 2023-10-18T14:04:03.395 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:04:03.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.362+0000 7f5f73b97700 1 -- 172.21.15.114:0/127200759 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5f580a15c0 msgr2=0x7f5f580a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.362+0000 7f5f73b97700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5f580a15c0 0x7f5f580a3a80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009bd0 tx=0x7f5f68009260 comp rx=0 tx=0).stop 2023-10-18T14:04:03.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.362+0000 7f5f73b97700 1 -- 172.21.15.114:0/127200759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c1056e0 msgr2=0x7f5f6c19d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.362+0000 7f5f73b97700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c1056e0 0x7f5f6c19d810 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400b070 tx=0x7f5f64007870 comp rx=0 tx=0).stop 2023-10-18T14:04:03.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.362+0000 7f5f73b97700 1 -- 172.21.15.114:0/127200759 shutdown_connections 2023-10-18T14:04:03.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.362+0000 7f5f73b97700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5f580a15c0 0x7f5f580a3a80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.362+0000 7f5f73b97700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c1056e0 0x7f5f6c19d810 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.362+0000 7f5f73b97700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5f6c0ff640 0x7f5f6c198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.362+0000 7f5f73b97700 1 --2- 172.21.15.114:0/127200759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f6c100000 0x7f5f6c199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.362+0000 7f5f73b97700 1 -- 172.21.15.114:0/127200759 >> 172.21.15.114:0/127200759 conn(0x7f5f6c0767f0 msgr2=0x7f5f6c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.362+0000 7f5f73b97700 1 -- 172.21.15.114:0/127200759 shutdown_connections 2023-10-18T14:04:03.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.362+0000 7f5f73b97700 1 -- 172.21.15.114:0/127200759 wait complete. 2023-10-18T14:04:03.399 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:04:03.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.519+0000 7f0ebdf82700 1 -- 172.21.15.114:0/3019883623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0eb8106720 msgr2=0x7f0eb8106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.519+0000 7f0ebdf82700 1 --2- 172.21.15.114:0/3019883623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0eb8106720 0x7f0eb8106b00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009990 tx=0x7f0ea8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.519+0000 7f0ebdf82700 1 -- 172.21.15.114:0/3019883623 shutdown_connections 2023-10-18T14:04:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.519+0000 7f0ebdf82700 1 --2- 172.21.15.114:0/3019883623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0eb81010d0 0x7f0eb810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.519+0000 7f0ebdf82700 1 --2- 172.21.15.114:0/3019883623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0eb8106720 0x7f0eb8106b00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.519+0000 7f0ebdf82700 1 --2- 172.21.15.114:0/3019883623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0eb8100710 0x7f0eb8100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.519+0000 7f0ebdf82700 1 -- 172.21.15.114:0/3019883623 >> 172.21.15.114:0/3019883623 conn(0x7f0eb80fc200 msgr2=0x7f0eb80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.519+0000 7f0ebdf82700 1 -- 172.21.15.114:0/3019883623 shutdown_connections 2023-10-18T14:04:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.519+0000 7f0ebdf82700 1 -- 172.21.15.114:0/3019883623 wait complete. 2023-10-18T14:04:03.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.520+0000 7f0ebdf82700 1 Processor -- start 2023-10-18T14:04:03.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.520+0000 7f0ebdf82700 1 -- start start 2023-10-18T14:04:03.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.520+0000 7f0ebdf82700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0eb8100710 0x7f0eb8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.520+0000 7f0ebdf82700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0eb81010d0 0x7f0eb8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.520+0000 7f0ebdf82700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0eb8106720 0x7f0eb8073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.520+0000 7f0ebdf82700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb81a4ec0 con 0x7f0eb8100710 2023-10-18T14:04:03.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.520+0000 7f0ebdf82700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb81a5030 con 0x7f0eb8106720 2023-10-18T14:04:03.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.520+0000 7f0ebdf82700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb81a51f0 con 0x7f0eb81010d0 2023-10-18T14:04:03.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.520+0000 7f0eb77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0eb8100710 0x7f0eb8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.520+0000 7f0eb77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0eb8100710 0x7f0eb8072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44236/0 (socket says 172.21.15.114:44236) 2023-10-18T14:04:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.520+0000 7f0eb77fe700 1 -- 172.21.15.114:0/1919381 learned_addr learned my addr 172.21.15.114:0/1919381 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.521+0000 7f0eb6ffd700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0eb81010d0 0x7f0eb8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.521+0000 7f0eb7fff700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0eb8106720 0x7f0eb8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.521+0000 7f0eb77fe700 1 -- 172.21.15.114:0/1919381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0eb81010d0 msgr2=0x7f0eb8073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.521+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0eb81010d0 0x7f0eb8073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.521+0000 7f0eb77fe700 1 -- 172.21.15.114:0/1919381 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0eb8106720 msgr2=0x7f0eb8073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.521+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0eb8106720 0x7f0eb8073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.521+0000 7f0eb77fe700 1 -- 172.21.15.114:0/1919381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea80095f0 con 0x7f0eb8100710 2023-10-18T14:04:03.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.521+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0eb8100710 0x7f0eb8072af0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80098e0 tx=0x7f0ea800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.521+0000 7f0eb4ff9700 1 -- 172.21.15.114:0/1919381 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea801d070 con 0x7f0eb8100710 2023-10-18T14:04:03.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.521+0000 7f0eb4ff9700 1 -- 172.21.15.114:0/1919381 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ea8022470 con 0x7f0eb8100710 2023-10-18T14:04:03.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.521+0000 7f0ebdf82700 1 -- 172.21.15.114:0/1919381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb81a5470 con 0x7f0eb8100710 2023-10-18T14:04:03.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.521+0000 7f0eb4ff9700 1 -- 172.21.15.114:0/1919381 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8017650 con 0x7f0eb8100710 2023-10-18T14:04:03.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.521+0000 7f0ebdf82700 1 -- 172.21.15.114:0/1919381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb81a5950 con 0x7f0eb8100710 2023-10-18T14:04:03.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.523+0000 7f0eb4ff9700 1 -- 172.21.15.114:0/1919381 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f0ea80177b0 con 0x7f0eb8100710 2023-10-18T14:04:03.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.524+0000 7f0eb4ff9700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0ea00a1560 0x7f0ea00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.524+0000 7f0eb6ffd700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0ea00a1560 0x7f0ea00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.524+0000 7f0eb4ff9700 1 -- 172.21.15.114:0/1919381 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0ea80cdf10 con 0x7f0eb8100710 2023-10-18T14:04:03.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.524+0000 7f0eb6ffd700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0ea00a1560 0x7f0ea00a3a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8074220 tx=0x7f0eac00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.525+0000 7f0eca16bb80 1 Processor -- start 2023-10-18T14:04:03.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.525+0000 7f0eca16bb80 1 -- start start 2023-10-18T14:04:03.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.525+0000 7f0eca16bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22badbe0 0x556e22badfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.525+0000 7f0eca16bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22bae500 0x556e22ba8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.525+0000 7f0eca16bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22ba85d0 0x556e22ba8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.525+0000 7f0eca16bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e22b1b6e0 con 0x556e22badbe0 2023-10-18T14:04:03.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.525+0000 7f0eca16bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e22b01c60 con 0x556e22bae500 2023-10-18T14:04:03.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.525+0000 7f0eca16bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e22aff580 con 0x556e22ba85d0 2023-10-18T14:04:03.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.525+0000 7f0eb77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22badbe0 0x556e22badfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.525+0000 7f0eb77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22badbe0 0x556e22badfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44244/0 (socket says 172.21.15.114:44244) 2023-10-18T14:04:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.525+0000 7f0eb77fe700 1 -- 172.21.15.114:0/864653712 learned_addr learned my addr 172.21.15.114:0/864653712 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.525+0000 7f0eb7fff700 1 --2- 172.21.15.114:0/864653712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22ba85d0 0x556e22ba8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.526+0000 7f0eb77fe700 1 -- 172.21.15.114:0/864653712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22ba85d0 msgr2=0x556e22ba8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.526+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/864653712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22ba85d0 0x556e22ba8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.526+0000 7f0eb77fe700 1 -- 172.21.15.114:0/864653712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22bae500 msgr2=0x556e22ba8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.526+0000 7f0eb6ffd700 1 --2- 172.21.15.114:0/864653712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22bae500 0x556e22ba8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.526+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/864653712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22bae500 0x556e22ba8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.526+0000 7f0eb77fe700 1 -- 172.21.15.114:0/864653712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e22ab83f0 con 0x556e22badbe0 2023-10-18T14:04:03.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.526+0000 7f0eb6ffd700 1 --2- 172.21.15.114:0/864653712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22bae500 0x556e22ba8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:03.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.526+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/864653712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22badbe0 0x556e22badfc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80cb790 tx=0x7f0ea809aff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ef5fa11524d5f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.526+0000 7f0e9dffb700 1 -- 172.21.15.114:0/864653712 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80a30d0 con 0x556e22badbe0 2023-10-18T14:04:03.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.526+0000 7f0e9dffb700 1 -- 172.21.15.114:0/864653712 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ea80a3230 con 0x556e22badbe0 2023-10-18T14:04:03.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.526+0000 7f0e9dffb700 1 -- 172.21.15.114:0/864653712 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8017c60 con 0x556e22badbe0 2023-10-18T14:04:03.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.526+0000 7f0eca16bb80 1 -- 172.21.15.114:0/864653712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22badbe0 msgr2=0x556e22badfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.526+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/864653712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22badbe0 0x556e22badfc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80cb790 tx=0x7f0ea809aff0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.527+0000 7f0eca16bb80 1 -- 172.21.15.114:0/864653712 shutdown_connections 2023-10-18T14:04:03.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.527+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/864653712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22ba85d0 0x556e22ba8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.527+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/864653712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22badbe0 0x556e22badfc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.527+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/864653712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22bae500 0x556e22ba8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.527+0000 7f0eca16bb80 1 -- 172.21.15.114:0/864653712 >> 172.21.15.114:0/864653712 conn(0x556e22b1c720 msgr2=0x556e22ba2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.527+0000 7f0eca16bb80 1 -- 172.21.15.114:0/864653712 shutdown_connections 2023-10-18T14:04:03.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.527+0000 7f0eca16bb80 1 -- 172.21.15.114:0/864653712 wait complete. 2023-10-18T14:04:03.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.527+0000 7f0eca16bb80 1 -- start start 2023-10-18T14:04:03.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.527+0000 7f0eca16bb80 1 Processor -- start 2023-10-18T14:04:03.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eca16bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 0x556e22bb44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eca16bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22badbe0 0x556e22bb17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eca16bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22bae500 0x556e22bb1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eca16bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e22afae70 con 0x556e22ba85d0 2023-10-18T14:04:03.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eca16bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e22a97710 con 0x556e22badbe0 2023-10-18T14:04:03.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eca16bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e22a973b0 con 0x556e22bae500 2023-10-18T14:04:03.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eca16bb80 10 client.0 _ll_register_callbacks cb 0x556e229e1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:03.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eb77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 0x556e22bb44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eb77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 0x556e22bb44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44250/0 (socket says 172.21.15.114:44250) 2023-10-18T14:04:03.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eb77fe700 1 -- 172.21.15.114:0/2995488266 learned_addr learned my addr 172.21.15.114:0/2995488266 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:03.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eb6ffd700 1 --2- 172.21.15.114:0/2995488266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22badbe0 0x556e22bb17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eb77fe700 1 -- 172.21.15.114:0/2995488266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22bae500 msgr2=0x556e22bb1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/2995488266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22bae500 0x556e22bb1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eb77fe700 1 -- 172.21.15.114:0/2995488266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22badbe0 msgr2=0x556e22bb17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/2995488266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22badbe0 0x556e22bb17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eb77fe700 1 -- 172.21.15.114:0/2995488266 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb81a5950 con 0x556e22ba85d0 2023-10-18T14:04:03.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/2995488266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 0x556e22bb44d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80cbda0 tx=0x7f0ea8017dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c327679395bd87 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0e96ffd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:03.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0e96ffd700 1 -- 172.21.15.114:0/2995488266 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8098d90 con 0x556e22ba85d0 2023-10-18T14:04:03.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0e96ffd700 1 -- 172.21.15.114:0/2995488266 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0ea80a1030 con 0x556e22ba85d0 2023-10-18T14:04:03.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.528+0000 7f0eca16bb80 1 -- 172.21.15.114:0/2995488266 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e22affef0 con 0x556e22ba85d0 2023-10-18T14:04:03.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.529+0000 7f0e96ffd700 1 -- 172.21.15.114:0/2995488266 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea80a11f0 con 0x556e22ba85d0 2023-10-18T14:04:03.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.529+0000 7f0eca16bb80 10 client.15663 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:03.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.529+0000 7f0eca16bb80 1 -- 172.21.15.114:0/2995488266 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556e22925de0 con 0x556e22ba85d0 2023-10-18T14:04:03.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.529+0000 7f0e96ffd700 1 -- 172.21.15.114:0/2995488266 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556e22affef0 con 0x556e22ba85d0 2023-10-18T14:04:03.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.529+0000 7f0e96ffd700 1 -- 172.21.15.114:0/2995488266 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0ea809b3f0 con 0x556e22ba85d0 2023-10-18T14:04:03.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.529+0000 7f0eca16bb80 10 client.15663 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:03.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.529+0000 7f0eca16bb80 10 client.15663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:03.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.529+0000 7f0eca16bb80 20 client.15663 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:03.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.529+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/2995488266 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556e22bc1740 0x556e22bc3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.529+0000 7f0eca16bb80 4 client.15663 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:03.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.529+0000 7f0eca16bb80 1 -- 172.21.15.114:0/2995488266 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e22b778b0 con 0x556e22bc1740 2023-10-18T14:04:03.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.529+0000 7f0eb6ffd700 1 --2- 172.21.15.114:0/2995488266 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556e22bc1740 0x556e22bc3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.530+0000 7f0e96ffd700 10 client.15663 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:03.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.530+0000 7f0eb6ffd700 1 --2- 172.21.15.114:0/2995488266 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556e22bc1740 0x556e22bc3b60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d95ba848bb9f6f8c server_cookie=ef6f798f41711812 in_seq=0 out_seq=0 2023-10-18T14:04:03.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.530+0000 7f0e96ffd700 1 -- 172.21.15.114:0/2995488266 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556e22b778b0 con 0x556e22bc1740 2023-10-18T14:04:03.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.530+0000 7f0e96ffd700 10 client.15663 handle_command_reply: tid=0 2023-10-18T14:04:03.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.530+0000 7f0eca16bb80 1 client.15663 shutdown 2023-10-18T14:04:03.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.530+0000 7f0eca16bb80 1 -- 172.21.15.114:0/2995488266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 msgr2=0x556e22bb44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.530+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/2995488266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 0x556e22bb44d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80cbda0 tx=0x7f0ea8017dc0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.531+0000 7f0eca16bb80 1 -- 172.21.15.114:0/2995488266 shutdown_connections 2023-10-18T14:04:03.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.531+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/2995488266 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556e22bc1740 0x556e22bc3b60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.531+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/2995488266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22bae500 0x556e22bb1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.531+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/2995488266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 0x556e22bb44d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.531+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/2995488266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22badbe0 0x556e22bb17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.531+0000 7f0e96ffd700 0 client.15663 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:03.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.531+0000 7f0eca16bb80 1 -- 172.21.15.114:0/2995488266 >> 172.21.15.114:0/2995488266 conn(0x556e22b1c720 msgr2=0x556e22ba7080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.531+0000 7f0eca16bb80 1 -- 172.21.15.114:0/2995488266 shutdown_connections 2023-10-18T14:04:03.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.531+0000 7f0eca16bb80 1 -- 172.21.15.114:0/2995488266 wait complete. 2023-10-18T14:04:03.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.531+0000 7f0eca16bb80 20 client.15663 trim_cache size 0 max 16384 2023-10-18T14:04:03.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.547+0000 7f0eca16bb80 1 Processor -- start 2023-10-18T14:04:03.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.547+0000 7f0eca16bb80 1 -- start start 2023-10-18T14:04:03.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.547+0000 7f0eca16bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 0x556e22bbda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.547+0000 7f0eca16bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22badbe0 0x556e22bb8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eca16bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22bae500 0x556e22bb4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eca16bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e22b9daf0 con 0x556e22ba85d0 2023-10-18T14:04:03.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eca16bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2297b920 con 0x556e22badbe0 2023-10-18T14:04:03.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eca16bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e22bae3b0 con 0x556e22bae500 2023-10-18T14:04:03.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eb77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 0x556e22bbda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eb77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 0x556e22bbda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44258/0 (socket says 172.21.15.114:44258) 2023-10-18T14:04:03.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eb77fe700 1 -- 172.21.15.114:0/2208239321 learned_addr learned my addr 172.21.15.114:0/2208239321 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:03.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eb6ffd700 1 --2- 172.21.15.114:0/2208239321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22badbe0 0x556e22bb8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eb7fff700 1 --2- 172.21.15.114:0/2208239321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22bae500 0x556e22bb4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eb77fe700 1 -- 172.21.15.114:0/2208239321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22bae500 msgr2=0x556e22bb4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/2208239321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22bae500 0x556e22bb4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eb77fe700 1 -- 172.21.15.114:0/2208239321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22badbe0 msgr2=0x556e22bb8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/2208239321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22badbe0 0x556e22bb8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eb77fe700 1 -- 172.21.15.114:0/2208239321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e2290ec60 con 0x556e22ba85d0 2023-10-18T14:04:03.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eb6ffd700 1 --2- 172.21.15.114:0/2208239321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22badbe0 0x556e22bb8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:03.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/2208239321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 0x556e22bbda90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80a33a0 tx=0x7f0ea8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e483e9f19049a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0e9e7fc700 1 -- 172.21.15.114:0/2208239321 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80b93b0 con 0x556e22ba85d0 2023-10-18T14:04:03.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0e9e7fc700 1 -- 172.21.15.114:0/2208239321 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ea809b940 con 0x556e22ba85d0 2023-10-18T14:04:03.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.548+0000 7f0e9e7fc700 1 -- 172.21.15.114:0/2208239321 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8004d90 con 0x556e22ba85d0 2023-10-18T14:04:03.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.549+0000 7f0eca16bb80 1 -- 172.21.15.114:0/2208239321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 msgr2=0x556e22bbda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.549+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/2208239321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 0x556e22bbda90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80a33a0 tx=0x7f0ea8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.549+0000 7f0eca16bb80 1 -- 172.21.15.114:0/2208239321 shutdown_connections 2023-10-18T14:04:03.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.549+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/2208239321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22bae500 0x556e22bb4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.549+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/2208239321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22ba85d0 0x556e22bbda90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.549+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/2208239321 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22badbe0 0x556e22bb8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.549+0000 7f0eca16bb80 1 -- 172.21.15.114:0/2208239321 >> 172.21.15.114:0/2208239321 conn(0x556e22b1c720 msgr2=0x556e22bbd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.549+0000 7f0eca16bb80 1 -- 172.21.15.114:0/2208239321 shutdown_connections 2023-10-18T14:04:03.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.549+0000 7f0eca16bb80 1 -- 172.21.15.114:0/2208239321 wait complete. 2023-10-18T14:04:03.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.549+0000 7f0eca16bb80 1 -- start start 2023-10-18T14:04:03.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.549+0000 7f0eca16bb80 1 Processor -- start 2023-10-18T14:04:03.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eca16bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22ba85d0 0x556e22bb6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eca16bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22badbe0 0x556e22bb7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eca16bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22bae500 0x556e22c0e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eca16bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e22c0eaf0 con 0x556e22bae500 2023-10-18T14:04:03.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eca16bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e22c0ec60 con 0x556e22ba85d0 2023-10-18T14:04:03.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eca16bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e22c0ee20 con 0x556e22badbe0 2023-10-18T14:04:03.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eca16bb80 10 client.0 _ll_register_callbacks cb 0x556e229e1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:03.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eb7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22bae500 0x556e22c0e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eb7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22bae500 0x556e22c0e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44268/0 (socket says 172.21.15.114:44268) 2023-10-18T14:04:03.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eb7fff700 1 -- 172.21.15.114:0/202538791 learned_addr learned my addr 172.21.15.114:0/202538791 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:03.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eb6ffd700 1 --2- 172.21.15.114:0/202538791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22badbe0 0x556e22bb7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/202538791 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22ba85d0 0x556e22bb6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eb7fff700 1 -- 172.21.15.114:0/202538791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22badbe0 msgr2=0x556e22bb7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eb7fff700 1 --2- 172.21.15.114:0/202538791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22badbe0 0x556e22bb7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eb7fff700 1 -- 172.21.15.114:0/202538791 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22ba85d0 msgr2=0x556e22bb6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eb7fff700 1 --2- 172.21.15.114:0/202538791 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22ba85d0 0x556e22bb6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eb7fff700 1 -- 172.21.15.114:0/202538791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e22925de0 con 0x556e22bae500 2023-10-18T14:04:03.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eb7fff700 1 --2- 172.21.15.114:0/202538791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22bae500 0x556e22c0e5b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0006070 tx=0x7f0eb0004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3d9a982fed2564 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0e96ffd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:03.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0e96ffd700 1 -- 172.21.15.114:0/202538791 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00048c0 con 0x556e22bae500 2023-10-18T14:04:03.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0e96ffd700 1 -- 172.21.15.114:0/202538791 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0eb0004b40 con 0x556e22bae500 2023-10-18T14:04:03.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.550+0000 7f0eca16bb80 1 -- 172.21.15.114:0/202538791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ea80a3230 con 0x556e22bae500 2023-10-18T14:04:03.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.551+0000 7f0e96ffd700 1 -- 172.21.15.114:0/202538791 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0eb0004d00 con 0x556e22bae500 2023-10-18T14:04:03.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.551+0000 7f0eca16bb80 10 client.15669 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:03.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.551+0000 7f0eca16bb80 1 -- 172.21.15.114:0/202538791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556e2294c250 con 0x556e22bae500 2023-10-18T14:04:03.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.551+0000 7f0e96ffd700 1 -- 172.21.15.114:0/202538791 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ea80a3230 con 0x556e22bae500 2023-10-18T14:04:03.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.551+0000 7f0e96ffd700 1 -- 172.21.15.114:0/202538791 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0eb0014040 con 0x556e22bae500 2023-10-18T14:04:03.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.551+0000 7f0eca16bb80 10 client.15669 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:03.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.551+0000 7f0eca16bb80 10 client.15669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:03.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.551+0000 7f0eca16bb80 20 client.15669 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:03.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.551+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/202538791 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556e22c16750 0x556e22c18b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.551+0000 7f0eca16bb80 4 client.15669 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:04:03.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.551+0000 7f0eca16bb80 1 -- 172.21.15.114:0/202538791 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556e22af3e50 con 0x556e22c16750 2023-10-18T14:04:03.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.551+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/202538791 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556e22c16750 0x556e22c18b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0e96ffd700 10 client.15669 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:03.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0eb77fe700 1 --2- 172.21.15.114:0/202538791 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556e22c16750 0x556e22c18b70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c79d358825d96e8e server_cookie=e94084bd709718ac in_seq=0 out_seq=0 2023-10-18T14:04:03.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0e96ffd700 1 -- 172.21.15.114:0/202538791 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556e22af3e50 con 0x556e22c16750 2023-10-18T14:04:03.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0e96ffd700 10 client.15669 handle_command_reply: tid=0 2023-10-18T14:04:03.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0eca16bb80 1 client.15669 shutdown 2023-10-18T14:04:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0eca16bb80 1 -- 172.21.15.114:0/202538791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22bae500 msgr2=0x556e22c0e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/202538791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22bae500 0x556e22c0e5b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0006070 tx=0x7f0eb0004320 comp rx=0 tx=0).stop 2023-10-18T14:04:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0eca16bb80 1 -- 172.21.15.114:0/202538791 shutdown_connections 2023-10-18T14:04:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/202538791 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556e22c16750 0x556e22c18b70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/202538791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556e22bae500 0x556e22c0e5b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/202538791 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556e22ba85d0 0x556e22bb6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0eca16bb80 1 --2- 172.21.15.114:0/202538791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e22badbe0 0x556e22bb7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0eca16bb80 1 -- 172.21.15.114:0/202538791 >> 172.21.15.114:0/202538791 conn(0x556e22b1c720 msgr2=0x556e22bb00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0e96ffd700 0 client.15669 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:03.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0eca16bb80 1 -- 172.21.15.114:0/202538791 shutdown_connections 2023-10-18T14:04:03.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0eca16bb80 1 -- 172.21.15.114:0/202538791 wait complete. 2023-10-18T14:04:03.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.552+0000 7f0eca16bb80 20 client.15669 trim_cache size 0 max 16384 2023-10-18T14:04:03.575 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:04:03.575 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-18T14:04:03.575 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": { 2023-10-18T14:04:03.575 INFO:teuthology.orchestra.run.smithi114.stdout: "2fc15053-a85f-407c-8073-29d189c253b3": { 2023-10-18T14:04:03.576 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/", 2023-10-18T14:04:03.576 INFO:teuthology.orchestra.run.smithi114.stdout: "tag": "2fc15053-a85f-407c-8073-29d189c253b3", 2023-10-18T14:04:03.576 INFO:teuthology.orchestra.run.smithi114.stdout: "options": "recursive,force" 2023-10-18T14:04:03.576 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:04:03.576 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:04:03.576 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:04:03.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.553+0000 7f0ebdf82700 1 -- 172.21.15.114:0/1919381 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0ea00a1560 msgr2=0x7f0ea00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.553+0000 7f0ebdf82700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0ea00a1560 0x7f0ea00a3a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8074220 tx=0x7f0eac00b410 comp rx=0 tx=0).stop 2023-10-18T14:04:03.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.553+0000 7f0ebdf82700 1 -- 172.21.15.114:0/1919381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0eb8100710 msgr2=0x7f0eb8072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.553+0000 7f0ebdf82700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0eb8100710 0x7f0eb8072af0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80098e0 tx=0x7f0ea800f670 comp rx=0 tx=0).stop 2023-10-18T14:04:03.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.553+0000 7f0ebdf82700 1 -- 172.21.15.114:0/1919381 shutdown_connections 2023-10-18T14:04:03.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.553+0000 7f0ebdf82700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0ea00a1560 0x7f0ea00a3a20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.553+0000 7f0ebdf82700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0eb8106720 0x7f0eb8073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.553+0000 7f0ebdf82700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0eb8100710 0x7f0eb8072af0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.553+0000 7f0ebdf82700 1 --2- 172.21.15.114:0/1919381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0eb81010d0 0x7f0eb8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.553+0000 7f0ebdf82700 1 -- 172.21.15.114:0/1919381 >> 172.21.15.114:0/1919381 conn(0x7f0eb80fc200 msgr2=0x7f0eb80fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.553+0000 7f0ebdf82700 1 -- 172.21.15.114:0/1919381 shutdown_connections 2023-10-18T14:04:03.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.553+0000 7f0ebdf82700 1 -- 172.21.15.114:0/1919381 wait complete. 2023-10-18T14:04:03.580 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:03 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2989273432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:04:03.580 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:03 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2583392522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:04:03.580 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:03 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/1298038568' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:04:03.581 INFO:tasks.cephfs.filesystem:scrub status for tag:2fc15053-a85f-407c-8073-29d189c253b3 - {'path': '/', 'tag': '2fc15053-a85f-407c-8073-29d189c253b3', 'options': 'recursive,force'} 2023-10-18T14:04:03.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.568+0000 7f6f073c0700 1 -- 172.21.15.114:0/1078251616 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f000676e0 con 0x7f6eec0a1560 2023-10-18T14:04:03.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:03 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2989273432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:04:03.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:03 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2583392522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:04:03.582 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:03 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/1298038568' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:04:03.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.677+0000 7f6ef67fc700 1 -- 172.21.15.114:0/1078251616 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6f000676e0 con 0x7f6eec0a1560 2023-10-18T14:04:03.681 INFO:teuthology.orchestra.run.smithi114.stdout:Schedule set for path / 2023-10-18T14:04:03.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.679+0000 7f6f073c0700 1 -- 172.21.15.114:0/1078251616 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6eec0a1560 msgr2=0x7f6eec0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.679+0000 7f6f073c0700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6eec0a1560 0x7f6eec0a3a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6f00197b50 tx=0x7f6ef0009260 comp rx=0 tx=0).stop 2023-10-18T14:04:03.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.679+0000 7f6f073c0700 1 -- 172.21.15.114:0/1078251616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f001006e0 msgr2=0x7f6f0019c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.679+0000 7f6f073c0700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f001006e0 0x7f6f0019c860 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6efc005910 tx=0x7f6efc004730 comp rx=0 tx=0).stop 2023-10-18T14:04:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.679+0000 7f6f073c0700 1 -- 172.21.15.114:0/1078251616 shutdown_connections 2023-10-18T14:04:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.679+0000 7f6f073c0700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6eec0a1560 0x7f6eec0a3a20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.679+0000 7f6f073c0700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6f001066f0 0x7f6f00196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.679+0000 7f6f073c0700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f001006e0 0x7f6f0019c860 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.679+0000 7f6f073c0700 1 --2- 172.21.15.114:0/1078251616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f001010a0 0x7f6f0019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.679+0000 7f6f073c0700 1 -- 172.21.15.114:0/1078251616 >> 172.21.15.114:0/1078251616 conn(0x7f6f000fc1f0 msgr2=0x7f6f000fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.679+0000 7f6f073c0700 1 -- 172.21.15.114:0/1078251616 shutdown_connections 2023-10-18T14:04:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.679+0000 7f6f073c0700 1 -- 172.21.15.114:0/1078251616 wait complete. 2023-10-18T14:04:03.695 DEBUG:teuthology.orchestra.run.smithi114:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2023-10-18T14:04:03.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:03 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2989273432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:04:03.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:03 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2583392522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:04:03.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:03 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/1298038568' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:04:03.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.815+0000 7f1181c5f700 1 -- 172.21.15.114:0/2584309540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f117c1066f0 msgr2=0x7f117c106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.815+0000 7f1181c5f700 1 --2- 172.21.15.114:0/2584309540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f117c1066f0 0x7f117c106ad0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1170009990 tx=0x7f1170009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.815+0000 7f1181c5f700 1 -- 172.21.15.114:0/2584309540 shutdown_connections 2023-10-18T14:04:03.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.815+0000 7f1181c5f700 1 --2- 172.21.15.114:0/2584309540 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f117c1010a0 0x7f117c10d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.815+0000 7f1181c5f700 1 --2- 172.21.15.114:0/2584309540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f117c1066f0 0x7f117c106ad0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.815+0000 7f1181c5f700 1 --2- 172.21.15.114:0/2584309540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f117c1006e0 0x7f117c100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.815+0000 7f1181c5f700 1 -- 172.21.15.114:0/2584309540 >> 172.21.15.114:0/2584309540 conn(0x7f117c0fc1f0 msgr2=0x7f117c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.815+0000 7f1181c5f700 1 -- 172.21.15.114:0/2584309540 shutdown_connections 2023-10-18T14:04:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.815+0000 7f1181c5f700 1 -- 172.21.15.114:0/2584309540 wait complete. 2023-10-18T14:04:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.816+0000 7f1181c5f700 1 Processor -- start 2023-10-18T14:04:03.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.816+0000 7f1181c5f700 1 -- start start 2023-10-18T14:04:03.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.816+0000 7f1181c5f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f117c1006e0 0x7f117c19c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.816+0000 7f1181c5f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f117c1010a0 0x7f117c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.816+0000 7f1181c5f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f117c1066f0 0x7f117c196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.816+0000 7f1181c5f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c196fa0 con 0x7f117c1066f0 2023-10-18T14:04:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.816+0000 7f1181c5f700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c197110 con 0x7f117c1006e0 2023-10-18T14:04:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.816+0000 7f1181c5f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c1972d0 con 0x7f117c1010a0 2023-10-18T14:04:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.816+0000 7f117bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f117c1066f0 0x7f117c196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.816+0000 7f117bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f117c1066f0 0x7f117c196940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44304/0 (socket says 172.21.15.114:44304) 2023-10-18T14:04:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.816+0000 7f117bfff700 1 -- 172.21.15.114:0/3341772843 learned_addr learned my addr 172.21.15.114:0/3341772843 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.816+0000 7f117affd700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f117c1010a0 0x7f117c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.816+0000 7f117b7fe700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f117c1006e0 0x7f117c19c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.817+0000 7f117bfff700 1 -- 172.21.15.114:0/3341772843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f117c1010a0 msgr2=0x7f117c19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.817+0000 7f117bfff700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f117c1010a0 0x7f117c19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.817+0000 7f117bfff700 1 -- 172.21.15.114:0/3341772843 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f117c1006e0 msgr2=0x7f117c19c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.817+0000 7f117bfff700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f117c1006e0 0x7f117c19c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.817+0000 7f117bfff700 1 -- 172.21.15.114:0/3341772843 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700095f0 con 0x7f117c1066f0 2023-10-18T14:04:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.817+0000 7f117affd700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f117c1010a0 0x7f117c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.817+0000 7f117b7fe700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f117c1006e0 0x7f117c19c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.817+0000 7f117bfff700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f117c1066f0 0x7f117c196940 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1174007ee0 tx=0x7f117400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.817+0000 7f1178ff9700 1 -- 172.21.15.114:0/3341772843 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174017070 con 0x7f117c1066f0 2023-10-18T14:04:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.817+0000 7f1178ff9700 1 -- 172.21.15.114:0/3341772843 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f117400f040 con 0x7f117c1066f0 2023-10-18T14:04:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.817+0000 7f1181c5f700 1 -- 172.21.15.114:0/3341772843 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c1975b0 con 0x7f117c1066f0 2023-10-18T14:04:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.817+0000 7f1178ff9700 1 -- 172.21.15.114:0/3341772843 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174005740 con 0x7f117c1066f0 2023-10-18T14:04:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.817+0000 7f1181c5f700 1 -- 172.21.15.114:0/3341772843 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c1a3800 con 0x7f117c1066f0 2023-10-18T14:04:03.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.818+0000 7f1181c5f700 1 -- 172.21.15.114:0/3341772843 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c108c70 con 0x7f117c1066f0 2023-10-18T14:04:03.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.819+0000 7f1178ff9700 1 -- 172.21.15.114:0/3341772843 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f11740058a0 con 0x7f117c1066f0 2023-10-18T14:04:03.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.819+0000 7f1178ff9700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f11640a1560 0x7f11640a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:03.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.819+0000 7f117b7fe700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f11640a1560 0x7f11640a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:03.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.820+0000 7f1178ff9700 1 -- 172.21.15.114:0/3341772843 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f11740cce30 con 0x7f117c1066f0 2023-10-18T14:04:03.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.820+0000 7f117b7fe700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f11640a1560 0x7f11640a3a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1170006010 tx=0x7f117001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:03.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:03.823+0000 7f1178ff9700 1 -- 172.21.15.114:0/3341772843 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1174096230 con 0x7f117c1066f0 2023-10-18T14:04:04.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.042+0000 7f1181c5f700 1 -- 172.21.15.114:0/3341772843 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f117c197e00 con 0x7f11640a1560 2023-10-18T14:04:04.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.096+0000 7f1178ff9700 1 -- 172.21.15.114:0/3341772843 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f117c197e00 con 0x7f11640a1560 2023-10-18T14:04:04.101 INFO:teuthology.orchestra.run.smithi114.stdout:Retention added to path / 2023-10-18T14:04:04.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.098+0000 7f1181c5f700 1 -- 172.21.15.114:0/3341772843 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f11640a1560 msgr2=0x7f11640a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:04.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.098+0000 7f1181c5f700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f11640a1560 0x7f11640a3a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1170006010 tx=0x7f117001a040 comp rx=0 tx=0).stop 2023-10-18T14:04:04.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.098+0000 7f1181c5f700 1 -- 172.21.15.114:0/3341772843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f117c1066f0 msgr2=0x7f117c196940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:04.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.098+0000 7f1181c5f700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f117c1066f0 0x7f117c196940 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1174007ee0 tx=0x7f117400d3b0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.098+0000 7f1181c5f700 1 -- 172.21.15.114:0/3341772843 shutdown_connections 2023-10-18T14:04:04.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.098+0000 7f1181c5f700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f11640a1560 0x7f11640a3a20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.098+0000 7f1181c5f700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f117c1066f0 0x7f117c196940 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.098+0000 7f1181c5f700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f117c1006e0 0x7f117c19c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.098+0000 7f1181c5f700 1 --2- 172.21.15.114:0/3341772843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f117c1010a0 0x7f117c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.098+0000 7f1181c5f700 1 -- 172.21.15.114:0/3341772843 >> 172.21.15.114:0/3341772843 conn(0x7f117c0fc1f0 msgr2=0x7f117c0fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.099+0000 7f1181c5f700 1 -- 172.21.15.114:0/3341772843 shutdown_connections 2023-10-18T14:04:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.099+0000 7f1181c5f700 1 -- 172.21.15.114:0/3341772843 wait complete. 2023-10-18T14:04:04.115 DEBUG:teuthology.orchestra.run.smithi114:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-18T14:04:04.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.234+0000 7f31c1831700 1 -- 172.21.15.114:0/3397875167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31bc0ff5d0 msgr2=0x7f31bc0ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:04.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.234+0000 7f31c1831700 1 --2- 172.21.15.114:0/3397875167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31bc0ff5d0 0x7f31bc0ffa50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009990 tx=0x7f31b0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.234+0000 7f31c1831700 1 -- 172.21.15.114:0/3397875167 shutdown_connections 2023-10-18T14:04:04.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.234+0000 7f31c1831700 1 --2- 172.21.15.114:0/3397875167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31bc0fff90 0x7f31bc10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.234+0000 7f31c1831700 1 --2- 172.21.15.114:0/3397875167 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc1045e0 0x7f31bc1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.234+0000 7f31c1831700 1 --2- 172.21.15.114:0/3397875167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31bc0ff5d0 0x7f31bc0ffa50 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.234+0000 7f31c1831700 1 -- 172.21.15.114:0/3397875167 >> 172.21.15.114:0/3397875167 conn(0x7f31bc076790 msgr2=0x7f31bc076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:04.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.234+0000 7f31c1831700 1 -- 172.21.15.114:0/3397875167 shutdown_connections 2023-10-18T14:04:04.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.234+0000 7f31c1831700 1 -- 172.21.15.114:0/3397875167 wait complete. 2023-10-18T14:04:04.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.234+0000 7f31c1831700 1 Processor -- start 2023-10-18T14:04:04.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31c1831700 1 -- start start 2023-10-18T14:04:04.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31c1831700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31bc0ff5d0 0x7f31bc197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:04.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31c1831700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc0fff90 0x7f31bc197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:04.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31c1831700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31bc1045e0 0x7f31bc1a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:04.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31c1831700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc1987c0 con 0x7f31bc0ff5d0 2023-10-18T14:04:04.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31c1831700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc1a2fc0 con 0x7f31bc0fff90 2023-10-18T14:04:04.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31c1831700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc1a3100 con 0x7f31bc1045e0 2023-10-18T14:04:04.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31baffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31bc0ff5d0 0x7f31bc197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:04.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31baffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31bc0ff5d0 0x7f31bc197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44314/0 (socket says 172.21.15.114:44314) 2023-10-18T14:04:04.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31baffd700 1 -- 172.21.15.114:0/3926301673 learned_addr learned my addr 172.21.15.114:0/3926301673 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:04.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31bb7fe700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31bc1045e0 0x7f31bc1a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:04.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31ba7fc700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc0fff90 0x7f31bc197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:04.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31baffd700 1 -- 172.21.15.114:0/3926301673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31bc1045e0 msgr2=0x7f31bc1a2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:04.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31baffd700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31bc1045e0 0x7f31bc1a2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31baffd700 1 -- 172.21.15.114:0/3926301673 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc0fff90 msgr2=0x7f31bc197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:04.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31baffd700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc0fff90 0x7f31bc197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31baffd700 1 -- 172.21.15.114:0/3926301673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b00095f0 con 0x7f31bc0ff5d0 2023-10-18T14:04:04.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31ba7fc700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc0fff90 0x7f31bc197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:04.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31baffd700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31bc0ff5d0 0x7f31bc197a00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00d980 tx=0x7f31ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:04.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.235+0000 7f31c082f700 1 -- 172.21.15.114:0/3926301673 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00b8f0 con 0x7f31bc0ff5d0 2023-10-18T14:04:04.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.236+0000 7f31c1831700 1 -- 172.21.15.114:0/3926301673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc1a3390 con 0x7f31bc0ff5d0 2023-10-18T14:04:04.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.236+0000 7f31c082f700 1 -- 172.21.15.114:0/3926301673 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31ac007620 con 0x7f31bc0ff5d0 2023-10-18T14:04:04.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.236+0000 7f31c082f700 1 -- 172.21.15.114:0/3926301673 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00f3c0 con 0x7f31bc0ff5d0 2023-10-18T14:04:04.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.236+0000 7f31c1831700 1 -- 172.21.15.114:0/3926301673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc1a38a0 con 0x7f31bc0ff5d0 2023-10-18T14:04:04.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.236+0000 7f31c1831700 1 -- 172.21.15.114:0/3926301673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc107be0 con 0x7f31bc0ff5d0 2023-10-18T14:04:04.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.238+0000 7f31c082f700 1 -- 172.21.15.114:0/3926301673 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f31ac0105f0 con 0x7f31bc0ff5d0 2023-10-18T14:04:04.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.238+0000 7f31c082f700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f31a40a1560 0x7f31a40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:04.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.238+0000 7f31ba7fc700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f31a40a1560 0x7f31a40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:04.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.238+0000 7f31c082f700 1 -- 172.21.15.114:0/3926301673 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f31ac0cd6a0 con 0x7f31bc0ff5d0 2023-10-18T14:04:04.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.239+0000 7f31ba7fc700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f31a40a1560 0x7f31a40a3a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f31b000b5c0 tx=0x7f31b001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:04.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.242+0000 7f31c082f700 1 -- 172.21.15.114:0/3926301673 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f31ac096aa0 con 0x7f31bc0ff5d0 2023-10-18T14:04:04.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.319+0000 7f31c082f700 1 -- 172.21.15.114:0/3926301673 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 22) v1 ==== 136129+0+0 (secure 0 0 0) 0x7f31ac096e70 con 0x7f31bc0ff5d0 2023-10-18T14:04:04.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.466+0000 7f31c1831700 1 -- 172.21.15.114:0/3926301673 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f31bc068080 con 0x7f31a40a1560 2023-10-18T14:04:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.474+0000 7f31c082f700 1 -- 172.21.15.114:0/3926301673 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7f31bc068080 con 0x7f31a40a1560 2023-10-18T14:04:04.478 INFO:teuthology.orchestra.run.smithi114.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-18T00:00:00", "created": "2023-10-18T14:04:03", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-10-18T14:04:04.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.476+0000 7f31c1831700 1 -- 172.21.15.114:0/3926301673 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f31a40a1560 msgr2=0x7f31a40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:04.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.476+0000 7f31c1831700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f31a40a1560 0x7f31a40a3a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f31b000b5c0 tx=0x7f31b001a040 comp rx=0 tx=0).stop 2023-10-18T14:04:04.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.476+0000 7f31c1831700 1 -- 172.21.15.114:0/3926301673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31bc0ff5d0 msgr2=0x7f31bc197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:04.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.476+0000 7f31c1831700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31bc0ff5d0 0x7f31bc197a00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00d980 tx=0x7f31ac00dc90 comp rx=0 tx=0).stop 2023-10-18T14:04:04.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.476+0000 7f31c1831700 1 -- 172.21.15.114:0/3926301673 shutdown_connections 2023-10-18T14:04:04.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.476+0000 7f31c1831700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f31a40a1560 0x7f31a40a3a20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.476+0000 7f31c1831700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31bc1045e0 0x7f31bc1a2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.476+0000 7f31c1831700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31bc0ff5d0 0x7f31bc197a00 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.476+0000 7f31c1831700 1 --2- 172.21.15.114:0/3926301673 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f31bc0fff90 0x7f31bc197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.476+0000 7f31c1831700 1 -- 172.21.15.114:0/3926301673 >> 172.21.15.114:0/3926301673 conn(0x7f31bc076790 msgr2=0x7f31bc0fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:04.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.476+0000 7f31c1831700 1 -- 172.21.15.114:0/3926301673 shutdown_connections 2023-10-18T14:04:04.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.476+0000 7f31c1831700 1 -- 172.21.15.114:0/3926301673 wait complete. 2023-10-18T14:04:04.491 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:04 smithi114 ceph-mon[99494]: scrub queued for path: / 2023-10-18T14:04:04.491 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:04 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:04:04.491 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:04 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:04:04.491 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:04 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:04:04.492 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:04 smithi114 ceph-mon[99494]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:04:04.492 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:04 smithi114 ceph-mon[99494]: pgmap v281: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-18T14:04:04.493 DEBUG:teuthology.orchestra.run.smithi114:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-18T14:04:04.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.613+0000 7f4d85072700 1 -- 172.21.15.114:0/2993257028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d801045e0 msgr2=0x7f4d801049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:04.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.613+0000 7f4d85072700 1 --2- 172.21.15.114:0/2993257028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d801045e0 0x7f4d801049c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009990 tx=0x7f4d74009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.613+0000 7f4d85072700 1 -- 172.21.15.114:0/2993257028 shutdown_connections 2023-10-18T14:04:04.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.613+0000 7f4d85072700 1 --2- 172.21.15.114:0/2993257028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d800fff90 0x7f4d8010c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.613+0000 7f4d85072700 1 --2- 172.21.15.114:0/2993257028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d801045e0 0x7f4d801049c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.613+0000 7f4d85072700 1 --2- 172.21.15.114:0/2993257028 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d800ff5d0 0x7f4d800ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.613+0000 7f4d85072700 1 -- 172.21.15.114:0/2993257028 >> 172.21.15.114:0/2993257028 conn(0x7f4d80076790 msgr2=0x7f4d80076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:04.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.613+0000 7f4d85072700 1 -- 172.21.15.114:0/2993257028 shutdown_connections 2023-10-18T14:04:04.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.613+0000 7f4d85072700 1 -- 172.21.15.114:0/2993257028 wait complete. 2023-10-18T14:04:04.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.614+0000 7f4d85072700 1 Processor -- start 2023-10-18T14:04:04.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.614+0000 7f4d85072700 1 -- start start 2023-10-18T14:04:04.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.614+0000 7f4d85072700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d800ff5d0 0x7f4d8019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:04.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.614+0000 7f4d85072700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800fff90 0x7f4d8019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:04.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.614+0000 7f4d85072700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d801045e0 0x7f4d801958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:04.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.614+0000 7f4d85072700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801960c0 con 0x7f4d800fff90 2023-10-18T14:04:04.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.614+0000 7f4d85072700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d80196230 con 0x7f4d800ff5d0 2023-10-18T14:04:04.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.614+0000 7f4d85072700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801963f0 con 0x7f4d801045e0 2023-10-18T14:04:04.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.614+0000 7f4d7e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800fff90 0x7f4d8019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:04.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.614+0000 7f4d7e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800fff90 0x7f4d8019bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44330/0 (socket says 172.21.15.114:44330) 2023-10-18T14:04:04.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.614+0000 7f4d7e59c700 1 -- 172.21.15.114:0/2071897474 learned_addr learned my addr 172.21.15.114:0/2071897474 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:04.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.614+0000 7f4d7ed9d700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d800ff5d0 0x7f4d8019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:04.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d7f59e700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d801045e0 0x7f4d801958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:04.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d7e59c700 1 -- 172.21.15.114:0/2071897474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d801045e0 msgr2=0x7f4d801958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:04.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d7e59c700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d801045e0 0x7f4d801958f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d7e59c700 1 -- 172.21.15.114:0/2071897474 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d800ff5d0 msgr2=0x7f4d8019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:04.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d7e59c700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d800ff5d0 0x7f4d8019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d7e59c700 1 -- 172.21.15.114:0/2071897474 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d740095f0 con 0x7f4d800fff90 2023-10-18T14:04:04.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d7f59e700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d801045e0 0x7f4d801958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:04.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d7ed9d700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d800ff5d0 0x7f4d8019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:04.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d7e59c700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800fff90 0x7f4d8019bd90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000b530 tx=0x7f4d7000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:04.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d67fff700 1 -- 172.21.15.114:0/2071897474 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70011830 con 0x7f4d800fff90 2023-10-18T14:04:04.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d85072700 1 -- 172.21.15.114:0/2071897474 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d801966d0 con 0x7f4d800fff90 2023-10-18T14:04:04.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d67fff700 1 -- 172.21.15.114:0/2071897474 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d70011e50 con 0x7f4d800fff90 2023-10-18T14:04:04.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d67fff700 1 -- 172.21.15.114:0/2071897474 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7000f2e0 con 0x7f4d800fff90 2023-10-18T14:04:04.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.615+0000 7f4d85072700 1 -- 172.21.15.114:0/2071897474 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d801a27d0 con 0x7f4d800fff90 2023-10-18T14:04:04.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.616+0000 7f4d85072700 1 -- 172.21.15.114:0/2071897474 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d80107bc0 con 0x7f4d800fff90 2023-10-18T14:04:04.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.617+0000 7f4d67fff700 1 -- 172.21.15.114:0/2071897474 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) v1 ==== 136129+0+0 (secure 0 0 0) 0x7f4d70010580 con 0x7f4d800fff90 2023-10-18T14:04:04.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.617+0000 7f4d67fff700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4d680a15f0 0x7f4d680a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:04.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.618+0000 7f4d7ed9d700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4d680a15f0 0x7f4d680a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:04.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.618+0000 7f4d67fff700 1 -- 172.21.15.114:0/2071897474 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f4d700ccff0 con 0x7f4d800fff90 2023-10-18T14:04:04.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.618+0000 7f4d7ed9d700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4d680a15f0 0x7f4d680a3ab0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4d74000c00 tx=0x7f4d7400b580 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:04.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.621+0000 7f4d67fff700 1 -- 172.21.15.114:0/2071897474 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4d700964a0 con 0x7f4d800fff90 2023-10-18T14:04:04.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:04 smithi158 ceph-mon[103317]: scrub queued for path: / 2023-10-18T14:04:04.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:04 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:04:04.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:04 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:04:04.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:04 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:04:04.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:04 smithi158 ceph-mon[103317]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:04:04.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:04 smithi158 ceph-mon[103317]: pgmap v281: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-18T14:04:04.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:04 smithi172 ceph-mon[103574]: scrub queued for path: / 2023-10-18T14:04:04.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:04 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:04:04.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:04 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:04:04.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:04 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:04:04.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:04 smithi172 ceph-mon[103574]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:04:04.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:04 smithi172 ceph-mon[103574]: pgmap v281: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-18T14:04:04.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.838+0000 7f4d85072700 1 -- 172.21.15.114:0/2071897474 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4d80196dd0 con 0x7f4d680a15f0 2023-10-18T14:04:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.845+0000 7f4d67fff700 1 -- 172.21.15.114:0/2071897474 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f4d80196dd0 con 0x7f4d680a15f0 2023-10-18T14:04:04.849 INFO:teuthology.orchestra.run.smithi114.stdout:/ 1m 6m3h 2023-10-18T14:04:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.848+0000 7f4d85072700 1 -- 172.21.15.114:0/2071897474 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4d680a15f0 msgr2=0x7f4d680a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.848+0000 7f4d85072700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4d680a15f0 0x7f4d680a3ab0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4d74000c00 tx=0x7f4d7400b580 comp rx=0 tx=0).stop 2023-10-18T14:04:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.848+0000 7f4d85072700 1 -- 172.21.15.114:0/2071897474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800fff90 msgr2=0x7f4d8019bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.848+0000 7f4d85072700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800fff90 0x7f4d8019bd90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000b530 tx=0x7f4d7000b8f0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.848+0000 7f4d85072700 1 -- 172.21.15.114:0/2071897474 shutdown_connections 2023-10-18T14:04:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.848+0000 7f4d85072700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4d680a15f0 0x7f4d680a3ab0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.848+0000 7f4d85072700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d801045e0 0x7f4d801958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.848+0000 7f4d85072700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4d800ff5d0 0x7f4d8019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.848+0000 7f4d85072700 1 --2- 172.21.15.114:0/2071897474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800fff90 0x7f4d8019bd90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.848+0000 7f4d85072700 1 -- 172.21.15.114:0/2071897474 >> 172.21.15.114:0/2071897474 conn(0x7f4d80076790 msgr2=0x7f4d800fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.848+0000 7f4d85072700 1 -- 172.21.15.114:0/2071897474 shutdown_connections 2023-10-18T14:04:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:04.848+0000 7f4d85072700 1 -- 172.21.15.114:0/2071897474 wait complete. 2023-10-18T14:04:04.864 DEBUG:teuthology.orchestra.run.smithi114:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-10-18T14:04:04.891 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-10-18T14:04:04.902 INFO:teuthology.run_tasks:Running task background_exec... 2023-10-18T14:04:04.942 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T14:04:04.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-10-18T14:04:04.945 INFO:teuthology.run_tasks:Running task workunit... 2023-10-18T14:04:04.961 INFO:tasks.workunit:Pulling workunits from ref f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-18T14:04:04.961 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-18T14:04:04.961 INFO:tasks.workunit:timeout=3h 2023-10-18T14:04:04.962 INFO:tasks.workunit:cleanup=True 2023-10-18T14:04:04.962 DEBUG:teuthology.orchestra.run.smithi114:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-18T14:04:04.985 INFO:teuthology.orchestra.run.smithi114.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-18T14:04:04.986 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-10-18T14:04:04.986 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 7ch/124d Inode: 1099511628283 Links: 2 2023-10-18T14:04:04.986 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T14:04:04.986 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:cephfs_t:s0 2023-10-18T14:04:04.986 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-10-18 14:02:39.055275826 +0000 2023-10-18T14:04:04.987 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-10-18 14:02:39.055275826 +0000 2023-10-18T14:04:04.987 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-10-18 14:03:56.479811877 +0000 2023-10-18T14:04:04.987 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2023-10-18 14:02:39.055275826 +0000 2023-10-18T14:04:04.987 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-18T14:04:04.988 DEBUG:teuthology.orchestra.run.smithi114:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-18T14:04:05.084 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-18T14:04:05.102 INFO:tasks.workunit.client.0.smithi114.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-18T14:04:05.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:05 smithi114 ceph-mon[99494]: from='client.15681 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:04:05.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:05 smithi114 ceph-mon[99494]: mgrmap e22: x(active, since 6m), standbys: z, y 2023-10-18T14:04:05.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:05 smithi114 ceph-mon[99494]: from='client.15687 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:04:05.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:05 smithi114 ceph-mon[99494]: from='client.15693 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:04:05.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:05 smithi158 ceph-mon[103317]: from='client.15681 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:04:05.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:05 smithi158 ceph-mon[103317]: mgrmap e22: x(active, since 6m), standbys: z, y 2023-10-18T14:04:05.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:05 smithi158 ceph-mon[103317]: from='client.15687 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:04:05.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:05 smithi158 ceph-mon[103317]: from='client.15693 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:04:05.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:05 smithi172 ceph-mon[103574]: from='client.15681 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:04:05.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:05 smithi172 ceph-mon[103574]: mgrmap e22: x(active, since 6m), standbys: z, y 2023-10-18T14:04:05.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:05 smithi172 ceph-mon[103574]: from='client.15687 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:04:05.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:05 smithi172 ceph-mon[103574]: from='client.15693 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:04:06.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:06 smithi114 ceph-mon[99494]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-18T14:04:06.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:06 smithi114 ceph-mon[99494]: scrub summary: idle 2023-10-18T14:04:06.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:06 smithi158 ceph-mon[103317]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-18T14:04:06.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:06 smithi158 ceph-mon[103317]: scrub summary: idle 2023-10-18T14:04:06.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:06 smithi172 ceph-mon[103574]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-18T14:04:06.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:06 smithi172 ceph-mon[103574]: scrub summary: idle 2023-10-18T14:04:09.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:08 smithi158 ceph-mon[103317]: pgmap v283: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 45 op/s 2023-10-18T14:04:09.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:08 smithi172 ceph-mon[103574]: pgmap v283: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 45 op/s 2023-10-18T14:04:09.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:08 smithi114 ceph-mon[99494]: pgmap v283: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 45 op/s 2023-10-18T14:04:10.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:09 smithi158 ceph-mon[103317]: mgrmap e23: x(active, since 7m), standbys: z, y 2023-10-18T14:04:10.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:09 smithi172 ceph-mon[103574]: mgrmap e23: x(active, since 7m), standbys: z, y 2023-10-18T14:04:10.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:09 smithi114 ceph-mon[99494]: mgrmap e23: x(active, since 7m), standbys: z, y 2023-10-18T14:04:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:10 smithi158 ceph-mon[103317]: pgmap v284: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-18T14:04:11.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:10 smithi172 ceph-mon[103574]: pgmap v284: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-18T14:04:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:10 smithi114 ceph-mon[99494]: pgmap v284: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-18T14:04:13.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:12 smithi158 ceph-mon[103317]: pgmap v285: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 116 KiB/s wr, 46 op/s 2023-10-18T14:04:13.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:12 smithi172 ceph-mon[103574]: pgmap v285: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 116 KiB/s wr, 46 op/s 2023-10-18T14:04:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:12 smithi114 ceph-mon[99494]: pgmap v285: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 116 KiB/s wr, 46 op/s 2023-10-18T14:04:14.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:14 smithi172 ceph-mon[103574]: pgmap v286: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 116 KiB/s wr, 45 op/s 2023-10-18T14:04:14.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:14 smithi114 ceph-mon[99494]: pgmap v286: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 116 KiB/s wr, 45 op/s 2023-10-18T14:04:14.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:14 smithi158 ceph-mon[103317]: pgmap v286: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 116 KiB/s wr, 45 op/s 2023-10-18T14:04:17.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:16 smithi158 ceph-mon[103317]: pgmap v287: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 116 KiB/s wr, 45 op/s 2023-10-18T14:04:17.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:16 smithi172 ceph-mon[103574]: pgmap v287: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 116 KiB/s wr, 45 op/s 2023-10-18T14:04:17.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:16 smithi114 ceph-mon[99494]: pgmap v287: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 116 KiB/s wr, 45 op/s 2023-10-18T14:04:18.107 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.102+0000 7efd59732700 1 -- 172.21.15.114:0/1738107797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd541045f0 msgr2=0x7efd541049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:18.107 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.102+0000 7efd59732700 1 --2- 172.21.15.114:0/1738107797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd541045f0 0x7efd541049d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efd48009990 tx=0x7efd48009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.107 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.102+0000 7efd59732700 1 -- 172.21.15.114:0/1738107797 shutdown_connections 2023-10-18T14:04:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.102+0000 7efd59732700 1 --2- 172.21.15.114:0/1738107797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd540fff90 0x7efd5410c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.102+0000 7efd59732700 1 --2- 172.21.15.114:0/1738107797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd541045f0 0x7efd541049d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.102+0000 7efd59732700 1 --2- 172.21.15.114:0/1738107797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd540ff5d0 0x7efd540ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.102+0000 7efd59732700 1 -- 172.21.15.114:0/1738107797 >> 172.21.15.114:0/1738107797 conn(0x7efd540767f0 msgr2=0x7efd54076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.103+0000 7efd59732700 1 -- 172.21.15.114:0/1738107797 shutdown_connections 2023-10-18T14:04:18.109 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.103+0000 7efd59732700 1 -- 172.21.15.114:0/1738107797 wait complete. 2023-10-18T14:04:18.109 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.103+0000 7efd59732700 1 Processor -- start 2023-10-18T14:04:18.109 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.103+0000 7efd59732700 1 -- start start 2023-10-18T14:04:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd59732700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd540ff5d0 0x7efd540fcf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd59732700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd540fff90 0x7efd540fd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd59732700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd541045f0 0x7efd540fda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd59732700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd541a4fb0 con 0x7efd541045f0 2023-10-18T14:04:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd59732700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd541a5120 con 0x7efd540ff5d0 2023-10-18T14:04:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd59732700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd541a52e0 con 0x7efd540fff90 2023-10-18T14:04:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd537fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd541045f0 0x7efd540fda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd537fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd541045f0 0x7efd540fda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44350/0 (socket says 172.21.15.114:44350) 2023-10-18T14:04:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd537fe700 1 -- 172.21.15.114:0/1348200070 learned_addr learned my addr 172.21.15.114:0/1348200070 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd52ffd700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd540ff5d0 0x7efd540fcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd527fc700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd540fff90 0x7efd540fd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd537fe700 1 -- 172.21.15.114:0/1348200070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd540fff90 msgr2=0x7efd540fd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd537fe700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd540fff90 0x7efd540fd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd537fe700 1 -- 172.21.15.114:0/1348200070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd540ff5d0 msgr2=0x7efd540fcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd537fe700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd540ff5d0 0x7efd540fcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd537fe700 1 -- 172.21.15.114:0/1348200070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd480095f0 con 0x7efd541045f0 2023-10-18T14:04:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd52ffd700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd540ff5d0 0x7efd540fcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd537fe700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd541045f0 0x7efd540fda10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00ab50 tx=0x7efd4c00af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd3bfff700 1 -- 172.21.15.114:0/1348200070 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c00f070 con 0x7efd541045f0 2023-10-18T14:04:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd59732700 1 -- 172.21.15.114:0/1348200070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd541a55c0 con 0x7efd541045f0 2023-10-18T14:04:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd3bfff700 1 -- 172.21.15.114:0/1348200070 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd4c007a80 con 0x7efd541045f0 2023-10-18T14:04:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd3bfff700 1 -- 172.21.15.114:0/1348200070 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c005310 con 0x7efd541045f0 2023-10-18T14:04:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.104+0000 7efd59732700 1 -- 172.21.15.114:0/1348200070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd541a5a80 con 0x7efd541045f0 2023-10-18T14:04:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.106+0000 7efd3bfff700 1 -- 172.21.15.114:0/1348200070 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7efd4c004ad0 con 0x7efd541045f0 2023-10-18T14:04:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.107+0000 7efd3bfff700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efd3c0a1560 0x7efd3c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.107+0000 7efd52ffd700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efd3c0a1560 0x7efd3c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.107+0000 7efd3bfff700 1 -- 172.21.15.114:0/1348200070 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efd4c0cc510 con 0x7efd541045f0 2023-10-18T14:04:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.108+0000 7efd52ffd700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efd3c0a1560 0x7efd3c0a3a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd48006010 tx=0x7efd4801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.108+0000 7efd6591bb80 1 Processor -- start 2023-10-18T14:04:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.108+0000 7efd6591bb80 1 -- start start 2023-10-18T14:04:18.121 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.108+0000 7efd6591bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9f630 0x556b81b9fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.121 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.108+0000 7efd6591bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 0x556b81b99ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.121 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.108+0000 7efd6591bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 0x556b81b9a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.121 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.108+0000 7efd6591bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b81b0d680 con 0x556b81b9ff50 2023-10-18T14:04:18.121 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.108+0000 7efd6591bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b81af3c00 con 0x556b81b9f630 2023-10-18T14:04:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.108+0000 7efd6591bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b81af1520 con 0x556b81b9a410 2023-10-18T14:04:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.108+0000 7efd527fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 0x556b81b99ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.108+0000 7efd527fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 0x556b81b99ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44358/0 (socket says 172.21.15.114:44358) 2023-10-18T14:04:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.108+0000 7efd527fc700 1 -- 172.21.15.114:0/1020819712 learned_addr learned my addr 172.21.15.114:0/1020819712 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.108+0000 7efd537fe700 1 --2- 172.21.15.114:0/1020819712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 0x556b81b9a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.109+0000 7efd52ffd700 1 --2- 172.21.15.114:0/1020819712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9f630 0x556b81b9fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.109+0000 7efd527fc700 1 -- 172.21.15.114:0/1020819712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 msgr2=0x556b81b9a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.109+0000 7efd527fc700 1 --2- 172.21.15.114:0/1020819712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 0x556b81b9a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.109+0000 7efd527fc700 1 -- 172.21.15.114:0/1020819712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9f630 msgr2=0x556b81b9fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.109+0000 7efd527fc700 1 --2- 172.21.15.114:0/1020819712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9f630 0x556b81b9fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.109+0000 7efd527fc700 1 -- 172.21.15.114:0/1020819712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b81aaa390 con 0x556b81b9ff50 2023-10-18T14:04:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.109+0000 7efd527fc700 1 --2- 172.21.15.114:0/1020819712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 0x556b81b99ed0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efd4400bd10 tx=0x7efd4400f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d06817b584d17d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.109+0000 7efd397fa700 1 -- 172.21.15.114:0/1020819712 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4400fda0 con 0x556b81b9ff50 2023-10-18T14:04:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.109+0000 7efd397fa700 1 -- 172.21.15.114:0/1020819712 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd4400be60 con 0x556b81b9ff50 2023-10-18T14:04:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.109+0000 7efd397fa700 1 -- 172.21.15.114:0/1020819712 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd440117c0 con 0x556b81b9ff50 2023-10-18T14:04:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 -- 172.21.15.114:0/1020819712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 msgr2=0x556b81b99ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 --2- 172.21.15.114:0/1020819712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 0x556b81b99ed0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efd4400bd10 tx=0x7efd4400f640 comp rx=0 tx=0).stop 2023-10-18T14:04:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 -- 172.21.15.114:0/1020819712 shutdown_connections 2023-10-18T14:04:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 --2- 172.21.15.114:0/1020819712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 0x556b81b9a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 --2- 172.21.15.114:0/1020819712 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9f630 0x556b81b9fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 --2- 172.21.15.114:0/1020819712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 0x556b81b99ed0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 -- 172.21.15.114:0/1020819712 >> 172.21.15.114:0/1020819712 conn(0x556b81b0e6c0 msgr2=0x556b81b945a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 -- 172.21.15.114:0/1020819712 shutdown_connections 2023-10-18T14:04:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 -- 172.21.15.114:0/1020819712 wait complete. 2023-10-18T14:04:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 -- start start 2023-10-18T14:04:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 Processor -- start 2023-10-18T14:04:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9a410 0x556b81ba5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9f630 0x556b81ba32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9ff50 0x556b81ba39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b81aece10 con 0x556b81b9a410 2023-10-18T14:04:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b81a896b0 con 0x556b81b9ff50 2023-10-18T14:04:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b81a89350 con 0x556b81b9f630 2023-10-18T14:04:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.110+0000 7efd6591bb80 10 client.0 _ll_register_callbacks cb 0x556b819d3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd52ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9a410 0x556b81ba5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd52ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9a410 0x556b81ba5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44360/0 (socket says 172.21.15.114:44360) 2023-10-18T14:04:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd52ffd700 1 -- 172.21.15.114:0/1884611010 learned_addr learned my addr 172.21.15.114:0/1884611010 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd527fc700 1 --2- 172.21.15.114:0/1884611010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9f630 0x556b81ba32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd537fe700 1 --2- 172.21.15.114:0/1884611010 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9ff50 0x556b81ba39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd52ffd700 1 -- 172.21.15.114:0/1884611010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9f630 msgr2=0x556b81ba32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd52ffd700 1 --2- 172.21.15.114:0/1884611010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9f630 0x556b81ba32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd52ffd700 1 -- 172.21.15.114:0/1884611010 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9ff50 msgr2=0x556b81ba39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:18.134 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd52ffd700 1 --2- 172.21.15.114:0/1884611010 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9ff50 0x556b81ba39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.134 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd52ffd700 1 -- 172.21.15.114:0/1884611010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4400b940 con 0x556b81b9a410 2023-10-18T14:04:18.134 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd52ffd700 1 --2- 172.21.15.114:0/1884611010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9a410 0x556b81ba5f40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7efd48005780 tx=0x7efd48009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af25023e10db20c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:18.134 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd36ff5700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:18.134 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd36ff5700 1 -- 172.21.15.114:0/1884611010 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4801d040 con 0x556b81b9a410 2023-10-18T14:04:18.135 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd36ff5700 1 -- 172.21.15.114:0/1884611010 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efd4800f660 con 0x556b81b9a410 2023-10-18T14:04:18.135 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd6591bb80 1 -- 172.21.15.114:0/1884611010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b81af1e90 con 0x556b81b9a410 2023-10-18T14:04:18.135 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd36ff5700 1 -- 172.21.15.114:0/1884611010 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd4800bb10 con 0x556b81b9a410 2023-10-18T14:04:18.135 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd6591bb80 10 client.15705 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:18.137 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.111+0000 7efd6591bb80 1 -- 172.21.15.114:0/1884611010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556b81917d80 con 0x556b81b9a410 2023-10-18T14:04:18.137 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.112+0000 7efd36ff5700 1 -- 172.21.15.114:0/1884611010 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd4803d020 con 0x556b81b9a410 2023-10-18T14:04:18.137 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.112+0000 7efd36ff5700 1 -- 172.21.15.114:0/1884611010 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efd48039900 con 0x556b81b9a410 2023-10-18T14:04:18.138 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.112+0000 7efd6591bb80 10 client.15705 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:18.138 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.112+0000 7efd6591bb80 10 client.15705 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:18.139 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.112+0000 7efd6591bb80 20 client.15705 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:18.139 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.112+0000 7efd6591bb80 1 --2- 172.21.15.114:0/1884611010 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556b81bb3990 0x556b81bb5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.139 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.112+0000 7efd6591bb80 4 client.15705 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:18.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.112+0000 7efd6591bb80 1 -- 172.21.15.114:0/1884611010 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b81b69850 con 0x556b81bb3990 2023-10-18T14:04:18.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.112+0000 7efd527fc700 1 --2- 172.21.15.114:0/1884611010 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556b81bb3990 0x556b81bb5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd36ff5700 10 client.15705 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:18.141 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd527fc700 1 --2- 172.21.15.114:0/1884611010 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556b81bb3990 0x556b81bb5db0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea911e451073d1b0 server_cookie=6f5acf81a870fa66 in_seq=0 out_seq=0 2023-10-18T14:04:18.141 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd36ff5700 1 -- 172.21.15.114:0/1884611010 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556b81b69850 con 0x556b81bb3990 2023-10-18T14:04:18.141 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd36ff5700 10 client.15705 handle_command_reply: tid=0 2023-10-18T14:04:18.142 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd6591bb80 1 client.15705 shutdown 2023-10-18T14:04:18.142 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd6591bb80 1 -- 172.21.15.114:0/1884611010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9a410 msgr2=0x556b81ba5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:18.143 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd6591bb80 1 --2- 172.21.15.114:0/1884611010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9a410 0x556b81ba5f40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7efd48005780 tx=0x7efd48009310 comp rx=0 tx=0).stop 2023-10-18T14:04:18.143 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd6591bb80 1 -- 172.21.15.114:0/1884611010 shutdown_connections 2023-10-18T14:04:18.143 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd6591bb80 1 --2- 172.21.15.114:0/1884611010 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556b81bb3990 0x556b81bb5db0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.144 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd6591bb80 1 --2- 172.21.15.114:0/1884611010 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9ff50 0x556b81ba39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.144 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd36ff5700 0 client.15705 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:18.144 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd6591bb80 1 --2- 172.21.15.114:0/1884611010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9a410 0x556b81ba5f40 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.145 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd6591bb80 1 --2- 172.21.15.114:0/1884611010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9f630 0x556b81ba32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.145 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd6591bb80 1 -- 172.21.15.114:0/1884611010 >> 172.21.15.114:0/1884611010 conn(0x556b81b0e6c0 msgr2=0x556b81b93d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:18.145 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd6591bb80 1 -- 172.21.15.114:0/1884611010 shutdown_connections 2023-10-18T14:04:18.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.113+0000 7efd6591bb80 1 -- 172.21.15.114:0/1884611010 wait complete. 2023-10-18T14:04:18.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.114+0000 7efd6591bb80 20 client.15705 trim_cache size 0 max 16384 2023-10-18T14:04:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.128+0000 7efd6591bb80 1 Processor -- start 2023-10-18T14:04:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.128+0000 7efd6591bb80 1 -- start start 2023-10-18T14:04:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.128+0000 7efd6591bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 0x556b81baa930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.128+0000 7efd6591bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9f630 0x556b81b944e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.128+0000 7efd6591bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9ff50 0x556b81baf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.128+0000 7efd6591bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b8196d8c0 con 0x556b81b9f630 2023-10-18T14:04:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.128+0000 7efd6591bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b81b95150 con 0x556b81b9ff50 2023-10-18T14:04:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.128+0000 7efd6591bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b81b8d080 con 0x556b81b9a410 2023-10-18T14:04:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.128+0000 7efd527fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9f630 0x556b81b944e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.128+0000 7efd527fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9f630 0x556b81b944e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44370/0 (socket says 172.21.15.114:44370) 2023-10-18T14:04:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.128+0000 7efd527fc700 1 -- 172.21.15.114:0/191721234 learned_addr learned my addr 172.21.15.114:0/191721234 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.128+0000 7efd52ffd700 1 --2- 172.21.15.114:0/191721234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 0x556b81baa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.128+0000 7efd537fe700 1 --2- 172.21.15.114:0/191721234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9ff50 0x556b81baf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd527fc700 1 -- 172.21.15.114:0/191721234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 msgr2=0x556b81baa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd527fc700 1 --2- 172.21.15.114:0/191721234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 0x556b81baa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd527fc700 1 -- 172.21.15.114:0/191721234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9ff50 msgr2=0x556b81baf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:18.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd527fc700 1 --2- 172.21.15.114:0/191721234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9ff50 0x556b81baf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd527fc700 1 -- 172.21.15.114:0/191721234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b81b9aac0 con 0x556b81b9f630 2023-10-18T14:04:18.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd527fc700 1 --2- 172.21.15.114:0/191721234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9f630 0x556b81b944e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efd4400bd10 tx=0x7efd4401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4466988845f173f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:18.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd39ffb700 1 -- 172.21.15.114:0/191721234 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44020050 con 0x556b81b9f630 2023-10-18T14:04:18.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd39ffb700 1 -- 172.21.15.114:0/191721234 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd44021040 con 0x556b81b9f630 2023-10-18T14:04:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd39ffb700 1 -- 172.21.15.114:0/191721234 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44027290 con 0x556b81b9f630 2023-10-18T14:04:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd6591bb80 1 -- 172.21.15.114:0/191721234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9f630 msgr2=0x556b81b944e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd6591bb80 1 --2- 172.21.15.114:0/191721234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9f630 0x556b81b944e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efd4400bd10 tx=0x7efd4401ad80 comp rx=0 tx=0).stop 2023-10-18T14:04:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd6591bb80 1 -- 172.21.15.114:0/191721234 shutdown_connections 2023-10-18T14:04:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd6591bb80 1 --2- 172.21.15.114:0/191721234 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9ff50 0x556b81baf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd6591bb80 1 --2- 172.21.15.114:0/191721234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 0x556b81baa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd6591bb80 1 --2- 172.21.15.114:0/191721234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9f630 0x556b81b944e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd6591bb80 1 -- 172.21.15.114:0/191721234 >> 172.21.15.114:0/191721234 conn(0x556b81b0e6c0 msgr2=0x556b81baf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.129+0000 7efd6591bb80 1 -- 172.21.15.114:0/191721234 shutdown_connections 2023-10-18T14:04:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.130+0000 7efd6591bb80 1 -- 172.21.15.114:0/191721234 wait complete. 2023-10-18T14:04:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.130+0000 7efd6591bb80 1 -- start start 2023-10-18T14:04:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.130+0000 7efd6591bb80 1 Processor -- start 2023-10-18T14:04:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.130+0000 7efd6591bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 0x556b81ba8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.130+0000 7efd6591bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9f630 0x556b81ba9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.130+0000 7efd6591bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 0x556b81c00770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.130+0000 7efd6591bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b81c00d20 con 0x556b81b9ff50 2023-10-18T14:04:18.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.130+0000 7efd6591bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b81c00e90 con 0x556b81b9f630 2023-10-18T14:04:18.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.130+0000 7efd6591bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b81c01050 con 0x556b81b9a410 2023-10-18T14:04:18.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.130+0000 7efd6591bb80 10 client.0 _ll_register_callbacks cb 0x556b819d3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.130+0000 7efd537fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 0x556b81c00770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.130+0000 7efd537fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 0x556b81c00770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44378/0 (socket says 172.21.15.114:44378) 2023-10-18T14:04:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.130+0000 7efd537fe700 1 -- 172.21.15.114:0/21845824 learned_addr learned my addr 172.21.15.114:0/21845824 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd52ffd700 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 0x556b81ba8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd527fc700 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9f630 0x556b81ba9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd537fe700 1 -- 172.21.15.114:0/21845824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 msgr2=0x556b81ba8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd537fe700 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 0x556b81ba8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd537fe700 1 -- 172.21.15.114:0/21845824 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9f630 msgr2=0x556b81ba9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd537fe700 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9f630 0x556b81ba9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd537fe700 1 -- 172.21.15.114:0/21845824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b81aaa390 con 0x556b81b9ff50 2023-10-18T14:04:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd527fc700 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9f630 0x556b81ba9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd537fe700 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 0x556b81c00770 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00c3e0 tx=0x7efd4c099e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465816ba6919502a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd36ff5700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd36ff5700 1 -- 172.21.15.114:0/21845824 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c0a19c0 con 0x556b81b9ff50 2023-10-18T14:04:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd36ff5700 1 -- 172.21.15.114:0/21845824 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7efd4c004dd0 con 0x556b81b9ff50 2023-10-18T14:04:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd6591bb80 1 -- 172.21.15.114:0/21845824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd4400be60 con 0x556b81b9ff50 2023-10-18T14:04:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd36ff5700 1 -- 172.21.15.114:0/21845824 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd4c098bb0 con 0x556b81b9ff50 2023-10-18T14:04:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd6591bb80 10 client.15711 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd6591bb80 1 -- 172.21.15.114:0/21845824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556b81900c00 con 0x556b81b9ff50 2023-10-18T14:04:18.166 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd36ff5700 1 -- 172.21.15.114:0/21845824 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd4c063020 con 0x556b81b9ff50 2023-10-18T14:04:18.166 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd36ff5700 1 -- 172.21.15.114:0/21845824 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efd4c0b7030 con 0x556b81b9ff50 2023-10-18T14:04:18.166 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd6591bb80 10 client.15711 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:18.166 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd6591bb80 10 client.15711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:18.166 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd6591bb80 20 client.15711 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd6591bb80 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556b81c08840 0x556b81c0ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd6591bb80 4 client.15711 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:04:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.131+0000 7efd6591bb80 1 -- 172.21.15.114:0/21845824 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556b81ae5df0 con 0x556b81c08840 2023-10-18T14:04:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.132+0000 7efd52ffd700 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556b81c08840 0x556b81c0ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.132+0000 7efd52ffd700 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556b81c08840 0x556b81c0ac60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b568570ad4b69173 server_cookie=d2e67cb46873d27f in_seq=0 out_seq=0 2023-10-18T14:04:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.132+0000 7efd36ff5700 10 client.15711 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd36ff5700 1 -- 172.21.15.114:0/21845824 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556b81ae5df0 con 0x556b81c08840 2023-10-18T14:04:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd36ff5700 10 client.15711 handle_command_reply: tid=0 2023-10-18T14:04:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd6591bb80 1 client.15711 shutdown 2023-10-18T14:04:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd6591bb80 1 -- 172.21.15.114:0/21845824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 msgr2=0x556b81c00770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd6591bb80 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 0x556b81c00770 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00c3e0 tx=0x7efd4c099e70 comp rx=0 tx=0).stop 2023-10-18T14:04:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd6591bb80 1 -- 172.21.15.114:0/21845824 shutdown_connections 2023-10-18T14:04:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd6591bb80 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556b81c08840 0x556b81c0ac60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd6591bb80 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556b81b9ff50 0x556b81c00770 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd36ff5700 0 client.15711 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd6591bb80 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b81b9a410 0x556b81ba8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd6591bb80 1 --2- 172.21.15.114:0/21845824 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556b81b9f630 0x556b81ba9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd6591bb80 1 -- 172.21.15.114:0/21845824 >> 172.21.15.114:0/21845824 conn(0x556b81b0e6c0 msgr2=0x556b81ba0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd6591bb80 1 -- 172.21.15.114:0/21845824 shutdown_connections 2023-10-18T14:04:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd6591bb80 1 -- 172.21.15.114:0/21845824 wait complete. 2023-10-18T14:04:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.145+0000 7efd6591bb80 20 client.15711 trim_cache size 0 max 16384 2023-10-18T14:04:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:04:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:04:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:04:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:04:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.146+0000 7efd59732700 1 -- 172.21.15.114:0/1348200070 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efd3c0a1560 msgr2=0x7efd3c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.146+0000 7efd59732700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efd3c0a1560 0x7efd3c0a3a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd48006010 tx=0x7efd4801a040 comp rx=0 tx=0).stop 2023-10-18T14:04:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.146+0000 7efd59732700 1 -- 172.21.15.114:0/1348200070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd541045f0 msgr2=0x7efd540fda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.146+0000 7efd59732700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd541045f0 0x7efd540fda10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00ab50 tx=0x7efd4c00af10 comp rx=0 tx=0).stop 2023-10-18T14:04:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.146+0000 7efd59732700 1 -- 172.21.15.114:0/1348200070 shutdown_connections 2023-10-18T14:04:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.146+0000 7efd59732700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7efd3c0a1560 0x7efd3c0a3a20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.146+0000 7efd59732700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd541045f0 0x7efd540fda10 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.146+0000 7efd59732700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efd540ff5d0 0x7efd540fcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.146+0000 7efd59732700 1 --2- 172.21.15.114:0/1348200070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd540fff90 0x7efd540fd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.146+0000 7efd59732700 1 -- 172.21.15.114:0/1348200070 >> 172.21.15.114:0/1348200070 conn(0x7efd540767f0 msgr2=0x7efd54069310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.146+0000 7efd59732700 1 -- 172.21.15.114:0/1348200070 shutdown_connections 2023-10-18T14:04:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:18.146+0000 7efd59732700 1 -- 172.21.15.114:0/1348200070 wait complete. 2023-10-18T14:04:19.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:18 smithi158 ceph-mon[103317]: pgmap v288: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 45 op/s 2023-10-18T14:04:19.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:18 smithi172 ceph-mon[103574]: pgmap v288: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 45 op/s 2023-10-18T14:04:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:18 smithi114 ceph-mon[99494]: pgmap v288: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 45 op/s 2023-10-18T14:04:21.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:20 smithi158 ceph-mon[103317]: pgmap v289: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-10-18T14:04:21.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:20 smithi172 ceph-mon[103574]: pgmap v289: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-10-18T14:04:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:20 smithi114 ceph-mon[99494]: pgmap v289: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-10-18T14:04:23.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:22 smithi158 ceph-mon[103317]: pgmap v290: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2023-10-18T14:04:23.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:22 smithi172 ceph-mon[103574]: pgmap v290: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2023-10-18T14:04:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:22 smithi114 ceph-mon[99494]: pgmap v290: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2023-10-18T14:04:24.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:24 smithi172 ceph-mon[103574]: pgmap v291: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2023-10-18T14:04:24.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:24 smithi114 ceph-mon[99494]: pgmap v291: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2023-10-18T14:04:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:24 smithi158 ceph-mon[103317]: pgmap v291: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2023-10-18T14:04:27.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:26 smithi158 ceph-mon[103317]: pgmap v292: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 15 op/s 2023-10-18T14:04:27.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:26 smithi172 ceph-mon[103574]: pgmap v292: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 15 op/s 2023-10-18T14:04:27.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:26 smithi114 ceph-mon[99494]: pgmap v292: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 15 op/s 2023-10-18T14:04:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:28 smithi158 ceph-mon[103317]: pgmap v293: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2023-10-18T14:04:29.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:28 smithi172 ceph-mon[103574]: pgmap v293: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2023-10-18T14:04:29.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:28 smithi114 ceph-mon[99494]: pgmap v293: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2023-10-18T14:04:31.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:30 smithi158 ceph-mon[103317]: pgmap v294: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2023-10-18T14:04:31.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:30 smithi172 ceph-mon[103574]: pgmap v294: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2023-10-18T14:04:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:30 smithi114 ceph-mon[99494]: pgmap v294: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2023-10-18T14:04:31.269 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.266+0000 7f0d0ee67700 1 -- 172.21.15.114:0/3508157714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d080ff5d0 msgr2=0x7f0d080ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.266+0000 7f0d0ee67700 1 --2- 172.21.15.114:0/3508157714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d080ff5d0 0x7f0d080ffa50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009990 tx=0x7f0cf4009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.266+0000 7f0d0ee67700 1 -- 172.21.15.114:0/3508157714 shutdown_connections 2023-10-18T14:04:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.266+0000 7f0d0ee67700 1 --2- 172.21.15.114:0/3508157714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d080fff90 0x7f0d0810c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.266+0000 7f0d0ee67700 1 --2- 172.21.15.114:0/3508157714 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d081045e0 0x7f0d081049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.266+0000 7f0d0ee67700 1 --2- 172.21.15.114:0/3508157714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d080ff5d0 0x7f0d080ffa50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.266+0000 7f0d0ee67700 1 -- 172.21.15.114:0/3508157714 >> 172.21.15.114:0/3508157714 conn(0x7f0d08076790 msgr2=0x7f0d08076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.266+0000 7f0d0ee67700 1 -- 172.21.15.114:0/3508157714 shutdown_connections 2023-10-18T14:04:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.266+0000 7f0d0ee67700 1 -- 172.21.15.114:0/3508157714 wait complete. 2023-10-18T14:04:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.267+0000 7f0d0ee67700 1 Processor -- start 2023-10-18T14:04:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.267+0000 7f0d0ee67700 1 -- start start 2023-10-18T14:04:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0ee67700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d080ff5d0 0x7f0d0819b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0ee67700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d080fff90 0x7f0d0819bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0ee67700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d081045e0 0x7f0d08195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0ee67700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08195e40 con 0x7f0d081045e0 2023-10-18T14:04:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0ee67700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08195fb0 con 0x7f0d080fff90 2023-10-18T14:04:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0ee67700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08196170 con 0x7f0d080ff5d0 2023-10-18T14:04:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0d404700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d081045e0 0x7f0d08195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0d404700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d081045e0 0x7f0d08195790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44392/0 (socket says 172.21.15.114:44392) 2023-10-18T14:04:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0d404700 1 -- 172.21.15.114:0/3668494940 learned_addr learned my addr 172.21.15.114:0/3668494940 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0cc03700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d080ff5d0 0x7f0d0819b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d07fff700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d080fff90 0x7f0d0819bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0d404700 1 -- 172.21.15.114:0/3668494940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d080ff5d0 msgr2=0x7f0d0819b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0d404700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d080ff5d0 0x7f0d0819b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0d404700 1 -- 172.21.15.114:0/3668494940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d080fff90 msgr2=0x7f0d0819bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:31.277 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0d404700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d080fff90 0x7f0d0819bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.277 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0d404700 1 -- 172.21.15.114:0/3668494940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40095f0 con 0x7f0d081045e0 2023-10-18T14:04:31.277 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0d404700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d081045e0 0x7f0d08195790 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0d00007ee0 tx=0x7f0d0000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:31.277 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d05ffb700 1 -- 172.21.15.114:0/3668494940 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00017070 con 0x7f0d081045e0 2023-10-18T14:04:31.277 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d05ffb700 1 -- 172.21.15.114:0/3668494940 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d0000f040 con 0x7f0d081045e0 2023-10-18T14:04:31.278 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d0ee67700 1 -- 172.21.15.114:0/3668494940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d08196450 con 0x7f0d081045e0 2023-10-18T14:04:31.278 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.268+0000 7f0d05ffb700 1 -- 172.21.15.114:0/3668494940 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00005740 con 0x7f0d081045e0 2023-10-18T14:04:31.278 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.269+0000 7f0d0ee67700 1 -- 172.21.15.114:0/3668494940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d081a2670 con 0x7f0d081045e0 2023-10-18T14:04:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.271+0000 7f0d05ffb700 1 -- 172.21.15.114:0/3668494940 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f0d0000dc60 con 0x7f0d081045e0 2023-10-18T14:04:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.272+0000 7f0d05ffb700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cf80a15e0 0x7f0cf80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.272+0000 7f0d0cc03700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cf80a15e0 0x7f0cf80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.272+0000 7f0d05ffb700 1 -- 172.21.15.114:0/3668494940 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0d000cc730 con 0x7f0d081045e0 2023-10-18T14:04:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.272+0000 7f0d1b050b80 1 Processor -- start 2023-10-18T14:04:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.272+0000 7f0d1b050b80 1 -- start start 2023-10-18T14:04:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d1b050b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5597186429b0 0x559718642d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d1b050b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x55971863e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d1b050b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55971863e870 0x55971863ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d1b050b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597185ad680 con 0x5597186432d0 2023-10-18T14:04:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d1b050b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559718593c00 con 0x5597186429b0 2023-10-18T14:04:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d1b050b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559718591520 con 0x55971863e870 2023-10-18T14:04:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d0cc03700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cf80a15e0 0x7f0cf80a3aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0d08069cf0 tx=0x7f0cfc00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:31.286 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d07fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x55971863e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d07fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x55971863e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44398/0 (socket says 172.21.15.114:44398) 2023-10-18T14:04:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d07fff700 1 -- 172.21.15.114:0/2403152795 learned_addr learned my addr 172.21.15.114:0/2403152795 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d0cc03700 1 --2- 172.21.15.114:0/2403152795 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5597186429b0 0x559718642d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d0d404700 1 --2- 172.21.15.114:0/2403152795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55971863e870 0x55971863ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d07fff700 1 -- 172.21.15.114:0/2403152795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55971863e870 msgr2=0x55971863ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:31.287 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d07fff700 1 --2- 172.21.15.114:0/2403152795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55971863e870 0x55971863ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d07fff700 1 -- 172.21.15.114:0/2403152795 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5597186429b0 msgr2=0x559718642d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d07fff700 1 --2- 172.21.15.114:0/2403152795 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5597186429b0 0x559718642d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d07fff700 1 -- 172.21.15.114:0/2403152795 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55971854a390 con 0x5597186432d0 2023-10-18T14:04:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0d07fff700 1 --2- 172.21.15.114:0/2403152795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x55971863e2e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4006010 tx=0x7f0cf4009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829a64da423f0686 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:31.288 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0cf2ffd700 1 -- 172.21.15.114:0/2403152795 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf401d040 con 0x5597186432d0 2023-10-18T14:04:31.289 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0cf2ffd700 1 -- 172.21.15.114:0/2403152795 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0cf4005070 con 0x5597186432d0 2023-10-18T14:04:31.289 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.273+0000 7f0cf2ffd700 1 -- 172.21.15.114:0/2403152795 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4003990 con 0x5597186432d0 2023-10-18T14:04:31.289 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.274+0000 7f0d1b050b80 1 -- 172.21.15.114:0/2403152795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 msgr2=0x55971863e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:31.289 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.274+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/2403152795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x55971863e2e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4006010 tx=0x7f0cf4009510 comp rx=0 tx=0).stop 2023-10-18T14:04:31.289 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.274+0000 7f0d1b050b80 1 -- 172.21.15.114:0/2403152795 shutdown_connections 2023-10-18T14:04:31.290 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.274+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/2403152795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55971863e870 0x55971863ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.290 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.274+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/2403152795 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5597186429b0 0x559718642d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.290 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.274+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/2403152795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x55971863e2e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.290 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.274+0000 7f0d1b050b80 1 -- 172.21.15.114:0/2403152795 >> 172.21.15.114:0/2403152795 conn(0x5597185ae6c0 msgr2=0x559718634410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:31.290 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.274+0000 7f0d1b050b80 1 -- 172.21.15.114:0/2403152795 shutdown_connections 2023-10-18T14:04:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.274+0000 7f0d1b050b80 1 -- 172.21.15.114:0/2403152795 wait complete. 2023-10-18T14:04:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.274+0000 7f0d1b050b80 1 -- start start 2023-10-18T14:04:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d1b050b80 1 Processor -- start 2023-10-18T14:04:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d1b050b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55971863e870 0x5597186477a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d1b050b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597186429b0 0x559718647ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d1b050b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x559718648220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d1b050b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55971858ce10 con 0x5597186432d0 2023-10-18T14:04:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d1b050b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597185296b0 con 0x55971863e870 2023-10-18T14:04:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d1b050b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559718529350 con 0x5597186429b0 2023-10-18T14:04:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d1b050b80 10 client.0 _ll_register_callbacks cb 0x559718473a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d0d404700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x559718648220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.293 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d0d404700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x559718648220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44406/0 (socket says 172.21.15.114:44406) 2023-10-18T14:04:31.293 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d0d404700 1 -- 172.21.15.114:0/2993197961 learned_addr learned my addr 172.21.15.114:0/2993197961 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:31.293 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d0cc03700 1 --2- 172.21.15.114:0/2993197961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55971863e870 0x5597186477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.293 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d07fff700 1 --2- 172.21.15.114:0/2993197961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597186429b0 0x559718647ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.293 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d0d404700 1 -- 172.21.15.114:0/2993197961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597186429b0 msgr2=0x559718647ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d0d404700 1 --2- 172.21.15.114:0/2993197961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597186429b0 0x559718647ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d0d404700 1 -- 172.21.15.114:0/2993197961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55971863e870 msgr2=0x5597186477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d0d404700 1 --2- 172.21.15.114:0/2993197961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55971863e870 0x5597186477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.275+0000 7f0d0d404700 1 -- 172.21.15.114:0/2993197961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0810cd90 con 0x5597186432d0 2023-10-18T14:04:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0d0d404700 1 --2- 172.21.15.114:0/2993197961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x559718648220 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0d000997e0 tx=0x7f0d000992e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb4e4f7db78dfb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0ce7fff700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0ce7fff700 1 -- 172.21.15.114:0/2993197961 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0009d9a0 con 0x5597186432d0 2023-10-18T14:04:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0ce7fff700 1 -- 172.21.15.114:0/2993197961 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0d000a1be0 con 0x5597186432d0 2023-10-18T14:04:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0d1b050b80 1 -- 172.21.15.114:0/2993197961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559718591e90 con 0x5597186432d0 2023-10-18T14:04:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0ce7fff700 1 -- 172.21.15.114:0/2993197961 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d000840b0 con 0x5597186432d0 2023-10-18T14:04:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0d1b050b80 10 client.15723 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:31.296 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0d1b050b80 1 -- 172.21.15.114:0/2993197961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5597183b7d80 con 0x5597186432d0 2023-10-18T14:04:31.296 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0ce7fff700 1 -- 172.21.15.114:0/2993197961 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559718591e90 con 0x5597186432d0 2023-10-18T14:04:31.296 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0ce7fff700 1 -- 172.21.15.114:0/2993197961 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0d00098d40 con 0x5597186432d0 2023-10-18T14:04:31.296 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0d1b050b80 10 client.15723 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:31.296 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0d1b050b80 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0d1b050b80 20 client.15723 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/2993197961 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559718657e70 0x55971865a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0d1b050b80 4 client.15723 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.276+0000 7f0d1b050b80 1 -- 172.21.15.114:0/2993197961 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559718609850 con 0x559718657e70 2023-10-18T14:04:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.277+0000 7f0d0cc03700 1 --2- 172.21.15.114:0/2993197961 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559718657e70 0x55971865a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.277+0000 7f0d0cc03700 1 --2- 172.21.15.114:0/2993197961 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559718657e70 0x55971865a290 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d96c5418485c4818 server_cookie=de3397b2218da583 in_seq=0 out_seq=0 2023-10-18T14:04:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.277+0000 7f0ce7fff700 10 client.15723 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0ce7fff700 1 -- 172.21.15.114:0/2993197961 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559718609850 con 0x559718657e70 2023-10-18T14:04:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0ce7fff700 10 client.15723 handle_command_reply: tid=0 2023-10-18T14:04:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0d1b050b80 1 client.15723 shutdown 2023-10-18T14:04:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0d1b050b80 1 -- 172.21.15.114:0/2993197961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 msgr2=0x559718648220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/2993197961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x559718648220 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0d000997e0 tx=0x7f0d000992e0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0d1b050b80 1 -- 172.21.15.114:0/2993197961 shutdown_connections 2023-10-18T14:04:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/2993197961 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559718657e70 0x55971865a290 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/2993197961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x559718648220 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/2993197961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55971863e870 0x5597186477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0ce7fff700 0 client.15723 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/2993197961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597186429b0 0x559718647ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0d1b050b80 1 -- 172.21.15.114:0/2993197961 >> 172.21.15.114:0/2993197961 conn(0x5597185ae6c0 msgr2=0x559718641660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0d1b050b80 1 -- 172.21.15.114:0/2993197961 shutdown_connections 2023-10-18T14:04:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0d1b050b80 1 -- 172.21.15.114:0/2993197961 wait complete. 2023-10-18T14:04:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.278+0000 7f0d1b050b80 20 client.15723 trim_cache size 0 max 16384 2023-10-18T14:04:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.292+0000 7f0d1b050b80 1 Processor -- start 2023-10-18T14:04:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.292+0000 7f0d1b050b80 1 -- start start 2023-10-18T14:04:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.292+0000 7f0d1b050b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55971863e870 0x5597186344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.292+0000 7f0d1b050b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186429b0 0x55971864ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.292+0000 7f0d1b050b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5597186432d0 0x55971863e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.292+0000 7f0d1b050b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55971840d8c0 con 0x5597186429b0 2023-10-18T14:04:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.292+0000 7f0d1b050b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559718657c90 con 0x5597186432d0 2023-10-18T14:04:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.292+0000 7f0d1b050b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55971864f2c0 con 0x55971863e870 2023-10-18T14:04:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0d07fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186429b0 0x55971864ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0d07fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186429b0 0x55971864ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44412/0 (socket says 172.21.15.114:44412) 2023-10-18T14:04:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0d07fff700 1 -- 172.21.15.114:0/3061633616 learned_addr learned my addr 172.21.15.114:0/3061633616 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0d0cc03700 1 --2- 172.21.15.114:0/3061633616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55971863e870 0x5597186344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0d0d404700 1 --2- 172.21.15.114:0/3061633616 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5597186432d0 0x55971863e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0d07fff700 1 -- 172.21.15.114:0/3061633616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55971863e870 msgr2=0x5597186344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0d07fff700 1 --2- 172.21.15.114:0/3061633616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55971863e870 0x5597186344e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0d07fff700 1 -- 172.21.15.114:0/3061633616 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5597186432d0 msgr2=0x55971863e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0d07fff700 1 --2- 172.21.15.114:0/3061633616 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5597186432d0 0x55971863e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0d07fff700 1 -- 172.21.15.114:0/3061633616 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597183a0c00 con 0x5597186429b0 2023-10-18T14:04:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0d07fff700 1 --2- 172.21.15.114:0/3061633616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186429b0 0x55971864ed80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009990 tx=0x7f0cf4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64d308eb22bfe86 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0cf37fe700 1 -- 172.21.15.114:0/3061633616 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf401d050 con 0x5597186429b0 2023-10-18T14:04:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0cf37fe700 1 -- 172.21.15.114:0/3061633616 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0cf40051e0 con 0x5597186429b0 2023-10-18T14:04:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.293+0000 7f0cf37fe700 1 -- 172.21.15.114:0/3061633616 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4003a80 con 0x5597186429b0 2023-10-18T14:04:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.294+0000 7f0d1b050b80 1 -- 172.21.15.114:0/3061633616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186429b0 msgr2=0x55971864ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.294+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/3061633616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186429b0 0x55971864ed80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009990 tx=0x7f0cf4000bc0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.294+0000 7f0d1b050b80 1 -- 172.21.15.114:0/3061633616 shutdown_connections 2023-10-18T14:04:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.294+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/3061633616 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5597186432d0 0x55971863e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.294+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/3061633616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55971863e870 0x5597186344e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.294+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/3061633616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186429b0 0x55971864ed80 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.294+0000 7f0d1b050b80 1 -- 172.21.15.114:0/3061633616 >> 172.21.15.114:0/3061633616 conn(0x5597185ae6c0 msgr2=0x55971863d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.294+0000 7f0d1b050b80 1 -- 172.21.15.114:0/3061633616 shutdown_connections 2023-10-18T14:04:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.294+0000 7f0d1b050b80 1 -- 172.21.15.114:0/3061633616 wait complete. 2023-10-18T14:04:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d1b050b80 1 -- start start 2023-10-18T14:04:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d1b050b80 1 Processor -- start 2023-10-18T14:04:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d1b050b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55971863e870 0x55971864e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d1b050b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597186429b0 0x55971864cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d1b050b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x55971864d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d1b050b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55971864d7e0 con 0x5597186432d0 2023-10-18T14:04:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d1b050b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55971864d950 con 0x55971863e870 2023-10-18T14:04:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d1b050b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55971864db10 con 0x5597186429b0 2023-10-18T14:04:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d1b050b80 10 client.0 _ll_register_callbacks cb 0x559718473a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d07fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597186429b0 0x55971864cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d0d404700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x55971864d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d07fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597186429b0 0x55971864cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:48354/0 (socket says 172.21.15.114:48354) 2023-10-18T14:04:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d07fff700 1 -- 172.21.15.114:0/3278659502 learned_addr learned my addr 172.21.15.114:0/3278659502 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.295+0000 7f0d0d404700 1 --2- 172.21.15.114:0/3278659502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x55971864d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44420/0 (socket says 172.21.15.114:44420) 2023-10-18T14:04:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0d0cc03700 1 --2- 172.21.15.114:0/3278659502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55971863e870 0x55971864e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0d0d404700 1 -- 172.21.15.114:0/3278659502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597186429b0 msgr2=0x55971864cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0d0d404700 1 --2- 172.21.15.114:0/3278659502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597186429b0 0x55971864cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0d0d404700 1 -- 172.21.15.114:0/3278659502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55971863e870 msgr2=0x55971864e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0d0d404700 1 --2- 172.21.15.114:0/3278659502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55971863e870 0x55971864e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0d0d404700 1 -- 172.21.15.114:0/3278659502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55971854a390 con 0x5597186432d0 2023-10-18T14:04:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0d0d404700 1 --2- 172.21.15.114:0/3278659502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x55971864d2a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000d7b0 tx=0x7f0d0000d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54061335e5978c65 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0ce7fff700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0ce7fff700 1 -- 172.21.15.114:0/3278659502 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d000842b0 con 0x5597186432d0 2023-10-18T14:04:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0ce7fff700 1 -- 172.21.15.114:0/3278659502 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0d000a1be0 con 0x5597186432d0 2023-10-18T14:04:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0d1b050b80 1 -- 172.21.15.114:0/3278659502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0cf4005070 con 0x5597186432d0 2023-10-18T14:04:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0ce7fff700 1 -- 172.21.15.114:0/3278659502 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d0009d9a0 con 0x5597186432d0 2023-10-18T14:04:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0d1b050b80 10 client.15729 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0d1b050b80 1 -- 172.21.15.114:0/3278659502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5597183de1f0 con 0x5597186432d0 2023-10-18T14:04:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.296+0000 7f0ce7fff700 1 -- 172.21.15.114:0/3278659502 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0cf4005070 con 0x5597186432d0 2023-10-18T14:04:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.297+0000 7f0ce7fff700 1 -- 172.21.15.114:0/3278659502 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0d000a1850 con 0x5597186432d0 2023-10-18T14:04:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.297+0000 7f0d1b050b80 10 client.15729 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.297+0000 7f0d1b050b80 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.297+0000 7f0d1b050b80 20 client.15729 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.297+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/3278659502 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5597186acd00 0x5597186af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.297+0000 7f0d1b050b80 4 client.15729 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:04:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.297+0000 7f0d1b050b80 1 -- 172.21.15.114:0/3278659502 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559718585df0 con 0x5597186acd00 2023-10-18T14:04:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.297+0000 7f0d0cc03700 1 --2- 172.21.15.114:0/3278659502 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5597186acd00 0x5597186af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.297+0000 7f0ce7fff700 10 client.15729 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.297+0000 7f0d0cc03700 1 --2- 172.21.15.114:0/3278659502 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5597186acd00 0x5597186af0f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf8b60fc30ee1028 server_cookie=2fbcf025fb819140 in_seq=0 out_seq=0 2023-10-18T14:04:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.301+0000 7f0ce7fff700 1 -- 172.21.15.114:0/3278659502 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559718585df0 con 0x5597186acd00 2023-10-18T14:04:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.301+0000 7f0ce7fff700 10 client.15729 handle_command_reply: tid=0 2023-10-18T14:04:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.301+0000 7f0d1b050b80 1 client.15729 shutdown 2023-10-18T14:04:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.302+0000 7f0d1b050b80 1 -- 172.21.15.114:0/3278659502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 msgr2=0x55971864d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.302+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/3278659502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x55971864d2a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000d7b0 tx=0x7f0d0000d8e0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.302+0000 7f0d1b050b80 1 -- 172.21.15.114:0/3278659502 shutdown_connections 2023-10-18T14:04:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.302+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/3278659502 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5597186acd00 0x5597186af0f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.302+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/3278659502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5597186432d0 0x55971864d2a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.302+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/3278659502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55971863e870 0x55971864e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.302+0000 7f0d1b050b80 1 --2- 172.21.15.114:0/3278659502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597186429b0 0x55971864cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.302+0000 7f0ce7fff700 0 client.15729 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.302+0000 7f0d1b050b80 1 -- 172.21.15.114:0/3278659502 >> 172.21.15.114:0/3278659502 conn(0x5597185ae6c0 msgr2=0x559718641510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.302+0000 7f0d1b050b80 1 -- 172.21.15.114:0/3278659502 shutdown_connections 2023-10-18T14:04:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.302+0000 7f0d1b050b80 1 -- 172.21.15.114:0/3278659502 wait complete. 2023-10-18T14:04:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.302+0000 7f0d1b050b80 20 client.15729 trim_cache size 0 max 16384 2023-10-18T14:04:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:04:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:04:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:04:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:04:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.303+0000 7f0d0ee67700 1 -- 172.21.15.114:0/3668494940 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cf80a15e0 msgr2=0x7f0cf80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.303+0000 7f0d0ee67700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cf80a15e0 0x7f0cf80a3aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0d08069cf0 tx=0x7f0cfc00b410 comp rx=0 tx=0).stop 2023-10-18T14:04:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.303+0000 7f0d0ee67700 1 -- 172.21.15.114:0/3668494940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d081045e0 msgr2=0x7f0d08195790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.303+0000 7f0d0ee67700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d081045e0 0x7f0d08195790 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0d00007ee0 tx=0x7f0d0000d3b0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.303+0000 7f0d0ee67700 1 -- 172.21.15.114:0/3668494940 shutdown_connections 2023-10-18T14:04:31.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.303+0000 7f0d0ee67700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cf80a15e0 0x7f0cf80a3aa0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.303+0000 7f0d0ee67700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d081045e0 0x7f0d08195790 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.303+0000 7f0d0ee67700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d080ff5d0 0x7f0d0819b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.303+0000 7f0d0ee67700 1 --2- 172.21.15.114:0/3668494940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d080fff90 0x7f0d0819bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.303+0000 7f0d0ee67700 1 -- 172.21.15.114:0/3668494940 >> 172.21.15.114:0/3668494940 conn(0x7f0d08076790 msgr2=0x7f0d080fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.303+0000 7f0d0ee67700 1 -- 172.21.15.114:0/3668494940 shutdown_connections 2023-10-18T14:04:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:31.303+0000 7f0d0ee67700 1 -- 172.21.15.114:0/3668494940 wait complete. 2023-10-18T14:04:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:32 smithi158 ceph-mon[103317]: pgmap v295: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-10-18T14:04:33.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:32 smithi172 ceph-mon[103574]: pgmap v295: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-10-18T14:04:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:32 smithi114 ceph-mon[99494]: pgmap v295: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-10-18T14:04:33.582 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:04:33.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.706+0000 7f414ada0700 1 -- 172.21.15.114:0/1197916190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41440ffea0 msgr2=0x7f414410c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:33.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.706+0000 7f414ada0700 1 --2- 172.21.15.114:0/1197916190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41440ffea0 0x7f414410c360 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f413c00b0d0 tx=0x7f413c00b3e0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.707+0000 7f414ada0700 1 -- 172.21.15.114:0/1197916190 shutdown_connections 2023-10-18T14:04:33.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.707+0000 7f414ada0700 1 --2- 172.21.15.114:0/1197916190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41440ffea0 0x7f414410c360 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.707+0000 7f414ada0700 1 --2- 172.21.15.114:0/1197916190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41441055a0 0x7f4144105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.707+0000 7f414ada0700 1 --2- 172.21.15.114:0/1197916190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41440ff4e0 0x7f41440ff960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.707+0000 7f414ada0700 1 -- 172.21.15.114:0/1197916190 >> 172.21.15.114:0/1197916190 conn(0x7f41440fafb0 msgr2=0x7f41440fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.707+0000 7f414ada0700 1 -- 172.21.15.114:0/1197916190 shutdown_connections 2023-10-18T14:04:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.707+0000 7f414ada0700 1 -- 172.21.15.114:0/1197916190 wait complete. 2023-10-18T14:04:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.707+0000 7f414ada0700 1 Processor -- start 2023-10-18T14:04:33.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.707+0000 7f414ada0700 1 -- start start 2023-10-18T14:04:33.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.707+0000 7f414ada0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41440ff4e0 0x7f414419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.707+0000 7f414ada0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41440ffea0 0x7f414419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f414ada0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41441055a0 0x7f41441968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f414ada0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144197090 con 0x7f41440ff4e0 2023-10-18T14:04:33.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f414ada0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144197200 con 0x7f41441055a0 2023-10-18T14:04:33.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f414ada0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41441973c0 con 0x7f41440ffea0 2023-10-18T14:04:33.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f4149d9e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41440ff4e0 0x7f414419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f4149d9e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41440ff4e0 0x7f414419c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44430/0 (socket says 172.21.15.114:44430) 2023-10-18T14:04:33.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f4149d9e700 1 -- 172.21.15.114:0/2472920674 learned_addr learned my addr 172.21.15.114:0/2472920674 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f414959d700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41440ffea0 0x7f414419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f414a59f700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41441055a0 0x7f41441968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f4149d9e700 1 -- 172.21.15.114:0/2472920674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41440ffea0 msgr2=0x7f414419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f4149d9e700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41440ffea0 0x7f414419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f4149d9e700 1 -- 172.21.15.114:0/2472920674 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41441055a0 msgr2=0x7f41441968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f4149d9e700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41441055a0 0x7f41441968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f4149d9e700 1 -- 172.21.15.114:0/2472920674 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c009d00 con 0x7f41440ff4e0 2023-10-18T14:04:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f4149d9e700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41440ff4e0 0x7f414419c820 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f414000d950 tx=0x7f414000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f413affd700 1 -- 172.21.15.114:0/2472920674 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414000f890 con 0x7f41440ff4e0 2023-10-18T14:04:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f413affd700 1 -- 172.21.15.114:0/2472920674 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4140010460 con 0x7f41440ff4e0 2023-10-18T14:04:33.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f414ada0700 1 -- 172.21.15.114:0/2472920674 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41441976a0 con 0x7f41440ff4e0 2023-10-18T14:04:33.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.708+0000 7f413affd700 1 -- 172.21.15.114:0/2472920674 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414000e610 con 0x7f41440ff4e0 2023-10-18T14:04:33.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.709+0000 7f414ada0700 1 -- 172.21.15.114:0/2472920674 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41441a37a0 con 0x7f41440ff4e0 2023-10-18T14:04:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.711+0000 7f413affd700 1 -- 172.21.15.114:0/2472920674 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f41400108d0 con 0x7f41440ff4e0 2023-10-18T14:04:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.712+0000 7f413affd700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f41300a1560 0x7f41300a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.712+0000 7f414959d700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f41300a1560 0x7f41300a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.712+0000 7f413affd700 1 -- 172.21.15.114:0/2472920674 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f41400ccd20 con 0x7f41440ff4e0 2023-10-18T14:04:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.712+0000 7f41581ebb80 1 Processor -- start 2023-10-18T14:04:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.712+0000 7f414959d700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f41300a1560 0x7f41300a3a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4144198030 tx=0x7f413400a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:33.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.712+0000 7f41581ebb80 1 -- start start 2023-10-18T14:04:33.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f41581ebb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d78bd60 0x55c93d78c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f41581ebb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d7862e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f41581ebb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d786820 0x55c93d786c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f41581ebb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c93d6f96e0 con 0x55c93d78c680 2023-10-18T14:04:33.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f41581ebb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c93d6dfc60 con 0x55c93d786820 2023-10-18T14:04:33.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f41581ebb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c93d6dd580 con 0x55c93d78bd60 2023-10-18T14:04:33.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f414959d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d7862e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f414959d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d7862e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44440/0 (socket says 172.21.15.114:44440) 2023-10-18T14:04:33.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f414959d700 1 -- 172.21.15.114:0/738353008 learned_addr learned my addr 172.21.15.114:0/738353008 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:33.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f4149d9e700 1 --2- 172.21.15.114:0/738353008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d78bd60 0x55c93d78c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f414959d700 1 -- 172.21.15.114:0/738353008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d78bd60 msgr2=0x55c93d78c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:33.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f414a59f700 1 --2- 172.21.15.114:0/738353008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d786820 0x55c93d786c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f414959d700 1 --2- 172.21.15.114:0/738353008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d78bd60 0x55c93d78c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f414959d700 1 -- 172.21.15.114:0/738353008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d786820 msgr2=0x55c93d786c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:33.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f414959d700 1 --2- 172.21.15.114:0/738353008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d786820 0x55c93d786c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f414959d700 1 -- 172.21.15.114:0/738353008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c93d6963f0 con 0x55c93d78c680 2023-10-18T14:04:33.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f414a59f700 1 --2- 172.21.15.114:0/738353008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d786820 0x55c93d786c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:33.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f414959d700 1 --2- 172.21.15.114:0/738353008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d7862e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f413400fd70 tx=0x7f4134012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a5fcee606a922d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:33.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.713+0000 7f412ffff700 1 -- 172.21.15.114:0/738353008 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4134010ac0 con 0x55c93d78c680 2023-10-18T14:04:33.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.714+0000 7f412ffff700 1 -- 172.21.15.114:0/738353008 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4134020070 con 0x55c93d78c680 2023-10-18T14:04:33.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.714+0000 7f412ffff700 1 -- 172.21.15.114:0/738353008 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413401bdf0 con 0x55c93d78c680 2023-10-18T14:04:33.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.714+0000 7f41581ebb80 1 -- 172.21.15.114:0/738353008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 msgr2=0x55c93d7862e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:33.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.714+0000 7f41581ebb80 1 --2- 172.21.15.114:0/738353008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d7862e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f413400fd70 tx=0x7f4134012000 comp rx=0 tx=0).stop 2023-10-18T14:04:33.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.714+0000 7f41581ebb80 1 -- 172.21.15.114:0/738353008 shutdown_connections 2023-10-18T14:04:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.714+0000 7f41581ebb80 1 --2- 172.21.15.114:0/738353008 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d786820 0x55c93d786c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.714+0000 7f41581ebb80 1 --2- 172.21.15.114:0/738353008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d78bd60 0x55c93d78c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.714+0000 7f41581ebb80 1 --2- 172.21.15.114:0/738353008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d7862e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.714+0000 7f41581ebb80 1 -- 172.21.15.114:0/738353008 >> 172.21.15.114:0/738353008 conn(0x55c93d6fa720 msgr2=0x55c93d780cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.714+0000 7f41581ebb80 1 -- 172.21.15.114:0/738353008 shutdown_connections 2023-10-18T14:04:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.714+0000 7f41581ebb80 1 -- 172.21.15.114:0/738353008 wait complete. 2023-10-18T14:04:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.715+0000 7f41581ebb80 1 -- start start 2023-10-18T14:04:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.715+0000 7f41581ebb80 1 Processor -- start 2023-10-18T14:04:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.715+0000 7f41581ebb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d786820 0x55c93d78fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.715+0000 7f41581ebb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78bd60 0x55c93d7900a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.715+0000 7f41581ebb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d78c680 0x55c93d7905e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.715+0000 7f41581ebb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c93d6d8e70 con 0x55c93d78bd60 2023-10-18T14:04:33.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.715+0000 7f41581ebb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c93d675710 con 0x55c93d78c680 2023-10-18T14:04:33.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.715+0000 7f41581ebb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c93d6753b0 con 0x55c93d786820 2023-10-18T14:04:33.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.715+0000 7f41581ebb80 10 client.0 _ll_register_callbacks cb 0x55c93d5bfa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:33.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f414959d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78bd60 0x55c93d7900a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f414959d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78bd60 0x55c93d7900a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44446/0 (socket says 172.21.15.114:44446) 2023-10-18T14:04:33.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f414959d700 1 -- 172.21.15.114:0/3705451555 learned_addr learned my addr 172.21.15.114:0/3705451555 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:33.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f4149d9e700 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d786820 0x55c93d78fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f414a59f700 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d78c680 0x55c93d7905e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f414959d700 1 -- 172.21.15.114:0/3705451555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d786820 msgr2=0x55c93d78fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f414959d700 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d786820 0x55c93d78fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f414959d700 1 -- 172.21.15.114:0/3705451555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d78c680 msgr2=0x55c93d7905e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f414959d700 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d78c680 0x55c93d7905e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f414959d700 1 -- 172.21.15.114:0/3705451555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f413400fa50 con 0x55c93d78bd60 2023-10-18T14:04:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f414a59f700 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d78c680 0x55c93d7905e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f414959d700 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78bd60 0x55c93d7900a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f413401ba30 tx=0x7f413401bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c8ff634ecd2d25 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f412d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f412d7fa700 1 -- 172.21.15.114:0/3705451555 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413402a070 con 0x55c93d78bd60 2023-10-18T14:04:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f41581ebb80 1 -- 172.21.15.114:0/3705451555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c93d6ddef0 con 0x55c93d78bd60 2023-10-18T14:04:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f412d7fa700 1 -- 172.21.15.114:0/3705451555 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f413400fe50 con 0x55c93d78bd60 2023-10-18T14:04:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f412d7fa700 1 -- 172.21.15.114:0/3705451555 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f413401bee0 con 0x55c93d78bd60 2023-10-18T14:04:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f41581ebb80 10 client.15741 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.716+0000 7f41581ebb80 1 -- 172.21.15.114:0/3705451555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c93d503de0 con 0x55c93d78bd60 2023-10-18T14:04:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.717+0000 7f412d7fa700 1 -- 172.21.15.114:0/3705451555 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c93d6ddef0 con 0x55c93d78bd60 2023-10-18T14:04:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.717+0000 7f412d7fa700 1 -- 172.21.15.114:0/3705451555 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f413401c420 con 0x55c93d78bd60 2023-10-18T14:04:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.717+0000 7f41581ebb80 10 client.15741 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.717+0000 7f41581ebb80 10 client.15741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.717+0000 7f41581ebb80 20 client.15741 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.717+0000 7f41581ebb80 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c93d7a00d0 0x55c93d7a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.717+0000 7f41581ebb80 4 client.15741 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:33.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.717+0000 7f41581ebb80 1 -- 172.21.15.114:0/3705451555 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c93d7558b0 con 0x55c93d7a00d0 2023-10-18T14:04:33.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.717+0000 7f4149d9e700 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c93d7a00d0 0x55c93d7a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.718+0000 7f412d7fa700 10 client.15741 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:33.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.718+0000 7f4149d9e700 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c93d7a00d0 0x55c93d7a24f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25adb826c9739893 server_cookie=fa83bf1fd4e6725a in_seq=0 out_seq=0 2023-10-18T14:04:33.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.718+0000 7f412d7fa700 1 -- 172.21.15.114:0/3705451555 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c93d7558b0 con 0x55c93d7a00d0 2023-10-18T14:04:33.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.718+0000 7f412d7fa700 10 client.15741 handle_command_reply: tid=0 2023-10-18T14:04:33.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.718+0000 7f41581ebb80 1 client.15741 shutdown 2023-10-18T14:04:33.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.718+0000 7f41581ebb80 1 -- 172.21.15.114:0/3705451555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78bd60 msgr2=0x55c93d7900a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:33.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.718+0000 7f41581ebb80 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78bd60 0x55c93d7900a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f413401ba30 tx=0x7f413401bcc0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.719+0000 7f41581ebb80 1 -- 172.21.15.114:0/3705451555 shutdown_connections 2023-10-18T14:04:33.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.719+0000 7f41581ebb80 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c93d7a00d0 0x55c93d7a24f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.719+0000 7f41581ebb80 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d78c680 0x55c93d7905e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.719+0000 7f412d7fa700 0 client.15741 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:33.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.719+0000 7f41581ebb80 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d786820 0x55c93d78fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.719+0000 7f41581ebb80 1 --2- 172.21.15.114:0/3705451555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78bd60 0x55c93d7900a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.719+0000 7f41581ebb80 1 -- 172.21.15.114:0/3705451555 >> 172.21.15.114:0/3705451555 conn(0x55c93d6fa720 msgr2=0x55c93d7852d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:33.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.719+0000 7f41581ebb80 1 -- 172.21.15.114:0/3705451555 shutdown_connections 2023-10-18T14:04:33.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.719+0000 7f41581ebb80 1 -- 172.21.15.114:0/3705451555 wait complete. 2023-10-18T14:04:33.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.719+0000 7f41581ebb80 20 client.15741 trim_cache size 0 max 16384 2023-10-18T14:04:33.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.735+0000 7f41581ebb80 1 Processor -- start 2023-10-18T14:04:33.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f41581ebb80 1 -- start start 2023-10-18T14:04:33.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f41581ebb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d786820 0x55c93d7862e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f41581ebb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d78bd60 0x55c93d78ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f41581ebb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d78b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f41581ebb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c93d559920 con 0x55c93d78c680 2023-10-18T14:04:33.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f41581ebb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c93d792e10 con 0x55c93d786820 2023-10-18T14:04:33.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f41581ebb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c93d782580 con 0x55c93d78bd60 2023-10-18T14:04:33.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f414a59f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d78b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f414a59f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d78b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44456/0 (socket says 172.21.15.114:44456) 2023-10-18T14:04:33.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f414a59f700 1 -- 172.21.15.114:0/3779103194 learned_addr learned my addr 172.21.15.114:0/3779103194 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:33.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f414959d700 1 --2- 172.21.15.114:0/3779103194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d78bd60 0x55c93d78ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f4149d9e700 1 --2- 172.21.15.114:0/3779103194 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d786820 0x55c93d7862e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f414a59f700 1 -- 172.21.15.114:0/3779103194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d78bd60 msgr2=0x55c93d78ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:33.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f414a59f700 1 --2- 172.21.15.114:0/3779103194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d78bd60 0x55c93d78ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f414a59f700 1 -- 172.21.15.114:0/3779103194 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d786820 msgr2=0x55c93d7862e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:33.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f414a59f700 1 --2- 172.21.15.114:0/3779103194 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d786820 0x55c93d7862e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f414a59f700 1 -- 172.21.15.114:0/3779103194 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c93d4ecc60 con 0x55c93d78c680 2023-10-18T14:04:33.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f4149d9e700 1 --2- 172.21.15.114:0/3779103194 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d786820 0x55c93d7862e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:33.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.736+0000 7f414a59f700 1 --2- 172.21.15.114:0/3779103194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d78b1b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f413c015000 tx=0x7f413c007c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee468f257ba957e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:33.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.737+0000 7f4138ff9700 1 -- 172.21.15.114:0/3779103194 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c00e040 con 0x55c93d78c680 2023-10-18T14:04:33.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.737+0000 7f4138ff9700 1 -- 172.21.15.114:0/3779103194 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f413c003a00 con 0x55c93d78c680 2023-10-18T14:04:33.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.737+0000 7f4138ff9700 1 -- 172.21.15.114:0/3779103194 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0050c0 con 0x55c93d78c680 2023-10-18T14:04:33.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.737+0000 7f41581ebb80 1 -- 172.21.15.114:0/3779103194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 msgr2=0x55c93d78b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:33.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.737+0000 7f41581ebb80 1 --2- 172.21.15.114:0/3779103194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d78b1b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f413c015000 tx=0x7f413c007c20 comp rx=0 tx=0).stop 2023-10-18T14:04:33.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.737+0000 7f41581ebb80 1 -- 172.21.15.114:0/3779103194 shutdown_connections 2023-10-18T14:04:33.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.737+0000 7f41581ebb80 1 --2- 172.21.15.114:0/3779103194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d78b1b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.737+0000 7f41581ebb80 1 --2- 172.21.15.114:0/3779103194 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d786820 0x55c93d7862e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.737+0000 7f41581ebb80 1 --2- 172.21.15.114:0/3779103194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d78bd60 0x55c93d78ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.737+0000 7f41581ebb80 1 -- 172.21.15.114:0/3779103194 >> 172.21.15.114:0/3779103194 conn(0x55c93d6fa720 msgr2=0x55c93d79b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:33.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.737+0000 7f41581ebb80 1 -- 172.21.15.114:0/3779103194 shutdown_connections 2023-10-18T14:04:33.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.737+0000 7f41581ebb80 1 -- 172.21.15.114:0/3779103194 wait complete. 2023-10-18T14:04:33.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f41581ebb80 1 -- start start 2023-10-18T14:04:33.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f41581ebb80 1 Processor -- start 2023-10-18T14:04:33.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f41581ebb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d786820 0x55c93d797150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f41581ebb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d78bd60 0x55c93d795670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f41581ebb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d795c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f41581ebb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c93d796390 con 0x55c93d78c680 2023-10-18T14:04:33.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f41581ebb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c93d796500 con 0x55c93d78bd60 2023-10-18T14:04:33.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f41581ebb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c93d7edf20 con 0x55c93d786820 2023-10-18T14:04:33.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f41581ebb80 10 client.0 _ll_register_callbacks cb 0x55c93d5bfa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:33.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f414a59f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d795c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f414a59f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d795c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44462/0 (socket says 172.21.15.114:44462) 2023-10-18T14:04:33.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f4149d9e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d786820 0x55c93d797150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f414a59f700 1 -- 172.21.15.114:0/2526663391 learned_addr learned my addr 172.21.15.114:0/2526663391 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:33.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.738+0000 7f414959d700 1 --2- 172.21.15.114:0/2526663391 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d78bd60 0x55c93d795670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f414a59f700 1 -- 172.21.15.114:0/2526663391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d786820 msgr2=0x55c93d797150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:33.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f414a59f700 1 --2- 172.21.15.114:0/2526663391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d786820 0x55c93d797150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f414a59f700 1 -- 172.21.15.114:0/2526663391 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d78bd60 msgr2=0x55c93d795670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:33.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f414a59f700 1 --2- 172.21.15.114:0/2526663391 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d78bd60 0x55c93d795670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f414a59f700 1 -- 172.21.15.114:0/2526663391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414410cc60 con 0x55c93d78c680 2023-10-18T14:04:33.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f414959d700 1 --2- 172.21.15.114:0/2526663391 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d78bd60 0x55c93d795670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:33.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f414a59f700 1 --2- 172.21.15.114:0/2526663391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d795c80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f413c00b820 tx=0x7f413c0076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a97c8f1bf55e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:33.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f412d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:33.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f412d7fa700 1 -- 172.21.15.114:0/2526663391 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c00e070 con 0x55c93d78c680 2023-10-18T14:04:33.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f41581ebb80 1 -- 172.21.15.114:0/2526663391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4134020070 con 0x55c93d78c680 2023-10-18T14:04:33.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f412d7fa700 1 -- 172.21.15.114:0/2526663391 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f413c003de0 con 0x55c93d78c680 2023-10-18T14:04:33.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f412d7fa700 1 -- 172.21.15.114:0/2526663391 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f413c0094e0 con 0x55c93d78c680 2023-10-18T14:04:33.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f41581ebb80 10 client.15747 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:33.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f41581ebb80 1 -- 172.21.15.114:0/2526663391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c93d52a250 con 0x55c93d78c680 2023-10-18T14:04:33.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f412d7fa700 1 -- 172.21.15.114:0/2526663391 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4134020070 con 0x55c93d78c680 2023-10-18T14:04:33.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f412d7fa700 1 -- 172.21.15.114:0/2526663391 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f413c00b100 con 0x55c93d78c680 2023-10-18T14:04:33.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f41581ebb80 10 client.15747 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:33.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f41581ebb80 10 client.15747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:33.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.739+0000 7f41581ebb80 20 client.15747 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:33.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.740+0000 7f41581ebb80 1 --2- 172.21.15.114:0/2526663391 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c93d7a00d0 0x55c93d7ef4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.740+0000 7f41581ebb80 4 client.15747 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:04:33.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.740+0000 7f41581ebb80 1 -- 172.21.15.114:0/2526663391 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c93d6d1e50 con 0x55c93d7a00d0 2023-10-18T14:04:33.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.740+0000 7f4149d9e700 1 --2- 172.21.15.114:0/2526663391 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c93d7a00d0 0x55c93d7ef4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.740+0000 7f412d7fa700 10 client.15747 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:33.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.740+0000 7f4149d9e700 1 --2- 172.21.15.114:0/2526663391 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c93d7a00d0 0x55c93d7ef4b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89b686abb5af08e0 server_cookie=cf3302c57f2d429d in_seq=0 out_seq=0 2023-10-18T14:04:33.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.740+0000 7f412d7fa700 1 -- 172.21.15.114:0/2526663391 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c93d6d1e50 con 0x55c93d7a00d0 2023-10-18T14:04:33.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.740+0000 7f412d7fa700 10 client.15747 handle_command_reply: tid=0 2023-10-18T14:04:33.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.740+0000 7f41581ebb80 1 client.15747 shutdown 2023-10-18T14:04:33.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.740+0000 7f41581ebb80 1 -- 172.21.15.114:0/2526663391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 msgr2=0x55c93d795c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:33.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.740+0000 7f41581ebb80 1 --2- 172.21.15.114:0/2526663391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d795c80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f413c00b820 tx=0x7f413c0076d0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.740+0000 7f41581ebb80 1 -- 172.21.15.114:0/2526663391 shutdown_connections 2023-10-18T14:04:33.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.740+0000 7f41581ebb80 1 --2- 172.21.15.114:0/2526663391 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c93d7a00d0 0x55c93d7ef4b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f41581ebb80 1 --2- 172.21.15.114:0/2526663391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c93d78c680 0x55c93d795c80 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f412d7fa700 0 client.15747 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:33.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f41581ebb80 1 --2- 172.21.15.114:0/2526663391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93d786820 0x55c93d797150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f41581ebb80 1 --2- 172.21.15.114:0/2526663391 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c93d78bd60 0x55c93d795670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f41581ebb80 1 -- 172.21.15.114:0/2526663391 >> 172.21.15.114:0/2526663391 conn(0x55c93d6fa720 msgr2=0x55c93d78ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:33.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f41581ebb80 1 -- 172.21.15.114:0/2526663391 shutdown_connections 2023-10-18T14:04:33.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f41581ebb80 1 -- 172.21.15.114:0/2526663391 wait complete. 2023-10-18T14:04:33.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f41581ebb80 20 client.15747 trim_cache size 0 max 16384 2023-10-18T14:04:33.766 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:04:33.766 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "no active scrubs running", 2023-10-18T14:04:33.766 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": {} 2023-10-18T14:04:33.766 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:04:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f414ada0700 1 -- 172.21.15.114:0/2472920674 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f41300a1560 msgr2=0x7f41300a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f414ada0700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f41300a1560 0x7f41300a3a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4144198030 tx=0x7f413400a300 comp rx=0 tx=0).stop 2023-10-18T14:04:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f414ada0700 1 -- 172.21.15.114:0/2472920674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41440ff4e0 msgr2=0x7f414419c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f414ada0700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41440ff4e0 0x7f414419c820 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f414000d950 tx=0x7f414000dc60 comp rx=0 tx=0).stop 2023-10-18T14:04:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f414ada0700 1 -- 172.21.15.114:0/2472920674 shutdown_connections 2023-10-18T14:04:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f414ada0700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f41300a1560 0x7f41300a3a20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f414ada0700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f41441055a0 0x7f41441968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f414ada0700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41440ff4e0 0x7f414419c820 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f414ada0700 1 --2- 172.21.15.114:0/2472920674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41440ffea0 0x7f414419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f414ada0700 1 -- 172.21.15.114:0/2472920674 >> 172.21.15.114:0/2472920674 conn(0x7f41440fafb0 msgr2=0x7f41440fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f414ada0700 1 -- 172.21.15.114:0/2472920674 shutdown_connections 2023-10-18T14:04:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.741+0000 7f414ada0700 1 -- 172.21.15.114:0/2472920674 wait complete. 2023-10-18T14:04:33.770 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-18T14:04:33.770 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:04:33.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.891+0000 7f0c70474700 1 -- 172.21.15.114:0/3954971239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c68106720 msgr2=0x7f0c68106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:33.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.891+0000 7f0c70474700 1 --2- 172.21.15.114:0/3954971239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c68106720 0x7f0c68106b00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009990 tx=0x7f0c64009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.891+0000 7f0c70474700 1 -- 172.21.15.114:0/3954971239 shutdown_connections 2023-10-18T14:04:33.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.891+0000 7f0c70474700 1 --2- 172.21.15.114:0/3954971239 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c680ff5a0 0x7f0c6810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.891+0000 7f0c70474700 1 --2- 172.21.15.114:0/3954971239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c68106720 0x7f0c68106b00 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.891+0000 7f0c70474700 1 --2- 172.21.15.114:0/3954971239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c680fec00 0x7f0c680ff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.891+0000 7f0c70474700 1 -- 172.21.15.114:0/3954971239 >> 172.21.15.114:0/3954971239 conn(0x7f0c68075b90 msgr2=0x7f0c680fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:33.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.891+0000 7f0c70474700 1 -- 172.21.15.114:0/3954971239 shutdown_connections 2023-10-18T14:04:33.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.891+0000 7f0c70474700 1 -- 172.21.15.114:0/3954971239 wait complete. 2023-10-18T14:04:33.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.892+0000 7f0c70474700 1 Processor -- start 2023-10-18T14:04:33.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.892+0000 7f0c70474700 1 -- start start 2023-10-18T14:04:33.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.892+0000 7f0c70474700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c680fec00 0x7f0c680ffde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.892+0000 7f0c70474700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c680ff5a0 0x7f0c68100320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.892+0000 7f0c70474700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c68106720 0x7f0c68100860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.892+0000 7f0c70474700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c681a4f60 con 0x7f0c680fec00 2023-10-18T14:04:33.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.892+0000 7f0c70474700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c681a50d0 con 0x7f0c680ff5a0 2023-10-18T14:04:33.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.892+0000 7f0c70474700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c681a5290 con 0x7f0c68106720 2023-10-18T14:04:33.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.892+0000 7f0c6e210700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c680fec00 0x7f0c680ffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.892+0000 7f0c6e210700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c680fec00 0x7f0c680ffde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44470/0 (socket says 172.21.15.114:44470) 2023-10-18T14:04:33.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.892+0000 7f0c6e210700 1 -- 172.21.15.114:0/3972867593 learned_addr learned my addr 172.21.15.114:0/3972867593 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:33.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.892+0000 7f0c6ea11700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c68106720 0x7f0c68100860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.893+0000 7f0c6da0f700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c680ff5a0 0x7f0c68100320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.893+0000 7f0c6e210700 1 -- 172.21.15.114:0/3972867593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c68106720 msgr2=0x7f0c68100860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:33.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.893+0000 7f0c6e210700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c68106720 0x7f0c68100860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.893+0000 7f0c6e210700 1 -- 172.21.15.114:0/3972867593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c680ff5a0 msgr2=0x7f0c68100320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:33.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.893+0000 7f0c6e210700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c680ff5a0 0x7f0c68100320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:33.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.893+0000 7f0c6e210700 1 -- 172.21.15.114:0/3972867593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c640095f0 con 0x7f0c680fec00 2023-10-18T14:04:33.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.893+0000 7f0c6da0f700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c680ff5a0 0x7f0c68100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:33.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.893+0000 7f0c6e210700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c680fec00 0x7f0c680ffde0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0c64000c00 tx=0x7f0c64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:33.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.893+0000 7f0c5f7fe700 1 -- 172.21.15.114:0/3972867593 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6401d070 con 0x7f0c680fec00 2023-10-18T14:04:33.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.893+0000 7f0c70474700 1 -- 172.21.15.114:0/3972867593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c681a5510 con 0x7f0c680fec00 2023-10-18T14:04:33.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.893+0000 7f0c5f7fe700 1 -- 172.21.15.114:0/3972867593 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c64022470 con 0x7f0c680fec00 2023-10-18T14:04:33.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.893+0000 7f0c5f7fe700 1 -- 172.21.15.114:0/3972867593 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c64017650 con 0x7f0c680fec00 2023-10-18T14:04:33.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.893+0000 7f0c70474700 1 -- 172.21.15.114:0/3972867593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c681a5930 con 0x7f0c680fec00 2023-10-18T14:04:33.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.894+0000 7f0c70474700 1 -- 172.21.15.114:0/3972867593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c68108cc0 con 0x7f0c680fec00 2023-10-18T14:04:33.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.895+0000 7f0c5f7fe700 1 -- 172.21.15.114:0/3972867593 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f0c640225e0 con 0x7f0c680fec00 2023-10-18T14:04:33.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.896+0000 7f0c5f7fe700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0c540a1560 0x7f0c540a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:33.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.896+0000 7f0c6da0f700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0c540a1560 0x7f0c540a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:33.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.896+0000 7f0c5f7fe700 1 -- 172.21.15.114:0/3972867593 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0c640ce810 con 0x7f0c680fec00 2023-10-18T14:04:33.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.896+0000 7f0c6da0f700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0c540a1560 0x7f0c540a3a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0c68101510 tx=0x7f0c58009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:33.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:33.904+0000 7f0c5f7fe700 1 -- 172.21.15.114:0/3972867593 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0c64097e20 con 0x7f0c680fec00 2023-10-18T14:04:34.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.159+0000 7f0c70474700 1 -- 172.21.15.114:0/3972867593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c68066ca0 con 0x7f0c680fec00 2023-10-18T14:04:34.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.159+0000 7f0c5f7fe700 1 -- 172.21.15.114:0/3972867593 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11390 (secure 0 0 0) 0x7f0c6409b440 con 0x7f0c680fec00 2023-10-18T14:04:34.163 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:04:34.163 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:02:39.260198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:04:34.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.162+0000 7f0c70474700 1 -- 172.21.15.114:0/3972867593 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0c540a1560 msgr2=0x7f0c540a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.162+0000 7f0c70474700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0c540a1560 0x7f0c540a3a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0c68101510 tx=0x7f0c58009260 comp rx=0 tx=0).stop 2023-10-18T14:04:34.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.162+0000 7f0c70474700 1 -- 172.21.15.114:0/3972867593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c680fec00 msgr2=0x7f0c680ffde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.162+0000 7f0c70474700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c680fec00 0x7f0c680ffde0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0c64000c00 tx=0x7f0c64004730 comp rx=0 tx=0).stop 2023-10-18T14:04:34.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.162+0000 7f0c70474700 1 -- 172.21.15.114:0/3972867593 shutdown_connections 2023-10-18T14:04:34.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.162+0000 7f0c70474700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0c540a1560 0x7f0c540a3a20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.162+0000 7f0c70474700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c68106720 0x7f0c68100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.162+0000 7f0c70474700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c680fec00 0x7f0c680ffde0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.162+0000 7f0c70474700 1 --2- 172.21.15.114:0/3972867593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0c680ff5a0 0x7f0c68100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.162+0000 7f0c70474700 1 -- 172.21.15.114:0/3972867593 >> 172.21.15.114:0/3972867593 conn(0x7f0c68075b90 msgr2=0x7f0c68103740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.162+0000 7f0c70474700 1 -- 172.21.15.114:0/3972867593 shutdown_connections 2023-10-18T14:04:34.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.162+0000 7f0c70474700 1 -- 172.21.15.114:0/3972867593 wait complete. 2023-10-18T14:04:34.167 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2023-10-18T14:04:34.177 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-18T14:04:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.300+0000 7f47bf81a700 1 -- 172.21.15.114:0/2630352533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b8105170 msgr2=0x7f47b81055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.301+0000 7f47bf81a700 1 --2- 172.21.15.114:0/2630352533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b8105170 0x7f47b81055f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f47a80099c0 tx=0x7f47a8009cd0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.301+0000 7f47bf81a700 1 -- 172.21.15.114:0/2630352533 shutdown_connections 2023-10-18T14:04:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.301+0000 7f47bf81a700 1 --2- 172.21.15.114:0/2630352533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47b8105b30 0x7f47b810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.301+0000 7f47bf81a700 1 --2- 172.21.15.114:0/2630352533 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f47b8067d40 0x7f47b8068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.301+0000 7f47bf81a700 1 --2- 172.21.15.114:0/2630352533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b8105170 0x7f47b81055f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.301+0000 7f47bf81a700 1 -- 172.21.15.114:0/2630352533 >> 172.21.15.114:0/2630352533 conn(0x7f47b80767f0 msgr2=0x7f47b8076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.301+0000 7f47bf81a700 1 -- 172.21.15.114:0/2630352533 shutdown_connections 2023-10-18T14:04:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.301+0000 7f47bf81a700 1 -- 172.21.15.114:0/2630352533 wait complete. 2023-10-18T14:04:34.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.301+0000 7f47bf81a700 1 Processor -- start 2023-10-18T14:04:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.301+0000 7f47bf81a700 1 -- start start 2023-10-18T14:04:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bf81a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f47b8067d40 0x7f47b80ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bf81a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47b8105170 0x7f47b80ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bf81a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b8105b30 0x7f47b8100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bf81a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b81a4f50 con 0x7f47b8105b30 2023-10-18T14:04:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bf81a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b81a50c0 con 0x7f47b8067d40 2023-10-18T14:04:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bf81a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b81a5280 con 0x7f47b8105170 2023-10-18T14:04:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bddb7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b8105b30 0x7f47b8100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bddb7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b8105b30 0x7f47b8100130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44488/0 (socket says 172.21.15.114:44488) 2023-10-18T14:04:34.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bddb7700 1 -- 172.21.15.114:0/346959232 learned_addr learned my addr 172.21.15.114:0/346959232 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bd5b6700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f47b8067d40 0x7f47b80ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bcdb5700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47b8105170 0x7f47b80ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bddb7700 1 -- 172.21.15.114:0/346959232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47b8105170 msgr2=0x7f47b80ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bddb7700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47b8105170 0x7f47b80ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bddb7700 1 -- 172.21.15.114:0/346959232 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f47b8067d40 msgr2=0x7f47b80ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bddb7700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f47b8067d40 0x7f47b80ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bddb7700 1 -- 172.21.15.114:0/346959232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a80095f0 con 0x7f47b8105b30 2023-10-18T14:04:34.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bddb7700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b8105b30 0x7f47b8100130 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f47b0007f10 tx=0x7f47b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47ae7fc700 1 -- 172.21.15.114:0/346959232 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0009ea0 con 0x7f47b8105b30 2023-10-18T14:04:34.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bf81a700 1 -- 172.21.15.114:0/346959232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b81a5560 con 0x7f47b8105b30 2023-10-18T14:04:34.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47ae7fc700 1 -- 172.21.15.114:0/346959232 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47b000f040 con 0x7f47b8105b30 2023-10-18T14:04:34.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47ae7fc700 1 -- 172.21.15.114:0/346959232 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0004760 con 0x7f47b8105b30 2023-10-18T14:04:34.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.302+0000 7f47bf81a700 1 -- 172.21.15.114:0/346959232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b81a5a40 con 0x7f47b8105b30 2023-10-18T14:04:34.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.305+0000 7f47ae7fc700 1 -- 172.21.15.114:0/346959232 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f47b0003a00 con 0x7f47b8105b30 2023-10-18T14:04:34.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.306+0000 7f47cba03b80 1 Processor -- start 2023-10-18T14:04:34.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.306+0000 7f47cba03b80 1 -- start start 2023-10-18T14:04:34.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.306+0000 7f47ae7fc700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47a40a1560 0x7f47a40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.306+0000 7f47cba03b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eabe0 0x55b6808eafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.306+0000 7f47cba03b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eb500 0x55b6808e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.306+0000 7f47cba03b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 0x55b6808e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.306+0000 7f47cba03b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6808586e0 con 0x55b6808eabe0 2023-10-18T14:04:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.306+0000 7f47bcdb5700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47a40a1560 0x7f47a40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.306+0000 7f47cba03b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68083ec60 con 0x55b6808e55d0 2023-10-18T14:04:34.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.306+0000 7f47cba03b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68083c580 con 0x55b6808eb500 2023-10-18T14:04:34.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.306+0000 7f47ae7fc700 1 -- 172.21.15.114:0/346959232 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f47b00cc670 con 0x7f47b8105b30 2023-10-18T14:04:34.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47bd5b6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eabe0 0x55b6808eafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47bd5b6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eabe0 0x55b6808eafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44492/0 (socket says 172.21.15.114:44492) 2023-10-18T14:04:34.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47bd5b6700 1 -- 172.21.15.114:0/2850683635 learned_addr learned my addr 172.21.15.114:0/2850683635 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47bddb7700 1 --2- 172.21.15.114:0/2850683635 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 0x55b6808e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47bd5b6700 1 -- 172.21.15.114:0/2850683635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eb500 msgr2=0x55b6808e5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47bd5b6700 1 --2- 172.21.15.114:0/2850683635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eb500 0x55b6808e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47bd5b6700 1 -- 172.21.15.114:0/2850683635 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 msgr2=0x55b6808e5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47bd5b6700 1 --2- 172.21.15.114:0/2850683635 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 0x55b6808e5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47bd5b6700 1 -- 172.21.15.114:0/2850683635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6807f53f0 con 0x55b6808eabe0 2023-10-18T14:04:34.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47bcdb5700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47a40a1560 0x7f47a40a3a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009fd0 tx=0x7f47a8005270 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47bd5b6700 1 --2- 172.21.15.114:0/2850683635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eabe0 0x55b6808eafc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009d80 tx=0x7f47b4011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e883ccf7a7ffa6ae server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47a37fe700 1 -- 172.21.15.114:0/2850683635 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4004230 con 0x55b6808eabe0 2023-10-18T14:04:34.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47a37fe700 1 -- 172.21.15.114:0/2850683635 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47b4004390 con 0x55b6808eabe0 2023-10-18T14:04:34.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.307+0000 7f47a37fe700 1 -- 172.21.15.114:0/2850683635 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4019880 con 0x55b6808eabe0 2023-10-18T14:04:34.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.308+0000 7f47cba03b80 1 -- 172.21.15.114:0/2850683635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eabe0 msgr2=0x55b6808eafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.308+0000 7f47cba03b80 1 --2- 172.21.15.114:0/2850683635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eabe0 0x55b6808eafc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009d80 tx=0x7f47b4011720 comp rx=0 tx=0).stop 2023-10-18T14:04:34.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.308+0000 7f47cba03b80 1 -- 172.21.15.114:0/2850683635 shutdown_connections 2023-10-18T14:04:34.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.308+0000 7f47cba03b80 1 --2- 172.21.15.114:0/2850683635 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 0x55b6808e5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.308+0000 7f47cba03b80 1 --2- 172.21.15.114:0/2850683635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eabe0 0x55b6808eafc0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.308+0000 7f47cba03b80 1 --2- 172.21.15.114:0/2850683635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eb500 0x55b6808e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.308+0000 7f47cba03b80 1 -- 172.21.15.114:0/2850683635 >> 172.21.15.114:0/2850683635 conn(0x55b680859720 msgr2=0x55b6808dfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.308+0000 7f47cba03b80 1 -- 172.21.15.114:0/2850683635 shutdown_connections 2023-10-18T14:04:34.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.308+0000 7f47cba03b80 1 -- 172.21.15.114:0/2850683635 wait complete. 2023-10-18T14:04:34.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.308+0000 7f47cba03b80 1 -- start start 2023-10-18T14:04:34.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47cba03b80 1 Processor -- start 2023-10-18T14:04:34.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47cba03b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 0x55b6808f1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47cba03b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eabe0 0x55b6808ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47cba03b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808eeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47cba03b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b680837e70 con 0x55b6808eb500 2023-10-18T14:04:34.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47cba03b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6807d4710 con 0x55b6808e55d0 2023-10-18T14:04:34.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47cba03b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6807d43b0 con 0x55b6808eabe0 2023-10-18T14:04:34.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47cba03b80 10 client.0 _ll_register_callbacks cb 0x55b68071ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:34.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47bddb7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808eeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47bddb7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808eeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44502/0 (socket says 172.21.15.114:44502) 2023-10-18T14:04:34.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47bddb7700 1 -- 172.21.15.114:0/1026201284 learned_addr learned my addr 172.21.15.114:0/1026201284 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47bcdb5700 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eabe0 0x55b6808ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47bd5b6700 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 0x55b6808f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47bddb7700 1 -- 172.21.15.114:0/1026201284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eabe0 msgr2=0x55b6808ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47bddb7700 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eabe0 0x55b6808ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47bddb7700 1 -- 172.21.15.114:0/1026201284 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 msgr2=0x55b6808f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47bddb7700 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 0x55b6808f1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47bddb7700 1 -- 172.21.15.114:0/1026201284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b40099e0 con 0x55b6808eb500 2023-10-18T14:04:34.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47bcdb5700 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eabe0 0x55b6808ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:34.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47bddb7700 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808eeea0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f47b0099720 tx=0x7f47b0099220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999a496c5a2e27f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.309+0000 7f47a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:34.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47a0ff9700 1 -- 172.21.15.114:0/1026201284 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0095ad0 con 0x55b6808eb500 2023-10-18T14:04:34.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47a0ff9700 1 -- 172.21.15.114:0/1026201284 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f47b009d8e0 con 0x55b6808eb500 2023-10-18T14:04:34.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47cba03b80 1 -- 172.21.15.114:0/1026201284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b68083cef0 con 0x55b6808eb500 2023-10-18T14:04:34.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47a0ff9700 1 -- 172.21.15.114:0/1026201284 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47b00a1b20 con 0x55b6808eb500 2023-10-18T14:04:34.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47cba03b80 10 client.15765 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:34.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47cba03b80 1 -- 172.21.15.114:0/1026201284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b680662de0 con 0x55b6808eb500 2023-10-18T14:04:34.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47a0ff9700 1 -- 172.21.15.114:0/1026201284 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b68083cef0 con 0x55b6808eb500 2023-10-18T14:04:34.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47a0ff9700 1 -- 172.21.15.114:0/1026201284 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f47b00b4070 con 0x55b6808eb500 2023-10-18T14:04:34.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47cba03b80 10 client.15765 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:34.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47cba03b80 10 client.15765 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-18T14:04:34.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47cba03b80 20 client.15765 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:34.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47cba03b80 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55b6808feec0 0x55b6809012e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47cba03b80 4 client.15765 mds_command: new command op to 14820 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:34.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47cba03b80 1 -- 172.21.15.114:0/1026201284 --> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6808b48b0 con 0x55b6808feec0 2023-10-18T14:04:34.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.310+0000 7f47bd5b6700 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55b6808feec0 0x55b6809012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.311+0000 7f47a0ff9700 10 client.15765 ms_handle_connect on v2:172.21.15.114:6840/2423071224 2023-10-18T14:04:34.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.311+0000 7f47bd5b6700 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55b6808feec0 0x55b6809012e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3dfe3e9d05893345 server_cookie=1af3b4fe0010a8b8 in_seq=0 out_seq=0 2023-10-18T14:04:34.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.311+0000 7f47a0ff9700 1 -- 172.21.15.114:0/1026201284 <== mds.4 v2:172.21.15.114:6840/2423071224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b6808b48b0 con 0x55b6808feec0 2023-10-18T14:04:34.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.311+0000 7f47a0ff9700 10 client.15765 handle_command_reply: tid=0 2023-10-18T14:04:34.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.311+0000 7f47cba03b80 1 client.15765 shutdown 2023-10-18T14:04:34.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.311+0000 7f47cba03b80 1 -- 172.21.15.114:0/1026201284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 msgr2=0x55b6808eeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.311+0000 7f47cba03b80 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808eeea0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f47b0099720 tx=0x7f47b0099220 comp rx=0 tx=0).stop 2023-10-18T14:04:34.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.312+0000 7f47cba03b80 1 -- 172.21.15.114:0/1026201284 shutdown_connections 2023-10-18T14:04:34.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.312+0000 7f47cba03b80 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55b6808feec0 0x55b6809012e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.312+0000 7f47cba03b80 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808eeea0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.312+0000 7f47a0ff9700 0 client.15765 ms_handle_reset on v2:172.21.15.114:6840/2423071224 2023-10-18T14:04:34.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.312+0000 7f47cba03b80 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 0x55b6808f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.312+0000 7f47cba03b80 1 --2- 172.21.15.114:0/1026201284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eabe0 0x55b6808ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.312+0000 7f47cba03b80 1 -- 172.21.15.114:0/1026201284 >> 172.21.15.114:0/1026201284 conn(0x55b680859720 msgr2=0x55b6808e4080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.312+0000 7f47cba03b80 1 -- 172.21.15.114:0/1026201284 shutdown_connections 2023-10-18T14:04:34.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.312+0000 7f47cba03b80 1 -- 172.21.15.114:0/1026201284 wait complete. 2023-10-18T14:04:34.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.312+0000 7f47cba03b80 20 client.15765 trim_cache size 0 max 16384 2023-10-18T14:04:34.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47cba03b80 1 Processor -- start 2023-10-18T14:04:34.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47cba03b80 1 -- start start 2023-10-18T14:04:34.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47cba03b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808e55d0 0x55b6808f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47cba03b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808eabe0 0x55b6808e86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47cba03b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808e8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47cba03b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6806b8920 con 0x55b6808eb500 2023-10-18T14:04:34.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47cba03b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6808b48b0 con 0x55b6808eabe0 2023-10-18T14:04:34.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47cba03b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68083cef0 con 0x55b6808e55d0 2023-10-18T14:04:34.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47bddb7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808e8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47bddb7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808e8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44510/0 (socket says 172.21.15.114:44510) 2023-10-18T14:04:34.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47bddb7700 1 -- 172.21.15.114:0/2840189190 learned_addr learned my addr 172.21.15.114:0/2840189190 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47bcdb5700 1 --2- 172.21.15.114:0/2840189190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808eabe0 0x55b6808e86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47bd5b6700 1 --2- 172.21.15.114:0/2840189190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808e55d0 0x55b6808f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47bddb7700 1 -- 172.21.15.114:0/2840189190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808e55d0 msgr2=0x55b6808f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47bddb7700 1 --2- 172.21.15.114:0/2840189190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808e55d0 0x55b6808f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47bddb7700 1 -- 172.21.15.114:0/2840189190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808eabe0 msgr2=0x55b6808e86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47bddb7700 1 --2- 172.21.15.114:0/2840189190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808eabe0 0x55b6808e86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47bddb7700 1 -- 172.21.15.114:0/2840189190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b68064bc60 con 0x55b6808eb500 2023-10-18T14:04:34.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.325+0000 7f47bcdb5700 1 --2- 172.21.15.114:0/2840189190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808eabe0 0x55b6808e86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:34.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.326+0000 7f47bddb7700 1 --2- 172.21.15.114:0/2840189190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808e8bf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f47b0004b80 tx=0x7f47b0097d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd54b94f15551579 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.326+0000 7f47a3fff700 1 -- 172.21.15.114:0/2840189190 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0095ad0 con 0x55b6808eb500 2023-10-18T14:04:34.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.326+0000 7f47a3fff700 1 -- 172.21.15.114:0/2840189190 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47b0004bd0 con 0x55b6808eb500 2023-10-18T14:04:34.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.326+0000 7f47a3fff700 1 -- 172.21.15.114:0/2840189190 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000de20 con 0x55b6808eb500 2023-10-18T14:04:34.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.326+0000 7f47cba03b80 1 -- 172.21.15.114:0/2840189190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 msgr2=0x55b6808e8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.326+0000 7f47cba03b80 1 --2- 172.21.15.114:0/2840189190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808e8bf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f47b0004b80 tx=0x7f47b0097d40 comp rx=0 tx=0).stop 2023-10-18T14:04:34.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.326+0000 7f47cba03b80 1 -- 172.21.15.114:0/2840189190 shutdown_connections 2023-10-18T14:04:34.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.326+0000 7f47cba03b80 1 --2- 172.21.15.114:0/2840189190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808e8bf0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.326+0000 7f47cba03b80 1 --2- 172.21.15.114:0/2840189190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808e55d0 0x55b6808f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.326+0000 7f47cba03b80 1 --2- 172.21.15.114:0/2840189190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808eabe0 0x55b6808e86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.326+0000 7f47cba03b80 1 -- 172.21.15.114:0/2840189190 >> 172.21.15.114:0/2840189190 conn(0x55b680859720 msgr2=0x55b6808ed070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47cba03b80 1 -- 172.21.15.114:0/2840189190 shutdown_connections 2023-10-18T14:04:34.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47cba03b80 1 -- 172.21.15.114:0/2840189190 wait complete. 2023-10-18T14:04:34.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47cba03b80 1 -- start start 2023-10-18T14:04:34.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47cba03b80 1 Processor -- start 2023-10-18T14:04:34.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47cba03b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 0x55b6808f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47cba03b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eabe0 0x55b6808f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47cba03b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808f4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47cba03b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6808f4e50 con 0x55b6808eb500 2023-10-18T14:04:34.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47cba03b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6808f4fc0 con 0x55b6808e55d0 2023-10-18T14:04:34.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47cba03b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6808f5180 con 0x55b6808eabe0 2023-10-18T14:04:34.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47cba03b80 10 client.0 _ll_register_callbacks cb 0x55b68071ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:34.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47bddb7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808f4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47bddb7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808f4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44516/0 (socket says 172.21.15.114:44516) 2023-10-18T14:04:34.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.327+0000 7f47bddb7700 1 -- 172.21.15.114:0/1620997832 learned_addr learned my addr 172.21.15.114:0/1620997832 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47bcdb5700 1 --2- 172.21.15.114:0/1620997832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eabe0 0x55b6808f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47bd5b6700 1 --2- 172.21.15.114:0/1620997832 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 0x55b6808f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47bddb7700 1 -- 172.21.15.114:0/1620997832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eabe0 msgr2=0x55b6808f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47bddb7700 1 --2- 172.21.15.114:0/1620997832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eabe0 0x55b6808f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47bddb7700 1 -- 172.21.15.114:0/1620997832 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 msgr2=0x55b6808f5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47bddb7700 1 --2- 172.21.15.114:0/1620997832 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 0x55b6808f5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47bddb7700 1 -- 172.21.15.114:0/1620997832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b680662de0 con 0x55b6808eb500 2023-10-18T14:04:34.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47bddb7700 1 --2- 172.21.15.114:0/1620997832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808f4800 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f47b0099720 tx=0x7f47b0099910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7945ea9fd5e52d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:34.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47a0ff9700 1 -- 172.21.15.114:0/1620997832 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0095ad0 con 0x55b6808eb500 2023-10-18T14:04:34.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47cba03b80 1 -- 172.21.15.114:0/1620997832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47b4004390 con 0x55b6808eb500 2023-10-18T14:04:34.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47a0ff9700 1 -- 172.21.15.114:0/1620997832 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f47b000de20 con 0x55b6808eb500 2023-10-18T14:04:34.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47a0ff9700 1 -- 172.21.15.114:0/1620997832 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47b00a1b20 con 0x55b6808eb500 2023-10-18T14:04:34.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47cba03b80 10 client.15771 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:34.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47cba03b80 1 -- 172.21.15.114:0/1620997832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b680689250 con 0x55b6808eb500 2023-10-18T14:04:34.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.328+0000 7f47a0ff9700 1 -- 172.21.15.114:0/1620997832 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47b4004390 con 0x55b6808eb500 2023-10-18T14:04:34.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47a0ff9700 1 -- 172.21.15.114:0/1620997832 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f47b00b4030 con 0x55b6808eb500 2023-10-18T14:04:34.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47cba03b80 10 client.15771 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:34.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47cba03b80 10 client.15771 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-18T14:04:34.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47cba03b80 20 client.15771 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:34.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47cba03b80 1 --2- 172.21.15.114:0/1620997832 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55b680953e70 0x55b680956260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47cba03b80 4 client.15771 mds_command: new command op to 14820 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:04:34.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47cba03b80 1 -- 172.21.15.114:0/1620997832 --> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b680830e50 con 0x55b680953e70 2023-10-18T14:04:34.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47bd5b6700 1 --2- 172.21.15.114:0/1620997832 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55b680953e70 0x55b680956260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47a0ff9700 10 client.15771 ms_handle_connect on v2:172.21.15.114:6840/2423071224 2023-10-18T14:04:34.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47bd5b6700 1 --2- 172.21.15.114:0/1620997832 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55b680953e70 0x55b680956260 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=33e16e87daba43d4 server_cookie=7c7a5e47999fe0be in_seq=0 out_seq=0 2023-10-18T14:04:34.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47a0ff9700 1 -- 172.21.15.114:0/1620997832 <== mds.4 v2:172.21.15.114:6840/2423071224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b680830e50 con 0x55b680953e70 2023-10-18T14:04:34.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47a0ff9700 10 client.15771 handle_command_reply: tid=0 2023-10-18T14:04:34.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47cba03b80 1 client.15771 shutdown 2023-10-18T14:04:34.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47cba03b80 1 -- 172.21.15.114:0/1620997832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 msgr2=0x55b6808f4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.329+0000 7f47cba03b80 1 --2- 172.21.15.114:0/1620997832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808f4800 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f47b0099720 tx=0x7f47b0099910 comp rx=0 tx=0).stop 2023-10-18T14:04:34.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47cba03b80 1 -- 172.21.15.114:0/1620997832 shutdown_connections 2023-10-18T14:04:34.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47cba03b80 1 --2- 172.21.15.114:0/1620997832 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55b680953e70 0x55b680956260 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47cba03b80 1 --2- 172.21.15.114:0/1620997832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6808eb500 0x55b6808f4800 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47cba03b80 1 --2- 172.21.15.114:0/1620997832 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b6808e55d0 0x55b6808f5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47cba03b80 1 --2- 172.21.15.114:0/1620997832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6808eabe0 0x55b6808f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47cba03b80 1 -- 172.21.15.114:0/1620997832 >> 172.21.15.114:0/1620997832 conn(0x55b680859720 msgr2=0x55b6808d94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47a0ff9700 0 client.15771 ms_handle_reset on v2:172.21.15.114:6840/2423071224 2023-10-18T14:04:34.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47cba03b80 1 -- 172.21.15.114:0/1620997832 shutdown_connections 2023-10-18T14:04:34.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47cba03b80 1 -- 172.21.15.114:0/1620997832 wait complete. 2023-10-18T14:04:34.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47cba03b80 20 client.15771 trim_cache size 0 max 16384 2023-10-18T14:04:34.361 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:04:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47bf81a700 1 -- 172.21.15.114:0/346959232 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47a40a1560 msgr2=0x7f47a40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47bf81a700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47a40a1560 0x7f47a40a3a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009fd0 tx=0x7f47a8005270 comp rx=0 tx=0).stop 2023-10-18T14:04:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47bf81a700 1 -- 172.21.15.114:0/346959232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b8105b30 msgr2=0x7f47b8100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47bf81a700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b8105b30 0x7f47b8100130 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f47b0007f10 tx=0x7f47b000d3b0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47bf81a700 1 -- 172.21.15.114:0/346959232 shutdown_connections 2023-10-18T14:04:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47bf81a700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47a40a1560 0x7f47a40a3a20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47bf81a700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b8105b30 0x7f47b8100130 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47bf81a700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f47b8067d40 0x7f47b80ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47bf81a700 1 --2- 172.21.15.114:0/346959232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47b8105170 0x7f47b80ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47bf81a700 1 -- 172.21.15.114:0/346959232 >> 172.21.15.114:0/346959232 conn(0x7f47b80767f0 msgr2=0x7f47b80fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47bf81a700 1 -- 172.21.15.114:0/346959232 shutdown_connections 2023-10-18T14:04:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.330+0000 7f47bf81a700 1 -- 172.21.15.114:0/346959232 wait complete. 2023-10-18T14:04:34.366 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-18T14:04:34.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.490+0000 7f44fa18a700 1 -- 172.21.15.114:0/788753080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f4100000 msgr2=0x7f44f410c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.490+0000 7f44fa18a700 1 --2- 172.21.15.114:0/788753080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f4100000 0x7f44f410c4a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00b0a0 tx=0x7f44ec00b3b0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.490+0000 7f44fa18a700 1 -- 172.21.15.114:0/788753080 shutdown_connections 2023-10-18T14:04:34.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.490+0000 7f44fa18a700 1 --2- 172.21.15.114:0/788753080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f4100000 0x7f44f410c4a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.490+0000 7f44fa18a700 1 --2- 172.21.15.114:0/788753080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44f41056e0 0x7f44f4105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.490+0000 7f44fa18a700 1 --2- 172.21.15.114:0/788753080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44f40ff640 0x7f44f40ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.490+0000 7f44fa18a700 1 -- 172.21.15.114:0/788753080 >> 172.21.15.114:0/788753080 conn(0x7f44f40767f0 msgr2=0x7f44f4076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.491+0000 7f44fa18a700 1 -- 172.21.15.114:0/788753080 shutdown_connections 2023-10-18T14:04:34.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.491+0000 7f44fa18a700 1 -- 172.21.15.114:0/788753080 wait complete. 2023-10-18T14:04:34.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.491+0000 7f44fa18a700 1 Processor -- start 2023-10-18T14:04:34.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.491+0000 7f44fa18a700 1 -- start start 2023-10-18T14:04:34.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44fa18a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44f40ff640 0x7f44f419b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44fa18a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44f4100000 0x7f44f419bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44fa18a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f41056e0 0x7f44f4195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44fa18a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f4195f80 con 0x7f44f41056e0 2023-10-18T14:04:34.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44fa18a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f41960f0 con 0x7f44f4100000 2023-10-18T14:04:34.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44fa18a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f41962b0 con 0x7f44f40ff640 2023-10-18T14:04:34.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f41056e0 0x7f44f4195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f41056e0 0x7f44f4195920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44528/0 (socket says 172.21.15.114:44528) 2023-10-18T14:04:34.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f3fff700 1 -- 172.21.15.114:0/3796973400 learned_addr learned my addr 172.21.15.114:0/3796973400 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f37fe700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44f40ff640 0x7f44f419b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44f4100000 0x7f44f419bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f3fff700 1 -- 172.21.15.114:0/3796973400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44f40ff640 msgr2=0x7f44f419b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f3fff700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44f40ff640 0x7f44f419b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f3fff700 1 -- 172.21.15.114:0/3796973400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44f4100000 msgr2=0x7f44f419bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f3fff700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44f4100000 0x7f44f419bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f3fff700 1 -- 172.21.15.114:0/3796973400 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec009d00 con 0x7f44f41056e0 2023-10-18T14:04:34.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44f4100000 0x7f44f419bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:34.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f37fe700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44f40ff640 0x7f44f419b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:34.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f3fff700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f41056e0 0x7f44f4195920 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00b830 tx=0x7f44ec007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f0ff9700 1 -- 172.21.15.114:0/3796973400 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec00e040 con 0x7f44f41056e0 2023-10-18T14:04:34.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44fa18a700 1 -- 172.21.15.114:0/3796973400 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f4196530 con 0x7f44f41056e0 2023-10-18T14:04:34.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f0ff9700 1 -- 172.21.15.114:0/3796973400 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44ec004e60 con 0x7f44f41056e0 2023-10-18T14:04:34.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44f0ff9700 1 -- 172.21.15.114:0/3796973400 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec0053c0 con 0x7f44f41056e0 2023-10-18T14:04:34.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.492+0000 7f44fa18a700 1 -- 172.21.15.114:0/3796973400 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f41a2790 con 0x7f44f41056e0 2023-10-18T14:04:34.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.494+0000 7f44f0ff9700 1 -- 172.21.15.114:0/3796973400 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f44ec005520 con 0x7f44f41056e0 2023-10-18T14:04:34.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.495+0000 7f44f0ff9700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f44dc0a1560 0x7f44dc0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.495+0000 7f44f0ff9700 1 -- 172.21.15.114:0/3796973400 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f44ec0cea90 con 0x7f44f41056e0 2023-10-18T14:04:34.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.495+0000 7f44f37fe700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f44dc0a1560 0x7f44dc0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.495+0000 7f44f37fe700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f44dc0a1560 0x7f44dc0a3a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f44e4005fd0 tx=0x7f44e400a5e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.496+0000 7f4506373b80 1 Processor -- start 2023-10-18T14:04:34.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.496+0000 7f4506373b80 1 -- start start 2023-10-18T14:04:34.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.496+0000 7f4506373b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2490 0x55bed8df2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.496+0000 7f4506373b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 0x55bed8df69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.496+0000 7f4506373b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df6f00 0x55bed8df7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.496+0000 7f4506373b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed8d636e0 con 0x55bed8df2db0 2023-10-18T14:04:34.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.496+0000 7f4506373b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed8d49c60 con 0x55bed8df2490 2023-10-18T14:04:34.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.496+0000 7f4506373b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed8d47580 con 0x55bed8df6f00 2023-10-18T14:04:34.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.496+0000 7f44f2ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 0x55bed8df69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.496+0000 7f44f2ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 0x55bed8df69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44534/0 (socket says 172.21.15.114:44534) 2023-10-18T14:04:34.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.496+0000 7f44f2ffd700 1 -- 172.21.15.114:0/2077024227 learned_addr learned my addr 172.21.15.114:0/2077024227 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.497+0000 7f44f37fe700 1 --2- 172.21.15.114:0/2077024227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2490 0x55bed8df2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.497+0000 7f44f3fff700 1 --2- 172.21.15.114:0/2077024227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df6f00 0x55bed8df7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.497+0000 7f44f2ffd700 1 -- 172.21.15.114:0/2077024227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df6f00 msgr2=0x55bed8df7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.497+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/2077024227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df6f00 0x55bed8df7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.497+0000 7f44f2ffd700 1 -- 172.21.15.114:0/2077024227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2490 msgr2=0x55bed8df2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.497+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/2077024227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2490 0x55bed8df2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.497+0000 7f44f2ffd700 1 -- 172.21.15.114:0/2077024227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bed8d003f0 con 0x55bed8df2db0 2023-10-18T14:04:34.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.497+0000 7f44f37fe700 1 --2- 172.21.15.114:0/2077024227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2490 0x55bed8df2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:34.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.497+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/2077024227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 0x55bed8df69c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f44e800bc80 tx=0x7f44e800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9f24bdffd39ba server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.497+0000 7f44d9ffb700 1 -- 172.21.15.114:0/2077024227 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e800de10 con 0x55bed8df2db0 2023-10-18T14:04:34.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.497+0000 7f44d9ffb700 1 -- 172.21.15.114:0/2077024227 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44e80178e0 con 0x55bed8df2db0 2023-10-18T14:04:34.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.497+0000 7f44d9ffb700 1 -- 172.21.15.114:0/2077024227 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e800fa30 con 0x55bed8df2db0 2023-10-18T14:04:34.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.498+0000 7f4506373b80 1 -- 172.21.15.114:0/2077024227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 msgr2=0x55bed8df69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.498+0000 7f4506373b80 1 --2- 172.21.15.114:0/2077024227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 0x55bed8df69c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f44e800bc80 tx=0x7f44e800bf90 comp rx=0 tx=0).stop 2023-10-18T14:04:34.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.498+0000 7f4506373b80 1 -- 172.21.15.114:0/2077024227 shutdown_connections 2023-10-18T14:04:34.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.498+0000 7f4506373b80 1 --2- 172.21.15.114:0/2077024227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df6f00 0x55bed8df7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.498+0000 7f4506373b80 1 --2- 172.21.15.114:0/2077024227 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2490 0x55bed8df2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.498+0000 7f4506373b80 1 --2- 172.21.15.114:0/2077024227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 0x55bed8df69c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.498+0000 7f4506373b80 1 -- 172.21.15.114:0/2077024227 >> 172.21.15.114:0/2077024227 conn(0x55bed8d64720 msgr2=0x55bed8deab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.498+0000 7f4506373b80 1 -- 172.21.15.114:0/2077024227 shutdown_connections 2023-10-18T14:04:34.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.498+0000 7f4506373b80 1 -- 172.21.15.114:0/2077024227 wait complete. 2023-10-18T14:04:34.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.498+0000 7f4506373b80 1 -- start start 2023-10-18T14:04:34.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.498+0000 7f4506373b80 1 Processor -- start 2023-10-18T14:04:34.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f4506373b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df2490 0x55bed8dfe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f4506373b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2db0 0x55bed8dfba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f4506373b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df6f00 0x55bed8dfc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f4506373b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed8d42e70 con 0x55bed8df6f00 2023-10-18T14:04:34.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f4506373b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed8cdf710 con 0x55bed8df2db0 2023-10-18T14:04:34.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f4506373b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed8cdf3b0 con 0x55bed8df2490 2023-10-18T14:04:34.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f4506373b80 10 client.0 _ll_register_callbacks cb 0x55bed8c29a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:34.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f44f2ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2db0 0x55bed8dfba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f44f2ffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2db0 0x55bed8dfba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:40684/0 (socket says 172.21.15.114:40684) 2023-10-18T14:04:34.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f44f2ffd700 1 -- 172.21.15.114:0/1488574699 learned_addr learned my addr 172.21.15.114:0/1488574699 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f44f37fe700 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df2490 0x55bed8dfe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f44f3fff700 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df6f00 0x55bed8dfc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f44f2ffd700 1 -- 172.21.15.114:0/1488574699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df2490 msgr2=0x55bed8dfe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df2490 0x55bed8dfe6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f44f2ffd700 1 -- 172.21.15.114:0/1488574699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df6f00 msgr2=0x55bed8dfc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df6f00 0x55bed8dfc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f44f2ffd700 1 -- 172.21.15.114:0/1488574699 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e800b8b0 con 0x55bed8df2db0 2023-10-18T14:04:34.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.499+0000 7f44f3fff700 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df6f00 0x55bed8dfc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:04:34.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.500+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2db0 0x55bed8dfba30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f44e800f610 tx=0x7f44e8017420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=700e51d5b805a366 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.500+0000 7f44d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:04:34.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.500+0000 7f44d2ffd700 1 -- 172.21.15.114:0/1488574699 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e8017710 con 0x55bed8df2db0 2023-10-18T14:04:34.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.500+0000 7f4506373b80 1 -- 172.21.15.114:0/1488574699 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bed8d47ef0 con 0x55bed8df2db0 2023-10-18T14:04:34.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.500+0000 7f44d2ffd700 1 -- 172.21.15.114:0/1488574699 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f44e8013070 con 0x55bed8df2db0 2023-10-18T14:04:34.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.500+0000 7f44d2ffd700 1 -- 172.21.15.114:0/1488574699 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44e8017c60 con 0x55bed8df2db0 2023-10-18T14:04:34.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.500+0000 7f4506373b80 10 client.25088 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:34.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.500+0000 7f4506373b80 1 -- 172.21.15.114:0/1488574699 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bed8b6dde0 con 0x55bed8df2db0 2023-10-18T14:04:34.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.500+0000 7f44d2ffd700 1 -- 172.21.15.114:0/1488574699 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bed8d47ef0 con 0x55bed8df2db0 2023-10-18T14:04:34.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.500+0000 7f44d2ffd700 1 -- 172.21.15.114:0/1488574699 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f44e801f070 con 0x55bed8df2db0 2023-10-18T14:04:34.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.500+0000 7f4506373b80 10 client.25088 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:34.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.500+0000 7f4506373b80 10 client.25088 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.b 2023-10-18T14:04:34.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.501+0000 7f4506373b80 20 client.25088 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:34.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.501+0000 7f4506373b80 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55bed8e0bfc0 0x55bed8e0e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.501+0000 7f4506373b80 4 client.25088 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:34.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.501+0000 7f4506373b80 1 -- 172.21.15.114:0/1488574699 --> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bed8dbf8b0 con 0x55bed8e0bfc0 2023-10-18T14:04:34.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.501+0000 7f44f37fe700 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55bed8e0bfc0 0x55bed8e0e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.501+0000 7f44d2ffd700 10 client.25088 ms_handle_connect on v2:172.21.15.158:6838/2616400572 2023-10-18T14:04:34.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.501+0000 7f44f37fe700 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55bed8e0bfc0 0x55bed8e0e3e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=61d4583a7088db5b server_cookie=94605c74332cbaeb in_seq=0 out_seq=0 2023-10-18T14:04:34.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f44d2ffd700 1 -- 172.21.15.114:0/1488574699 <== mds.3 v2:172.21.15.158:6838/2616400572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bed8dbf8b0 con 0x55bed8e0bfc0 2023-10-18T14:04:34.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f44d2ffd700 10 client.25088 handle_command_reply: tid=0 2023-10-18T14:04:34.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f4506373b80 1 client.25088 shutdown 2023-10-18T14:04:34.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f4506373b80 1 -- 172.21.15.114:0/1488574699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2db0 msgr2=0x55bed8dfba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f4506373b80 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2db0 0x55bed8dfba30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f44e800f610 tx=0x7f44e8017420 comp rx=0 tx=0).stop 2023-10-18T14:04:34.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f4506373b80 1 -- 172.21.15.114:0/1488574699 shutdown_connections 2023-10-18T14:04:34.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f4506373b80 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55bed8e0bfc0 0x55bed8e0e3e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f4506373b80 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df6f00 0x55bed8dfc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f4506373b80 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df2490 0x55bed8dfe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f4506373b80 1 --2- 172.21.15.114:0/1488574699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2db0 0x55bed8dfba30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f44d2ffd700 0 client.25088 ms_handle_reset on v2:172.21.15.158:6838/2616400572 2023-10-18T14:04:34.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f4506373b80 1 -- 172.21.15.114:0/1488574699 >> 172.21.15.114:0/1488574699 conn(0x55bed8d64720 msgr2=0x55bed8def080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f4506373b80 1 -- 172.21.15.114:0/1488574699 shutdown_connections 2023-10-18T14:04:34.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f4506373b80 1 -- 172.21.15.114:0/1488574699 wait complete. 2023-10-18T14:04:34.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.502+0000 7f4506373b80 20 client.25088 trim_cache size 0 max 16384 2023-10-18T14:04:34.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.518+0000 7f4506373b80 1 Processor -- start 2023-10-18T14:04:34.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.518+0000 7f4506373b80 1 -- start start 2023-10-18T14:04:34.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.518+0000 7f4506373b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2490 0x55bed8de55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.518+0000 7f4506373b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 0x55bed8dfb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.518+0000 7f4506373b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df6f00 0x55bed8e030c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.518+0000 7f4506373b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed8bc3920 con 0x55bed8df2db0 2023-10-18T14:04:34.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.518+0000 7f4506373b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed8dfb830 con 0x55bed8df2490 2023-10-18T14:04:34.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.518+0000 7f4506373b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed8e03630 con 0x55bed8df6f00 2023-10-18T14:04:34.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.518+0000 7f44f2ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 0x55bed8dfb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.518+0000 7f44f2ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 0x55bed8dfb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44548/0 (socket says 172.21.15.114:44548) 2023-10-18T14:04:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.518+0000 7f44f2ffd700 1 -- 172.21.15.114:0/3302956482 learned_addr learned my addr 172.21.15.114:0/3302956482 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.518+0000 7f44f3fff700 1 --2- 172.21.15.114:0/3302956482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df6f00 0x55bed8e030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.519+0000 7f44f37fe700 1 --2- 172.21.15.114:0/3302956482 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2490 0x55bed8de55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.519+0000 7f44f2ffd700 1 -- 172.21.15.114:0/3302956482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df6f00 msgr2=0x55bed8e030c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.519+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/3302956482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df6f00 0x55bed8e030c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.519+0000 7f44f2ffd700 1 -- 172.21.15.114:0/3302956482 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2490 msgr2=0x55bed8de55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.519+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/3302956482 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2490 0x55bed8de55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.519+0000 7f44f2ffd700 1 -- 172.21.15.114:0/3302956482 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bed8b56c60 con 0x55bed8df2db0 2023-10-18T14:04:34.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.519+0000 7f44f37fe700 1 --2- 172.21.15.114:0/3302956482 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2490 0x55bed8de55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:34.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.519+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/3302956482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 0x55bed8dfb2c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f44e800b5d0 tx=0x7f44e800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15feda4fc59778a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.519+0000 7f44da7fc700 1 -- 172.21.15.114:0/3302956482 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e8017490 con 0x55bed8df2db0 2023-10-18T14:04:34.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.519+0000 7f44da7fc700 1 -- 172.21.15.114:0/3302956482 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44e8017710 con 0x55bed8df2db0 2023-10-18T14:04:34.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.519+0000 7f44da7fc700 1 -- 172.21.15.114:0/3302956482 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e800fe20 con 0x55bed8df2db0 2023-10-18T14:04:34.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.520+0000 7f4506373b80 1 -- 172.21.15.114:0/3302956482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 msgr2=0x55bed8dfb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.520+0000 7f4506373b80 1 --2- 172.21.15.114:0/3302956482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 0x55bed8dfb2c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f44e800b5d0 tx=0x7f44e800bf90 comp rx=0 tx=0).stop 2023-10-18T14:04:34.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.520+0000 7f4506373b80 1 -- 172.21.15.114:0/3302956482 shutdown_connections 2023-10-18T14:04:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.520+0000 7f4506373b80 1 --2- 172.21.15.114:0/3302956482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df6f00 0x55bed8e030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.520+0000 7f4506373b80 1 --2- 172.21.15.114:0/3302956482 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df2490 0x55bed8de55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.520+0000 7f4506373b80 1 --2- 172.21.15.114:0/3302956482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2db0 0x55bed8dfb2c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.520+0000 7f4506373b80 1 -- 172.21.15.114:0/3302956482 >> 172.21.15.114:0/3302956482 conn(0x55bed8d64720 msgr2=0x55bed8e12d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.520+0000 7f4506373b80 1 -- 172.21.15.114:0/3302956482 shutdown_connections 2023-10-18T14:04:34.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.520+0000 7f4506373b80 1 -- 172.21.15.114:0/3302956482 wait complete. 2023-10-18T14:04:34.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.520+0000 7f4506373b80 1 -- start start 2023-10-18T14:04:34.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f4506373b80 1 Processor -- start 2023-10-18T14:04:34.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f4506373b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2490 0x55bed8e010a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f4506373b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df2db0 0x55bed8e015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f4506373b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df6f00 0x55bed8e5edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f4506373b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed8e01ef0 con 0x55bed8df2490 2023-10-18T14:04:34.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f4506373b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed8e5f330 con 0x55bed8df6f00 2023-10-18T14:04:34.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f4506373b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed8e5f470 con 0x55bed8df2db0 2023-10-18T14:04:34.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f4506373b80 10 client.0 _ll_register_callbacks cb 0x55bed8c29a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:34.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f44f37fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2490 0x55bed8e010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f44f37fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2490 0x55bed8e010a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44552/0 (socket says 172.21.15.114:44552) 2023-10-18T14:04:34.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f44f37fe700 1 -- 172.21.15.114:0/952846310 learned_addr learned my addr 172.21.15.114:0/952846310 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f44f3fff700 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df6f00 0x55bed8e5edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df2db0 0x55bed8e015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f44f37fe700 1 -- 172.21.15.114:0/952846310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df2db0 msgr2=0x55bed8e015e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f44f37fe700 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df2db0 0x55bed8e015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f44f37fe700 1 -- 172.21.15.114:0/952846310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df6f00 msgr2=0x55bed8e5edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f44f37fe700 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df6f00 0x55bed8e5edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f44f37fe700 1 -- 172.21.15.114:0/952846310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bed8b6dde0 con 0x55bed8df2490 2023-10-18T14:04:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.521+0000 7f44f3fff700 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df6f00 0x55bed8e5edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f44f37fe700 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2490 0x55bed8e010a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f44e4013040 tx=0x7f44e40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85df24b7e24cd867 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f44d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f44d2ffd700 1 -- 172.21.15.114:0/952846310 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4024050 con 0x55bed8df2490 2023-10-18T14:04:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f44d2ffd700 1 -- 172.21.15.114:0/952846310 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f44e4026430 con 0x55bed8df2490 2023-10-18T14:04:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f4506373b80 1 -- 172.21.15.114:0/952846310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44e80178e0 con 0x55bed8df2490 2023-10-18T14:04:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f44d2ffd700 1 -- 172.21.15.114:0/952846310 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44e4026810 con 0x55bed8df2490 2023-10-18T14:04:34.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f4506373b80 10 client.15789 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:34.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f4506373b80 1 -- 172.21.15.114:0/952846310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bed8b94250 con 0x55bed8df2490 2023-10-18T14:04:34.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f44d2ffd700 1 -- 172.21.15.114:0/952846310 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44e80178e0 con 0x55bed8df2490 2023-10-18T14:04:34.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f44d2ffd700 1 -- 172.21.15.114:0/952846310 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f44e402fb10 con 0x55bed8df2490 2023-10-18T14:04:34.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f4506373b80 10 client.15789 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:34.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f4506373b80 10 client.15789 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.b 2023-10-18T14:04:34.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f4506373b80 20 client.15789 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:34.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f4506373b80 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55bed8e60bd0 0x55bed8e62ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f4506373b80 4 client.15789 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:04:34.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.522+0000 7f4506373b80 1 -- 172.21.15.114:0/952846310 --> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bed8d3be50 con 0x55bed8e60bd0 2023-10-18T14:04:34.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.523+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55bed8e60bd0 0x55bed8e62ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.523+0000 7f44d2ffd700 10 client.15789 ms_handle_connect on v2:172.21.15.158:6838/2616400572 2023-10-18T14:04:34.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.523+0000 7f44f2ffd700 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55bed8e60bd0 0x55bed8e62ff0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d4a21b9a6aff74c2 server_cookie=8db4312fab43e320 in_seq=0 out_seq=0 2023-10-18T14:04:34.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.523+0000 7f44d2ffd700 1 -- 172.21.15.114:0/952846310 <== mds.3 v2:172.21.15.158:6838/2616400572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bed8d3be50 con 0x55bed8e60bd0 2023-10-18T14:04:34.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.523+0000 7f44d2ffd700 10 client.15789 handle_command_reply: tid=0 2023-10-18T14:04:34.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.523+0000 7f4506373b80 1 client.15789 shutdown 2023-10-18T14:04:34.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.523+0000 7f4506373b80 1 -- 172.21.15.114:0/952846310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2490 msgr2=0x55bed8e010a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.523+0000 7f4506373b80 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2490 0x55bed8e010a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f44e4013040 tx=0x7f44e40047c0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.523+0000 7f4506373b80 1 -- 172.21.15.114:0/952846310 shutdown_connections 2023-10-18T14:04:34.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.523+0000 7f4506373b80 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55bed8e60bd0 0x55bed8e62ff0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f4506373b80 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bed8df6f00 0x55bed8e5edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f44d2ffd700 0 client.15789 ms_handle_reset on v2:172.21.15.158:6838/2616400572 2023-10-18T14:04:34.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f4506373b80 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bed8df2490 0x55bed8e010a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f4506373b80 1 --2- 172.21.15.114:0/952846310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bed8df2db0 0x55bed8e015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f4506373b80 1 -- 172.21.15.114:0/952846310 >> 172.21.15.114:0/952846310 conn(0x55bed8d64720 msgr2=0x55bed8df92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f4506373b80 1 -- 172.21.15.114:0/952846310 shutdown_connections 2023-10-18T14:04:34.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f4506373b80 1 -- 172.21.15.114:0/952846310 wait complete. 2023-10-18T14:04:34.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f4506373b80 20 client.15789 trim_cache size 0 max 16384 2023-10-18T14:04:34.547 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:04:34.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f44fa18a700 1 -- 172.21.15.114:0/3796973400 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f44dc0a1560 msgr2=0x7f44dc0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f44fa18a700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f44dc0a1560 0x7f44dc0a3a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f44e4005fd0 tx=0x7f44e400a5e0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f44fa18a700 1 -- 172.21.15.114:0/3796973400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f41056e0 msgr2=0x7f44f4195920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f44fa18a700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f41056e0 0x7f44f4195920 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00b830 tx=0x7f44ec007920 comp rx=0 tx=0).stop 2023-10-18T14:04:34.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f44fa18a700 1 -- 172.21.15.114:0/3796973400 shutdown_connections 2023-10-18T14:04:34.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f44fa18a700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f44dc0a1560 0x7f44dc0a3a20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f44fa18a700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f41056e0 0x7f44f4195920 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f44fa18a700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44f40ff640 0x7f44f419b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f44fa18a700 1 --2- 172.21.15.114:0/3796973400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44f4100000 0x7f44f419bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f44fa18a700 1 -- 172.21.15.114:0/3796973400 >> 172.21.15.114:0/3796973400 conn(0x7f44f40767f0 msgr2=0x7f44f40fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f44fa18a700 1 -- 172.21.15.114:0/3796973400 shutdown_connections 2023-10-18T14:04:34.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.524+0000 7f44fa18a700 1 -- 172.21.15.114:0/3796973400 wait complete. 2023-10-18T14:04:34.550 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:34 smithi114 ceph-mon[99494]: pgmap v296: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-18T14:04:34.551 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:34 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3972867593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:04:34.551 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-18T14:04:34.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:34 smithi172 ceph-mon[103574]: pgmap v296: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-18T14:04:34.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:34 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3972867593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:04:34.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.676+0000 7fb836a64700 1 -- 172.21.15.114:0/4203657133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8300ff3b0 msgr2=0x7fb8300ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.676+0000 7fb836a64700 1 --2- 172.21.15.114:0/4203657133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8300ff3b0 0x7fb8300ff790 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb824009990 tx=0x7fb824009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.676+0000 7fb836a64700 1 -- 172.21.15.114:0/4203657133 shutdown_connections 2023-10-18T14:04:34.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.676+0000 7fb836a64700 1 --2- 172.21.15.114:0/4203657133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb830105bc0 0x7fb83010d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.676+0000 7fb836a64700 1 --2- 172.21.15.114:0/4203657133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8300ff3b0 0x7fb8300ff790 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.676+0000 7fb836a64700 1 --2- 172.21.15.114:0/4203657133 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb8300ffd60 0x7fb830105490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.676+0000 7fb836a64700 1 -- 172.21.15.114:0/4203657133 >> 172.21.15.114:0/4203657133 conn(0x7fb8300749d0 msgr2=0x7fb830074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.676+0000 7fb836a64700 1 -- 172.21.15.114:0/4203657133 shutdown_connections 2023-10-18T14:04:34.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.676+0000 7fb836a64700 1 -- 172.21.15.114:0/4203657133 wait complete. 2023-10-18T14:04:34.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.677+0000 7fb836a64700 1 Processor -- start 2023-10-18T14:04:34.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.677+0000 7fb836a64700 1 -- start start 2023-10-18T14:04:34.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.677+0000 7fb836a64700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8300ff3b0 0x7fb83019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.677+0000 7fb836a64700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb830105bc0 0x7fb83019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.677+0000 7fb836a64700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb830196b20 0x7fb830196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.677+0000 7fb836a64700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8301975a0 con 0x7fb8300ff3b0 2023-10-18T14:04:34.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.677+0000 7fb836a64700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb830197710 con 0x7fb830105bc0 2023-10-18T14:04:34.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.677+0000 7fb836a64700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8301978d0 con 0x7fb830196b20 2023-10-18T14:04:34.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.677+0000 7fb834800700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8300ff3b0 0x7fb83019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.677+0000 7fb834800700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8300ff3b0 0x7fb83019c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44564/0 (socket says 172.21.15.114:44564) 2023-10-18T14:04:34.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.677+0000 7fb834800700 1 -- 172.21.15.114:0/2910899813 learned_addr learned my addr 172.21.15.114:0/2910899813 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb835001700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb830196b20 0x7fb830196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb82ffff700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb830105bc0 0x7fb83019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb834800700 1 -- 172.21.15.114:0/2910899813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb830196b20 msgr2=0x7fb830196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb834800700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb830196b20 0x7fb830196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb834800700 1 -- 172.21.15.114:0/2910899813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb830105bc0 msgr2=0x7fb83019cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb834800700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb830105bc0 0x7fb83019cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb834800700 1 -- 172.21.15.114:0/2910899813 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8240095f0 con 0x7fb8300ff3b0 2023-10-18T14:04:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb82ffff700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb830105bc0 0x7fb83019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb834800700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8300ff3b0 0x7fb83019c9f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb824005770 tx=0x7fb824009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb82dffb700 1 -- 172.21.15.114:0/2910899813 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82401d070 con 0x7fb8300ff3b0 2023-10-18T14:04:34.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb82dffb700 1 -- 172.21.15.114:0/2910899813 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb82400fc70 con 0x7fb8300ff3b0 2023-10-18T14:04:34.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb836a64700 1 -- 172.21.15.114:0/2910899813 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8301a3860 con 0x7fb8300ff3b0 2023-10-18T14:04:34.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb82dffb700 1 -- 172.21.15.114:0/2910899813 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824022ce0 con 0x7fb8300ff3b0 2023-10-18T14:04:34.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.678+0000 7fb836a64700 1 -- 172.21.15.114:0/2910899813 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8301a3c80 con 0x7fb8300ff3b0 2023-10-18T14:04:34.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.680+0000 7fb82dffb700 1 -- 172.21.15.114:0/2910899813 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7fb824022470 con 0x7fb8300ff3b0 2023-10-18T14:04:34.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.681+0000 7fb82dffb700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb8200a1560 0x7fb8200a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.681+0000 7fb82ffff700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb8200a1560 0x7fb8200a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.681+0000 7fb82dffb700 1 -- 172.21.15.114:0/2910899813 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb824022e40 con 0x7fb8300ff3b0 2023-10-18T14:04:34.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb82ffff700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb8200a1560 0x7fb8200a3a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb81c005d90 tx=0x7fb81c005d00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb842c4db80 1 Processor -- start 2023-10-18T14:04:34.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb842c4db80 1 -- start start 2023-10-18T14:04:34.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb842c4db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762ccbe0 0x563c762ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb842c4db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762cd500 0x563c762c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb842c4db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 0x563c762c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb842c4db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c7623a6e0 con 0x563c762cd500 2023-10-18T14:04:34.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb842c4db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c76220c60 con 0x563c762c75d0 2023-10-18T14:04:34.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb842c4db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c7621e580 con 0x563c762ccbe0 2023-10-18T14:04:34.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762cd500 0x563c762c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762cd500 0x563c762c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44574/0 (socket says 172.21.15.114:44574) 2023-10-18T14:04:34.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb82ffff700 1 -- 172.21.15.114:0/546636852 learned_addr learned my addr 172.21.15.114:0/546636852 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb834800700 1 --2- 172.21.15.114:0/546636852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762ccbe0 0x563c762ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb835001700 1 --2- 172.21.15.114:0/546636852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 0x563c762c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb82ffff700 1 -- 172.21.15.114:0/546636852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762ccbe0 msgr2=0x563c762ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb82ffff700 1 --2- 172.21.15.114:0/546636852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762ccbe0 0x563c762ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb82ffff700 1 -- 172.21.15.114:0/546636852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 msgr2=0x563c762c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb82ffff700 1 --2- 172.21.15.114:0/546636852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 0x563c762c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.682+0000 7fb82ffff700 1 -- 172.21.15.114:0/546636852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c761d73f0 con 0x563c762cd500 2023-10-18T14:04:34.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.683+0000 7fb82ffff700 1 --2- 172.21.15.114:0/546636852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762cd500 0x563c762c7090 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0093f0 tx=0x7fb81c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd8cdaa85ec11e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.683+0000 7fb81affd700 1 -- 172.21.15.114:0/546636852 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c011c90 con 0x563c762cd500 2023-10-18T14:04:34.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.683+0000 7fb81affd700 1 -- 172.21.15.114:0/546636852 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb81c011df0 con 0x563c762cd500 2023-10-18T14:04:34.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.683+0000 7fb81affd700 1 -- 172.21.15.114:0/546636852 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0106a0 con 0x563c762cd500 2023-10-18T14:04:34.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.684+0000 7fb842c4db80 1 -- 172.21.15.114:0/546636852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762cd500 msgr2=0x563c762c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.684+0000 7fb842c4db80 1 --2- 172.21.15.114:0/546636852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762cd500 0x563c762c7090 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0093f0 tx=0x7fb81c009f90 comp rx=0 tx=0).stop 2023-10-18T14:04:34.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.684+0000 7fb842c4db80 1 -- 172.21.15.114:0/546636852 shutdown_connections 2023-10-18T14:04:34.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.684+0000 7fb842c4db80 1 --2- 172.21.15.114:0/546636852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 0x563c762c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.684+0000 7fb842c4db80 1 --2- 172.21.15.114:0/546636852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762ccbe0 0x563c762ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.684+0000 7fb842c4db80 1 --2- 172.21.15.114:0/546636852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762cd500 0x563c762c7090 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.684+0000 7fb842c4db80 1 -- 172.21.15.114:0/546636852 >> 172.21.15.114:0/546636852 conn(0x563c7623b720 msgr2=0x563c762c1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.684+0000 7fb842c4db80 1 -- 172.21.15.114:0/546636852 shutdown_connections 2023-10-18T14:04:34.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.684+0000 7fb842c4db80 1 -- 172.21.15.114:0/546636852 wait complete. 2023-10-18T14:04:34.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.684+0000 7fb842c4db80 1 -- start start 2023-10-18T14:04:34.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.684+0000 7fb842c4db80 1 Processor -- start 2023-10-18T14:04:34.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.684+0000 7fb842c4db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762c75d0 0x563c762d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb842c4db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb842c4db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762cd500 0x563c762d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb842c4db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c76219e70 con 0x563c762ccbe0 2023-10-18T14:04:34.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb842c4db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c761b6710 con 0x563c762cd500 2023-10-18T14:04:34.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb842c4db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c761b63b0 con 0x563c762c75d0 2023-10-18T14:04:34.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb842c4db80 10 client.0 _ll_register_callbacks cb 0x563c76100a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:34.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44580/0 (socket says 172.21.15.114:44580) 2023-10-18T14:04:34.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb82ffff700 1 -- 172.21.15.114:0/741008274 learned_addr learned my addr 172.21.15.114:0/741008274 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb834800700 1 --2- 172.21.15.114:0/741008274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762c75d0 0x563c762d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb82ffff700 1 -- 172.21.15.114:0/741008274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762c75d0 msgr2=0x563c762d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb82ffff700 1 --2- 172.21.15.114:0/741008274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762c75d0 0x563c762d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb82ffff700 1 -- 172.21.15.114:0/741008274 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762cd500 msgr2=0x563c762d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb82ffff700 1 --2- 172.21.15.114:0/741008274 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762cd500 0x563c762d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb82ffff700 1 -- 172.21.15.114:0/741008274 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81c00ea80 con 0x563c762ccbe0 2023-10-18T14:04:34.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb82ffff700 1 --2- 172.21.15.114:0/741008274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d07a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb81c013040 tx=0x7fb81c004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa19fcee17f4fb1f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb80ffff700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:34.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb80ffff700 1 -- 172.21.15.114:0/741008274 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c011c90 con 0x563c762ccbe0 2023-10-18T14:04:34.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb80ffff700 1 -- 172.21.15.114:0/741008274 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb81c005240 con 0x563c762ccbe0 2023-10-18T14:04:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.685+0000 7fb842c4db80 1 -- 172.21.15.114:0/741008274 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c7621eef0 con 0x563c762ccbe0 2023-10-18T14:04:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.686+0000 7fb80ffff700 1 -- 172.21.15.114:0/741008274 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb81c005400 con 0x563c762ccbe0 2023-10-18T14:04:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.686+0000 7fb842c4db80 10 client.15801 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.686+0000 7fb842c4db80 1 -- 172.21.15.114:0/741008274 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563c76044de0 con 0x563c762ccbe0 2023-10-18T14:04:34.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.686+0000 7fb80ffff700 1 -- 172.21.15.114:0/741008274 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563c7621eef0 con 0x563c762ccbe0 2023-10-18T14:04:34.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.686+0000 7fb80ffff700 1 -- 172.21.15.114:0/741008274 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb81c032470 con 0x563c762ccbe0 2023-10-18T14:04:34.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.686+0000 7fb842c4db80 10 client.15801 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:34.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.686+0000 7fb842c4db80 10 client.15801 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-18T14:04:34.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.686+0000 7fb842c4db80 20 client.15801 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:34.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.686+0000 7fb842c4db80 1 --2- 172.21.15.114:0/741008274 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x563c762e0dd0 0x563c762e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.686+0000 7fb842c4db80 4 client.15801 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:34.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.686+0000 7fb842c4db80 1 -- 172.21.15.114:0/741008274 --> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c762968b0 con 0x563c762e0dd0 2023-10-18T14:04:34.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.686+0000 7fb834800700 1 --2- 172.21.15.114:0/741008274 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x563c762e0dd0 0x563c762e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.687+0000 7fb80ffff700 10 client.15801 ms_handle_connect on v2:172.21.15.172:6834/2655563129 2023-10-18T14:04:34.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.687+0000 7fb834800700 1 --2- 172.21.15.114:0/741008274 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x563c762e0dd0 0x563c762e31f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bea46449bad9ac22 server_cookie=6654056e13128d01 in_seq=0 out_seq=0 2023-10-18T14:04:34.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.687+0000 7fb80ffff700 1 -- 172.21.15.114:0/741008274 <== mds.2 v2:172.21.15.172:6834/2655563129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563c762968b0 con 0x563c762e0dd0 2023-10-18T14:04:34.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.687+0000 7fb80ffff700 10 client.15801 handle_command_reply: tid=0 2023-10-18T14:04:34.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.687+0000 7fb842c4db80 1 client.15801 shutdown 2023-10-18T14:04:34.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.688+0000 7fb842c4db80 1 -- 172.21.15.114:0/741008274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 msgr2=0x563c762d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.688+0000 7fb842c4db80 1 --2- 172.21.15.114:0/741008274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d07a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb81c013040 tx=0x7fb81c004e10 comp rx=0 tx=0).stop 2023-10-18T14:04:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.688+0000 7fb842c4db80 1 -- 172.21.15.114:0/741008274 shutdown_connections 2023-10-18T14:04:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.688+0000 7fb842c4db80 1 --2- 172.21.15.114:0/741008274 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x563c762e0dd0 0x563c762e31f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.688+0000 7fb842c4db80 1 --2- 172.21.15.114:0/741008274 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762cd500 0x563c762d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.688+0000 7fb842c4db80 1 --2- 172.21.15.114:0/741008274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762c75d0 0x563c762d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.688+0000 7fb842c4db80 1 --2- 172.21.15.114:0/741008274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d07a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.688+0000 7fb842c4db80 1 -- 172.21.15.114:0/741008274 >> 172.21.15.114:0/741008274 conn(0x563c7623b720 msgr2=0x563c762c6080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.688+0000 7fb80ffff700 0 client.15801 ms_handle_reset on v2:172.21.15.172:6834/2655563129 2023-10-18T14:04:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.688+0000 7fb842c4db80 1 -- 172.21.15.114:0/741008274 shutdown_connections 2023-10-18T14:04:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.688+0000 7fb842c4db80 1 -- 172.21.15.114:0/741008274 wait complete. 2023-10-18T14:04:34.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.688+0000 7fb842c4db80 20 client.15801 trim_cache size 0 max 16384 2023-10-18T14:04:34.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.703+0000 7fb842c4db80 1 Processor -- start 2023-10-18T14:04:34.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.703+0000 7fb842c4db80 1 -- start start 2023-10-18T14:04:34.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.703+0000 7fb842c4db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 0x563c762c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.703+0000 7fb842c4db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.703+0000 7fb842c4db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762cd500 0x563c762c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.703+0000 7fb842c4db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c7609a920 con 0x563c762ccbe0 2023-10-18T14:04:34.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.703+0000 7fb842c4db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c762d1da0 con 0x563c762c75d0 2023-10-18T14:04:34.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.703+0000 7fb842c4db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c762be2e0 con 0x563c762cd500 2023-10-18T14:04:34.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.703+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.703+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44588/0 (socket says 172.21.15.114:44588) 2023-10-18T14:04:34.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.703+0000 7fb82ffff700 1 -- 172.21.15.114:0/3392591274 learned_addr learned my addr 172.21.15.114:0/3392591274 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.703+0000 7fb82ffff700 1 -- 172.21.15.114:0/3392591274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762cd500 msgr2=0x563c762c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.703+0000 7fb82ffff700 1 --2- 172.21.15.114:0/3392591274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762cd500 0x563c762c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.704+0000 7fb82ffff700 1 -- 172.21.15.114:0/3392591274 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 msgr2=0x563c762c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.704+0000 7fb82ffff700 1 --2- 172.21.15.114:0/3392591274 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 0x563c762c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.704+0000 7fb82ffff700 1 -- 172.21.15.114:0/3392591274 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c7602dc60 con 0x563c762ccbe0 2023-10-18T14:04:34.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.704+0000 7fb82ffff700 1 --2- 172.21.15.114:0/3392591274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d7ee0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00ed70 tx=0x7fb81c004f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a307aa5e0c7c918 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.704+0000 7fb81b7fe700 1 -- 172.21.15.114:0/3392591274 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c011c90 con 0x563c762ccbe0 2023-10-18T14:04:34.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.704+0000 7fb81b7fe700 1 -- 172.21.15.114:0/3392591274 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb81c0329f0 con 0x563c762ccbe0 2023-10-18T14:04:34.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.704+0000 7fb81b7fe700 1 -- 172.21.15.114:0/3392591274 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c01e730 con 0x563c762ccbe0 2023-10-18T14:04:34.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.704+0000 7fb842c4db80 1 -- 172.21.15.114:0/3392591274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 msgr2=0x563c762d7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.704+0000 7fb842c4db80 1 --2- 172.21.15.114:0/3392591274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d7ee0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00ed70 tx=0x7fb81c004f30 comp rx=0 tx=0).stop 2023-10-18T14:04:34.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.705+0000 7fb842c4db80 1 -- 172.21.15.114:0/3392591274 shutdown_connections 2023-10-18T14:04:34.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.705+0000 7fb842c4db80 1 --2- 172.21.15.114:0/3392591274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762cd500 0x563c762c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.705+0000 7fb842c4db80 1 --2- 172.21.15.114:0/3392591274 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 0x563c762c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.705+0000 7fb842c4db80 1 --2- 172.21.15.114:0/3392591274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d7ee0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.705+0000 7fb842c4db80 1 -- 172.21.15.114:0/3392591274 >> 172.21.15.114:0/3392591274 conn(0x563c7623b720 msgr2=0x563c762d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.705+0000 7fb842c4db80 1 -- 172.21.15.114:0/3392591274 shutdown_connections 2023-10-18T14:04:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.705+0000 7fb842c4db80 1 -- 172.21.15.114:0/3392591274 wait complete. 2023-10-18T14:04:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.705+0000 7fb842c4db80 1 -- start start 2023-10-18T14:04:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.705+0000 7fb842c4db80 1 Processor -- start 2023-10-18T14:04:34.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb842c4db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 0x563c762d5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb842c4db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb842c4db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762cd500 0x563c762d6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb842c4db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c76333bc0 con 0x563c762ccbe0 2023-10-18T14:04:34.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb842c4db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c76333d00 con 0x563c762c75d0 2023-10-18T14:04:34.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb842c4db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c76333e40 con 0x563c762cd500 2023-10-18T14:04:34.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb842c4db80 10 client.0 _ll_register_callbacks cb 0x563c76100a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:34.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44594/0 (socket says 172.21.15.114:44594) 2023-10-18T14:04:34.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb82ffff700 1 -- 172.21.15.114:0/3483187723 learned_addr learned my addr 172.21.15.114:0/3483187723 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb835001700 1 --2- 172.21.15.114:0/3483187723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762cd500 0x563c762d6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb834800700 1 --2- 172.21.15.114:0/3483187723 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 0x563c762d5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb82ffff700 1 -- 172.21.15.114:0/3483187723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762cd500 msgr2=0x563c762d6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb82ffff700 1 --2- 172.21.15.114:0/3483187723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762cd500 0x563c762d6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb82ffff700 1 -- 172.21.15.114:0/3483187723 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 msgr2=0x563c762d5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb82ffff700 1 --2- 172.21.15.114:0/3483187723 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 0x563c762d5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb82ffff700 1 -- 172.21.15.114:0/3483187723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c76044de0 con 0x563c762ccbe0 2023-10-18T14:04:34.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb82ffff700 1 --2- 172.21.15.114:0/3483187723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d6400 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00a010 tx=0x7fb81c004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55eb8edc60337ff8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb80ffff700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:34.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb80ffff700 1 -- 172.21.15.114:0/3483187723 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0051a0 con 0x563c762ccbe0 2023-10-18T14:04:34.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb80ffff700 1 -- 172.21.15.114:0/3483187723 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb81c037020 con 0x563c762ccbe0 2023-10-18T14:04:34.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb842c4db80 1 -- 172.21.15.114:0/3483187723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb81c011df0 con 0x563c762ccbe0 2023-10-18T14:04:34.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb80ffff700 1 -- 172.21.15.114:0/3483187723 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb81c032ca0 con 0x563c762ccbe0 2023-10-18T14:04:34.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb842c4db80 10 client.15807 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:34.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.706+0000 7fb842c4db80 1 -- 172.21.15.114:0/3483187723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563c7606b250 con 0x563c762ccbe0 2023-10-18T14:04:34.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.707+0000 7fb80ffff700 1 -- 172.21.15.114:0/3483187723 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb81c053020 con 0x563c762ccbe0 2023-10-18T14:04:34.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.707+0000 7fb80ffff700 1 -- 172.21.15.114:0/3483187723 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb81c043070 con 0x563c762ccbe0 2023-10-18T14:04:34.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.707+0000 7fb842c4db80 10 client.15807 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:34.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.707+0000 7fb842c4db80 10 client.15807 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-18T14:04:34.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.707+0000 7fb842c4db80 20 client.15807 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:34.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.707+0000 7fb842c4db80 1 --2- 172.21.15.114:0/3483187723 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x563c76335020 0x563c76337440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.707+0000 7fb842c4db80 4 client.15807 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:04:34.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.707+0000 7fb842c4db80 1 -- 172.21.15.114:0/3483187723 --> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563c76212e50 con 0x563c76335020 2023-10-18T14:04:34.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.707+0000 7fb834800700 1 --2- 172.21.15.114:0/3483187723 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x563c76335020 0x563c76337440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb80ffff700 10 client.15807 ms_handle_connect on v2:172.21.15.172:6834/2655563129 2023-10-18T14:04:34.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb834800700 1 --2- 172.21.15.114:0/3483187723 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x563c76335020 0x563c76337440 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=108c49d092535a65 server_cookie=34ebdfa5ffa15191 in_seq=0 out_seq=0 2023-10-18T14:04:34.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb80ffff700 1 -- 172.21.15.114:0/3483187723 <== mds.2 v2:172.21.15.172:6834/2655563129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563c76212e50 con 0x563c76335020 2023-10-18T14:04:34.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb80ffff700 10 client.15807 handle_command_reply: tid=0 2023-10-18T14:04:34.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb842c4db80 1 client.15807 shutdown 2023-10-18T14:04:34.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb842c4db80 1 -- 172.21.15.114:0/3483187723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 msgr2=0x563c762d6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb842c4db80 1 --2- 172.21.15.114:0/3483187723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d6400 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00a010 tx=0x7fb81c004e10 comp rx=0 tx=0).stop 2023-10-18T14:04:34.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb842c4db80 1 -- 172.21.15.114:0/3483187723 shutdown_connections 2023-10-18T14:04:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb842c4db80 1 --2- 172.21.15.114:0/3483187723 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x563c76335020 0x563c76337440 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb842c4db80 1 --2- 172.21.15.114:0/3483187723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c762cd500 0x563c762d6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb842c4db80 1 --2- 172.21.15.114:0/3483187723 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563c762c75d0 0x563c762d5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb842c4db80 1 --2- 172.21.15.114:0/3483187723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563c762ccbe0 0x563c762d6400 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb80ffff700 0 client.15807 ms_handle_reset on v2:172.21.15.172:6834/2655563129 2023-10-18T14:04:34.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb842c4db80 1 -- 172.21.15.114:0/3483187723 >> 172.21.15.114:0/3483187723 conn(0x563c7623b720 msgr2=0x563c762c79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb842c4db80 1 -- 172.21.15.114:0/3483187723 shutdown_connections 2023-10-18T14:04:34.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb842c4db80 1 -- 172.21.15.114:0/3483187723 wait complete. 2023-10-18T14:04:34.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.708+0000 7fb842c4db80 20 client.15807 trim_cache size 0 max 16384 2023-10-18T14:04:34.732 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:04:34.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.709+0000 7fb836a64700 1 -- 172.21.15.114:0/2910899813 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb8200a1560 msgr2=0x7fb8200a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.709+0000 7fb836a64700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb8200a1560 0x7fb8200a3a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb81c005d90 tx=0x7fb81c005d00 comp rx=0 tx=0).stop 2023-10-18T14:04:34.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.709+0000 7fb836a64700 1 -- 172.21.15.114:0/2910899813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8300ff3b0 msgr2=0x7fb83019c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.709+0000 7fb836a64700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8300ff3b0 0x7fb83019c9f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb824005770 tx=0x7fb824009580 comp rx=0 tx=0).stop 2023-10-18T14:04:34.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.709+0000 7fb836a64700 1 -- 172.21.15.114:0/2910899813 shutdown_connections 2023-10-18T14:04:34.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.709+0000 7fb836a64700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb8200a1560 0x7fb8200a3a20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.709+0000 7fb836a64700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb830196b20 0x7fb830196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.709+0000 7fb836a64700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8300ff3b0 0x7fb83019c9f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.709+0000 7fb836a64700 1 --2- 172.21.15.114:0/2910899813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb830105bc0 0x7fb83019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.709+0000 7fb836a64700 1 -- 172.21.15.114:0/2910899813 >> 172.21.15.114:0/2910899813 conn(0x7fb8300749d0 msgr2=0x7fb8300fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.709+0000 7fb836a64700 1 -- 172.21.15.114:0/2910899813 shutdown_connections 2023-10-18T14:04:34.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.709+0000 7fb836a64700 1 -- 172.21.15.114:0/2910899813 wait complete. 2023-10-18T14:04:34.736 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-18T14:04:34.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:34 smithi158 ceph-mon[103317]: pgmap v296: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-18T14:04:34.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:34 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3972867593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:04:34.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.859+0000 7f9bbd2eb700 1 -- 172.21.15.114:0/2794758974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb81056e0 msgr2=0x7f9bb8105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.859+0000 7f9bbd2eb700 1 --2- 172.21.15.114:0/2794758974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb81056e0 0x7f9bb8105ac0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009990 tx=0x7f9ba8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.859+0000 7f9bbd2eb700 1 -- 172.21.15.114:0/2794758974 shutdown_connections 2023-10-18T14:04:34.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.859+0000 7f9bbd2eb700 1 --2- 172.21.15.114:0/2794758974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8100000 0x7f9bb810c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.859+0000 7f9bbd2eb700 1 --2- 172.21.15.114:0/2794758974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb81056e0 0x7f9bb8105ac0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.859+0000 7f9bbd2eb700 1 --2- 172.21.15.114:0/2794758974 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bb80ff640 0x7f9bb80ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.859+0000 7f9bbd2eb700 1 -- 172.21.15.114:0/2794758974 >> 172.21.15.114:0/2794758974 conn(0x7f9bb80767f0 msgr2=0x7f9bb8076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.859+0000 7f9bbd2eb700 1 -- 172.21.15.114:0/2794758974 shutdown_connections 2023-10-18T14:04:34.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.859+0000 7f9bbd2eb700 1 -- 172.21.15.114:0/2794758974 wait complete. 2023-10-18T14:04:34.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.860+0000 7f9bbd2eb700 1 Processor -- start 2023-10-18T14:04:34.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.860+0000 7f9bbd2eb700 1 -- start start 2023-10-18T14:04:34.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.860+0000 7f9bbd2eb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb80ff640 0x7f9bb819c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.860+0000 7f9bbd2eb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8100000 0x7f9bb819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.860+0000 7f9bbd2eb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bb81056e0 0x7f9bb81969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.860+0000 7f9bbd2eb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb8197000 con 0x7f9bb80ff640 2023-10-18T14:04:34.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.860+0000 7f9bbd2eb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb8197170 con 0x7f9bb81056e0 2023-10-18T14:04:34.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.860+0000 7f9bbd2eb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb8197330 con 0x7f9bb8100000 2023-10-18T14:04:34.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.860+0000 7f9bb6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb80ff640 0x7f9bb819c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.860+0000 7f9bb6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb80ff640 0x7f9bb819c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44606/0 (socket says 172.21.15.114:44606) 2023-10-18T14:04:34.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.860+0000 7f9bb6ffd700 1 -- 172.21.15.114:0/3640139300 learned_addr learned my addr 172.21.15.114:0/3640139300 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.860+0000 7f9bb77fe700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bb81056e0 0x7f9bb81969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.860+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8100000 0x7f9bb819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.861+0000 7f9bb6ffd700 1 -- 172.21.15.114:0/3640139300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8100000 msgr2=0x7f9bb819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.861+0000 7f9bb6ffd700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8100000 0x7f9bb819cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.861+0000 7f9bb6ffd700 1 -- 172.21.15.114:0/3640139300 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bb81056e0 msgr2=0x7f9bb81969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.861+0000 7f9bb6ffd700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bb81056e0 0x7f9bb81969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.861+0000 7f9bb6ffd700 1 -- 172.21.15.114:0/3640139300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba80095f0 con 0x7f9bb80ff640 2023-10-18T14:04:34.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.861+0000 7f9bb6ffd700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb80ff640 0x7f9bb819c870 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8000c00 tx=0x7f9ba8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.861+0000 7f9b9ffff700 1 -- 172.21.15.114:0/3640139300 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba801d070 con 0x7f9bb80ff640 2023-10-18T14:04:34.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.861+0000 7f9b9ffff700 1 -- 172.21.15.114:0/3640139300 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ba8022470 con 0x7f9bb80ff640 2023-10-18T14:04:34.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.861+0000 7f9bbd2eb700 1 -- 172.21.15.114:0/3640139300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb81975b0 con 0x7f9bb80ff640 2023-10-18T14:04:34.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.861+0000 7f9b9ffff700 1 -- 172.21.15.114:0/3640139300 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8017650 con 0x7f9bb80ff640 2023-10-18T14:04:34.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.861+0000 7f9bbd2eb700 1 -- 172.21.15.114:0/3640139300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb81a3860 con 0x7f9bb80ff640 2023-10-18T14:04:34.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.863+0000 7f9b9ffff700 1 -- 172.21.15.114:0/3640139300 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f9ba8005030 con 0x7f9bb80ff640 2023-10-18T14:04:34.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.864+0000 7f9b9ffff700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9ba00a1560 0x7f9ba00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.864+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9ba00a1560 0x7f9ba00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.864+0000 7f9b9ffff700 1 -- 172.21.15.114:0/3640139300 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9ba80ce1c0 con 0x7f9bb80ff640 2023-10-18T14:04:34.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.864+0000 7f9bc94d4b80 1 Processor -- start 2023-10-18T14:04:34.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bc94d4b80 1 -- start start 2023-10-18T14:04:34.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bc94d4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdd3be0 0x56008bdd3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bc94d4b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd4500 0x56008bdce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bc94d4b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdce5d0 0x56008bdcea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9ba00a1560 0x7f9ba00a3a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8197b60 tx=0x7f9bac009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bc94d4b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008bd416e0 con 0x56008bdd4500 2023-10-18T14:04:34.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bc94d4b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008bd27c60 con 0x56008bdce5d0 2023-10-18T14:04:34.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bc94d4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008bd25580 con 0x56008bdd3be0 2023-10-18T14:04:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bb67fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd4500 0x56008bdce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bb67fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd4500 0x56008bdce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44616/0 (socket says 172.21.15.114:44616) 2023-10-18T14:04:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bb67fc700 1 -- 172.21.15.114:0/1036072245 learned_addr learned my addr 172.21.15.114:0/1036072245 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bb6ffd700 1 --2- 172.21.15.114:0/1036072245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdd3be0 0x56008bdd3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bb67fc700 1 -- 172.21.15.114:0/1036072245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdd3be0 msgr2=0x56008bdd3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/1036072245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdd3be0 0x56008bdd3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bb67fc700 1 -- 172.21.15.114:0/1036072245 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdce5d0 msgr2=0x56008bdcea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bb77fe700 1 --2- 172.21.15.114:0/1036072245 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdce5d0 0x56008bdcea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/1036072245 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdce5d0 0x56008bdcea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bb67fc700 1 -- 172.21.15.114:0/1036072245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56008bcde3f0 con 0x56008bdd4500 2023-10-18T14:04:34.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.865+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/1036072245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd4500 0x56008bdce090 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9bac011d50 tx=0x7f9bac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba62c5886bd8ce0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.866+0000 7f9b9d7fa700 1 -- 172.21.15.114:0/1036072245 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00ebd0 con 0x56008bdd4500 2023-10-18T14:04:34.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.866+0000 7f9b9d7fa700 1 -- 172.21.15.114:0/1036072245 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9bac021070 con 0x56008bdd4500 2023-10-18T14:04:34.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.866+0000 7f9b9d7fa700 1 -- 172.21.15.114:0/1036072245 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac01d670 con 0x56008bdd4500 2023-10-18T14:04:34.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.866+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/1036072245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd4500 msgr2=0x56008bdce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.867+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/1036072245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd4500 0x56008bdce090 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9bac011d50 tx=0x7f9bac014000 comp rx=0 tx=0).stop 2023-10-18T14:04:34.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.867+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/1036072245 shutdown_connections 2023-10-18T14:04:34.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.867+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/1036072245 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdce5d0 0x56008bdcea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.867+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/1036072245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdd3be0 0x56008bdd3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.867+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/1036072245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd4500 0x56008bdce090 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.867+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/1036072245 >> 172.21.15.114:0/1036072245 conn(0x56008bd42720 msgr2=0x56008bdc8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.867+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/1036072245 shutdown_connections 2023-10-18T14:04:34.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.867+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/1036072245 wait complete. 2023-10-18T14:04:34.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.867+0000 7f9bc94d4b80 1 -- start start 2023-10-18T14:04:34.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.867+0000 7f9bc94d4b80 1 Processor -- start 2023-10-18T14:04:34.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bc94d4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdce5d0 0x56008bdda410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bc94d4b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 0x56008bdd7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bc94d4b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008bdd7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bc94d4b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008bd20e70 con 0x56008bdd3be0 2023-10-18T14:04:34.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bc94d4b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008bcbd710 con 0x56008bdd4500 2023-10-18T14:04:34.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bc94d4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008bcbd3b0 con 0x56008bdce5d0 2023-10-18T14:04:34.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bc94d4b80 10 client.0 _ll_register_callbacks cb 0x56008bc07a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:34.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bb67fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 0x56008bdd7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bb67fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 0x56008bdd7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44622/0 (socket says 172.21.15.114:44622) 2023-10-18T14:04:34.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bb67fc700 1 -- 172.21.15.114:0/2339600603 learned_addr learned my addr 172.21.15.114:0/2339600603 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bb6ffd700 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdce5d0 0x56008bdda410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bb77fe700 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008bdd7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bb67fc700 1 -- 172.21.15.114:0/2339600603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdce5d0 msgr2=0x56008bdda410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdce5d0 0x56008bdda410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bb67fc700 1 -- 172.21.15.114:0/2339600603 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 msgr2=0x56008bdd7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008bdd7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bb67fc700 1 -- 172.21.15.114:0/2339600603 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac017070 con 0x56008bdd3be0 2023-10-18T14:04:34.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bb6ffd700 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdce5d0 0x56008bdda410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:34.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bb77fe700 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008bdd7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:34.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 0x56008bdd7700 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00ea20 tx=0x7f9bac00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42f7c80627284a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9b9aff5700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:34.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9b9aff5700 1 -- 172.21.15.114:0/2339600603 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac005250 con 0x56008bdd3be0 2023-10-18T14:04:34.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9b9aff5700 1 -- 172.21.15.114:0/2339600603 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9bac0053b0 con 0x56008bdd3be0 2023-10-18T14:04:34.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.868+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/2339600603 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56008bd25ef0 con 0x56008bdd3be0 2023-10-18T14:04:34.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.869+0000 7f9b9aff5700 1 -- 172.21.15.114:0/2339600603 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bac005570 con 0x56008bdd3be0 2023-10-18T14:04:34.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.869+0000 7f9bc94d4b80 10 client.15819 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:34.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.869+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/2339600603 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56008bb4bde0 con 0x56008bdd3be0 2023-10-18T14:04:34.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.869+0000 7f9b9aff5700 1 -- 172.21.15.114:0/2339600603 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9bac03c020 con 0x56008bdd3be0 2023-10-18T14:04:34.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.869+0000 7f9b9aff5700 1 -- 172.21.15.114:0/2339600603 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9bac003a50 con 0x56008bdd3be0 2023-10-18T14:04:34.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.869+0000 7f9bc94d4b80 10 client.15819 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:34.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.869+0000 7f9bc94d4b80 10 client.15819 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-18T14:04:34.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.869+0000 7f9bc94d4b80 20 client.15819 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:34.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.869+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x56008bde7e10 0x56008bdea230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.869+0000 7f9bc94d4b80 4 client.15819 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:34.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.869+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/2339600603 --> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56008bd9d8b0 con 0x56008bde7e10 2023-10-18T14:04:34.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.869+0000 7f9bb6ffd700 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x56008bde7e10 0x56008bdea230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.870+0000 7f9bb6ffd700 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x56008bde7e10 0x56008bdea230 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f352b091a656372 server_cookie=1b527e1b9c6125c6 in_seq=0 out_seq=0 2023-10-18T14:04:34.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.870+0000 7f9b9aff5700 10 client.15819 ms_handle_connect on v2:172.21.15.172:6836/1821444438 2023-10-18T14:04:34.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.870+0000 7f9b9aff5700 1 -- 172.21.15.114:0/2339600603 <== mds.1 v2:172.21.15.172:6836/1821444438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56008bd9d8b0 con 0x56008bde7e10 2023-10-18T14:04:34.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.870+0000 7f9b9aff5700 10 client.15819 handle_command_reply: tid=0 2023-10-18T14:04:34.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.870+0000 7f9bc94d4b80 1 client.15819 shutdown 2023-10-18T14:04:34.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.870+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/2339600603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 msgr2=0x56008bdd7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.870+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 0x56008bdd7700 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00ea20 tx=0x7f9bac00ec80 comp rx=0 tx=0).stop 2023-10-18T14:04:34.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.870+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/2339600603 shutdown_connections 2023-10-18T14:04:34.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.870+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008bdd7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.870+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x56008bde7e10 0x56008bdea230 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.871+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdce5d0 0x56008bdda410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.871+0000 7f9b9aff5700 0 client.15819 ms_handle_reset on v2:172.21.15.172:6836/1821444438 2023-10-18T14:04:34.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.871+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/2339600603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 0x56008bdd7700 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.871+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/2339600603 >> 172.21.15.114:0/2339600603 conn(0x56008bd42720 msgr2=0x56008bdcd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.871+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/2339600603 shutdown_connections 2023-10-18T14:04:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.871+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/2339600603 wait complete. 2023-10-18T14:04:34.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.871+0000 7f9bc94d4b80 20 client.15819 trim_cache size 0 max 16384 2023-10-18T14:04:34.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.893+0000 7f9bc94d4b80 1 Processor -- start 2023-10-18T14:04:34.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.893+0000 7f9bc94d4b80 1 -- start start 2023-10-18T14:04:34.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bc94d4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdce5d0 0x56008bddeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bc94d4b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 0x56008bdd1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bc94d4b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008bdd1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bc94d4b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008bba1920 con 0x56008bdd3be0 2023-10-18T14:04:34.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bc94d4b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008bd9d8b0 con 0x56008bdd4500 2023-10-18T14:04:34.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bc94d4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008bdcf030 con 0x56008bdce5d0 2023-10-18T14:04:34.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bb67fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 0x56008bdd1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bb67fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 0x56008bdd1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44630/0 (socket says 172.21.15.114:44630) 2023-10-18T14:04:34.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bb67fc700 1 -- 172.21.15.114:0/318411204 learned_addr learned my addr 172.21.15.114:0/318411204 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bb6ffd700 1 --2- 172.21.15.114:0/318411204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdce5d0 0x56008bddeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bb67fc700 1 -- 172.21.15.114:0/318411204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdce5d0 msgr2=0x56008bddeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bb77fe700 1 --2- 172.21.15.114:0/318411204 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008bdd1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/318411204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdce5d0 0x56008bddeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bb67fc700 1 -- 172.21.15.114:0/318411204 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 msgr2=0x56008bdd1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/318411204 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008bdd1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bb67fc700 1 -- 172.21.15.114:0/318411204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56008bb34c60 con 0x56008bdd3be0 2023-10-18T14:04:34.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bb77fe700 1 --2- 172.21.15.114:0/318411204 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008bdd1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:34.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/318411204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 0x56008bdd1720 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9bac016040 tx=0x7f9bac00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b125f34ba19f53 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9b9dffb700 1 -- 172.21.15.114:0/318411204 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00ea50 con 0x56008bdd3be0 2023-10-18T14:04:34.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9b9dffb700 1 -- 172.21.15.114:0/318411204 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9bac03c040 con 0x56008bdd3be0 2023-10-18T14:04:34.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.894+0000 7f9b9dffb700 1 -- 172.21.15.114:0/318411204 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac0267b0 con 0x56008bdd3be0 2023-10-18T14:04:34.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.895+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/318411204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 msgr2=0x56008bdd1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.895+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/318411204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 0x56008bdd1720 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9bac016040 tx=0x7f9bac00eda0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.895+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/318411204 shutdown_connections 2023-10-18T14:04:34.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.895+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/318411204 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008bdd1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.895+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/318411204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdce5d0 0x56008bddeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.895+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/318411204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdd3be0 0x56008bdd1720 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.895+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/318411204 >> 172.21.15.114:0/318411204 conn(0x56008bd42720 msgr2=0x56008bdd5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.895+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/318411204 shutdown_connections 2023-10-18T14:04:34.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.895+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/318411204 wait complete. 2023-10-18T14:04:34.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.895+0000 7f9bc94d4b80 1 -- start start 2023-10-18T14:04:34.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bc94d4b80 1 Processor -- start 2023-10-18T14:04:34.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bc94d4b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdce5d0 0x56008bddd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bc94d4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdd3be0 0x56008bddd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bc94d4b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008be3ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bc94d4b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008bdddd20 con 0x56008bdce5d0 2023-10-18T14:04:34.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bc94d4b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008be3b180 con 0x56008bdd4500 2023-10-18T14:04:34.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bc94d4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008be3b310 con 0x56008bdd3be0 2023-10-18T14:04:34.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bc94d4b80 10 client.0 _ll_register_callbacks cb 0x56008bc07a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:34.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bb6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdce5d0 0x56008bddd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bb6ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdce5d0 0x56008bddd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44634/0 (socket says 172.21.15.114:44634) 2023-10-18T14:04:34.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bb6ffd700 1 -- 172.21.15.114:0/3049697994 learned_addr learned my addr 172.21.15.114:0/3049697994 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:34.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdd3be0 0x56008bddd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bb77fe700 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008be3ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bb6ffd700 1 -- 172.21.15.114:0/3049697994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdd3be0 msgr2=0x56008bddd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bb6ffd700 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdd3be0 0x56008bddd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bb6ffd700 1 -- 172.21.15.114:0/3049697994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 msgr2=0x56008be3ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:34.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bb6ffd700 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008be3ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bb6ffd700 1 -- 172.21.15.114:0/3049697994 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56008bb4bde0 con 0x56008bdce5d0 2023-10-18T14:04:34.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bb77fe700 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008be3ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:34.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9bb6ffd700 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdce5d0 0x56008bddd0b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800b6f0 tx=0x7f9ba8097040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81107df73f3c1e54 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:34.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.896+0000 7f9b9aff5700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:34.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9b9aff5700 1 -- 172.21.15.114:0/3049697994 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80b1040 con 0x56008bdce5d0 2023-10-18T14:04:34.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9b9aff5700 1 -- 172.21.15.114:0/3049697994 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9ba80a3670 con 0x56008bdce5d0 2023-10-18T14:04:34.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/3049697994 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9bac021070 con 0x56008bdce5d0 2023-10-18T14:04:34.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9b9aff5700 1 -- 172.21.15.114:0/3049697994 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ba809f130 con 0x56008bdce5d0 2023-10-18T14:04:34.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9bc94d4b80 10 client.15825 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:34.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/3049697994 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56008bb72250 con 0x56008bdce5d0 2023-10-18T14:04:34.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9b9aff5700 1 -- 172.21.15.114:0/3049697994 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9bac021070 con 0x56008bdce5d0 2023-10-18T14:04:34.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9b9aff5700 1 -- 172.21.15.114:0/3049697994 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9ba809a860 con 0x56008bdce5d0 2023-10-18T14:04:34.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9bc94d4b80 10 client.15825 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:34.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9bc94d4b80 10 client.15825 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-18T14:04:34.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9bc94d4b80 20 client.15825 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:34.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x56008be3c660 0x56008be3ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:34.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9bc94d4b80 4 client.15825 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:04:34.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.897+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/3049697994 --> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56008bd19e50 con 0x56008be3c660 2023-10-18T14:04:34.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x56008be3c660 0x56008be3ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:34.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9b9aff5700 10 client.15825 ms_handle_connect on v2:172.21.15.172:6836/1821444438 2023-10-18T14:04:34.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x56008be3c660 0x56008be3ea80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f75a6832c3882f8 server_cookie=80ac9f8f078e9bde in_seq=0 out_seq=0 2023-10-18T14:04:34.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9b9aff5700 1 -- 172.21.15.114:0/3049697994 <== mds.1 v2:172.21.15.172:6836/1821444438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56008bd19e50 con 0x56008be3c660 2023-10-18T14:04:34.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9b9aff5700 10 client.15825 handle_command_reply: tid=0 2023-10-18T14:04:34.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9bc94d4b80 1 client.15825 shutdown 2023-10-18T14:04:34.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/3049697994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdce5d0 msgr2=0x56008bddd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdce5d0 0x56008bddd0b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800b6f0 tx=0x7f9ba8097040 comp rx=0 tx=0).stop 2023-10-18T14:04:34.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/3049697994 shutdown_connections 2023-10-18T14:04:34.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56008bdd4500 0x56008be3ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56008bdce5d0 0x56008bddd0b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x56008be3c660 0x56008be3ea80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9bc94d4b80 1 --2- 172.21.15.114:0/3049697994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008bdd3be0 0x56008bddd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9b9aff5700 0 client.15825 ms_handle_reset on v2:172.21.15.172:6836/1821444438 2023-10-18T14:04:34.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.898+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/3049697994 >> 172.21.15.114:0/3049697994 conn(0x56008bd42720 msgr2=0x56008bdd5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/3049697994 shutdown_connections 2023-10-18T14:04:34.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bc94d4b80 1 -- 172.21.15.114:0/3049697994 wait complete. 2023-10-18T14:04:34.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bc94d4b80 20 client.15825 trim_cache size 0 max 16384 2023-10-18T14:04:34.918 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:04:34.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bbd2eb700 1 -- 172.21.15.114:0/3640139300 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9ba00a1560 msgr2=0x7f9ba00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bbd2eb700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9ba00a1560 0x7f9ba00a3a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8197b60 tx=0x7f9bac009260 comp rx=0 tx=0).stop 2023-10-18T14:04:34.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bbd2eb700 1 -- 172.21.15.114:0/3640139300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb80ff640 msgr2=0x7f9bb819c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:34.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bbd2eb700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb80ff640 0x7f9bb819c870 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8000c00 tx=0x7f9ba8004730 comp rx=0 tx=0).stop 2023-10-18T14:04:34.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bbd2eb700 1 -- 172.21.15.114:0/3640139300 shutdown_connections 2023-10-18T14:04:34.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bbd2eb700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9ba00a1560 0x7f9ba00a3a20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bbd2eb700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9bb81056e0 0x7f9bb81969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bbd2eb700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb80ff640 0x7f9bb819c870 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bbd2eb700 1 --2- 172.21.15.114:0/3640139300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8100000 0x7f9bb819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:34.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bbd2eb700 1 -- 172.21.15.114:0/3640139300 >> 172.21.15.114:0/3640139300 conn(0x7f9bb80767f0 msgr2=0x7f9bb8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:34.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bbd2eb700 1 -- 172.21.15.114:0/3640139300 shutdown_connections 2023-10-18T14:04:34.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:34.899+0000 7f9bbd2eb700 1 -- 172.21.15.114:0/3640139300 wait complete. 2023-10-18T14:04:34.922 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-18T14:04:35.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.045+0000 7f8d3145d700 1 -- 172.21.15.114:0/1196717057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c100730 msgr2=0x7f8d2c100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:35.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.045+0000 7f8d3145d700 1 --2- 172.21.15.114:0/1196717057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c100730 0x7f8d2c100bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8d200098f0 tx=0x7f8d20009c00 comp rx=0 tx=0).stop 2023-10-18T14:04:35.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.045+0000 7f8d3145d700 1 -- 172.21.15.114:0/1196717057 shutdown_connections 2023-10-18T14:04:35.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.045+0000 7f8d3145d700 1 --2- 172.21.15.114:0/1196717057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d2c1010f0 0x7f8d2c10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.045+0000 7f8d3145d700 1 --2- 172.21.15.114:0/1196717057 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d2c106740 0x7f8d2c106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.045+0000 7f8d3145d700 1 --2- 172.21.15.114:0/1196717057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c100730 0x7f8d2c100bb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.045+0000 7f8d3145d700 1 -- 172.21.15.114:0/1196717057 >> 172.21.15.114:0/1196717057 conn(0x7f8d2c0fc200 msgr2=0x7f8d2c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:35.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.045+0000 7f8d3145d700 1 -- 172.21.15.114:0/1196717057 shutdown_connections 2023-10-18T14:04:35.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.045+0000 7f8d3145d700 1 -- 172.21.15.114:0/1196717057 wait complete. 2023-10-18T14:04:35.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.046+0000 7f8d3145d700 1 Processor -- start 2023-10-18T14:04:35.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.046+0000 7f8d3145d700 1 -- start start 2023-10-18T14:04:35.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d3145d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c100730 0x7f8d2c19c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d3145d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d2c1010f0 0x7f8d2c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d3145d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d2c106740 0x7f8d2c1969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d3145d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c197050 con 0x7f8d2c1010f0 2023-10-18T14:04:35.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d3145d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c1971c0 con 0x7f8d2c106740 2023-10-18T14:04:35.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d3145d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c197380 con 0x7f8d2c100730 2023-10-18T14:04:35.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d2a7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d2c1010f0 0x7f8d2c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d2a7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d2c1010f0 0x7f8d2c19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44650/0 (socket says 172.21.15.114:44650) 2023-10-18T14:04:35.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d2a7fc700 1 -- 172.21.15.114:0/2451437819 learned_addr learned my addr 172.21.15.114:0/2451437819 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:35.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d2affd700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c100730 0x7f8d2c19c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d2b7fe700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d2c106740 0x7f8d2c1969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d2a7fc700 1 -- 172.21.15.114:0/2451437819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c100730 msgr2=0x7f8d2c19c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:35.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d2a7fc700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c100730 0x7f8d2c19c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d2a7fc700 1 -- 172.21.15.114:0/2451437819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d2c106740 msgr2=0x7f8d2c1969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:35.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d2a7fc700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d2c106740 0x7f8d2c1969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d2a7fc700 1 -- 172.21.15.114:0/2451437819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d24009d00 con 0x7f8d2c1010f0 2023-10-18T14:04:35.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d2b7fe700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d2c106740 0x7f8d2c1969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:35.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d2a7fc700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d2c1010f0 0x7f8d2c19ce00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000fa00 tx=0x7f8d2000fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:35.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d13fff700 1 -- 172.21.15.114:0/2451437819 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2001c070 con 0x7f8d2c1010f0 2023-10-18T14:04:35.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d13fff700 1 -- 172.21.15.114:0/2451437819 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d2000bba0 con 0x7f8d2c1010f0 2023-10-18T14:04:35.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d3145d700 1 -- 172.21.15.114:0/2451437819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d20009520 con 0x7f8d2c1010f0 2023-10-18T14:04:35.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d13fff700 1 -- 172.21.15.114:0/2451437819 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d200049c0 con 0x7f8d2c1010f0 2023-10-18T14:04:35.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.047+0000 7f8d3145d700 1 -- 172.21.15.114:0/2451437819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c1a36d0 con 0x7f8d2c1010f0 2023-10-18T14:04:35.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.050+0000 7f8d13fff700 1 -- 172.21.15.114:0/2451437819 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f8d20020070 con 0x7f8d2c1010f0 2023-10-18T14:04:35.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.050+0000 7f8d13fff700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8d140a1560 0x7f8d140a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.050+0000 7f8d2affd700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8d140a1560 0x7f8d140a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.050+0000 7f8d13fff700 1 -- 172.21.15.114:0/2451437819 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8d200cdc30 con 0x7f8d2c1010f0 2023-10-18T14:04:35.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.051+0000 7f8d2affd700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8d140a1560 0x7f8d140a3a20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c005950 tx=0x7f8d1c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:35.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.051+0000 7f8d3d646b80 1 Processor -- start 2023-10-18T14:04:35.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.051+0000 7f8d3d646b80 1 -- start start 2023-10-18T14:04:35.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.051+0000 7f8d3d646b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 0x557058170fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.051+0000 7f8d3d646b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 0x55705816b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.051+0000 7f8d3d646b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55705816b5d0 0x55705816ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.051+0000 7f8d3d646b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570580de6e0 con 0x557058170be0 2023-10-18T14:04:35.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.051+0000 7f8d3d646b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570580c4c60 con 0x55705816b5d0 2023-10-18T14:04:35.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.051+0000 7f8d3d646b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570580c2580 con 0x557058171500 2023-10-18T14:04:35.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.051+0000 7f8d2affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 0x557058170fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.051+0000 7f8d2affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 0x557058170fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44656/0 (socket says 172.21.15.114:44656) 2023-10-18T14:04:35.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.051+0000 7f8d2affd700 1 -- 172.21.15.114:0/3301437984 learned_addr learned my addr 172.21.15.114:0/3301437984 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:35.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.052+0000 7f8d2a7fc700 1 --2- 172.21.15.114:0/3301437984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 0x55705816b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.052+0000 7f8d2b7fe700 1 --2- 172.21.15.114:0/3301437984 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55705816b5d0 0x55705816ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.052+0000 7f8d2affd700 1 -- 172.21.15.114:0/3301437984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 msgr2=0x55705816b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:35.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.052+0000 7f8d2affd700 1 --2- 172.21.15.114:0/3301437984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 0x55705816b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.052+0000 7f8d2affd700 1 -- 172.21.15.114:0/3301437984 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55705816b5d0 msgr2=0x55705816ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:35.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.052+0000 7f8d2affd700 1 --2- 172.21.15.114:0/3301437984 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55705816b5d0 0x55705816ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.052+0000 7f8d2affd700 1 -- 172.21.15.114:0/3301437984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55705807b3f0 con 0x557058170be0 2023-10-18T14:04:35.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.052+0000 7f8d2b7fe700 1 --2- 172.21.15.114:0/3301437984 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55705816b5d0 0x55705816ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:35.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.052+0000 7f8d2affd700 1 --2- 172.21.15.114:0/3301437984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 0x557058170fc0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c010e60 tx=0x7f8d1c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fb324d235b42b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:35.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.052+0000 7f8d117fa700 1 -- 172.21.15.114:0/3301437984 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c011db0 con 0x557058170be0 2023-10-18T14:04:35.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.052+0000 7f8d117fa700 1 -- 172.21.15.114:0/3301437984 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d1c015070 con 0x557058170be0 2023-10-18T14:04:35.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.052+0000 7f8d117fa700 1 -- 172.21.15.114:0/3301437984 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c01c610 con 0x557058170be0 2023-10-18T14:04:35.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.053+0000 7f8d3d646b80 1 -- 172.21.15.114:0/3301437984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 msgr2=0x557058170fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:35.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.053+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/3301437984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 0x557058170fc0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c010e60 tx=0x7f8d1c013000 comp rx=0 tx=0).stop 2023-10-18T14:04:35.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.053+0000 7f8d3d646b80 1 -- 172.21.15.114:0/3301437984 shutdown_connections 2023-10-18T14:04:35.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.053+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/3301437984 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55705816b5d0 0x55705816ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.053+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/3301437984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 0x557058170fc0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.053+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/3301437984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 0x55705816b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.053+0000 7f8d3d646b80 1 -- 172.21.15.114:0/3301437984 >> 172.21.15.114:0/3301437984 conn(0x5570580df720 msgr2=0x557058165b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:35.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.053+0000 7f8d3d646b80 1 -- 172.21.15.114:0/3301437984 shutdown_connections 2023-10-18T14:04:35.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.053+0000 7f8d3d646b80 1 -- 172.21.15.114:0/3301437984 wait complete. 2023-10-18T14:04:35.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.053+0000 7f8d3d646b80 1 -- start start 2023-10-18T14:04:35.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.053+0000 7f8d3d646b80 1 Processor -- start 2023-10-18T14:04:35.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d3d646b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55705816b5d0 0x557058174800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d3d646b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557058170be0 0x557058174d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d3d646b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058171500 0x557058175280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d3d646b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570580bde70 con 0x557058171500 2023-10-18T14:04:35.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d3d646b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705805a710 con 0x557058170be0 2023-10-18T14:04:35.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d3d646b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705805a3b0 con 0x55705816b5d0 2023-10-18T14:04:35.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d3d646b80 10 client.0 _ll_register_callbacks cb 0x557057fa4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:35.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d2b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058171500 0x557058175280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d2b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058171500 0x557058175280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44666/0 (socket says 172.21.15.114:44666) 2023-10-18T14:04:35.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d2b7fe700 1 -- 172.21.15.114:0/1060665090 learned_addr learned my addr 172.21.15.114:0/1060665090 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:35.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d2affd700 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55705816b5d0 0x557058174800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d2a7fc700 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557058170be0 0x557058174d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d2b7fe700 1 -- 172.21.15.114:0/1060665090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55705816b5d0 msgr2=0x557058174800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:35.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d2b7fe700 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55705816b5d0 0x557058174800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d2b7fe700 1 -- 172.21.15.114:0/1060665090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557058170be0 msgr2=0x557058174d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:35.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d2b7fe700 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557058170be0 0x557058174d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d2b7fe700 1 -- 172.21.15.114:0/1060665090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c010b10 con 0x557058171500 2023-10-18T14:04:35.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d2a7fc700 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557058170be0 0x557058174d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:04:35.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d2b7fe700 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058171500 0x557058175280 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8d24007cb0 tx=0x7f8d240111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad06ea708e0207d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:35.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.054+0000 7f8d0eff5700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:35.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d0eff5700 1 -- 172.21.15.114:0/1060665090 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24004bb0 con 0x557058171500 2023-10-18T14:04:35.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d0eff5700 1 -- 172.21.15.114:0/1060665090 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8d24004d10 con 0x557058171500 2023-10-18T14:04:35.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d3d646b80 1 -- 172.21.15.114:0/1060665090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570580c2ef0 con 0x557058171500 2023-10-18T14:04:35.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d0eff5700 1 -- 172.21.15.114:0/1060665090 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d240119e0 con 0x557058171500 2023-10-18T14:04:35.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d3d646b80 10 client.15837 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:35.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d3d646b80 1 -- 172.21.15.114:0/1060665090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557057ee8de0 con 0x557058171500 2023-10-18T14:04:35.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d0eff5700 1 -- 172.21.15.114:0/1060665090 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5570580c2ef0 con 0x557058171500 2023-10-18T14:04:35.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d0eff5700 1 -- 172.21.15.114:0/1060665090 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8d24014070 con 0x557058171500 2023-10-18T14:04:35.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d3d646b80 10 client.15837 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:35.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d3d646b80 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:35.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d3d646b80 20 client.15837 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:35.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x557058185010 0x557058187430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d3d646b80 4 client.15837 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:35.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.055+0000 7f8d3d646b80 1 -- 172.21.15.114:0/1060665090 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55705813a8b0 con 0x557058185010 2023-10-18T14:04:35.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.056+0000 7f8d2affd700 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x557058185010 0x557058187430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.056+0000 7f8d2affd700 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x557058185010 0x557058187430 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eeb6f38c9faaf9f server_cookie=b00c4060a87ebf2a in_seq=0 out_seq=0 2023-10-18T14:04:35.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.056+0000 7f8d0eff5700 10 client.15837 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:35.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d0eff5700 1 -- 172.21.15.114:0/1060665090 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55705813a8b0 con 0x557058185010 2023-10-18T14:04:35.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d0eff5700 10 client.15837 handle_command_reply: tid=0 2023-10-18T14:04:35.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d3d646b80 1 client.15837 shutdown 2023-10-18T14:04:35.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d3d646b80 1 -- 172.21.15.114:0/1060665090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058171500 msgr2=0x557058175280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:35.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058171500 0x557058175280 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8d24007cb0 tx=0x7f8d240111d0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d3d646b80 1 -- 172.21.15.114:0/1060665090 shutdown_connections 2023-10-18T14:04:35.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x557058185010 0x557058187430 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058171500 0x557058175280 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55705816b5d0 0x557058174800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/1060665090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557058170be0 0x557058174d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d3d646b80 1 -- 172.21.15.114:0/1060665090 >> 172.21.15.114:0/1060665090 conn(0x5570580df720 msgr2=0x55705816a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d0eff5700 0 client.15837 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d3d646b80 1 -- 172.21.15.114:0/1060665090 shutdown_connections 2023-10-18T14:04:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d3d646b80 1 -- 172.21.15.114:0/1060665090 wait complete. 2023-10-18T14:04:35.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.057+0000 7f8d3d646b80 20 client.15837 trim_cache size 0 max 16384 2023-10-18T14:04:35.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.070+0000 7f8d3d646b80 1 Processor -- start 2023-10-18T14:04:35.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.070+0000 7f8d3d646b80 1 -- start start 2023-10-18T14:04:35.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.070+0000 7f8d3d646b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55705816b5d0 0x55705816ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.070+0000 7f8d3d646b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 0x5570581740e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.070+0000 7f8d3d646b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 0x557058170060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.070+0000 7f8d3d646b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557057f3e920 con 0x557058170be0 2023-10-18T14:04:35.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.070+0000 7f8d3d646b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570581675e0 con 0x55705816b5d0 2023-10-18T14:04:35.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.070+0000 7f8d3d646b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557058175e00 con 0x557058171500 2023-10-18T14:04:35.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.070+0000 7f8d2a7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 0x5570581740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.070+0000 7f8d2a7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 0x5570581740e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44672/0 (socket says 172.21.15.114:44672) 2023-10-18T14:04:35.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.070+0000 7f8d2a7fc700 1 -- 172.21.15.114:0/3202236263 learned_addr learned my addr 172.21.15.114:0/3202236263 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:35.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.070+0000 7f8d2b7fe700 1 --2- 172.21.15.114:0/3202236263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 0x557058170060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.071+0000 7f8d2affd700 1 --2- 172.21.15.114:0/3202236263 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55705816b5d0 0x55705816ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.071+0000 7f8d2a7fc700 1 -- 172.21.15.114:0/3202236263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 msgr2=0x557058170060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:35.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.071+0000 7f8d2a7fc700 1 --2- 172.21.15.114:0/3202236263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 0x557058170060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.071+0000 7f8d2a7fc700 1 -- 172.21.15.114:0/3202236263 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55705816b5d0 msgr2=0x55705816ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:35.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.071+0000 7f8d2a7fc700 1 --2- 172.21.15.114:0/3202236263 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55705816b5d0 0x55705816ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.071+0000 7f8d2a7fc700 1 -- 172.21.15.114:0/3202236263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557057ed1c60 con 0x557058170be0 2023-10-18T14:04:35.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.071+0000 7f8d2a7fc700 1 --2- 172.21.15.114:0/3202236263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 0x5570581740e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8d20097850 tx=0x7f8d20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61baf8976d42cd23 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:35.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.071+0000 7f8d11ffb700 1 -- 172.21.15.114:0/3202236263 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2009ef30 con 0x557058170be0 2023-10-18T14:04:35.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.071+0000 7f8d11ffb700 1 -- 172.21.15.114:0/3202236263 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d200a30e0 con 0x557058170be0 2023-10-18T14:04:35.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.071+0000 7f8d11ffb700 1 -- 172.21.15.114:0/3202236263 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2009a2d0 con 0x557058170be0 2023-10-18T14:04:35.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 -- 172.21.15.114:0/3202236263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 msgr2=0x5570581740e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:35.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/3202236263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 0x5570581740e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8d20097850 tx=0x7f8d20009c00 comp rx=0 tx=0).stop 2023-10-18T14:04:35.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 -- 172.21.15.114:0/3202236263 shutdown_connections 2023-10-18T14:04:35.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/3202236263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 0x557058170060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/3202236263 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55705816b5d0 0x55705816ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/3202236263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557058170be0 0x5570581740e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 -- 172.21.15.114:0/3202236263 >> 172.21.15.114:0/3202236263 conn(0x5570580df720 msgr2=0x55705816f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 -- 172.21.15.114:0/3202236263 shutdown_connections 2023-10-18T14:04:35.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 -- 172.21.15.114:0/3202236263 wait complete. 2023-10-18T14:04:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 -- start start 2023-10-18T14:04:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 Processor -- start 2023-10-18T14:04:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55705816b5d0 0x55705817b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557058170be0 0x55705817bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 0x557058179e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705817a460 con 0x55705816b5d0 2023-10-18T14:04:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705817a5d0 con 0x557058170be0 2023-10-18T14:04:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705817a790 con 0x557058171500 2023-10-18T14:04:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d3d646b80 10 client.0 _ll_register_callbacks cb 0x557057fa4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d2affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55705816b5d0 0x55705817b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d2affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55705816b5d0 0x55705817b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44676/0 (socket says 172.21.15.114:44676) 2023-10-18T14:04:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.072+0000 7f8d2affd700 1 -- 172.21.15.114:0/486003200 learned_addr learned my addr 172.21.15.114:0/486003200 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d2b7fe700 1 --2- 172.21.15.114:0/486003200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 0x557058179e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d2a7fc700 1 --2- 172.21.15.114:0/486003200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557058170be0 0x55705817bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d2affd700 1 -- 172.21.15.114:0/486003200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 msgr2=0x557058179e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:35.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d2affd700 1 --2- 172.21.15.114:0/486003200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 0x557058179e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d2affd700 1 -- 172.21.15.114:0/486003200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557058170be0 msgr2=0x55705817bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:35.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d2affd700 1 --2- 172.21.15.114:0/486003200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557058170be0 0x55705817bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d2affd700 1 -- 172.21.15.114:0/486003200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c1a36d0 con 0x55705816b5d0 2023-10-18T14:04:35.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d2affd700 1 --2- 172.21.15.114:0/486003200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55705816b5d0 0x55705817b850 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00bae0 tx=0x7f8d1c01edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5e9a130833716 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:35.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d0eff5700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:35.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d0eff5700 1 -- 172.21.15.114:0/486003200 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c02c030 con 0x55705816b5d0 2023-10-18T14:04:35.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d0eff5700 1 -- 172.21.15.114:0/486003200 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8d1c017070 con 0x55705816b5d0 2023-10-18T14:04:35.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d3d646b80 1 -- 172.21.15.114:0/486003200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d1c015070 con 0x55705816b5d0 2023-10-18T14:04:35.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d0eff5700 1 -- 172.21.15.114:0/486003200 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d1c035c60 con 0x55705816b5d0 2023-10-18T14:04:35.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d3d646b80 10 client.15843 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:35.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d3d646b80 1 -- 172.21.15.114:0/486003200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557057f0f250 con 0x55705816b5d0 2023-10-18T14:04:35.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.073+0000 7f8d0eff5700 1 -- 172.21.15.114:0/486003200 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d1c015070 con 0x55705816b5d0 2023-10-18T14:04:35.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.074+0000 7f8d0eff5700 1 -- 172.21.15.114:0/486003200 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8d1c005480 con 0x55705816b5d0 2023-10-18T14:04:35.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.074+0000 7f8d3d646b80 10 client.15843 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:35.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.074+0000 7f8d3d646b80 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:35.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.074+0000 7f8d3d646b80 20 client.15843 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.074+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/486003200 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5570581da000 0x5570581dc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.074+0000 7f8d3d646b80 4 client.15843 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:04:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.074+0000 7f8d3d646b80 1 -- 172.21.15.114:0/486003200 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5570580b6e50 con 0x5570581da000 2023-10-18T14:04:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.074+0000 7f8d2a7fc700 1 --2- 172.21.15.114:0/486003200 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5570581da000 0x5570581dc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.074+0000 7f8d0eff5700 10 client.15843 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.074+0000 7f8d2a7fc700 1 --2- 172.21.15.114:0/486003200 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5570581da000 0x5570581dc3f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4616d3d6f1018fa4 server_cookie=4b47edd1917e46e0 in_seq=0 out_seq=0 2023-10-18T14:04:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d0eff5700 1 -- 172.21.15.114:0/486003200 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5570580b6e50 con 0x5570581da000 2023-10-18T14:04:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d0eff5700 10 client.15843 handle_command_reply: tid=0 2023-10-18T14:04:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d3d646b80 1 client.15843 shutdown 2023-10-18T14:04:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d3d646b80 1 -- 172.21.15.114:0/486003200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55705816b5d0 msgr2=0x55705817b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/486003200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55705816b5d0 0x55705817b850 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00bae0 tx=0x7f8d1c01edc0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d3d646b80 1 -- 172.21.15.114:0/486003200 shutdown_connections 2023-10-18T14:04:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/486003200 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5570581da000 0x5570581dc3f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/486003200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557058171500 0x557058179e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d0eff5700 0 client.15843 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/486003200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55705816b5d0 0x55705817b850 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d3d646b80 1 --2- 172.21.15.114:0/486003200 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557058170be0 0x55705817bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d3d646b80 1 -- 172.21.15.114:0/486003200 >> 172.21.15.114:0/486003200 conn(0x5570580df720 msgr2=0x55705816edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d3d646b80 1 -- 172.21.15.114:0/486003200 shutdown_connections 2023-10-18T14:04:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d3d646b80 1 -- 172.21.15.114:0/486003200 wait complete. 2023-10-18T14:04:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.075+0000 7f8d3d646b80 20 client.15843 trim_cache size 0 max 16384 2023-10-18T14:04:35.101 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:04:35.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.076+0000 7f8d3145d700 1 -- 172.21.15.114:0/2451437819 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8d140a1560 msgr2=0x7f8d140a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:35.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.076+0000 7f8d3145d700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8d140a1560 0x7f8d140a3a20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c005950 tx=0x7f8d1c00b410 comp rx=0 tx=0).stop 2023-10-18T14:04:35.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.076+0000 7f8d3145d700 1 -- 172.21.15.114:0/2451437819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d2c1010f0 msgr2=0x7f8d2c19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.076+0000 7f8d3145d700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d2c1010f0 0x7f8d2c19ce00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000fa00 tx=0x7f8d2000fa30 comp rx=0 tx=0).stop 2023-10-18T14:04:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.076+0000 7f8d3145d700 1 -- 172.21.15.114:0/2451437819 shutdown_connections 2023-10-18T14:04:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.076+0000 7f8d3145d700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8d140a1560 0x7f8d140a3a20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.076+0000 7f8d3145d700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d2c106740 0x7f8d2c1969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.076+0000 7f8d3145d700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c100730 0x7f8d2c19c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.076+0000 7f8d3145d700 1 --2- 172.21.15.114:0/2451437819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d2c1010f0 0x7f8d2c19ce00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:35.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.076+0000 7f8d3145d700 1 -- 172.21.15.114:0/2451437819 >> 172.21.15.114:0/2451437819 conn(0x7f8d2c0fc200 msgr2=0x7f8d2c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:35.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.076+0000 7f8d3145d700 1 -- 172.21.15.114:0/2451437819 shutdown_connections 2023-10-18T14:04:35.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:35.076+0000 7f8d3145d700 1 -- 172.21.15.114:0/2451437819 wait complete. 2023-10-18T14:04:36.105 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-18T14:04:36.106 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-18T14:04:36.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.230+0000 7f928095b700 1 -- 172.21.15.114:0/3603855673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927c105b30 msgr2=0x7f927c10d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.230+0000 7f928095b700 1 --2- 172.21.15.114:0/3603855673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927c105b30 0x7f927c10d540 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f927400b0d0 tx=0x7f927400b3e0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.230+0000 7f928095b700 1 -- 172.21.15.114:0/3603855673 shutdown_connections 2023-10-18T14:04:36.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.230+0000 7f928095b700 1 --2- 172.21.15.114:0/3603855673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927c105b30 0x7f927c10d540 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.230+0000 7f928095b700 1 --2- 172.21.15.114:0/3603855673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f927c067d40 0x7f927c068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.230+0000 7f928095b700 1 --2- 172.21.15.114:0/3603855673 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c105170 0x7f927c1055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.230+0000 7f928095b700 1 -- 172.21.15.114:0/3603855673 >> 172.21.15.114:0/3603855673 conn(0x7f927c0767f0 msgr2=0x7f927c076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:36.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.230+0000 7f928095b700 1 -- 172.21.15.114:0/3603855673 shutdown_connections 2023-10-18T14:04:36.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.230+0000 7f928095b700 1 -- 172.21.15.114:0/3603855673 wait complete. 2023-10-18T14:04:36.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.231+0000 7f928095b700 1 Processor -- start 2023-10-18T14:04:36.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.231+0000 7f928095b700 1 -- start start 2023-10-18T14:04:36.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.231+0000 7f928095b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f927c067d40 0x7f927c19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.231+0000 7f928095b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927c105170 0x7f927c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.231+0000 7f928095b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c105b30 0x7f927c196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.231+0000 7f928095b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c1970b0 con 0x7f927c105170 2023-10-18T14:04:36.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.231+0000 7f928095b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c197220 con 0x7f927c105b30 2023-10-18T14:04:36.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.231+0000 7f928095b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c1973e0 con 0x7f927c067d40 2023-10-18T14:04:36.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.231+0000 7f9279d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927c105170 0x7f927c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.231+0000 7f9279d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927c105170 0x7f927c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44690/0 (socket says 172.21.15.114:44690) 2023-10-18T14:04:36.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.231+0000 7f9279d9b700 1 -- 172.21.15.114:0/4073176760 learned_addr learned my addr 172.21.15.114:0/4073176760 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:36.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.231+0000 7f927a59c700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f927c067d40 0x7f927c19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.232+0000 7f927ad9d700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c105b30 0x7f927c196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.232+0000 7f9279d9b700 1 -- 172.21.15.114:0/4073176760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f927c067d40 msgr2=0x7f927c19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.232+0000 7f9279d9b700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f927c067d40 0x7f927c19c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.232+0000 7f9279d9b700 1 -- 172.21.15.114:0/4073176760 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c105b30 msgr2=0x7f927c196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.232+0000 7f9279d9b700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c105b30 0x7f927c196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.232+0000 7f9279d9b700 1 -- 172.21.15.114:0/4073176760 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9274009d00 con 0x7f927c105170 2023-10-18T14:04:36.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.232+0000 7f9279d9b700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927c105170 0x7f927c19ce10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f927000c9b0 tx=0x7f927000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:36.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.232+0000 7f926b7fe700 1 -- 172.21.15.114:0/4073176760 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270007b00 con 0x7f927c105170 2023-10-18T14:04:36.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.232+0000 7f928095b700 1 -- 172.21.15.114:0/4073176760 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927c1976c0 con 0x7f927c105170 2023-10-18T14:04:36.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.232+0000 7f926b7fe700 1 -- 172.21.15.114:0/4073176760 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9270007c60 con 0x7f927c105170 2023-10-18T14:04:36.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.232+0000 7f926b7fe700 1 -- 172.21.15.114:0/4073176760 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270018660 con 0x7f927c105170 2023-10-18T14:04:36.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.232+0000 7f928095b700 1 -- 172.21.15.114:0/4073176760 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c1a38c0 con 0x7f927c105170 2023-10-18T14:04:36.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.234+0000 7f926b7fe700 1 -- 172.21.15.114:0/4073176760 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f927000f450 con 0x7f927c105170 2023-10-18T14:04:36.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.235+0000 7f926b7fe700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92640a1560 0x7f92640a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.235+0000 7f926b7fe700 1 -- 172.21.15.114:0/4073176760 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f92700ccea0 con 0x7f927c105170 2023-10-18T14:04:36.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.235+0000 7f927a59c700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92640a1560 0x7f92640a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.235+0000 7f927a59c700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92640a1560 0x7f92640a3a20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f926c005950 tx=0x7f926c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:36.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.236+0000 7f928cb44b80 1 Processor -- start 2023-10-18T14:04:36.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.236+0000 7f928cb44b80 1 -- start start 2023-10-18T14:04:36.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.236+0000 7f928cb44b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b667baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.236+0000 7f928cb44b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667c030 0x55f9b667fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.236+0000 7f928cb44b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b66805e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.236+0000 7f928cb44b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b65ea760 con 0x55f9b6680180 2023-10-18T14:04:36.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.236+0000 7f928cb44b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b65d0ce0 con 0x55f9b667b710 2023-10-18T14:04:36.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.236+0000 7f928cb44b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b65ce600 con 0x55f9b667c030 2023-10-18T14:04:36.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.236+0000 7f927ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b66805e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.236+0000 7f927ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b66805e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44700/0 (socket says 172.21.15.114:44700) 2023-10-18T14:04:36.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.236+0000 7f927ad9d700 1 -- 172.21.15.114:0/1957525684 learned_addr learned my addr 172.21.15.114:0/1957525684 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.236+0000 7f9279d9b700 1 --2- 172.21.15.114:0/1957525684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667c030 0x55f9b667fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.237+0000 7f927a59c700 1 --2- 172.21.15.114:0/1957525684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b667baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.237+0000 7f927ad9d700 1 -- 172.21.15.114:0/1957525684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667c030 msgr2=0x55f9b667fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.237+0000 7f927ad9d700 1 --2- 172.21.15.114:0/1957525684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667c030 0x55f9b667fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.237+0000 7f927ad9d700 1 -- 172.21.15.114:0/1957525684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 msgr2=0x55f9b667baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.237+0000 7f927ad9d700 1 --2- 172.21.15.114:0/1957525684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b667baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.237+0000 7f927ad9d700 1 -- 172.21.15.114:0/1957525684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9b6587470 con 0x55f9b6680180 2023-10-18T14:04:36.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.237+0000 7f927a59c700 1 --2- 172.21.15.114:0/1957525684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b667baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:36.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.237+0000 7f927ad9d700 1 --2- 172.21.15.114:0/1957525684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b66805e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f927400ce40 tx=0x7f927400ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc2c9997b7a9459 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:36.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.237+0000 7f9268ff9700 1 -- 172.21.15.114:0/1957525684 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927400e050 con 0x55f9b6680180 2023-10-18T14:04:36.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.237+0000 7f9268ff9700 1 -- 172.21.15.114:0/1957525684 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9274007df0 con 0x55f9b6680180 2023-10-18T14:04:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.237+0000 7f9268ff9700 1 -- 172.21.15.114:0/1957525684 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274007940 con 0x55f9b6680180 2023-10-18T14:04:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 -- 172.21.15.114:0/1957525684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 msgr2=0x55f9b66805e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 --2- 172.21.15.114:0/1957525684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b66805e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f927400ce40 tx=0x7f927400ce70 comp rx=0 tx=0).stop 2023-10-18T14:04:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 -- 172.21.15.114:0/1957525684 shutdown_connections 2023-10-18T14:04:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 --2- 172.21.15.114:0/1957525684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b66805e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 --2- 172.21.15.114:0/1957525684 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b667baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 --2- 172.21.15.114:0/1957525684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667c030 0x55f9b667fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 -- 172.21.15.114:0/1957525684 >> 172.21.15.114:0/1957525684 conn(0x55f9b65eb7a0 msgr2=0x55f9b6671be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 -- 172.21.15.114:0/1957525684 shutdown_connections 2023-10-18T14:04:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 -- 172.21.15.114:0/1957525684 wait complete. 2023-10-18T14:04:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 -- start start 2023-10-18T14:04:36.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 Processor -- start 2023-10-18T14:04:36.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b66878c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b667c030 0x55f9b6684bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b6680180 0x55f9b66851e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b65c9ef0 con 0x55f9b667c030 2023-10-18T14:04:36.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6566790 con 0x55f9b667b710 2023-10-18T14:04:36.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.238+0000 7f928cb44b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6566430 con 0x55f9b6680180 2023-10-18T14:04:36.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f928cb44b80 10 client.0 _ll_register_callbacks cb 0x55f9b64b0b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:36.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9279d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b667c030 0x55f9b6684bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9279d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b667c030 0x55f9b6684bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44704/0 (socket says 172.21.15.114:44704) 2023-10-18T14:04:36.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9279d9b700 1 -- 172.21.15.114:0/1353431963 learned_addr learned my addr 172.21.15.114:0/1353431963 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:36.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f927ad9d700 1 --2- 172.21.15.114:0/1353431963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b6680180 0x55f9b66851e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f927a59c700 1 --2- 172.21.15.114:0/1353431963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b66878c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9279d9b700 1 -- 172.21.15.114:0/1353431963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b6680180 msgr2=0x55f9b66851e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9279d9b700 1 --2- 172.21.15.114:0/1353431963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b6680180 0x55f9b66851e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9279d9b700 1 -- 172.21.15.114:0/1353431963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 msgr2=0x55f9b66878c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9279d9b700 1 --2- 172.21.15.114:0/1353431963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b66878c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9279d9b700 1 -- 172.21.15.114:0/1353431963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c10de70 con 0x55f9b667c030 2023-10-18T14:04:36.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9279d9b700 1 --2- 172.21.15.114:0/1353431963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b667c030 0x55f9b6684bb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9270000c00 tx=0x7f927009a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ea3b11ddf001c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:36.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9261ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:36.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9261ffb700 1 -- 172.21.15.114:0/1353431963 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92700a2350 con 0x55f9b667c030 2023-10-18T14:04:36.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9261ffb700 1 -- 172.21.15.114:0/1353431963 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f927009a220 con 0x55f9b667c030 2023-10-18T14:04:36.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f928cb44b80 1 -- 172.21.15.114:0/1353431963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9b65cef70 con 0x55f9b667c030 2023-10-18T14:04:36.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9261ffb700 1 -- 172.21.15.114:0/1353431963 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92700b82a0 con 0x55f9b667c030 2023-10-18T14:04:36.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f928cb44b80 10 client.15855 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f928cb44b80 1 -- 172.21.15.114:0/1353431963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f9b63f4e60 con 0x55f9b667c030 2023-10-18T14:04:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.239+0000 7f9261ffb700 1 -- 172.21.15.114:0/1353431963 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9270065030 con 0x55f9b667c030 2023-10-18T14:04:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.240+0000 7f9261ffb700 1 -- 172.21.15.114:0/1353431963 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9270094bd0 con 0x55f9b667c030 2023-10-18T14:04:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.240+0000 7f928cb44b80 10 client.15855 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.240+0000 7f928cb44b80 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.240+0000 7f928cb44b80 20 client.15855 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.240+0000 7f928cb44b80 1 --2- 172.21.15.114:0/1353431963 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f9b6695120 0x55f9b6697510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.240+0000 7f928cb44b80 4 client.15855 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.240+0000 7f928cb44b80 1 -- 172.21.15.114:0/1353431963 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9b6646930 con 0x55f9b6695120 2023-10-18T14:04:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.240+0000 7f927a59c700 1 --2- 172.21.15.114:0/1353431963 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f9b6695120 0x55f9b6697510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f927a59c700 1 --2- 172.21.15.114:0/1353431963 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f9b6695120 0x55f9b6697510 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9197cc3ec3a1de5 server_cookie=c11fe9afa7d1b1d1 in_seq=0 out_seq=0 2023-10-18T14:04:36.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f9261ffb700 10 client.15855 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:36.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f9261ffb700 1 -- 172.21.15.114:0/1353431963 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f9b6646930 con 0x55f9b6695120 2023-10-18T14:04:36.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f9261ffb700 10 client.15855 handle_command_reply: tid=0 2023-10-18T14:04:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f928cb44b80 1 client.15855 shutdown 2023-10-18T14:04:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f928cb44b80 1 -- 172.21.15.114:0/1353431963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b667c030 msgr2=0x55f9b6684bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f928cb44b80 1 --2- 172.21.15.114:0/1353431963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b667c030 0x55f9b6684bb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9270000c00 tx=0x7f927009a780 comp rx=0 tx=0).stop 2023-10-18T14:04:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f928cb44b80 1 -- 172.21.15.114:0/1353431963 shutdown_connections 2023-10-18T14:04:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f928cb44b80 1 --2- 172.21.15.114:0/1353431963 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f9b6695120 0x55f9b6697510 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f928cb44b80 1 --2- 172.21.15.114:0/1353431963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b6680180 0x55f9b66851e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f928cb44b80 1 --2- 172.21.15.114:0/1353431963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b66878c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f928cb44b80 1 --2- 172.21.15.114:0/1353431963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b667c030 0x55f9b6684bb0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f9261ffb700 0 client.15855 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:36.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.241+0000 7f928cb44b80 1 -- 172.21.15.114:0/1353431963 >> 172.21.15.114:0/1353431963 conn(0x55f9b65eb7a0 msgr2=0x55f9b6676100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:36.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.242+0000 7f928cb44b80 1 -- 172.21.15.114:0/1353431963 shutdown_connections 2023-10-18T14:04:36.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.242+0000 7f928cb44b80 1 -- 172.21.15.114:0/1353431963 wait complete. 2023-10-18T14:04:36.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.242+0000 7f928cb44b80 20 client.15855 trim_cache size 0 max 16384 2023-10-18T14:04:36.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.258+0000 7f928cb44b80 1 Processor -- start 2023-10-18T14:04:36.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.258+0000 7f928cb44b80 1 -- start start 2023-10-18T14:04:36.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f928cb44b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667b710 0x55f9b668c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f928cb44b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667c030 0x55f9b667e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f928cb44b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b667e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f928cb44b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b644a9a0 con 0x55f9b6680180 2023-10-18T14:04:36.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f928cb44b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6676f50 con 0x55f9b667c030 2023-10-18T14:04:36.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f928cb44b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b668c820 con 0x55f9b667b710 2023-10-18T14:04:36.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f927ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b667e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f9279d9b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667c030 0x55f9b667e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f927ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b667e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44714/0 (socket says 172.21.15.114:44714) 2023-10-18T14:04:36.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f927ad9d700 1 -- 172.21.15.114:0/2486644534 learned_addr learned my addr 172.21.15.114:0/2486644534 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:36.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f927a59c700 1 --2- 172.21.15.114:0/2486644534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667b710 0x55f9b668c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f927ad9d700 1 -- 172.21.15.114:0/2486644534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667b710 msgr2=0x55f9b668c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f927ad9d700 1 --2- 172.21.15.114:0/2486644534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667b710 0x55f9b668c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f927ad9d700 1 -- 172.21.15.114:0/2486644534 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667c030 msgr2=0x55f9b667e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f927ad9d700 1 --2- 172.21.15.114:0/2486644534 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667c030 0x55f9b667e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f927ad9d700 1 -- 172.21.15.114:0/2486644534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9b669c140 con 0x55f9b6680180 2023-10-18T14:04:36.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f927a59c700 1 --2- 172.21.15.114:0/2486644534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667b710 0x55f9b668c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:36.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.259+0000 7f927ad9d700 1 --2- 172.21.15.114:0/2486644534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b667e720 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f927400d010 tx=0x7f92740099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcdd1adc3ce7ed3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:36.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.260+0000 7f92697fa700 1 -- 172.21.15.114:0/2486644534 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274004a50 con 0x55f9b6680180 2023-10-18T14:04:36.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.260+0000 7f92697fa700 1 -- 172.21.15.114:0/2486644534 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f927402a070 con 0x55f9b6680180 2023-10-18T14:04:36.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.260+0000 7f92697fa700 1 -- 172.21.15.114:0/2486644534 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92740266b0 con 0x55f9b6680180 2023-10-18T14:04:36.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.260+0000 7f928cb44b80 1 -- 172.21.15.114:0/2486644534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 msgr2=0x55f9b667e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.260+0000 7f928cb44b80 1 --2- 172.21.15.114:0/2486644534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b667e720 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f927400d010 tx=0x7f92740099e0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.260+0000 7f928cb44b80 1 -- 172.21.15.114:0/2486644534 shutdown_connections 2023-10-18T14:04:36.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.260+0000 7f928cb44b80 1 --2- 172.21.15.114:0/2486644534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b667e720 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.260+0000 7f928cb44b80 1 --2- 172.21.15.114:0/2486644534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667b710 0x55f9b668c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.260+0000 7f928cb44b80 1 --2- 172.21.15.114:0/2486644534 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667c030 0x55f9b667e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.260+0000 7f928cb44b80 1 -- 172.21.15.114:0/2486644534 >> 172.21.15.114:0/2486644534 conn(0x55f9b65eb7a0 msgr2=0x55f9b66840f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:36.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.260+0000 7f928cb44b80 1 -- 172.21.15.114:0/2486644534 shutdown_connections 2023-10-18T14:04:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.260+0000 7f928cb44b80 1 -- 172.21.15.114:0/2486644534 wait complete. 2023-10-18T14:04:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f928cb44b80 1 -- start start 2023-10-18T14:04:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f928cb44b80 1 Processor -- start 2023-10-18T14:04:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f928cb44b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b66e2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f928cb44b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667c030 0x55f9b66e2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f928cb44b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b668b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f928cb44b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b668b810 con 0x55f9b6680180 2023-10-18T14:04:36.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f928cb44b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b668b980 con 0x55f9b667b710 2023-10-18T14:04:36.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f928cb44b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b668bb40 con 0x55f9b667c030 2023-10-18T14:04:36.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f928cb44b80 10 client.0 _ll_register_callbacks cb 0x55f9b64b0b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:36.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f927ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b668b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f927ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b668b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44720/0 (socket says 172.21.15.114:44720) 2023-10-18T14:04:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f927ad9d700 1 -- 172.21.15.114:0/2690250870 learned_addr learned my addr 172.21.15.114:0/2690250870 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f927a59c700 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b66e2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f9279d9b700 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667c030 0x55f9b66e2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f927ad9d700 1 -- 172.21.15.114:0/2690250870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667c030 msgr2=0x55f9b66e2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f927ad9d700 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667c030 0x55f9b66e2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f927ad9d700 1 -- 172.21.15.114:0/2690250870 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 msgr2=0x55f9b66e2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f927ad9d700 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b66e2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f927ad9d700 1 -- 172.21.15.114:0/2690250870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9b6587470 con 0x55f9b6680180 2023-10-18T14:04:36.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.261+0000 7f927a59c700 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b66e2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f927ad9d700 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b668b180 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9274000f80 tx=0x7f9274007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19667f6acafe3b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f9261ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f9261ffb700 1 -- 172.21.15.114:0/2690250870 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927400e040 con 0x55f9b6680180 2023-10-18T14:04:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f928cb44b80 1 -- 172.21.15.114:0/2690250870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9274007df0 con 0x55f9b6680180 2023-10-18T14:04:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f9261ffb700 1 -- 172.21.15.114:0/2690250870 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f92740092d0 con 0x55f9b6680180 2023-10-18T14:04:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f9261ffb700 1 -- 172.21.15.114:0/2690250870 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9274009490 con 0x55f9b6680180 2023-10-18T14:04:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f928cb44b80 10 client.15861 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f928cb44b80 1 -- 172.21.15.114:0/2690250870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f9b63ddce0 con 0x55f9b6680180 2023-10-18T14:04:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f9261ffb700 1 -- 172.21.15.114:0/2690250870 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9274045080 con 0x55f9b6680180 2023-10-18T14:04:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f9261ffb700 1 -- 172.21.15.114:0/2690250870 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f927400b100 con 0x55f9b6680180 2023-10-18T14:04:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f928cb44b80 10 client.15861 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f928cb44b80 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f928cb44b80 20 client.15861 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f928cb44b80 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f9b66ead90 0x55f9b66ed180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f928cb44b80 4 client.15861 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-18T14:04:36.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.262+0000 7f928cb44b80 1 -- 172.21.15.114:0/2690250870 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f9b65c2ed0 con 0x55f9b66ead90 2023-10-18T14:04:36.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.263+0000 7f927a59c700 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f9b66ead90 0x55f9b66ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.263+0000 7f9261ffb700 10 client.15861 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:36.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.263+0000 7f927a59c700 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f9b66ead90 0x55f9b66ed180 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b231238427639420 server_cookie=3706efb1f4aa1b32 in_seq=0 out_seq=0 2023-10-18T14:04:36.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.264+0000 7f9261ffb700 1 -- 172.21.15.114:0/2690250870 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f9b65c2ed0 con 0x55f9b66ead90 2023-10-18T14:04:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.264+0000 7f9261ffb700 10 client.15861 handle_command_reply: tid=0 2023-10-18T14:04:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.264+0000 7f928cb44b80 1 client.15861 shutdown 2023-10-18T14:04:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.264+0000 7f928cb44b80 1 -- 172.21.15.114:0/2690250870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 msgr2=0x55f9b668b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.264+0000 7f928cb44b80 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b668b180 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9274000f80 tx=0x7f9274007ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928cb44b80 1 -- 172.21.15.114:0/2690250870 shutdown_connections 2023-10-18T14:04:36.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928cb44b80 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f9b66ead90 0x55f9b66ed180 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928cb44b80 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f9b6680180 0x55f9b668b180 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928cb44b80 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f9b667b710 0x55f9b66e2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928cb44b80 1 --2- 172.21.15.114:0/2690250870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9b667c030 0x55f9b66e2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f9261ffb700 0 client.15861 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:36.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928cb44b80 1 -- 172.21.15.114:0/2690250870 >> 172.21.15.114:0/2690250870 conn(0x55f9b65eb7a0 msgr2=0x55f9b667e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:36.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928cb44b80 1 -- 172.21.15.114:0/2690250870 shutdown_connections 2023-10-18T14:04:36.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928cb44b80 1 -- 172.21.15.114:0/2690250870 wait complete. 2023-10-18T14:04:36.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928cb44b80 20 client.15861 trim_cache size 0 max 16384 2023-10-18T14:04:36.288 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:04:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: "return_code": 0, 2023-10-18T14:04:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_tag": "1bb90356-cbd1-4ace-8817-fd8842a9a799", 2023-10-18T14:04:36.289 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": "asynchronous" 2023-10-18T14:04:36.289 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:04:36.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928095b700 1 -- 172.21.15.114:0/4073176760 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92640a1560 msgr2=0x7f92640a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928095b700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92640a1560 0x7f92640a3a20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f926c005950 tx=0x7f926c00b410 comp rx=0 tx=0).stop 2023-10-18T14:04:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928095b700 1 -- 172.21.15.114:0/4073176760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927c105170 msgr2=0x7f927c19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928095b700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927c105170 0x7f927c19ce10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f927000c9b0 tx=0x7f927000ccc0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928095b700 1 -- 172.21.15.114:0/4073176760 shutdown_connections 2023-10-18T14:04:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928095b700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92640a1560 0x7f92640a3a20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928095b700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f927c105b30 0x7f927c196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928095b700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f927c067d40 0x7f927c19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928095b700 1 --2- 172.21.15.114:0/4073176760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927c105170 0x7f927c19ce10 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928095b700 1 -- 172.21.15.114:0/4073176760 >> 172.21.15.114:0/4073176760 conn(0x7f927c0767f0 msgr2=0x7f927c0fd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:36.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928095b700 1 -- 172.21.15.114:0/4073176760 shutdown_connections 2023-10-18T14:04:36.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.265+0000 7f928095b700 1 -- 172.21.15.114:0/4073176760 wait complete. 2023-10-18T14:04:36.293 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:04:36.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.414+0000 7f93dec80700 1 -- 172.21.15.114:0/4278032006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d8106730 msgr2=0x7f93d8106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.414+0000 7f93dec80700 1 --2- 172.21.15.114:0/4278032006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d8106730 0x7f93d8106b10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009990 tx=0x7f93cc009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.414+0000 7f93dec80700 1 -- 172.21.15.114:0/4278032006 shutdown_connections 2023-10-18T14:04:36.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.414+0000 7f93dec80700 1 --2- 172.21.15.114:0/4278032006 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93d81010e0 0x7f93d810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.414+0000 7f93dec80700 1 --2- 172.21.15.114:0/4278032006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d8106730 0x7f93d8106b10 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.414+0000 7f93dec80700 1 --2- 172.21.15.114:0/4278032006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93d8100720 0x7f93d8100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.414+0000 7f93dec80700 1 -- 172.21.15.114:0/4278032006 >> 172.21.15.114:0/4278032006 conn(0x7f93d80fc1b0 msgr2=0x7f93d80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.415+0000 7f93dec80700 1 -- 172.21.15.114:0/4278032006 shutdown_connections 2023-10-18T14:04:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.415+0000 7f93dec80700 1 -- 172.21.15.114:0/4278032006 wait complete. 2023-10-18T14:04:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.415+0000 7f93dec80700 1 Processor -- start 2023-10-18T14:04:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.415+0000 7f93dec80700 1 -- start start 2023-10-18T14:04:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93dec80700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93d8100720 0x7f93d819c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93dec80700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d81010e0 0x7f93d819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93dec80700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93d8106730 0x7f93d81969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93dec80700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8197000 con 0x7f93d81010e0 2023-10-18T14:04:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93dec80700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8197170 con 0x7f93d8106730 2023-10-18T14:04:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93dec80700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8197330 con 0x7f93d8100720 2023-10-18T14:04:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93d7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d81010e0 0x7f93d819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93d7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d81010e0 0x7f93d819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44732/0 (socket says 172.21.15.114:44732) 2023-10-18T14:04:36.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93d7fff700 1 -- 172.21.15.114:0/2072444271 learned_addr learned my addr 172.21.15.114:0/2072444271 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:36.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93dca1c700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93d8100720 0x7f93d819c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93dd21d700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93d8106730 0x7f93d81969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93d7fff700 1 -- 172.21.15.114:0/2072444271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93d8100720 msgr2=0x7f93d819c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93d7fff700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93d8100720 0x7f93d819c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93d7fff700 1 -- 172.21.15.114:0/2072444271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93d8106730 msgr2=0x7f93d81969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93d7fff700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93d8106730 0x7f93d81969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93d7fff700 1 -- 172.21.15.114:0/2072444271 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc0095f0 con 0x7f93d81010e0 2023-10-18T14:04:36.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93dd21d700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93d8106730 0x7f93d81969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:36.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93d7fff700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d81010e0 0x7f93d819cdb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f93c400e9c0 tx=0x7f93c400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:36.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93d5ffb700 1 -- 172.21.15.114:0/2072444271 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40097b0 con 0x7f93d81010e0 2023-10-18T14:04:36.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93dec80700 1 -- 172.21.15.114:0/2072444271 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d8197610 con 0x7f93d81010e0 2023-10-18T14:04:36.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93d5ffb700 1 -- 172.21.15.114:0/2072444271 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93c4004cf0 con 0x7f93d81010e0 2023-10-18T14:04:36.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.416+0000 7f93d5ffb700 1 -- 172.21.15.114:0/2072444271 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c4005600 con 0x7f93d81010e0 2023-10-18T14:04:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.417+0000 7f93dec80700 1 -- 172.21.15.114:0/2072444271 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d81a3860 con 0x7f93d81010e0 2023-10-18T14:04:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.419+0000 7f93d5ffb700 1 -- 172.21.15.114:0/2072444271 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f93c400cc60 con 0x7f93d81010e0 2023-10-18T14:04:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.419+0000 7f93d5ffb700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f93c80a1560 0x7f93c80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.419+0000 7f93d5ffb700 1 -- 172.21.15.114:0/2072444271 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f93c4014070 con 0x7f93d81010e0 2023-10-18T14:04:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.419+0000 7f93dca1c700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f93c80a1560 0x7f93c80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.420+0000 7f93dca1c700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f93c80a1560 0x7f93c80a3a20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00b2e0 tx=0x7f93cc005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.420+0000 7f93eae69b80 1 Processor -- start 2023-10-18T14:04:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.420+0000 7f93eae69b80 1 -- start start 2023-10-18T14:04:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.420+0000 7f93eae69b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5690 0x55607c9c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93eae69b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5fb0 0x55607c9c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93eae69b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93eae69b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607c9346e0 con 0x55607c9c5fb0 2023-10-18T14:04:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93eae69b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607c91ac60 con 0x55607c9c5690 2023-10-18T14:04:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93eae69b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607c918580 con 0x55607c9ca100 2023-10-18T14:04:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93d7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5fb0 0x55607c9c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93d7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5fb0 0x55607c9c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44740/0 (socket says 172.21.15.114:44740) 2023-10-18T14:04:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93d7fff700 1 -- 172.21.15.114:0/1081755590 learned_addr learned my addr 172.21.15.114:0/1081755590 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93dca1c700 1 --2- 172.21.15.114:0/1081755590 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5690 0x55607c9c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93dd21d700 1 --2- 172.21.15.114:0/1081755590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93d7fff700 1 -- 172.21.15.114:0/1081755590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 msgr2=0x55607c9ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93d7fff700 1 --2- 172.21.15.114:0/1081755590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93d7fff700 1 -- 172.21.15.114:0/1081755590 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5690 msgr2=0x55607c9c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93d7fff700 1 --2- 172.21.15.114:0/1081755590 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5690 0x55607c9c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93d7fff700 1 -- 172.21.15.114:0/1081755590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55607c8d13f0 con 0x55607c9c5fb0 2023-10-18T14:04:36.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93dca1c700 1 --2- 172.21.15.114:0/1081755590 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5690 0x55607c9c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:36.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93d7fff700 1 --2- 172.21.15.114:0/1081755590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5fb0 0x55607c9c9bc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f93c4096dc0 tx=0x7f93c4099cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298984256060113f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:36.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93c2ffd700 1 -- 172.21.15.114:0/1081755590 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40af070 con 0x55607c9c5fb0 2023-10-18T14:04:36.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93c2ffd700 1 -- 172.21.15.114:0/1081755590 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93c409a350 con 0x55607c9c5fb0 2023-10-18T14:04:36.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.421+0000 7f93c2ffd700 1 -- 172.21.15.114:0/1081755590 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c409e170 con 0x55607c9c5fb0 2023-10-18T14:04:36.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.422+0000 7f93eae69b80 1 -- 172.21.15.114:0/1081755590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5fb0 msgr2=0x55607c9c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.422+0000 7f93eae69b80 1 --2- 172.21.15.114:0/1081755590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5fb0 0x55607c9c9bc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f93c4096dc0 tx=0x7f93c4099cb0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.422+0000 7f93eae69b80 1 -- 172.21.15.114:0/1081755590 shutdown_connections 2023-10-18T14:04:36.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.422+0000 7f93eae69b80 1 --2- 172.21.15.114:0/1081755590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.422+0000 7f93eae69b80 1 --2- 172.21.15.114:0/1081755590 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5690 0x55607c9c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.422+0000 7f93eae69b80 1 --2- 172.21.15.114:0/1081755590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5fb0 0x55607c9c9bc0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.422+0000 7f93eae69b80 1 -- 172.21.15.114:0/1081755590 >> 172.21.15.114:0/1081755590 conn(0x55607c935720 msgr2=0x55607c9bbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:36.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.422+0000 7f93eae69b80 1 -- 172.21.15.114:0/1081755590 shutdown_connections 2023-10-18T14:04:36.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.422+0000 7f93eae69b80 1 -- 172.21.15.114:0/1081755590 wait complete. 2023-10-18T14:04:36.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.422+0000 7f93eae69b80 1 -- start start 2023-10-18T14:04:36.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93eae69b80 1 Processor -- start 2023-10-18T14:04:36.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93eae69b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93eae69b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93eae69b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93eae69b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607c913e70 con 0x55607c9c5690 2023-10-18T14:04:36.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93eae69b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607c8b0710 con 0x55607c9c5fb0 2023-10-18T14:04:36.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93eae69b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607c8b03b0 con 0x55607c9ca100 2023-10-18T14:04:36.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93eae69b80 10 client.0 _ll_register_callbacks cb 0x55607c7faa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:36.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93dca1c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93dca1c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44744/0 (socket says 172.21.15.114:44744) 2023-10-18T14:04:36.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93dca1c700 1 -- 172.21.15.114:0/3975877643 learned_addr learned my addr 172.21.15.114:0/3975877643 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:36.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93d7fff700 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93dd21d700 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93dca1c700 1 -- 172.21.15.114:0/3975877643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 msgr2=0x55607c9cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93dca1c700 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93dca1c700 1 -- 172.21.15.114:0/3975877643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 msgr2=0x55607c9cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93dca1c700 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93dca1c700 1 -- 172.21.15.114:0/3975877643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d81a3860 con 0x55607c9c5690 2023-10-18T14:04:36.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.423+0000 7f93d7fff700 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:36.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93dca1c700 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d1940 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f93cc015000 tx=0x7f93cc01a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c897fe51c33d4f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93b7fff700 1 -- 172.21.15.114:0/3975877643 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0056a0 con 0x55607c9c5690 2023-10-18T14:04:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93eae69b80 1 -- 172.21.15.114:0/3975877643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55607c918ef0 con 0x55607c9c5690 2023-10-18T14:04:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93b7fff700 1 -- 172.21.15.114:0/3975877643 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f93cc00f460 con 0x55607c9c5690 2023-10-18T14:04:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93b7fff700 1 -- 172.21.15.114:0/3975877643 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93cc00f660 con 0x55607c9c5690 2023-10-18T14:04:36.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93eae69b80 10 client.15873 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:36.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93eae69b80 1 -- 172.21.15.114:0/3975877643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55607c73ede0 con 0x55607c9c5690 2023-10-18T14:04:36.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93b7fff700 1 -- 172.21.15.114:0/3975877643 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93cc03e020 con 0x55607c9c5690 2023-10-18T14:04:36.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93b7fff700 1 -- 172.21.15.114:0/3975877643 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f93cc03a7c0 con 0x55607c9c5690 2023-10-18T14:04:36.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93eae69b80 10 client.15873 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:36.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93eae69b80 10 client.15873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:36.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93eae69b80 20 client.15873 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:36.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93eae69b80 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55607c9df390 0x55607c9e17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93eae69b80 4 client.15873 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:36.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.424+0000 7f93eae69b80 1 -- 172.21.15.114:0/3975877643 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55607c9908b0 con 0x55607c9df390 2023-10-18T14:04:36.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.425+0000 7f93d7fff700 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55607c9df390 0x55607c9e17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.425+0000 7f93b7fff700 10 client.15873 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:36.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.425+0000 7f93d7fff700 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55607c9df390 0x55607c9e17b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e143206af701977b server_cookie=a9e53fecebfd7cf8 in_seq=0 out_seq=0 2023-10-18T14:04:36.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93b7fff700 1 -- 172.21.15.114:0/3975877643 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55607c9908b0 con 0x55607c9df390 2023-10-18T14:04:36.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93b7fff700 10 client.15873 handle_command_reply: tid=0 2023-10-18T14:04:36.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93eae69b80 1 client.15873 shutdown 2023-10-18T14:04:36.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93eae69b80 1 -- 172.21.15.114:0/3975877643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 msgr2=0x55607c9d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93eae69b80 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d1940 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f93cc015000 tx=0x7f93cc01a050 comp rx=0 tx=0).stop 2023-10-18T14:04:36.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93eae69b80 1 -- 172.21.15.114:0/3975877643 shutdown_connections 2023-10-18T14:04:36.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93eae69b80 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55607c9df390 0x55607c9e17b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93eae69b80 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93eae69b80 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d1940 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93eae69b80 1 --2- 172.21.15.114:0/3975877643 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93eae69b80 1 -- 172.21.15.114:0/3975877643 >> 172.21.15.114:0/3975877643 conn(0x55607c935720 msgr2=0x55607c9c0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:36.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93b7fff700 0 client.15873 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:36.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93eae69b80 1 -- 172.21.15.114:0/3975877643 shutdown_connections 2023-10-18T14:04:36.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93eae69b80 1 -- 172.21.15.114:0/3975877643 wait complete. 2023-10-18T14:04:36.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.426+0000 7f93eae69b80 20 client.15873 trim_cache size 0 max 16384 2023-10-18T14:04:36.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93eae69b80 1 Processor -- start 2023-10-18T14:04:36.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93eae69b80 1 -- start start 2023-10-18T14:04:36.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93eae69b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93eae69b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93eae69b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93eae69b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607c794920 con 0x55607c9c5690 2023-10-18T14:04:36.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93eae69b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607c9d0230 con 0x55607c9c5fb0 2023-10-18T14:04:36.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93eae69b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607c9cfb60 con 0x55607c9ca100 2023-10-18T14:04:36.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93dca1c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93dca1c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44752/0 (socket says 172.21.15.114:44752) 2023-10-18T14:04:36.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93dca1c700 1 -- 172.21.15.114:0/2438222336 learned_addr learned my addr 172.21.15.114:0/2438222336 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:36.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93d7fff700 1 --2- 172.21.15.114:0/2438222336 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93dd21d700 1 --2- 172.21.15.114:0/2438222336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93dca1c700 1 -- 172.21.15.114:0/2438222336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 msgr2=0x55607c9d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93dca1c700 1 --2- 172.21.15.114:0/2438222336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93dca1c700 1 -- 172.21.15.114:0/2438222336 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 msgr2=0x55607c9cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.443+0000 7f93dca1c700 1 --2- 172.21.15.114:0/2438222336 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.444+0000 7f93dca1c700 1 -- 172.21.15.114:0/2438222336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55607c727c60 con 0x55607c9c5690 2023-10-18T14:04:36.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.444+0000 7f93dd21d700 1 --2- 172.21.15.114:0/2438222336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:36.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.444+0000 7f93d7fff700 1 --2- 172.21.15.114:0/2438222336 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:36.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.444+0000 7f93dca1c700 1 --2- 172.21.15.114:0/2438222336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d62c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00b680 tx=0x7f93cc004fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419d96541b7bba2f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:36.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.444+0000 7f93c37fe700 1 -- 172.21.15.114:0/2438222336 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0056a0 con 0x55607c9c5690 2023-10-18T14:04:36.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.444+0000 7f93c37fe700 1 -- 172.21.15.114:0/2438222336 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93cc03e070 con 0x55607c9c5690 2023-10-18T14:04:36.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.444+0000 7f93c37fe700 1 -- 172.21.15.114:0/2438222336 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc030c50 con 0x55607c9c5690 2023-10-18T14:04:36.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.445+0000 7f93eae69b80 1 -- 172.21.15.114:0/2438222336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 msgr2=0x55607c9d62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.445+0000 7f93eae69b80 1 --2- 172.21.15.114:0/2438222336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d62c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00b680 tx=0x7f93cc004fb0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.445+0000 7f93eae69b80 1 -- 172.21.15.114:0/2438222336 shutdown_connections 2023-10-18T14:04:36.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.445+0000 7f93eae69b80 1 --2- 172.21.15.114:0/2438222336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.445+0000 7f93eae69b80 1 --2- 172.21.15.114:0/2438222336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d62c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.445+0000 7f93eae69b80 1 --2- 172.21.15.114:0/2438222336 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.445+0000 7f93eae69b80 1 -- 172.21.15.114:0/2438222336 >> 172.21.15.114:0/2438222336 conn(0x55607c935720 msgr2=0x55607c9c0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:36.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.445+0000 7f93eae69b80 1 -- 172.21.15.114:0/2438222336 shutdown_connections 2023-10-18T14:04:36.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.445+0000 7f93eae69b80 1 -- 172.21.15.114:0/2438222336 wait complete. 2023-10-18T14:04:36.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.445+0000 7f93eae69b80 1 -- start start 2023-10-18T14:04:36.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.445+0000 7f93eae69b80 1 Processor -- start 2023-10-18T14:04:36.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93eae69b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93eae69b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93eae69b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93eae69b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607c9d0ee0 con 0x55607c9c5690 2023-10-18T14:04:36.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93eae69b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607c9d1050 con 0x55607c9c5fb0 2023-10-18T14:04:36.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93eae69b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607c9d1210 con 0x55607c9ca100 2023-10-18T14:04:36.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93eae69b80 10 client.0 _ll_register_callbacks cb 0x55607c7faa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:36.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93dca1c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93dca1c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44758/0 (socket says 172.21.15.114:44758) 2023-10-18T14:04:36.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93dca1c700 1 -- 172.21.15.114:0/2668838205 learned_addr learned my addr 172.21.15.114:0/2668838205 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:36.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93d7fff700 1 --2- 172.21.15.114:0/2668838205 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93dca1c700 1 -- 172.21.15.114:0/2668838205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 msgr2=0x55607c9d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93dca1c700 1 --2- 172.21.15.114:0/2668838205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93dca1c700 1 -- 172.21.15.114:0/2668838205 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 msgr2=0x55607c9d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:36.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93dca1c700 1 --2- 172.21.15.114:0/2668838205 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93dca1c700 1 -- 172.21.15.114:0/2668838205 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55607c73ede0 con 0x55607c9c5690 2023-10-18T14:04:36.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93d7fff700 1 --2- 172.21.15.114:0/2668838205 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:36.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93dca1c700 1 --2- 172.21.15.114:0/2668838205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d1760 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f93cc03ac40 tx=0x7f93cc030550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92c25b99e13e0e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:36.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:36.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93b7fff700 1 -- 172.21.15.114:0/2668838205 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc03a940 con 0x55607c9c5690 2023-10-18T14:04:36.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93b7fff700 1 -- 172.21.15.114:0/2668838205 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f93cc03f080 con 0x55607c9c5690 2023-10-18T14:04:36.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.446+0000 7f93eae69b80 1 -- 172.21.15.114:0/2668838205 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f93c409a350 con 0x55607c9c5690 2023-10-18T14:04:36.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.447+0000 7f93b7fff700 1 -- 172.21.15.114:0/2668838205 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93cc0308d0 con 0x55607c9c5690 2023-10-18T14:04:36.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.447+0000 7f93eae69b80 10 client.15879 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:36.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.447+0000 7f93eae69b80 1 -- 172.21.15.114:0/2668838205 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55607c765250 con 0x55607c9c5690 2023-10-18T14:04:36.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.447+0000 7f93b7fff700 1 -- 172.21.15.114:0/2668838205 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93c409a350 con 0x55607c9c5690 2023-10-18T14:04:36.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.447+0000 7f93b7fff700 1 -- 172.21.15.114:0/2668838205 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f93cc00fbf0 con 0x55607c9c5690 2023-10-18T14:04:36.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.447+0000 7f93eae69b80 10 client.15879 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:36.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.447+0000 7f93eae69b80 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:36.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.447+0000 7f93eae69b80 20 client.15879 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:36.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.447+0000 7f93eae69b80 1 --2- 172.21.15.114:0/2668838205 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55607ca34210 0x55607ca36650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:36.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.447+0000 7f93eae69b80 4 client.15879 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:04:36.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.447+0000 7f93eae69b80 1 -- 172.21.15.114:0/2668838205 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55607c90ce50 con 0x55607ca34210 2023-10-18T14:04:36.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.447+0000 7f93d7fff700 1 --2- 172.21.15.114:0/2668838205 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55607ca34210 0x55607ca36650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:36.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93b7fff700 10 client.15879 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:36.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93d7fff700 1 --2- 172.21.15.114:0/2668838205 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55607ca34210 0x55607ca36650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25f7556c8a35e11b server_cookie=1ef2cf82b2606644 in_seq=0 out_seq=0 2023-10-18T14:04:36.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93b7fff700 1 -- 172.21.15.114:0/2668838205 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55607c90ce50 con 0x55607ca34210 2023-10-18T14:04:36.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93b7fff700 10 client.15879 handle_command_reply: tid=0 2023-10-18T14:04:36.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93eae69b80 1 client.15879 shutdown 2023-10-18T14:04:36.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93eae69b80 1 -- 172.21.15.114:0/2668838205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 msgr2=0x55607c9d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93eae69b80 1 --2- 172.21.15.114:0/2668838205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d1760 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f93cc03ac40 tx=0x7f93cc030550 comp rx=0 tx=0).stop 2023-10-18T14:04:36.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93eae69b80 1 -- 172.21.15.114:0/2668838205 shutdown_connections 2023-10-18T14:04:36.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93eae69b80 1 --2- 172.21.15.114:0/2668838205 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55607ca34210 0x55607ca36650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93eae69b80 1 --2- 172.21.15.114:0/2668838205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607c9ca100 0x55607c9d09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93eae69b80 1 --2- 172.21.15.114:0/2668838205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55607c9c5690 0x55607c9d1760 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93b7fff700 0 client.15879 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:36.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93eae69b80 1 --2- 172.21.15.114:0/2668838205 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55607c9c5fb0 0x55607c9d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.448+0000 7f93eae69b80 1 -- 172.21.15.114:0/2668838205 >> 172.21.15.114:0/2668838205 conn(0x55607c935720 msgr2=0x55607c9c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:36.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93eae69b80 1 -- 172.21.15.114:0/2668838205 shutdown_connections 2023-10-18T14:04:36.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93eae69b80 1 -- 172.21.15.114:0/2668838205 wait complete. 2023-10-18T14:04:36.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93eae69b80 20 client.15879 trim_cache size 0 max 16384 2023-10-18T14:04:36.474 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:04:36.474 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-18T14:04:36.474 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": { 2023-10-18T14:04:36.475 INFO:teuthology.orchestra.run.smithi114.stdout: "1bb90356-cbd1-4ace-8817-fd8842a9a799": { 2023-10-18T14:04:36.475 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/", 2023-10-18T14:04:36.475 INFO:teuthology.orchestra.run.smithi114.stdout: "tag": "1bb90356-cbd1-4ace-8817-fd8842a9a799", 2023-10-18T14:04:36.475 INFO:teuthology.orchestra.run.smithi114.stdout: "options": "recursive,force" 2023-10-18T14:04:36.475 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:04:36.476 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:04:36.476 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:04:36.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93dec80700 1 -- 172.21.15.114:0/2072444271 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f93c80a1560 msgr2=0x7f93c80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93dec80700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f93c80a1560 0x7f93c80a3a20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00b2e0 tx=0x7f93cc005960 comp rx=0 tx=0).stop 2023-10-18T14:04:36.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93dec80700 1 -- 172.21.15.114:0/2072444271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d81010e0 msgr2=0x7f93d819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:36.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93dec80700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d81010e0 0x7f93d819cdb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f93c400e9c0 tx=0x7f93c400ecd0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93dec80700 1 -- 172.21.15.114:0/2072444271 shutdown_connections 2023-10-18T14:04:36.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93dec80700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f93c80a1560 0x7f93c80a3a20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93dec80700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f93d8106730 0x7f93d81969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93dec80700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93d8100720 0x7f93d819c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93dec80700 1 --2- 172.21.15.114:0/2072444271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93d81010e0 0x7f93d819cdb0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93dec80700 1 -- 172.21.15.114:0/2072444271 >> 172.21.15.114:0/2072444271 conn(0x7f93d80fc1b0 msgr2=0x7f93d80fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93dec80700 1 -- 172.21.15.114:0/2072444271 shutdown_connections 2023-10-18T14:04:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:04:36.449+0000 7f93dec80700 1 -- 172.21.15.114:0/2072444271 wait complete. 2023-10-18T14:04:36.480 INFO:tasks.cephfs.filesystem:scrub status for tag:1bb90356-cbd1-4ace-8817-fd8842a9a799 - {'path': '/', 'tag': '1bb90356-cbd1-4ace-8817-fd8842a9a799', 'options': 'recursive,force'} 2023-10-18T14:04:36.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:36 smithi114 ceph-mon[99494]: pgmap v297: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-18T14:04:37.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:36 smithi158 ceph-mon[103317]: pgmap v297: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-18T14:04:37.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:36 smithi172 ceph-mon[103574]: pgmap v297: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-18T14:04:38.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:37 smithi158 ceph-mon[103317]: scrub queued for path: / 2023-10-18T14:04:38.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:37 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:04:38.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:37 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:04:38.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:37 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:04:38.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:37 smithi172 ceph-mon[103574]: scrub queued for path: / 2023-10-18T14:04:38.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:37 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:04:38.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:37 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:04:38.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:37 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:04:38.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:37 smithi114 ceph-mon[99494]: scrub queued for path: / 2023-10-18T14:04:38.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:37 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:04:38.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:37 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:04:38.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:37 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:04:39.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:38 smithi158 ceph-mon[103317]: pgmap v298: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-18T14:04:39.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:38 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:04:39.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:38 smithi172 ceph-mon[103574]: pgmap v298: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-18T14:04:39.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:38 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:04:39.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:38 smithi114 ceph-mon[99494]: pgmap v298: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-18T14:04:39.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:38 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:04:41.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:40 smithi158 ceph-mon[103317]: pgmap v299: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-18T14:04:41.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:40 smithi172 ceph-mon[103574]: pgmap v299: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-18T14:04:41.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:40 smithi114 ceph-mon[99494]: pgmap v299: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-18T14:04:42.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:41 smithi158 ceph-mon[103317]: scrub summary: idle 2023-10-18T14:04:42.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:41 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:41 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:41 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:41 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:41 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:41 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:41 smithi172 ceph-mon[103574]: scrub summary: idle 2023-10-18T14:04:42.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:41 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:41 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:41 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:41 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:41 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:41 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:41 smithi114 ceph-mon[99494]: scrub summary: idle 2023-10-18T14:04:42.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:41 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:41 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:41 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:41 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:41 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:42.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:41 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:43.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:42 smithi158 ceph-mon[103317]: pgmap v300: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-10-18T14:04:43.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:04:43.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:04:43.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:43.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:42 smithi172 ceph-mon[103574]: pgmap v300: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-10-18T14:04:43.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:04:43.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:04:43.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:42 smithi114 ceph-mon[99494]: pgmap v300: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-10-18T14:04:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:04:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:04:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:04:44.427 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.421+0000 7ff2dbbbc700 1 -- 172.21.15.114:0/2760135739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d40ff620 msgr2=0x7ff2d410d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:44.427 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.421+0000 7ff2dbbbc700 1 --2- 172.21.15.114:0/2760135739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d40ff620 0x7ff2d410d570 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00b0a0 tx=0x7ff2cc00b3b0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.427 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.421+0000 7ff2dbbbc700 1 -- 172.21.15.114:0/2760135739 shutdown_connections 2023-10-18T14:04:44.428 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.421+0000 7ff2dbbbc700 1 --2- 172.21.15.114:0/2760135739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d40ff620 0x7ff2d410d570 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.428 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.421+0000 7ff2dbbbc700 1 --2- 172.21.15.114:0/2760135739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d4106760 0x7ff2d4106b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.428 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.421+0000 7ff2dbbbc700 1 --2- 172.21.15.114:0/2760135739 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2d40fec60 0x7ff2d40ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.428 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.421+0000 7ff2dbbbc700 1 -- 172.21.15.114:0/2760135739 >> 172.21.15.114:0/2760135739 conn(0x7ff2d4075bf0 msgr2=0x7ff2d40fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:44.428 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.421+0000 7ff2dbbbc700 1 -- 172.21.15.114:0/2760135739 shutdown_connections 2023-10-18T14:04:44.429 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.421+0000 7ff2dbbbc700 1 -- 172.21.15.114:0/2760135739 wait complete. 2023-10-18T14:04:44.429 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.422+0000 7ff2dbbbc700 1 Processor -- start 2023-10-18T14:04:44.429 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.422+0000 7ff2dbbbc700 1 -- start start 2023-10-18T14:04:44.429 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.422+0000 7ff2dbbbc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2d40fec60 0x7ff2d419c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.429 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.422+0000 7ff2dbbbc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d40ff620 0x7ff2d419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.430 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.422+0000 7ff2dbbbc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d4106760 0x7ff2d41969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.430 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.422+0000 7ff2dbbbc700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4197050 con 0x7ff2d40ff620 2023-10-18T14:04:44.430 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.422+0000 7ff2dbbbc700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d41971c0 con 0x7ff2d40fec60 2023-10-18T14:04:44.430 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.422+0000 7ff2dbbbc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4197380 con 0x7ff2d4106760 2023-10-18T14:04:44.431 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.423+0000 7ff2d9958700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2d40fec60 0x7ff2d419c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.431 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.423+0000 7ff2d9958700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2d40fec60 0x7ff2d419c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:40914/0 (socket says 172.21.15.114:40914) 2023-10-18T14:04:44.431 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.423+0000 7ff2d9958700 1 -- 172.21.15.114:0/2367182337 learned_addr learned my addr 172.21.15.114:0/2367182337 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:44.431 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.423+0000 7ff2d9157700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d40ff620 0x7ff2d419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.432 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.423+0000 7ff2da159700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d4106760 0x7ff2d41969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.432 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.423+0000 7ff2d9958700 1 -- 172.21.15.114:0/2367182337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d4106760 msgr2=0x7ff2d41969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:44.432 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.423+0000 7ff2d9958700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d4106760 0x7ff2d41969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.432 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.423+0000 7ff2d9958700 1 -- 172.21.15.114:0/2367182337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d40ff620 msgr2=0x7ff2d419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:44.432 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.423+0000 7ff2d9958700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d40ff620 0x7ff2d419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.433 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.423+0000 7ff2d9958700 1 -- 172.21.15.114:0/2367182337 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc009d00 con 0x7ff2d40fec60 2023-10-18T14:04:44.433 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.423+0000 7ff2d9157700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d40ff620 0x7ff2d419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:04:44.433 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.423+0000 7ff2d9958700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2d40fec60 0x7ff2d419c8c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000e9a0 tx=0x7ff2d000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:44.439 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.423+0000 7ff2caffd700 1 -- 172.21.15.114:0/2367182337 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0009790 con 0x7ff2d40fec60 2023-10-18T14:04:44.440 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.424+0000 7ff2dbbbc700 1 -- 172.21.15.114:0/2367182337 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d4197660 con 0x7ff2d40fec60 2023-10-18T14:04:44.440 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.424+0000 7ff2caffd700 1 -- 172.21.15.114:0/2367182337 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2d0010430 con 0x7ff2d40fec60 2023-10-18T14:04:44.440 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.424+0000 7ff2caffd700 1 -- 172.21.15.114:0/2367182337 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0018680 con 0x7ff2d40fec60 2023-10-18T14:04:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.424+0000 7ff2dbbbc700 1 -- 172.21.15.114:0/2367182337 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d40fff50 con 0x7ff2d40fec60 2023-10-18T14:04:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.426+0000 7ff2caffd700 1 -- 172.21.15.114:0/2367182337 <== mon.2 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7ff2d00105a0 con 0x7ff2d40fec60 2023-10-18T14:04:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.427+0000 7ff2caffd700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff2c00a1560 0x7ff2c00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.427+0000 7ff2d9157700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff2c00a1560 0x7ff2c00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.427+0000 7ff2caffd700 1 -- 172.21.15.114:0/2367182337 <== mon.2 v2:172.21.15.158:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff2d0014070 con 0x7ff2d40fec60 2023-10-18T14:04:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.428+0000 7ff2e7da5b80 1 Processor -- start 2023-10-18T14:04:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.428+0000 7ff2d9157700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff2c00a1560 0x7ff2c00a3a20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4197bb0 tx=0x7ff2c400a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.428+0000 7ff2e7da5b80 1 -- start start 2023-10-18T14:04:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.428+0000 7ff2e7da5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9630 0x5624124b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.428+0000 7ff2e7da5b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b9f50 0x5624124b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.428+0000 7ff2e7da5b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b4410 0x5624124b4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.428+0000 7ff2e7da5b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562412427680 con 0x5624124b4410 2023-10-18T14:04:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.428+0000 7ff2e7da5b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241240dc00 con 0x5624124b9f50 2023-10-18T14:04:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.428+0000 7ff2e7da5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241240b520 con 0x5624124b9630 2023-10-18T14:04:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.428+0000 7ff2da159700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b4410 0x5624124b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.443 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.428+0000 7ff2da159700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b4410 0x5624124b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44780/0 (socket says 172.21.15.114:44780) 2023-10-18T14:04:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.428+0000 7ff2da159700 1 -- 172.21.15.114:0/3762669194 learned_addr learned my addr 172.21.15.114:0/3762669194 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.428+0000 7ff2d9958700 1 --2- 172.21.15.114:0/3762669194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9630 0x5624124b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.429+0000 7ff2d9157700 1 --2- 172.21.15.114:0/3762669194 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b9f50 0x5624124b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.429+0000 7ff2da159700 1 -- 172.21.15.114:0/3762669194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9630 msgr2=0x5624124b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.429+0000 7ff2da159700 1 --2- 172.21.15.114:0/3762669194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9630 0x5624124b9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.429+0000 7ff2da159700 1 -- 172.21.15.114:0/3762669194 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b9f50 msgr2=0x5624124b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.429+0000 7ff2da159700 1 --2- 172.21.15.114:0/3762669194 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b9f50 0x5624124b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.429+0000 7ff2da159700 1 -- 172.21.15.114:0/3762669194 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624123c4390 con 0x5624124b4410 2023-10-18T14:04:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.429+0000 7ff2da159700 1 --2- 172.21.15.114:0/3762669194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b4410 0x5624124b4870 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009430 tx=0x7ff2cc009460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3745b4dca82f0d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.429+0000 7ff2bffff700 1 -- 172.21.15.114:0/3762669194 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00e040 con 0x5624124b4410 2023-10-18T14:04:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.429+0000 7ff2bffff700 1 -- 172.21.15.114:0/3762669194 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2cc009b80 con 0x5624124b4410 2023-10-18T14:04:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.429+0000 7ff2bffff700 1 -- 172.21.15.114:0/3762669194 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc0077b0 con 0x5624124b4410 2023-10-18T14:04:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.430+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/3762669194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b4410 msgr2=0x5624124b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.430+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/3762669194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b4410 0x5624124b4870 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009430 tx=0x7ff2cc009460 comp rx=0 tx=0).stop 2023-10-18T14:04:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.430+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/3762669194 shutdown_connections 2023-10-18T14:04:44.447 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.430+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/3762669194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b4410 0x5624124b4870 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.447 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.430+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/3762669194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9630 0x5624124b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.447 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.430+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/3762669194 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b9f50 0x5624124b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.447 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.430+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/3762669194 >> 172.21.15.114:0/3762669194 conn(0x5624124286c0 msgr2=0x5624124ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:44.448 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.430+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/3762669194 shutdown_connections 2023-10-18T14:04:44.448 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.430+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/3762669194 wait complete. 2023-10-18T14:04:44.448 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.431+0000 7ff2e7da5b80 1 -- start start 2023-10-18T14:04:44.448 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.431+0000 7ff2e7da5b80 1 Processor -- start 2023-10-18T14:04:44.448 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.431+0000 7ff2e7da5b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 0x5624124bff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.448 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.431+0000 7ff2e7da5b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9630 0x5624124bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.431+0000 7ff2e7da5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9f50 0x5624124bd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.431+0000 7ff2e7da5b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562412406e10 con 0x5624124b9630 2023-10-18T14:04:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.431+0000 7ff2e7da5b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624123a36b0 con 0x5624124b4410 2023-10-18T14:04:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.431+0000 7ff2e7da5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624123a3350 con 0x5624124b9f50 2023-10-18T14:04:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.431+0000 7ff2e7da5b80 10 client.0 _ll_register_callbacks cb 0x5624122eda20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2d9958700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 0x5624124bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2d9958700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 0x5624124bff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:40928/0 (socket says 172.21.15.114:40928) 2023-10-18T14:04:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2d9958700 1 -- 172.21.15.114:0/2263195975 learned_addr learned my addr 172.21.15.114:0/2263195975 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2d9157700 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9630 0x5624124bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2da159700 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9f50 0x5624124bd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.450 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2d9958700 1 -- 172.21.15.114:0/2263195975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9f50 msgr2=0x5624124bd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:44.451 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2d9958700 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9f50 0x5624124bd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.451 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2d9958700 1 -- 172.21.15.114:0/2263195975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9630 msgr2=0x5624124bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:44.451 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2d9958700 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9630 0x5624124bd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.451 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2d9958700 1 -- 172.21.15.114:0/2263195975 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d410de30 con 0x5624124b4410 2023-10-18T14:04:44.451 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2d9157700 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9630 0x5624124bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:04:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2da159700 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9f50 0x5624124bd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:04:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2d9958700 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 0x5624124bff50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00caa80 tx=0x7ff2d009a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afed1ff231e6d399 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2bd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:04:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.432+0000 7ff2bd7fa700 1 -- 172.21.15.114:0/2263195975 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d009e3b0 con 0x5624124b4410 2023-10-18T14:04:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/2263195975 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562412483850 con 0x5624124b4410 2023-10-18T14:04:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2bd7fa700 1 -- 172.21.15.114:0/2263195975 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff2d00a25f0 con 0x5624124b4410 2023-10-18T14:04:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2bd7fa700 1 -- 172.21.15.114:0/2263195975 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2d00a2160 con 0x5624124b4410 2023-10-18T14:04:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2e7da5b80 10 client.25157 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/2263195975 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562412231d80 con 0x5624124b4410 2023-10-18T14:04:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2bd7fa700 1 -- 172.21.15.114:0/2263195975 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562412483850 con 0x5624124b4410 2023-10-18T14:04:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2bd7fa700 1 -- 172.21.15.114:0/2263195975 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff2d00b2d20 con 0x5624124b4410 2023-10-18T14:04:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2e7da5b80 10 client.25157 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2e7da5b80 10 client.25157 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2e7da5b80 20 client.25157 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5624124d6120 0x5624124d8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2e7da5b80 4 client.25157 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/2263195975 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624123ffdf0 con 0x5624124d6120 2023-10-18T14:04:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.433+0000 7ff2d9157700 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5624124d6120 0x5624124d8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.434+0000 7ff2bd7fa700 10 client.25157 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.434+0000 7ff2d9157700 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5624124d6120 0x5624124d8540 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f25310390d53a62d server_cookie=5da1450696f1efaa in_seq=0 out_seq=0 2023-10-18T14:04:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2bd7fa700 1 -- 172.21.15.114:0/2263195975 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5624123ffdf0 con 0x5624124d6120 2023-10-18T14:04:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2bd7fa700 10 client.25157 handle_command_reply: tid=0 2023-10-18T14:04:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2e7da5b80 1 client.25157 shutdown 2023-10-18T14:04:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/2263195975 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 msgr2=0x5624124bff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 0x5624124bff50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00caa80 tx=0x7ff2d009a7a0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/2263195975 shutdown_connections 2023-10-18T14:04:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5624124d6120 0x5624124d8540 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9f50 0x5624124bd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2bd7fa700 0 client.25157 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 0x5624124bff50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/2263195975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9630 0x5624124bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.457 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/2263195975 >> 172.21.15.114:0/2263195975 conn(0x5624124286c0 msgr2=0x5624124add60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/2263195975 shutdown_connections 2023-10-18T14:04:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/2263195975 wait complete. 2023-10-18T14:04:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.435+0000 7ff2e7da5b80 20 client.25157 trim_cache size 0 max 16384 2023-10-18T14:04:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.450+0000 7ff2e7da5b80 1 Processor -- start 2023-10-18T14:04:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.450+0000 7ff2e7da5b80 1 -- start start 2023-10-18T14:04:44.462 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2e7da5b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 0x5624124bd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2e7da5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9630 0x5624124c4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2e7da5b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9f50 0x5624124ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2e7da5b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624122878c0 con 0x5624124b9f50 2023-10-18T14:04:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2e7da5b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624124b9c60 con 0x5624124b4410 2023-10-18T14:04:44.463 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2e7da5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624124be1f0 con 0x5624124b9630 2023-10-18T14:04:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2d9958700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 0x5624124bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2d9958700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 0x5624124bd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:40936/0 (socket says 172.21.15.114:40936) 2023-10-18T14:04:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2d9958700 1 -- 172.21.15.114:0/2795815095 learned_addr learned my addr 172.21.15.114:0/2795815095 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2da159700 1 --2- 172.21.15.114:0/2795815095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9f50 0x5624124ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2d9958700 1 -- 172.21.15.114:0/2795815095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9630 msgr2=0x5624124c4900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-18T14:04:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2d9958700 1 --2- 172.21.15.114:0/2795815095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9630 0x5624124c4900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2d9958700 1 -- 172.21.15.114:0/2795815095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9f50 msgr2=0x5624124ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2d9958700 1 --2- 172.21.15.114:0/2795815095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9f50 0x5624124ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.451+0000 7ff2d9958700 1 -- 172.21.15.114:0/2795815095 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56241221ac00 con 0x5624124b4410 2023-10-18T14:04:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.452+0000 7ff2d9958700 1 --2- 172.21.15.114:0/2795815095 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 0x5624124bd920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0096760 tx=0x7ff2d000c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecc1bef714bd5d63 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.452+0000 7ff2c8d82700 1 -- 172.21.15.114:0/2795815095 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00a25f0 con 0x5624124b4410 2023-10-18T14:04:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.452+0000 7ff2c8d82700 1 -- 172.21.15.114:0/2795815095 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2d00b1070 con 0x5624124b4410 2023-10-18T14:04:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.452+0000 7ff2c8d82700 1 -- 172.21.15.114:0/2795815095 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00b82b0 con 0x5624124b4410 2023-10-18T14:04:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.453+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/2795815095 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 msgr2=0x5624124bd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.453+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/2795815095 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 0x5624124bd920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0096760 tx=0x7ff2d000c480 comp rx=0 tx=0).stop 2023-10-18T14:04:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.453+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/2795815095 shutdown_connections 2023-10-18T14:04:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.453+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/2795815095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9f50 0x5624124ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.453+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/2795815095 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b4410 0x5624124bd920 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.453+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/2795815095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b9630 0x5624124c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.453+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/2795815095 >> 172.21.15.114:0/2795815095 conn(0x5624124286c0 msgr2=0x5624124b8430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.453+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/2795815095 shutdown_connections 2023-10-18T14:04:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.453+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/2795815095 wait complete. 2023-10-18T14:04:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.453+0000 7ff2e7da5b80 1 -- start start 2023-10-18T14:04:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.453+0000 7ff2e7da5b80 1 Processor -- start 2023-10-18T14:04:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2e7da5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b4410 0x5624124c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2e7da5b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b9630 0x5624124c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.468 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2e7da5b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9f50 0x5624124c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2e7da5b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624124c2e80 con 0x5624124b9f50 2023-10-18T14:04:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2e7da5b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624124c2ff0 con 0x5624124b9630 2023-10-18T14:04:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2e7da5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624124c31b0 con 0x5624124b4410 2023-10-18T14:04:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2e7da5b80 10 client.0 _ll_register_callbacks cb 0x5624122eda20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:44.469 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2d9958700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b4410 0x5624124c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2d9958700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b4410 0x5624124c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:48734/0 (socket says 172.21.15.114:48734) 2023-10-18T14:04:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2d9958700 1 -- 172.21.15.114:0/261092143 learned_addr learned my addr 172.21.15.114:0/261092143 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2da159700 1 --2- 172.21.15.114:0/261092143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9f50 0x5624124c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2d9958700 1 -- 172.21.15.114:0/261092143 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b9630 msgr2=0x5624124c4780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T14:04:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2d9958700 1 --2- 172.21.15.114:0/261092143 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b9630 0x5624124c4780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2d9958700 1 -- 172.21.15.114:0/261092143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9f50 msgr2=0x5624124c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2d9958700 1 --2- 172.21.15.114:0/261092143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9f50 0x5624124c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2d9958700 1 -- 172.21.15.114:0/261092143 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562412231d80 con 0x5624124b4410 2023-10-18T14:04:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2da159700 1 --2- 172.21.15.114:0/261092143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9f50 0x5624124c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:04:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2d9958700 1 --2- 172.21.15.114:0/261092143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b4410 0x5624124c4240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2d009a8c0 tx=0x7ff2d009a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fc249c8d9ecfa65 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.454+0000 7ff2bd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-10-18T14:04:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2bd7fa700 1 -- 172.21.15.114:0/261092143 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00b84b0 con 0x5624124b4410 2023-10-18T14:04:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2bd7fa700 1 -- 172.21.15.114:0/261092143 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7ff2d009e3b0 con 0x5624124b4410 2023-10-18T14:04:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/261092143 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56241240be90 con 0x5624124b4410 2023-10-18T14:04:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2bd7fa700 1 -- 172.21.15.114:0/261092143 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2d00a25f0 con 0x5624124b4410 2023-10-18T14:04:44.472 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2e7da5b80 10 client.25348 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:44.473 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/261092143 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5624122581f0 con 0x5624124b4410 2023-10-18T14:04:44.473 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2bd7fa700 1 -- 172.21.15.114:0/261092143 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56241240be90 con 0x5624124b4410 2023-10-18T14:04:44.473 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2bd7fa700 1 -- 172.21.15.114:0/261092143 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff2d00b2d20 con 0x5624124b4410 2023-10-18T14:04:44.473 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2e7da5b80 10 client.25348 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:44.473 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2e7da5b80 10 client.25348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2e7da5b80 20 client.25348 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/261092143 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56241252ac30 0x56241252d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2e7da5b80 4 client.25348 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:04:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.455+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/261092143 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5624123ffb10 con 0x56241252ac30 2023-10-18T14:04:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.456+0000 7ff2d9157700 1 --2- 172.21.15.114:0/261092143 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56241252ac30 0x56241252d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.456+0000 7ff2bd7fa700 10 client.25348 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.456+0000 7ff2d9157700 1 --2- 172.21.15.114:0/261092143 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56241252ac30 0x56241252d020 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b1a49230907d3a2 server_cookie=3843df66fef105c9 in_seq=0 out_seq=0 2023-10-18T14:04:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.463+0000 7ff2bd7fa700 1 -- 172.21.15.114:0/261092143 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5624123ffb10 con 0x56241252ac30 2023-10-18T14:04:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.463+0000 7ff2bd7fa700 10 client.25348 handle_command_reply: tid=0 2023-10-18T14:04:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.463+0000 7ff2e7da5b80 1 client.25348 shutdown 2023-10-18T14:04:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.463+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/261092143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b4410 msgr2=0x5624124c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.463+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/261092143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b4410 0x5624124c4240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2d009a8c0 tx=0x7ff2d009a7a0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.463+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/261092143 shutdown_connections 2023-10-18T14:04:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.463+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/261092143 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56241252ac30 0x56241252d020 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.463+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/261092143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5624124b9f50 0x5624124c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.463+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/261092143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624124b4410 0x5624124c4240 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.463+0000 7ff2bd7fa700 0 client.25348 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.463+0000 7ff2e7da5b80 1 --2- 172.21.15.114:0/261092143 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5624124b9630 0x5624124c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.463+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/261092143 >> 172.21.15.114:0/261092143 conn(0x5624124286c0 msgr2=0x5624124bbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.463+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/261092143 shutdown_connections 2023-10-18T14:04:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2e7da5b80 1 -- 172.21.15.114:0/261092143 wait complete. 2023-10-18T14:04:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2e7da5b80 20 client.25348 trim_cache size 0 max 16384 2023-10-18T14:04:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:04:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:04:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:04:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:04:44.482 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2dbbbc700 1 -- 172.21.15.114:0/2367182337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff2c00a1560 msgr2=0x7ff2c00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:44.482 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2dbbbc700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff2c00a1560 0x7ff2c00a3a20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4197bb0 tx=0x7ff2c400a380 comp rx=0 tx=0).stop 2023-10-18T14:04:44.482 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2dbbbc700 1 -- 172.21.15.114:0/2367182337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2d40fec60 msgr2=0x7ff2d419c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:44.482 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2dbbbc700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2d40fec60 0x7ff2d419c8c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000e9a0 tx=0x7ff2d000ecb0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.482 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2dbbbc700 1 -- 172.21.15.114:0/2367182337 shutdown_connections 2023-10-18T14:04:44.483 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2dbbbc700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7ff2c00a1560 0x7ff2c00a3a20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.483 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2dbbbc700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d4106760 0x7ff2d41969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.483 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2dbbbc700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff2d40fec60 0x7ff2d419c8c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.483 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2dbbbc700 1 --2- 172.21.15.114:0/2367182337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d40ff620 0x7ff2d419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:44.483 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2dbbbc700 1 -- 172.21.15.114:0/2367182337 >> 172.21.15.114:0/2367182337 conn(0x7ff2d4075bf0 msgr2=0x7ff2d40fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2dbbbc700 1 -- 172.21.15.114:0/2367182337 shutdown_connections 2023-10-18T14:04:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:44.464+0000 7ff2dbbbc700 1 -- 172.21.15.114:0/2367182337 wait complete. 2023-10-18T14:04:44.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:44 smithi172 ceph-mon[103574]: pgmap v301: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2023-10-18T14:04:44.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:44 smithi114 ceph-mon[99494]: pgmap v301: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2023-10-18T14:04:44.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:44 smithi158 ceph-mon[103317]: pgmap v301: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2023-10-18T14:04:47.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:46 smithi158 ceph-mon[103317]: pgmap v302: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-18T14:04:47.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:46 smithi172 ceph-mon[103574]: pgmap v302: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-18T14:04:47.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:46 smithi114 ceph-mon[99494]: pgmap v302: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-18T14:04:49.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:48 smithi158 ceph-mon[103317]: pgmap v303: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2023-10-18T14:04:49.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:48 smithi172 ceph-mon[103574]: pgmap v303: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2023-10-18T14:04:49.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:48 smithi114 ceph-mon[99494]: pgmap v303: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2023-10-18T14:04:51.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:50 smithi158 ceph-mon[103317]: pgmap v304: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-18T14:04:51.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:50 smithi172 ceph-mon[103574]: pgmap v304: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-18T14:04:51.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:50 smithi114 ceph-mon[99494]: pgmap v304: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-18T14:04:53.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:52 smithi158 ceph-mon[103317]: pgmap v305: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2023-10-18T14:04:53.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:52 smithi172 ceph-mon[103574]: pgmap v305: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2023-10-18T14:04:53.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:52 smithi114 ceph-mon[99494]: pgmap v305: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2023-10-18T14:04:54.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:54 smithi172 ceph-mon[103574]: pgmap v306: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-18T14:04:54.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:54 smithi114 ceph-mon[99494]: pgmap v306: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-18T14:04:54.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:54 smithi158 ceph-mon[103317]: pgmap v306: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-18T14:04:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:56 smithi158 ceph-mon[103317]: pgmap v307: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 12 op/s 2023-10-18T14:04:57.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:56 smithi172 ceph-mon[103574]: pgmap v307: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 12 op/s 2023-10-18T14:04:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:56 smithi114 ceph-mon[99494]: pgmap v307: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 12 op/s 2023-10-18T14:04:57.633 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.629+0000 7fd9b1cc1700 1 -- 172.21.15.114:0/2672533790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0ff5d0 msgr2=0x7fd9ac0ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:57.634 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.629+0000 7fd9b1cc1700 1 --2- 172.21.15.114:0/2672533790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0ff5d0 0x7fd9ac0ffa50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009990 tx=0x7fd9a0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.634 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.629+0000 7fd9b1cc1700 1 -- 172.21.15.114:0/2672533790 shutdown_connections 2023-10-18T14:04:57.634 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.629+0000 7fd9b1cc1700 1 --2- 172.21.15.114:0/2672533790 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9ac0fff90 0x7fd9ac10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.634 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.629+0000 7fd9b1cc1700 1 --2- 172.21.15.114:0/2672533790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9ac1045e0 0x7fd9ac1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.634 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.629+0000 7fd9b1cc1700 1 --2- 172.21.15.114:0/2672533790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0ff5d0 0x7fd9ac0ffa50 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.635 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.629+0000 7fd9b1cc1700 1 -- 172.21.15.114:0/2672533790 >> 172.21.15.114:0/2672533790 conn(0x7fd9ac076790 msgr2=0x7fd9ac076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:57.635 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.629+0000 7fd9b1cc1700 1 -- 172.21.15.114:0/2672533790 shutdown_connections 2023-10-18T14:04:57.635 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.629+0000 7fd9b1cc1700 1 -- 172.21.15.114:0/2672533790 wait complete. 2023-10-18T14:04:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.630+0000 7fd9b1cc1700 1 Processor -- start 2023-10-18T14:04:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.630+0000 7fd9b1cc1700 1 -- start start 2023-10-18T14:04:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.630+0000 7fd9b1cc1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0ff5d0 0x7fd9ac197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.630+0000 7fd9b1cc1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9ac0fff90 0x7fd9ac197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.630+0000 7fd9b1cc1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9ac1045e0 0x7fd9ac1a2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9b1cc1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac198740 con 0x7fd9ac0ff5d0 2023-10-18T14:04:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9b1cc1700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac1a2ed0 con 0x7fd9ac1045e0 2023-10-18T14:04:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9b1cc1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac195730 con 0x7fd9ac0fff90 2023-10-18T14:04:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9ab7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0ff5d0 0x7fd9ac197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9ab7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0ff5d0 0x7fd9ac197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44810/0 (socket says 172.21.15.114:44810) 2023-10-18T14:04:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9ab7fe700 1 -- 172.21.15.114:0/388320912 learned_addr learned my addr 172.21.15.114:0/388320912 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9abfff700 1 --2- 172.21.15.114:0/388320912 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9ac1045e0 0x7fd9ac1a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9ab7fe700 1 -- 172.21.15.114:0/388320912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9ac0fff90 msgr2=0x7fd9ac197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9ab7fe700 1 --2- 172.21.15.114:0/388320912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9ac0fff90 0x7fd9ac197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9ab7fe700 1 -- 172.21.15.114:0/388320912 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9ac1045e0 msgr2=0x7fd9ac1a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9ab7fe700 1 --2- 172.21.15.114:0/388320912 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9ac1045e0 0x7fd9ac1a2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9ab7fe700 1 -- 172.21.15.114:0/388320912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a00095f0 con 0x7fd9ac0ff5d0 2023-10-18T14:04:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9ab7fe700 1 --2- 172.21.15.114:0/388320912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0ff5d0 0x7fd9ac197910 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c990 tx=0x7fd99c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.631+0000 7fd9a8ff9700 1 -- 172.21.15.114:0/388320912 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c007b00 con 0x7fd9ac0ff5d0 2023-10-18T14:04:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.632+0000 7fd9b1cc1700 1 -- 172.21.15.114:0/388320912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ac195a10 con 0x7fd9ac0ff5d0 2023-10-18T14:04:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.632+0000 7fd9a8ff9700 1 -- 172.21.15.114:0/388320912 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd99c007c60 con 0x7fd9ac0ff5d0 2023-10-18T14:04:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.632+0000 7fd9a8ff9700 1 -- 172.21.15.114:0/388320912 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c018660 con 0x7fd9ac0ff5d0 2023-10-18T14:04:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.632+0000 7fd9b1cc1700 1 -- 172.21.15.114:0/388320912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac195f70 con 0x7fd9ac0ff5d0 2023-10-18T14:04:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.635+0000 7fd9a8ff9700 1 -- 172.21.15.114:0/388320912 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7fd99c0187c0 con 0x7fd9ac0ff5d0 2023-10-18T14:04:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.636+0000 7fd9a8ff9700 1 --2- 172.21.15.114:0/388320912 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd9940a1560 0x7fd9940a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.636+0000 7fd9aaffd700 1 --2- 172.21.15.114:0/388320912 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd9940a1560 0x7fd9940a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.636+0000 7fd9a8ff9700 1 -- 172.21.15.114:0/388320912 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd99c0cceb0 con 0x7fd9ac0ff5d0 2023-10-18T14:04:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.636+0000 7fd9aaffd700 1 --2- 172.21.15.114:0/388320912 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd9940a1560 0x7fd9940a3a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0003760 tx=0x7fd9a000b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.636+0000 7fd9bdeaab80 1 Processor -- start 2023-10-18T14:04:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.636+0000 7fd9bdeaab80 1 -- start start 2023-10-18T14:04:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9bdeaab80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 0x558a2df88060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9bdeaab80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df885a0 0x558a2df7aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9bdeaab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df7b410 0x558a2df7b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9bdeaab80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2deee680 con 0x558a2df87c80 2023-10-18T14:04:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9bdeaab80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2ded4c00 con 0x558a2df885a0 2023-10-18T14:04:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9bdeaab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2ded2520 con 0x558a2df7b410 2023-10-18T14:04:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9ab7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 0x558a2df88060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9ab7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 0x558a2df88060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44818/0 (socket says 172.21.15.114:44818) 2023-10-18T14:04:57.648 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9ab7fe700 1 -- 172.21.15.114:0/2297901210 learned_addr learned my addr 172.21.15.114:0/2297901210 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:57.648 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9abfff700 1 --2- 172.21.15.114:0/2297901210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df7b410 0x558a2df7b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.648 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9ab7fe700 1 -- 172.21.15.114:0/2297901210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df7b410 msgr2=0x558a2df7b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:57.648 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9ab7fe700 1 --2- 172.21.15.114:0/2297901210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df7b410 0x558a2df7b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.648 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9ab7fe700 1 -- 172.21.15.114:0/2297901210 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df885a0 msgr2=0x558a2df7aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:57.649 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9ab7fe700 1 --2- 172.21.15.114:0/2297901210 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df885a0 0x558a2df7aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.649 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9ab7fe700 1 -- 172.21.15.114:0/2297901210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a2de8b390 con 0x558a2df87c80 2023-10-18T14:04:57.649 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9abfff700 1 --2- 172.21.15.114:0/2297901210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df7b410 0x558a2df7b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:57.649 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.637+0000 7fd9ab7fe700 1 --2- 172.21.15.114:0/2297901210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 0x558a2df88060 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0a1e30 tx=0x7fd99c09a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b554a43ebc0ed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:57.649 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.638+0000 7fd991ffb700 1 -- 172.21.15.114:0/2297901210 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0a2360 con 0x558a2df87c80 2023-10-18T14:04:57.650 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.638+0000 7fd991ffb700 1 -- 172.21.15.114:0/2297901210 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd99c098110 con 0x558a2df87c80 2023-10-18T14:04:57.650 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.638+0000 7fd991ffb700 1 -- 172.21.15.114:0/2297901210 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c094be0 con 0x558a2df87c80 2023-10-18T14:04:57.650 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.638+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/2297901210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 msgr2=0x558a2df88060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:57.650 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.638+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/2297901210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 0x558a2df88060 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0a1e30 tx=0x7fd99c09a750 comp rx=0 tx=0).stop 2023-10-18T14:04:57.650 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.639+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/2297901210 shutdown_connections 2023-10-18T14:04:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.639+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/2297901210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df7b410 0x558a2df7b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.639+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/2297901210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 0x558a2df88060 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.639+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/2297901210 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df885a0 0x558a2df7aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.639+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/2297901210 >> 172.21.15.114:0/2297901210 conn(0x558a2deef6c0 msgr2=0x558a2df755a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.639+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/2297901210 shutdown_connections 2023-10-18T14:04:57.651 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.639+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/2297901210 wait complete. 2023-10-18T14:04:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.639+0000 7fd9bdeaab80 1 -- start start 2023-10-18T14:04:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.639+0000 7fd9bdeaab80 1 Processor -- start 2023-10-18T14:04:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9bdeaab80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 0x558a2df8cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9bdeaab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df87c80 0x558a2df8d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9bdeaab80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df885a0 0x558a2df8d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9bdeaab80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2decde10 con 0x558a2df885a0 2023-10-18T14:04:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9bdeaab80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2de6a6b0 con 0x558a2df7b410 2023-10-18T14:04:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9bdeaab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2de6a350 con 0x558a2df87c80 2023-10-18T14:04:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9bdeaab80 10 client.0 _ll_register_callbacks cb 0x558a2ddb4a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9abfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df885a0 0x558a2df8d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9ab7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 0x558a2df8cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9abfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df885a0 0x558a2df8d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44826/0 (socket says 172.21.15.114:44826) 2023-10-18T14:04:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9ab7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 0x558a2df8cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:40968/0 (socket says 172.21.15.114:40968) 2023-10-18T14:04:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9abfff700 1 -- 172.21.15.114:0/1333103689 learned_addr learned my addr 172.21.15.114:0/1333103689 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9abfff700 1 -- 172.21.15.114:0/1333103689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df87c80 msgr2=0x558a2df8d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9abfff700 1 --2- 172.21.15.114:0/1333103689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df87c80 0x558a2df8d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9abfff700 1 -- 172.21.15.114:0/1333103689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 msgr2=0x558a2df8cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9abfff700 1 --2- 172.21.15.114:0/1333103689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 0x558a2df8cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9abfff700 1 -- 172.21.15.114:0/1333103689 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac195f70 con 0x558a2df885a0 2023-10-18T14:04:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.640+0000 7fd9ab7fe700 1 --2- 172.21.15.114:0/1333103689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 0x558a2df8cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:04:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.641+0000 7fd9abfff700 1 --2- 172.21.15.114:0/1333103689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df885a0 0x558a2df8d710 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400d510 tx=0x7fd9a400d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66596fd5da164571 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.641+0000 7fd98affd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:04:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.641+0000 7fd98affd700 1 -- 172.21.15.114:0/1333103689 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4011810 con 0x558a2df885a0 2023-10-18T14:04:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.641+0000 7fd98affd700 1 -- 172.21.15.114:0/1333103689 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd9a4011970 con 0x558a2df885a0 2023-10-18T14:04:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.641+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/1333103689 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a2ded2e90 con 0x558a2df885a0 2023-10-18T14:04:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.641+0000 7fd98affd700 1 -- 172.21.15.114:0/1333103689 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9a4011b30 con 0x558a2df885a0 2023-10-18T14:04:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.641+0000 7fd9bdeaab80 10 client.15909 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.641+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/1333103689 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558a2dcf8d80 con 0x558a2df885a0 2023-10-18T14:04:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.641+0000 7fd98affd700 1 -- 172.21.15.114:0/1333103689 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558a2ded2e90 con 0x558a2df885a0 2023-10-18T14:04:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.642+0000 7fd98affd700 1 -- 172.21.15.114:0/1333103689 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd9a40193b0 con 0x558a2df885a0 2023-10-18T14:04:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.642+0000 7fd9bdeaab80 10 client.15909 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.642+0000 7fd9bdeaab80 10 client.15909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.642+0000 7fd9bdeaab80 20 client.15909 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.642+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/1333103689 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2df9d270 0x558a2df9f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.660 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.642+0000 7fd9bdeaab80 4 client.15909 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:04:57.660 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.642+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/1333103689 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a2df4a850 con 0x558a2df9d270 2023-10-18T14:04:57.660 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.643+0000 7fd9ab7fe700 1 --2- 172.21.15.114:0/1333103689 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2df9d270 0x558a2df9f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.660 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.643+0000 7fd98affd700 10 client.15909 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:57.660 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.643+0000 7fd9ab7fe700 1 --2- 172.21.15.114:0/1333103689 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2df9d270 0x558a2df9f690 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bed3c35e8632e765 server_cookie=a97de3b4e9ec2c5e in_seq=0 out_seq=0 2023-10-18T14:04:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.644+0000 7fd98affd700 1 -- 172.21.15.114:0/1333103689 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558a2df4a850 con 0x558a2df9d270 2023-10-18T14:04:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.644+0000 7fd98affd700 10 client.15909 handle_command_reply: tid=0 2023-10-18T14:04:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.644+0000 7fd9bdeaab80 1 client.15909 shutdown 2023-10-18T14:04:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.644+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/1333103689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df885a0 msgr2=0x558a2df8d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.644+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/1333103689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df885a0 0x558a2df8d710 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400d510 tx=0x7fd9a400d820 comp rx=0 tx=0).stop 2023-10-18T14:04:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.644+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/1333103689 shutdown_connections 2023-10-18T14:04:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.644+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/1333103689 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2df9d270 0x558a2df9f690 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.644+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/1333103689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df885a0 0x558a2df8d710 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.644+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/1333103689 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 0x558a2df8cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.644+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/1333103689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df87c80 0x558a2df8d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.644+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/1333103689 >> 172.21.15.114:0/1333103689 conn(0x558a2deef6c0 msgr2=0x558a2df74d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.644+0000 7fd98affd700 0 client.15909 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.645+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/1333103689 shutdown_connections 2023-10-18T14:04:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.645+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/1333103689 wait complete. 2023-10-18T14:04:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.645+0000 7fd9bdeaab80 20 client.15909 trim_cache size 0 max 16384 2023-10-18T14:04:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.673+0000 7fd9bdeaab80 1 Processor -- start 2023-10-18T14:04:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.673+0000 7fd9bdeaab80 1 -- start start 2023-10-18T14:04:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9bdeaab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df7b410 0x558a2df78ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9bdeaab80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 0x558a2df941e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9bdeaab80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df885a0 0x558a2df8b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9bdeaab80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2dd4e8c0 con 0x558a2df87c80 2023-10-18T14:04:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9bdeaab80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2df8e120 con 0x558a2df885a0 2023-10-18T14:04:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9bdeaab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2df72090 con 0x558a2df7b410 2023-10-18T14:04:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9aaffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 0x558a2df941e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9aaffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 0x558a2df941e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44834/0 (socket says 172.21.15.114:44834) 2023-10-18T14:04:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9aaffd700 1 -- 172.21.15.114:0/1911645171 learned_addr learned my addr 172.21.15.114:0/1911645171 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9ab7fe700 1 --2- 172.21.15.114:0/1911645171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df7b410 0x558a2df78ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9abfff700 1 --2- 172.21.15.114:0/1911645171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df885a0 0x558a2df8b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9aaffd700 1 -- 172.21.15.114:0/1911645171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df7b410 msgr2=0x558a2df78ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9aaffd700 1 --2- 172.21.15.114:0/1911645171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df7b410 0x558a2df78ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9aaffd700 1 -- 172.21.15.114:0/1911645171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df885a0 msgr2=0x558a2df8b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9aaffd700 1 --2- 172.21.15.114:0/1911645171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df885a0 0x558a2df8b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9aaffd700 1 -- 172.21.15.114:0/1911645171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a2dce1c00 con 0x558a2df87c80 2023-10-18T14:04:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9abfff700 1 --2- 172.21.15.114:0/1911645171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df885a0 0x558a2df8b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:04:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.674+0000 7fd9aaffd700 1 --2- 172.21.15.114:0/1911645171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 0x558a2df941e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0015000 tx=0x7fd9a0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ff59a294ae638f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.675+0000 7fd9927fc700 1 -- 172.21.15.114:0/1911645171 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0029070 con 0x558a2df87c80 2023-10-18T14:04:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.675+0000 7fd9927fc700 1 -- 172.21.15.114:0/1911645171 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9a0003c80 con 0x558a2df87c80 2023-10-18T14:04:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.675+0000 7fd9927fc700 1 -- 172.21.15.114:0/1911645171 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a001d070 con 0x558a2df87c80 2023-10-18T14:04:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.676+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/1911645171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 msgr2=0x558a2df941e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.676+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/1911645171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 0x558a2df941e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0015000 tx=0x7fd9a0009310 comp rx=0 tx=0).stop 2023-10-18T14:04:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.676+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/1911645171 shutdown_connections 2023-10-18T14:04:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.676+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/1911645171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df885a0 0x558a2df8b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.676+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/1911645171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df7b410 0x558a2df78ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.676+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/1911645171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df87c80 0x558a2df941e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.676+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/1911645171 >> 172.21.15.114:0/1911645171 conn(0x558a2deef6c0 msgr2=0x558a2df79780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.676+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/1911645171 shutdown_connections 2023-10-18T14:04:57.687 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.676+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/1911645171 wait complete. 2023-10-18T14:04:57.687 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.676+0000 7fd9bdeaab80 1 -- start start 2023-10-18T14:04:57.687 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.677+0000 7fd9bdeaab80 1 Processor -- start 2023-10-18T14:04:57.687 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.677+0000 7fd9bdeaab80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 0x558a2df784d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.687 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.677+0000 7fd9bdeaab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df87c80 0x558a2df78a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.687 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.677+0000 7fd9bdeaab80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df885a0 0x558a2df744d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.677+0000 7fd9bdeaab80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2df790e0 con 0x558a2df885a0 2023-10-18T14:04:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.677+0000 7fd9bdeaab80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2df79250 con 0x558a2df7b410 2023-10-18T14:04:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.677+0000 7fd9bdeaab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2df74a10 con 0x558a2df87c80 2023-10-18T14:04:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.677+0000 7fd9bdeaab80 10 client.0 _ll_register_callbacks cb 0x558a2ddb4a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:04:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.677+0000 7fd9ab7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 0x558a2df784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.677+0000 7fd9ab7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 0x558a2df784d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:40982/0 (socket says 172.21.15.114:40982) 2023-10-18T14:04:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.677+0000 7fd9ab7fe700 1 -- 172.21.15.114:0/3961728831 learned_addr learned my addr 172.21.15.114:0/3961728831 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:04:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.677+0000 7fd9abfff700 1 --2- 172.21.15.114:0/3961728831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df885a0 0x558a2df744d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd9ab7fe700 1 -- 172.21.15.114:0/3961728831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df87c80 msgr2=0x558a2df78a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-18T14:04:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd9ab7fe700 1 --2- 172.21.15.114:0/3961728831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df87c80 0x558a2df78a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd9ab7fe700 1 -- 172.21.15.114:0/3961728831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df885a0 msgr2=0x558a2df744d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:04:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd9ab7fe700 1 --2- 172.21.15.114:0/3961728831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df885a0 0x558a2df744d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd9ab7fe700 1 -- 172.21.15.114:0/3961728831 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac10cd90 con 0x558a2df7b410 2023-10-18T14:04:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd9abfff700 1 --2- 172.21.15.114:0/3961728831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df885a0 0x558a2df744d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:04:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd9ab7fe700 1 --2- 172.21.15.114:0/3961728831 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 0x558a2df784d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0cad40 tx=0x7fd99c099da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=506f8b75549cc992 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:04:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd98affd700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:04:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd98affd700 1 -- 172.21.15.114:0/3961728831 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0b6040 con 0x558a2df7b410 2023-10-18T14:04:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/3961728831 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd99c098110 con 0x558a2df7b410 2023-10-18T14:04:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd98affd700 1 -- 172.21.15.114:0/3961728831 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd99c0833e0 con 0x558a2df7b410 2023-10-18T14:04:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd98affd700 1 -- 172.21.15.114:0/3961728831 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd99c0caa10 con 0x558a2df7b410 2023-10-18T14:04:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd9bdeaab80 10 client.25166 fetch_fsmap learned FSMap version 26 2023-10-18T14:04:57.692 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.678+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/3961728831 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558a2dd1f1f0 con 0x558a2df7b410 2023-10-18T14:04:57.692 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.679+0000 7fd98affd700 1 -- 172.21.15.114:0/3961728831 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd99c098110 con 0x558a2df7b410 2023-10-18T14:04:57.692 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.679+0000 7fd98affd700 1 -- 172.21.15.114:0/3961728831 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd99c09a330 con 0x558a2df7b410 2023-10-18T14:04:57.692 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.679+0000 7fd9bdeaab80 10 client.25166 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:04:57.692 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.679+0000 7fd9bdeaab80 10 client.25166 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:04:57.693 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.679+0000 7fd9bdeaab80 20 client.25166 populate_metadata read hostname 'smithi114' 2023-10-18T14:04:57.693 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.679+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/3961728831 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2dff1970 0x558a2dff3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:04:57.693 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.679+0000 7fd9bdeaab80 4 client.25166 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:04:57.693 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.679+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/3961728831 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558a2dec6df0 con 0x558a2dff1970 2023-10-18T14:04:57.694 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.680+0000 7fd9aaffd700 1 --2- 172.21.15.114:0/3961728831 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2dff1970 0x558a2dff3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:04:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.680+0000 7fd98affd700 10 client.25166 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.680+0000 7fd9aaffd700 1 --2- 172.21.15.114:0/3961728831 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2dff1970 0x558a2dff3db0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68004b8036ba05ec server_cookie=6a06f575b59fc977 in_seq=0 out_seq=0 2023-10-18T14:04:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.684+0000 7fd98affd700 1 -- 172.21.15.114:0/3961728831 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558a2dec6df0 con 0x558a2dff1970 2023-10-18T14:04:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.684+0000 7fd98affd700 10 client.25166 handle_command_reply: tid=0 2023-10-18T14:04:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.684+0000 7fd9bdeaab80 1 client.25166 shutdown 2023-10-18T14:04:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.684+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/3961728831 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 msgr2=0x558a2df784d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.684+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/3961728831 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 0x558a2df784d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0cad40 tx=0x7fd99c099da0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.684+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/3961728831 shutdown_connections 2023-10-18T14:04:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.684+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/3961728831 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2dff1970 0x558a2dff3db0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.684+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/3961728831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2df885a0 0x558a2df744d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.684+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/3961728831 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2df7b410 0x558a2df784d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.684+0000 7fd9bdeaab80 1 --2- 172.21.15.114:0/3961728831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2df87c80 0x558a2df78a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.684+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/3961728831 >> 172.21.15.114:0/3961728831 conn(0x558a2deef6c0 msgr2=0x558a2df7a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.684+0000 7fd98affd700 0 client.25166 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:04:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.684+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/3961728831 shutdown_connections 2023-10-18T14:04:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.685+0000 7fd9bdeaab80 1 -- 172.21.15.114:0/3961728831 wait complete. 2023-10-18T14:04:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.685+0000 7fd9bdeaab80 20 client.25166 trim_cache size 0 max 16384 2023-10-18T14:04:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:04:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:04:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:04:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:04:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.685+0000 7fd9b1cc1700 1 -- 172.21.15.114:0/388320912 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd9940a1560 msgr2=0x7fd9940a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.685+0000 7fd9b1cc1700 1 --2- 172.21.15.114:0/388320912 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd9940a1560 0x7fd9940a3a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0003760 tx=0x7fd9a000b540 comp rx=0 tx=0).stop 2023-10-18T14:04:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.685+0000 7fd9b1cc1700 1 -- 172.21.15.114:0/388320912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0ff5d0 msgr2=0x7fd9ac197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:04:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.685+0000 7fd9b1cc1700 1 --2- 172.21.15.114:0/388320912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0ff5d0 0x7fd9ac197910 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c990 tx=0x7fd99c00cd50 comp rx=0 tx=0).stop 2023-10-18T14:04:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.685+0000 7fd9b1cc1700 1 -- 172.21.15.114:0/388320912 shutdown_connections 2023-10-18T14:04:57.701 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.685+0000 7fd9b1cc1700 1 --2- 172.21.15.114:0/388320912 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd9940a1560 0x7fd9940a3a20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.701 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.685+0000 7fd9b1cc1700 1 --2- 172.21.15.114:0/388320912 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd9ac1045e0 0x7fd9ac1a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.701 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.685+0000 7fd9b1cc1700 1 --2- 172.21.15.114:0/388320912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0ff5d0 0x7fd9ac197910 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.701 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.685+0000 7fd9b1cc1700 1 --2- 172.21.15.114:0/388320912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9ac0fff90 0x7fd9ac197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:04:57.701 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.685+0000 7fd9b1cc1700 1 -- 172.21.15.114:0/388320912 >> 172.21.15.114:0/388320912 conn(0x7fd9ac076790 msgr2=0x7fd9ac0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:04:57.701 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.686+0000 7fd9b1cc1700 1 -- 172.21.15.114:0/388320912 shutdown_connections 2023-10-18T14:04:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:04:57.686+0000 7fd9b1cc1700 1 -- 172.21.15.114:0/388320912 wait complete. 2023-10-18T14:04:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:04:58 smithi158 ceph-mon[103317]: pgmap v308: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-18T14:04:59.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:04:58 smithi172 ceph-mon[103574]: pgmap v308: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-18T14:04:59.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:04:58 smithi114 ceph-mon[99494]: pgmap v308: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-18T14:05:00.588 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 14:05:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T14:05:00.108+0000 7f3b7cb1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T14:05:00.589 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 14:05:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T14:05:00.108+0000 7f3b7cb1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T14:05:00.589 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 14:05:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T14:05:00.108+0000 7f3b7cb1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T14:05:00.589 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 14:05:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T14:05:00.108+0000 7f3b7cb1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T14:05:00.589 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 14:05:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T14:05:00.108+0000 7f3b7cb1b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T14:05:01.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:00 smithi158 ceph-mon[103317]: pgmap v309: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-18T14:05:01.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:00 smithi172 ceph-mon[103574]: pgmap v309: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-18T14:05:01.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:00 smithi114 ceph-mon[99494]: pgmap v309: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-18T14:05:03.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:02 smithi158 ceph-mon[103317]: pgmap v310: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 22 op/s 2023-10-18T14:05:03.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:02 smithi172 ceph-mon[103574]: pgmap v310: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 22 op/s 2023-10-18T14:05:03.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:02 smithi114 ceph-mon[99494]: pgmap v310: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 22 op/s 2023-10-18T14:05:04.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:03 smithi158 ceph-mon[103317]: mgrmap e24: x(active, since 7m), standbys: z, y 2023-10-18T14:05:04.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:03 smithi172 ceph-mon[103574]: mgrmap e24: x(active, since 7m), standbys: z, y 2023-10-18T14:05:04.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:03 smithi114 ceph-mon[99494]: mgrmap e24: x(active, since 7m), standbys: z, y 2023-10-18T14:05:05.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:04 smithi158 ceph-mon[103317]: pgmap v311: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-18T14:05:05.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:04 smithi172 ceph-mon[103574]: pgmap v311: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-18T14:05:05.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:04 smithi114 ceph-mon[99494]: pgmap v311: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-18T14:05:05.616 INFO:tasks.workunit.client.0.smithi114.stderr:Note: switching to 'f7420d7f8e55ceea786dcbf536c338ce920c21eb'. 2023-10-18T14:05:05.616 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:05.617 INFO:tasks.workunit.client.0.smithi114.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-18T14:05:05.617 INFO:tasks.workunit.client.0.smithi114.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-18T14:05:05.617 INFO:tasks.workunit.client.0.smithi114.stderr:state without impacting any branches by switching back to a branch. 2023-10-18T14:05:05.617 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:05.617 INFO:tasks.workunit.client.0.smithi114.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-18T14:05:05.618 INFO:tasks.workunit.client.0.smithi114.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-18T14:05:05.618 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:05.618 INFO:tasks.workunit.client.0.smithi114.stderr: git switch -c 2023-10-18T14:05:05.618 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:05.618 INFO:tasks.workunit.client.0.smithi114.stderr:Or undo this operation with: 2023-10-18T14:05:05.619 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:05.619 INFO:tasks.workunit.client.0.smithi114.stderr: git switch - 2023-10-18T14:05:05.619 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:05.619 INFO:tasks.workunit.client.0.smithi114.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-18T14:05:05.619 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:05.620 INFO:tasks.workunit.client.0.smithi114.stderr:HEAD is now at f7420d7f8e5 Merge PR #48130 into wip-batrick-testing-20231016.203825 2023-10-18T14:05:05.621 DEBUG:teuthology.orchestra.run.smithi114:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-18T14:05:05.652 INFO:tasks.workunit.client.0.smithi114.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-18T14:05:05.654 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-18T14:05:05.655 INFO:tasks.workunit.client.0.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-18T14:05:06.197 INFO:tasks.workunit.client.0.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-18T14:05:06.260 INFO:tasks.workunit.client.0.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-18T14:05:06.298 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-18T14:05:06.299 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-18T14:05:06.300 INFO:tasks.workunit.client.0.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-18T14:05:06.336 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-18T14:05:06.339 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T14:05:06.340 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-18T14:05:06.397 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2023-10-18T14:05:06.398 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2023-10-18T14:05:06.398 DEBUG:teuthology.orchestra.run.smithi114:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f7420d7f8e55ceea786dcbf536c338ce920c21eb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2023-10-18T14:05:06.458 INFO:tasks.workunit.client.0.smithi114.stderr:+ set -e 2023-10-18T14:05:06.459 INFO:tasks.workunit.client.0.smithi114.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2023-10-18T14:05:06.461 INFO:tasks.workunit.client.0.smithi114.stderr:Cloning into 'xfstests-dev'... 2023-10-18T14:05:06.480 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:05:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.616+0000 7fd2f7c19700 1 -- 172.21.15.114:0/1689080501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f0106860 msgr2=0x7fd2f0106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.616+0000 7fd2f7c19700 1 --2- 172.21.15.114:0/1689080501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f0106860 0x7fd2f0106c40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009990 tx=0x7fd2ec009ca0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.616+0000 7fd2f7c19700 1 -- 172.21.15.114:0/1689080501 shutdown_connections 2023-10-18T14:05:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.616+0000 7fd2f7c19700 1 --2- 172.21.15.114:0/1689080501 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2f00ffae0 0x7fd2f010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.616+0000 7fd2f7c19700 1 --2- 172.21.15.114:0/1689080501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f0106860 0x7fd2f0106c40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.616+0000 7fd2f7c19700 1 --2- 172.21.15.114:0/1689080501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f00ff120 0x7fd2f00ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.616+0000 7fd2f7c19700 1 -- 172.21.15.114:0/1689080501 >> 172.21.15.114:0/1689080501 conn(0x7fd2f0074890 msgr2=0x7fd2f0074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f7c19700 1 -- 172.21.15.114:0/1689080501 shutdown_connections 2023-10-18T14:05:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f7c19700 1 -- 172.21.15.114:0/1689080501 wait complete. 2023-10-18T14:05:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f7c19700 1 Processor -- start 2023-10-18T14:05:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f7c19700 1 -- start start 2023-10-18T14:05:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f7c19700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f00ff120 0x7fd2f019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f7c19700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f00ffae0 0x7fd2f019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f7c19700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2f0106860 0x7fd2f0196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f7c19700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f01970f0 con 0x7fd2f00ff120 2023-10-18T14:05:06.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f7c19700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0197260 con 0x7fd2f0106860 2023-10-18T14:05:06.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f7c19700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0197420 con 0x7fd2f00ffae0 2023-10-18T14:05:06.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f59b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f00ff120 0x7fd2f019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f59b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f00ff120 0x7fd2f019c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44876/0 (socket says 172.21.15.114:44876) 2023-10-18T14:05:06.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f59b5700 1 -- 172.21.15.114:0/629264625 learned_addr learned my addr 172.21.15.114:0/629264625 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:06.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.617+0000 7fd2f51b4700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f00ffae0 0x7fd2f019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.618+0000 7fd2f61b6700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2f0106860 0x7fd2f0196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.618+0000 7fd2f59b5700 1 -- 172.21.15.114:0/629264625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f00ffae0 msgr2=0x7fd2f019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:06.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.618+0000 7fd2f59b5700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f00ffae0 0x7fd2f019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.618+0000 7fd2f59b5700 1 -- 172.21.15.114:0/629264625 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2f0106860 msgr2=0x7fd2f0196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:06.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.618+0000 7fd2f59b5700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2f0106860 0x7fd2f0196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.618+0000 7fd2f59b5700 1 -- 172.21.15.114:0/629264625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec0095f0 con 0x7fd2f00ff120 2023-10-18T14:05:06.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.618+0000 7fd2f59b5700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f00ff120 0x7fd2f019c910 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec004760 tx=0x7fd2ec004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:06.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.618+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/629264625 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec01d070 con 0x7fd2f00ff120 2023-10-18T14:05:06.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.618+0000 7fd2f7c19700 1 -- 172.21.15.114:0/629264625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f01976a0 con 0x7fd2f00ff120 2023-10-18T14:05:06.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.618+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/629264625 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2ec00fbf0 con 0x7fd2f00ff120 2023-10-18T14:05:06.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.618+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/629264625 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec022d50 con 0x7fd2f00ff120 2023-10-18T14:05:06.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.618+0000 7fd2f7c19700 1 -- 172.21.15.114:0/629264625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f0100230 con 0x7fd2f00ff120 2023-10-18T14:05:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.620+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/629264625 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fd2ec022470 con 0x7fd2f00ff120 2023-10-18T14:05:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.621+0000 7fd2e6ffd700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd2dc0a5a00 0x7fd2dc0a7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.621+0000 7fd2e6ffd700 1 -- 172.21.15.114:0/629264625 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd2ec0ce080 con 0x7fd2f00ff120 2023-10-18T14:05:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.621+0000 7fd2f51b4700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd2dc0a5a00 0x7fd2dc0a7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.621+0000 7fd2f51b4700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd2dc0a5a00 0x7fd2dc0a7ec0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0197c00 tx=0x7fd2e000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.622+0000 7fd303e02b80 1 Processor -- start 2023-10-18T14:05:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.622+0000 7fd303e02b80 1 -- start start 2023-10-18T14:05:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.622+0000 7fd303e02b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 0x557f371b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.622+0000 7fd303e02b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b5500 0x557f371af090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.622+0000 7fd303e02b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371af5d0 0x557f371afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.622+0000 7fd303e02b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f371226e0 con 0x557f371b4be0 2023-10-18T14:05:06.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.622+0000 7fd303e02b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f37108c60 con 0x557f371af5d0 2023-10-18T14:05:06.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.622+0000 7fd303e02b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f37106580 con 0x557f371b5500 2023-10-18T14:05:06.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.622+0000 7fd2f59b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 0x557f371b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.623+0000 7fd2f51b4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b5500 0x557f371af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.623+0000 7fd2f59b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 0x557f371b4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44884/0 (socket says 172.21.15.114:44884) 2023-10-18T14:05:06.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.623+0000 7fd2f59b5700 1 -- 172.21.15.114:0/1154215228 learned_addr learned my addr 172.21.15.114:0/1154215228 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:06.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.623+0000 7fd2f61b6700 1 --2- 172.21.15.114:0/1154215228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371af5d0 0x557f371afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.623+0000 7fd2f59b5700 1 -- 172.21.15.114:0/1154215228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b5500 msgr2=0x557f371af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:06.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.623+0000 7fd2f59b5700 1 --2- 172.21.15.114:0/1154215228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b5500 0x557f371af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.623+0000 7fd2f59b5700 1 -- 172.21.15.114:0/1154215228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371af5d0 msgr2=0x557f371afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:06.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.623+0000 7fd2f59b5700 1 --2- 172.21.15.114:0/1154215228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371af5d0 0x557f371afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.623+0000 7fd2f59b5700 1 -- 172.21.15.114:0/1154215228 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f370bf3f0 con 0x557f371b4be0 2023-10-18T14:05:06.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.623+0000 7fd2f59b5700 1 --2- 172.21.15.114:0/1154215228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 0x557f371b4fc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec09b1a0 tx=0x7fd2ec009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0d9b2e865a0432 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:06.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.623+0000 7fd2dbfff700 1 -- 172.21.15.114:0/1154215228 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec09b910 con 0x557f371b4be0 2023-10-18T14:05:06.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.623+0000 7fd2dbfff700 1 -- 172.21.15.114:0/1154215228 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2ec09f120 con 0x557f371b4be0 2023-10-18T14:05:06.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.623+0000 7fd2dbfff700 1 -- 172.21.15.114:0/1154215228 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec09b470 con 0x557f371b4be0 2023-10-18T14:05:06.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.624+0000 7fd303e02b80 1 -- 172.21.15.114:0/1154215228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 msgr2=0x557f371b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:06.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.624+0000 7fd303e02b80 1 --2- 172.21.15.114:0/1154215228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 0x557f371b4fc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec09b1a0 tx=0x7fd2ec009ca0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.624+0000 7fd303e02b80 1 -- 172.21.15.114:0/1154215228 shutdown_connections 2023-10-18T14:05:06.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.624+0000 7fd303e02b80 1 --2- 172.21.15.114:0/1154215228 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371af5d0 0x557f371afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.624+0000 7fd303e02b80 1 --2- 172.21.15.114:0/1154215228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 0x557f371b4fc0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.624+0000 7fd303e02b80 1 --2- 172.21.15.114:0/1154215228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b5500 0x557f371af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.624+0000 7fd303e02b80 1 -- 172.21.15.114:0/1154215228 >> 172.21.15.114:0/1154215228 conn(0x557f37123720 msgr2=0x557f371a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:06.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.624+0000 7fd303e02b80 1 -- 172.21.15.114:0/1154215228 shutdown_connections 2023-10-18T14:05:06.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.624+0000 7fd303e02b80 1 -- 172.21.15.114:0/1154215228 wait complete. 2023-10-18T14:05:06.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.624+0000 7fd303e02b80 1 -- start start 2023-10-18T14:05:06.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.624+0000 7fd303e02b80 1 Processor -- start 2023-10-18T14:05:06.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd303e02b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 0x557f371bb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd303e02b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b4be0 0x557f371b8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd303e02b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371b5500 0x557f371b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd303e02b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f37101e70 con 0x557f371af5d0 2023-10-18T14:05:06.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd303e02b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3709e710 con 0x557f371b5500 2023-10-18T14:05:06.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd303e02b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3709e3b0 con 0x557f371b4be0 2023-10-18T14:05:06.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd303e02b80 10 client.0 _ll_register_callbacks cb 0x557f36fe8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:06.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2f59b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 0x557f371bb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2f59b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 0x557f371bb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44890/0 (socket says 172.21.15.114:44890) 2023-10-18T14:05:06.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2f59b5700 1 -- 172.21.15.114:0/1555085452 learned_addr learned my addr 172.21.15.114:0/1555085452 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:06.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2f51b4700 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b4be0 0x557f371b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2f61b6700 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371b5500 0x557f371b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2f59b5700 1 -- 172.21.15.114:0/1555085452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b4be0 msgr2=0x557f371b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:06.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2f59b5700 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b4be0 0x557f371b8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2f59b5700 1 -- 172.21.15.114:0/1555085452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371b5500 msgr2=0x557f371b8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:06.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2f59b5700 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371b5500 0x557f371b8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2f59b5700 1 -- 172.21.15.114:0/1555085452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f0100230 con 0x557f371af5d0 2023-10-18T14:05:06.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2f61b6700 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371b5500 0x557f371b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:06.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2f59b5700 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 0x557f371bb3c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec006010 tx=0x7fd2ec009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1e114ba38d6010 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:06.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:06.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2d97fa700 1 -- 172.21.15.114:0/1555085452 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec09b910 con 0x557f371af5d0 2023-10-18T14:05:06.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd2d97fa700 1 -- 172.21.15.114:0/1555085452 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd2ec09b210 con 0x557f371af5d0 2023-10-18T14:05:06.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.625+0000 7fd303e02b80 1 -- 172.21.15.114:0/1555085452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f37106ef0 con 0x557f371af5d0 2023-10-18T14:05:06.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.626+0000 7fd2d97fa700 1 -- 172.21.15.114:0/1555085452 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2ec0a3510 con 0x557f371af5d0 2023-10-18T14:05:06.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.626+0000 7fd303e02b80 10 client.15930 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:06.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.626+0000 7fd303e02b80 1 -- 172.21.15.114:0/1555085452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557f36f2cde0 con 0x557f371af5d0 2023-10-18T14:05:06.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.626+0000 7fd2d97fa700 1 -- 172.21.15.114:0/1555085452 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557f37106ef0 con 0x557f371af5d0 2023-10-18T14:05:06.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.626+0000 7fd2d97fa700 1 -- 172.21.15.114:0/1555085452 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd2ec0a1120 con 0x557f371af5d0 2023-10-18T14:05:06.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.626+0000 7fd303e02b80 10 client.15930 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:06.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.626+0000 7fd303e02b80 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:06.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.626+0000 7fd303e02b80 20 client.15930 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:06.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.626+0000 7fd303e02b80 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x557f371c8630 0x557f371caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.626+0000 7fd303e02b80 4 client.15930 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:06.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.626+0000 7fd303e02b80 1 -- 172.21.15.114:0/1555085452 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f3717e8b0 con 0x557f371c8630 2023-10-18T14:05:06.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.626+0000 7fd2f51b4700 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x557f371c8630 0x557f371caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd2d97fa700 10 client.15930 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:06.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd2f51b4700 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x557f371c8630 0x557f371caa20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3708ff6d8377597 server_cookie=afbba57b51eec9a6 in_seq=0 out_seq=0 2023-10-18T14:05:06.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd2d97fa700 1 -- 172.21.15.114:0/1555085452 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557f3717e8b0 con 0x557f371c8630 2023-10-18T14:05:06.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd2d97fa700 10 client.15930 handle_command_reply: tid=0 2023-10-18T14:05:06.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd303e02b80 1 client.15930 shutdown 2023-10-18T14:05:06.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd303e02b80 1 -- 172.21.15.114:0/1555085452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 msgr2=0x557f371bb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:06.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd303e02b80 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 0x557f371bb3c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec006010 tx=0x7fd2ec009310 comp rx=0 tx=0).stop 2023-10-18T14:05:06.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd303e02b80 1 -- 172.21.15.114:0/1555085452 shutdown_connections 2023-10-18T14:05:06.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd303e02b80 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x557f371c8630 0x557f371caa20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd303e02b80 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371b5500 0x557f371b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd303e02b80 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 0x557f371bb3c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd2d97fa700 0 client.15930 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:06.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd303e02b80 1 --2- 172.21.15.114:0/1555085452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b4be0 0x557f371b8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd303e02b80 1 -- 172.21.15.114:0/1555085452 >> 172.21.15.114:0/1555085452 conn(0x557f37123720 msgr2=0x557f371ae080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:06.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.627+0000 7fd303e02b80 1 -- 172.21.15.114:0/1555085452 shutdown_connections 2023-10-18T14:05:06.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.628+0000 7fd303e02b80 1 -- 172.21.15.114:0/1555085452 wait complete. 2023-10-18T14:05:06.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.628+0000 7fd303e02b80 20 client.15930 trim_cache size 0 max 16384 2023-10-18T14:05:06.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.644+0000 7fd303e02b80 1 Processor -- start 2023-10-18T14:05:06.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.644+0000 7fd303e02b80 1 -- start start 2023-10-18T14:05:06.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd303e02b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371af5d0 0x557f371bf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd303e02b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 0x557f371ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd303e02b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b5500 0x557f371b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd303e02b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f36f82920 con 0x557f371b4be0 2023-10-18T14:05:06.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd303e02b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f37106ef0 con 0x557f371af5d0 2023-10-18T14:05:06.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd303e02b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f371b0030 con 0x557f371b5500 2023-10-18T14:05:06.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2f51b4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 0x557f371ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2f51b4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 0x557f371ae080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44898/0 (socket says 172.21.15.114:44898) 2023-10-18T14:05:06.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2f51b4700 1 -- 172.21.15.114:0/3443689259 learned_addr learned my addr 172.21.15.114:0/3443689259 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:06.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2f61b6700 1 --2- 172.21.15.114:0/3443689259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b5500 0x557f371b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2f59b5700 1 --2- 172.21.15.114:0/3443689259 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371af5d0 0x557f371bf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2f51b4700 1 -- 172.21.15.114:0/3443689259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b5500 msgr2=0x557f371b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:06.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2f51b4700 1 --2- 172.21.15.114:0/3443689259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b5500 0x557f371b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2f51b4700 1 -- 172.21.15.114:0/3443689259 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371af5d0 msgr2=0x557f371bf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:06.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2f51b4700 1 --2- 172.21.15.114:0/3443689259 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371af5d0 0x557f371bf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2f51b4700 1 -- 172.21.15.114:0/3443689259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f36f15c60 con 0x557f371b4be0 2023-10-18T14:05:06.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2f51b4700 1 --2- 172.21.15.114:0/3443689259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 0x557f371ae080 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0005d90 tx=0x7fd2e0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc73de86447aa05 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:06.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2e4d82700 1 -- 172.21.15.114:0/3443689259 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0024040 con 0x557f371b4be0 2023-10-18T14:05:06.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2e4d82700 1 -- 172.21.15.114:0/3443689259 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2e0015070 con 0x557f371b4be0 2023-10-18T14:05:06.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.645+0000 7fd2e4d82700 1 -- 172.21.15.114:0/3443689259 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0004a90 con 0x557f371b4be0 2023-10-18T14:05:06.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.646+0000 7fd303e02b80 1 -- 172.21.15.114:0/3443689259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 msgr2=0x557f371ae080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:06.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.646+0000 7fd303e02b80 1 --2- 172.21.15.114:0/3443689259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 0x557f371ae080 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0005d90 tx=0x7fd2e0013000 comp rx=0 tx=0).stop 2023-10-18T14:05:06.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.646+0000 7fd303e02b80 1 -- 172.21.15.114:0/3443689259 shutdown_connections 2023-10-18T14:05:06.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.646+0000 7fd303e02b80 1 --2- 172.21.15.114:0/3443689259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b5500 0x557f371b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.646+0000 7fd303e02b80 1 --2- 172.21.15.114:0/3443689259 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371af5d0 0x557f371bf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.646+0000 7fd303e02b80 1 --2- 172.21.15.114:0/3443689259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371b4be0 0x557f371ae080 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.646+0000 7fd303e02b80 1 -- 172.21.15.114:0/3443689259 >> 172.21.15.114:0/3443689259 conn(0x557f37123720 msgr2=0x557f371ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.646+0000 7fd303e02b80 1 -- 172.21.15.114:0/3443689259 shutdown_connections 2023-10-18T14:05:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.646+0000 7fd303e02b80 1 -- 172.21.15.114:0/3443689259 wait complete. 2023-10-18T14:05:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.646+0000 7fd303e02b80 1 -- start start 2023-10-18T14:05:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd303e02b80 1 Processor -- start 2023-10-18T14:05:06.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd303e02b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 0x557f371bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd303e02b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b4be0 0x557f371be050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd303e02b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371b5500 0x557f371be770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd303e02b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f371bee80 con 0x557f371af5d0 2023-10-18T14:05:06.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd303e02b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3721c400 con 0x557f371b5500 2023-10-18T14:05:06.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd303e02b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3721c540 con 0x557f371b4be0 2023-10-18T14:05:06.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd303e02b80 10 client.0 _ll_register_callbacks cb 0x557f36fe8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:06.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd2f59b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 0x557f371bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd2f59b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 0x557f371bfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44904/0 (socket says 172.21.15.114:44904) 2023-10-18T14:05:06.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd2f51b4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b4be0 0x557f371be050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd2f59b5700 1 -- 172.21.15.114:0/88965207 learned_addr learned my addr 172.21.15.114:0/88965207 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:06.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd2f61b6700 1 --2- 172.21.15.114:0/88965207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371b5500 0x557f371be770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd2f59b5700 1 -- 172.21.15.114:0/88965207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b4be0 msgr2=0x557f371be050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:06.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd2f59b5700 1 --2- 172.21.15.114:0/88965207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b4be0 0x557f371be050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd2f59b5700 1 -- 172.21.15.114:0/88965207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371b5500 msgr2=0x557f371be770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:06.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd2f59b5700 1 --2- 172.21.15.114:0/88965207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371b5500 0x557f371be770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd2f59b5700 1 -- 172.21.15.114:0/88965207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e0010d00 con 0x557f371af5d0 2023-10-18T14:05:06.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.647+0000 7fd2f61b6700 1 --2- 172.21.15.114:0/88965207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371b5500 0x557f371be770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:06.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd2f59b5700 1 --2- 172.21.15.114:0/88965207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 0x557f371bfb60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec097710 tx=0x7fd2ec09ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c80477fe1e1a5c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:06.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd2d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:06.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd2d97fa700 1 -- 172.21.15.114:0/88965207 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec09b910 con 0x557f371af5d0 2023-10-18T14:05:06.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd2d97fa700 1 -- 172.21.15.114:0/88965207 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd2ec09f360 con 0x557f371af5d0 2023-10-18T14:05:06.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd303e02b80 1 -- 172.21.15.114:0/88965207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd2ec09f120 con 0x557f371af5d0 2023-10-18T14:05:06.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd2d97fa700 1 -- 172.21.15.114:0/88965207 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2ec09b210 con 0x557f371af5d0 2023-10-18T14:05:06.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd303e02b80 10 client.15936 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:06.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd303e02b80 1 -- 172.21.15.114:0/88965207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557f36f53250 con 0x557f371af5d0 2023-10-18T14:05:06.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd2d97fa700 1 -- 172.21.15.114:0/88965207 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2ec09f120 con 0x557f371af5d0 2023-10-18T14:05:06.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd2d97fa700 1 -- 172.21.15.114:0/88965207 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd2ec0971a0 con 0x557f371af5d0 2023-10-18T14:05:06.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd303e02b80 10 client.15936 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:06.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd303e02b80 10 client.15936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:06.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd303e02b80 20 client.15936 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:06.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd303e02b80 1 --2- 172.21.15.114:0/88965207 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x557f371c8630 0x557f3721f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd303e02b80 4 client.15936 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:05:06.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd303e02b80 1 -- 172.21.15.114:0/88965207 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557f370fae50 con 0x557f371c8630 2023-10-18T14:05:06.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.648+0000 7fd2f51b4700 1 --2- 172.21.15.114:0/88965207 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x557f371c8630 0x557f3721f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.649+0000 7fd2d97fa700 10 client.15936 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:06.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.649+0000 7fd2f51b4700 1 --2- 172.21.15.114:0/88965207 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x557f371c8630 0x557f3721f790 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81deeadd1ca14ba4 server_cookie=ac2e5ac37ddb04d1 in_seq=0 out_seq=0 2023-10-18T14:05:06.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.649+0000 7fd2d97fa700 1 -- 172.21.15.114:0/88965207 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x557f370fae50 con 0x557f371c8630 2023-10-18T14:05:06.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.649+0000 7fd2d97fa700 10 client.15936 handle_command_reply: tid=0 2023-10-18T14:05:06.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.649+0000 7fd303e02b80 1 client.15936 shutdown 2023-10-18T14:05:06.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.649+0000 7fd303e02b80 1 -- 172.21.15.114:0/88965207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 msgr2=0x557f371bfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:06.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.649+0000 7fd303e02b80 1 --2- 172.21.15.114:0/88965207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 0x557f371bfb60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec097710 tx=0x7fd2ec09ad50 comp rx=0 tx=0).stop 2023-10-18T14:05:06.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd303e02b80 1 -- 172.21.15.114:0/88965207 shutdown_connections 2023-10-18T14:05:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd303e02b80 1 --2- 172.21.15.114:0/88965207 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x557f371c8630 0x557f3721f790 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd303e02b80 1 --2- 172.21.15.114:0/88965207 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x557f371b5500 0x557f371be770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd303e02b80 1 --2- 172.21.15.114:0/88965207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557f371af5d0 0x557f371bfb60 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd303e02b80 1 --2- 172.21.15.114:0/88965207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f371b4be0 0x557f371be050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd2d97fa700 0 client.15936 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd303e02b80 1 -- 172.21.15.114:0/88965207 >> 172.21.15.114:0/88965207 conn(0x557f37123720 msgr2=0x557f371a34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd303e02b80 1 -- 172.21.15.114:0/88965207 shutdown_connections 2023-10-18T14:05:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd303e02b80 1 -- 172.21.15.114:0/88965207 wait complete. 2023-10-18T14:05:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd303e02b80 20 client.15936 trim_cache size 0 max 16384 2023-10-18T14:05:06.677 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:05:06.677 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "no active scrubs running", 2023-10-18T14:05:06.677 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": {} 2023-10-18T14:05:06.677 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:05:06.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd2f7c19700 1 -- 172.21.15.114:0/629264625 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd2dc0a5a00 msgr2=0x7fd2dc0a7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:06.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd2f7c19700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd2dc0a5a00 0x7fd2dc0a7ec0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0197c00 tx=0x7fd2e000b410 comp rx=0 tx=0).stop 2023-10-18T14:05:06.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd2f7c19700 1 -- 172.21.15.114:0/629264625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f00ff120 msgr2=0x7fd2f019c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:06.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd2f7c19700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f00ff120 0x7fd2f019c910 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec004760 tx=0x7fd2ec004790 comp rx=0 tx=0).stop 2023-10-18T14:05:06.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd2f7c19700 1 -- 172.21.15.114:0/629264625 shutdown_connections 2023-10-18T14:05:06.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd2f7c19700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd2dc0a5a00 0x7fd2dc0a7ec0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd2f7c19700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2f0106860 0x7fd2f0196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd2f7c19700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f00ff120 0x7fd2f019c910 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd2f7c19700 1 --2- 172.21.15.114:0/629264625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f00ffae0 0x7fd2f019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd2f7c19700 1 -- 172.21.15.114:0/629264625 >> 172.21.15.114:0/629264625 conn(0x7fd2f0074890 msgr2=0x7fd2f00fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:06.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd2f7c19700 1 -- 172.21.15.114:0/629264625 shutdown_connections 2023-10-18T14:05:06.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.650+0000 7fd2f7c19700 1 -- 172.21.15.114:0/629264625 wait complete. 2023-10-18T14:05:06.681 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-18T14:05:06.682 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:05:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.799+0000 7f959ba89700 1 -- 172.21.15.114:0/4018838511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95940fec00 msgr2=0x7f95940ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.799+0000 7f959ba89700 1 --2- 172.21.15.114:0/4018838511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95940fec00 0x7f95940ff060 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9584009990 tx=0x7f9584009ca0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.799+0000 7f959ba89700 1 -- 172.21.15.114:0/4018838511 shutdown_connections 2023-10-18T14:05:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.799+0000 7f959ba89700 1 --2- 172.21.15.114:0/4018838511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95940ff5a0 0x7f959410d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.799+0000 7f959ba89700 1 --2- 172.21.15.114:0/4018838511 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9594106720 0x7f9594106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.799+0000 7f959ba89700 1 --2- 172.21.15.114:0/4018838511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95940fec00 0x7f95940ff060 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.799+0000 7f959ba89700 1 -- 172.21.15.114:0/4018838511 >> 172.21.15.114:0/4018838511 conn(0x7f9594075b90 msgr2=0x7f95940fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.800+0000 7f959ba89700 1 -- 172.21.15.114:0/4018838511 shutdown_connections 2023-10-18T14:05:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.800+0000 7f959ba89700 1 -- 172.21.15.114:0/4018838511 wait complete. 2023-10-18T14:05:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.800+0000 7f959ba89700 1 Processor -- start 2023-10-18T14:05:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.800+0000 7f959ba89700 1 -- start start 2023-10-18T14:05:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.800+0000 7f959ba89700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95940fec00 0x7f959419c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.800+0000 7f959ba89700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95940ff5a0 0x7f959419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.800+0000 7f959ba89700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9594106720 0x7f95941969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.800+0000 7f959ba89700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9594197020 con 0x7f9594106720 2023-10-18T14:05:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.800+0000 7f959ba89700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9594197190 con 0x7f95940fec00 2023-10-18T14:05:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.800+0000 7f959ba89700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9594197350 con 0x7f95940ff5a0 2023-10-18T14:05:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.800+0000 7f959a026700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9594106720 0x7f95941969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f959a026700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9594106720 0x7f95941969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44922/0 (socket says 172.21.15.114:44922) 2023-10-18T14:05:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f9599825700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95940fec00 0x7f959419c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f959a026700 1 -- 172.21.15.114:0/4003505309 learned_addr learned my addr 172.21.15.114:0/4003505309 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f9599024700 1 --2- 172.21.15.114:0/4003505309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95940ff5a0 0x7f959419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f959a026700 1 -- 172.21.15.114:0/4003505309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95940ff5a0 msgr2=0x7f959419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f959a026700 1 --2- 172.21.15.114:0/4003505309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95940ff5a0 0x7f959419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f959a026700 1 -- 172.21.15.114:0/4003505309 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95940fec00 msgr2=0x7f959419c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f959a026700 1 --2- 172.21.15.114:0/4003505309 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95940fec00 0x7f959419c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f959a026700 1 -- 172.21.15.114:0/4003505309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95840095f0 con 0x7f9594106720 2023-10-18T14:05:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f959a026700 1 --2- 172.21.15.114:0/4003505309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9594106720 0x7f95941969c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f958c007ee0 tx=0x7f958c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f958affd700 1 -- 172.21.15.114:0/4003505309 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c017070 con 0x7f9594106720 2023-10-18T14:05:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f958affd700 1 -- 172.21.15.114:0/4003505309 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f958c00f040 con 0x7f9594106720 2023-10-18T14:05:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f959ba89700 1 -- 172.21.15.114:0/4003505309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9594197630 con 0x7f9594106720 2023-10-18T14:05:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f958affd700 1 -- 172.21.15.114:0/4003505309 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c005740 con 0x7f9594106720 2023-10-18T14:05:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.801+0000 7f959ba89700 1 -- 172.21.15.114:0/4003505309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95941a3880 con 0x7f9594106720 2023-10-18T14:05:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.802+0000 7f959ba89700 1 -- 172.21.15.114:0/4003505309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9594108ca0 con 0x7f9594106720 2023-10-18T14:05:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.803+0000 7f958affd700 1 -- 172.21.15.114:0/4003505309 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f958c00dc60 con 0x7f9594106720 2023-10-18T14:05:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.803+0000 7f958affd700 1 --2- 172.21.15.114:0/4003505309 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f95800a16f0 0x7f95800a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.804+0000 7f9599825700 1 --2- 172.21.15.114:0/4003505309 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f95800a16f0 0x7f95800a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.804+0000 7f958affd700 1 -- 172.21.15.114:0/4003505309 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f958c0ccee0 con 0x7f9594106720 2023-10-18T14:05:06.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.804+0000 7f9599825700 1 --2- 172.21.15.114:0/4003505309 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f95800a16f0 0x7f95800a3bb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9590005950 tx=0x7f959000a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:06.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:06.807+0000 7f958affd700 1 -- 172.21.15.114:0/4003505309 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f958c096220 con 0x7f9594106720 2023-10-18T14:05:06.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:06 smithi114 ceph-mon[99494]: pgmap v312: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 24 op/s 2023-10-18T14:05:07.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:06 smithi158 ceph-mon[103317]: pgmap v312: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 24 op/s 2023-10-18T14:05:07.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.039+0000 7f959ba89700 1 -- 172.21.15.114:0/4003505309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9594101f20 con 0x7f9594106720 2023-10-18T14:05:07.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.040+0000 7f958affd700 1 -- 172.21.15.114:0/4003505309 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11390 (secure 0 0 0) 0x7f958c099840 con 0x7f9594106720 2023-10-18T14:05:07.044 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:05:07.044 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:02:39.260198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:05:07.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.042+0000 7f959ba89700 1 -- 172.21.15.114:0/4003505309 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f95800a16f0 msgr2=0x7f95800a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.042+0000 7f959ba89700 1 --2- 172.21.15.114:0/4003505309 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f95800a16f0 0x7f95800a3bb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9590005950 tx=0x7f959000a300 comp rx=0 tx=0).stop 2023-10-18T14:05:07.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.042+0000 7f959ba89700 1 -- 172.21.15.114:0/4003505309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9594106720 msgr2=0x7f95941969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.042+0000 7f959ba89700 1 --2- 172.21.15.114:0/4003505309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9594106720 0x7f95941969c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f958c007ee0 tx=0x7f958c00d3b0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.042+0000 7f959ba89700 1 -- 172.21.15.114:0/4003505309 shutdown_connections 2023-10-18T14:05:07.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.042+0000 7f959ba89700 1 --2- 172.21.15.114:0/4003505309 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f95800a16f0 0x7f95800a3bb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.042+0000 7f959ba89700 1 --2- 172.21.15.114:0/4003505309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9594106720 0x7f95941969c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.042+0000 7f959ba89700 1 --2- 172.21.15.114:0/4003505309 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f95940fec00 0x7f959419c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.042+0000 7f959ba89700 1 --2- 172.21.15.114:0/4003505309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95940ff5a0 0x7f959419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.042+0000 7f959ba89700 1 -- 172.21.15.114:0/4003505309 >> 172.21.15.114:0/4003505309 conn(0x7f9594075b90 msgr2=0x7f9594103780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.042+0000 7f959ba89700 1 -- 172.21.15.114:0/4003505309 shutdown_connections 2023-10-18T14:05:07.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.042+0000 7f959ba89700 1 -- 172.21.15.114:0/4003505309 wait complete. 2023-10-18T14:05:07.049 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2023-10-18T14:05:07.058 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-18T14:05:07.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:06 smithi172 ceph-mon[103574]: pgmap v312: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 24 op/s 2023-10-18T14:05:07.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.178+0000 7f5472597700 1 -- 172.21.15.114:0/2427372941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f546c105d20 msgr2=0x7f546c10c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.178+0000 7f5472597700 1 --2- 172.21.15.114:0/2427372941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f546c105d20 0x7f546c10c4e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f546400b0a0 tx=0x7f546400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.178+0000 7f5472597700 1 -- 172.21.15.114:0/2427372941 shutdown_connections 2023-10-18T14:05:07.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.178+0000 7f5472597700 1 --2- 172.21.15.114:0/2427372941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f546c105d20 0x7f546c10c4e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.178+0000 7f5472597700 1 --2- 172.21.15.114:0/2427372941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f546c104630 0x7f546c104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.178+0000 7f5472597700 1 --2- 172.21.15.114:0/2427372941 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f546c105360 0x7f546c1057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.178+0000 7f5472597700 1 -- 172.21.15.114:0/2427372941 >> 172.21.15.114:0/2427372941 conn(0x7f546c074890 msgr2=0x7f546c074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.178+0000 7f5472597700 1 -- 172.21.15.114:0/2427372941 shutdown_connections 2023-10-18T14:05:07.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.178+0000 7f5472597700 1 -- 172.21.15.114:0/2427372941 wait complete. 2023-10-18T14:05:07.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.178+0000 7f5472597700 1 Processor -- start 2023-10-18T14:05:07.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.178+0000 7f5472597700 1 -- start start 2023-10-18T14:05:07.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5472597700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f546c104630 0x7f546c10cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5472597700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f546c105360 0x7f546c10d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5472597700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f546c105d20 0x7f546c10d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5472597700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c1a5130 con 0x7f546c105d20 2023-10-18T14:05:07.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5472597700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c1a52a0 con 0x7f546c104630 2023-10-18T14:05:07.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5472597700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c1a5460 con 0x7f546c105360 2023-10-18T14:05:07.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5470b34700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f546c105d20 0x7f546c10d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5470b34700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f546c105d20 0x7f546c10d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44936/0 (socket says 172.21.15.114:44936) 2023-10-18T14:05:07.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5470b34700 1 -- 172.21.15.114:0/3517961441 learned_addr learned my addr 172.21.15.114:0/3517961441 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f546bfff700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f546c104630 0x7f546c10cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f546b7fe700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f546c105360 0x7f546c10d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5470b34700 1 -- 172.21.15.114:0/3517961441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f546c105360 msgr2=0x7f546c10d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5470b34700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f546c105360 0x7f546c10d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5470b34700 1 -- 172.21.15.114:0/3517961441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f546c104630 msgr2=0x7f546c10cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5470b34700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f546c104630 0x7f546c10cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5470b34700 1 -- 172.21.15.114:0/3517961441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5464009d00 con 0x7f546c105d20 2023-10-18T14:05:07.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5470b34700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f546c105d20 0x7f546c10d9b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f546400b070 tx=0x7f5464007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f54697fa700 1 -- 172.21.15.114:0/3517961441 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546400e040 con 0x7f546c105d20 2023-10-18T14:05:07.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f5472597700 1 -- 172.21.15.114:0/3517961441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546c1a56e0 con 0x7f546c105d20 2023-10-18T14:05:07.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f54697fa700 1 -- 172.21.15.114:0/3517961441 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5464009440 con 0x7f546c105d20 2023-10-18T14:05:07.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.179+0000 7f54697fa700 1 -- 172.21.15.114:0/3517961441 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546401b450 con 0x7f546c105d20 2023-10-18T14:05:07.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.180+0000 7f5472597700 1 -- 172.21.15.114:0/3517961441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546c1a5b10 con 0x7f546c105d20 2023-10-18T14:05:07.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.181+0000 7f54697fa700 1 -- 172.21.15.114:0/3517961441 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f5464004cf0 con 0x7f546c105d20 2023-10-18T14:05:07.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.182+0000 7f54697fa700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f54580a15f0 0x7f54580a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.182+0000 7f54697fa700 1 -- 172.21.15.114:0/3517961441 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f54640ce8f0 con 0x7f546c105d20 2023-10-18T14:05:07.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.182+0000 7f546bfff700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f54580a15f0 0x7f54580a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.182+0000 7f546bfff700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f54580a15f0 0x7f54580a3ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f545c007bc0 tx=0x7f545c0073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.183+0000 7f547e780b80 1 Processor -- start 2023-10-18T14:05:07.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.183+0000 7f547e780b80 1 -- start start 2023-10-18T14:05:07.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.183+0000 7f547e780b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 0x559c0837efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.183+0000 7f547e780b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c0837f500 0x559c08379090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.183+0000 7f547e780b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c083795d0 0x559c08379a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.183+0000 7f547e780b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c082ec6e0 con 0x559c0837ebe0 2023-10-18T14:05:07.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.183+0000 7f547e780b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c082d2c60 con 0x559c0837f500 2023-10-18T14:05:07.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.183+0000 7f547e780b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c082d0580 con 0x559c083795d0 2023-10-18T14:05:07.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.183+0000 7f546bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 0x559c0837efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.183+0000 7f546bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 0x559c0837efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44940/0 (socket says 172.21.15.114:44940) 2023-10-18T14:05:07.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.183+0000 7f546bfff700 1 -- 172.21.15.114:0/402631629 learned_addr learned my addr 172.21.15.114:0/402631629 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.184+0000 7f546b7fe700 1 --2- 172.21.15.114:0/402631629 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c0837f500 0x559c08379090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.184+0000 7f546bfff700 1 -- 172.21.15.114:0/402631629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c083795d0 msgr2=0x559c08379a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.184+0000 7f5470b34700 1 --2- 172.21.15.114:0/402631629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c083795d0 0x559c08379a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.184+0000 7f546bfff700 1 --2- 172.21.15.114:0/402631629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c083795d0 0x559c08379a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.184+0000 7f546bfff700 1 -- 172.21.15.114:0/402631629 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c0837f500 msgr2=0x559c08379090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.184+0000 7f546bfff700 1 --2- 172.21.15.114:0/402631629 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c0837f500 0x559c08379090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.184+0000 7f546bfff700 1 -- 172.21.15.114:0/402631629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c082893f0 con 0x559c0837ebe0 2023-10-18T14:05:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.184+0000 7f546b7fe700 1 --2- 172.21.15.114:0/402631629 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c0837f500 0x559c08379090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.184+0000 7f546bfff700 1 --2- 172.21.15.114:0/402631629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 0x559c0837efc0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f545c010e10 tx=0x7f545c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe362fbd363dfa server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.184+0000 7f54627fc700 1 -- 172.21.15.114:0/402631629 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c004050 con 0x559c0837ebe0 2023-10-18T14:05:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.184+0000 7f54627fc700 1 -- 172.21.15.114:0/402631629 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f545c015070 con 0x559c0837ebe0 2023-10-18T14:05:07.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.184+0000 7f54627fc700 1 -- 172.21.15.114:0/402631629 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c01e620 con 0x559c0837ebe0 2023-10-18T14:05:07.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.184+0000 7f547e780b80 1 -- 172.21.15.114:0/402631629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 msgr2=0x559c0837efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 --2- 172.21.15.114:0/402631629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 0x559c0837efc0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f545c010e10 tx=0x7f545c013000 comp rx=0 tx=0).stop 2023-10-18T14:05:07.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 -- 172.21.15.114:0/402631629 shutdown_connections 2023-10-18T14:05:07.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 --2- 172.21.15.114:0/402631629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c083795d0 0x559c08379a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 --2- 172.21.15.114:0/402631629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 0x559c0837efc0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 --2- 172.21.15.114:0/402631629 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c0837f500 0x559c08379090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 -- 172.21.15.114:0/402631629 >> 172.21.15.114:0/402631629 conn(0x559c082ed720 msgr2=0x559c08373b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 -- 172.21.15.114:0/402631629 shutdown_connections 2023-10-18T14:05:07.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 -- 172.21.15.114:0/402631629 wait complete. 2023-10-18T14:05:07.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 -- start start 2023-10-18T14:05:07.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 Processor -- start 2023-10-18T14:05:07.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c083795d0 0x559c083827a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c0837ebe0 0x559c08382ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 0x559c08383220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c082cbe70 con 0x559c0837f500 2023-10-18T14:05:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c08268710 con 0x559c0837ebe0 2023-10-18T14:05:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c082683b0 con 0x559c083795d0 2023-10-18T14:05:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.185+0000 7f547e780b80 10 client.0 _ll_register_callbacks cb 0x559c081b2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f5470b34700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 0x559c08383220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f5470b34700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 0x559c08383220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44950/0 (socket says 172.21.15.114:44950) 2023-10-18T14:05:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f5470b34700 1 -- 172.21.15.114:0/3760495878 learned_addr learned my addr 172.21.15.114:0/3760495878 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f546b7fe700 1 --2- 172.21.15.114:0/3760495878 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c0837ebe0 0x559c08382ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f546bfff700 1 --2- 172.21.15.114:0/3760495878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c083795d0 0x559c083827a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f5470b34700 1 -- 172.21.15.114:0/3760495878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c083795d0 msgr2=0x559c083827a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f5470b34700 1 --2- 172.21.15.114:0/3760495878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c083795d0 0x559c083827a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f5470b34700 1 -- 172.21.15.114:0/3760495878 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c0837ebe0 msgr2=0x559c08382ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f5470b34700 1 --2- 172.21.15.114:0/3760495878 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c0837ebe0 0x559c08382ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f5470b34700 1 -- 172.21.15.114:0/3760495878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c010ac0 con 0x559c0837f500 2023-10-18T14:05:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f5470b34700 1 --2- 172.21.15.114:0/3760495878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 0x559c08383220 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5464009fd0 tx=0x7f546400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98601a343932d885 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f544b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:07.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f544b7fe700 1 -- 172.21.15.114:0/3760495878 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546409c0e0 con 0x559c0837f500 2023-10-18T14:05:07.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f544b7fe700 1 -- 172.21.15.114:0/3760495878 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f546409b9e0 con 0x559c0837f500 2023-10-18T14:05:07.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f547e780b80 1 -- 172.21.15.114:0/3760495878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c082d0ef0 con 0x559c0837f500 2023-10-18T14:05:07.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f544b7fe700 1 -- 172.21.15.114:0/3760495878 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54640b4230 con 0x559c0837f500 2023-10-18T14:05:07.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f547e780b80 10 client.15954 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:07.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f547e780b80 1 -- 172.21.15.114:0/3760495878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559c080f6de0 con 0x559c0837f500 2023-10-18T14:05:07.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.186+0000 7f544b7fe700 1 -- 172.21.15.114:0/3760495878 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54640b8070 con 0x559c0837f500 2023-10-18T14:05:07.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.187+0000 7f544b7fe700 1 -- 172.21.15.114:0/3760495878 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f54640a3850 con 0x559c0837f500 2023-10-18T14:05:07.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.187+0000 7f547e780b80 10 client.15954 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:07.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.187+0000 7f547e780b80 10 client.15954 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-18T14:05:07.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.187+0000 7f547e780b80 20 client.15954 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:07.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.187+0000 7f547e780b80 1 --2- 172.21.15.114:0/3760495878 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x559c08392c20 0x559c08395040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.187+0000 7f547e780b80 4 client.15954 mds_command: new command op to 14820 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:07.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.187+0000 7f547e780b80 1 -- 172.21.15.114:0/3760495878 --> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c083488b0 con 0x559c08392c20 2023-10-18T14:05:07.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.187+0000 7f546bfff700 1 --2- 172.21.15.114:0/3760495878 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x559c08392c20 0x559c08395040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.187+0000 7f544b7fe700 10 client.15954 ms_handle_connect on v2:172.21.15.114:6840/2423071224 2023-10-18T14:05:07.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.187+0000 7f546bfff700 1 --2- 172.21.15.114:0/3760495878 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x559c08392c20 0x559c08395040 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9ebf0813245cbe84 server_cookie=c81efeb4354f19cb in_seq=0 out_seq=0 2023-10-18T14:05:07.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.187+0000 7f544b7fe700 1 -- 172.21.15.114:0/3760495878 <== mds.4 v2:172.21.15.114:6840/2423071224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559c083488b0 con 0x559c08392c20 2023-10-18T14:05:07.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f544b7fe700 10 client.15954 handle_command_reply: tid=0 2023-10-18T14:05:07.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f547e780b80 1 client.15954 shutdown 2023-10-18T14:05:07.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f547e780b80 1 -- 172.21.15.114:0/3760495878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 msgr2=0x559c08383220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f547e780b80 1 --2- 172.21.15.114:0/3760495878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 0x559c08383220 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5464009fd0 tx=0x7f546400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f547e780b80 1 -- 172.21.15.114:0/3760495878 shutdown_connections 2023-10-18T14:05:07.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f547e780b80 1 --2- 172.21.15.114:0/3760495878 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x559c08392c20 0x559c08395040 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f547e780b80 1 --2- 172.21.15.114:0/3760495878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 0x559c08383220 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f547e780b80 1 --2- 172.21.15.114:0/3760495878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c083795d0 0x559c083827a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f544b7fe700 0 client.15954 ms_handle_reset on v2:172.21.15.114:6840/2423071224 2023-10-18T14:05:07.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f547e780b80 1 --2- 172.21.15.114:0/3760495878 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c0837ebe0 0x559c08382ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f547e780b80 1 -- 172.21.15.114:0/3760495878 >> 172.21.15.114:0/3760495878 conn(0x559c082ed720 msgr2=0x559c08378080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f547e780b80 1 -- 172.21.15.114:0/3760495878 shutdown_connections 2023-10-18T14:05:07.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f547e780b80 1 -- 172.21.15.114:0/3760495878 wait complete. 2023-10-18T14:05:07.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.188+0000 7f547e780b80 20 client.15954 trim_cache size 0 max 16384 2023-10-18T14:05:07.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f547e780b80 1 Processor -- start 2023-10-18T14:05:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f547e780b80 1 -- start start 2023-10-18T14:05:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f547e780b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c083795d0 0x559c083799b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f547e780b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c0837ebe0 0x559c08381070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f547e780b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 0x559c083815b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f547e780b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c0814c920 con 0x559c0837f500 2023-10-18T14:05:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f547e780b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c083740a0 con 0x559c083795d0 2023-10-18T14:05:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f547e780b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c08383e10 con 0x559c0837ebe0 2023-10-18T14:05:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f5470b34700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 0x559c083815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f5470b34700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 0x559c083815b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44956/0 (socket says 172.21.15.114:44956) 2023-10-18T14:05:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f5470b34700 1 -- 172.21.15.114:0/335813337 learned_addr learned my addr 172.21.15.114:0/335813337 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f5470b34700 1 -- 172.21.15.114:0/335813337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c0837ebe0 msgr2=0x559c08381070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f5470b34700 1 --2- 172.21.15.114:0/335813337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c0837ebe0 0x559c08381070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f5470b34700 1 -- 172.21.15.114:0/335813337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c083795d0 msgr2=0x559c083799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f5470b34700 1 --2- 172.21.15.114:0/335813337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c083795d0 0x559c083799b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.201+0000 7f5470b34700 1 -- 172.21.15.114:0/335813337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c080dfc60 con 0x559c0837f500 2023-10-18T14:05:07.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.202+0000 7f5470b34700 1 --2- 172.21.15.114:0/335813337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 0x559c083815b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f546409b6e0 tx=0x7f546400cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79d5b74194b9510 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.202+0000 7f5462ffd700 1 -- 172.21.15.114:0/335813337 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546409b520 con 0x559c0837f500 2023-10-18T14:05:07.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.202+0000 7f5462ffd700 1 -- 172.21.15.114:0/335813337 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54640b8070 con 0x559c0837f500 2023-10-18T14:05:07.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.202+0000 7f5462ffd700 1 -- 172.21.15.114:0/335813337 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546409aed0 con 0x559c0837f500 2023-10-18T14:05:07.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.202+0000 7f547e780b80 1 -- 172.21.15.114:0/335813337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 msgr2=0x559c083815b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.202+0000 7f547e780b80 1 --2- 172.21.15.114:0/335813337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 0x559c083815b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f546409b6e0 tx=0x7f546400cfd0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.202+0000 7f547e780b80 1 -- 172.21.15.114:0/335813337 shutdown_connections 2023-10-18T14:05:07.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.202+0000 7f547e780b80 1 --2- 172.21.15.114:0/335813337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837f500 0x559c083815b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.202+0000 7f547e780b80 1 --2- 172.21.15.114:0/335813337 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c083795d0 0x559c083799b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.202+0000 7f547e780b80 1 --2- 172.21.15.114:0/335813337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c0837ebe0 0x559c08381070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.202+0000 7f547e780b80 1 -- 172.21.15.114:0/335813337 >> 172.21.15.114:0/335813337 conn(0x559c082ed720 msgr2=0x559c08382030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.202+0000 7f547e780b80 1 -- 172.21.15.114:0/335813337 shutdown_connections 2023-10-18T14:05:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.202+0000 7f547e780b80 1 -- 172.21.15.114:0/335813337 wait complete. 2023-10-18T14:05:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f547e780b80 1 -- start start 2023-10-18T14:05:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f547e780b80 1 Processor -- start 2023-10-18T14:05:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f547e780b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c083795d0 0x559c08388080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f547e780b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 0x559c083885c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f547e780b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c0837f500 0x559c083e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f547e780b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c083e5f90 con 0x559c0837ebe0 2023-10-18T14:05:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f547e780b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c083e60d0 con 0x559c083795d0 2023-10-18T14:05:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f547e780b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c083e6210 con 0x559c0837f500 2023-10-18T14:05:07.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f547e780b80 10 client.0 _ll_register_callbacks cb 0x559c081b2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:07.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f546b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 0x559c083885c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f546b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 0x559c083885c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44960/0 (socket says 172.21.15.114:44960) 2023-10-18T14:05:07.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f546b7fe700 1 -- 172.21.15.114:0/2459343489 learned_addr learned my addr 172.21.15.114:0/2459343489 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f546bfff700 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c083795d0 0x559c08388080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f5470b34700 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c0837f500 0x559c083e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f546b7fe700 1 -- 172.21.15.114:0/2459343489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c0837f500 msgr2=0x559c083e5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f546b7fe700 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c0837f500 0x559c083e5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f546b7fe700 1 -- 172.21.15.114:0/2459343489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c083795d0 msgr2=0x559c08388080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f546b7fe700 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c083795d0 0x559c08388080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.203+0000 7f546b7fe700 1 -- 172.21.15.114:0/2459343489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c080f6de0 con 0x559c0837ebe0 2023-10-18T14:05:07.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f546bfff700 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c083795d0 0x559c08388080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:07.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f546b7fe700 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 0x559c083885c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x559c083757d0 tx=0x7f5454012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1096c6737322ca8e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f544b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:07.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f544b7fe700 1 -- 172.21.15.114:0/2459343489 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454004a30 con 0x559c0837ebe0 2023-10-18T14:05:07.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f544b7fe700 1 -- 172.21.15.114:0/2459343489 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5454004b90 con 0x559c0837ebe0 2023-10-18T14:05:07.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f547e780b80 1 -- 172.21.15.114:0/2459343489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f545c015070 con 0x559c0837ebe0 2023-10-18T14:05:07.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f544b7fe700 1 -- 172.21.15.114:0/2459343489 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5454004d50 con 0x559c0837ebe0 2023-10-18T14:05:07.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f547e780b80 10 client.15960 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:07.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f547e780b80 1 -- 172.21.15.114:0/2459343489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559c0811d250 con 0x559c0837ebe0 2023-10-18T14:05:07.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f544b7fe700 1 -- 172.21.15.114:0/2459343489 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5454028080 con 0x559c0837ebe0 2023-10-18T14:05:07.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f544b7fe700 1 -- 172.21.15.114:0/2459343489 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f54540109b0 con 0x559c0837ebe0 2023-10-18T14:05:07.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f547e780b80 10 client.15960 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:07.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f547e780b80 10 client.15960 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-18T14:05:07.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f547e780b80 20 client.15960 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:07.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f547e780b80 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x559c083e7b90 0x559c083e9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f547e780b80 4 client.15960 mds_command: new command op to 14820 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:05:07.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f547e780b80 1 -- 172.21.15.114:0/2459343489 --> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559c082c4e50 con 0x559c083e7b90 2023-10-18T14:05:07.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.204+0000 7f546bfff700 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x559c083e7b90 0x559c083e9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f546bfff700 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x559c083e7b90 0x559c083e9fb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9c1610c468f7d20 server_cookie=2dfa069c3ba9f98 in_seq=0 out_seq=0 2023-10-18T14:05:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f544b7fe700 10 client.15960 ms_handle_connect on v2:172.21.15.114:6840/2423071224 2023-10-18T14:05:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f544b7fe700 1 -- 172.21.15.114:0/2459343489 <== mds.4 v2:172.21.15.114:6840/2423071224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559c082c4e50 con 0x559c083e7b90 2023-10-18T14:05:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f544b7fe700 10 client.15960 handle_command_reply: tid=0 2023-10-18T14:05:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f547e780b80 1 client.15960 shutdown 2023-10-18T14:05:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f547e780b80 1 -- 172.21.15.114:0/2459343489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 msgr2=0x559c083885c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f547e780b80 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 0x559c083885c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x559c083757d0 tx=0x7f5454012730 comp rx=0 tx=0).stop 2023-10-18T14:05:07.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f547e780b80 1 -- 172.21.15.114:0/2459343489 shutdown_connections 2023-10-18T14:05:07.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f547e780b80 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x559c083e7b90 0x559c083e9fb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f547e780b80 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c0837f500 0x559c083e5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f547e780b80 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559c083795d0 0x559c08388080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f544b7fe700 0 client.15960 ms_handle_reset on v2:172.21.15.114:6840/2423071224 2023-10-18T14:05:07.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f547e780b80 1 --2- 172.21.15.114:0/2459343489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559c0837ebe0 0x559c083885c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f547e780b80 1 -- 172.21.15.114:0/2459343489 >> 172.21.15.114:0/2459343489 conn(0x559c082ed720 msgr2=0x559c0837c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f547e780b80 1 -- 172.21.15.114:0/2459343489 shutdown_connections 2023-10-18T14:05:07.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f547e780b80 1 -- 172.21.15.114:0/2459343489 wait complete. 2023-10-18T14:05:07.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.205+0000 7f547e780b80 20 client.15960 trim_cache size 0 max 16384 2023-10-18T14:05:07.236 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:05:07.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.206+0000 7f5472597700 1 -- 172.21.15.114:0/3517961441 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f54580a15f0 msgr2=0x7f54580a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.206+0000 7f5472597700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f54580a15f0 0x7f54580a3ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f545c007bc0 tx=0x7f545c0073d0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.206+0000 7f5472597700 1 -- 172.21.15.114:0/3517961441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f546c105d20 msgr2=0x7f546c10d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.206+0000 7f5472597700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f546c105d20 0x7f546c10d9b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f546400b070 tx=0x7f5464007870 comp rx=0 tx=0).stop 2023-10-18T14:05:07.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.206+0000 7f5472597700 1 -- 172.21.15.114:0/3517961441 shutdown_connections 2023-10-18T14:05:07.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.206+0000 7f5472597700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f54580a15f0 0x7f54580a3ab0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.206+0000 7f5472597700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f546c105d20 0x7f546c10d9b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.206+0000 7f5472597700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f546c104630 0x7f546c10cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.206+0000 7f5472597700 1 --2- 172.21.15.114:0/3517961441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f546c105360 0x7f546c10d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.206+0000 7f5472597700 1 -- 172.21.15.114:0/3517961441 >> 172.21.15.114:0/3517961441 conn(0x7f546c074890 msgr2=0x7f546c0fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.206+0000 7f5472597700 1 -- 172.21.15.114:0/3517961441 shutdown_connections 2023-10-18T14:05:07.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.206+0000 7f5472597700 1 -- 172.21.15.114:0/3517961441 wait complete. 2023-10-18T14:05:07.240 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-18T14:05:07.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.361+0000 7fb95898a700 1 -- 172.21.15.114:0/321947231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954105b30 msgr2=0x7fb95410d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.361+0000 7fb95898a700 1 --2- 172.21.15.114:0/321947231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954105b30 0x7fb95410d540 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00b0d0 tx=0x7fb94c00b3e0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.361+0000 7fb95898a700 1 -- 172.21.15.114:0/321947231 shutdown_connections 2023-10-18T14:05:07.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.361+0000 7fb95898a700 1 --2- 172.21.15.114:0/321947231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954105b30 0x7fb95410d540 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.361+0000 7fb95898a700 1 --2- 172.21.15.114:0/321947231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb954067d40 0x7fb954068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.361+0000 7fb95898a700 1 --2- 172.21.15.114:0/321947231 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb954105170 0x7fb9541055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.361+0000 7fb95898a700 1 -- 172.21.15.114:0/321947231 >> 172.21.15.114:0/321947231 conn(0x7fb9540767f0 msgr2=0x7fb954076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.361+0000 7fb95898a700 1 -- 172.21.15.114:0/321947231 shutdown_connections 2023-10-18T14:05:07.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.361+0000 7fb95898a700 1 -- 172.21.15.114:0/321947231 wait complete. 2023-10-18T14:05:07.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb95898a700 1 Processor -- start 2023-10-18T14:05:07.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb95898a700 1 -- start start 2023-10-18T14:05:07.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb95898a700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb954067d40 0x7fb9540ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb95898a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb954105170 0x7fb9540ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb95898a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954105b30 0x7fb954100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb95898a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9541a4f80 con 0x7fb954105b30 2023-10-18T14:05:07.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb95898a700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9541a50f0 con 0x7fb954067d40 2023-10-18T14:05:07.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb95898a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9541a52b0 con 0x7fb954105170 2023-10-18T14:05:07.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb952d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954105b30 0x7fb954100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb952d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954105b30 0x7fb954100130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44974/0 (socket says 172.21.15.114:44974) 2023-10-18T14:05:07.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb952d9d700 1 -- 172.21.15.114:0/1126774180 learned_addr learned my addr 172.21.15.114:0/1126774180 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb95259c700 1 --2- 172.21.15.114:0/1126774180 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb954067d40 0x7fb9540ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb952d9d700 1 -- 172.21.15.114:0/1126774180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb954105170 msgr2=0x7fb9540ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb952d9d700 1 --2- 172.21.15.114:0/1126774180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb954105170 0x7fb9540ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb952d9d700 1 -- 172.21.15.114:0/1126774180 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb954067d40 msgr2=0x7fb9540ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb952d9d700 1 --2- 172.21.15.114:0/1126774180 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb954067d40 0x7fb9540ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb952d9d700 1 -- 172.21.15.114:0/1126774180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c009d00 con 0x7fb954105b30 2023-10-18T14:05:07.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.362+0000 7fb952d9d700 1 --2- 172.21.15.114:0/1126774180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954105b30 0x7fb954100130 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb94c007fd0 tx=0x7fb94c009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.363+0000 7fb9437fe700 1 -- 172.21.15.114:0/1126774180 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c00e040 con 0x7fb954105b30 2023-10-18T14:05:07.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.363+0000 7fb9437fe700 1 -- 172.21.15.114:0/1126774180 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb94c01d940 con 0x7fb954105b30 2023-10-18T14:05:07.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.363+0000 7fb95898a700 1 -- 172.21.15.114:0/1126774180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9541a5530 con 0x7fb954105b30 2023-10-18T14:05:07.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.363+0000 7fb9437fe700 1 -- 172.21.15.114:0/1126774180 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c01b9f0 con 0x7fb954105b30 2023-10-18T14:05:07.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.363+0000 7fb95898a700 1 -- 172.21.15.114:0/1126774180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9541a59b0 con 0x7fb954105b30 2023-10-18T14:05:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.365+0000 7fb9437fe700 1 -- 172.21.15.114:0/1126774180 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fb94c01bb50 con 0x7fb954105b30 2023-10-18T14:05:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.365+0000 7fb9437fe700 1 --2- 172.21.15.114:0/1126774180 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb93c0a1670 0x7fb93c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.365+0000 7fb9437fe700 1 -- 172.21.15.114:0/1126774180 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb94c0ce9e0 con 0x7fb954105b30 2023-10-18T14:05:07.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.365+0000 7fb95259c700 1 --2- 172.21.15.114:0/1126774180 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb93c0a1670 0x7fb93c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.366+0000 7fb95259c700 1 --2- 172.21.15.114:0/1126774180 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb93c0a1670 0x7fb93c0a3b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb948005ea0 tx=0x7fb948005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.366+0000 7fb964b73b80 1 Processor -- start 2023-10-18T14:05:07.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.366+0000 7fb964b73b80 1 -- start start 2023-10-18T14:05:07.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb964b73b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 0x55f843ffffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb964b73b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f844000500 0x55f843ffa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb964b73b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 0x55f843ffaa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb964b73b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f843f6d6e0 con 0x55f843fffbe0 2023-10-18T14:05:07.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb964b73b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f843f53c60 con 0x55f843ffa5d0 2023-10-18T14:05:07.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb964b73b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f843f51580 con 0x55f844000500 2023-10-18T14:05:07.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb95259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 0x55f843ffffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb95259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 0x55f843ffffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44978/0 (socket says 172.21.15.114:44978) 2023-10-18T14:05:07.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb95259c700 1 -- 172.21.15.114:0/3842428306 learned_addr learned my addr 172.21.15.114:0/3842428306 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb952d9d700 1 --2- 172.21.15.114:0/3842428306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 0x55f843ffaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb951d9b700 1 --2- 172.21.15.114:0/3842428306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f844000500 0x55f843ffa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb95259c700 1 -- 172.21.15.114:0/3842428306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f844000500 msgr2=0x55f843ffa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb95259c700 1 --2- 172.21.15.114:0/3842428306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f844000500 0x55f843ffa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb95259c700 1 -- 172.21.15.114:0/3842428306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 msgr2=0x55f843ffaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb95259c700 1 --2- 172.21.15.114:0/3842428306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 0x55f843ffaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb95259c700 1 -- 172.21.15.114:0/3842428306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f843f0a3f0 con 0x55f843fffbe0 2023-10-18T14:05:07.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb95259c700 1 --2- 172.21.15.114:0/3842428306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 0x55f843ffffc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb94800a520 tx=0x7fb94800af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4cec508b29df73 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb940ff9700 1 -- 172.21.15.114:0/3842428306 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948010d80 con 0x55f843fffbe0 2023-10-18T14:05:07.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb940ff9700 1 -- 172.21.15.114:0/3842428306 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb94801d910 con 0x55f843fffbe0 2023-10-18T14:05:07.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.367+0000 7fb940ff9700 1 -- 172.21.15.114:0/3842428306 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94800f7e0 con 0x55f843fffbe0 2023-10-18T14:05:07.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.368+0000 7fb964b73b80 1 -- 172.21.15.114:0/3842428306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 msgr2=0x55f843ffffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.368+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3842428306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 0x55f843ffffc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb94800a520 tx=0x7fb94800af90 comp rx=0 tx=0).stop 2023-10-18T14:05:07.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.368+0000 7fb964b73b80 1 -- 172.21.15.114:0/3842428306 shutdown_connections 2023-10-18T14:05:07.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.368+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3842428306 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 0x55f843ffaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.368+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3842428306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 0x55f843ffffc0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.368+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3842428306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f844000500 0x55f843ffa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.368+0000 7fb964b73b80 1 -- 172.21.15.114:0/3842428306 >> 172.21.15.114:0/3842428306 conn(0x55f843f6e720 msgr2=0x55f843ff4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.368+0000 7fb964b73b80 1 -- 172.21.15.114:0/3842428306 shutdown_connections 2023-10-18T14:05:07.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.368+0000 7fb964b73b80 1 -- 172.21.15.114:0/3842428306 wait complete. 2023-10-18T14:05:07.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb964b73b80 1 -- start start 2023-10-18T14:05:07.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb964b73b80 1 Processor -- start 2023-10-18T14:05:07.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb964b73b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 0x55f844003830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb964b73b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f843fffbe0 0x55f844003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb964b73b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f844000500 0x55f8440042b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb964b73b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f843f4ce70 con 0x55f844000500 2023-10-18T14:05:07.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb964b73b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f843ee9710 con 0x55f843ffa5d0 2023-10-18T14:05:07.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb964b73b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f843ee93b0 con 0x55f843fffbe0 2023-10-18T14:05:07.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb964b73b80 10 client.0 _ll_register_callbacks cb 0x55f843e33a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:07.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb952d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f844000500 0x55f8440042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb952d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f844000500 0x55f8440042b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44988/0 (socket says 172.21.15.114:44988) 2023-10-18T14:05:07.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb952d9d700 1 -- 172.21.15.114:0/1463513526 learned_addr learned my addr 172.21.15.114:0/1463513526 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb951d9b700 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f843fffbe0 0x55f844003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb952d9d700 1 -- 172.21.15.114:0/1463513526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f843fffbe0 msgr2=0x55f844003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb952d9d700 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f843fffbe0 0x55f844003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb95259c700 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 0x55f844003830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb952d9d700 1 -- 172.21.15.114:0/1463513526 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 msgr2=0x55f844003830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb952d9d700 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 0x55f844003830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb952d9d700 1 -- 172.21.15.114:0/1463513526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94800e9d0 con 0x55f844000500 2023-10-18T14:05:07.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.369+0000 7fb951d9b700 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f843fffbe0 0x55f844003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:07.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb952d9d700 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f844000500 0x55f8440042b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0cc210 tx=0x7fb94c09c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c920eef97dd21f6b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb939ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:07.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb939ffb700 1 -- 172.21.15.114:0/1463513526 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0a3dd0 con 0x55f844000500 2023-10-18T14:05:07.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb964b73b80 1 -- 172.21.15.114:0/1463513526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f843f51ef0 con 0x55f844000500 2023-10-18T14:05:07.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb939ffb700 1 -- 172.21.15.114:0/1463513526 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb94c01be00 con 0x55f844000500 2023-10-18T14:05:07.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb939ffb700 1 -- 172.21.15.114:0/1463513526 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb94c0b4210 con 0x55f844000500 2023-10-18T14:05:07.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb964b73b80 10 client.15972 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:07.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb964b73b80 1 -- 172.21.15.114:0/1463513526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f843d77de0 con 0x55f844000500 2023-10-18T14:05:07.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb939ffb700 1 -- 172.21.15.114:0/1463513526 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb94c07e020 con 0x55f844000500 2023-10-18T14:05:07.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb939ffb700 1 -- 172.21.15.114:0/1463513526 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb94c09afc0 con 0x55f844000500 2023-10-18T14:05:07.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb964b73b80 10 client.15972 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:07.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb964b73b80 10 client.15972 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.b 2023-10-18T14:05:07.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb964b73b80 20 client.15972 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:07.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb964b73b80 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55f844013d50 0x55f844016140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb964b73b80 4 client.15972 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:07.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.370+0000 7fb964b73b80 1 -- 172.21.15.114:0/1463513526 --> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f843fc98b0 con 0x55f844013d50 2023-10-18T14:05:07.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.371+0000 7fb95259c700 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55f844013d50 0x55f844016140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.371+0000 7fb95259c700 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55f844013d50 0x55f844016140 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cf440a10bad4bf5c server_cookie=1a47f7c26c968255 in_seq=0 out_seq=0 2023-10-18T14:05:07.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.371+0000 7fb939ffb700 10 client.15972 ms_handle_connect on v2:172.21.15.158:6838/2616400572 2023-10-18T14:05:07.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb939ffb700 1 -- 172.21.15.114:0/1463513526 <== mds.3 v2:172.21.15.158:6838/2616400572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f843fc98b0 con 0x55f844013d50 2023-10-18T14:05:07.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb939ffb700 10 client.15972 handle_command_reply: tid=0 2023-10-18T14:05:07.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb964b73b80 1 client.15972 shutdown 2023-10-18T14:05:07.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb964b73b80 1 -- 172.21.15.114:0/1463513526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f844000500 msgr2=0x55f8440042b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb964b73b80 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f844000500 0x55f8440042b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0cc210 tx=0x7fb94c09c1d0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb964b73b80 1 -- 172.21.15.114:0/1463513526 shutdown_connections 2023-10-18T14:05:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb964b73b80 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55f844013d50 0x55f844016140 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb964b73b80 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f844000500 0x55f8440042b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb964b73b80 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 0x55f844003830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb939ffb700 0 client.15972 ms_handle_reset on v2:172.21.15.158:6838/2616400572 2023-10-18T14:05:07.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb964b73b80 1 --2- 172.21.15.114:0/1463513526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f843fffbe0 0x55f844003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb964b73b80 1 -- 172.21.15.114:0/1463513526 >> 172.21.15.114:0/1463513526 conn(0x55f843f6e720 msgr2=0x55f843ff9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb964b73b80 1 -- 172.21.15.114:0/1463513526 shutdown_connections 2023-10-18T14:05:07.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb964b73b80 1 -- 172.21.15.114:0/1463513526 wait complete. 2023-10-18T14:05:07.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.372+0000 7fb964b73b80 20 client.15972 trim_cache size 0 max 16384 2023-10-18T14:05:07.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb964b73b80 1 Processor -- start 2023-10-18T14:05:07.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb964b73b80 1 -- start start 2023-10-18T14:05:07.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb964b73b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 0x55f843fef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb964b73b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 0x55f84400aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb964b73b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f844000500 0x55f843ffd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb964b73b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f843dcd920 con 0x55f843fffbe0 2023-10-18T14:05:07.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb964b73b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f843ff65e0 con 0x55f843ffa5d0 2023-10-18T14:05:07.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb964b73b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f844004e30 con 0x55f844000500 2023-10-18T14:05:07.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb951d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 0x55f84400aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb951d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 0x55f84400aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44994/0 (socket says 172.21.15.114:44994) 2023-10-18T14:05:07.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb951d9b700 1 -- 172.21.15.114:0/3375828256 learned_addr learned my addr 172.21.15.114:0/3375828256 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb95259c700 1 --2- 172.21.15.114:0/3375828256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 0x55f843fef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb952d9d700 1 --2- 172.21.15.114:0/3375828256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f844000500 0x55f843ffd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb951d9b700 1 -- 172.21.15.114:0/3375828256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f844000500 msgr2=0x55f843ffd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb951d9b700 1 --2- 172.21.15.114:0/3375828256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f844000500 0x55f843ffd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb951d9b700 1 -- 172.21.15.114:0/3375828256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 msgr2=0x55f843fef5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb951d9b700 1 --2- 172.21.15.114:0/3375828256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 0x55f843fef5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb951d9b700 1 -- 172.21.15.114:0/3375828256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f843d60c60 con 0x55f843fffbe0 2023-10-18T14:05:07.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.385+0000 7fb952d9d700 1 --2- 172.21.15.114:0/3375828256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f844000500 0x55f843ffd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:07.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.386+0000 7fb951d9b700 1 --2- 172.21.15.114:0/3375828256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 0x55f84400aeb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55f843ff67d0 tx=0x7fb94400dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8e593356cc7b97 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.386+0000 7fb9417fa700 1 -- 172.21.15.114:0/3375828256 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944004230 con 0x55f843fffbe0 2023-10-18T14:05:07.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.386+0000 7fb9417fa700 1 -- 172.21.15.114:0/3375828256 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb94400fce0 con 0x55f843fffbe0 2023-10-18T14:05:07.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.386+0000 7fb9417fa700 1 -- 172.21.15.114:0/3375828256 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944003d10 con 0x55f843fffbe0 2023-10-18T14:05:07.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.386+0000 7fb964b73b80 1 -- 172.21.15.114:0/3375828256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 msgr2=0x55f84400aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.386+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3375828256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 0x55f84400aeb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55f843ff67d0 tx=0x7fb94400dd80 comp rx=0 tx=0).stop 2023-10-18T14:05:07.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.386+0000 7fb964b73b80 1 -- 172.21.15.114:0/3375828256 shutdown_connections 2023-10-18T14:05:07.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.386+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3375828256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f844000500 0x55f843ffd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.386+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3375828256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f843ffa5d0 0x55f843fef5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.386+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3375828256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843fffbe0 0x55f84400aeb0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.386+0000 7fb964b73b80 1 -- 172.21.15.114:0/3375828256 >> 172.21.15.114:0/3375828256 conn(0x55f843f6e720 msgr2=0x55f844002100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.386+0000 7fb964b73b80 1 -- 172.21.15.114:0/3375828256 shutdown_connections 2023-10-18T14:05:07.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.386+0000 7fb964b73b80 1 -- 172.21.15.114:0/3375828256 wait complete. 2023-10-18T14:05:07.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb964b73b80 1 -- start start 2023-10-18T14:05:07.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb964b73b80 1 Processor -- start 2023-10-18T14:05:07.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb964b73b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843ffa5d0 0x55f84400aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb964b73b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f843fffbe0 0x55f8440094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb964b73b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f844000500 0x55f8440099f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb964b73b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f84400a0b0 con 0x55f843ffa5d0 2023-10-18T14:05:07.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb964b73b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f84400a220 con 0x55f844000500 2023-10-18T14:05:07.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb964b73b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f844067b60 con 0x55f843fffbe0 2023-10-18T14:05:07.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb964b73b80 10 client.0 _ll_register_callbacks cb 0x55f843e33a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:07.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb95259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843ffa5d0 0x55f84400aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb95259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843ffa5d0 0x55f84400aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44998/0 (socket says 172.21.15.114:44998) 2023-10-18T14:05:07.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb95259c700 1 -- 172.21.15.114:0/3733010699 learned_addr learned my addr 172.21.15.114:0/3733010699 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb952d9d700 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f844000500 0x55f8440099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb95259c700 1 -- 172.21.15.114:0/3733010699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f843fffbe0 msgr2=0x55f8440094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb951d9b700 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f843fffbe0 0x55f8440094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb95259c700 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f843fffbe0 0x55f8440094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb95259c700 1 -- 172.21.15.114:0/3733010699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f844000500 msgr2=0x55f8440099f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb95259c700 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f844000500 0x55f8440099f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb95259c700 1 -- 172.21.15.114:0/3733010699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94400d700 con 0x55f843ffa5d0 2023-10-18T14:05:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.387+0000 7fb951d9b700 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f843fffbe0 0x55f8440094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb95259c700 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843ffa5d0 0x55f84400aee0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb9480107c0 tx=0x7fb94800e790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ccd97fd685c32d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb939ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb939ffb700 1 -- 172.21.15.114:0/3733010699 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94802e040 con 0x55f843ffa5d0 2023-10-18T14:05:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb939ffb700 1 -- 172.21.15.114:0/3733010699 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb94801d650 con 0x55f843ffa5d0 2023-10-18T14:05:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb964b73b80 1 -- 172.21.15.114:0/3733010699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb94801d910 con 0x55f843ffa5d0 2023-10-18T14:05:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb939ffb700 1 -- 172.21.15.114:0/3733010699 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb948030580 con 0x55f843ffa5d0 2023-10-18T14:05:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb964b73b80 10 client.15978 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb964b73b80 1 -- 172.21.15.114:0/3733010699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f843d9e250 con 0x55f843ffa5d0 2023-10-18T14:05:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb939ffb700 1 -- 172.21.15.114:0/3733010699 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb94801d910 con 0x55f843ffa5d0 2023-10-18T14:05:07.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb939ffb700 1 -- 172.21.15.114:0/3733010699 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb948005040 con 0x55f843ffa5d0 2023-10-18T14:05:07.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb964b73b80 10 client.15978 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:07.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb964b73b80 10 client.15978 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.b 2023-10-18T14:05:07.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb964b73b80 20 client.15978 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55f844069210 0x55f84406b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb964b73b80 4 client.15978 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:05:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.388+0000 7fb964b73b80 1 -- 172.21.15.114:0/3733010699 --> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f843f45e50 con 0x55f844069210 2023-10-18T14:05:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb951d9b700 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55f844069210 0x55f84406b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb939ffb700 10 client.15978 ms_handle_connect on v2:172.21.15.158:6838/2616400572 2023-10-18T14:05:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb951d9b700 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55f844069210 0x55f84406b630 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a4f4fc2e8bdf6756 server_cookie=b1b8b87965ce431c in_seq=0 out_seq=0 2023-10-18T14:05:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb939ffb700 1 -- 172.21.15.114:0/3733010699 <== mds.3 v2:172.21.15.158:6838/2616400572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f843f45e50 con 0x55f844069210 2023-10-18T14:05:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb939ffb700 10 client.15978 handle_command_reply: tid=0 2023-10-18T14:05:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb964b73b80 1 client.15978 shutdown 2023-10-18T14:05:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb964b73b80 1 -- 172.21.15.114:0/3733010699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843ffa5d0 msgr2=0x55f84400aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843ffa5d0 0x55f84400aee0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb9480107c0 tx=0x7fb94800e790 comp rx=0 tx=0).stop 2023-10-18T14:05:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb964b73b80 1 -- 172.21.15.114:0/3733010699 shutdown_connections 2023-10-18T14:05:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55f844069210 0x55f84406b630 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f844000500 0x55f8440099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb939ffb700 0 client.15978 ms_handle_reset on v2:172.21.15.158:6838/2616400572 2023-10-18T14:05:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f843ffa5d0 0x55f84400aee0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb964b73b80 1 --2- 172.21.15.114:0/3733010699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f843fffbe0 0x55f8440094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb964b73b80 1 -- 172.21.15.114:0/3733010699 >> 172.21.15.114:0/3733010699 conn(0x55f843f6e720 msgr2=0x55f843ffd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb964b73b80 1 -- 172.21.15.114:0/3733010699 shutdown_connections 2023-10-18T14:05:07.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.389+0000 7fb964b73b80 1 -- 172.21.15.114:0/3733010699 wait complete. 2023-10-18T14:05:07.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.390+0000 7fb964b73b80 20 client.15978 trim_cache size 0 max 16384 2023-10-18T14:05:07.419 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:05:07.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.390+0000 7fb95898a700 1 -- 172.21.15.114:0/1126774180 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb93c0a1670 msgr2=0x7fb93c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.390+0000 7fb95898a700 1 --2- 172.21.15.114:0/1126774180 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb93c0a1670 0x7fb93c0a3b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb948005ea0 tx=0x7fb948005e30 comp rx=0 tx=0).stop 2023-10-18T14:05:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.390+0000 7fb95898a700 1 -- 172.21.15.114:0/1126774180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954105b30 msgr2=0x7fb954100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.390+0000 7fb95898a700 1 --2- 172.21.15.114:0/1126774180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954105b30 0x7fb954100130 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb94c007fd0 tx=0x7fb94c009430 comp rx=0 tx=0).stop 2023-10-18T14:05:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.390+0000 7fb95898a700 1 -- 172.21.15.114:0/1126774180 shutdown_connections 2023-10-18T14:05:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.390+0000 7fb95898a700 1 --2- 172.21.15.114:0/1126774180 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb93c0a1670 0x7fb93c0a3b30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.390+0000 7fb95898a700 1 --2- 172.21.15.114:0/1126774180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb954105b30 0x7fb954100130 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.390+0000 7fb95898a700 1 --2- 172.21.15.114:0/1126774180 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb954067d40 0x7fb9540ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.390+0000 7fb95898a700 1 --2- 172.21.15.114:0/1126774180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb954105170 0x7fb9540ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.390+0000 7fb95898a700 1 -- 172.21.15.114:0/1126774180 >> 172.21.15.114:0/1126774180 conn(0x7fb9540767f0 msgr2=0x7fb9540fd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.390+0000 7fb95898a700 1 -- 172.21.15.114:0/1126774180 shutdown_connections 2023-10-18T14:05:07.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.390+0000 7fb95898a700 1 -- 172.21.15.114:0/1126774180 wait complete. 2023-10-18T14:05:07.423 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-18T14:05:07.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.558+0000 7fe13922c700 1 -- 172.21.15.114:0/793998729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe134105170 msgr2=0x7fe1341055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.558+0000 7fe13922c700 1 --2- 172.21.15.114:0/793998729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe134105170 0x7fe1341055f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0099c0 tx=0x7fe11c009cd0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.558+0000 7fe13922c700 1 -- 172.21.15.114:0/793998729 shutdown_connections 2023-10-18T14:05:07.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.558+0000 7fe13922c700 1 --2- 172.21.15.114:0/793998729 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe134105b30 0x7fe13410d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.558+0000 7fe13922c700 1 --2- 172.21.15.114:0/793998729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe134067d40 0x7fe134068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.558+0000 7fe13922c700 1 --2- 172.21.15.114:0/793998729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe134105170 0x7fe1341055f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.558+0000 7fe13922c700 1 -- 172.21.15.114:0/793998729 >> 172.21.15.114:0/793998729 conn(0x7fe1340767f0 msgr2=0x7fe134076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.558+0000 7fe13922c700 1 -- 172.21.15.114:0/793998729 shutdown_connections 2023-10-18T14:05:07.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.558+0000 7fe13922c700 1 -- 172.21.15.114:0/793998729 wait complete. 2023-10-18T14:05:07.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.559+0000 7fe13922c700 1 Processor -- start 2023-10-18T14:05:07.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.559+0000 7fe13922c700 1 -- start start 2023-10-18T14:05:07.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.559+0000 7fe13922c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe134067d40 0x7fe13419c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.559+0000 7fe13922c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe134105170 0x7fe13419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.559+0000 7fe13922c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe134105b30 0x7fe134196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.559+0000 7fe13922c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe134197070 con 0x7fe134105b30 2023-10-18T14:05:07.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.559+0000 7fe13922c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1341971e0 con 0x7fe134067d40 2023-10-18T14:05:07.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.559+0000 7fe13922c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1341973a0 con 0x7fe134105170 2023-10-18T14:05:07.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.559+0000 7fe13359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe134105b30 0x7fe134196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe13259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe134105170 0x7fe13419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe132d9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe134067d40 0x7fe13419c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe13259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe134105170 0x7fe13419ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:48954/0 (socket says 172.21.15.114:48954) 2023-10-18T14:05:07.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe13259c700 1 -- 172.21.15.114:0/1916497423 learned_addr learned my addr 172.21.15.114:0/1916497423 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe13359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe134105b30 0x7fe134196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45020/0 (socket says 172.21.15.114:45020) 2023-10-18T14:05:07.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe132d9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe134067d40 0x7fe13419c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41160/0 (socket says 172.21.15.114:41160) 2023-10-18T14:05:07.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe13359e700 1 -- 172.21.15.114:0/1916497423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe134105170 msgr2=0x7fe13419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe13359e700 1 --2- 172.21.15.114:0/1916497423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe134105170 0x7fe13419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe13359e700 1 -- 172.21.15.114:0/1916497423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe134067d40 msgr2=0x7fe13419c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe13359e700 1 --2- 172.21.15.114:0/1916497423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe134067d40 0x7fe13419c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe13359e700 1 -- 172.21.15.114:0/1916497423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0095f0 con 0x7fe134105b30 2023-10-18T14:05:07.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe13259c700 1 --2- 172.21.15.114:0/1916497423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe134105170 0x7fe13419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:07.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe13359e700 1 --2- 172.21.15.114:0/1916497423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe134105b30 0x7fe134196a10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe12c007f10 tx=0x7fe12c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe12bfff700 1 -- 172.21.15.114:0/1916497423 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c004db0 con 0x7fe134105b30 2023-10-18T14:05:07.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe13922c700 1 -- 172.21.15.114:0/1916497423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe134197680 con 0x7fe134105b30 2023-10-18T14:05:07.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe13922c700 1 -- 172.21.15.114:0/1916497423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1341a38d0 con 0x7fe134105b30 2023-10-18T14:05:07.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe12bfff700 1 -- 172.21.15.114:0/1916497423 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe12c00f040 con 0x7fe134105b30 2023-10-18T14:05:07.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.560+0000 7fe12bfff700 1 -- 172.21.15.114:0/1916497423 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c004280 con 0x7fe134105b30 2023-10-18T14:05:07.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.563+0000 7fe12bfff700 1 -- 172.21.15.114:0/1916497423 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fe12c0043e0 con 0x7fe134105b30 2023-10-18T14:05:07.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.563+0000 7fe12bfff700 1 --2- 172.21.15.114:0/1916497423 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1200a15f0 0x7fe1200a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.564+0000 7fe12bfff700 1 -- 172.21.15.114:0/1916497423 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe12c0cc840 con 0x7fe134105b30 2023-10-18T14:05:07.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.564+0000 7fe132d9d700 1 --2- 172.21.15.114:0/1916497423 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1200a15f0 0x7fe1200a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.564+0000 7fe132d9d700 1 --2- 172.21.15.114:0/1916497423 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1200a15f0 0x7fe1200a3ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe124005950 tx=0x7fe12400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.564+0000 7fe145415b80 1 Processor -- start 2023-10-18T14:05:07.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.564+0000 7fe145415b80 1 -- start start 2023-10-18T14:05:07.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe145415b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9050be0 0x55def9050fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe145415b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9051500 0x55def904b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe145415b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 0x55def904ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe145415b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def8fbe6e0 con 0x55def904b5d0 2023-10-18T14:05:07.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe145415b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def8fa4c60 con 0x55def9050be0 2023-10-18T14:05:07.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe145415b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def8fa2580 con 0x55def9051500 2023-10-18T14:05:07.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe13359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 0x55def904ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe13359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 0x55def904ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45028/0 (socket says 172.21.15.114:45028) 2023-10-18T14:05:07.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe13359e700 1 -- 172.21.15.114:0/257687603 learned_addr learned my addr 172.21.15.114:0/257687603 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe13259c700 1 --2- 172.21.15.114:0/257687603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9051500 0x55def904b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe132d9d700 1 --2- 172.21.15.114:0/257687603 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9050be0 0x55def9050fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe13359e700 1 -- 172.21.15.114:0/257687603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9051500 msgr2=0x55def904b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe13359e700 1 --2- 172.21.15.114:0/257687603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9051500 0x55def904b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe13359e700 1 -- 172.21.15.114:0/257687603 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9050be0 msgr2=0x55def9050fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe13359e700 1 --2- 172.21.15.114:0/257687603 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9050be0 0x55def9050fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.565+0000 7fe13359e700 1 -- 172.21.15.114:0/257687603 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55def8f5b3f0 con 0x55def904b5d0 2023-10-18T14:05:07.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.566+0000 7fe13359e700 1 --2- 172.21.15.114:0/257687603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 0x55def904ba50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe12c096270 tx=0x7fe12c099470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a23c1c21a7e4f41 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.566+0000 7fe1297fa700 1 -- 172.21.15.114:0/257687603 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c0a1b90 con 0x55def904b5d0 2023-10-18T14:05:07.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.566+0000 7fe1297fa700 1 -- 172.21.15.114:0/257687603 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe12c097ba0 con 0x55def904b5d0 2023-10-18T14:05:07.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.566+0000 7fe1297fa700 1 -- 172.21.15.114:0/257687603 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c0048f0 con 0x55def904b5d0 2023-10-18T14:05:07.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.566+0000 7fe145415b80 1 -- 172.21.15.114:0/257687603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 msgr2=0x55def904ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.566+0000 7fe145415b80 1 --2- 172.21.15.114:0/257687603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 0x55def904ba50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe12c096270 tx=0x7fe12c099470 comp rx=0 tx=0).stop 2023-10-18T14:05:07.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 -- 172.21.15.114:0/257687603 shutdown_connections 2023-10-18T14:05:07.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 --2- 172.21.15.114:0/257687603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 0x55def904ba50 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 --2- 172.21.15.114:0/257687603 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9050be0 0x55def9050fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 --2- 172.21.15.114:0/257687603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9051500 0x55def904b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 -- 172.21.15.114:0/257687603 >> 172.21.15.114:0/257687603 conn(0x55def8fbf720 msgr2=0x55def9045b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 -- 172.21.15.114:0/257687603 shutdown_connections 2023-10-18T14:05:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 -- 172.21.15.114:0/257687603 wait complete. 2023-10-18T14:05:07.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 -- start start 2023-10-18T14:05:07.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 Processor -- start 2023-10-18T14:05:07.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def904b5d0 0x55def9057500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9050be0 0x55def9054780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9051500 0x55def9054ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def8f9de70 con 0x55def9050be0 2023-10-18T14:05:07.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def8f3a710 con 0x55def9051500 2023-10-18T14:05:07.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def8f3a3b0 con 0x55def904b5d0 2023-10-18T14:05:07.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe145415b80 10 client.0 _ll_register_callbacks cb 0x55def8e84a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:07.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe13259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9050be0 0x55def9054780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe132d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def904b5d0 0x55def9057500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe13259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9050be0 0x55def9054780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45032/0 (socket says 172.21.15.114:45032) 2023-10-18T14:05:07.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.567+0000 7fe13259c700 1 -- 172.21.15.114:0/1577171248 learned_addr learned my addr 172.21.15.114:0/1577171248 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe13359e700 1 --2- 172.21.15.114:0/1577171248 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9051500 0x55def9054ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe132d9d700 1 -- 172.21.15.114:0/1577171248 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9051500 msgr2=0x55def9054ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe132d9d700 1 --2- 172.21.15.114:0/1577171248 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9051500 0x55def9054ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe132d9d700 1 -- 172.21.15.114:0/1577171248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9050be0 msgr2=0x55def9054780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe132d9d700 1 --2- 172.21.15.114:0/1577171248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9050be0 0x55def9054780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe132d9d700 1 -- 172.21.15.114:0/1577171248 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1341a38d0 con 0x55def904b5d0 2023-10-18T14:05:07.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe13259c700 1 --2- 172.21.15.114:0/1577171248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9050be0 0x55def9054780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:07.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe132d9d700 1 --2- 172.21.15.114:0/1577171248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def904b5d0 0x55def9057500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe124010a40 tx=0x7fe1240047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac7199b87a8296e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe11a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-10-18T14:05:07.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe11a7fc700 1 -- 172.21.15.114:0/1577171248 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124004a30 con 0x55def904b5d0 2023-10-18T14:05:07.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe145415b80 1 -- 172.21.15.114:0/1577171248 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55def8fa2ef0 con 0x55def904b5d0 2023-10-18T14:05:07.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe11a7fc700 1 -- 172.21.15.114:0/1577171248 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe124017070 con 0x55def904b5d0 2023-10-18T14:05:07.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe11a7fc700 1 -- 172.21.15.114:0/1577171248 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe124004b90 con 0x55def904b5d0 2023-10-18T14:05:07.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe145415b80 10 client.25399 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:07.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.568+0000 7fe145415b80 1 -- 172.21.15.114:0/1577171248 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55def8dc8de0 con 0x55def904b5d0 2023-10-18T14:05:07.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.569+0000 7fe11a7fc700 1 -- 172.21.15.114:0/1577171248 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55def8fa2ef0 con 0x55def904b5d0 2023-10-18T14:05:07.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.569+0000 7fe11a7fc700 1 -- 172.21.15.114:0/1577171248 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe12401f500 con 0x55def904b5d0 2023-10-18T14:05:07.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.569+0000 7fe145415b80 10 client.25399 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:07.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.569+0000 7fe145415b80 10 client.25399 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-18T14:05:07.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.569+0000 7fe145415b80 20 client.25399 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:07.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.569+0000 7fe145415b80 1 --2- 172.21.15.114:0/1577171248 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55def9064f40 0x55def9067360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.569+0000 7fe145415b80 4 client.25399 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:07.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.569+0000 7fe145415b80 1 -- 172.21.15.114:0/1577171248 --> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55def901a8b0 con 0x55def9064f40 2023-10-18T14:05:07.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.569+0000 7fe13259c700 1 --2- 172.21.15.114:0/1577171248 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55def9064f40 0x55def9067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.569+0000 7fe11a7fc700 10 client.25399 ms_handle_connect on v2:172.21.15.172:6834/2655563129 2023-10-18T14:05:07.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.569+0000 7fe13259c700 1 --2- 172.21.15.114:0/1577171248 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55def9064f40 0x55def9067360 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=751595c863e4a5cd server_cookie=84ec32abca36bbf6 in_seq=0 out_seq=0 2023-10-18T14:05:07.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe11a7fc700 1 -- 172.21.15.114:0/1577171248 <== mds.2 v2:172.21.15.172:6834/2655563129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55def901a8b0 con 0x55def9064f40 2023-10-18T14:05:07.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe11a7fc700 10 client.25399 handle_command_reply: tid=0 2023-10-18T14:05:07.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe145415b80 1 client.25399 shutdown 2023-10-18T14:05:07.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe145415b80 1 -- 172.21.15.114:0/1577171248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def904b5d0 msgr2=0x55def9057500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe145415b80 1 --2- 172.21.15.114:0/1577171248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def904b5d0 0x55def9057500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe124010a40 tx=0x7fe1240047c0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe145415b80 1 -- 172.21.15.114:0/1577171248 shutdown_connections 2023-10-18T14:05:07.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe145415b80 1 --2- 172.21.15.114:0/1577171248 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55def9064f40 0x55def9067360 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe145415b80 1 --2- 172.21.15.114:0/1577171248 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9051500 0x55def9054ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe11a7fc700 0 client.25399 ms_handle_reset on v2:172.21.15.172:6834/2655563129 2023-10-18T14:05:07.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe145415b80 1 --2- 172.21.15.114:0/1577171248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def904b5d0 0x55def9057500 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe145415b80 1 --2- 172.21.15.114:0/1577171248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9050be0 0x55def9054780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe145415b80 1 -- 172.21.15.114:0/1577171248 >> 172.21.15.114:0/1577171248 conn(0x55def8fbf720 msgr2=0x55def904a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe145415b80 1 -- 172.21.15.114:0/1577171248 shutdown_connections 2023-10-18T14:05:07.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.570+0000 7fe145415b80 1 -- 172.21.15.114:0/1577171248 wait complete. 2023-10-18T14:05:07.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.571+0000 7fe145415b80 20 client.25399 trim_cache size 0 max 16384 2023-10-18T14:05:07.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe145415b80 1 Processor -- start 2023-10-18T14:05:07.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe145415b80 1 -- start start 2023-10-18T14:05:07.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe145415b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def904b5d0 0x55def90405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe145415b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9050be0 0x55def905be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe145415b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9051500 0x55def904a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe145415b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def8e1e920 con 0x55def9051500 2023-10-18T14:05:07.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe145415b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def9046810 con 0x55def904b5d0 2023-10-18T14:05:07.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe145415b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def9055df0 con 0x55def9050be0 2023-10-18T14:05:07.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe13359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9051500 0x55def904a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe13359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9051500 0x55def904a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45042/0 (socket says 172.21.15.114:45042) 2023-10-18T14:05:07.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe13359e700 1 -- 172.21.15.114:0/1482030255 learned_addr learned my addr 172.21.15.114:0/1482030255 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe13259c700 1 --2- 172.21.15.114:0/1482030255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9050be0 0x55def905be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe132d9d700 1 --2- 172.21.15.114:0/1482030255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def904b5d0 0x55def90405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe13359e700 1 -- 172.21.15.114:0/1482030255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9050be0 msgr2=0x55def905be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe13359e700 1 --2- 172.21.15.114:0/1482030255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9050be0 0x55def905be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe13359e700 1 -- 172.21.15.114:0/1482030255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def904b5d0 msgr2=0x55def90405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe13359e700 1 --2- 172.21.15.114:0/1482030255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def904b5d0 0x55def90405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe13359e700 1 -- 172.21.15.114:0/1482030255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55def8db1c60 con 0x55def9051500 2023-10-18T14:05:07.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.584+0000 7fe13259c700 1 --2- 172.21.15.114:0/1482030255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9050be0 0x55def905be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:07.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.585+0000 7fe13359e700 1 --2- 172.21.15.114:0/1482030255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9051500 0x55def904a080 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0ca0c0 tx=0x7fe12c0996e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104d80bb5f477b13 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.585+0000 7fe129ffb700 1 -- 172.21.15.114:0/1482030255 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c0a1b90 con 0x55def9051500 2023-10-18T14:05:07.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.585+0000 7fe129ffb700 1 -- 172.21.15.114:0/1482030255 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe12c0ca290 con 0x55def9051500 2023-10-18T14:05:07.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.585+0000 7fe129ffb700 1 -- 172.21.15.114:0/1482030255 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c004690 con 0x55def9051500 2023-10-18T14:05:07.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.586+0000 7fe145415b80 1 -- 172.21.15.114:0/1482030255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9051500 msgr2=0x55def904a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.586+0000 7fe145415b80 1 --2- 172.21.15.114:0/1482030255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9051500 0x55def904a080 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0ca0c0 tx=0x7fe12c0996e0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.586+0000 7fe145415b80 1 -- 172.21.15.114:0/1482030255 shutdown_connections 2023-10-18T14:05:07.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.586+0000 7fe145415b80 1 --2- 172.21.15.114:0/1482030255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def9051500 0x55def904a080 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.586+0000 7fe145415b80 1 --2- 172.21.15.114:0/1482030255 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def904b5d0 0x55def90405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.586+0000 7fe145415b80 1 --2- 172.21.15.114:0/1482030255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9050be0 0x55def905be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.586+0000 7fe145415b80 1 -- 172.21.15.114:0/1482030255 >> 172.21.15.114:0/1482030255 conn(0x55def8fbf720 msgr2=0x55def9045aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.586+0000 7fe145415b80 1 -- 172.21.15.114:0/1482030255 shutdown_connections 2023-10-18T14:05:07.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.586+0000 7fe145415b80 1 -- 172.21.15.114:0/1482030255 wait complete. 2023-10-18T14:05:07.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.586+0000 7fe145415b80 1 -- start start 2023-10-18T14:05:07.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.586+0000 7fe145415b80 1 Processor -- start 2023-10-18T14:05:07.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe145415b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 0x55def905a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe145415b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9050be0 0x55def905a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe145415b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9051500 0x55def90b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe145415b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def905ace0 con 0x55def904b5d0 2023-10-18T14:05:07.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe145415b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def90b82d0 con 0x55def9050be0 2023-10-18T14:05:07.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe145415b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55def90b8490 con 0x55def9051500 2023-10-18T14:05:07.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe145415b80 10 client.0 _ll_register_callbacks cb 0x55def8e84a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:07.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe132d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 0x55def905a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe132d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 0x55def905a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45044/0 (socket says 172.21.15.114:45044) 2023-10-18T14:05:07.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe132d9d700 1 -- 172.21.15.114:0/1618317368 learned_addr learned my addr 172.21.15.114:0/1618317368 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe13259c700 1 --2- 172.21.15.114:0/1618317368 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9050be0 0x55def905a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe13359e700 1 --2- 172.21.15.114:0/1618317368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9051500 0x55def90b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe132d9d700 1 -- 172.21.15.114:0/1618317368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9051500 msgr2=0x55def90b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe132d9d700 1 --2- 172.21.15.114:0/1618317368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9051500 0x55def90b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe132d9d700 1 -- 172.21.15.114:0/1618317368 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9050be0 msgr2=0x55def905a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe132d9d700 1 --2- 172.21.15.114:0/1618317368 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9050be0 0x55def905a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe132d9d700 1 -- 172.21.15.114:0/1618317368 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13410de70 con 0x55def904b5d0 2023-10-18T14:05:07.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe132d9d700 1 --2- 172.21.15.114:0/1618317368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 0x55def905a050 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe12401f8e0 tx=0x7fe124010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54aed79bf31e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.587+0000 7fe11a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:07.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe11a7fc700 1 -- 172.21.15.114:0/1618317368 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12401fad0 con 0x55def904b5d0 2023-10-18T14:05:07.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe11a7fc700 1 -- 172.21.15.114:0/1618317368 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe124017050 con 0x55def904b5d0 2023-10-18T14:05:07.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe145415b80 1 -- 172.21.15.114:0/1618317368 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe12c097ba0 con 0x55def904b5d0 2023-10-18T14:05:07.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe11a7fc700 1 -- 172.21.15.114:0/1618317368 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe12401fc30 con 0x55def904b5d0 2023-10-18T14:05:07.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe145415b80 10 client.15996 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:07.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe145415b80 1 -- 172.21.15.114:0/1618317368 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55def8f5b3f0 con 0x55def904b5d0 2023-10-18T14:05:07.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe11a7fc700 1 -- 172.21.15.114:0/1618317368 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe12c097ba0 con 0x55def904b5d0 2023-10-18T14:05:07.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe11a7fc700 1 -- 172.21.15.114:0/1618317368 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe124039c80 con 0x55def904b5d0 2023-10-18T14:05:07.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe145415b80 10 client.15996 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:07.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe145415b80 10 client.15996 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-18T14:05:07.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe145415b80 20 client.15996 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:07.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe145415b80 1 --2- 172.21.15.114:0/1618317368 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55def90b9c10 0x55def90bc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe145415b80 4 client.15996 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:05:07.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe145415b80 1 -- 172.21.15.114:0/1618317368 --> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55def8f96e50 con 0x55def90b9c10 2023-10-18T14:05:07.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.588+0000 7fe13259c700 1 --2- 172.21.15.114:0/1618317368 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55def90b9c10 0x55def90bc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe13259c700 1 --2- 172.21.15.114:0/1618317368 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55def90b9c10 0x55def90bc030 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=666033b3d2457da4 server_cookie=1dcd6d893c6f6678 in_seq=0 out_seq=0 2023-10-18T14:05:07.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe11a7fc700 10 client.15996 ms_handle_connect on v2:172.21.15.172:6834/2655563129 2023-10-18T14:05:07.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe11a7fc700 1 -- 172.21.15.114:0/1618317368 <== mds.2 v2:172.21.15.172:6834/2655563129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55def8f96e50 con 0x55def90b9c10 2023-10-18T14:05:07.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe11a7fc700 10 client.15996 handle_command_reply: tid=0 2023-10-18T14:05:07.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe145415b80 1 client.15996 shutdown 2023-10-18T14:05:07.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe145415b80 1 -- 172.21.15.114:0/1618317368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 msgr2=0x55def905a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe145415b80 1 --2- 172.21.15.114:0/1618317368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 0x55def905a050 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe12401f8e0 tx=0x7fe124010af0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe145415b80 1 -- 172.21.15.114:0/1618317368 shutdown_connections 2023-10-18T14:05:07.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe145415b80 1 --2- 172.21.15.114:0/1618317368 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55def90b9c10 0x55def90bc030 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe145415b80 1 --2- 172.21.15.114:0/1618317368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55def9051500 0x55def90b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe145415b80 1 --2- 172.21.15.114:0/1618317368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55def904b5d0 0x55def905a050 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe11a7fc700 0 client.15996 ms_handle_reset on v2:172.21.15.172:6834/2655563129 2023-10-18T14:05:07.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe145415b80 1 --2- 172.21.15.114:0/1618317368 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55def9050be0 0x55def905a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe145415b80 1 -- 172.21.15.114:0/1618317368 >> 172.21.15.114:0/1618317368 conn(0x55def8fbf720 msgr2=0x55def904f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe145415b80 1 -- 172.21.15.114:0/1618317368 shutdown_connections 2023-10-18T14:05:07.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe145415b80 1 -- 172.21.15.114:0/1618317368 wait complete. 2023-10-18T14:05:07.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.589+0000 7fe145415b80 20 client.15996 trim_cache size 0 max 16384 2023-10-18T14:05:07.620 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:05:07.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.590+0000 7fe13922c700 1 -- 172.21.15.114:0/1916497423 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1200a15f0 msgr2=0x7fe1200a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.590+0000 7fe13922c700 1 --2- 172.21.15.114:0/1916497423 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1200a15f0 0x7fe1200a3ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe124005950 tx=0x7fe12400b410 comp rx=0 tx=0).stop 2023-10-18T14:05:07.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.590+0000 7fe13922c700 1 -- 172.21.15.114:0/1916497423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe134105b30 msgr2=0x7fe134196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.590+0000 7fe13922c700 1 --2- 172.21.15.114:0/1916497423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe134105b30 0x7fe134196a10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe12c007f10 tx=0x7fe12c00d3b0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.590+0000 7fe13922c700 1 -- 172.21.15.114:0/1916497423 shutdown_connections 2023-10-18T14:05:07.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.590+0000 7fe13922c700 1 --2- 172.21.15.114:0/1916497423 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe1200a15f0 0x7fe1200a3ab0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.590+0000 7fe13922c700 1 --2- 172.21.15.114:0/1916497423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe134105b30 0x7fe134196a10 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.590+0000 7fe13922c700 1 --2- 172.21.15.114:0/1916497423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe134067d40 0x7fe13419c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.590+0000 7fe13922c700 1 --2- 172.21.15.114:0/1916497423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe134105170 0x7fe13419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.590+0000 7fe13922c700 1 -- 172.21.15.114:0/1916497423 >> 172.21.15.114:0/1916497423 conn(0x7fe1340767f0 msgr2=0x7fe1340fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.590+0000 7fe13922c700 1 -- 172.21.15.114:0/1916497423 shutdown_connections 2023-10-18T14:05:07.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.590+0000 7fe13922c700 1 -- 172.21.15.114:0/1916497423 wait complete. 2023-10-18T14:05:07.624 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-18T14:05:07.687 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:07 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/4003505309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:05:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.748+0000 7f06a4bd4700 1 -- 172.21.15.114:0/3261144355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06a00ff120 msgr2=0x7f06a00ff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.748+0000 7f06a4bd4700 1 --2- 172.21.15.114:0/3261144355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06a00ff120 0x7f06a00ff5a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0694009990 tx=0x7f0694009ca0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.748+0000 7f06a4bd4700 1 -- 172.21.15.114:0/3261144355 shutdown_connections 2023-10-18T14:05:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.748+0000 7f06a4bd4700 1 --2- 172.21.15.114:0/3261144355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06a00ffae0 0x7f06a010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.748+0000 7f06a4bd4700 1 --2- 172.21.15.114:0/3261144355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06a0106860 0x7f06a0106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.748+0000 7f06a4bd4700 1 --2- 172.21.15.114:0/3261144355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06a00ff120 0x7f06a00ff5a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.748+0000 7f06a4bd4700 1 -- 172.21.15.114:0/3261144355 >> 172.21.15.114:0/3261144355 conn(0x7f06a0074890 msgr2=0x7f06a0074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.748+0000 7f06a4bd4700 1 -- 172.21.15.114:0/3261144355 shutdown_connections 2023-10-18T14:05:07.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.748+0000 7f06a4bd4700 1 -- 172.21.15.114:0/3261144355 wait complete. 2023-10-18T14:05:07.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f06a4bd4700 1 Processor -- start 2023-10-18T14:05:07.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f06a4bd4700 1 -- start start 2023-10-18T14:05:07.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f06a4bd4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06a00ff120 0x7f06a019c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f06a4bd4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06a00ffae0 0x7f06a019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f06a4bd4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06a0106860 0x7f06a01969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f06a4bd4700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a0197050 con 0x7f06a00ff120 2023-10-18T14:05:07.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f06a4bd4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a01971c0 con 0x7f06a00ffae0 2023-10-18T14:05:07.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f06a4bd4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a0197380 con 0x7f06a0106860 2023-10-18T14:05:07.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f069e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06a00ff120 0x7f06a019c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f069e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06a00ff120 0x7f06a019c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45058/0 (socket says 172.21.15.114:45058) 2023-10-18T14:05:07.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f069e59c700 1 -- 172.21.15.114:0/1611061541 learned_addr learned my addr 172.21.15.114:0/1611061541 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f069ed9d700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06a0106860 0x7f06a01969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f069dd9b700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06a00ffae0 0x7f06a019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f069e59c700 1 -- 172.21.15.114:0/1611061541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06a0106860 msgr2=0x7f06a01969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f069e59c700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06a0106860 0x7f06a01969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f069e59c700 1 -- 172.21.15.114:0/1611061541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06a00ffae0 msgr2=0x7f06a019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f069e59c700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06a00ffae0 0x7f06a019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f069e59c700 1 -- 172.21.15.114:0/1611061541 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06940095f0 con 0x7f06a00ff120 2023-10-18T14:05:07.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.749+0000 7f069dd9b700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06a00ffae0 0x7f06a019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:07.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.750+0000 7f069e59c700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06a00ff120 0x7f06a019c8c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f069000c920 tx=0x7f069000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.750+0000 7f068f7fe700 1 -- 172.21.15.114:0/1611061541 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690007b00 con 0x7f06a00ff120 2023-10-18T14:05:07.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.750+0000 7f068f7fe700 1 -- 172.21.15.114:0/1611061541 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f069000ce70 con 0x7f06a00ff120 2023-10-18T14:05:07.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.750+0000 7f068f7fe700 1 -- 172.21.15.114:0/1611061541 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900054e0 con 0x7f06a00ff120 2023-10-18T14:05:07.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.750+0000 7f06a4bd4700 1 -- 172.21.15.114:0/1611061541 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a0197660 con 0x7f06a00ff120 2023-10-18T14:05:07.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.750+0000 7f06a4bd4700 1 -- 172.21.15.114:0/1611061541 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a01a38b0 con 0x7f06a00ff120 2023-10-18T14:05:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.753+0000 7f068f7fe700 1 -- 172.21.15.114:0/1611061541 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f0690004750 con 0x7f06a00ff120 2023-10-18T14:05:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.753+0000 7f06b0dbdb80 1 Processor -- start 2023-10-18T14:05:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f06b0dbdb80 1 -- start start 2023-10-18T14:05:07.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f068f7fe700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f06880a1670 0x7f06880a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f06b0dbdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f06b0dbdb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 0x55fa6f2a2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f06b0dbdb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2a2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f06b0dbdb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6f2156e0 con 0x55fa6f2a25d0 2023-10-18T14:05:07.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f06b0dbdb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6f1fbc60 con 0x55fa6f2a8500 2023-10-18T14:05:07.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f06b0dbdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6f1f9580 con 0x55fa6f2a7be0 2023-10-18T14:05:07.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f069ed9d700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f06880a1670 0x7f06880a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f068f7fe700 1 -- 172.21.15.114:0/1611061541 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f06900ccc10 con 0x7f06a00ff120 2023-10-18T14:05:07.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f069e59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f069e59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2a7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49002/0 (socket says 172.21.15.114:49002) 2023-10-18T14:05:07.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f069e59c700 1 -- 172.21.15.114:0/3683631139 learned_addr learned my addr 172.21.15.114:0/3683631139 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f069dd9b700 1 --2- 172.21.15.114:0/3683631139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 0x55fa6f2a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f069ed9d700 1 --2- 172.21.15.114:0/3683631139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2a2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f069e59c700 1 -- 172.21.15.114:0/3683631139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 msgr2=0x55fa6f2a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f069e59c700 1 --2- 172.21.15.114:0/3683631139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 0x55fa6f2a2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f069e59c700 1 -- 172.21.15.114:0/3683631139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 msgr2=0x55fa6f2a2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f069e59c700 1 --2- 172.21.15.114:0/3683631139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2a2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.754+0000 7f069e59c700 1 -- 172.21.15.114:0/3683631139 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa6f1b23f0 con 0x55fa6f2a7be0 2023-10-18T14:05:07.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.755+0000 7f069ed9d700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f06880a1670 0x7f06880a3b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0698009c90 tx=0x7f0698004320 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.755+0000 7f069e59c700 1 --2- 172.21.15.114:0/3683631139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2a7fc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0690096680 tx=0x7f0690099820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeb13c5c312146f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.755+0000 7f068cff9700 1 -- 172.21.15.114:0/3683631139 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690099c10 con 0x55fa6f2a7be0 2023-10-18T14:05:07.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.755+0000 7f068cff9700 1 -- 172.21.15.114:0/3683631139 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f069009dd60 con 0x55fa6f2a7be0 2023-10-18T14:05:07.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.755+0000 7f068cff9700 1 -- 172.21.15.114:0/3683631139 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900ca600 con 0x55fa6f2a7be0 2023-10-18T14:05:07.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.755+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3683631139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 msgr2=0x55fa6f2a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.755+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3683631139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2a7fc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0690096680 tx=0x7f0690099820 comp rx=0 tx=0).stop 2023-10-18T14:05:07.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.755+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3683631139 shutdown_connections 2023-10-18T14:05:07.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3683631139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2a2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3683631139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2a7fc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3683631139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 0x55fa6f2a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3683631139 >> 172.21.15.114:0/3683631139 conn(0x55fa6f216720 msgr2=0x55fa6f29cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3683631139 shutdown_connections 2023-10-18T14:05:07.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3683631139 wait complete. 2023-10-18T14:05:07.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 -- start start 2023-10-18T14:05:07.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 Processor -- start 2023-10-18T14:05:07.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2ab790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a8500 0x55fa6f2abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6f1f4e70 con 0x55fa6f2a7be0 2023-10-18T14:05:07.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6f191710 con 0x55fa6f2a25d0 2023-10-18T14:05:07.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6f1913b0 con 0x55fa6f2a8500 2023-10-18T14:05:07.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f06b0dbdb80 10 client.0 _ll_register_callbacks cb 0x55fa6f0dba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:07.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f069dd9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.756+0000 7f069ed9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a8500 0x55fa6f2abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f069dd9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2ab790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45074/0 (socket says 172.21.15.114:45074) 2023-10-18T14:05:07.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f069dd9b700 1 -- 172.21.15.114:0/3311563829 learned_addr learned my addr 172.21.15.114:0/3311563829 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f069ed9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a8500 0x55fa6f2abda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49012/0 (socket says 172.21.15.114:49012) 2023-10-18T14:05:07.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f069e59c700 1 --2- 172.21.15.114:0/3311563829 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f069ed9d700 1 -- 172.21.15.114:0/3311563829 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a25d0 msgr2=0x55fa6f2ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f069ed9d700 1 --2- 172.21.15.114:0/3311563829 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f069ed9d700 1 -- 172.21.15.114:0/3311563829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a7be0 msgr2=0x55fa6f2ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f069ed9d700 1 --2- 172.21.15.114:0/3311563829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f069ed9d700 1 -- 172.21.15.114:0/3311563829 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a01a38b0 con 0x55fa6f2a8500 2023-10-18T14:05:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f069dd9b700 1 --2- 172.21.15.114:0/3311563829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f069ed9d700 1 --2- 172.21.15.114:0/3311563829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a8500 0x55fa6f2abda0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0698003fd0 tx=0x7f0698004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73041804577b806 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f0685ffb700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-10-18T14:05:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f0685ffb700 1 -- 172.21.15.114:0/3311563829 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069801a670 con 0x55fa6f2a8500 2023-10-18T14:05:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3311563829 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa6f1f9ef0 con 0x55fa6f2a8500 2023-10-18T14:05:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f0685ffb700 1 -- 172.21.15.114:0/3311563829 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f069801a7d0 con 0x55fa6f2a8500 2023-10-18T14:05:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f0685ffb700 1 -- 172.21.15.114:0/3311563829 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f069801a990 con 0x55fa6f2a8500 2023-10-18T14:05:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f06b0dbdb80 10 client.25417 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.757+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3311563829 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fa6f01fde0 con 0x55fa6f2a8500 2023-10-18T14:05:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.758+0000 7f0685ffb700 1 -- 172.21.15.114:0/3311563829 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fa6f1f9ef0 con 0x55fa6f2a8500 2023-10-18T14:05:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.758+0000 7f0685ffb700 1 -- 172.21.15.114:0/3311563829 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0698025ae0 con 0x55fa6f2a8500 2023-10-18T14:05:07.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.758+0000 7f06b0dbdb80 10 client.25417 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:07.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.758+0000 7f06b0dbdb80 10 client.25417 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-18T14:05:07.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.758+0000 7f06b0dbdb80 20 client.25417 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:07.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.758+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3311563829 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55fa6f2bbd40 0x55fa6f2be160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.758+0000 7f06b0dbdb80 4 client.25417 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.758+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3311563829 --> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa6f2718b0 con 0x55fa6f2bbd40 2023-10-18T14:05:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.758+0000 7f069e59c700 1 --2- 172.21.15.114:0/3311563829 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55fa6f2bbd40 0x55fa6f2be160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.758+0000 7f0685ffb700 10 client.25417 ms_handle_connect on v2:172.21.15.172:6836/1821444438 2023-10-18T14:05:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.758+0000 7f069e59c700 1 --2- 172.21.15.114:0/3311563829 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55fa6f2bbd40 0x55fa6f2be160 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78610b1774bbff04 server_cookie=11a61691178f0cab in_seq=0 out_seq=0 2023-10-18T14:05:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f0685ffb700 1 -- 172.21.15.114:0/3311563829 <== mds.1 v2:172.21.15.172:6836/1821444438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fa6f2718b0 con 0x55fa6f2bbd40 2023-10-18T14:05:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f0685ffb700 10 client.25417 handle_command_reply: tid=0 2023-10-18T14:05:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f06b0dbdb80 1 client.25417 shutdown 2023-10-18T14:05:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3311563829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a8500 msgr2=0x55fa6f2abda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3311563829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a8500 0x55fa6f2abda0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0698003fd0 tx=0x7f0698004b40 comp rx=0 tx=0).stop 2023-10-18T14:05:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3311563829 shutdown_connections 2023-10-18T14:05:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3311563829 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55fa6f2bbd40 0x55fa6f2be160 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3311563829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a8500 0x55fa6f2abda0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f0685ffb700 0 client.25417 ms_handle_reset on v2:172.21.15.172:6836/1821444438 2023-10-18T14:05:07.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3311563829 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3311563829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3311563829 >> 172.21.15.114:0/3311563829 conn(0x55fa6f216720 msgr2=0x55fa6f2a1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3311563829 shutdown_connections 2023-10-18T14:05:07.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3311563829 wait complete. 2023-10-18T14:05:07.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.759+0000 7f06b0dbdb80 20 client.25417 trim_cache size 0 max 16384 2023-10-18T14:05:07.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f06b0dbdb80 1 Processor -- start 2023-10-18T14:05:07.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f06b0dbdb80 1 -- start start 2023-10-18T14:05:07.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f06b0dbdb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f06b0dbdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2a1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f06b0dbdb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 0x55fa6f2aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f06b0dbdb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6f297af0 con 0x55fa6f2a25d0 2023-10-18T14:05:07.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f06b0dbdb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6f075920 con 0x55fa6f2a8500 2023-10-18T14:05:07.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f06b0dbdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6f29e5e0 con 0x55fa6f2a7be0 2023-10-18T14:05:07.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f069e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f069e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45080/0 (socket says 172.21.15.114:45080) 2023-10-18T14:05:07.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f069e59c700 1 -- 172.21.15.114:0/3059970282 learned_addr learned my addr 172.21.15.114:0/3059970282 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f069dd9b700 1 --2- 172.21.15.114:0/3059970282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f069ed9d700 1 --2- 172.21.15.114:0/3059970282 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 0x55fa6f2aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f069e59c700 1 -- 172.21.15.114:0/3059970282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 msgr2=0x55fa6f2a1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f069e59c700 1 --2- 172.21.15.114:0/3059970282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2a1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f069e59c700 1 -- 172.21.15.114:0/3059970282 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 msgr2=0x55fa6f2aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f069e59c700 1 --2- 172.21.15.114:0/3059970282 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 0x55fa6f2aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f069e59c700 1 -- 172.21.15.114:0/3059970282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa6f008c60 con 0x55fa6f2a25d0 2023-10-18T14:05:07.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.773+0000 7f069e59c700 1 --2- 172.21.15.114:0/3059970282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2b2d20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f069000c8f0 tx=0x7f0690096080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243c7d0aed792d00 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.774+0000 7f068d7fa700 1 -- 172.21.15.114:0/3059970282 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690099c10 con 0x55fa6f2a25d0 2023-10-18T14:05:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.774+0000 7f068d7fa700 1 -- 172.21.15.114:0/3059970282 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0690097fb0 con 0x55fa6f2a25d0 2023-10-18T14:05:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.774+0000 7f068d7fa700 1 -- 172.21.15.114:0/3059970282 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690099e70 con 0x55fa6f2a25d0 2023-10-18T14:05:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.774+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3059970282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 msgr2=0x55fa6f2b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.774+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3059970282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2b2d20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f069000c8f0 tx=0x7f0690096080 comp rx=0 tx=0).stop 2023-10-18T14:05:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.774+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3059970282 shutdown_connections 2023-10-18T14:05:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.774+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3059970282 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 0x55fa6f2aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.774+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3059970282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2b2d20 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.774+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/3059970282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.774+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3059970282 >> 172.21.15.114:0/3059970282 conn(0x55fa6f216720 msgr2=0x55fa6f2a1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.774+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3059970282 shutdown_connections 2023-10-18T14:05:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.774+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/3059970282 wait complete. 2023-10-18T14:05:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.775+0000 7f06b0dbdb80 1 -- start start 2023-10-18T14:05:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.775+0000 7f06b0dbdb80 1 Processor -- start 2023-10-18T14:05:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.775+0000 7f06b0dbdb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.775+0000 7f06b0dbdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.775+0000 7f06b0dbdb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 0x55fa6f2b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.775+0000 7f06b0dbdb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6f30ecd0 con 0x55fa6f2a25d0 2023-10-18T14:05:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.775+0000 7f06b0dbdb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6f30ee40 con 0x55fa6f2a8500 2023-10-18T14:05:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.775+0000 7f06b0dbdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6f30f000 con 0x55fa6f2a7be0 2023-10-18T14:05:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.775+0000 7f06b0dbdb80 10 client.0 _ll_register_callbacks cb 0x55fa6f0dba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.775+0000 7f069e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.775+0000 7f069e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45086/0 (socket says 172.21.15.114:45086) 2023-10-18T14:05:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.775+0000 7f069e59c700 1 -- 172.21.15.114:0/2752609028 learned_addr learned my addr 172.21.15.114:0/2752609028 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.775+0000 7f069dd9b700 1 --2- 172.21.15.114:0/2752609028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f069ed9d700 1 --2- 172.21.15.114:0/2752609028 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 0x55fa6f2b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f069e59c700 1 -- 172.21.15.114:0/2752609028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 msgr2=0x55fa6f2b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f069e59c700 1 --2- 172.21.15.114:0/2752609028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f069e59c700 1 -- 172.21.15.114:0/2752609028 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 msgr2=0x55fa6f2b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f069e59c700 1 --2- 172.21.15.114:0/2752609028 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 0x55fa6f2b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f069e59c700 1 -- 172.21.15.114:0/2752609028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa6f1b23f0 con 0x55fa6f2a25d0 2023-10-18T14:05:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f069e59c700 1 --2- 172.21.15.114:0/2752609028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2b0d00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f06900b0040 tx=0x7f0690099cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654c73f5e771d59d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f0685ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f0685ffb700 1 -- 172.21.15.114:0/2752609028 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900ca800 con 0x55fa6f2a25d0 2023-10-18T14:05:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f0685ffb700 1 -- 172.21.15.114:0/2752609028 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0690097dd0 con 0x55fa6f2a25d0 2023-10-18T14:05:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/2752609028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f069009dd60 con 0x55fa6f2a25d0 2023-10-18T14:05:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f0685ffb700 1 -- 172.21.15.114:0/2752609028 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0690099100 con 0x55fa6f2a25d0 2023-10-18T14:05:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f06b0dbdb80 10 client.16014 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/2752609028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fa6f046250 con 0x55fa6f2a25d0 2023-10-18T14:05:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f0685ffb700 1 -- 172.21.15.114:0/2752609028 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f069009dd60 con 0x55fa6f2a25d0 2023-10-18T14:05:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f0685ffb700 1 -- 172.21.15.114:0/2752609028 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f06900a1ba0 con 0x55fa6f2a25d0 2023-10-18T14:05:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f06b0dbdb80 10 client.16014 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f06b0dbdb80 10 client.16014 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-18T14:05:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f06b0dbdb80 20 client.16014 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/2752609028 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55fa6f310320 0x55fa6f312710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f06b0dbdb80 4 client.16014 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:05:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.776+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/2752609028 --> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fa6f1ede50 con 0x55fa6f310320 2023-10-18T14:05:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f069dd9b700 1 --2- 172.21.15.114:0/2752609028 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55fa6f310320 0x55fa6f312710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f0685ffb700 10 client.16014 ms_handle_connect on v2:172.21.15.172:6836/1821444438 2023-10-18T14:05:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f069dd9b700 1 --2- 172.21.15.114:0/2752609028 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55fa6f310320 0x55fa6f312710 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4187e7507ca85896 server_cookie=b1ba0f3d15976220 in_seq=0 out_seq=0 2023-10-18T14:05:07.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f0685ffb700 1 -- 172.21.15.114:0/2752609028 <== mds.1 v2:172.21.15.172:6836/1821444438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fa6f1ede50 con 0x55fa6f310320 2023-10-18T14:05:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f0685ffb700 10 client.16014 handle_command_reply: tid=0 2023-10-18T14:05:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f06b0dbdb80 1 client.16014 shutdown 2023-10-18T14:05:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/2752609028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 msgr2=0x55fa6f2b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/2752609028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2b0d00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f06900b0040 tx=0x7f0690099cc0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/2752609028 shutdown_connections 2023-10-18T14:05:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/2752609028 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55fa6f2a8500 0x55fa6f2b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/2752609028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fa6f2a25d0 0x55fa6f2b0d00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/2752609028 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55fa6f310320 0x55fa6f312710 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f06b0dbdb80 1 --2- 172.21.15.114:0/2752609028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa6f2a7be0 0x55fa6f2b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f0685ffb700 0 client.16014 ms_handle_reset on v2:172.21.15.172:6836/1821444438 2023-10-18T14:05:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.777+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/2752609028 >> 172.21.15.114:0/2752609028 conn(0x55fa6f216720 msgr2=0x55fa6f2964b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/2752609028 shutdown_connections 2023-10-18T14:05:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06b0dbdb80 1 -- 172.21.15.114:0/2752609028 wait complete. 2023-10-18T14:05:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06b0dbdb80 20 client.16014 trim_cache size 0 max 16384 2023-10-18T14:05:07.805 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:05:07.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06a4bd4700 1 -- 172.21.15.114:0/1611061541 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f06880a1670 msgr2=0x7f06880a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06a4bd4700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f06880a1670 0x7f06880a3b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0698009c90 tx=0x7f0698004320 comp rx=0 tx=0).stop 2023-10-18T14:05:07.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06a4bd4700 1 -- 172.21.15.114:0/1611061541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06a00ff120 msgr2=0x7f06a019c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06a4bd4700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06a00ff120 0x7f06a019c8c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f069000c920 tx=0x7f069000cc30 comp rx=0 tx=0).stop 2023-10-18T14:05:07.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06a4bd4700 1 -- 172.21.15.114:0/1611061541 shutdown_connections 2023-10-18T14:05:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06a4bd4700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f06880a1670 0x7f06880a3b30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06a4bd4700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06a0106860 0x7f06a01969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06a4bd4700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06a00ff120 0x7f06a019c8c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06a4bd4700 1 --2- 172.21.15.114:0/1611061541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06a00ffae0 0x7f06a019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06a4bd4700 1 -- 172.21.15.114:0/1611061541 >> 172.21.15.114:0/1611061541 conn(0x7f06a0074890 msgr2=0x7f06a00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06a4bd4700 1 -- 172.21.15.114:0/1611061541 shutdown_connections 2023-10-18T14:05:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.778+0000 7f06a4bd4700 1 -- 172.21.15.114:0/1611061541 wait complete. 2023-10-18T14:05:07.809 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-18T14:05:07.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.936+0000 7f921b2bd700 1 -- 172.21.15.114:0/4162479614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140ff640 msgr2=0x7f92140ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.936+0000 7f921b2bd700 1 --2- 172.21.15.114:0/4162479614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140ff640 0x7f92140ffac0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9204009990 tx=0x7f9204009ca0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.936+0000 7f921b2bd700 1 -- 172.21.15.114:0/4162479614 shutdown_connections 2023-10-18T14:05:07.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.936+0000 7f921b2bd700 1 --2- 172.21.15.114:0/4162479614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9214100000 0x7f921410c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.936+0000 7f921b2bd700 1 --2- 172.21.15.114:0/4162479614 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f92141056e0 0x7f9214105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.936+0000 7f921b2bd700 1 --2- 172.21.15.114:0/4162479614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140ff640 0x7f92140ffac0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.936+0000 7f921b2bd700 1 -- 172.21.15.114:0/4162479614 >> 172.21.15.114:0/4162479614 conn(0x7f92140767f0 msgr2=0x7f9214076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.937+0000 7f921b2bd700 1 -- 172.21.15.114:0/4162479614 shutdown_connections 2023-10-18T14:05:07.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.937+0000 7f921b2bd700 1 -- 172.21.15.114:0/4162479614 wait complete. 2023-10-18T14:05:07.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.937+0000 7f921b2bd700 1 Processor -- start 2023-10-18T14:05:07.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.937+0000 7f921b2bd700 1 -- start start 2023-10-18T14:05:07.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.937+0000 7f921b2bd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f92140ff640 0x7f921419c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.937+0000 7f921b2bd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214100000 0x7f921419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.937+0000 7f921b2bd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92141056e0 0x7f9214196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f921b2bd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92141970d0 con 0x7f9214100000 2023-10-18T14:05:07.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f921b2bd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9214197240 con 0x7f92140ff640 2023-10-18T14:05:07.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f921b2bd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9214197400 con 0x7f92141056e0 2023-10-18T14:05:07.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f9218858700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214100000 0x7f921419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f9218858700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214100000 0x7f921419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45102/0 (socket says 172.21.15.114:45102) 2023-10-18T14:05:07.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f9218858700 1 -- 172.21.15.114:0/3387634596 learned_addr learned my addr 172.21.15.114:0/3387634596 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f9219059700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f92140ff640 0x7f921419c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f921985a700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92141056e0 0x7f9214196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f9218858700 1 -- 172.21.15.114:0/3387634596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92141056e0 msgr2=0x7f9214196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f9218858700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92141056e0 0x7f9214196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f9218858700 1 -- 172.21.15.114:0/3387634596 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f92140ff640 msgr2=0x7f921419c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f9218858700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f92140ff640 0x7f921419c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f9218858700 1 -- 172.21.15.114:0/3387634596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92040095f0 con 0x7f9214100000 2023-10-18T14:05:07.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f9219059700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f92140ff640 0x7f921419c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:07.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f921985a700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92141056e0 0x7f9214196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:07.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f9218858700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214100000 0x7f921419ce80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9204000c00 tx=0x7f9204005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f920a7fc700 1 -- 172.21.15.114:0/3387634596 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920401d070 con 0x7f9214100000 2023-10-18T14:05:07.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f920a7fc700 1 -- 172.21.15.114:0/3387634596 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9204022470 con 0x7f9214100000 2023-10-18T14:05:07.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f921b2bd700 1 -- 172.21.15.114:0/3387634596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9214197680 con 0x7f9214100000 2023-10-18T14:05:07.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f920a7fc700 1 -- 172.21.15.114:0/3387634596 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204017650 con 0x7f9214100000 2023-10-18T14:05:07.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.938+0000 7f921b2bd700 1 -- 172.21.15.114:0/3387634596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92141a3930 con 0x7f9214100000 2023-10-18T14:05:07.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.941+0000 7f920a7fc700 1 -- 172.21.15.114:0/3387634596 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f92040225e0 con 0x7f9214100000 2023-10-18T14:05:07.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.942+0000 7f920a7fc700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92000a1670 0x7f92000a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.942+0000 7f9219059700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92000a1670 0x7f92000a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.942+0000 7f920a7fc700 1 -- 172.21.15.114:0/3387634596 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f92040ce630 con 0x7f9214100000 2023-10-18T14:05:07.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.943+0000 7f9219059700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92000a1670 0x7f92000a3b30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9210009be0 tx=0x7f9210009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.943+0000 7f92274a6b80 1 Processor -- start 2023-10-18T14:05:07.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.943+0000 7f92274a6b80 1 -- start start 2023-10-18T14:05:07.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f92274a6b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 0x558adc8b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f92274a6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5fb0 0x558adc8b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f92274a6b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8ba100 0x558adc8ba560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f92274a6b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc8246e0 con 0x558adc8b5690 2023-10-18T14:05:07.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f92274a6b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc80ac60 con 0x558adc8ba100 2023-10-18T14:05:07.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f92274a6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc808580 con 0x558adc8b5fb0 2023-10-18T14:05:07.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f9219059700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 0x558adc8b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f9219059700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 0x558adc8b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45108/0 (socket says 172.21.15.114:45108) 2023-10-18T14:05:07.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f9219059700 1 -- 172.21.15.114:0/4278107299 learned_addr learned my addr 172.21.15.114:0/4278107299 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f921985a700 1 --2- 172.21.15.114:0/4278107299 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8ba100 0x558adc8ba560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f9218858700 1 --2- 172.21.15.114:0/4278107299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5fb0 0x558adc8b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f9219059700 1 -- 172.21.15.114:0/4278107299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5fb0 msgr2=0x558adc8b9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f9219059700 1 --2- 172.21.15.114:0/4278107299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5fb0 0x558adc8b9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f9219059700 1 -- 172.21.15.114:0/4278107299 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8ba100 msgr2=0x558adc8ba560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f9219059700 1 --2- 172.21.15.114:0/4278107299 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8ba100 0x558adc8ba560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f9219059700 1 -- 172.21.15.114:0/4278107299 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558adc7c13f0 con 0x558adc8b5690 2023-10-18T14:05:07.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f9218858700 1 --2- 172.21.15.114:0/4278107299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5fb0 0x558adc8b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:07.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f9219059700 1 --2- 172.21.15.114:0/4278107299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 0x558adc8b5a70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9210010d00 tx=0x7f9210013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b971c50fd2bcf209 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f91ff7fe700 1 -- 172.21.15.114:0/4278107299 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210012ab0 con 0x558adc8b5690 2023-10-18T14:05:07.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f91ff7fe700 1 -- 172.21.15.114:0/4278107299 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9210012c10 con 0x558adc8b5690 2023-10-18T14:05:07.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.944+0000 7f91ff7fe700 1 -- 172.21.15.114:0/4278107299 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921001e5b0 con 0x558adc8b5690 2023-10-18T14:05:07.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.945+0000 7f92274a6b80 1 -- 172.21.15.114:0/4278107299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 msgr2=0x558adc8b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.945+0000 7f92274a6b80 1 --2- 172.21.15.114:0/4278107299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 0x558adc8b5a70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9210010d00 tx=0x7f9210013000 comp rx=0 tx=0).stop 2023-10-18T14:05:07.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.945+0000 7f92274a6b80 1 -- 172.21.15.114:0/4278107299 shutdown_connections 2023-10-18T14:05:07.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.945+0000 7f92274a6b80 1 --2- 172.21.15.114:0/4278107299 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8ba100 0x558adc8ba560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.945+0000 7f92274a6b80 1 --2- 172.21.15.114:0/4278107299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 0x558adc8b5a70 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.945+0000 7f92274a6b80 1 --2- 172.21.15.114:0/4278107299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5fb0 0x558adc8b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.945+0000 7f92274a6b80 1 -- 172.21.15.114:0/4278107299 >> 172.21.15.114:0/4278107299 conn(0x558adc825720 msgr2=0x558adc8abb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.945+0000 7f92274a6b80 1 -- 172.21.15.114:0/4278107299 shutdown_connections 2023-10-18T14:05:07.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.945+0000 7f92274a6b80 1 -- 172.21.15.114:0/4278107299 wait complete. 2023-10-18T14:05:07.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.946+0000 7f92274a6b80 1 -- start start 2023-10-18T14:05:07.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.946+0000 7f92274a6b80 1 Processor -- start 2023-10-18T14:05:07.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.946+0000 7f92274a6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 0x558adc8c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.946+0000 7f92274a6b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8b5fb0 0x558adc8bec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.946+0000 7f92274a6b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8ba100 0x558adc8bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.946+0000 7f92274a6b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc803e70 con 0x558adc8ba100 2023-10-18T14:05:07.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.946+0000 7f92274a6b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc7a0710 con 0x558adc8b5fb0 2023-10-18T14:05:07.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.946+0000 7f92274a6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc7a03b0 con 0x558adc8b5690 2023-10-18T14:05:07.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.946+0000 7f92274a6b80 10 client.0 _ll_register_callbacks cb 0x558adc6eaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:07.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.946+0000 7f9219059700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 0x558adc8c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.946+0000 7f9219059700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 0x558adc8c1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49050/0 (socket says 172.21.15.114:49050) 2023-10-18T14:05:07.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f9219059700 1 -- 172.21.15.114:0/4200764057 learned_addr learned my addr 172.21.15.114:0/4200764057 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f9218858700 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8b5fb0 0x558adc8bec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f921985a700 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8ba100 0x558adc8bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f9219059700 1 -- 172.21.15.114:0/4200764057 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8b5fb0 msgr2=0x558adc8bec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f9219059700 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8b5fb0 0x558adc8bec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f9219059700 1 -- 172.21.15.114:0/4200764057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8ba100 msgr2=0x558adc8bf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f9219059700 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8ba100 0x558adc8bf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f9219059700 1 -- 172.21.15.114:0/4200764057 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92100109b0 con 0x558adc8b5690 2023-10-18T14:05:07.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f921985a700 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8ba100 0x558adc8bf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:07.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f9219059700 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 0x558adc8c1900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9210009990 tx=0x7f9210012e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c7d101f3ba42ed server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f91fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-10-18T14:05:07.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f91fcff9700 1 -- 172.21.15.114:0/4200764057 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921002f070 con 0x558adc8b5690 2023-10-18T14:05:07.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f91fcff9700 1 -- 172.21.15.114:0/4200764057 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f921001f450 con 0x558adc8b5690 2023-10-18T14:05:07.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f92274a6b80 1 -- 172.21.15.114:0/4200764057 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558adc808ef0 con 0x558adc8b5690 2023-10-18T14:05:07.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.947+0000 7f91fcff9700 1 -- 172.21.15.114:0/4200764057 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f921001f610 con 0x558adc8b5690 2023-10-18T14:05:07.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.948+0000 7f92274a6b80 10 client.25432 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:07.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.948+0000 7f92274a6b80 1 -- 172.21.15.114:0/4200764057 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558adc62ede0 con 0x558adc8b5690 2023-10-18T14:05:07.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.948+0000 7f91fcff9700 1 -- 172.21.15.114:0/4200764057 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558adc808ef0 con 0x558adc8b5690 2023-10-18T14:05:07.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.948+0000 7f91fcff9700 1 -- 172.21.15.114:0/4200764057 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f92100038d0 con 0x558adc8b5690 2023-10-18T14:05:07.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.948+0000 7f92274a6b80 10 client.25432 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:07.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.948+0000 7f92274a6b80 10 client.25432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:07.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.948+0000 7f92274a6b80 20 client.25432 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:07.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.948+0000 7f92274a6b80 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558adc8cf1c0 0x558adc8d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.948+0000 7f92274a6b80 4 client.25432 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.948+0000 7f92274a6b80 1 -- 172.21.15.114:0/4200764057 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558adc8808b0 con 0x558adc8cf1c0 2023-10-18T14:05:07.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.948+0000 7f9218858700 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558adc8cf1c0 0x558adc8d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f91fcff9700 10 client.25432 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:07.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f9218858700 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558adc8cf1c0 0x558adc8d15e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2513d7a6df1732f5 server_cookie=eff53f97dc743a8 in_seq=0 out_seq=0 2023-10-18T14:05:07.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f91fcff9700 1 -- 172.21.15.114:0/4200764057 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558adc8808b0 con 0x558adc8cf1c0 2023-10-18T14:05:07.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f91fcff9700 10 client.25432 handle_command_reply: tid=0 2023-10-18T14:05:07.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f92274a6b80 1 client.25432 shutdown 2023-10-18T14:05:07.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f92274a6b80 1 -- 172.21.15.114:0/4200764057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 msgr2=0x558adc8c1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f92274a6b80 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 0x558adc8c1900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9210009990 tx=0x7f9210012e80 comp rx=0 tx=0).stop 2023-10-18T14:05:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f92274a6b80 1 -- 172.21.15.114:0/4200764057 shutdown_connections 2023-10-18T14:05:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f92274a6b80 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558adc8cf1c0 0x558adc8d15e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f92274a6b80 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8ba100 0x558adc8bf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f91fcff9700 0 client.25432 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f92274a6b80 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 0x558adc8c1900 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f92274a6b80 1 --2- 172.21.15.114:0/4200764057 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8b5fb0 0x558adc8bec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.949+0000 7f92274a6b80 1 -- 172.21.15.114:0/4200764057 >> 172.21.15.114:0/4200764057 conn(0x558adc825720 msgr2=0x558adc8b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.950+0000 7f92274a6b80 1 -- 172.21.15.114:0/4200764057 shutdown_connections 2023-10-18T14:05:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.950+0000 7f92274a6b80 1 -- 172.21.15.114:0/4200764057 wait complete. 2023-10-18T14:05:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.950+0000 7f92274a6b80 20 client.25432 trim_cache size 0 max 16384 2023-10-18T14:05:07.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f92274a6b80 1 Processor -- start 2023-10-18T14:05:07.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f92274a6b80 1 -- start start 2023-10-18T14:05:07.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f92274a6b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 0x558adc8b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f92274a6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5fb0 0x558adc8a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f92274a6b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8ba100 0x558adc8c6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f92274a6b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc684920 con 0x558adc8b5690 2023-10-18T14:05:07.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f92274a6b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc8d1970 con 0x558adc8ba100 2023-10-18T14:05:07.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f92274a6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc8c67d0 con 0x558adc8b5fb0 2023-10-18T14:05:07.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f9219059700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 0x558adc8b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f9219059700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 0x558adc8b79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45122/0 (socket says 172.21.15.114:45122) 2023-10-18T14:05:07.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f9219059700 1 -- 172.21.15.114:0/1524621804 learned_addr learned my addr 172.21.15.114:0/1524621804 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f9218858700 1 --2- 172.21.15.114:0/1524621804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5fb0 0x558adc8a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f921985a700 1 --2- 172.21.15.114:0/1524621804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8ba100 0x558adc8c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f9219059700 1 -- 172.21.15.114:0/1524621804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5fb0 msgr2=0x558adc8a65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f9219059700 1 --2- 172.21.15.114:0/1524621804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5fb0 0x558adc8a65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f9219059700 1 -- 172.21.15.114:0/1524621804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8ba100 msgr2=0x558adc8c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f9219059700 1 --2- 172.21.15.114:0/1524621804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8ba100 0x558adc8c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.972+0000 7f9219059700 1 -- 172.21.15.114:0/1524621804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558adc617c60 con 0x558adc8b5690 2023-10-18T14:05:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.973+0000 7f9219059700 1 --2- 172.21.15.114:0/1524621804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 0x558adc8b79f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9210009aa0 tx=0x7f9210020da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e15c5abb695581 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.973+0000 7f91fffff700 1 -- 172.21.15.114:0/1524621804 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921002f030 con 0x558adc8b5690 2023-10-18T14:05:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.973+0000 7f91fffff700 1 -- 172.21.15.114:0/1524621804 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f921001f910 con 0x558adc8b5690 2023-10-18T14:05:07.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.973+0000 7f91fffff700 1 -- 172.21.15.114:0/1524621804 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210003ea0 con 0x558adc8b5690 2023-10-18T14:05:07.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.974+0000 7f92274a6b80 1 -- 172.21.15.114:0/1524621804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 msgr2=0x558adc8b79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.974+0000 7f92274a6b80 1 --2- 172.21.15.114:0/1524621804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 0x558adc8b79f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9210009aa0 tx=0x7f9210020da0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.974+0000 7f92274a6b80 1 -- 172.21.15.114:0/1524621804 shutdown_connections 2023-10-18T14:05:07.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.974+0000 7f92274a6b80 1 --2- 172.21.15.114:0/1524621804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8ba100 0x558adc8c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.974+0000 7f92274a6b80 1 --2- 172.21.15.114:0/1524621804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8b5690 0x558adc8b79f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.974+0000 7f92274a6b80 1 --2- 172.21.15.114:0/1524621804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5fb0 0x558adc8a65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.974+0000 7f92274a6b80 1 -- 172.21.15.114:0/1524621804 >> 172.21.15.114:0/1524621804 conn(0x558adc825720 msgr2=0x558adc8d5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.974+0000 7f92274a6b80 1 -- 172.21.15.114:0/1524621804 shutdown_connections 2023-10-18T14:05:07.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.974+0000 7f92274a6b80 1 -- 172.21.15.114:0/1524621804 wait complete. 2023-10-18T14:05:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.974+0000 7f92274a6b80 1 -- start start 2023-10-18T14:05:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.974+0000 7f92274a6b80 1 Processor -- start 2023-10-18T14:05:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f92274a6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 0x558adc8c4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f92274a6b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8b5fb0 0x558adc8c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f92274a6b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8ba100 0x558adc921ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f92274a6b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc8c4f80 con 0x558adc8ba100 2023-10-18T14:05:07.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f92274a6b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc8c50f0 con 0x558adc8b5fb0 2023-10-18T14:05:07.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f92274a6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adc922560 con 0x558adc8b5690 2023-10-18T14:05:07.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f92274a6b80 10 client.0 _ll_register_callbacks cb 0x558adc6eaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:07.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f9219059700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 0x558adc8c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f921985a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8ba100 0x558adc921ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f9219059700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 0x558adc8c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49064/0 (socket says 172.21.15.114:49064) 2023-10-18T14:05:07.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f9219059700 1 -- 172.21.15.114:0/2416636915 learned_addr learned my addr 172.21.15.114:0/2416636915 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:07.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f921985a700 1 -- 172.21.15.114:0/2416636915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 msgr2=0x558adc8c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f921985a700 1 --2- 172.21.15.114:0/2416636915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 0x558adc8c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f921985a700 1 -- 172.21.15.114:0/2416636915 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8b5fb0 msgr2=0x558adc8c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:07.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f921985a700 1 --2- 172.21.15.114:0/2416636915 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8b5fb0 0x558adc8c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f921985a700 1 -- 172.21.15.114:0/2416636915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558adc62ede0 con 0x558adc8ba100 2023-10-18T14:05:07.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.975+0000 7f9219059700 1 --2- 172.21.15.114:0/2416636915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 0x558adc8c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:07.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.976+0000 7f921985a700 1 --2- 172.21.15.114:0/2416636915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8ba100 0x558adc921ff0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x558adc8a8870 tx=0x7f920c00a9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baafd4c0f0b50f79 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:07.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.976+0000 7f91fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:07.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.976+0000 7f91fcff9700 1 -- 172.21.15.114:0/2416636915 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c011070 con 0x558adc8ba100 2023-10-18T14:05:07.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.976+0000 7f91fcff9700 1 -- 172.21.15.114:0/2416636915 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f920c006e40 con 0x558adc8ba100 2023-10-18T14:05:07.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.976+0000 7f92274a6b80 1 -- 172.21.15.114:0/2416636915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9210012c10 con 0x558adc8ba100 2023-10-18T14:05:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.976+0000 7f91fcff9700 1 -- 172.21.15.114:0/2416636915 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f920c0178b0 con 0x558adc8ba100 2023-10-18T14:05:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.976+0000 7f92274a6b80 10 client.16032 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.976+0000 7f92274a6b80 1 -- 172.21.15.114:0/2416636915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558adc655250 con 0x558adc8ba100 2023-10-18T14:05:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.976+0000 7f91fcff9700 1 -- 172.21.15.114:0/2416636915 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9210012c10 con 0x558adc8ba100 2023-10-18T14:05:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.976+0000 7f91fcff9700 1 -- 172.21.15.114:0/2416636915 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f920c018b10 con 0x558adc8ba100 2023-10-18T14:05:07.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.976+0000 7f92274a6b80 10 client.16032 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:07.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.976+0000 7f92274a6b80 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:07.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.976+0000 7f92274a6b80 20 client.16032 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:07.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.977+0000 7f92274a6b80 1 --2- 172.21.15.114:0/2416636915 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558adc923e30 0x558adc926250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:07.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.977+0000 7f92274a6b80 4 client.16032 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:05:07.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.977+0000 7f92274a6b80 1 -- 172.21.15.114:0/2416636915 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558adc7fce50 con 0x558adc923e30 2023-10-18T14:05:07.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.977+0000 7f9219059700 1 --2- 172.21.15.114:0/2416636915 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558adc923e30 0x558adc926250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:07.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.977+0000 7f91fcff9700 10 client.16032 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:07.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.977+0000 7f9219059700 1 --2- 172.21.15.114:0/2416636915 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558adc923e30 0x558adc926250 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8049f542ede5428 server_cookie=15e52b2f99582257 in_seq=0 out_seq=0 2023-10-18T14:05:07.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.977+0000 7f91fcff9700 1 -- 172.21.15.114:0/2416636915 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558adc7fce50 con 0x558adc923e30 2023-10-18T14:05:07.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.977+0000 7f91fcff9700 10 client.16032 handle_command_reply: tid=0 2023-10-18T14:05:07.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.977+0000 7f92274a6b80 1 client.16032 shutdown 2023-10-18T14:05:07.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.978+0000 7f92274a6b80 1 -- 172.21.15.114:0/2416636915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8ba100 msgr2=0x558adc921ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:07.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.978+0000 7f92274a6b80 1 --2- 172.21.15.114:0/2416636915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8ba100 0x558adc921ff0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x558adc8a8870 tx=0x7f920c00a9f0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.978+0000 7f92274a6b80 1 -- 172.21.15.114:0/2416636915 shutdown_connections 2023-10-18T14:05:07.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.978+0000 7f92274a6b80 1 --2- 172.21.15.114:0/2416636915 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558adc923e30 0x558adc926250 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.978+0000 7f92274a6b80 1 --2- 172.21.15.114:0/2416636915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558adc8ba100 0x558adc921ff0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.978+0000 7f92274a6b80 1 --2- 172.21.15.114:0/2416636915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558adc8b5690 0x558adc8c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.978+0000 7f91fcff9700 0 client.16032 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:07.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.978+0000 7f92274a6b80 1 --2- 172.21.15.114:0/2416636915 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558adc8b5fb0 0x558adc8c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:07.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.978+0000 7f92274a6b80 1 -- 172.21.15.114:0/2416636915 >> 172.21.15.114:0/2416636915 conn(0x558adc825720 msgr2=0x558adc8bc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:07.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.978+0000 7f92274a6b80 1 -- 172.21.15.114:0/2416636915 shutdown_connections 2023-10-18T14:05:07.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.978+0000 7f92274a6b80 1 -- 172.21.15.114:0/2416636915 wait complete. 2023-10-18T14:05:07.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.978+0000 7f92274a6b80 20 client.16032 trim_cache size 0 max 16384 2023-10-18T14:05:07.999 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:05:08.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.979+0000 7f921b2bd700 1 -- 172.21.15.114:0/3387634596 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92000a1670 msgr2=0x7f92000a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:08.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.979+0000 7f921b2bd700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92000a1670 0x7f92000a3b30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9210009be0 tx=0x7f9210009260 comp rx=0 tx=0).stop 2023-10-18T14:05:08.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.979+0000 7f921b2bd700 1 -- 172.21.15.114:0/3387634596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214100000 msgr2=0x7f921419ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:08.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.979+0000 7f921b2bd700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214100000 0x7f921419ce80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9204000c00 tx=0x7f9204005ef0 comp rx=0 tx=0).stop 2023-10-18T14:05:08.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.979+0000 7f921b2bd700 1 -- 172.21.15.114:0/3387634596 shutdown_connections 2023-10-18T14:05:08.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.979+0000 7f921b2bd700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f92000a1670 0x7f92000a3b30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:08.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.979+0000 7f921b2bd700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92141056e0 0x7f9214196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:08.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.979+0000 7f921b2bd700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f92140ff640 0x7f921419c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:08.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.979+0000 7f921b2bd700 1 --2- 172.21.15.114:0/3387634596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9214100000 0x7f921419ce80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:08.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.979+0000 7f921b2bd700 1 -- 172.21.15.114:0/3387634596 >> 172.21.15.114:0/3387634596 conn(0x7f92140767f0 msgr2=0x7f92140fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:08.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.979+0000 7f921b2bd700 1 -- 172.21.15.114:0/3387634596 shutdown_connections 2023-10-18T14:05:08.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:07.979+0000 7f921b2bd700 1 -- 172.21.15.114:0/3387634596 wait complete. 2023-10-18T14:05:08.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:07 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/4003505309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:05:08.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:07 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/4003505309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:05:09.007 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-18T14:05:09.008 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-18T14:05:09.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:08 smithi158 ceph-mon[103317]: pgmap v313: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2023-10-18T14:05:09.032 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:08 smithi114 ceph-mon[99494]: pgmap v313: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2023-10-18T14:05:09.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:08 smithi172 ceph-mon[103574]: pgmap v313: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2023-10-18T14:05:09.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.129+0000 7fae366f3700 1 -- 172.21.15.114:0/4019108078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae30100000 msgr2=0x7fae3010c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.129+0000 7fae366f3700 1 --2- 172.21.15.114:0/4019108078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae30100000 0x7fae3010c4a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b0a0 tx=0x7fae2800b3b0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.129+0000 7fae366f3700 1 -- 172.21.15.114:0/4019108078 shutdown_connections 2023-10-18T14:05:09.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.129+0000 7fae366f3700 1 --2- 172.21.15.114:0/4019108078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae30100000 0x7fae3010c4a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.129+0000 7fae366f3700 1 --2- 172.21.15.114:0/4019108078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae301056e0 0x7fae30105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.129+0000 7fae366f3700 1 --2- 172.21.15.114:0/4019108078 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae300ff640 0x7fae300ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.129+0000 7fae366f3700 1 -- 172.21.15.114:0/4019108078 >> 172.21.15.114:0/4019108078 conn(0x7fae300767f0 msgr2=0x7fae30076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.129+0000 7fae366f3700 1 -- 172.21.15.114:0/4019108078 shutdown_connections 2023-10-18T14:05:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.130+0000 7fae366f3700 1 -- 172.21.15.114:0/4019108078 wait complete. 2023-10-18T14:05:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.130+0000 7fae366f3700 1 Processor -- start 2023-10-18T14:05:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.130+0000 7fae366f3700 1 -- start start 2023-10-18T14:05:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.130+0000 7fae366f3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae300ff640 0x7fae30101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.130+0000 7fae366f3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae30100000 0x7fae301017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.130+0000 7fae366f3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae301056e0 0x7fae30101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.130+0000 7fae366f3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae301a5050 con 0x7fae300ff640 2023-10-18T14:05:09.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.130+0000 7fae366f3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae301a51c0 con 0x7fae301056e0 2023-10-18T14:05:09.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.130+0000 7fae366f3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae301a5380 con 0x7fae30100000 2023-10-18T14:05:09.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae2ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae300ff640 0x7fae30101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae2ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae300ff640 0x7fae30101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45150/0 (socket says 172.21.15.114:45150) 2023-10-18T14:05:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae2ffff700 1 -- 172.21.15.114:0/1985592334 learned_addr learned my addr 172.21.15.114:0/1985592334 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae2f7fe700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae30100000 0x7fae301017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae34c90700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae301056e0 0x7fae30101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae2ffff700 1 -- 172.21.15.114:0/1985592334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae30100000 msgr2=0x7fae301017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae2ffff700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae30100000 0x7fae301017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae2ffff700 1 -- 172.21.15.114:0/1985592334 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae301056e0 msgr2=0x7fae30101d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae2ffff700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae301056e0 0x7fae30101d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae2ffff700 1 -- 172.21.15.114:0/1985592334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae28009d00 con 0x7fae300ff640 2023-10-18T14:05:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae34c90700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae301056e0 0x7fae30101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae2ffff700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae300ff640 0x7fae30101290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fae2000d950 tx=0x7fae2000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae2d7fa700 1 -- 172.21.15.114:0/1985592334 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20009940 con 0x7fae300ff640 2023-10-18T14:05:09.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae366f3700 1 -- 172.21.15.114:0/1985592334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae301a5660 con 0x7fae300ff640 2023-10-18T14:05:09.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae2d7fa700 1 -- 172.21.15.114:0/1985592334 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae20010460 con 0x7fae300ff640 2023-10-18T14:05:09.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae2d7fa700 1 -- 172.21.15.114:0/1985592334 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000f620 con 0x7fae300ff640 2023-10-18T14:05:09.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.131+0000 7fae366f3700 1 -- 172.21.15.114:0/1985592334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae301a5b70 con 0x7fae300ff640 2023-10-18T14:05:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.133+0000 7fae2d7fa700 1 -- 172.21.15.114:0/1985592334 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fae200108d0 con 0x7fae300ff640 2023-10-18T14:05:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.134+0000 7fae2d7fa700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fae180a15f0 0x7fae180a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.134+0000 7fae2d7fa700 1 -- 172.21.15.114:0/1985592334 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fae200ccef0 con 0x7fae300ff640 2023-10-18T14:05:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.134+0000 7fae2f7fe700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fae180a15f0 0x7fae180a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.134+0000 7fae2f7fe700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fae180a15f0 0x7fae180a3ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fae301029c0 tx=0x7fae2400a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae428dcb80 1 Processor -- start 2023-10-18T14:05:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae428dcb80 1 -- start start 2023-10-18T14:05:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae428dcb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f4c60 0x55a37b8f5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae428dcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8f5580 0x55a37b8ef110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae428dcb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 0x55a37b8efad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae428dcb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37b862760 con 0x55a37b8ef650 2023-10-18T14:05:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae428dcb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37b848ce0 con 0x55a37b8f4c60 2023-10-18T14:05:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae428dcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37b846600 con 0x55a37b8f5580 2023-10-18T14:05:09.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae34c90700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 0x55a37b8efad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae34c90700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 0x55a37b8efad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45162/0 (socket says 172.21.15.114:45162) 2023-10-18T14:05:09.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae34c90700 1 -- 172.21.15.114:0/2731708849 learned_addr learned my addr 172.21.15.114:0/2731708849 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:09.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae2ffff700 1 --2- 172.21.15.114:0/2731708849 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f4c60 0x55a37b8f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae2f7fe700 1 --2- 172.21.15.114:0/2731708849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8f5580 0x55a37b8ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae34c90700 1 -- 172.21.15.114:0/2731708849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8f5580 msgr2=0x55a37b8ef110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae34c90700 1 --2- 172.21.15.114:0/2731708849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8f5580 0x55a37b8ef110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae34c90700 1 -- 172.21.15.114:0/2731708849 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f4c60 msgr2=0x55a37b8f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae34c90700 1 --2- 172.21.15.114:0/2731708849 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f4c60 0x55a37b8f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae34c90700 1 -- 172.21.15.114:0/2731708849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a37b7ff470 con 0x55a37b8ef650 2023-10-18T14:05:09.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae2ffff700 1 --2- 172.21.15.114:0/2731708849 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f4c60 0x55a37b8f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:09.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae34c90700 1 --2- 172.21.15.114:0/2731708849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 0x55a37b8efad0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fae28007c80 tx=0x7fae28007cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc6d34a0f9b22c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:09.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.135+0000 7fae167fc700 1 -- 172.21.15.114:0/2731708849 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2800e050 con 0x55a37b8ef650 2023-10-18T14:05:09.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.136+0000 7fae167fc700 1 -- 172.21.15.114:0/2731708849 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae280092d0 con 0x55a37b8ef650 2023-10-18T14:05:09.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.136+0000 7fae167fc700 1 -- 172.21.15.114:0/2731708849 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28005240 con 0x55a37b8ef650 2023-10-18T14:05:09.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.136+0000 7fae428dcb80 1 -- 172.21.15.114:0/2731708849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 msgr2=0x55a37b8efad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.136+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2731708849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 0x55a37b8efad0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fae28007c80 tx=0x7fae28007cb0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.136+0000 7fae428dcb80 1 -- 172.21.15.114:0/2731708849 shutdown_connections 2023-10-18T14:05:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.136+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2731708849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 0x55a37b8efad0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.136+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2731708849 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f4c60 0x55a37b8f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.136+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2731708849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8f5580 0x55a37b8ef110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.136+0000 7fae428dcb80 1 -- 172.21.15.114:0/2731708849 >> 172.21.15.114:0/2731708849 conn(0x55a37b8637a0 msgr2=0x55a37b8e9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.136+0000 7fae428dcb80 1 -- 172.21.15.114:0/2731708849 shutdown_connections 2023-10-18T14:05:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.136+0000 7fae428dcb80 1 -- 172.21.15.114:0/2731708849 wait complete. 2023-10-18T14:05:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.137+0000 7fae428dcb80 1 -- start start 2023-10-18T14:05:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.137+0000 7fae428dcb80 1 Processor -- start 2023-10-18T14:05:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.137+0000 7fae428dcb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 0x55a37b8fb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.137+0000 7fae428dcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8f4c60 0x55a37b8f8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.137+0000 7fae428dcb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f5580 0x55a37b8f8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.137+0000 7fae428dcb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37b841ef0 con 0x55a37b8ef650 2023-10-18T14:05:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.137+0000 7fae428dcb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37b7de790 con 0x55a37b8f5580 2023-10-18T14:05:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.137+0000 7fae428dcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37b7de430 con 0x55a37b8f4c60 2023-10-18T14:05:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.137+0000 7fae428dcb80 10 client.0 _ll_register_callbacks cb 0x55a37b728b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.137+0000 7fae2ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 0x55a37b8fb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.137+0000 7fae2ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 0x55a37b8fb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45164/0 (socket says 172.21.15.114:45164) 2023-10-18T14:05:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.137+0000 7fae2ffff700 1 -- 172.21.15.114:0/3655942987 learned_addr learned my addr 172.21.15.114:0/3655942987 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.137+0000 7fae2f7fe700 1 --2- 172.21.15.114:0/3655942987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8f4c60 0x55a37b8f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae34c90700 1 --2- 172.21.15.114:0/3655942987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f5580 0x55a37b8f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae2ffff700 1 -- 172.21.15.114:0/3655942987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8f4c60 msgr2=0x55a37b8f8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae2ffff700 1 --2- 172.21.15.114:0/3655942987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8f4c60 0x55a37b8f8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae2ffff700 1 -- 172.21.15.114:0/3655942987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f5580 msgr2=0x55a37b8f8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae2ffff700 1 --2- 172.21.15.114:0/3655942987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f5580 0x55a37b8f8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae2ffff700 1 -- 172.21.15.114:0/3655942987 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3010cd90 con 0x55a37b8ef650 2023-10-18T14:05:09.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae2ffff700 1 --2- 172.21.15.114:0/3655942987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 0x55a37b8fb580 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fae200963f0 tx=0x7fae2009a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4362e15013e25cd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:09.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae0f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:09.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae0f7fe700 1 -- 172.21.15.114:0/3655942987 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2009a350 con 0x55a37b8ef650 2023-10-18T14:05:09.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae0f7fe700 1 -- 172.21.15.114:0/3655942987 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fae200a2280 con 0x55a37b8ef650 2023-10-18T14:05:09.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae428dcb80 1 -- 172.21.15.114:0/3655942987 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a37b846f70 con 0x55a37b8ef650 2023-10-18T14:05:09.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae0f7fe700 1 -- 172.21.15.114:0/3655942987 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae200b8170 con 0x55a37b8ef650 2023-10-18T14:05:09.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae428dcb80 10 client.16044 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:09.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae428dcb80 1 -- 172.21.15.114:0/3655942987 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a37b66ce60 con 0x55a37b8ef650 2023-10-18T14:05:09.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae0f7fe700 1 -- 172.21.15.114:0/3655942987 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae20063080 con 0x55a37b8ef650 2023-10-18T14:05:09.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae0f7fe700 1 -- 172.21.15.114:0/3655942987 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fae200a1e80 con 0x55a37b8ef650 2023-10-18T14:05:09.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae428dcb80 10 client.16044 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:09.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.138+0000 7fae428dcb80 10 client.16044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:09.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.139+0000 7fae428dcb80 20 client.16044 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:09.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.139+0000 7fae428dcb80 1 --2- 172.21.15.114:0/3655942987 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55a37b908e50 0x55a37b90b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.139+0000 7fae428dcb80 4 client.16044 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:09.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.139+0000 7fae428dcb80 1 -- 172.21.15.114:0/3655942987 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a37b8be930 con 0x55a37b908e50 2023-10-18T14:05:09.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.139+0000 7fae2f7fe700 1 --2- 172.21.15.114:0/3655942987 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55a37b908e50 0x55a37b90b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.139+0000 7fae0f7fe700 10 client.16044 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:09.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.139+0000 7fae2f7fe700 1 --2- 172.21.15.114:0/3655942987 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55a37b908e50 0x55a37b90b260 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b489ca36b274c2d server_cookie=b821274330afae13 in_seq=0 out_seq=0 2023-10-18T14:05:09.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae0f7fe700 1 -- 172.21.15.114:0/3655942987 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a37b8be930 con 0x55a37b908e50 2023-10-18T14:05:09.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae0f7fe700 10 client.16044 handle_command_reply: tid=0 2023-10-18T14:05:09.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae428dcb80 1 client.16044 shutdown 2023-10-18T14:05:09.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae428dcb80 1 -- 172.21.15.114:0/3655942987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 msgr2=0x55a37b8fb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae428dcb80 1 --2- 172.21.15.114:0/3655942987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 0x55a37b8fb580 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fae200963f0 tx=0x7fae2009a6e0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae428dcb80 1 -- 172.21.15.114:0/3655942987 shutdown_connections 2023-10-18T14:05:09.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae428dcb80 1 --2- 172.21.15.114:0/3655942987 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55a37b908e50 0x55a37b90b260 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae428dcb80 1 --2- 172.21.15.114:0/3655942987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f5580 0x55a37b8f8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae428dcb80 1 --2- 172.21.15.114:0/3655942987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8ef650 0x55a37b8fb580 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae0f7fe700 0 client.16044 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:09.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae428dcb80 1 --2- 172.21.15.114:0/3655942987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8f4c60 0x55a37b8f8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae428dcb80 1 -- 172.21.15.114:0/3655942987 >> 172.21.15.114:0/3655942987 conn(0x55a37b8637a0 msgr2=0x55a37b8ee100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:09.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae428dcb80 1 -- 172.21.15.114:0/3655942987 shutdown_connections 2023-10-18T14:05:09.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae428dcb80 1 -- 172.21.15.114:0/3655942987 wait complete. 2023-10-18T14:05:09.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.140+0000 7fae428dcb80 20 client.16044 trim_cache size 0 max 16384 2023-10-18T14:05:09.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.157+0000 7fae428dcb80 1 Processor -- start 2023-10-18T14:05:09.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.157+0000 7fae428dcb80 1 -- start start 2023-10-18T14:05:09.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.157+0000 7fae428dcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8ef650 0x55a37b8ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.157+0000 7fae428dcb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f4c60 0x55a37b8f4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae428dcb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f5580 0x55a37b8f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae428dcb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37b6c29a0 con 0x55a37b8f4c60 2023-10-18T14:05:09.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae428dcb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37b8e6220 con 0x55a37b8f5580 2023-10-18T14:05:09.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae428dcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37b8eada0 con 0x55a37b8ef650 2023-10-18T14:05:09.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae2f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f4c60 0x55a37b8f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae2f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f4c60 0x55a37b8f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45174/0 (socket says 172.21.15.114:45174) 2023-10-18T14:05:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae2f7fe700 1 -- 172.21.15.114:0/2855229659 learned_addr learned my addr 172.21.15.114:0/2855229659 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae2ffff700 1 --2- 172.21.15.114:0/2855229659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8ef650 0x55a37b8ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae34c90700 1 --2- 172.21.15.114:0/2855229659 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f5580 0x55a37b8f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae2f7fe700 1 -- 172.21.15.114:0/2855229659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8ef650 msgr2=0x55a37b8ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae2f7fe700 1 --2- 172.21.15.114:0/2855229659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8ef650 0x55a37b8ffed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae2f7fe700 1 -- 172.21.15.114:0/2855229659 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f5580 msgr2=0x55a37b8f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae2f7fe700 1 --2- 172.21.15.114:0/2855229659 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f5580 0x55a37b8f26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae2f7fe700 1 -- 172.21.15.114:0/2855229659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a37b8e9df0 con 0x55a37b8f4c60 2023-10-18T14:05:09.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae2ffff700 1 --2- 172.21.15.114:0/2855229659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8ef650 0x55a37b8ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:09.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae2f7fe700 1 --2- 172.21.15.114:0/2855229659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f4c60 0x55a37b8f4110 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x55a37b8eb850 tx=0x7fae24012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3489f033c5cac439 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:09.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae16ffd700 1 -- 172.21.15.114:0/2855229659 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae24021040 con 0x55a37b8f4c60 2023-10-18T14:05:09.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae16ffd700 1 -- 172.21.15.114:0/2855229659 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae24014070 con 0x55a37b8f4c60 2023-10-18T14:05:09.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.158+0000 7fae16ffd700 1 -- 172.21.15.114:0/2855229659 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae24025730 con 0x55a37b8f4c60 2023-10-18T14:05:09.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.159+0000 7fae428dcb80 1 -- 172.21.15.114:0/2855229659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f4c60 msgr2=0x55a37b8f4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.159+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2855229659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f4c60 0x55a37b8f4110 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x55a37b8eb850 tx=0x7fae24012000 comp rx=0 tx=0).stop 2023-10-18T14:05:09.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.159+0000 7fae428dcb80 1 -- 172.21.15.114:0/2855229659 shutdown_connections 2023-10-18T14:05:09.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.159+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2855229659 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f5580 0x55a37b8f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.159+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2855229659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8ef650 0x55a37b8ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.159+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2855229659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f4c60 0x55a37b8f4110 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.159+0000 7fae428dcb80 1 -- 172.21.15.114:0/2855229659 >> 172.21.15.114:0/2855229659 conn(0x55a37b8637a0 msgr2=0x55a37b8f3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:09.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.159+0000 7fae428dcb80 1 -- 172.21.15.114:0/2855229659 shutdown_connections 2023-10-18T14:05:09.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.159+0000 7fae428dcb80 1 -- 172.21.15.114:0/2855229659 wait complete. 2023-10-18T14:05:09.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.159+0000 7fae428dcb80 1 -- start start 2023-10-18T14:05:09.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.159+0000 7fae428dcb80 1 Processor -- start 2023-10-18T14:05:09.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae428dcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8ef650 0x55a37b952c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae428dcb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f4c60 0x55a37b953190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae428dcb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f5580 0x55a37b9536d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae428dcb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37b95dd70 con 0x55a37b8f5580 2023-10-18T14:05:09.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae428dcb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37b95deb0 con 0x55a37b8f4c60 2023-10-18T14:05:09.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae428dcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37b95e070 con 0x55a37b8ef650 2023-10-18T14:05:09.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae428dcb80 10 client.0 _ll_register_callbacks cb 0x55a37b728b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:09.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae34c90700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f5580 0x55a37b9536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae34c90700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f5580 0x55a37b9536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45182/0 (socket says 172.21.15.114:45182) 2023-10-18T14:05:09.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae34c90700 1 -- 172.21.15.114:0/2496866110 learned_addr learned my addr 172.21.15.114:0/2496866110 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:09.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae2ffff700 1 --2- 172.21.15.114:0/2496866110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8ef650 0x55a37b952c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae34c90700 1 -- 172.21.15.114:0/2496866110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8ef650 msgr2=0x55a37b952c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae34c90700 1 --2- 172.21.15.114:0/2496866110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8ef650 0x55a37b952c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae34c90700 1 -- 172.21.15.114:0/2496866110 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f4c60 msgr2=0x55a37b953190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae34c90700 1 --2- 172.21.15.114:0/2496866110 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f4c60 0x55a37b953190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae34c90700 1 -- 172.21.15.114:0/2496866110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2400faa0 con 0x55a37b8f5580 2023-10-18T14:05:09.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae2ffff700 1 --2- 172.21.15.114:0/2496866110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8ef650 0x55a37b952c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:09.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae34c90700 1 --2- 172.21.15.114:0/2496866110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f5580 0x55a37b9536d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b3f0 tx=0x7fae28007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185743f2b0ff57dd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:09.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae0f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:09.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae0f7fe700 1 -- 172.21.15.114:0/2496866110 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2800b7b0 con 0x55a37b8f5580 2023-10-18T14:05:09.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae0f7fe700 1 -- 172.21.15.114:0/2496866110 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fae2802b070 con 0x55a37b8f5580 2023-10-18T14:05:09.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae428dcb80 1 -- 172.21.15.114:0/2496866110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae280092d0 con 0x55a37b8f5580 2023-10-18T14:05:09.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae0f7fe700 1 -- 172.21.15.114:0/2496866110 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae2800e020 con 0x55a37b8f5580 2023-10-18T14:05:09.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae428dcb80 10 client.16050 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:09.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.160+0000 7fae428dcb80 1 -- 172.21.15.114:0/2496866110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a37b655ce0 con 0x55a37b8f5580 2023-10-18T14:05:09.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.161+0000 7fae0f7fe700 1 -- 172.21.15.114:0/2496866110 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae280092d0 con 0x55a37b8f5580 2023-10-18T14:05:09.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.161+0000 7fae0f7fe700 1 -- 172.21.15.114:0/2496866110 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fae2800b0d0 con 0x55a37b8f5580 2023-10-18T14:05:09.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.161+0000 7fae428dcb80 10 client.16050 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:09.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.161+0000 7fae428dcb80 10 client.16050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:09.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.161+0000 7fae428dcb80 20 client.16050 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:09.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.161+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2496866110 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55a37b95f510 0x55a37b961930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.161+0000 7fae428dcb80 4 client.16050 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-18T14:05:09.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.161+0000 7fae428dcb80 1 -- 172.21.15.114:0/2496866110 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a37b83aed0 con 0x55a37b95f510 2023-10-18T14:05:09.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.161+0000 7fae2ffff700 1 --2- 172.21.15.114:0/2496866110 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55a37b95f510 0x55a37b961930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.161+0000 7fae0f7fe700 10 client.16050 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:09.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.161+0000 7fae2ffff700 1 --2- 172.21.15.114:0/2496866110 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55a37b95f510 0x55a37b961930 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92bcf1d89a621424 server_cookie=9bbeb1c79a1d760 in_seq=0 out_seq=0 2023-10-18T14:05:09.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae0f7fe700 1 -- 172.21.15.114:0/2496866110 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a37b83aed0 con 0x55a37b95f510 2023-10-18T14:05:09.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae0f7fe700 10 client.16050 handle_command_reply: tid=0 2023-10-18T14:05:09.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae428dcb80 1 client.16050 shutdown 2023-10-18T14:05:09.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae428dcb80 1 -- 172.21.15.114:0/2496866110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f5580 msgr2=0x55a37b9536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2496866110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f5580 0x55a37b9536d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b3f0 tx=0x7fae28007780 comp rx=0 tx=0).stop 2023-10-18T14:05:09.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae428dcb80 1 -- 172.21.15.114:0/2496866110 shutdown_connections 2023-10-18T14:05:09.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2496866110 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55a37b95f510 0x55a37b961930 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2496866110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a37b8f5580 0x55a37b9536d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2496866110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a37b8ef650 0x55a37b952c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae428dcb80 1 --2- 172.21.15.114:0/2496866110 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55a37b8f4c60 0x55a37b953190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae428dcb80 1 -- 172.21.15.114:0/2496866110 >> 172.21.15.114:0/2496866110 conn(0x55a37b8637a0 msgr2=0x55a37b8f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:09.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae0f7fe700 0 client.16050 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:09.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae428dcb80 1 -- 172.21.15.114:0/2496866110 shutdown_connections 2023-10-18T14:05:09.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae428dcb80 1 -- 172.21.15.114:0/2496866110 wait complete. 2023-10-18T14:05:09.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.163+0000 7fae428dcb80 20 client.16050 trim_cache size 0 max 16384 2023-10-18T14:05:09.186 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:05:09.186 INFO:teuthology.orchestra.run.smithi114.stdout: "return_code": 0, 2023-10-18T14:05:09.187 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_tag": "d835d03f-5da5-43e5-81bf-2feeea35c1ae", 2023-10-18T14:05:09.187 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": "asynchronous" 2023-10-18T14:05:09.187 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:05:09.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.164+0000 7fae366f3700 1 -- 172.21.15.114:0/1985592334 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fae180a15f0 msgr2=0x7fae180a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.164+0000 7fae366f3700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fae180a15f0 0x7fae180a3ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fae301029c0 tx=0x7fae2400a300 comp rx=0 tx=0).stop 2023-10-18T14:05:09.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.164+0000 7fae366f3700 1 -- 172.21.15.114:0/1985592334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae300ff640 msgr2=0x7fae30101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.164+0000 7fae366f3700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae300ff640 0x7fae30101290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fae2000d950 tx=0x7fae2000dc60 comp rx=0 tx=0).stop 2023-10-18T14:05:09.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.164+0000 7fae366f3700 1 -- 172.21.15.114:0/1985592334 shutdown_connections 2023-10-18T14:05:09.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.164+0000 7fae366f3700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fae180a15f0 0x7fae180a3ab0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.164+0000 7fae366f3700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae301056e0 0x7fae30101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.164+0000 7fae366f3700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae300ff640 0x7fae30101290 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.164+0000 7fae366f3700 1 --2- 172.21.15.114:0/1985592334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae30100000 0x7fae301017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.164+0000 7fae366f3700 1 -- 172.21.15.114:0/1985592334 >> 172.21.15.114:0/1985592334 conn(0x7fae300767f0 msgr2=0x7fae30067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.164+0000 7fae366f3700 1 -- 172.21.15.114:0/1985592334 shutdown_connections 2023-10-18T14:05:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.164+0000 7fae366f3700 1 -- 172.21.15.114:0/1985592334 wait complete. 2023-10-18T14:05:09.191 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:05:09.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.353+0000 7f28fee06700 1 -- 172.21.15.114:0/1513216010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28f8101120 msgr2=0x7f28f81015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.353+0000 7f28fee06700 1 --2- 172.21.15.114:0/1513216010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28f8101120 0x7f28f81015a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009990 tx=0x7f28e4009ca0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.353+0000 7f28fee06700 1 -- 172.21.15.114:0/1513216010 shutdown_connections 2023-10-18T14:05:09.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.353+0000 7f28fee06700 1 --2- 172.21.15.114:0/1513216010 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28f8101ae0 0x7f28f810c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.353+0000 7f28fee06700 1 --2- 172.21.15.114:0/1513216010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28f80ffa00 0x7f28f80ffde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.353+0000 7f28fee06700 1 --2- 172.21.15.114:0/1513216010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28f8101120 0x7f28f81015a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.353+0000 7f28fee06700 1 -- 172.21.15.114:0/1513216010 >> 172.21.15.114:0/1513216010 conn(0x7f28f8076790 msgr2=0x7f28f8076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:09.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.353+0000 7f28fee06700 1 -- 172.21.15.114:0/1513216010 shutdown_connections 2023-10-18T14:05:09.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.353+0000 7f28fee06700 1 -- 172.21.15.114:0/1513216010 wait complete. 2023-10-18T14:05:09.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.353+0000 7f28fee06700 1 Processor -- start 2023-10-18T14:05:09.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.353+0000 7f28fee06700 1 -- start start 2023-10-18T14:05:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fee06700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28f80ffa00 0x7f28f810bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fee06700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28f8101120 0x7f28f810c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fee06700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28f8101ae0 0x7f28f819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fee06700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f819dd60 con 0x7f28f80ffa00 2023-10-18T14:05:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fee06700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f819ded0 con 0x7f28f8101120 2023-10-18T14:05:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fee06700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f819e090 con 0x7f28f8101ae0 2023-10-18T14:05:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fcba2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28f80ffa00 0x7f28f810bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fcba2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28f80ffa00 0x7f28f810bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45192/0 (socket says 172.21.15.114:45192) 2023-10-18T14:05:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fcba2700 1 -- 172.21.15.114:0/447230889 learned_addr learned my addr 172.21.15.114:0/447230889 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fd3a3700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28f8101ae0 0x7f28f819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28f7fff700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28f8101120 0x7f28f810c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fcba2700 1 -- 172.21.15.114:0/447230889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28f8101ae0 msgr2=0x7f28f819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fcba2700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28f8101ae0 0x7f28f819d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fcba2700 1 -- 172.21.15.114:0/447230889 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28f8101120 msgr2=0x7f28f810c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fcba2700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28f8101120 0x7f28f810c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fcba2700 1 -- 172.21.15.114:0/447230889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec009520 con 0x7f28f80ffa00 2023-10-18T14:05:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fcba2700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28f80ffa00 0x7f28f810bbf0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00eb30 tx=0x7f28ec00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28f5ffb700 1 -- 172.21.15.114:0/447230889 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec009880 con 0x7f28f80ffa00 2023-10-18T14:05:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28f5ffb700 1 -- 172.21.15.114:0/447230889 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28ec0044e0 con 0x7f28f80ffa00 2023-10-18T14:05:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28fee06700 1 -- 172.21.15.114:0/447230889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e40095f0 con 0x7f28f80ffa00 2023-10-18T14:05:09.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.354+0000 7f28f5ffb700 1 -- 172.21.15.114:0/447230889 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec003e90 con 0x7f28f80ffa00 2023-10-18T14:05:09.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.355+0000 7f28fee06700 1 -- 172.21.15.114:0/447230889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f81a59d0 con 0x7f28f80ffa00 2023-10-18T14:05:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.356+0000 7f28f5ffb700 1 -- 172.21.15.114:0/447230889 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f28ec004000 con 0x7f28f80ffa00 2023-10-18T14:05:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.357+0000 7f28f5ffb700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f28e80a15f0 0x7f28e80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.357+0000 7f28f7fff700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f28e80a15f0 0x7f28e80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.357+0000 7f28f5ffb700 1 -- 172.21.15.114:0/447230889 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f28ec014070 con 0x7f28f80ffa00 2023-10-18T14:05:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.357+0000 7f28f7fff700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f28e80a15f0 0x7f28e80a3ab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f28e400b2e0 tx=0x7f28e4005e80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.358+0000 7f290afefb80 1 Processor -- start 2023-10-18T14:05:09.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.358+0000 7f290afefb80 1 -- start start 2023-10-18T14:05:09.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.358+0000 7f290afefb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 0x55b77ee6ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.358+0000 7f290afefb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee70500 0x55b77ee6a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.358+0000 7f290afefb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6a5d0 0x55b77ee6aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.358+0000 7f290afefb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77eddd6e0 con 0x55b77ee6fbe0 2023-10-18T14:05:09.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.358+0000 7f290afefb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77edc3c60 con 0x55b77ee70500 2023-10-18T14:05:09.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.358+0000 7f290afefb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77edc1580 con 0x55b77ee6a5d0 2023-10-18T14:05:09.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.358+0000 7f28fcba2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 0x55b77ee6ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.359+0000 7f28fcba2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 0x55b77ee6ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45200/0 (socket says 172.21.15.114:45200) 2023-10-18T14:05:09.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.359+0000 7f28fcba2700 1 -- 172.21.15.114:0/1604685961 learned_addr learned my addr 172.21.15.114:0/1604685961 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:09.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.359+0000 7f28fd3a3700 1 --2- 172.21.15.114:0/1604685961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6a5d0 0x55b77ee6aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.359+0000 7f28f7fff700 1 --2- 172.21.15.114:0/1604685961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee70500 0x55b77ee6a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.359+0000 7f28fcba2700 1 -- 172.21.15.114:0/1604685961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6a5d0 msgr2=0x55b77ee6aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.359+0000 7f28fcba2700 1 --2- 172.21.15.114:0/1604685961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6a5d0 0x55b77ee6aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.359+0000 7f28fcba2700 1 -- 172.21.15.114:0/1604685961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee70500 msgr2=0x55b77ee6a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.359+0000 7f28fcba2700 1 --2- 172.21.15.114:0/1604685961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee70500 0x55b77ee6a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.359+0000 7f28fcba2700 1 -- 172.21.15.114:0/1604685961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b77ed7a3f0 con 0x55b77ee6fbe0 2023-10-18T14:05:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.359+0000 7f28fcba2700 1 --2- 172.21.15.114:0/1604685961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 0x55b77ee6ffc0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00c5b0 tx=0x7f28ec0969d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6daafca232b5a590 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.359+0000 7f28e2ffd700 1 -- 172.21.15.114:0/1604685961 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec016330 con 0x55b77ee6fbe0 2023-10-18T14:05:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.359+0000 7f28e2ffd700 1 -- 172.21.15.114:0/1604685961 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28ec09ac90 con 0x55b77ee6fbe0 2023-10-18T14:05:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.359+0000 7f28e2ffd700 1 -- 172.21.15.114:0/1604685961 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec096ca0 con 0x55b77ee6fbe0 2023-10-18T14:05:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.360+0000 7f290afefb80 1 -- 172.21.15.114:0/1604685961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 msgr2=0x55b77ee6ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.360+0000 7f290afefb80 1 --2- 172.21.15.114:0/1604685961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 0x55b77ee6ffc0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00c5b0 tx=0x7f28ec0969d0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.360+0000 7f290afefb80 1 -- 172.21.15.114:0/1604685961 shutdown_connections 2023-10-18T14:05:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.360+0000 7f290afefb80 1 --2- 172.21.15.114:0/1604685961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6a5d0 0x55b77ee6aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.360+0000 7f290afefb80 1 --2- 172.21.15.114:0/1604685961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 0x55b77ee6ffc0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.360+0000 7f290afefb80 1 --2- 172.21.15.114:0/1604685961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee70500 0x55b77ee6a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.360+0000 7f290afefb80 1 -- 172.21.15.114:0/1604685961 >> 172.21.15.114:0/1604685961 conn(0x55b77edde720 msgr2=0x55b77ee64b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.360+0000 7f290afefb80 1 -- 172.21.15.114:0/1604685961 shutdown_connections 2023-10-18T14:05:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.360+0000 7f290afefb80 1 -- 172.21.15.114:0/1604685961 wait complete. 2023-10-18T14:05:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.360+0000 7f290afefb80 1 -- start start 2023-10-18T14:05:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.360+0000 7f290afefb80 1 Processor -- start 2023-10-18T14:05:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f290afefb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6a5d0 0x55b77ee76480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f290afefb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6fbe0 0x55b77ee73770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f290afefb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee70500 0x55b77ee73da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f290afefb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77edbce70 con 0x55b77ee70500 2023-10-18T14:05:09.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f290afefb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77ed59710 con 0x55b77ee6fbe0 2023-10-18T14:05:09.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f290afefb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77ed593b0 con 0x55b77ee6a5d0 2023-10-18T14:05:09.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f290afefb80 10 client.0 _ll_register_callbacks cb 0x55b77eca3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:09.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28fd3a3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee70500 0x55b77ee73da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28fcba2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6a5d0 0x55b77ee76480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28fcba2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6a5d0 0x55b77ee76480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49142/0 (socket says 172.21.15.114:49142) 2023-10-18T14:05:09.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28fcba2700 1 -- 172.21.15.114:0/623902940 learned_addr learned my addr 172.21.15.114:0/623902940 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:09.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28f7fff700 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6fbe0 0x55b77ee73770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28fcba2700 1 -- 172.21.15.114:0/623902940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6fbe0 msgr2=0x55b77ee73770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28fcba2700 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6fbe0 0x55b77ee73770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28fcba2700 1 -- 172.21.15.114:0/623902940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee70500 msgr2=0x55b77ee73da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28fcba2700 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee70500 0x55b77ee73da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28fcba2700 1 -- 172.21.15.114:0/623902940 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f81a59d0 con 0x55b77ee6a5d0 2023-10-18T14:05:09.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28f7fff700 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6fbe0 0x55b77ee73770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:09.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28fd3a3700 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee70500 0x55b77ee73da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:09.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28fcba2700 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6a5d0 0x55b77ee76480 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0cb280 tx=0x7f28ec003790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df2211e6ef05d724 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:09.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-10-18T14:05:09.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28d7fff700 1 -- 172.21.15.114:0/623902940 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec09a9f0 con 0x55b77ee6a5d0 2023-10-18T14:05:09.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f290afefb80 1 -- 172.21.15.114:0/623902940 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b77edc1ef0 con 0x55b77ee6a5d0 2023-10-18T14:05:09.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.361+0000 7f28d7fff700 1 -- 172.21.15.114:0/623902940 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f28ec00cc90 con 0x55b77ee6a5d0 2023-10-18T14:05:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f28d7fff700 1 -- 172.21.15.114:0/623902940 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28ec09e6e0 con 0x55b77ee6a5d0 2023-10-18T14:05:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f290afefb80 10 client.25465 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f290afefb80 1 -- 172.21.15.114:0/623902940 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b77ebe7de0 con 0x55b77ee6a5d0 2023-10-18T14:05:09.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f28d7fff700 1 -- 172.21.15.114:0/623902940 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b77edc1ef0 con 0x55b77ee6a5d0 2023-10-18T14:05:09.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f28d7fff700 1 -- 172.21.15.114:0/623902940 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f28ec0a2490 con 0x55b77ee6a5d0 2023-10-18T14:05:09.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f290afefb80 10 client.25465 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:09.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f290afefb80 10 client.25465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:09.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f290afefb80 20 client.25465 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:09.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f290afefb80 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55b77ee83950 0x55b77ee85d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f290afefb80 4 client.25465 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:09.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f290afefb80 1 -- 172.21.15.114:0/623902940 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b77ee398b0 con 0x55b77ee83950 2023-10-18T14:05:09.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f28f7fff700 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55b77ee83950 0x55b77ee85d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f28d7fff700 10 client.25465 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:09.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.362+0000 7f28f7fff700 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55b77ee83950 0x55b77ee85d40 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64e6591e8a320e0f server_cookie=7b57afb68644f504 in_seq=0 out_seq=0 2023-10-18T14:05:09.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f28d7fff700 1 -- 172.21.15.114:0/623902940 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b77ee398b0 con 0x55b77ee83950 2023-10-18T14:05:09.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f28d7fff700 10 client.25465 handle_command_reply: tid=0 2023-10-18T14:05:09.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f290afefb80 1 client.25465 shutdown 2023-10-18T14:05:09.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f290afefb80 1 -- 172.21.15.114:0/623902940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6a5d0 msgr2=0x55b77ee76480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f290afefb80 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6a5d0 0x55b77ee76480 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0cb280 tx=0x7f28ec003790 comp rx=0 tx=0).stop 2023-10-18T14:05:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f290afefb80 1 -- 172.21.15.114:0/623902940 shutdown_connections 2023-10-18T14:05:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f290afefb80 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55b77ee83950 0x55b77ee85d40 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f290afefb80 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee70500 0x55b77ee73da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f28d7fff700 0 client.25465 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f290afefb80 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6a5d0 0x55b77ee76480 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f290afefb80 1 --2- 172.21.15.114:0/623902940 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6fbe0 0x55b77ee73770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f290afefb80 1 -- 172.21.15.114:0/623902940 >> 172.21.15.114:0/623902940 conn(0x55b77edde720 msgr2=0x55b77ee69080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:09.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f290afefb80 1 -- 172.21.15.114:0/623902940 shutdown_connections 2023-10-18T14:05:09.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f290afefb80 1 -- 172.21.15.114:0/623902940 wait complete. 2023-10-18T14:05:09.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.364+0000 7f290afefb80 20 client.25465 trim_cache size 0 max 16384 2023-10-18T14:05:09.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.381+0000 7f290afefb80 1 Processor -- start 2023-10-18T14:05:09.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.381+0000 7f290afefb80 1 -- start start 2023-10-18T14:05:09.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.381+0000 7f290afefb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6a5d0 0x55b77ee7aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.381+0000 7f290afefb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6fbe0 0x55b77ee69930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.381+0000 7f290afefb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee70500 0x55b77ee73050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.381+0000 7f290afefb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77ec3d920 con 0x55b77ee70500 2023-10-18T14:05:09.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.381+0000 7f290afefb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77ee5cfd0 con 0x55b77ee6a5d0 2023-10-18T14:05:09.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.381+0000 7f290afefb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77ee743a0 con 0x55b77ee6fbe0 2023-10-18T14:05:09.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28fd3a3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee70500 0x55b77ee73050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28f7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6fbe0 0x55b77ee69930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28fd3a3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee70500 0x55b77ee73050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45218/0 (socket says 172.21.15.114:45218) 2023-10-18T14:05:09.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28fd3a3700 1 -- 172.21.15.114:0/2618001350 learned_addr learned my addr 172.21.15.114:0/2618001350 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:09.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28fcba2700 1 --2- 172.21.15.114:0/2618001350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6a5d0 0x55b77ee7aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28f7fff700 1 -- 172.21.15.114:0/2618001350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6a5d0 msgr2=0x55b77ee7aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28f7fff700 1 --2- 172.21.15.114:0/2618001350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6a5d0 0x55b77ee7aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28f7fff700 1 -- 172.21.15.114:0/2618001350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee70500 msgr2=0x55b77ee73050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28f7fff700 1 --2- 172.21.15.114:0/2618001350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee70500 0x55b77ee73050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28f7fff700 1 -- 172.21.15.114:0/2618001350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b77ebd0c60 con 0x55b77ee6fbe0 2023-10-18T14:05:09.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28fcba2700 1 --2- 172.21.15.114:0/2618001350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6a5d0 0x55b77ee7aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:09.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28fd3a3700 1 --2- 172.21.15.114:0/2618001350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee70500 0x55b77ee73050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:09.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28f7fff700 1 --2- 172.21.15.114:0/2618001350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6fbe0 0x55b77ee69930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f28e4006010 tx=0x7f28e4021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4b986834d794525 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:09.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28e37fe700 1 -- 172.21.15.114:0/2618001350 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e402e040 con 0x55b77ee6fbe0 2023-10-18T14:05:09.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28e37fe700 1 -- 172.21.15.114:0/2618001350 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28e400bdd0 con 0x55b77ee6fbe0 2023-10-18T14:05:09.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.382+0000 7f28e37fe700 1 -- 172.21.15.114:0/2618001350 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e401e070 con 0x55b77ee6fbe0 2023-10-18T14:05:09.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.383+0000 7f290afefb80 1 -- 172.21.15.114:0/2618001350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6fbe0 msgr2=0x55b77ee69930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.383+0000 7f290afefb80 1 --2- 172.21.15.114:0/2618001350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6fbe0 0x55b77ee69930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f28e4006010 tx=0x7f28e4021000 comp rx=0 tx=0).stop 2023-10-18T14:05:09.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.383+0000 7f290afefb80 1 -- 172.21.15.114:0/2618001350 shutdown_connections 2023-10-18T14:05:09.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.383+0000 7f290afefb80 1 --2- 172.21.15.114:0/2618001350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee70500 0x55b77ee73050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.383+0000 7f290afefb80 1 --2- 172.21.15.114:0/2618001350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6a5d0 0x55b77ee7aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.383+0000 7f290afefb80 1 --2- 172.21.15.114:0/2618001350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee6fbe0 0x55b77ee69930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.383+0000 7f290afefb80 1 -- 172.21.15.114:0/2618001350 >> 172.21.15.114:0/2618001350 conn(0x55b77edde720 msgr2=0x55b77ee69080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:09.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.383+0000 7f290afefb80 1 -- 172.21.15.114:0/2618001350 shutdown_connections 2023-10-18T14:05:09.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.383+0000 7f290afefb80 1 -- 172.21.15.114:0/2618001350 wait complete. 2023-10-18T14:05:09.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.383+0000 7f290afefb80 1 -- start start 2023-10-18T14:05:09.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.383+0000 7f290afefb80 1 Processor -- start 2023-10-18T14:05:09.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f290afefb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6a5d0 0x55b77ee7ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f290afefb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 0x55b77ee79070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f290afefb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee70500 0x55b77ee795b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f290afefb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77ee79af0 con 0x55b77ee6fbe0 2023-10-18T14:05:09.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f290afefb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77ee79c60 con 0x55b77ee6a5d0 2023-10-18T14:05:09.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f290afefb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77ee79e20 con 0x55b77ee70500 2023-10-18T14:05:09.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f290afefb80 10 client.0 _ll_register_callbacks cb 0x55b77eca3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:09.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28f7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 0x55b77ee79070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28f7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 0x55b77ee79070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45222/0 (socket says 172.21.15.114:45222) 2023-10-18T14:05:09.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28f7fff700 1 -- 172.21.15.114:0/2137406461 learned_addr learned my addr 172.21.15.114:0/2137406461 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:09.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28fd3a3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee70500 0x55b77ee795b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28fcba2700 1 --2- 172.21.15.114:0/2137406461 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6a5d0 0x55b77ee7ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28f7fff700 1 -- 172.21.15.114:0/2137406461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee70500 msgr2=0x55b77ee795b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28f7fff700 1 --2- 172.21.15.114:0/2137406461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee70500 0x55b77ee795b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28f7fff700 1 -- 172.21.15.114:0/2137406461 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6a5d0 msgr2=0x55b77ee7ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:09.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28f7fff700 1 --2- 172.21.15.114:0/2137406461 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6a5d0 0x55b77ee7ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28f7fff700 1 -- 172.21.15.114:0/2137406461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f0012800 con 0x55b77ee6fbe0 2023-10-18T14:05:09.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28f7fff700 1 --2- 172.21.15.114:0/2137406461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 0x55b77ee79070 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f28e4000c00 tx=0x7f28e400fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc4089cff143d36 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:09.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:09.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28d7fff700 1 -- 172.21.15.114:0/2137406461 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e401e040 con 0x55b77ee6fbe0 2023-10-18T14:05:09.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f290afefb80 1 -- 172.21.15.114:0/2137406461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f28ec09ac90 con 0x55b77ee6fbe0 2023-10-18T14:05:09.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.384+0000 7f28d7fff700 1 -- 172.21.15.114:0/2137406461 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f28e40304b0 con 0x55b77ee6fbe0 2023-10-18T14:05:09.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f28d7fff700 1 -- 172.21.15.114:0/2137406461 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28e400fea0 con 0x55b77ee6fbe0 2023-10-18T14:05:09.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f290afefb80 10 client.16068 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:09.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f290afefb80 1 -- 172.21.15.114:0/2137406461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f28f810cef0 con 0x55b77ee6fbe0 2023-10-18T14:05:09.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f28d7fff700 1 -- 172.21.15.114:0/2137406461 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28ec09ac90 con 0x55b77ee6fbe0 2023-10-18T14:05:09.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f28d7fff700 1 -- 172.21.15.114:0/2137406461 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f28e4004620 con 0x55b77ee6fbe0 2023-10-18T14:05:09.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f290afefb80 10 client.16068 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:09.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f290afefb80 10 client.16068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:09.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f290afefb80 20 client.16068 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:09.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f290afefb80 1 --2- 172.21.15.114:0/2137406461 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55b77eed87b0 0x55b77eedabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:09.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f290afefb80 4 client.16068 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:05:09.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f290afefb80 1 -- 172.21.15.114:0/2137406461 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b77edb5e50 con 0x55b77eed87b0 2023-10-18T14:05:09.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f28fcba2700 1 --2- 172.21.15.114:0/2137406461 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55b77eed87b0 0x55b77eedabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:09.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f28d7fff700 10 client.16068 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:09.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.385+0000 7f28fcba2700 1 --2- 172.21.15.114:0/2137406461 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55b77eed87b0 0x55b77eedabd0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80397e7ffc5c1e6c server_cookie=11d601882aa55d42 in_seq=0 out_seq=0 2023-10-18T14:05:09.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f28d7fff700 1 -- 172.21.15.114:0/2137406461 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b77edb5e50 con 0x55b77eed87b0 2023-10-18T14:05:09.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f28d7fff700 10 client.16068 handle_command_reply: tid=0 2023-10-18T14:05:09.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f290afefb80 1 client.16068 shutdown 2023-10-18T14:05:09.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f290afefb80 1 -- 172.21.15.114:0/2137406461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 msgr2=0x55b77ee79070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f290afefb80 1 --2- 172.21.15.114:0/2137406461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 0x55b77ee79070 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f28e4000c00 tx=0x7f28e400fbd0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f290afefb80 1 -- 172.21.15.114:0/2137406461 shutdown_connections 2023-10-18T14:05:09.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f290afefb80 1 --2- 172.21.15.114:0/2137406461 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55b77eed87b0 0x55b77eedabd0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f290afefb80 1 --2- 172.21.15.114:0/2137406461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b77ee70500 0x55b77ee795b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f28d7fff700 0 client.16068 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:09.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f290afefb80 1 --2- 172.21.15.114:0/2137406461 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b77ee6a5d0 0x55b77ee7ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f290afefb80 1 --2- 172.21.15.114:0/2137406461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b77ee6fbe0 0x55b77ee79070 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f290afefb80 1 -- 172.21.15.114:0/2137406461 >> 172.21.15.114:0/2137406461 conn(0x55b77edde720 msgr2=0x55b77ee6d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:09.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f290afefb80 1 -- 172.21.15.114:0/2137406461 shutdown_connections 2023-10-18T14:05:09.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.386+0000 7f290afefb80 1 -- 172.21.15.114:0/2137406461 wait complete. 2023-10-18T14:05:09.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.387+0000 7f290afefb80 20 client.16068 trim_cache size 0 max 16384 2023-10-18T14:05:09.415 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:05:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-18T14:05:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": { 2023-10-18T14:05:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "d835d03f-5da5-43e5-81bf-2feeea35c1ae": { 2023-10-18T14:05:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/", 2023-10-18T14:05:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "tag": "d835d03f-5da5-43e5-81bf-2feeea35c1ae", 2023-10-18T14:05:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "options": "recursive,force" 2023-10-18T14:05:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:05:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:05:09.417 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:05:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.387+0000 7f28fee06700 1 -- 172.21.15.114:0/447230889 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f28e80a15f0 msgr2=0x7f28e80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.387+0000 7f28fee06700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f28e80a15f0 0x7f28e80a3ab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f28e400b2e0 tx=0x7f28e4005e80 comp rx=0 tx=0).stop 2023-10-18T14:05:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.387+0000 7f28fee06700 1 -- 172.21.15.114:0/447230889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28f80ffa00 msgr2=0x7f28f810bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.387+0000 7f28fee06700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28f80ffa00 0x7f28f810bbf0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00eb30 tx=0x7f28ec00ee40 comp rx=0 tx=0).stop 2023-10-18T14:05:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.387+0000 7f28fee06700 1 -- 172.21.15.114:0/447230889 shutdown_connections 2023-10-18T14:05:09.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.387+0000 7f28fee06700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f28e80a15f0 0x7f28e80a3ab0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.387+0000 7f28fee06700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28f8101ae0 0x7f28f819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.387+0000 7f28fee06700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28f80ffa00 0x7f28f810bbf0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.387+0000 7f28fee06700 1 --2- 172.21.15.114:0/447230889 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f28f8101120 0x7f28f810c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:09.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.387+0000 7f28fee06700 1 -- 172.21.15.114:0/447230889 >> 172.21.15.114:0/447230889 conn(0x7f28f8076790 msgr2=0x7f28f8102710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:09.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.387+0000 7f28fee06700 1 -- 172.21.15.114:0/447230889 shutdown_connections 2023-10-18T14:05:09.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:09.387+0000 7f28fee06700 1 -- 172.21.15.114:0/447230889 wait complete. 2023-10-18T14:05:09.421 INFO:tasks.cephfs.filesystem:scrub status for tag:d835d03f-5da5-43e5-81bf-2feeea35c1ae - {'path': '/', 'tag': 'd835d03f-5da5-43e5-81bf-2feeea35c1ae', 'options': 'recursive,force'} 2023-10-18T14:05:10.814 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.808+0000 7fe7012b5700 1 -- 172.21.15.114:0/2317592256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc106720 msgr2=0x7fe6fc106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:10.814 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.808+0000 7fe7012b5700 1 --2- 172.21.15.114:0/2317592256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc106720 0x7fe6fc106b00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec009990 tx=0x7fe6ec009ca0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.814 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.808+0000 7fe7012b5700 1 -- 172.21.15.114:0/2317592256 shutdown_connections 2023-10-18T14:05:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.808+0000 7fe7012b5700 1 --2- 172.21.15.114:0/2317592256 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe6fc0698f0 0x7fe6fc10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.808+0000 7fe7012b5700 1 --2- 172.21.15.114:0/2317592256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc106720 0x7fe6fc106b00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.808+0000 7fe7012b5700 1 --2- 172.21.15.114:0/2317592256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6fc068f50 0x7fe6fc0693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.808+0000 7fe7012b5700 1 -- 172.21.15.114:0/2317592256 >> 172.21.15.114:0/2317592256 conn(0x7fe6fc076810 msgr2=0x7fe6fc076c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.808+0000 7fe7012b5700 1 -- 172.21.15.114:0/2317592256 shutdown_connections 2023-10-18T14:05:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.808+0000 7fe7012b5700 1 -- 172.21.15.114:0/2317592256 wait complete. 2023-10-18T14:05:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.808+0000 7fe7012b5700 1 Processor -- start 2023-10-18T14:05:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe7012b5700 1 -- start start 2023-10-18T14:05:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe7012b5700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe6fc068f50 0x7fe6fc19c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe7012b5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6fc0698f0 0x7fe6fc19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe7012b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc106720 0x7fe6fc196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe7012b5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc196fe0 con 0x7fe6fc106720 2023-10-18T14:05:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe7012b5700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc197150 con 0x7fe6fc068f50 2023-10-18T14:05:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe7012b5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc197310 con 0x7fe6fc0698f0 2023-10-18T14:05:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe6fb7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc106720 0x7fe6fc196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe6fb7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc106720 0x7fe6fc196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45238/0 (socket says 172.21.15.114:45238) 2023-10-18T14:05:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe6fb7fe700 1 -- 172.21.15.114:0/3866293665 learned_addr learned my addr 172.21.15.114:0/3866293665 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe6fa7fc700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6fc0698f0 0x7fe6fc19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe6faffd700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe6fc068f50 0x7fe6fc19c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe6fb7fe700 1 -- 172.21.15.114:0/3866293665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6fc0698f0 msgr2=0x7fe6fc19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe6fb7fe700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6fc0698f0 0x7fe6fc19cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe6fb7fe700 1 -- 172.21.15.114:0/3866293665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe6fc068f50 msgr2=0x7fe6fc19c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe6fb7fe700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe6fc068f50 0x7fe6fc19c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe6fb7fe700 1 -- 172.21.15.114:0/3866293665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec0095f0 con 0x7fe6fc106720 2023-10-18T14:05:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe6faffd700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe6fc068f50 0x7fe6fc19c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.809+0000 7fe6fb7fe700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc106720 0x7fe6fc196980 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400b9e0 tx=0x7fe6f400bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.810+0000 7fe6e3fff700 1 -- 172.21.15.114:0/3866293665 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f400d8e0 con 0x7fe6fc106720 2023-10-18T14:05:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.810+0000 7fe6e3fff700 1 -- 172.21.15.114:0/3866293665 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6f4015420 con 0x7fe6fc106720 2023-10-18T14:05:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.810+0000 7fe7012b5700 1 -- 172.21.15.114:0/3866293665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6fc1975f0 con 0x7fe6fc106720 2023-10-18T14:05:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.810+0000 7fe6e3fff700 1 -- 172.21.15.114:0/3866293665 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4014630 con 0x7fe6fc106720 2023-10-18T14:05:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.810+0000 7fe7012b5700 1 -- 172.21.15.114:0/3866293665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc1a3840 con 0x7fe6fc106720 2023-10-18T14:05:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.812+0000 7fe6e3fff700 1 -- 172.21.15.114:0/3866293665 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fe6f4015590 con 0x7fe6fc106720 2023-10-18T14:05:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.812+0000 7fe6e3fff700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe6e40a15f0 0x7fe6e40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.812+0000 7fe6faffd700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe6e40a15f0 0x7fe6e40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.812+0000 7fe6e3fff700 1 -- 172.21.15.114:0/3866293665 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe6f4011070 con 0x7fe6fc106720 2023-10-18T14:05:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.813+0000 7fe6faffd700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe6e40a15f0 0x7fe6e40a3ab0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec000c00 tx=0x7fe6ec005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.813+0000 7fe70d49eb80 1 Processor -- start 2023-10-18T14:05:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.813+0000 7fe70d49eb80 1 -- start start 2023-10-18T14:05:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.813+0000 7fe70d49eb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 0x55ff384a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.813+0000 7fe70d49eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1f50 0x55ff3849bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.813+0000 7fe70d49eb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff3849c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.813+0000 7fe70d49eb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff3840f680 con 0x55ff3849c410 2023-10-18T14:05:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.813+0000 7fe70d49eb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff383f5c00 con 0x55ff384a1630 2023-10-18T14:05:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.813+0000 7fe70d49eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff383f3520 con 0x55ff384a1f50 2023-10-18T14:05:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.813+0000 7fe6fb7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff3849c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.813+0000 7fe6fb7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff3849c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45246/0 (socket says 172.21.15.114:45246) 2023-10-18T14:05:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.813+0000 7fe6fb7fe700 1 -- 172.21.15.114:0/4202330413 learned_addr learned my addr 172.21.15.114:0/4202330413 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.813+0000 7fe6fa7fc700 1 --2- 172.21.15.114:0/4202330413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1f50 0x55ff3849bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.814+0000 7fe6faffd700 1 --2- 172.21.15.114:0/4202330413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 0x55ff384a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.814+0000 7fe6fb7fe700 1 -- 172.21.15.114:0/4202330413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1f50 msgr2=0x55ff3849bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.814+0000 7fe6fb7fe700 1 --2- 172.21.15.114:0/4202330413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1f50 0x55ff3849bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.814+0000 7fe6fb7fe700 1 -- 172.21.15.114:0/4202330413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 msgr2=0x55ff384a1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.814+0000 7fe6fb7fe700 1 --2- 172.21.15.114:0/4202330413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 0x55ff384a1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.814+0000 7fe6fb7fe700 1 -- 172.21.15.114:0/4202330413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff383ac390 con 0x55ff3849c410 2023-10-18T14:05:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.814+0000 7fe6fb7fe700 1 --2- 172.21.15.114:0/4202330413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff3849c870 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4095f30 tx=0x7fe6f4015c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e667216e5feeb244 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:10.833 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.814+0000 7fe6e17fa700 1 -- 172.21.15.114:0/4202330413 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f409db80 con 0x55ff3849c410 2023-10-18T14:05:10.833 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.814+0000 7fe6e17fa700 1 -- 172.21.15.114:0/4202330413 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6f40a1dc0 con 0x55ff3849c410 2023-10-18T14:05:10.833 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.814+0000 7fe6e17fa700 1 -- 172.21.15.114:0/4202330413 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4099180 con 0x55ff3849c410 2023-10-18T14:05:10.833 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 -- 172.21.15.114:0/4202330413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 msgr2=0x55ff3849c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:10.834 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/4202330413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff3849c870 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4095f30 tx=0x7fe6f4015c70 comp rx=0 tx=0).stop 2023-10-18T14:05:10.834 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 -- 172.21.15.114:0/4202330413 shutdown_connections 2023-10-18T14:05:10.834 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/4202330413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff3849c870 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.834 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/4202330413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 0x55ff384a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/4202330413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1f50 0x55ff3849bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 -- 172.21.15.114:0/4202330413 >> 172.21.15.114:0/4202330413 conn(0x55ff384106c0 msgr2=0x55ff384965a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 -- 172.21.15.114:0/4202330413 shutdown_connections 2023-10-18T14:05:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 -- 172.21.15.114:0/4202330413 wait complete. 2023-10-18T14:05:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 -- start start 2023-10-18T14:05:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 Processor -- start 2023-10-18T14:05:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff384a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 0x55ff384a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1f50 0x55ff384a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff383eee10 con 0x55ff3849c410 2023-10-18T14:05:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff3838b6b0 con 0x55ff384a1630 2023-10-18T14:05:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff3838b350 con 0x55ff384a1f50 2023-10-18T14:05:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.815+0000 7fe70d49eb80 10 client.0 _ll_register_callbacks cb 0x55ff382d5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6faffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff384a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6faffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff384a7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45248/0 (socket says 172.21.15.114:45248) 2023-10-18T14:05:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6faffd700 1 -- 172.21.15.114:0/1422559225 learned_addr learned my addr 172.21.15.114:0/1422559225 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6fb7fe700 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1f50 0x55ff384a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6fa7fc700 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 0x55ff384a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6faffd700 1 -- 172.21.15.114:0/1422559225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1f50 msgr2=0x55ff384a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6faffd700 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1f50 0x55ff384a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6faffd700 1 -- 172.21.15.114:0/1422559225 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 msgr2=0x55ff384a52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6faffd700 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 0x55ff384a52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6faffd700 1 -- 172.21.15.114:0/1422559225 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc1a3840 con 0x55ff3849c410 2023-10-18T14:05:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6fb7fe700 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1f50 0x55ff384a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6faffd700 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff384a7fb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec005290 tx=0x7fe6ec009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6661180f491fc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6deff5700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6deff5700 1 -- 172.21.15.114:0/1422559225 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec02b070 con 0x55ff3849c410 2023-10-18T14:05:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6deff5700 1 -- 172.21.15.114:0/1422559225 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe6ec003db0 con 0x55ff3849c410 2023-10-18T14:05:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe70d49eb80 1 -- 172.21.15.114:0/1422559225 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff383f3e90 con 0x55ff3849c410 2023-10-18T14:05:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe6deff5700 1 -- 172.21.15.114:0/1422559225 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6ec01d070 con 0x55ff3849c410 2023-10-18T14:05:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe70d49eb80 10 client.16080 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.816+0000 7fe70d49eb80 1 -- 172.21.15.114:0/1422559225 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ff38219d80 con 0x55ff3849c410 2023-10-18T14:05:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.817+0000 7fe6deff5700 1 -- 172.21.15.114:0/1422559225 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ff383f3e90 con 0x55ff3849c410 2023-10-18T14:05:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.817+0000 7fe6deff5700 1 -- 172.21.15.114:0/1422559225 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe6ec039520 con 0x55ff3849c410 2023-10-18T14:05:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.817+0000 7fe70d49eb80 10 client.16080 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.817+0000 7fe70d49eb80 10 client.16080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.817+0000 7fe70d49eb80 20 client.16080 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.817+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55ff384b5a50 0x55ff384b7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.817+0000 7fe70d49eb80 4 client.16080 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.817+0000 7fe70d49eb80 1 -- 172.21.15.114:0/1422559225 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff3846b850 con 0x55ff384b5a50 2023-10-18T14:05:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.817+0000 7fe6fa7fc700 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55ff384b5a50 0x55ff384b7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.817+0000 7fe6deff5700 10 client.16080 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.817+0000 7fe6fa7fc700 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55ff384b5a50 0x55ff384b7e70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f34fd67aafd87a9f server_cookie=7d7c9be389cc4339 in_seq=0 out_seq=0 2023-10-18T14:05:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe6deff5700 1 -- 172.21.15.114:0/1422559225 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ff3846b850 con 0x55ff384b5a50 2023-10-18T14:05:10.845 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe6deff5700 10 client.16080 handle_command_reply: tid=0 2023-10-18T14:05:10.845 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe70d49eb80 1 client.16080 shutdown 2023-10-18T14:05:10.845 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe70d49eb80 1 -- 172.21.15.114:0/1422559225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 msgr2=0x55ff384a7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:10.845 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff384a7fb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec005290 tx=0x7fe6ec009310 comp rx=0 tx=0).stop 2023-10-18T14:05:10.845 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe70d49eb80 1 -- 172.21.15.114:0/1422559225 shutdown_connections 2023-10-18T14:05:10.846 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55ff384b5a50 0x55ff384b7e70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.846 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1f50 0x55ff384a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.846 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe6deff5700 0 client.16080 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:10.846 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff384a7fb0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.847 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/1422559225 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 0x55ff384a52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.847 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe70d49eb80 1 -- 172.21.15.114:0/1422559225 >> 172.21.15.114:0/1422559225 conn(0x55ff384106c0 msgr2=0x55ff38495d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:10.847 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe70d49eb80 1 -- 172.21.15.114:0/1422559225 shutdown_connections 2023-10-18T14:05:10.847 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe70d49eb80 1 -- 172.21.15.114:0/1422559225 wait complete. 2023-10-18T14:05:10.847 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.818+0000 7fe70d49eb80 20 client.16080 trim_cache size 0 max 16384 2023-10-18T14:05:10.853 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe70d49eb80 1 Processor -- start 2023-10-18T14:05:10.853 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe70d49eb80 1 -- start start 2023-10-18T14:05:10.853 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe70d49eb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff3849bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.853 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe70d49eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1630 0x55ff384ac930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.854 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe70d49eb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1f50 0x55ff384964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.854 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe70d49eb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff3826f8c0 con 0x55ff3849c410 2023-10-18T14:05:10.854 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe70d49eb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff3848f0b0 con 0x55ff384a1f50 2023-10-18T14:05:10.854 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe70d49eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff384acef0 con 0x55ff384a1630 2023-10-18T14:05:10.854 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe6faffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff3849bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.855 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe6faffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff3849bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45256/0 (socket says 172.21.15.114:45256) 2023-10-18T14:05:10.855 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe6faffd700 1 -- 172.21.15.114:0/2776507331 learned_addr learned my addr 172.21.15.114:0/2776507331 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:10.855 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe6fb7fe700 1 --2- 172.21.15.114:0/2776507331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1f50 0x55ff384964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.855 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe6faffd700 1 -- 172.21.15.114:0/2776507331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1630 msgr2=0x55ff384ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:10.856 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe6faffd700 1 --2- 172.21.15.114:0/2776507331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1630 0x55ff384ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.856 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe6faffd700 1 -- 172.21.15.114:0/2776507331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1f50 msgr2=0x55ff384964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:10.856 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe6faffd700 1 --2- 172.21.15.114:0/2776507331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1f50 0x55ff384964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.856 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe6faffd700 1 -- 172.21.15.114:0/2776507331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff38202c00 con 0x55ff3849c410 2023-10-18T14:05:10.856 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.833+0000 7fe6fb7fe700 1 --2- 172.21.15.114:0/2776507331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1f50 0x55ff384964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:10.857 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.834+0000 7fe6faffd700 1 --2- 172.21.15.114:0/2776507331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff3849bed0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00b8f0 tx=0x7fe6ec0057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0785ece7b5289ee server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:10.857 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.834+0000 7fe6e1ffb700 1 -- 172.21.15.114:0/2776507331 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec02b040 con 0x55ff3849c410 2023-10-18T14:05:10.857 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.834+0000 7fe6e1ffb700 1 -- 172.21.15.114:0/2776507331 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6ec003db0 con 0x55ff3849c410 2023-10-18T14:05:10.857 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.834+0000 7fe6e1ffb700 1 -- 172.21.15.114:0/2776507331 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec00f8f0 con 0x55ff3849c410 2023-10-18T14:05:10.857 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.834+0000 7fe70d49eb80 1 -- 172.21.15.114:0/2776507331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 msgr2=0x55ff3849bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.834+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/2776507331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff3849bed0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00b8f0 tx=0x7fe6ec0057e0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.834+0000 7fe70d49eb80 1 -- 172.21.15.114:0/2776507331 shutdown_connections 2023-10-18T14:05:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.834+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/2776507331 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1f50 0x55ff384964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.834+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/2776507331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff3849c410 0x55ff3849bed0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.834+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/2776507331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff384a1630 0x55ff384ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.834+0000 7fe70d49eb80 1 -- 172.21.15.114:0/2776507331 >> 172.21.15.114:0/2776507331 conn(0x55ff384106c0 msgr2=0x55ff3849f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.834+0000 7fe70d49eb80 1 -- 172.21.15.114:0/2776507331 shutdown_connections 2023-10-18T14:05:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.834+0000 7fe70d49eb80 1 -- 172.21.15.114:0/2776507331 wait complete. 2023-10-18T14:05:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe70d49eb80 1 -- start start 2023-10-18T14:05:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe70d49eb80 1 Processor -- start 2023-10-18T14:05:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe70d49eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff3849c410 0x55ff384ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe70d49eb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 0x55ff384ac910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe70d49eb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff384a1f50 0x55ff384aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe70d49eb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff384ab200 con 0x55ff384a1f50 2023-10-18T14:05:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe70d49eb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff384ab370 con 0x55ff384a1630 2023-10-18T14:05:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe70d49eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff384ab530 con 0x55ff3849c410 2023-10-18T14:05:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe70d49eb80 10 client.0 _ll_register_callbacks cb 0x55ff382d5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe6fb7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff384a1f50 0x55ff384aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe6fb7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff384a1f50 0x55ff384aaaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45266/0 (socket says 172.21.15.114:45266) 2023-10-18T14:05:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe6fb7fe700 1 -- 172.21.15.114:0/322789991 learned_addr learned my addr 172.21.15.114:0/322789991 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe6fa7fc700 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 0x55ff384ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe6fb7fe700 1 -- 172.21.15.114:0/322789991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff3849c410 msgr2=0x55ff384ac3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe6faffd700 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff3849c410 0x55ff384ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe6fb7fe700 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff3849c410 0x55ff384ac3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe6fb7fe700 1 -- 172.21.15.114:0/322789991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 msgr2=0x55ff384ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe6fb7fe700 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 0x55ff384ac910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe6fb7fe700 1 -- 172.21.15.114:0/322789991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff38219d80 con 0x55ff384a1f50 2023-10-18T14:05:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe6fa7fc700 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 0x55ff384ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe6fb7fe700 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff384a1f50 0x55ff384aaaf0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe6f409a2e0 tx=0x7fe6f400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30366331447bb590 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.835+0000 7fe6deff5700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe6deff5700 1 -- 172.21.15.114:0/322789991 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f409db80 con 0x55ff384a1f50 2023-10-18T14:05:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe6deff5700 1 -- 172.21.15.114:0/322789991 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe6f4006e40 con 0x55ff384a1f50 2023-10-18T14:05:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe70d49eb80 1 -- 172.21.15.114:0/322789991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe6f40a1dc0 con 0x55ff384a1f50 2023-10-18T14:05:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe6deff5700 1 -- 172.21.15.114:0/322789991 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6f4099ea0 con 0x55ff384a1f50 2023-10-18T14:05:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe70d49eb80 10 client.16086 fetch_fsmap learned FSMap version 26 2023-10-18T14:05:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe70d49eb80 1 -- 172.21.15.114:0/322789991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ff382401f0 con 0x55ff384a1f50 2023-10-18T14:05:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe6deff5700 1 -- 172.21.15.114:0/322789991 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6f4063080 con 0x55ff384a1f50 2023-10-18T14:05:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe6deff5700 1 -- 172.21.15.114:0/322789991 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe6f4065120 con 0x55ff384a1f50 2023-10-18T14:05:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe70d49eb80 10 client.16086 fetch_fsmap finished waiting for FSMap version 26 2023-10-18T14:05:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe70d49eb80 10 client.16086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe70d49eb80 20 client.16086 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:10.866 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55ff3850a960 0x55ff3850cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:10.866 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe70d49eb80 4 client.16086 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:05:10.866 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe70d49eb80 1 -- 172.21.15.114:0/322789991 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ff383e7df0 con 0x55ff3850a960 2023-10-18T14:05:10.866 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.836+0000 7fe6faffd700 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55ff3850a960 0x55ff3850cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:10.866 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.837+0000 7fe6deff5700 10 client.16086 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:10.867 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:10.837+0000 7fe6faffd700 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55ff3850a960 0x55ff3850cd50 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e88b5d9609309007 server_cookie=a79a34795b6fcf15 in_seq=0 out_seq=0 2023-10-18T14:05:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:10 smithi158 ceph-mon[103317]: scrub queued for path: / 2023-10-18T14:05:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:10 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:11.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:10 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:05:11.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:10 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:11.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:10 smithi158 ceph-mon[103317]: pgmap v314: 97 pgs: 97 active+clean; 2.5 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 127 KiB/s wr, 23 op/s 2023-10-18T14:05:11.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:10 smithi172 ceph-mon[103574]: scrub queued for path: / 2023-10-18T14:05:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:10 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:10 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:05:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:10 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:10 smithi172 ceph-mon[103574]: pgmap v314: 97 pgs: 97 active+clean; 2.5 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 127 KiB/s wr, 23 op/s 2023-10-18T14:05:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:10 smithi114 ceph-mon[99494]: scrub queued for path: / 2023-10-18T14:05:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:10 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:11.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:10 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:05:11.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:10 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:11.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:10 smithi114 ceph-mon[99494]: pgmap v314: 97 pgs: 97 active+clean; 2.5 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 127 KiB/s wr, 23 op/s 2023-10-18T14:05:11.320 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe6deff5700 1 -- 172.21.15.114:0/322789991 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ff383e7df0 con 0x55ff3850a960 2023-10-18T14:05:11.320 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe6deff5700 10 client.16086 handle_command_reply: tid=0 2023-10-18T14:05:11.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe70d49eb80 1 client.16086 shutdown 2023-10-18T14:05:11.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe70d49eb80 1 -- 172.21.15.114:0/322789991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff384a1f50 msgr2=0x55ff384aaaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:11.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff384a1f50 0x55ff384aaaf0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe6f409a2e0 tx=0x7fe6f400bf10 comp rx=0 tx=0).stop 2023-10-18T14:05:11.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe70d49eb80 1 -- 172.21.15.114:0/322789991 shutdown_connections 2023-10-18T14:05:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55ff3850a960 0x55ff3850cd50 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ff384a1f50 0x55ff384aaaf0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe6deff5700 0 client.16086 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff3849c410 0x55ff384ac3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe70d49eb80 1 --2- 172.21.15.114:0/322789991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55ff384a1630 0x55ff384ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe70d49eb80 1 -- 172.21.15.114:0/322789991 >> 172.21.15.114:0/322789991 conn(0x55ff384106c0 msgr2=0x55ff384a3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe70d49eb80 1 -- 172.21.15.114:0/322789991 shutdown_connections 2023-10-18T14:05:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe70d49eb80 1 -- 172.21.15.114:0/322789991 wait complete. 2023-10-18T14:05:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe70d49eb80 20 client.16086 trim_cache size 0 max 16384 2023-10-18T14:05:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:05:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:05:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:05:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:05:11.325 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe7012b5700 1 -- 172.21.15.114:0/3866293665 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe6e40a15f0 msgr2=0x7fe6e40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:11.325 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe7012b5700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe6e40a15f0 0x7fe6e40a3ab0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec000c00 tx=0x7fe6ec005fb0 comp rx=0 tx=0).stop 2023-10-18T14:05:11.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe7012b5700 1 -- 172.21.15.114:0/3866293665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc106720 msgr2=0x7fe6fc196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:11.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe7012b5700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc106720 0x7fe6fc196980 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400b9e0 tx=0x7fe6f400bcf0 comp rx=0 tx=0).stop 2023-10-18T14:05:11.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe7012b5700 1 -- 172.21.15.114:0/3866293665 shutdown_connections 2023-10-18T14:05:11.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe7012b5700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe6e40a15f0 0x7fe6e40a3ab0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe7012b5700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc106720 0x7fe6fc196980 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe7012b5700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe6fc068f50 0x7fe6fc19c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe7012b5700 1 --2- 172.21.15.114:0/3866293665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6fc0698f0 0x7fe6fc19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe7012b5700 1 -- 172.21.15.114:0/3866293665 >> 172.21.15.114:0/3866293665 conn(0x7fe6fc076810 msgr2=0x7fe6fc0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe7012b5700 1 -- 172.21.15.114:0/3866293665 shutdown_connections 2023-10-18T14:05:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:11.316+0000 7fe7012b5700 1 -- 172.21.15.114:0/3866293665 wait complete. 2023-10-18T14:05:12.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:11 smithi158 ceph-mon[103317]: scrub summary: idle 2023-10-18T14:05:12.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:11 smithi172 ceph-mon[103574]: scrub summary: idle 2023-10-18T14:05:12.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:11 smithi114 ceph-mon[99494]: scrub summary: idle 2023-10-18T14:05:13.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:12 smithi158 ceph-mon[103317]: pgmap v315: 97 pgs: 97 active+clean; 8.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 640 KiB/s wr, 36 op/s 2023-10-18T14:05:13.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:12 smithi172 ceph-mon[103574]: pgmap v315: 97 pgs: 97 active+clean; 8.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 640 KiB/s wr, 36 op/s 2023-10-18T14:05:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:12 smithi114 ceph-mon[99494]: pgmap v315: 97 pgs: 97 active+clean; 8.3 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 640 KiB/s wr, 36 op/s 2023-10-18T14:05:14.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:14 smithi172 ceph-mon[103574]: pgmap v316: 97 pgs: 97 active+clean; 16 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.3 MiB/s wr, 215 op/s 2023-10-18T14:05:14.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:14 smithi114 ceph-mon[99494]: pgmap v316: 97 pgs: 97 active+clean; 16 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.3 MiB/s wr, 215 op/s 2023-10-18T14:05:14.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:14 smithi158 ceph-mon[103317]: pgmap v316: 97 pgs: 97 active+clean; 16 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.3 MiB/s wr, 215 op/s 2023-10-18T14:05:16.355 INFO:tasks.workunit.client.0.smithi114.stderr:Updating files: 22% (939/4205) Updating files: 23% (968/4205) Updating files: 24% (1010/4205) Updating files: 25% (1052/4205) Updating files: 26% (1094/4205) Updating files: 27% (1136/4205) Updating files: 28% (1178/4205) Updating files: 29% (1220/4205) Updating files: 30% (1262/4205) Updating files: 31% (1304/4205) Updating files: 32% (1346/4205) Updating files: 33% (1388/4205) Updating files: 34% (1430/4205) Updating files: 35% (1472/4205) Updating files: 35% (1502/4205) Updating files: 36% (1514/4205) Updating files: 37% (1556/4205) Updating files: 38% (1598/4205) Updating files: 39% (1640/4205) Updating files: 40% (1682/4205) Updating files: 41% (1725/4205) Updating files: 42% (1767/4205) Updating files: 43% (1809/4205) Updating files: 44% (1851/4205) Updating files: 45% (1893/4205) Updating files: 46% (1935/4205) Updating files: 47% (1977/4205) Updating files: 47% (2006/4205) Updating files: 48% (2019/4205) Updating files: 49% (2061/4205) Updating files: 50% (2103/4205) Updating files: 51% (2145/4205) Updating files: 52% (2187/4205) Updating files: 53% (2229/4205) Updating files: 53% (2259/4205) Updating files: 54% (2271/4205) Updating files: 55% (2313/4205) Updating files: 56% (2355/4205) Updating files: 57% (2397/4205) Updating files: 58% (2439/4205) Updating files: 59% (2481/4205) Updating files: 60% (2523/4205) Updating files: 61% (2566/4205) Updating files: 62% (2608/4205) Updating files: 63% (2650/4205) Updating files: 64% (2692/4205) Updating files: 65% (2734/4205) Updating files: 66% (2776/4205) Updating files: 67% (2818/4205) Updating files: 68% (2860/4205) Updating files: 69% (2902/4205) Updating files: 70% (2944/4205) Updating files: 71% (2986/4205) Updating files: 72% (3028/4205) Updating files: 73% (3070/4205) Updating files: 74% (3112/4205) Updating files: 75% (3154/4205) Updating files: 76% (3196/4205) Updating files: 77% (3238/4205) Updating files: 77% (3277/4205) Updating files: 78% (3280/4205) Updating files: 79% (3322/4205) Updating files: 80% (3364/4205) Updating files: 81% (3407/4205) Updating files: 82% (3449/4205) Updating files: 83% (3491/4205) Updating files: 84% (3533/4205) Updating files: 85% (3575/4205) Updating files: 86% (3617/4205) Updating files: 87% (3659/4205) Updating files: 88% (3701/4205) Updating files: 89% (3743/4205) Updating files: 90% (3785/4205) Updating files: 91% (3827/4205) Updating files: 92% (3869/4205) Updating files: 93% (3911/4205) Updating files: 94% (3953/4205) Updating files: 95% (3995/4205) Updating files: 96% (4037/4205) Updating files: 97% (4079/4205) Updating files: 98% (4121/4205) Updating files: 99% (4163/4205) Updating files: 100% (4205/4205) Updating files: 100% (4205/4205), done. 2023-10-18T14:05:16.381 INFO:tasks.workunit.client.0.smithi114.stderr:+ cd xfstests-dev 2023-10-18T14:05:16.382 INFO:tasks.workunit.client.0.smithi114.stderr:+ git checkout 12973fc04fd10d4af086901e10ffa8e48866b735 2023-10-18T14:05:17.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:16 smithi158 ceph-mon[103317]: pgmap v317: 97 pgs: 97 active+clean; 18 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 1.5 MiB/s wr, 282 op/s 2023-10-18T14:05:17.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:16 smithi172 ceph-mon[103574]: pgmap v317: 97 pgs: 97 active+clean; 18 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 1.5 MiB/s wr, 282 op/s 2023-10-18T14:05:17.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:16 smithi114 ceph-mon[99494]: pgmap v317: 97 pgs: 97 active+clean; 18 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 1.5 MiB/s wr, 282 op/s 2023-10-18T14:05:19.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:18 smithi158 ceph-mon[103317]: pgmap v318: 97 pgs: 97 active+clean; 21 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 1.8 MiB/s wr, 310 op/s 2023-10-18T14:05:19.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:18 smithi172 ceph-mon[103574]: pgmap v318: 97 pgs: 97 active+clean; 21 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 1.8 MiB/s wr, 310 op/s 2023-10-18T14:05:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:18 smithi114 ceph-mon[99494]: pgmap v318: 97 pgs: 97 active+clean; 21 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 1.8 MiB/s wr, 310 op/s 2023-10-18T14:05:21.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:20 smithi158 ceph-mon[103317]: pgmap v319: 97 pgs: 97 active+clean; 25 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-10-18T14:05:21.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:20 smithi172 ceph-mon[103574]: pgmap v319: 97 pgs: 97 active+clean; 25 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-10-18T14:05:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:20 smithi114 ceph-mon[99494]: pgmap v319: 97 pgs: 97 active+clean; 25 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-10-18T14:05:23.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:22 smithi158 ceph-mon[103317]: pgmap v320: 97 pgs: 97 active+clean; 26 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 328 op/s 2023-10-18T14:05:23.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:22 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:23.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:22 smithi172 ceph-mon[103574]: pgmap v320: 97 pgs: 97 active+clean; 26 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 328 op/s 2023-10-18T14:05:23.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:22 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:22 smithi114 ceph-mon[99494]: pgmap v320: 97 pgs: 97 active+clean; 26 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 328 op/s 2023-10-18T14:05:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:22 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:24.433 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.429+0000 7f8e0572d700 1 -- 172.21.15.114:0/2052027414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e00105880 msgr2=0x7f8e00105c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:24.433 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.429+0000 7f8e0572d700 1 --2- 172.21.15.114:0/2052027414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e00105880 0x7f8e00105c60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8df0009990 tx=0x7f8df0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.433 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.429+0000 7f8e0572d700 1 -- 172.21.15.114:0/2052027414 shutdown_connections 2023-10-18T14:05:24.433 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.429+0000 7f8e0572d700 1 --2- 172.21.15.114:0/2052027414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e000ff9e0 0x7f8e0010d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.434 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.429+0000 7f8e0572d700 1 --2- 172.21.15.114:0/2052027414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e00105880 0x7f8e00105c60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.434 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.429+0000 7f8e0572d700 1 --2- 172.21.15.114:0/2052027414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e000ff020 0x7f8e000ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.434 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.429+0000 7f8e0572d700 1 -- 172.21.15.114:0/2052027414 >> 172.21.15.114:0/2052027414 conn(0x7f8e00074970 msgr2=0x7f8e00074d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:24.434 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.429+0000 7f8e0572d700 1 -- 172.21.15.114:0/2052027414 shutdown_connections 2023-10-18T14:05:24.434 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.429+0000 7f8e0572d700 1 -- 172.21.15.114:0/2052027414 wait complete. 2023-10-18T14:05:24.435 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.430+0000 7f8e0572d700 1 Processor -- start 2023-10-18T14:05:24.435 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.430+0000 7f8e0572d700 1 -- start start 2023-10-18T14:05:24.437 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.430+0000 7f8e0572d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e000ff020 0x7f8e0019c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.437 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.430+0000 7f8e0572d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e000ff9e0 0x7f8e0019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.430+0000 7f8e0572d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e00105880 0x7f8e001969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.430+0000 7f8e0572d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e00197040 con 0x7f8e00105880 2023-10-18T14:05:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.430+0000 7f8e0572d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e001971b0 con 0x7f8e000ff9e0 2023-10-18T14:05:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.430+0000 7f8e0572d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e00197370 con 0x7f8e000ff020 2023-10-18T14:05:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8dfeffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e000ff020 0x7f8e0019c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8dff7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e00105880 0x7f8e001969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8dfeffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e000ff020 0x7f8e0019c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49212/0 (socket says 172.21.15.114:49212) 2023-10-18T14:05:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8dfeffd700 1 -- 172.21.15.114:0/1664039789 learned_addr learned my addr 172.21.15.114:0/1664039789 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8dfe7fc700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e000ff9e0 0x7f8e0019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8dfeffd700 1 -- 172.21.15.114:0/1664039789 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e000ff9e0 msgr2=0x7f8e0019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:24.440 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e000ff9e0 0x7f8e0019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.440 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8dfeffd700 1 -- 172.21.15.114:0/1664039789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e00105880 msgr2=0x7f8e001969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:24.440 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e00105880 0x7f8e001969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.440 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8dfeffd700 1 -- 172.21.15.114:0/1664039789 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df00095f0 con 0x7f8e000ff020 2023-10-18T14:05:24.440 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8dff7fe700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e00105880 0x7f8e001969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:24.441 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e000ff020 0x7f8e0019c8b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8df0000c00 tx=0x7f8df0009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:24.441 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8de7fff700 1 -- 172.21.15.114:0/1664039789 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df001d070 con 0x7f8e000ff020 2023-10-18T14:05:24.441 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8e0572d700 1 -- 172.21.15.114:0/1664039789 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e001975f0 con 0x7f8e000ff020 2023-10-18T14:05:24.441 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8de7fff700 1 -- 172.21.15.114:0/1664039789 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8df0021410 con 0x7f8e000ff020 2023-10-18T14:05:24.441 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8e0572d700 1 -- 172.21.15.114:0/1664039789 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e001a38a0 con 0x7f8e000ff020 2023-10-18T14:05:24.442 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.431+0000 7f8de7fff700 1 -- 172.21.15.114:0/1664039789 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df00175f0 con 0x7f8e000ff020 2023-10-18T14:05:24.442 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.434+0000 7f8de7fff700 1 -- 172.21.15.114:0/1664039789 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f8df0021580 con 0x7f8e000ff020 2023-10-18T14:05:24.442 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.434+0000 7f8de7fff700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8de80a15f0 0x7f8de80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.442 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.434+0000 7f8dfe7fc700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8de80a15f0 0x7f8de80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.442 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8de7fff700 1 -- 172.21.15.114:0/1664039789 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8df00ce100 con 0x7f8e000ff020 2023-10-18T14:05:24.448 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8dfe7fc700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8de80a15f0 0x7f8de80a3ab0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8e00197ba0 tx=0x7f8df4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:24.448 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8e11916b80 1 Processor -- start 2023-10-18T14:05:24.448 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8e11916b80 1 -- start start 2023-10-18T14:05:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8e11916b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acb630 0x55bb48acba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8e11916b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acbf50 0x55bb48ac5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8e11916b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 0x55bb48ac6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8e11916b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb48a39680 con 0x55bb48ac6410 2023-10-18T14:05:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8e11916b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb48a1fc00 con 0x55bb48acbf50 2023-10-18T14:05:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8e11916b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb48a1d520 con 0x55bb48acb630 2023-10-18T14:05:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8dff7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 0x55bb48ac6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8dff7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 0x55bb48ac6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45288/0 (socket says 172.21.15.114:45288) 2023-10-18T14:05:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8dff7fe700 1 -- 172.21.15.114:0/2723518334 learned_addr learned my addr 172.21.15.114:0/2723518334 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/2723518334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acb630 0x55bb48acba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.435+0000 7f8dfe7fc700 1 --2- 172.21.15.114:0/2723518334 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acbf50 0x55bb48ac5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.436+0000 7f8dfeffd700 1 -- 172.21.15.114:0/2723518334 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acbf50 msgr2=0x55bb48ac5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.436+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/2723518334 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acbf50 0x55bb48ac5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.436+0000 7f8dfeffd700 1 -- 172.21.15.114:0/2723518334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 msgr2=0x55bb48ac6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.436+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/2723518334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 0x55bb48ac6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.436+0000 7f8dfeffd700 1 -- 172.21.15.114:0/2723518334 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb489d6390 con 0x55bb48acb630 2023-10-18T14:05:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.436+0000 7f8dff7fe700 1 --2- 172.21.15.114:0/2723518334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 0x55bb48ac6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.436+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/2723518334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acb630 0x55bb48acba10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8df00cb8d0 tx=0x7f8df009afc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3d077e8a7a26eef server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.436+0000 7f8de57fa700 1 -- 172.21.15.114:0/2723518334 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df009f170 con 0x55bb48acb630 2023-10-18T14:05:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.436+0000 7f8de57fa700 1 -- 172.21.15.114:0/2723518334 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8df009ab50 con 0x55bb48acb630 2023-10-18T14:05:24.453 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.436+0000 7f8de57fa700 1 -- 172.21.15.114:0/2723518334 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df009b6b0 con 0x55bb48acb630 2023-10-18T14:05:24.453 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 -- 172.21.15.114:0/2723518334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acb630 msgr2=0x55bb48acba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:24.453 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 --2- 172.21.15.114:0/2723518334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acb630 0x55bb48acba10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8df00cb8d0 tx=0x7f8df009afc0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.453 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 -- 172.21.15.114:0/2723518334 shutdown_connections 2023-10-18T14:05:24.453 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 --2- 172.21.15.114:0/2723518334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 0x55bb48ac6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.453 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 --2- 172.21.15.114:0/2723518334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acb630 0x55bb48acba10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.454 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 --2- 172.21.15.114:0/2723518334 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acbf50 0x55bb48ac5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.454 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 -- 172.21.15.114:0/2723518334 >> 172.21.15.114:0/2723518334 conn(0x55bb48a3a6c0 msgr2=0x55bb48ac05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:24.454 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 -- 172.21.15.114:0/2723518334 shutdown_connections 2023-10-18T14:05:24.454 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 -- 172.21.15.114:0/2723518334 wait complete. 2023-10-18T14:05:24.454 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 -- start start 2023-10-18T14:05:24.455 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 Processor -- start 2023-10-18T14:05:24.455 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48ac6410 0x55bb48ad1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.455 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 0x55bb48acf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.455 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acbf50 0x55bb48acf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.455 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb48a18e10 con 0x55bb48acb630 2023-10-18T14:05:24.456 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb489b56b0 con 0x55bb48ac6410 2023-10-18T14:05:24.456 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb489b5350 con 0x55bb48acbf50 2023-10-18T14:05:24.456 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8e11916b80 10 client.0 _ll_register_callbacks cb 0x55bb488ffa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:24.456 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.437+0000 7f8dfe7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 0x55bb48acf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.456 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8dfe7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 0x55bb48acf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45292/0 (socket says 172.21.15.114:45292) 2023-10-18T14:05:24.457 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8dff7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acbf50 0x55bb48acf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.457 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8dfe7fc700 1 -- 172.21.15.114:0/1621220177 learned_addr learned my addr 172.21.15.114:0/1621220177 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:24.457 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48ac6410 0x55bb48ad1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.457 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8dfe7fc700 1 -- 172.21.15.114:0/1621220177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acbf50 msgr2=0x55bb48acf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:24.457 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8dfe7fc700 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acbf50 0x55bb48acf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.458 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8dfe7fc700 1 -- 172.21.15.114:0/1621220177 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48ac6410 msgr2=0x55bb48ad1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:24.458 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8dfe7fc700 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48ac6410 0x55bb48ad1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.458 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8dfe7fc700 1 -- 172.21.15.114:0/1621220177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df800a4a0 con 0x55bb48acb630 2023-10-18T14:05:24.458 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48ac6410 0x55bb48ad1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:24.458 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8dff7fe700 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acbf50 0x55bb48acf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:24.459 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8dfe7fc700 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 0x55bb48acf180 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8df4004580 tx=0x7f8df40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b570542eeda32a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:24.459 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8de2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:24.459 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8de2ff5700 1 -- 172.21.15.114:0/1621220177 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4022070 con 0x55bb48acb630 2023-10-18T14:05:24.459 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8de2ff5700 1 -- 172.21.15.114:0/1621220177 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8df4003e20 con 0x55bb48acb630 2023-10-18T14:05:24.459 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8e11916b80 1 -- 172.21.15.114:0/1621220177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb48a1de90 con 0x55bb48acb630 2023-10-18T14:05:24.459 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8de2ff5700 1 -- 172.21.15.114:0/1621220177 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8df40045b0 con 0x55bb48acb630 2023-10-18T14:05:24.460 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8e11916b80 10 client.16098 fetch_fsmap learned FSMap version 27 2023-10-18T14:05:24.460 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8e11916b80 1 -- 172.21.15.114:0/1621220177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f8e001a38a0 con 0x55bb48acb630 2023-10-18T14:05:24.460 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.438+0000 7f8de2ff5700 1 -- 172.21.15.114:0/1621220177 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bb48a1de90 con 0x55bb48acb630 2023-10-18T14:05:24.460 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.439+0000 7f8de2ff5700 1 -- 172.21.15.114:0/1621220177 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f8df4027720 con 0x55bb48acb630 2023-10-18T14:05:24.460 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.439+0000 7f8e11916b80 10 client.16098 fetch_fsmap finished waiting for FSMap version 27 2023-10-18T14:05:24.461 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.439+0000 7f8e11916b80 10 client.16098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:24.461 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.439+0000 7f8e11916b80 20 client.16098 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:24.461 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.439+0000 7f8e11916b80 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb48adf6f0 0x55bb48ae1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.461 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.439+0000 7f8e11916b80 4 client.16098 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:24.461 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.439+0000 7f8e11916b80 1 -- 172.21.15.114:0/1621220177 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb48a95850 con 0x55bb48adf6f0 2023-10-18T14:05:24.462 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.439+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb48adf6f0 0x55bb48ae1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.462 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.439+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb48adf6f0 0x55bb48ae1b10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fa5c7f99b412ecb server_cookie=2f8d20fc76ad7290 in_seq=0 out_seq=0 2023-10-18T14:05:24.462 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.439+0000 7f8de2ff5700 10 client.16098 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:24.462 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8de2ff5700 1 -- 172.21.15.114:0/1621220177 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bb48a95850 con 0x55bb48adf6f0 2023-10-18T14:05:24.462 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8de2ff5700 10 client.16098 handle_command_reply: tid=0 2023-10-18T14:05:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8e11916b80 1 client.16098 shutdown 2023-10-18T14:05:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8e11916b80 1 -- 172.21.15.114:0/1621220177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 msgr2=0x55bb48acf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8e11916b80 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 0x55bb48acf180 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8df4004580 tx=0x7f8df40047c0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8e11916b80 1 -- 172.21.15.114:0/1621220177 shutdown_connections 2023-10-18T14:05:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8e11916b80 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb48adf6f0 0x55bb48ae1b10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8e11916b80 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acbf50 0x55bb48acf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8e11916b80 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48ac6410 0x55bb48ad1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8de2ff5700 0 client.16098 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8e11916b80 1 --2- 172.21.15.114:0/1621220177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 0x55bb48acf180 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8e11916b80 1 -- 172.21.15.114:0/1621220177 >> 172.21.15.114:0/1621220177 conn(0x55bb48a3a6c0 msgr2=0x55bb48abfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:24.465 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8e11916b80 1 -- 172.21.15.114:0/1621220177 shutdown_connections 2023-10-18T14:05:24.465 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8e11916b80 1 -- 172.21.15.114:0/1621220177 wait complete. 2023-10-18T14:05:24.465 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.442+0000 7f8e11916b80 20 client.16098 trim_cache size 0 max 16384 2023-10-18T14:05:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.456+0000 7f8e11916b80 1 Processor -- start 2023-10-18T14:05:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.456+0000 7f8e11916b80 1 -- start start 2023-10-18T14:05:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8e11916b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48ac6410 0x55bb48acf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8e11916b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 0x55bb48ad66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.471 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8e11916b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acbf50 0x55bb48ac04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.471 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8e11916b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb488998c0 con 0x55bb48acb630 2023-10-18T14:05:24.471 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8e11916b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb48ad2440 con 0x55bb48acbf50 2023-10-18T14:05:24.471 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8e11916b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb48ad6be0 con 0x55bb48ac6410 2023-10-18T14:05:24.471 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8dfe7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 0x55bb48ad66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8dfe7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 0x55bb48ad66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45300/0 (socket says 172.21.15.114:45300) 2023-10-18T14:05:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8dfe7fc700 1 -- 172.21.15.114:0/2875172010 learned_addr learned my addr 172.21.15.114:0/2875172010 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/2875172010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48ac6410 0x55bb48acf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8dff7fe700 1 --2- 172.21.15.114:0/2875172010 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acbf50 0x55bb48ac04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8dfe7fc700 1 -- 172.21.15.114:0/2875172010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48ac6410 msgr2=0x55bb48acf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8dfe7fc700 1 --2- 172.21.15.114:0/2875172010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48ac6410 0x55bb48acf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.473 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8dfe7fc700 1 -- 172.21.15.114:0/2875172010 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acbf50 msgr2=0x55bb48ac04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:24.473 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8dfe7fc700 1 --2- 172.21.15.114:0/2875172010 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acbf50 0x55bb48ac04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.473 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8dfe7fc700 1 -- 172.21.15.114:0/2875172010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb48843d80 con 0x55bb48acb630 2023-10-18T14:05:24.473 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/2875172010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48ac6410 0x55bb48acf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:24.473 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8dff7fe700 1 --2- 172.21.15.114:0/2875172010 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acbf50 0x55bb48ac04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:24.474 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8dfe7fc700 1 --2- 172.21.15.114:0/2875172010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 0x55bb48ad66a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8df40097c0 tx=0x7f8df40093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52418fced38bd9cf server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:24.474 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8de5ffb700 1 -- 172.21.15.114:0/2875172010 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4022030 con 0x55bb48acb630 2023-10-18T14:05:24.474 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8de5ffb700 1 -- 172.21.15.114:0/2875172010 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8df401dae0 con 0x55bb48acb630 2023-10-18T14:05:24.474 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.457+0000 7f8de5ffb700 1 -- 172.21.15.114:0/2875172010 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4030640 con 0x55bb48acb630 2023-10-18T14:05:24.474 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 -- 172.21.15.114:0/2875172010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 msgr2=0x55bb48ad66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 --2- 172.21.15.114:0/2875172010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 0x55bb48ad66a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8df40097c0 tx=0x7f8df40093d0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 -- 172.21.15.114:0/2875172010 shutdown_connections 2023-10-18T14:05:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 --2- 172.21.15.114:0/2875172010 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acbf50 0x55bb48ac04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 --2- 172.21.15.114:0/2875172010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48ac6410 0x55bb48acf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 --2- 172.21.15.114:0/2875172010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48acb630 0x55bb48ad66a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 -- 172.21.15.114:0/2875172010 >> 172.21.15.114:0/2875172010 conn(0x55bb48a3a6c0 msgr2=0x55bb48acda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 -- 172.21.15.114:0/2875172010 shutdown_connections 2023-10-18T14:05:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 -- 172.21.15.114:0/2875172010 wait complete. 2023-10-18T14:05:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 -- start start 2023-10-18T14:05:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 Processor -- start 2023-10-18T14:05:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 0x55bb48ad2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acb630 0x55bb48ad2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acbf50 0x55bb48b324d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb48b32a10 con 0x55bb48ac6410 2023-10-18T14:05:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb48b32b50 con 0x55bb48acb630 2023-10-18T14:05:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb48b32d10 con 0x55bb48acbf50 2023-10-18T14:05:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.458+0000 7f8e11916b80 10 client.0 _ll_register_callbacks cb 0x55bb488ffa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8dfeffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 0x55bb48ad2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8dfeffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 0x55bb48ad2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45304/0 (socket says 172.21.15.114:45304) 2023-10-18T14:05:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8dfeffd700 1 -- 172.21.15.114:0/3014458852 learned_addr learned my addr 172.21.15.114:0/3014458852 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8dff7fe700 1 --2- 172.21.15.114:0/3014458852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acbf50 0x55bb48b324d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8dfe7fc700 1 --2- 172.21.15.114:0/3014458852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acb630 0x55bb48ad2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8dfeffd700 1 -- 172.21.15.114:0/3014458852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acbf50 msgr2=0x55bb48b324d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/3014458852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acbf50 0x55bb48b324d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8dfeffd700 1 -- 172.21.15.114:0/3014458852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acb630 msgr2=0x55bb48ad2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/3014458852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acb630 0x55bb48ad2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8dfeffd700 1 -- 172.21.15.114:0/3014458852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e001a38a0 con 0x55bb48ac6410 2023-10-18T14:05:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8dfeffd700 1 --2- 172.21.15.114:0/3014458852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 0x55bb48ad2890 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8df0097c60 tx=0x7f8df0021c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861d5da4cb6a9429 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8de2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8de2ff5700 1 -- 172.21.15.114:0/3014458852 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df00a3570 con 0x55bb48ac6410 2023-10-18T14:05:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8de2ff5700 1 -- 172.21.15.114:0/3014458852 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8df009b8f0 con 0x55bb48ac6410 2023-10-18T14:05:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8e11916b80 1 -- 172.21.15.114:0/3014458852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8df009ab50 con 0x55bb48ac6410 2023-10-18T14:05:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8de2ff5700 1 -- 172.21.15.114:0/3014458852 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8df009f170 con 0x55bb48ac6410 2023-10-18T14:05:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8e11916b80 10 client.16104 fetch_fsmap learned FSMap version 27 2023-10-18T14:05:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8e11916b80 1 -- 172.21.15.114:0/3014458852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bb4882cc00 con 0x55bb48ac6410 2023-10-18T14:05:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.459+0000 7f8de2ff5700 1 -- 172.21.15.114:0/3014458852 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8df00a7020 con 0x55bb48ac6410 2023-10-18T14:05:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.460+0000 7f8de2ff5700 1 -- 172.21.15.114:0/3014458852 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f8df009a6e0 con 0x55bb48ac6410 2023-10-18T14:05:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.460+0000 7f8e11916b80 10 client.16104 fetch_fsmap finished waiting for FSMap version 27 2023-10-18T14:05:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.460+0000 7f8e11916b80 10 client.16104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.460+0000 7f8e11916b80 20 client.16104 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.460+0000 7f8e11916b80 1 --2- 172.21.15.114:0/3014458852 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb48adf6f0 0x55bb48b36140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.460+0000 7f8e11916b80 4 client.16104 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:05:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.460+0000 7f8e11916b80 1 -- 172.21.15.114:0/3014458852 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bb48a11df0 con 0x55bb48adf6f0 2023-10-18T14:05:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.460+0000 7f8dfe7fc700 1 --2- 172.21.15.114:0/3014458852 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb48adf6f0 0x55bb48b36140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.460+0000 7f8dfe7fc700 1 --2- 172.21.15.114:0/3014458852 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb48adf6f0 0x55bb48b36140 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4991463e9b18549 server_cookie=e9efdd93ddbc8ae1 in_seq=0 out_seq=0 2023-10-18T14:05:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:24.460+0000 7f8de2ff5700 10 client.16104 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:24.559 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:24 smithi172 ceph-mon[103574]: pgmap v321: 97 pgs: 97 active+clean; 26 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.8 MiB/s wr, 319 op/s 2023-10-18T14:05:24.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:24 smithi114 ceph-mon[99494]: pgmap v321: 97 pgs: 97 active+clean; 26 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.8 MiB/s wr, 319 op/s 2023-10-18T14:05:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:24 smithi158 ceph-mon[103317]: pgmap v321: 97 pgs: 97 active+clean; 26 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.8 MiB/s wr, 319 op/s 2023-10-18T14:05:27.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:26 smithi158 ceph-mon[103317]: pgmap v322: 97 pgs: 97 active+clean; 30 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.4 MiB/s wr, 128 op/s 2023-10-18T14:05:27.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:26 smithi172 ceph-mon[103574]: pgmap v322: 97 pgs: 97 active+clean; 30 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.4 MiB/s wr, 128 op/s 2023-10-18T14:05:27.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:26 smithi114 ceph-mon[99494]: pgmap v322: 97 pgs: 97 active+clean; 30 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.4 MiB/s wr, 128 op/s 2023-10-18T14:05:28.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:27 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:28.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:27 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:28.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:27 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:28.423 INFO:tasks.workunit.client.0.smithi114.stderr:Note: switching to '12973fc04fd10d4af086901e10ffa8e48866b735'. 2023-10-18T14:05:28.424 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:28.424 INFO:tasks.workunit.client.0.smithi114.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-18T14:05:28.424 INFO:tasks.workunit.client.0.smithi114.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-18T14:05:28.424 INFO:tasks.workunit.client.0.smithi114.stderr:state without impacting any branches by switching back to a branch. 2023-10-18T14:05:28.424 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:28.425 INFO:tasks.workunit.client.0.smithi114.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-18T14:05:28.425 INFO:tasks.workunit.client.0.smithi114.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-18T14:05:28.425 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:28.425 INFO:tasks.workunit.client.0.smithi114.stderr: git switch -c 2023-10-18T14:05:28.425 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:28.426 INFO:tasks.workunit.client.0.smithi114.stderr:Or undo this operation with: 2023-10-18T14:05:28.426 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:28.426 INFO:tasks.workunit.client.0.smithi114.stderr: git switch - 2023-10-18T14:05:28.426 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:28.426 INFO:tasks.workunit.client.0.smithi114.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-18T14:05:28.427 INFO:tasks.workunit.client.0.smithi114.stderr: 2023-10-18T14:05:28.427 INFO:tasks.workunit.client.0.smithi114.stderr:HEAD is now at 12973fc0 btrfs/022: Correct seq number in golden output 2023-10-18T14:05:28.427 INFO:tasks.workunit.client.0.smithi114.stderr:+ make -j4 2023-10-18T14:05:28.436 INFO:tasks.workunit.client.0.smithi114.stdout:libtoolize -cfi 2023-10-18T14:05:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8de2ff5700 1 -- 172.21.15.114:0/3014458852 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bb48a11df0 con 0x55bb48adf6f0 2023-10-18T14:05:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8de2ff5700 10 client.16104 handle_command_reply: tid=0 2023-10-18T14:05:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e11916b80 1 client.16104 shutdown 2023-10-18T14:05:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e11916b80 1 -- 172.21.15.114:0/3014458852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 msgr2=0x55bb48ad2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e11916b80 1 --2- 172.21.15.114:0/3014458852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 0x55bb48ad2890 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8df0097c60 tx=0x7f8df0021c60 comp rx=0 tx=0).stop 2023-10-18T14:05:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e11916b80 1 -- 172.21.15.114:0/3014458852 shutdown_connections 2023-10-18T14:05:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e11916b80 1 --2- 172.21.15.114:0/3014458852 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb48adf6f0 0x55bb48b36140 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e11916b80 1 --2- 172.21.15.114:0/3014458852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb48acbf50 0x55bb48b324d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8de2ff5700 0 client.16104 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e11916b80 1 --2- 172.21.15.114:0/3014458852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb48ac6410 0x55bb48ad2890 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e11916b80 1 --2- 172.21.15.114:0/3014458852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb48acb630 0x55bb48ad2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e11916b80 1 -- 172.21.15.114:0/3014458852 >> 172.21.15.114:0/3014458852 conn(0x55bb48a3a6c0 msgr2=0x55bb48adae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e11916b80 1 -- 172.21.15.114:0/3014458852 shutdown_connections 2023-10-18T14:05:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e11916b80 1 -- 172.21.15.114:0/3014458852 wait complete. 2023-10-18T14:05:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e11916b80 20 client.16104 trim_cache size 0 max 16384 2023-10-18T14:05:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:05:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:05:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:05:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:05:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e0572d700 1 -- 172.21.15.114:0/1664039789 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8de80a15f0 msgr2=0x7f8de80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e0572d700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8de80a15f0 0x7f8de80a3ab0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8e00197ba0 tx=0x7f8df4009260 comp rx=0 tx=0).stop 2023-10-18T14:05:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e0572d700 1 -- 172.21.15.114:0/1664039789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e000ff020 msgr2=0x7f8e0019c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.730+0000 7f8e0572d700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e000ff020 0x7f8e0019c8b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8df0000c00 tx=0x7f8df0009580 comp rx=0 tx=0).stop 2023-10-18T14:05:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.731+0000 7f8e0572d700 1 -- 172.21.15.114:0/1664039789 shutdown_connections 2023-10-18T14:05:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.731+0000 7f8e0572d700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8de80a15f0 0x7f8de80a3ab0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.731+0000 7f8e0572d700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e00105880 0x7f8e001969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.731+0000 7f8e0572d700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e000ff020 0x7f8e0019c8b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.731+0000 7f8e0572d700 1 --2- 172.21.15.114:0/1664039789 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e000ff9e0 0x7f8e0019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.731+0000 7f8e0572d700 1 -- 172.21.15.114:0/1664039789 >> 172.21.15.114:0/1664039789 conn(0x7f8e00074970 msgr2=0x7f8e000fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.731+0000 7f8e0572d700 1 -- 172.21.15.114:0/1664039789 shutdown_connections 2023-10-18T14:05:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:28.731+0000 7f8e0572d700 1 -- 172.21.15.114:0/1664039789 wait complete. 2023-10-18T14:05:28.802 INFO:tasks.workunit.client.0.smithi114.stdout:libtoolize: putting auxiliary files in '.'. 2023-10-18T14:05:28.802 INFO:tasks.workunit.client.0.smithi114.stdout:libtoolize: copying file './config.guess' 2023-10-18T14:05:28.805 INFO:tasks.workunit.client.0.smithi114.stdout:libtoolize: copying file './config.sub' 2023-10-18T14:05:28.809 INFO:tasks.workunit.client.0.smithi114.stdout:libtoolize: copying file './install-sh' 2023-10-18T14:05:28.813 INFO:tasks.workunit.client.0.smithi114.stdout:libtoolize: copying file './ltmain.sh' 2023-10-18T14:05:28.884 INFO:tasks.workunit.client.0.smithi114.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-10-18T14:05:28.885 INFO:tasks.workunit.client.0.smithi114.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-10-18T14:05:28.906 INFO:tasks.workunit.client.0.smithi114.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-10-18T14:05:28.916 INFO:tasks.workunit.client.0.smithi114.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-10-18T14:05:28.927 INFO:tasks.workunit.client.0.smithi114.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-10-18T14:05:28.937 INFO:tasks.workunit.client.0.smithi114.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-10-18T14:05:28.943 INFO:tasks.workunit.client.0.smithi114.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-10-18T14:05:28.944 INFO:tasks.workunit.client.0.smithi114.stdout:cp include/install-sh . 2023-10-18T14:05:28.951 INFO:tasks.workunit.client.0.smithi114.stdout:aclocal -I m4 2023-10-18T14:05:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:28 smithi158 ceph-mon[103317]: pgmap v323: 97 pgs: 97 active+clean; 33 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 64 op/s 2023-10-18T14:05:29.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:28 smithi172 ceph-mon[103574]: pgmap v323: 97 pgs: 97 active+clean; 33 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 64 op/s 2023-10-18T14:05:29.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:28 smithi114 ceph-mon[99494]: pgmap v323: 97 pgs: 97 active+clean; 33 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 64 op/s 2023-10-18T14:05:30.683 INFO:tasks.workunit.client.0.smithi114.stdout:autoheader 2023-10-18T14:05:30.995 INFO:tasks.workunit.client.0.smithi114.stdout:autoconf 2023-10-18T14:05:31.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:30 smithi158 ceph-mon[103317]: pgmap v324: 97 pgs: 97 active+clean; 40 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 310 op/s 2023-10-18T14:05:31.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:30 smithi172 ceph-mon[103574]: pgmap v324: 97 pgs: 97 active+clean; 40 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 310 op/s 2023-10-18T14:05:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:30 smithi114 ceph-mon[99494]: pgmap v324: 97 pgs: 97 active+clean; 40 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 310 op/s 2023-10-18T14:05:31.159 INFO:tasks.workunit.client.0.smithi114.stdout:./configure \ 2023-10-18T14:05:31.160 INFO:tasks.workunit.client.0.smithi114.stdout: --libexecdir=/usr/lib \ 2023-10-18T14:05:31.160 INFO:tasks.workunit.client.0.smithi114.stdout: --exec_prefix=/var/lib 2023-10-18T14:05:31.317 INFO:tasks.workunit.client.0.smithi114.stdout:checking build system type... x86_64-pc-linux-gnu 2023-10-18T14:05:31.318 INFO:tasks.workunit.client.0.smithi114.stdout:checking host system type... x86_64-pc-linux-gnu 2023-10-18T14:05:31.318 INFO:tasks.workunit.client.0.smithi114.stdout:checking how to print strings... printf 2023-10-18T14:05:31.319 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gcc... gcc 2023-10-18T14:05:31.391 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether the C compiler works... yes 2023-10-18T14:05:31.391 INFO:tasks.workunit.client.0.smithi114.stdout:checking for C compiler default output file name... a.out 2023-10-18T14:05:31.428 INFO:tasks.workunit.client.0.smithi114.stdout:checking for suffix of executables... 2023-10-18T14:05:31.466 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether we are cross compiling... no 2023-10-18T14:05:31.505 INFO:tasks.workunit.client.0.smithi114.stdout:checking for suffix of object files... o 2023-10-18T14:05:31.529 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether we are using the GNU C compiler... yes 2023-10-18T14:05:31.549 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether gcc accepts -g... yes 2023-10-18T14:05:31.586 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gcc option to accept ISO C89... none needed 2023-10-18T14:05:31.589 INFO:tasks.workunit.client.0.smithi114.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-10-18T14:05:31.592 INFO:tasks.workunit.client.0.smithi114.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-10-18T14:05:31.594 INFO:tasks.workunit.client.0.smithi114.stdout:checking for egrep... /usr/bin/grep -E 2023-10-18T14:05:31.595 INFO:tasks.workunit.client.0.smithi114.stdout:checking for fgrep... /usr/bin/grep -F 2023-10-18T14:05:31.598 INFO:tasks.workunit.client.0.smithi114.stdout:checking for ld used by gcc... /usr/bin/ld 2023-10-18T14:05:31.599 INFO:tasks.workunit.client.0.smithi114.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-10-18T14:05:31.606 INFO:tasks.workunit.client.0.smithi114.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-10-18T14:05:31.650 INFO:tasks.workunit.client.0.smithi114.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-10-18T14:05:31.650 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether ln -s works... yes 2023-10-18T14:05:31.658 INFO:tasks.workunit.client.0.smithi114.stdout:checking the maximum length of command line arguments... 1572864 2023-10-18T14:05:31.661 INFO:tasks.workunit.client.0.smithi114.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-10-18T14:05:31.661 INFO:tasks.workunit.client.0.smithi114.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-10-18T14:05:31.662 INFO:tasks.workunit.client.0.smithi114.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-10-18T14:05:31.662 INFO:tasks.workunit.client.0.smithi114.stdout:checking for objdump... objdump 2023-10-18T14:05:31.663 INFO:tasks.workunit.client.0.smithi114.stdout:checking how to recognize dependent libraries... pass_all 2023-10-18T14:05:31.663 INFO:tasks.workunit.client.0.smithi114.stdout:checking for dlltool... no 2023-10-18T14:05:31.663 INFO:tasks.workunit.client.0.smithi114.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-10-18T14:05:31.663 INFO:tasks.workunit.client.0.smithi114.stdout:checking for ar... ar 2023-10-18T14:05:31.821 INFO:tasks.workunit.client.0.smithi114.stdout:checking for archiver @FILE support... @ 2023-10-18T14:05:31.822 INFO:tasks.workunit.client.0.smithi114.stdout:checking for strip... strip 2023-10-18T14:05:31.823 INFO:tasks.workunit.client.0.smithi114.stdout:checking for ranlib... ranlib 2023-10-18T14:05:31.823 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gawk... gawk 2023-10-18T14:05:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:32 smithi158 ceph-mon[103317]: pgmap v325: 97 pgs: 97 active+clean; 32 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 427 op/s 2023-10-18T14:05:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:32 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:33.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:32 smithi172 ceph-mon[103574]: pgmap v325: 97 pgs: 97 active+clean; 32 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 427 op/s 2023-10-18T14:05:33.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:32 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:33.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:32 smithi114 ceph-mon[99494]: pgmap v325: 97 pgs: 97 active+clean; 32 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 427 op/s 2023-10-18T14:05:33.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:32 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:34.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:34 smithi114 ceph-mon[99494]: pgmap v326: 97 pgs: 97 active+clean; 38 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 1.12k op/s 2023-10-18T14:05:34.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:34 smithi158 ceph-mon[103317]: pgmap v326: 97 pgs: 97 active+clean; 38 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 1.12k op/s 2023-10-18T14:05:34.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:34 smithi172 ceph-mon[103574]: pgmap v326: 97 pgs: 97 active+clean; 38 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 1.12k op/s 2023-10-18T14:05:35.326 INFO:tasks.workunit.client.0.smithi114.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-10-18T14:05:35.328 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sysroot... no 2023-10-18T14:05:35.338 INFO:tasks.workunit.client.0.smithi114.stdout:checking for a working dd... /usr/bin/dd 2023-10-18T14:05:35.348 INFO:tasks.workunit.client.0.smithi114.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-10-18T14:05:35.855 INFO:tasks.workunit.client.0.smithi114.stdout:checking for mt... no 2023-10-18T14:05:35.874 INFO:tasks.workunit.client.0.smithi114.stdout:checking if : is a manifest tool... no 2023-10-18T14:05:35.969 INFO:tasks.workunit.client.0.smithi114.stdout:checking how to run the C preprocessor... gcc -E 2023-10-18T14:05:36.317 INFO:tasks.workunit.client.0.smithi114.stdout:checking for ANSI C header files... yes 2023-10-18T14:05:36.430 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/types.h... yes 2023-10-18T14:05:36.488 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/stat.h... yes 2023-10-18T14:05:36.571 INFO:tasks.workunit.client.0.smithi114.stdout:checking for stdlib.h... yes 2023-10-18T14:05:36.624 INFO:tasks.workunit.client.0.smithi114.stdout:checking for string.h... yes 2023-10-18T14:05:36.722 INFO:tasks.workunit.client.0.smithi114.stdout:checking for memory.h... yes 2023-10-18T14:05:36.779 INFO:tasks.workunit.client.0.smithi114.stdout:checking for strings.h... yes 2023-10-18T14:05:36.832 INFO:tasks.workunit.client.0.smithi114.stdout:checking for inttypes.h... yes 2023-10-18T14:05:36.878 INFO:tasks.workunit.client.0.smithi114.stdout:checking for stdint.h... yes 2023-10-18T14:05:36.915 INFO:tasks.workunit.client.0.smithi114.stdout:checking for unistd.h... yes 2023-10-18T14:05:36.979 INFO:tasks.workunit.client.0.smithi114.stdout:checking for dlfcn.h... yes 2023-10-18T14:05:36.985 INFO:tasks.workunit.client.0.smithi114.stdout:checking for objdir... .libs 2023-10-18T14:05:37.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:36 smithi158 ceph-mon[103317]: pgmap v327: 97 pgs: 97 active+clean; 43 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 1.25k op/s 2023-10-18T14:05:37.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:36 smithi172 ceph-mon[103574]: pgmap v327: 97 pgs: 97 active+clean; 43 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 1.25k op/s 2023-10-18T14:05:37.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:36 smithi114 ceph-mon[99494]: pgmap v327: 97 pgs: 97 active+clean; 43 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 1.25k op/s 2023-10-18T14:05:37.096 INFO:tasks.workunit.client.0.smithi114.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-10-18T14:05:37.096 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-10-18T14:05:37.131 INFO:tasks.workunit.client.0.smithi114.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-10-18T14:05:37.192 INFO:tasks.workunit.client.0.smithi114.stdout:checking if gcc static flag -static works... no 2023-10-18T14:05:37.252 INFO:tasks.workunit.client.0.smithi114.stdout:checking if gcc supports -c -o file.o... yes 2023-10-18T14:05:37.253 INFO:tasks.workunit.client.0.smithi114.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-10-18T14:05:37.258 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-10-18T14:05:37.311 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether -lc should be explicitly linked in... no 2023-10-18T14:05:37.386 INFO:tasks.workunit.client.0.smithi114.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-10-18T14:05:37.387 INFO:tasks.workunit.client.0.smithi114.stdout:checking how to hardcode library paths into programs... immediate 2023-10-18T14:05:37.394 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether stripping libraries is possible... yes 2023-10-18T14:05:37.394 INFO:tasks.workunit.client.0.smithi114.stdout:checking if libtool supports shared libraries... yes 2023-10-18T14:05:37.394 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether to build shared libraries... yes 2023-10-18T14:05:37.395 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether to build static libraries... yes 2023-10-18T14:05:37.399 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gcc... (cached) gcc 2023-10-18T14:05:37.424 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-10-18T14:05:37.424 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-18T14:05:37.425 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-10-18T14:05:37.425 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gmake... /usr/bin/gmake 2023-10-18T14:05:37.425 INFO:tasks.workunit.client.0.smithi114.stderr:./configure: line 11956: test: $(SHELL): binary operator expected 2023-10-18T14:05:37.426 INFO:tasks.workunit.client.0.smithi114.stdout:checking for tar... /bin/tar 2023-10-18T14:05:37.426 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gzip... /bin/gzip 2023-10-18T14:05:37.433 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether gcc -MM is supported... yes 2023-10-18T14:05:37.434 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sort... /bin/sort 2023-10-18T14:05:37.434 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether ln -s works... yes 2023-10-18T14:05:37.435 INFO:tasks.workunit.client.0.smithi114.stdout:checking for rpm... /bin/rpm 2023-10-18T14:05:37.438 INFO:tasks.workunit.client.0.smithi114.stdout:checking for rpmbuild... no 2023-10-18T14:05:37.438 INFO:tasks.workunit.client.0.smithi114.stdout:checking for ANSI C header files... (cached) yes 2023-10-18T14:05:37.510 INFO:tasks.workunit.client.0.smithi114.stdout:checking assert.h usability... yes 2023-10-18T14:05:37.520 INFO:tasks.workunit.client.0.smithi114.stdout:checking assert.h presence... yes 2023-10-18T14:05:37.520 INFO:tasks.workunit.client.0.smithi114.stdout:checking for assert.h... yes 2023-10-18T14:05:37.567 INFO:tasks.workunit.client.0.smithi114.stdout:checking bstring.h usability... no 2023-10-18T14:05:37.589 INFO:tasks.workunit.client.0.smithi114.stdout:checking bstring.h presence... no 2023-10-18T14:05:37.589 INFO:tasks.workunit.client.0.smithi114.stdout:checking for bstring.h... no 2023-10-18T14:05:37.625 INFO:tasks.workunit.client.0.smithi114.stdout:checking libgen.h usability... yes 2023-10-18T14:05:37.635 INFO:tasks.workunit.client.0.smithi114.stdout:checking libgen.h presence... yes 2023-10-18T14:05:37.636 INFO:tasks.workunit.client.0.smithi114.stdout:checking for libgen.h... yes 2023-10-18T14:05:37.689 INFO:tasks.workunit.client.0.smithi114.stdout:checking dirent.h usability... yes 2023-10-18T14:05:37.700 INFO:tasks.workunit.client.0.smithi114.stdout:checking dirent.h presence... yes 2023-10-18T14:05:37.701 INFO:tasks.workunit.client.0.smithi114.stdout:checking for dirent.h... yes 2023-10-18T14:05:37.742 INFO:tasks.workunit.client.0.smithi114.stdout:checking errno.h usability... yes 2023-10-18T14:05:37.753 INFO:tasks.workunit.client.0.smithi114.stdout:checking errno.h presence... yes 2023-10-18T14:05:37.754 INFO:tasks.workunit.client.0.smithi114.stdout:checking for errno.h... yes 2023-10-18T14:05:37.798 INFO:tasks.workunit.client.0.smithi114.stdout:checking malloc.h usability... yes 2023-10-18T14:05:37.809 INFO:tasks.workunit.client.0.smithi114.stdout:checking malloc.h presence... yes 2023-10-18T14:05:37.810 INFO:tasks.workunit.client.0.smithi114.stdout:checking for malloc.h... yes 2023-10-18T14:05:37.854 INFO:tasks.workunit.client.0.smithi114.stdout:checking uuid.h usability... no 2023-10-18T14:05:37.875 INFO:tasks.workunit.client.0.smithi114.stdout:checking uuid.h presence... no 2023-10-18T14:05:37.875 INFO:tasks.workunit.client.0.smithi114.stdout:checking for uuid.h... no 2023-10-18T14:05:37.914 INFO:tasks.workunit.client.0.smithi114.stdout:checking uuid/uuid.h usability... yes 2023-10-18T14:05:37.927 INFO:tasks.workunit.client.0.smithi114.stdout:checking uuid/uuid.h presence... yes 2023-10-18T14:05:37.927 INFO:tasks.workunit.client.0.smithi114.stdout:checking for uuid/uuid.h... yes 2023-10-18T14:05:37.977 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/uuid.h usability... no 2023-10-18T14:05:37.999 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/uuid.h presence... no 2023-10-18T14:05:38.000 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/uuid.h... no 2023-10-18T14:05:38.047 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/file.h usability... yes 2023-10-18T14:05:38.058 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/file.h presence... yes 2023-10-18T14:05:38.058 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/file.h... yes 2023-10-18T14:05:38.105 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/fcntl.h usability... yes 2023-10-18T14:05:38.116 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/fcntl.h presence... yes 2023-10-18T14:05:38.116 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/fcntl.h... yes 2023-10-18T14:05:38.165 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/syssgi.h usability... no 2023-10-18T14:05:38.188 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/syssgi.h presence... no 2023-10-18T14:05:38.188 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/syssgi.h... no 2023-10-18T14:05:38.254 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/param.h usability... yes 2023-10-18T14:05:38.267 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/param.h presence... yes 2023-10-18T14:05:38.268 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/param.h... yes 2023-10-18T14:05:38.282 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/stat.h... (cached) yes 2023-10-18T14:05:38.315 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/statvfs.h usability... yes 2023-10-18T14:05:38.326 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/statvfs.h presence... yes 2023-10-18T14:05:38.326 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/statvfs.h... yes 2023-10-18T14:05:38.370 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/time.h usability... yes 2023-10-18T14:05:38.381 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/time.h presence... yes 2023-10-18T14:05:38.382 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/time.h... yes 2023-10-18T14:05:38.426 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/ioctl.h usability... yes 2023-10-18T14:05:38.437 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/ioctl.h presence... yes 2023-10-18T14:05:38.437 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/ioctl.h... yes 2023-10-18T14:05:38.487 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/wait.h usability... yes 2023-10-18T14:05:38.499 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/wait.h presence... yes 2023-10-18T14:05:38.499 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/wait.h... yes 2023-10-18T14:05:38.513 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/types.h... (cached) yes 2023-10-18T14:05:38.517 INFO:tasks.workunit.client.0.smithi114.stdout:checking for strings.h... (cached) yes 2023-10-18T14:05:38.550 INFO:tasks.workunit.client.0.smithi114.stdout:checking err.h usability... yes 2023-10-18T14:05:38.561 INFO:tasks.workunit.client.0.smithi114.stdout:checking err.h presence... yes 2023-10-18T14:05:38.561 INFO:tasks.workunit.client.0.smithi114.stdout:checking for err.h... yes 2023-10-18T14:05:38.604 INFO:tasks.workunit.client.0.smithi114.stdout:checking linux/falloc.h usability... yes 2023-10-18T14:05:38.616 INFO:tasks.workunit.client.0.smithi114.stdout:checking linux/falloc.h presence... yes 2023-10-18T14:05:38.616 INFO:tasks.workunit.client.0.smithi114.stdout:checking for linux/falloc.h... yes 2023-10-18T14:05:38.662 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-10-18T14:05:38.682 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-10-18T14:05:38.683 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/fs/xfs_fsops.h... no 2023-10-18T14:05:38.723 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/fs/xfs_itable.h usability... no 2023-10-18T14:05:38.744 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/fs/xfs_itable.h presence... no 2023-10-18T14:05:38.744 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/fs/xfs_itable.h... no 2023-10-18T14:05:38.783 INFO:tasks.workunit.client.0.smithi114.stdout:checking xfs/platform_defs.h usability... no 2023-10-18T14:05:38.805 INFO:tasks.workunit.client.0.smithi114.stdout:checking xfs/platform_defs.h presence... no 2023-10-18T14:05:38.805 INFO:tasks.workunit.client.0.smithi114.stdout:checking for xfs/platform_defs.h... no 2023-10-18T14:05:38.845 INFO:tasks.workunit.client.0.smithi114.stdout:checking btrfs/ioctl.h usability... no 2023-10-18T14:05:38.865 INFO:tasks.workunit.client.0.smithi114.stdout:checking btrfs/ioctl.h presence... no 2023-10-18T14:05:38.865 INFO:tasks.workunit.client.0.smithi114.stdout:checking for btrfs/ioctl.h... no 2023-10-18T14:05:38.906 INFO:tasks.workunit.client.0.smithi114.stdout:checking cifs/ioctl.h usability... no 2023-10-18T14:05:38.927 INFO:tasks.workunit.client.0.smithi114.stdout:checking cifs/ioctl.h presence... no 2023-10-18T14:05:38.927 INFO:tasks.workunit.client.0.smithi114.stdout:checking for cifs/ioctl.h... no 2023-10-18T14:05:38.964 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/mman.h usability... yes 2023-10-18T14:05:38.975 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/mman.h presence... yes 2023-10-18T14:05:38.975 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/mman.h... yes 2023-10-18T14:05:39.009 INFO:tasks.workunit.client.0.smithi114.stdout:checking for xfs/xfs_log_format.h... no 2023-10-18T14:05:39.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:38 smithi158 ceph-mon[103317]: pgmap v328: 97 pgs: 97 active+clean; 48 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 1.37k op/s 2023-10-18T14:05:39.056 INFO:tasks.workunit.client.0.smithi114.stdout:checking for uuid_compare... no 2023-10-18T14:05:39.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:38 smithi172 ceph-mon[103574]: pgmap v328: 97 pgs: 97 active+clean; 48 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 1.37k op/s 2023-10-18T14:05:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:38 smithi114 ceph-mon[99494]: pgmap v328: 97 pgs: 97 active+clean; 48 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 1.37k op/s 2023-10-18T14:05:39.091 INFO:tasks.workunit.client.0.smithi114.stdout:checking for uuid_compare in -luuid... yes 2023-10-18T14:05:39.153 INFO:tasks.workunit.client.0.smithi114.stdout:checking for xfs/xfs.h... yes 2023-10-18T14:05:39.183 INFO:tasks.workunit.client.0.smithi114.stdout:checking for xfs/libxfs.h... no 2023-10-18T14:05:39.210 INFO:tasks.workunit.client.0.smithi114.stdout:checking whether xlog_assign_lsn is declared... no 2023-10-18T14:05:39.242 INFO:tasks.workunit.client.0.smithi114.stdout:checking for xfs/xqm.h... yes 2023-10-18T14:05:39.287 INFO:tasks.workunit.client.0.smithi114.stdout:checking xfsctl from xfs/xfs.h... ok 2023-10-18T14:05:39.322 INFO:tasks.workunit.client.0.smithi114.stdout:checking xfs/handle.h usability... yes 2023-10-18T14:05:39.333 INFO:tasks.workunit.client.0.smithi114.stdout:checking xfs/handle.h presence... yes 2023-10-18T14:05:39.334 INFO:tasks.workunit.client.0.smithi114.stdout:checking for xfs/handle.h... yes 2023-10-18T14:05:39.376 INFO:tasks.workunit.client.0.smithi114.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-10-18T14:05:39.422 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:05:39.437 INFO:tasks.workunit.client.0.smithi114.stdout:checking attr/attributes.h usability... yes 2023-10-18T14:05:39.448 INFO:tasks.workunit.client.0.smithi114.stdout:checking attr/attributes.h presence... yes 2023-10-18T14:05:39.448 INFO:tasks.workunit.client.0.smithi114.stdout:checking for attr/attributes.h... yes 2023-10-18T14:05:39.492 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/attributes.h usability... no 2023-10-18T14:05:39.511 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/attributes.h presence... no 2023-10-18T14:05:39.511 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/attributes.h... no 2023-10-18T14:05:39.545 INFO:tasks.workunit.client.0.smithi114.stdout:checking for attr_list in -lattr... yes 2023-10-18T14:05:39.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.551+0000 7f0d1fdde700 1 -- 172.21.15.114:0/2738966642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d18106730 msgr2=0x7f0d18106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:39.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.551+0000 7f0d1fdde700 1 --2- 172.21.15.114:0/2738966642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d18106730 0x7f0d18106b10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009990 tx=0x7f0d14009ca0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.551+0000 7f0d1fdde700 1 -- 172.21.15.114:0/2738966642 shutdown_connections 2023-10-18T14:05:39.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.551+0000 7f0d1fdde700 1 --2- 172.21.15.114:0/2738966642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d181010e0 0x7f0d1810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.551+0000 7f0d1fdde700 1 --2- 172.21.15.114:0/2738966642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d18106730 0x7f0d18106b10 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.551+0000 7f0d1fdde700 1 --2- 172.21.15.114:0/2738966642 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d18100720 0x7f0d18100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.551+0000 7f0d1fdde700 1 -- 172.21.15.114:0/2738966642 >> 172.21.15.114:0/2738966642 conn(0x7f0d180fc230 msgr2=0x7f0d180fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:39.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.551+0000 7f0d1fdde700 1 -- 172.21.15.114:0/2738966642 shutdown_connections 2023-10-18T14:05:39.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.551+0000 7f0d1fdde700 1 -- 172.21.15.114:0/2738966642 wait complete. 2023-10-18T14:05:39.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.552+0000 7f0d1fdde700 1 Processor -- start 2023-10-18T14:05:39.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.552+0000 7f0d1fdde700 1 -- start start 2023-10-18T14:05:39.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.552+0000 7f0d1fdde700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d18100720 0x7f0d1819c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.552+0000 7f0d1fdde700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d181010e0 0x7f0d1819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.552+0000 7f0d1fdde700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d18106730 0x7f0d18196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.552+0000 7f0d1fdde700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18196ff0 con 0x7f0d18106730 2023-10-18T14:05:39.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.552+0000 7f0d1fdde700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18197160 con 0x7f0d18100720 2023-10-18T14:05:39.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.552+0000 7f0d1fdde700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18197320 con 0x7f0d181010e0 2023-10-18T14:05:39.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.552+0000 7f0d1e37b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d18106730 0x7f0d18196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.552+0000 7f0d1e37b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d18106730 0x7f0d18196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45334/0 (socket says 172.21.15.114:45334) 2023-10-18T14:05:39.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.552+0000 7f0d1e37b700 1 -- 172.21.15.114:0/1451223062 learned_addr learned my addr 172.21.15.114:0/1451223062 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:39.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.552+0000 7f0d1d379700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d181010e0 0x7f0d1819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.553+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d18100720 0x7f0d1819c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.553+0000 7f0d1e37b700 1 -- 172.21.15.114:0/1451223062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d181010e0 msgr2=0x7f0d1819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:39.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.553+0000 7f0d1e37b700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d181010e0 0x7f0d1819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.553+0000 7f0d1e37b700 1 -- 172.21.15.114:0/1451223062 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d18100720 msgr2=0x7f0d1819c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:39.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.553+0000 7f0d1e37b700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d18100720 0x7f0d1819c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.553+0000 7f0d1e37b700 1 -- 172.21.15.114:0/1451223062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d140095f0 con 0x7f0d18106730 2023-10-18T14:05:39.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.553+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d18100720 0x7f0d1819c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:39.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.553+0000 7f0d1e37b700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d18106730 0x7f0d18196990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000ef30 tx=0x7f0d1000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:39.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.553+0000 7f0d0effd700 1 -- 172.21.15.114:0/1451223062 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10018070 con 0x7f0d18106730 2023-10-18T14:05:39.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.553+0000 7f0d1fdde700 1 -- 172.21.15.114:0/1451223062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d181975a0 con 0x7f0d18106730 2023-10-18T14:05:39.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.553+0000 7f0d0effd700 1 -- 172.21.15.114:0/1451223062 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d1000f040 con 0x7f0d18106730 2023-10-18T14:05:39.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.553+0000 7f0d0effd700 1 -- 172.21.15.114:0/1451223062 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1000cdb0 con 0x7f0d18106730 2023-10-18T14:05:39.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.553+0000 7f0d1fdde700 1 -- 172.21.15.114:0/1451223062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d181a3850 con 0x7f0d18106730 2023-10-18T14:05:39.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.555+0000 7f0d0effd700 1 -- 172.21.15.114:0/1451223062 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f0d10003a00 con 0x7f0d18106730 2023-10-18T14:05:39.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.556+0000 7f0d0effd700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0d040a15f0 0x7f0d040a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.556+0000 7f0d0effd700 1 -- 172.21.15.114:0/1451223062 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0d100ccc50 con 0x7f0d18106730 2023-10-18T14:05:39.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.556+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0d040a15f0 0x7f0d040a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.556+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0d040a15f0 0x7f0d040a3ab0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0d14006010 tx=0x7f0d1400b260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:39.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.557+0000 7f0d2bfc7b80 1 Processor -- start 2023-10-18T14:05:39.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.557+0000 7f0d2bfc7b80 1 -- start start 2023-10-18T14:05:39.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.557+0000 7f0d2bfc7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ebbe0 0x55c8949ebfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.557+0000 7f0d2bfc7b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949ec500 0x55c8949e6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.557+0000 7f0d2bfc7b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949e65d0 0x55c8949e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.557+0000 7f0d2bfc7b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8949596e0 con 0x55c8949e65d0 2023-10-18T14:05:39.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.557+0000 7f0d2bfc7b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89493fc60 con 0x55c8949ec500 2023-10-18T14:05:39.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.557+0000 7f0d2bfc7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89493d580 con 0x55c8949ebbe0 2023-10-18T14:05:39.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.557+0000 7f0d1e37b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949e65d0 0x55c8949e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.557+0000 7f0d1e37b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949e65d0 0x55c8949e6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45342/0 (socket says 172.21.15.114:45342) 2023-10-18T14:05:39.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.557+0000 7f0d1e37b700 1 -- 172.21.15.114:0/1517601122 learned_addr learned my addr 172.21.15.114:0/1517601122 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:39.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.557+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/1517601122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ebbe0 0x55c8949ebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.557+0000 7f0d1d379700 1 --2- 172.21.15.114:0/1517601122 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949ec500 0x55c8949e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.558+0000 7f0d1e37b700 1 -- 172.21.15.114:0/1517601122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ebbe0 msgr2=0x55c8949ebfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:39.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.558+0000 7f0d1e37b700 1 --2- 172.21.15.114:0/1517601122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ebbe0 0x55c8949ebfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.558+0000 7f0d1e37b700 1 -- 172.21.15.114:0/1517601122 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949ec500 msgr2=0x55c8949e6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:39.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.558+0000 7f0d1e37b700 1 --2- 172.21.15.114:0/1517601122 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949ec500 0x55c8949e6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.558+0000 7f0d1e37b700 1 -- 172.21.15.114:0/1517601122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8948f63f0 con 0x55c8949e65d0 2023-10-18T14:05:39.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.558+0000 7f0d1d379700 1 --2- 172.21.15.114:0/1517601122 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949ec500 0x55c8949e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:39.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.558+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/1517601122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ebbe0 0x55c8949ebfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:39.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.558+0000 7f0d1e37b700 1 --2- 172.21.15.114:0/1517601122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949e65d0 0x55c8949e6a50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0d100090a0 tx=0x7f0d10099b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b49fd129ffe55e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:39.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.558+0000 7f0d03fff700 1 -- 172.21.15.114:0/1517601122 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10004ad0 con 0x55c8949e65d0 2023-10-18T14:05:39.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.558+0000 7f0d03fff700 1 -- 172.21.15.114:0/1517601122 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d1001b320 con 0x55c8949e65d0 2023-10-18T14:05:39.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.558+0000 7f0d03fff700 1 -- 172.21.15.114:0/1517601122 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d100a20d0 con 0x55c8949e65d0 2023-10-18T14:05:39.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.559+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/1517601122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949e65d0 msgr2=0x55c8949e6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:39.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.559+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/1517601122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949e65d0 0x55c8949e6a50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0d100090a0 tx=0x7f0d10099b90 comp rx=0 tx=0).stop 2023-10-18T14:05:39.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.559+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/1517601122 shutdown_connections 2023-10-18T14:05:39.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.559+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/1517601122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949e65d0 0x55c8949e6a50 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.559+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/1517601122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ebbe0 0x55c8949ebfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.559+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/1517601122 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949ec500 0x55c8949e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.559+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/1517601122 >> 172.21.15.114:0/1517601122 conn(0x55c89495a720 msgr2=0x55c8949e0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:39.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.559+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/1517601122 shutdown_connections 2023-10-18T14:05:39.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.559+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/1517601122 wait complete. 2023-10-18T14:05:39.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.559+0000 7f0d2bfc7b80 1 -- start start 2023-10-18T14:05:39.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d2bfc7b80 1 Processor -- start 2023-10-18T14:05:39.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d2bfc7b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949e65d0 0x55c8949f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d2bfc7b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949ef810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d2bfc7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ec500 0x55c8949eff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d2bfc7b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c894938e70 con 0x55c8949ebbe0 2023-10-18T14:05:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d2bfc7b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8948d5710 con 0x55c8949e65d0 2023-10-18T14:05:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d2bfc7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8948d53b0 con 0x55c8949ec500 2023-10-18T14:05:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d2bfc7b80 10 client.0 _ll_register_callbacks cb 0x55c89481fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d1d379700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949ef810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d1d379700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949ef810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45346/0 (socket says 172.21.15.114:45346) 2023-10-18T14:05:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d1d379700 1 -- 172.21.15.114:0/2569036210 learned_addr learned my addr 172.21.15.114:0/2569036210 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d1e37b700 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ec500 0x55c8949eff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d1d379700 1 -- 172.21.15.114:0/2569036210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ec500 msgr2=0x55c8949eff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d1d379700 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ec500 0x55c8949eff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d1d379700 1 -- 172.21.15.114:0/2569036210 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949e65d0 msgr2=0x55c8949f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949e65d0 0x55c8949f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d1d379700 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949e65d0 0x55c8949f24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d1d379700 1 -- 172.21.15.114:0/2569036210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1810def0 con 0x55c8949ebbe0 2023-10-18T14:05:39.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.560+0000 7f0d1e37b700 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ec500 0x55c8949eff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:39.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d1d379700 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949ef810 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0d0800bf90 tx=0x7f0d080127e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7479182ba29341f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:39.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d017fa700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:39.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d017fa700 1 -- 172.21.15.114:0/2569036210 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08004440 con 0x55c8949ebbe0 2023-10-18T14:05:39.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d017fa700 1 -- 172.21.15.114:0/2569036210 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0d08004830 con 0x55c8949ebbe0 2023-10-18T14:05:39.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/2569036210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c89493def0 con 0x55c8949ebbe0 2023-10-18T14:05:39.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d017fa700 1 -- 172.21.15.114:0/2569036210 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d080045a0 con 0x55c8949ebbe0 2023-10-18T14:05:39.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d2bfc7b80 10 client.16116 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:39.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/2569036210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f0d181a3850 con 0x55c8949ebbe0 2023-10-18T14:05:39.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d017fa700 1 -- 172.21.15.114:0/2569036210 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c89493def0 con 0x55c8949ebbe0 2023-10-18T14:05:39.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d017fa700 1 -- 172.21.15.114:0/2569036210 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0d08024920 con 0x55c8949ebbe0 2023-10-18T14:05:39.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d2bfc7b80 10 client.16116 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:39.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d2bfc7b80 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:39.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d2bfc7b80 20 client.16116 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:39.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c8949fffd0 0x55c894a023f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d2bfc7b80 4 client.16116 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:39.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.561+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/2569036210 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8949b58b0 con 0x55c8949fffd0 2023-10-18T14:05:39.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.562+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c8949fffd0 0x55c894a023f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.562+0000 7f0d017fa700 10 client.16116 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:39.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.562+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c8949fffd0 0x55c894a023f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=534e3a869c911a6d server_cookie=1eb410270451016b in_seq=0 out_seq=0 2023-10-18T14:05:39.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d017fa700 1 -- 172.21.15.114:0/2569036210 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c8949b58b0 con 0x55c8949fffd0 2023-10-18T14:05:39.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d017fa700 10 client.16116 handle_command_reply: tid=0 2023-10-18T14:05:39.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d2bfc7b80 1 client.16116 shutdown 2023-10-18T14:05:39.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/2569036210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 msgr2=0x55c8949ef810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:39.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949ef810 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0d0800bf90 tx=0x7f0d080127e0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/2569036210 shutdown_connections 2023-10-18T14:05:39.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c8949fffd0 0x55c894a023f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ec500 0x55c8949eff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d017fa700 0 client.16116 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:39.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949e65d0 0x55c8949f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/2569036210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949ef810 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/2569036210 >> 172.21.15.114:0/2569036210 conn(0x55c89495a720 msgr2=0x55c8949e5080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:39.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/2569036210 shutdown_connections 2023-10-18T14:05:39.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/2569036210 wait complete. 2023-10-18T14:05:39.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.563+0000 7f0d2bfc7b80 20 client.16116 trim_cache size 0 max 16384 2023-10-18T14:05:39.588 INFO:tasks.workunit.client.0.smithi114.stdout:checking for attr_set in -lattr... yes 2023-10-18T14:05:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.580+0000 7f0d2bfc7b80 1 Processor -- start 2023-10-18T14:05:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.580+0000 7f0d2bfc7b80 1 -- start start 2023-10-18T14:05:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d2bfc7b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949e65d0 0x55c8949f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d2bfc7b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949f2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d2bfc7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ec500 0x55c8949e0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d2bfc7b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8947b9920 con 0x55c8949ebbe0 2023-10-18T14:05:39.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d2bfc7b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8949edd80 con 0x55c8949e65d0 2023-10-18T14:05:39.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d2bfc7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8949e5ff0 con 0x55c8949ec500 2023-10-18T14:05:39.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d1d379700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d1e37b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ec500 0x55c8949e0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d1d379700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949f2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45354/0 (socket says 172.21.15.114:45354) 2023-10-18T14:05:39.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d1d379700 1 -- 172.21.15.114:0/465845039 learned_addr learned my addr 172.21.15.114:0/465845039 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:39.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/465845039 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949e65d0 0x55c8949f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d1e37b700 1 -- 172.21.15.114:0/465845039 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949e65d0 msgr2=0x55c8949f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d1e37b700 1 --2- 172.21.15.114:0/465845039 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949e65d0 0x55c8949f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d1e37b700 1 -- 172.21.15.114:0/465845039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 msgr2=0x55c8949f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d1e37b700 1 --2- 172.21.15.114:0/465845039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d1e37b700 1 -- 172.21.15.114:0/465845039 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c894763de0 con 0x55c8949ec500 2023-10-18T14:05:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/465845039 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949e65d0 0x55c8949f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.581+0000 7f0d1d379700 1 --2- 172.21.15.114:0/465845039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.582+0000 7f0d1e37b700 1 --2- 172.21.15.114:0/465845039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ec500 0x55c8949e0810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55c8949f2a70 tx=0x7f0d10004dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7b9bb1e26737bf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.582+0000 7f0d0cff9700 1 -- 172.21.15.114:0/465845039 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1009a440 con 0x55c8949ec500 2023-10-18T14:05:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.582+0000 7f0d0cff9700 1 -- 172.21.15.114:0/465845039 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d1009de90 con 0x55c8949ec500 2023-10-18T14:05:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.582+0000 7f0d0cff9700 1 -- 172.21.15.114:0/465845039 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1009a200 con 0x55c8949ec500 2023-10-18T14:05:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.582+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/465845039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ec500 msgr2=0x55c8949e0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.582+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/465845039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ec500 0x55c8949e0810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55c8949f2a70 tx=0x7f0d10004dc0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.582+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/465845039 shutdown_connections 2023-10-18T14:05:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.582+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/465845039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949ec500 0x55c8949e0810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.582+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/465845039 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949e65d0 0x55c8949f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.582+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/465845039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.582+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/465845039 >> 172.21.15.114:0/465845039 conn(0x55c89495a720 msgr2=0x55c8949fb600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.582+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/465845039 shutdown_connections 2023-10-18T14:05:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.582+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/465845039 wait complete. 2023-10-18T14:05:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.583+0000 7f0d2bfc7b80 1 -- start start 2023-10-18T14:05:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.583+0000 7f0d2bfc7b80 1 Processor -- start 2023-10-18T14:05:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.583+0000 7f0d2bfc7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949e65d0 0x55c8949ef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.583+0000 7f0d2bfc7b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.583+0000 7f0d2bfc7b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949ec500 0x55c8949f6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.583+0000 7f0d2bfc7b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8949f6960 con 0x55c8949ebbe0 2023-10-18T14:05:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.583+0000 7f0d2bfc7b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8949f6ad0 con 0x55c8949ec500 2023-10-18T14:05:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.583+0000 7f0d2bfc7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8949f6c90 con 0x55c8949e65d0 2023-10-18T14:05:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.583+0000 7f0d2bfc7b80 10 client.0 _ll_register_callbacks cb 0x55c89481fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.583+0000 7f0d1d379700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.583+0000 7f0d1d379700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45358/0 (socket says 172.21.15.114:45358) 2023-10-18T14:05:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.583+0000 7f0d1d379700 1 -- 172.21.15.114:0/543143476 learned_addr learned my addr 172.21.15.114:0/543143476 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.583+0000 7f0d1db7a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949e65d0 0x55c8949ef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d1e37b700 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949ec500 0x55c8949f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d1d379700 1 -- 172.21.15.114:0/543143476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949e65d0 msgr2=0x55c8949ef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d1d379700 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949e65d0 0x55c8949ef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d1d379700 1 -- 172.21.15.114:0/543143476 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949ec500 msgr2=0x55c8949f6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d1d379700 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949ec500 0x55c8949f6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d1d379700 1 -- 172.21.15.114:0/543143476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d181a3850 con 0x55c8949ebbe0 2023-10-18T14:05:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d1e37b700 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949ec500 0x55c8949f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949e65d0 0x55c8949ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d1d379700 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949f5ee0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0d08024d30 tx=0x7f0d08005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78700850250c74 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d017fa700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d017fa700 1 -- 172.21.15.114:0/543143476 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d080052b0 con 0x55c8949ebbe0 2023-10-18T14:05:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d017fa700 1 -- 172.21.15.114:0/543143476 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f0d0801f020 con 0x55c8949ebbe0 2023-10-18T14:05:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/543143476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d1001b320 con 0x55c8949ebbe0 2023-10-18T14:05:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d017fa700 1 -- 172.21.15.114:0/543143476 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d08005410 con 0x55c8949ebbe0 2023-10-18T14:05:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d2bfc7b80 10 client.16122 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/543143476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c8948f63f0 con 0x55c8949ebbe0 2023-10-18T14:05:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.584+0000 7f0d017fa700 1 -- 172.21.15.114:0/543143476 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d0803c020 con 0x55c8949ebbe0 2023-10-18T14:05:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.585+0000 7f0d017fa700 1 -- 172.21.15.114:0/543143476 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0d080108f0 con 0x55c8949ebbe0 2023-10-18T14:05:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.585+0000 7f0d2bfc7b80 10 client.16122 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.585+0000 7f0d2bfc7b80 10 client.16122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.585+0000 7f0d2bfc7b80 20 client.16122 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.585+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c894a552d0 0x55c894a576f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.585+0000 7f0d2bfc7b80 4 client.16122 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:05:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.585+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/543143476 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c894931e50 con 0x55c894a552d0 2023-10-18T14:05:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.585+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c894a552d0 0x55c894a576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.585+0000 7f0d017fa700 10 client.16122 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.585+0000 7f0d1db7a700 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c894a552d0 0x55c894a576f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92668a7b4a839bea server_cookie=f4ebd676faeeb0c3 in_seq=0 out_seq=0 2023-10-18T14:05:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.585+0000 7f0d017fa700 1 -- 172.21.15.114:0/543143476 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c894931e50 con 0x55c894a552d0 2023-10-18T14:05:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.585+0000 7f0d017fa700 10 client.16122 handle_command_reply: tid=0 2023-10-18T14:05:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.585+0000 7f0d2bfc7b80 1 client.16122 shutdown 2023-10-18T14:05:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/543143476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 msgr2=0x55c8949f5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949f5ee0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0d08024d30 tx=0x7f0d08005a00 comp rx=0 tx=0).stop 2023-10-18T14:05:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/543143476 shutdown_connections 2023-10-18T14:05:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c894a552d0 0x55c894a576f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c8949ec500 0x55c8949f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8949e65d0 0x55c8949ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d2bfc7b80 1 --2- 172.21.15.114:0/543143476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c8949ebbe0 0x55c8949f5ee0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d017fa700 0 client.16122 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/543143476 >> 172.21.15.114:0/543143476 conn(0x55c89495a720 msgr2=0x55c8949e0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/543143476 shutdown_connections 2023-10-18T14:05:39.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d2bfc7b80 1 -- 172.21.15.114:0/543143476 wait complete. 2023-10-18T14:05:39.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d2bfc7b80 20 client.16122 trim_cache size 0 max 16384 2023-10-18T14:05:39.611 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:05:39.611 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "no active scrubs running", 2023-10-18T14:05:39.612 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": {} 2023-10-18T14:05:39.612 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:05:39.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d1fdde700 1 -- 172.21.15.114:0/1451223062 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0d040a15f0 msgr2=0x7f0d040a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:39.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d1fdde700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0d040a15f0 0x7f0d040a3ab0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0d14006010 tx=0x7f0d1400b260 comp rx=0 tx=0).stop 2023-10-18T14:05:39.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d1fdde700 1 -- 172.21.15.114:0/1451223062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d18106730 msgr2=0x7f0d18196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:39.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d1fdde700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d18106730 0x7f0d18196990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000ef30 tx=0x7f0d1000c3a0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d1fdde700 1 -- 172.21.15.114:0/1451223062 shutdown_connections 2023-10-18T14:05:39.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d1fdde700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0d040a15f0 0x7f0d040a3ab0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d1fdde700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d18106730 0x7f0d18196990 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d1fdde700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d18100720 0x7f0d1819c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d1fdde700 1 --2- 172.21.15.114:0/1451223062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d181010e0 0x7f0d1819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d1fdde700 1 -- 172.21.15.114:0/1451223062 >> 172.21.15.114:0/1451223062 conn(0x7f0d180fc230 msgr2=0x7f0d180fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:39.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d1fdde700 1 -- 172.21.15.114:0/1451223062 shutdown_connections 2023-10-18T14:05:39.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.586+0000 7f0d1fdde700 1 -- 172.21.15.114:0/1451223062 wait complete. 2023-10-18T14:05:39.616 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-18T14:05:39.616 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:05:39.618 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/acl.h usability... yes 2023-10-18T14:05:39.630 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/acl.h presence... yes 2023-10-18T14:05:39.630 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/acl.h... yes 2023-10-18T14:05:39.668 INFO:tasks.workunit.client.0.smithi114.stdout:checking acl/libacl.h usability... yes 2023-10-18T14:05:39.679 INFO:tasks.workunit.client.0.smithi114.stdout:checking acl/libacl.h presence... yes 2023-10-18T14:05:39.680 INFO:tasks.workunit.client.0.smithi114.stdout:checking for acl/libacl.h... yes 2023-10-18T14:05:39.715 INFO:tasks.workunit.client.0.smithi114.stdout:checking for acl_init in -lacl... yes 2023-10-18T14:05:39.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.741+0000 7f7baf16d700 1 -- 172.21.15.114:0/3592072966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ba80ffa10 msgr2=0x7f7ba810bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:39.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.741+0000 7f7baf16d700 1 --2- 172.21.15.114:0/3592072966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ba80ffa10 0x7f7ba810bc20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c240 tx=0x7f7ba000c550 comp rx=0 tx=0).stop 2023-10-18T14:05:39.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.741+0000 7f7baf16d700 1 -- 172.21.15.114:0/3592072966 shutdown_connections 2023-10-18T14:05:39.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.741+0000 7f7baf16d700 1 --2- 172.21.15.114:0/3592072966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ba80ffa10 0x7f7ba810bc20 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.741+0000 7f7baf16d700 1 --2- 172.21.15.114:0/3592072966 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7ba8103d90 0x7f7ba8104170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.741+0000 7f7baf16d700 1 --2- 172.21.15.114:0/3592072966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba80ff050 0x7f7ba80ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.741+0000 7f7baf16d700 1 -- 172.21.15.114:0/3592072966 >> 172.21.15.114:0/3592072966 conn(0x7f7ba80748e0 msgr2=0x7f7ba8074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:39.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.741+0000 7f7baf16d700 1 -- 172.21.15.114:0/3592072966 shutdown_connections 2023-10-18T14:05:39.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.741+0000 7f7baf16d700 1 -- 172.21.15.114:0/3592072966 wait complete. 2023-10-18T14:05:39.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7baf16d700 1 Processor -- start 2023-10-18T14:05:39.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7baf16d700 1 -- start start 2023-10-18T14:05:39.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7baf16d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba80ff050 0x7f7ba819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7baf16d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7ba80ffa10 0x7f7ba819cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7baf16d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ba8103d90 0x7f7ba8196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7baf16d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba8197280 con 0x7f7ba8103d90 2023-10-18T14:05:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7baf16d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba81973f0 con 0x7f7ba80ffa10 2023-10-18T14:05:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7baf16d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba81975b0 con 0x7f7ba80ff050 2023-10-18T14:05:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7bad70a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ba8103d90 0x7f7ba8196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7bacf09700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba80ff050 0x7f7ba819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7bacf09700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba80ff050 0x7f7ba819ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49306/0 (socket says 172.21.15.114:49306) 2023-10-18T14:05:39.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7bad70a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ba8103d90 0x7f7ba8196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45374/0 (socket says 172.21.15.114:45374) 2023-10-18T14:05:39.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7bacf09700 1 -- 172.21.15.114:0/3865636672 learned_addr learned my addr 172.21.15.114:0/3865636672 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:39.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.742+0000 7f7ba7fff700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7ba80ffa10 0x7f7ba819cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.743+0000 7f7bad70a700 1 -- 172.21.15.114:0/3865636672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba80ff050 msgr2=0x7f7ba819ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:39.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.743+0000 7f7bad70a700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba80ff050 0x7f7ba819ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.743+0000 7f7bad70a700 1 -- 172.21.15.114:0/3865636672 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7ba80ffa10 msgr2=0x7f7ba819cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:39.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.743+0000 7f7bad70a700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7ba80ffa10 0x7f7ba819cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:39.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.743+0000 7f7bad70a700 1 -- 172.21.15.114:0/3865636672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba000ae10 con 0x7f7ba8103d90 2023-10-18T14:05:39.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.743+0000 7f7bacf09700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba80ff050 0x7f7ba819ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:39.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.743+0000 7f7bad70a700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ba8103d90 0x7f7ba8196ab0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c8e0 tx=0x7f7ba0008270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:39.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.743+0000 7f7ba5ffb700 1 -- 172.21.15.114:0/3865636672 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba000f040 con 0x7f7ba8103d90 2023-10-18T14:05:39.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.743+0000 7f7ba5ffb700 1 -- 172.21.15.114:0/3865636672 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ba0008a40 con 0x7f7ba8103d90 2023-10-18T14:05:39.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.743+0000 7f7baf16d700 1 -- 172.21.15.114:0/3865636672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba8197830 con 0x7f7ba8103d90 2023-10-18T14:05:39.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.743+0000 7f7ba5ffb700 1 -- 172.21.15.114:0/3865636672 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0005700 con 0x7f7ba8103d90 2023-10-18T14:05:39.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.743+0000 7f7baf16d700 1 -- 172.21.15.114:0/3865636672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba81a3990 con 0x7f7ba8103d90 2023-10-18T14:05:39.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.744+0000 7f7baf16d700 1 -- 172.21.15.114:0/3865636672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba8107370 con 0x7f7ba8103d90 2023-10-18T14:05:39.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.745+0000 7f7ba5ffb700 1 -- 172.21.15.114:0/3865636672 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f7ba000a070 con 0x7f7ba8103d90 2023-10-18T14:05:39.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.746+0000 7f7ba5ffb700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7b980a1670 0x7f7b980a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:39.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.746+0000 7f7bacf09700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7b980a1670 0x7f7b980a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:39.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.746+0000 7f7ba5ffb700 1 -- 172.21.15.114:0/3865636672 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7ba00ce820 con 0x7f7ba8103d90 2023-10-18T14:05:39.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.746+0000 7f7bacf09700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7b980a1670 0x7f7b980a3b30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c005950 tx=0x7f7b9c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:39.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:39.749+0000 7f7ba5ffb700 1 -- 172.21.15.114:0/3865636672 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7ba0097bf0 con 0x7f7ba8103d90 2023-10-18T14:05:39.766 INFO:tasks.workunit.client.0.smithi114.stdout:checking gdbm-ndbm.h usability... no 2023-10-18T14:05:39.788 INFO:tasks.workunit.client.0.smithi114.stdout:checking gdbm-ndbm.h presence... no 2023-10-18T14:05:39.788 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gdbm-ndbm.h... no 2023-10-18T14:05:39.820 INFO:tasks.workunit.client.0.smithi114.stdout:checking gdbm/ndbm.h usability... no 2023-10-18T14:05:39.842 INFO:tasks.workunit.client.0.smithi114.stdout:checking gdbm/ndbm.h presence... no 2023-10-18T14:05:39.843 INFO:tasks.workunit.client.0.smithi114.stdout:checking for gdbm/ndbm.h... no 2023-10-18T14:05:39.874 INFO:tasks.workunit.client.0.smithi114.stdout:checking ndbm.h usability... no 2023-10-18T14:05:39.896 INFO:tasks.workunit.client.0.smithi114.stdout:checking ndbm.h presence... no 2023-10-18T14:05:39.896 INFO:tasks.workunit.client.0.smithi114.stdout:checking for ndbm.h... no 2023-10-18T14:05:39.924 INFO:tasks.workunit.client.0.smithi114.stdout:checking libaio.h usability... yes 2023-10-18T14:05:39.938 INFO:tasks.workunit.client.0.smithi114.stdout:checking libaio.h presence... yes 2023-10-18T14:05:39.938 INFO:tasks.workunit.client.0.smithi114.stdout:checking for libaio.h... yes 2023-10-18T14:05:39.982 INFO:tasks.workunit.client.0.smithi114.stdout:checking for dm_make_handle in -ldm... no 2023-10-18T14:05:39.982 INFO:tasks.workunit.client.0.smithi114.stdout: 2023-10-18T14:05:39.982 INFO:tasks.workunit.client.0.smithi114.stdout:WARNING: could not find a valid DMAPI base library. 2023-10-18T14:05:39.982 INFO:tasks.workunit.client.0.smithi114.stdout:If you want DMAPI support please install the data migration 2023-10-18T14:05:39.983 INFO:tasks.workunit.client.0.smithi114.stdout:API (dmapi) library package. Alternatively, run "make install" 2023-10-18T14:05:39.983 INFO:tasks.workunit.client.0.smithi114.stdout:from the dmapi source. 2023-10-18T14:05:39.983 INFO:tasks.workunit.client.0.smithi114.stdout: 2023-10-18T14:05:40.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.000+0000 7f7baf16d700 1 -- 172.21.15.114:0/3865636672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ba81004c0 con 0x7f7ba8103d90 2023-10-18T14:05:40.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.001+0000 7f7ba5ffb700 1 -- 172.21.15.114:0/3865636672 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+11397 (secure 0 0 0) 0x7f7ba009b210 con 0x7f7ba8103d90 2023-10-18T14:05:40.005 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:05:40.005 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:05:30.940269+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3053339885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3053339885},{"type":"v1","addr":"172.21.15.172:6833","nonce":3053339885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:05:40.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.003+0000 7f7baf16d700 1 -- 172.21.15.114:0/3865636672 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7b980a1670 msgr2=0x7f7b980a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.003+0000 7f7baf16d700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7b980a1670 0x7f7b980a3b30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c005950 tx=0x7f7b9c009260 comp rx=0 tx=0).stop 2023-10-18T14:05:40.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.003+0000 7f7baf16d700 1 -- 172.21.15.114:0/3865636672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ba8103d90 msgr2=0x7f7ba8196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.003+0000 7f7baf16d700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ba8103d90 0x7f7ba8196ab0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c8e0 tx=0x7f7ba0008270 comp rx=0 tx=0).stop 2023-10-18T14:05:40.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.003+0000 7f7baf16d700 1 -- 172.21.15.114:0/3865636672 shutdown_connections 2023-10-18T14:05:40.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.003+0000 7f7baf16d700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f7b980a1670 0x7f7b980a3b30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.003+0000 7f7baf16d700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ba8103d90 0x7f7ba8196ab0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.008 INFO:tasks.workunit.client.0.smithi114.stdout:checking linux/fiemap.h usability... yes 2023-10-18T14:05:40.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.003+0000 7f7baf16d700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba80ff050 0x7f7ba819ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.003+0000 7f7baf16d700 1 --2- 172.21.15.114:0/3865636672 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7ba80ffa10 0x7f7ba819cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.003+0000 7f7baf16d700 1 -- 172.21.15.114:0/3865636672 >> 172.21.15.114:0/3865636672 conn(0x7f7ba80748e0 msgr2=0x7f7ba80fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.004+0000 7f7baf16d700 1 -- 172.21.15.114:0/3865636672 shutdown_connections 2023-10-18T14:05:40.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.004+0000 7f7baf16d700 1 -- 172.21.15.114:0/3865636672 wait complete. 2023-10-18T14:05:40.010 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 29 2023-10-18T14:05:40.018 INFO:tasks.workunit.client.0.smithi114.stdout:checking linux/fiemap.h presence... yes 2023-10-18T14:05:40.018 INFO:tasks.workunit.client.0.smithi114.stdout:checking for linux/fiemap.h... yes 2023-10-18T14:05:40.021 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-18T14:05:40.050 INFO:tasks.workunit.client.0.smithi114.stdout:checking for fallocate... yes 2023-10-18T14:05:40.099 INFO:tasks.workunit.client.0.smithi114.stdout:checking for open_by_handle_at... yes 2023-10-18T14:05:40.134 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/prctl.h usability... yes 2023-10-18T14:05:40.146 INFO:tasks.workunit.client.0.smithi114.stdout:checking sys/prctl.h presence... yes 2023-10-18T14:05:40.147 INFO:tasks.workunit.client.0.smithi114.stdout:checking for sys/prctl.h... yes 2023-10-18T14:05:40.175 INFO:tasks.workunit.client.0.smithi114.stdout:checking linux/fs.h usability... yes 2023-10-18T14:05:40.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.187+0000 7fd451d02700 1 -- 172.21.15.114:0/3200502370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd44c100000 msgr2=0x7fd44c10c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.187+0000 7fd451d02700 1 --2- 172.21.15.114:0/3200502370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd44c100000 0x7fd44c10c4a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd44400b0a0 tx=0x7fd44400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.187+0000 7fd451d02700 1 -- 172.21.15.114:0/3200502370 shutdown_connections 2023-10-18T14:05:40.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.187+0000 7fd451d02700 1 --2- 172.21.15.114:0/3200502370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd44c100000 0x7fd44c10c4a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.187+0000 7fd451d02700 1 --2- 172.21.15.114:0/3200502370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd44c1056e0 0x7fd44c105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.187+0000 7fd451d02700 1 --2- 172.21.15.114:0/3200502370 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd44c0ff640 0x7fd44c0ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.187+0000 7fd451d02700 1 -- 172.21.15.114:0/3200502370 >> 172.21.15.114:0/3200502370 conn(0x7fd44c0767f0 msgr2=0x7fd44c076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.187+0000 7fd451d02700 1 -- 172.21.15.114:0/3200502370 shutdown_connections 2023-10-18T14:05:40.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.187+0000 7fd451d02700 1 -- 172.21.15.114:0/3200502370 wait complete. 2023-10-18T14:05:40.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd451d02700 1 Processor -- start 2023-10-18T14:05:40.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd451d02700 1 -- start start 2023-10-18T14:05:40.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd451d02700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd44c0ff640 0x7fd44c197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd451d02700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd44c100000 0x7fd44c198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd451d02700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd44c1056e0 0x7fd44c1a2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd451d02700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c198880 con 0x7fd44c0ff640 2023-10-18T14:05:40.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd451d02700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c1a30b0 con 0x7fd44c100000 2023-10-18T14:05:40.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd451d02700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c1a31f0 con 0x7fd44c1056e0 2023-10-18T14:05:40.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd44b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd44c0ff640 0x7fd44c197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd44b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd44c0ff640 0x7fd44c197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45384/0 (socket says 172.21.15.114:45384) 2023-10-18T14:05:40.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd44b7fe700 1 -- 172.21.15.114:0/1962293738 learned_addr learned my addr 172.21.15.114:0/1962293738 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.199 INFO:tasks.workunit.client.0.smithi114.stdout:checking linux/fs.h presence... yes 2023-10-18T14:05:40.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd44bfff700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd44c1056e0 0x7fd44c1a2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd44affd700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd44c100000 0x7fd44c198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.201 INFO:tasks.workunit.client.0.smithi114.stdout:checking for linux/fs.h... yes 2023-10-18T14:05:40.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd44b7fe700 1 -- 172.21.15.114:0/1962293738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd44c1056e0 msgr2=0x7fd44c1a2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd44c1056e0 0x7fd44c1a2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd44b7fe700 1 -- 172.21.15.114:0/1962293738 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd44c100000 msgr2=0x7fd44c198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd44c100000 0x7fd44c198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd44b7fe700 1 -- 172.21.15.114:0/1962293738 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd444009d00 con 0x7fd44c0ff640 2023-10-18T14:05:40.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd44bfff700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd44c1056e0 0x7fd44c1a2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:40.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.188+0000 7fd44affd700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd44c100000 0x7fd44c198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:40.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.189+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd44c0ff640 0x7fd44c197af0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00e9d0 tx=0x7fd43c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.189+0000 7fd448ff9700 1 -- 172.21.15.114:0/1962293738 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c009790 con 0x7fd44c0ff640 2023-10-18T14:05:40.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.189+0000 7fd451d02700 1 -- 172.21.15.114:0/1962293738 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c1a3450 con 0x7fd44c0ff640 2023-10-18T14:05:40.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.189+0000 7fd448ff9700 1 -- 172.21.15.114:0/1962293738 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd43c00cbd0 con 0x7fd44c0ff640 2023-10-18T14:05:40.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.189+0000 7fd448ff9700 1 -- 172.21.15.114:0/1962293738 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c018680 con 0x7fd44c0ff640 2023-10-18T14:05:40.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.189+0000 7fd451d02700 1 -- 172.21.15.114:0/1962293738 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c1a39b0 con 0x7fd44c0ff640 2023-10-18T14:05:40.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.191+0000 7fd448ff9700 1 -- 172.21.15.114:0/1962293738 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fd43c00cd40 con 0x7fd44c0ff640 2023-10-18T14:05:40.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.192+0000 7fd448ff9700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd4340a15f0 0x7fd4340a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.192+0000 7fd448ff9700 1 -- 172.21.15.114:0/1962293738 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd43c014070 con 0x7fd44c0ff640 2023-10-18T14:05:40.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.192+0000 7fd44affd700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd4340a15f0 0x7fd4340a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.192+0000 7fd44affd700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd4340a15f0 0x7fd4340a3ab0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd440005950 tx=0x7fd4400058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd45deebb80 1 Processor -- start 2023-10-18T14:05:40.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd45deebb80 1 -- start start 2023-10-18T14:05:40.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd45deebb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 0x55f54e319fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd45deebb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 0x55f54e314090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd45deebb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e3145d0 0x55f54e314a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd45deebb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e2876e0 con 0x55f54e319be0 2023-10-18T14:05:40.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd45deebb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e26dc60 con 0x55f54e31a500 2023-10-18T14:05:40.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd45deebb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e26b580 con 0x55f54e3145d0 2023-10-18T14:05:40.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd44b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 0x55f54e319fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd44b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 0x55f54e319fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45392/0 (socket says 172.21.15.114:45392) 2023-10-18T14:05:40.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd44b7fe700 1 -- 172.21.15.114:0/684850812 learned_addr learned my addr 172.21.15.114:0/684850812 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd44bfff700 1 --2- 172.21.15.114:0/684850812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e3145d0 0x55f54e314a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd44affd700 1 --2- 172.21.15.114:0/684850812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 0x55f54e314090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd44b7fe700 1 -- 172.21.15.114:0/684850812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e3145d0 msgr2=0x55f54e314a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/684850812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e3145d0 0x55f54e314a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd44b7fe700 1 -- 172.21.15.114:0/684850812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 msgr2=0x55f54e314090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/684850812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 0x55f54e314090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.193+0000 7fd44b7fe700 1 -- 172.21.15.114:0/684850812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f54e2243f0 con 0x55f54e319be0 2023-10-18T14:05:40.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.194+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/684850812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 0x55f54e319fc0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd43c096820 tx=0x7fd43c099d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d724ca3007c263 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.194+0000 7fd431ffb700 1 -- 172.21.15.114:0/684850812 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c09e470 con 0x55f54e319be0 2023-10-18T14:05:40.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.194+0000 7fd431ffb700 1 -- 172.21.15.114:0/684850812 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd43c0a26b0 con 0x55f54e319be0 2023-10-18T14:05:40.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.194+0000 7fd431ffb700 1 -- 172.21.15.114:0/684850812 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c099810 con 0x55f54e319be0 2023-10-18T14:05:40.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.195+0000 7fd45deebb80 1 -- 172.21.15.114:0/684850812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 msgr2=0x55f54e319fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.195+0000 7fd45deebb80 1 --2- 172.21.15.114:0/684850812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 0x55f54e319fc0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd43c096820 tx=0x7fd43c099d00 comp rx=0 tx=0).stop 2023-10-18T14:05:40.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.195+0000 7fd45deebb80 1 -- 172.21.15.114:0/684850812 shutdown_connections 2023-10-18T14:05:40.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.195+0000 7fd45deebb80 1 --2- 172.21.15.114:0/684850812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e3145d0 0x55f54e314a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.195+0000 7fd45deebb80 1 --2- 172.21.15.114:0/684850812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 0x55f54e319fc0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.195+0000 7fd45deebb80 1 --2- 172.21.15.114:0/684850812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 0x55f54e314090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.195+0000 7fd45deebb80 1 -- 172.21.15.114:0/684850812 >> 172.21.15.114:0/684850812 conn(0x55f54e288720 msgr2=0x55f54e30eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.195+0000 7fd45deebb80 1 -- 172.21.15.114:0/684850812 shutdown_connections 2023-10-18T14:05:40.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.195+0000 7fd45deebb80 1 -- 172.21.15.114:0/684850812 wait complete. 2023-10-18T14:05:40.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.195+0000 7fd45deebb80 1 -- start start 2023-10-18T14:05:40.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.195+0000 7fd45deebb80 1 Processor -- start 2023-10-18T14:05:40.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd45deebb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e3145d0 0x55f54e31d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd45deebb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 0x55f54e31ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd45deebb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 0x55f54e31e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd45deebb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e266e70 con 0x55f54e319be0 2023-10-18T14:05:40.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd45deebb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e203710 con 0x55f54e31a500 2023-10-18T14:05:40.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd45deebb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e2033b0 con 0x55f54e3145d0 2023-10-18T14:05:40.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd45deebb80 10 client.0 _ll_register_callbacks cb 0x55f54e14da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:40.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd44affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 0x55f54e31ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd44affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 0x55f54e31ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45400/0 (socket says 172.21.15.114:45400) 2023-10-18T14:05:40.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd44b7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e3145d0 0x55f54e31d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd44affd700 1 -- 172.21.15.114:0/4081801435 learned_addr learned my addr 172.21.15.114:0/4081801435 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd44bfff700 1 --2- 172.21.15.114:0/4081801435 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 0x55f54e31e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd44affd700 1 -- 172.21.15.114:0/4081801435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e3145d0 msgr2=0x55f54e31d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd44affd700 1 --2- 172.21.15.114:0/4081801435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e3145d0 0x55f54e31d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd44affd700 1 -- 172.21.15.114:0/4081801435 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 msgr2=0x55f54e31e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd44affd700 1 --2- 172.21.15.114:0/4081801435 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 0x55f54e31e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd44affd700 1 -- 172.21.15.114:0/4081801435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c1a39b0 con 0x55f54e319be0 2023-10-18T14:05:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/4081801435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e3145d0 0x55f54e31d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd44affd700 1 --2- 172.21.15.114:0/4081801435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 0x55f54e31ddc0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd44000fe30 tx=0x7fd440004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4a0eceb2fdaa83 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd42affd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd42affd700 1 -- 172.21.15.114:0/4081801435 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440017040 con 0x55f54e319be0 2023-10-18T14:05:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd42affd700 1 -- 172.21.15.114:0/4081801435 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd440003880 con 0x55f54e319be0 2023-10-18T14:05:40.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.196+0000 7fd45deebb80 1 -- 172.21.15.114:0/4081801435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f54e26bef0 con 0x55f54e319be0 2023-10-18T14:05:40.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.197+0000 7fd42affd700 1 -- 172.21.15.114:0/4081801435 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd440003a40 con 0x55f54e319be0 2023-10-18T14:05:40.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.197+0000 7fd45deebb80 10 client.16140 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:40.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.197+0000 7fd45deebb80 1 -- 172.21.15.114:0/4081801435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55f54e091de0 con 0x55f54e319be0 2023-10-18T14:05:40.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.197+0000 7fd42affd700 1 -- 172.21.15.114:0/4081801435 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f54e26bef0 con 0x55f54e319be0 2023-10-18T14:05:40.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.197+0000 7fd42affd700 1 -- 172.21.15.114:0/4081801435 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd440011c60 con 0x55f54e319be0 2023-10-18T14:05:40.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.197+0000 7fd45deebb80 10 client.16140 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:40.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.197+0000 7fd45deebb80 10 client.16140 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-18T14:05:40.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.197+0000 7fd45deebb80 20 client.16140 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:40.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.197+0000 7fd45deebb80 1 --2- 172.21.15.114:0/4081801435 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55f54e32dfc0 0x55f54e3303e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.197+0000 7fd45deebb80 4 client.16140 mds_command: new command op to 14820 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.197+0000 7fd45deebb80 1 -- 172.21.15.114:0/4081801435 --> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f54e2e38b0 con 0x55f54e32dfc0 2023-10-18T14:05:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.197+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/4081801435 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55f54e32dfc0 0x55f54e3303e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd42affd700 10 client.16140 ms_handle_connect on v2:172.21.15.114:6840/2423071224 2023-10-18T14:05:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/4081801435 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55f54e32dfc0 0x55f54e3303e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=151e4b461b46eb8c server_cookie=5d4809bf53d13623 in_seq=0 out_seq=0 2023-10-18T14:05:40.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd42affd700 1 -- 172.21.15.114:0/4081801435 <== mds.4 v2:172.21.15.114:6840/2423071224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f54e2e38b0 con 0x55f54e32dfc0 2023-10-18T14:05:40.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd42affd700 10 client.16140 handle_command_reply: tid=0 2023-10-18T14:05:40.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd45deebb80 1 client.16140 shutdown 2023-10-18T14:05:40.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd45deebb80 1 -- 172.21.15.114:0/4081801435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 msgr2=0x55f54e31ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd45deebb80 1 --2- 172.21.15.114:0/4081801435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 0x55f54e31ddc0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd44000fe30 tx=0x7fd440004750 comp rx=0 tx=0).stop 2023-10-18T14:05:40.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd45deebb80 1 -- 172.21.15.114:0/4081801435 shutdown_connections 2023-10-18T14:05:40.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd45deebb80 1 --2- 172.21.15.114:0/4081801435 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55f54e32dfc0 0x55f54e3303e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd45deebb80 1 --2- 172.21.15.114:0/4081801435 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 0x55f54e31e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd42affd700 0 client.16140 ms_handle_reset on v2:172.21.15.114:6840/2423071224 2023-10-18T14:05:40.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd45deebb80 1 --2- 172.21.15.114:0/4081801435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e3145d0 0x55f54e31d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd45deebb80 1 --2- 172.21.15.114:0/4081801435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e319be0 0x55f54e31ddc0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd45deebb80 1 -- 172.21.15.114:0/4081801435 >> 172.21.15.114:0/4081801435 conn(0x55f54e288720 msgr2=0x55f54e313080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd45deebb80 1 -- 172.21.15.114:0/4081801435 shutdown_connections 2023-10-18T14:05:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd45deebb80 1 -- 172.21.15.114:0/4081801435 wait complete. 2023-10-18T14:05:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.198+0000 7fd45deebb80 20 client.16140 trim_cache size 0 max 16384 2023-10-18T14:05:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.211+0000 7fd45deebb80 1 Processor -- start 2023-10-18T14:05:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.211+0000 7fd45deebb80 1 -- start start 2023-10-18T14:05:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd45deebb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 0x55f54e324eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd45deebb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e319be0 0x55f54e31e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd45deebb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e31a500 0x55f54e313a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd45deebb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e309af0 con 0x55f54e3145d0 2023-10-18T14:05:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd45deebb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e0e7920 con 0x55f54e319be0 2023-10-18T14:05:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd45deebb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e30fcf0 con 0x55f54e31a500 2023-10-18T14:05:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd44b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 0x55f54e324eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd44affd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e319be0 0x55f54e31e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd44b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 0x55f54e324eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45406/0 (socket says 172.21.15.114:45406) 2023-10-18T14:05:40.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd44b7fe700 1 -- 172.21.15.114:0/3858536698 learned_addr learned my addr 172.21.15.114:0/3858536698 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd44bfff700 1 --2- 172.21.15.114:0/3858536698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e31a500 0x55f54e313a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd44b7fe700 1 -- 172.21.15.114:0/3858536698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e31a500 msgr2=0x55f54e313a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/3858536698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e31a500 0x55f54e313a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd44b7fe700 1 -- 172.21.15.114:0/3858536698 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e319be0 msgr2=0x55f54e31e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/3858536698 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e319be0 0x55f54e31e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd44b7fe700 1 -- 172.21.15.114:0/3858536698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f54e07ac60 con 0x55f54e3145d0 2023-10-18T14:05:40.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/3858536698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 0x55f54e324eb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00c5b0 tx=0x7fd43c099f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0b9a0d5730814e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd4327fc700 1 -- 172.21.15.114:0/3858536698 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c09e470 con 0x55f54e3145d0 2023-10-18T14:05:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd4327fc700 1 -- 172.21.15.114:0/3858536698 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd43c09e160 con 0x55f54e3145d0 2023-10-18T14:05:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.212+0000 7fd4327fc700 1 -- 172.21.15.114:0/3858536698 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c0994e0 con 0x55f54e3145d0 2023-10-18T14:05:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.213+0000 7fd45deebb80 1 -- 172.21.15.114:0/3858536698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 msgr2=0x55f54e324eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.213+0000 7fd45deebb80 1 --2- 172.21.15.114:0/3858536698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 0x55f54e324eb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00c5b0 tx=0x7fd43c099f10 comp rx=0 tx=0).stop 2023-10-18T14:05:40.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.213+0000 7fd45deebb80 1 -- 172.21.15.114:0/3858536698 shutdown_connections 2023-10-18T14:05:40.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.213+0000 7fd45deebb80 1 --2- 172.21.15.114:0/3858536698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e31a500 0x55f54e313a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.213+0000 7fd45deebb80 1 --2- 172.21.15.114:0/3858536698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 0x55f54e324eb0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.213+0000 7fd45deebb80 1 --2- 172.21.15.114:0/3858536698 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e319be0 0x55f54e31e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.213+0000 7fd45deebb80 1 -- 172.21.15.114:0/3858536698 >> 172.21.15.114:0/3858536698 conn(0x55f54e288720 msgr2=0x55f54e3149b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.213+0000 7fd45deebb80 1 -- 172.21.15.114:0/3858536698 shutdown_connections 2023-10-18T14:05:40.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.213+0000 7fd45deebb80 1 -- 172.21.15.114:0/3858536698 wait complete. 2023-10-18T14:05:40.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.213+0000 7fd45deebb80 1 -- start start 2023-10-18T14:05:40.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd45deebb80 1 Processor -- start 2023-10-18T14:05:40.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd45deebb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 0x55f54e322e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd45deebb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e319be0 0x55f54e3233d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd45deebb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 0x55f54e323910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd45deebb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e380e30 con 0x55f54e3145d0 2023-10-18T14:05:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd45deebb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e380f70 con 0x55f54e31a500 2023-10-18T14:05:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd45deebb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e381100 con 0x55f54e319be0 2023-10-18T14:05:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd45deebb80 10 client.0 _ll_register_callbacks cb 0x55f54e14da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd44b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 0x55f54e322e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd44b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 0x55f54e322e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45412/0 (socket says 172.21.15.114:45412) 2023-10-18T14:05:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd44b7fe700 1 -- 172.21.15.114:0/2872466395 learned_addr learned my addr 172.21.15.114:0/2872466395 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd44affd700 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e319be0 0x55f54e3233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd44bfff700 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 0x55f54e323910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd44b7fe700 1 -- 172.21.15.114:0/2872466395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e319be0 msgr2=0x55f54e3233d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e319be0 0x55f54e3233d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd44b7fe700 1 -- 172.21.15.114:0/2872466395 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 msgr2=0x55f54e323910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 0x55f54e323910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd44b7fe700 1 -- 172.21.15.114:0/2872466395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f54e2243f0 con 0x55f54e3145d0 2023-10-18T14:05:40.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd44bfff700 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 0x55f54e323910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:40.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.214+0000 7fd44b7fe700 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 0x55f54e322e90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0cb090 tx=0x7fd43c00c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1a28566c397d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd42affd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:40.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd42affd700 1 -- 172.21.15.114:0/2872466395 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c09a580 con 0x55f54e3145d0 2023-10-18T14:05:40.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd42affd700 1 -- 172.21.15.114:0/2872466395 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd43c09a780 con 0x55f54e3145d0 2023-10-18T14:05:40.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd45deebb80 1 -- 172.21.15.114:0/2872466395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd43c0a26b0 con 0x55f54e3145d0 2023-10-18T14:05:40.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd42affd700 1 -- 172.21.15.114:0/2872466395 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd43c0a2360 con 0x55f54e3145d0 2023-10-18T14:05:40.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd45deebb80 10 client.16146 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:40.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd45deebb80 1 -- 172.21.15.114:0/2872466395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55f54e0b8250 con 0x55f54e3145d0 2023-10-18T14:05:40.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd42affd700 1 -- 172.21.15.114:0/2872466395 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd43c0a26b0 con 0x55f54e3145d0 2023-10-18T14:05:40.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd42affd700 1 -- 172.21.15.114:0/2872466395 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd43c099410 con 0x55f54e3145d0 2023-10-18T14:05:40.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd45deebb80 10 client.16146 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:40.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd45deebb80 10 client.16146 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-18T14:05:40.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd45deebb80 20 client.16146 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:40.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd45deebb80 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55f54e382430 0x55f54e384820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd45deebb80 4 client.16146 mds_command: new command op to 14820 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:05:40.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd45deebb80 1 -- 172.21.15.114:0/2872466395 --> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f54e25fe50 con 0x55f54e382430 2023-10-18T14:05:40.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.215+0000 7fd44affd700 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55f54e382430 0x55f54e384820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd42affd700 10 client.16146 ms_handle_connect on v2:172.21.15.114:6840/2423071224 2023-10-18T14:05:40.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd44affd700 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55f54e382430 0x55f54e384820 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=35425b95da0cf54a server_cookie=c86ca9458a0adcaa in_seq=0 out_seq=0 2023-10-18T14:05:40.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd42affd700 1 -- 172.21.15.114:0/2872466395 <== mds.4 v2:172.21.15.114:6840/2423071224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f54e25fe50 con 0x55f54e382430 2023-10-18T14:05:40.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd42affd700 10 client.16146 handle_command_reply: tid=0 2023-10-18T14:05:40.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd45deebb80 1 client.16146 shutdown 2023-10-18T14:05:40.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd45deebb80 1 -- 172.21.15.114:0/2872466395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 msgr2=0x55f54e322e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd45deebb80 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 0x55f54e322e90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0cb090 tx=0x7fd43c00c6e0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd45deebb80 1 -- 172.21.15.114:0/2872466395 shutdown_connections 2023-10-18T14:05:40.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd45deebb80 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55f54e382430 0x55f54e384820 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd45deebb80 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f54e31a500 0x55f54e323910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd45deebb80 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f54e3145d0 0x55f54e322e90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd42affd700 0 client.16146 ms_handle_reset on v2:172.21.15.114:6840/2423071224 2023-10-18T14:05:40.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd45deebb80 1 --2- 172.21.15.114:0/2872466395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f54e319be0 0x55f54e3233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd45deebb80 1 -- 172.21.15.114:0/2872466395 >> 172.21.15.114:0/2872466395 conn(0x55f54e288720 msgr2=0x55f54e313930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd45deebb80 1 -- 172.21.15.114:0/2872466395 shutdown_connections 2023-10-18T14:05:40.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd45deebb80 1 -- 172.21.15.114:0/2872466395 wait complete. 2023-10-18T14:05:40.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.216+0000 7fd45deebb80 20 client.16146 trim_cache size 0 max 16384 2023-10-18T14:05:40.250 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:05:40.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.217+0000 7fd451d02700 1 -- 172.21.15.114:0/1962293738 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd4340a15f0 msgr2=0x7fd4340a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.217+0000 7fd451d02700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd4340a15f0 0x7fd4340a3ab0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd440005950 tx=0x7fd4400058e0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.217+0000 7fd451d02700 1 -- 172.21.15.114:0/1962293738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd44c0ff640 msgr2=0x7fd44c197af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.217+0000 7fd451d02700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd44c0ff640 0x7fd44c197af0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00e9d0 tx=0x7fd43c00ece0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.217+0000 7fd451d02700 1 -- 172.21.15.114:0/1962293738 shutdown_connections 2023-10-18T14:05:40.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.217+0000 7fd451d02700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd4340a15f0 0x7fd4340a3ab0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.217+0000 7fd451d02700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd44c1056e0 0x7fd44c1a2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.217+0000 7fd451d02700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd44c0ff640 0x7fd44c197af0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.217+0000 7fd451d02700 1 --2- 172.21.15.114:0/1962293738 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd44c100000 0x7fd44c198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.217+0000 7fd451d02700 1 -- 172.21.15.114:0/1962293738 >> 172.21.15.114:0/1962293738 conn(0x7fd44c0767f0 msgr2=0x7fd44c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.217+0000 7fd451d02700 1 -- 172.21.15.114:0/1962293738 shutdown_connections 2023-10-18T14:05:40.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.217+0000 7fd451d02700 1 -- 172.21.15.114:0/1962293738 wait complete. 2023-10-18T14:05:40.254 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-18T14:05:40.268 INFO:tasks.workunit.client.0.smithi114.stdout:checking btrfsutil.h usability... no 2023-10-18T14:05:40.290 INFO:tasks.workunit.client.0.smithi114.stdout:checking btrfsutil.h presence... no 2023-10-18T14:05:40.290 INFO:tasks.workunit.client.0.smithi114.stdout:checking for btrfsutil.h... no 2023-10-18T14:05:40.326 INFO:tasks.workunit.client.0.smithi114.stdout:checking for copy_file_range... yes 2023-10-18T14:05:40.365 INFO:tasks.workunit.client.0.smithi114.stdout:checking for renameat2... yes 2023-10-18T14:05:40.384 INFO:tasks.workunit.client.0.smithi114.stdout:configure: creating ./config.status 2023-10-18T14:05:40.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.393+0000 7f82ab8b7700 1 -- 172.21.15.114:0/191145818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a4100700 msgr2=0x7f82a4100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.393+0000 7f82ab8b7700 1 --2- 172.21.15.114:0/191145818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a4100700 0x7f82a4100b80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8294009990 tx=0x7f8294009ca0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.393+0000 7f82ab8b7700 1 -- 172.21.15.114:0/191145818 shutdown_connections 2023-10-18T14:05:40.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.393+0000 7f82ab8b7700 1 --2- 172.21.15.114:0/191145818 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82a41010c0 0x7f82a410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.393+0000 7f82ab8b7700 1 --2- 172.21.15.114:0/191145818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a4106710 0x7f82a4106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.393+0000 7f82ab8b7700 1 --2- 172.21.15.114:0/191145818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a4100700 0x7f82a4100b80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.393+0000 7f82ab8b7700 1 -- 172.21.15.114:0/191145818 >> 172.21.15.114:0/191145818 conn(0x7f82a40fc1d0 msgr2=0x7f82a40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.393+0000 7f82ab8b7700 1 -- 172.21.15.114:0/191145818 shutdown_connections 2023-10-18T14:05:40.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.393+0000 7f82ab8b7700 1 -- 172.21.15.114:0/191145818 wait complete. 2023-10-18T14:05:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.393+0000 7f82ab8b7700 1 Processor -- start 2023-10-18T14:05:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.393+0000 7f82ab8b7700 1 -- start start 2023-10-18T14:05:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.393+0000 7f82ab8b7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a4100700 0x7f82a419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.393+0000 7f82ab8b7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82a41010c0 0x7f82a419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82ab8b7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a4106710 0x7f82a41968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82ab8b7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a41970a0 con 0x7f82a4100700 2023-10-18T14:05:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82ab8b7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a4197210 con 0x7f82a41010c0 2023-10-18T14:05:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82ab8b7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a41973d0 con 0x7f82a4106710 2023-10-18T14:05:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82a9653700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a4100700 0x7f82a419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82a9653700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a4100700 0x7f82a419c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45426/0 (socket says 172.21.15.114:45426) 2023-10-18T14:05:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82a9653700 1 -- 172.21.15.114:0/1804036512 learned_addr learned my addr 172.21.15.114:0/1804036512 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82a9e54700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a4106710 0x7f82a41968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82a8e52700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82a41010c0 0x7f82a419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82a9653700 1 -- 172.21.15.114:0/1804036512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a4106710 msgr2=0x7f82a41968d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82a9653700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a4106710 0x7f82a41968d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82a9653700 1 -- 172.21.15.114:0/1804036512 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82a41010c0 msgr2=0x7f82a419cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82a9653700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82a41010c0 0x7f82a419cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82a9653700 1 -- 172.21.15.114:0/1804036512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940095f0 con 0x7f82a4100700 2023-10-18T14:05:40.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82a9653700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a4100700 0x7f82a419c830 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c9b0 tx=0x7f82a000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f829a7fc700 1 -- 172.21.15.114:0/1804036512 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0007b00 con 0x7f82a4100700 2023-10-18T14:05:40.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f829a7fc700 1 -- 172.21.15.114:0/1804036512 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82a0007c60 con 0x7f82a4100700 2023-10-18T14:05:40.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f829a7fc700 1 -- 172.21.15.114:0/1804036512 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0018660 con 0x7f82a4100700 2023-10-18T14:05:40.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.394+0000 7f82ab8b7700 1 -- 172.21.15.114:0/1804036512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a41976b0 con 0x7f82a4100700 2023-10-18T14:05:40.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.395+0000 7f82ab8b7700 1 -- 172.21.15.114:0/1804036512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a41a37b0 con 0x7f82a4100700 2023-10-18T14:05:40.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.397+0000 7f829a7fc700 1 -- 172.21.15.114:0/1804036512 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f82a000f450 con 0x7f82a4100700 2023-10-18T14:05:40.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.397+0000 7f829a7fc700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f82900a15f0 0x7f82900a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.397+0000 7f82a8e52700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f82900a15f0 0x7f82900a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.398+0000 7f829a7fc700 1 -- 172.21.15.114:0/1804036512 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f82a00ccfe0 con 0x7f82a4100700 2023-10-18T14:05:40.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.398+0000 7f82a8e52700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f82900a15f0 0x7f82900a3ab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8294006010 tx=0x7f829401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82b7aa0b80 1 Processor -- start 2023-10-18T14:05:40.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82b7aa0b80 1 -- start start 2023-10-18T14:05:40.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82b7aa0b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a93d690 0x55c25a93da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82b7aa0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93dfb0 0x55c25a941bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82b7aa0b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a942100 0x55c25a942560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82b7aa0b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c25a8ac6e0 con 0x55c25a93d690 2023-10-18T14:05:40.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82b7aa0b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c25a892c60 con 0x55c25a942100 2023-10-18T14:05:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82b7aa0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c25a890580 con 0x55c25a93dfb0 2023-10-18T14:05:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82a9653700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a93d690 0x55c25a93da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82a9653700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a93d690 0x55c25a93da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45434/0 (socket says 172.21.15.114:45434) 2023-10-18T14:05:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82a9653700 1 -- 172.21.15.114:0/1910533941 learned_addr learned my addr 172.21.15.114:0/1910533941 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82a8e52700 1 --2- 172.21.15.114:0/1910533941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93dfb0 0x55c25a941bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82a9e54700 1 --2- 172.21.15.114:0/1910533941 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a942100 0x55c25a942560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82a9653700 1 -- 172.21.15.114:0/1910533941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93dfb0 msgr2=0x55c25a941bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82a9653700 1 --2- 172.21.15.114:0/1910533941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93dfb0 0x55c25a941bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82a9653700 1 -- 172.21.15.114:0/1910533941 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a942100 msgr2=0x55c25a942560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82a9653700 1 --2- 172.21.15.114:0/1910533941 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a942100 0x55c25a942560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82a9653700 1 -- 172.21.15.114:0/1910533941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c25a8493f0 con 0x55c25a93d690 2023-10-18T14:05:40.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.399+0000 7f82a9e54700 1 --2- 172.21.15.114:0/1910533941 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a942100 0x55c25a942560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:40.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.400+0000 7f82a9653700 1 --2- 172.21.15.114:0/1910533941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a93d690 0x55c25a93da70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f82a0096a70 tx=0x7f82a0099f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e310148edee59e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.400+0000 7f828f7fe700 1 -- 172.21.15.114:0/1910533941 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a009e150 con 0x55c25a93d690 2023-10-18T14:05:40.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.400+0000 7f828f7fe700 1 -- 172.21.15.114:0/1910533941 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82a00a2390 con 0x55c25a93d690 2023-10-18T14:05:40.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.400+0000 7f828f7fe700 1 -- 172.21.15.114:0/1910533941 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a000f990 con 0x55c25a93d690 2023-10-18T14:05:40.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.400+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/1910533941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a93d690 msgr2=0x55c25a93da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.400+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/1910533941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a93d690 0x55c25a93da70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f82a0096a70 tx=0x7f82a0099f00 comp rx=0 tx=0).stop 2023-10-18T14:05:40.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.401+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/1910533941 shutdown_connections 2023-10-18T14:05:40.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.401+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/1910533941 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a942100 0x55c25a942560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.401+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/1910533941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a93d690 0x55c25a93da70 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.401+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/1910533941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93dfb0 0x55c25a941bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.401+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/1910533941 >> 172.21.15.114:0/1910533941 conn(0x55c25a8ad720 msgr2=0x55c25a933b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.401+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/1910533941 shutdown_connections 2023-10-18T14:05:40.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.401+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/1910533941 wait complete. 2023-10-18T14:05:40.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.401+0000 7f82b7aa0b80 1 -- start start 2023-10-18T14:05:40.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.401+0000 7f82b7aa0b80 1 Processor -- start 2023-10-18T14:05:40.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82b7aa0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 0x55c25a9498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82b7aa0b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 0x55c25a946b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82b7aa0b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a947210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82b7aa0b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c25a88be70 con 0x55c25a942100 2023-10-18T14:05:40.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82b7aa0b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c25a828710 con 0x55c25a93dfb0 2023-10-18T14:05:40.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82b7aa0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c25a8283b0 con 0x55c25a93d690 2023-10-18T14:05:40.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82b7aa0b80 10 client.0 _ll_register_callbacks cb 0x55c25a772a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:40.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82a9e54700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a947210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82a9e54700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a947210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45444/0 (socket says 172.21.15.114:45444) 2023-10-18T14:05:40.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82a9e54700 1 -- 172.21.15.114:0/1165312593 learned_addr learned my addr 172.21.15.114:0/1165312593 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82a8e52700 1 --2- 172.21.15.114:0/1165312593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 0x55c25a946b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82a9653700 1 --2- 172.21.15.114:0/1165312593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 0x55c25a9498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82a9e54700 1 -- 172.21.15.114:0/1165312593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 msgr2=0x55c25a9498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82a9e54700 1 --2- 172.21.15.114:0/1165312593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 0x55c25a9498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82a9e54700 1 -- 172.21.15.114:0/1165312593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 msgr2=0x55c25a946b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82a9e54700 1 --2- 172.21.15.114:0/1165312593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 0x55c25a946b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82a9e54700 1 -- 172.21.15.114:0/1165312593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a41a37b0 con 0x55c25a942100 2023-10-18T14:05:40.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f82a9e54700 1 --2- 172.21.15.114:0/1165312593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a947210 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f829c004140 tx=0x7f829c004450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc4cfb60531f4b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.402+0000 7f828cff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:40.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f828cff9700 1 -- 172.21.15.114:0/1165312593 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c0078b0 con 0x55c25a942100 2023-10-18T14:05:40.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f828cff9700 1 -- 172.21.15.114:0/1165312593 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f829c007a10 con 0x55c25a942100 2023-10-18T14:05:40.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/1165312593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c25a890ef0 con 0x55c25a942100 2023-10-18T14:05:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f828cff9700 1 -- 172.21.15.114:0/1165312593 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f829c007bd0 con 0x55c25a942100 2023-10-18T14:05:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f82b7aa0b80 10 client.16158 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/1165312593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c25a6b6de0 con 0x55c25a942100 2023-10-18T14:05:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f828cff9700 1 -- 172.21.15.114:0/1165312593 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c25a890ef0 con 0x55c25a942100 2023-10-18T14:05:40.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f828cff9700 1 -- 172.21.15.114:0/1165312593 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f829c014040 con 0x55c25a942100 2023-10-18T14:05:40.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f82b7aa0b80 10 client.16158 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:40.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f82b7aa0b80 10 client.16158 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.b 2023-10-18T14:05:40.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f82b7aa0b80 20 client.16158 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:40.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/1165312593 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55c25a93c590 0x55c25a93c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f82b7aa0b80 4 client.16158 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:40.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.403+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/1165312593 --> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c25a9088b0 con 0x55c25a93c590 2023-10-18T14:05:40.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.404+0000 7f82a9653700 1 --2- 172.21.15.114:0/1165312593 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55c25a93c590 0x55c25a93c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.404+0000 7f828cff9700 10 client.16158 ms_handle_connect on v2:172.21.15.158:6838/2616400572 2023-10-18T14:05:40.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.404+0000 7f82a9653700 1 --2- 172.21.15.114:0/1165312593 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55c25a93c590 0x55c25a93c9a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bbaa3150d671821a server_cookie=f31052ac1d09b52d in_seq=0 out_seq=0 2023-10-18T14:05:40.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f828cff9700 1 -- 172.21.15.114:0/1165312593 <== mds.3 v2:172.21.15.158:6838/2616400572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c25a9088b0 con 0x55c25a93c590 2023-10-18T14:05:40.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f828cff9700 10 client.16158 handle_command_reply: tid=0 2023-10-18T14:05:40.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f82b7aa0b80 1 client.16158 shutdown 2023-10-18T14:05:40.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/1165312593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 msgr2=0x55c25a947210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/1165312593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a947210 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f829c004140 tx=0x7f829c004450 comp rx=0 tx=0).stop 2023-10-18T14:05:40.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/1165312593 shutdown_connections 2023-10-18T14:05:40.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/1165312593 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55c25a93c590 0x55c25a93c9a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/1165312593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a947210 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/1165312593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 0x55c25a9498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/1165312593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 0x55c25a946b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/1165312593 >> 172.21.15.114:0/1165312593 conn(0x55c25a8ad720 msgr2=0x55c25a938080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f828cff9700 0 client.16158 ms_handle_reset on v2:172.21.15.158:6838/2616400572 2023-10-18T14:05:40.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/1165312593 shutdown_connections 2023-10-18T14:05:40.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/1165312593 wait complete. 2023-10-18T14:05:40.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.405+0000 7f82b7aa0b80 20 client.16158 trim_cache size 0 max 16384 2023-10-18T14:05:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.419+0000 7f82b7aa0b80 1 Processor -- start 2023-10-18T14:05:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.419+0000 7f82b7aa0b80 1 -- start start 2023-10-18T14:05:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.419+0000 7f82b7aa0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 0x55c25a9531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.419+0000 7f82b7aa0b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 0x55c25a9434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.419+0000 7f82b7aa0b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a9402e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.419+0000 7f82b7aa0b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c25a70c920 con 0x55c25a942100 2023-10-18T14:05:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.419+0000 7f82b7aa0b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c25a9302f0 con 0x55c25a93dfb0 2023-10-18T14:05:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.419+0000 7f82b7aa0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c25a9338d0 con 0x55c25a93d690 2023-10-18T14:05:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f82a9e54700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a9402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f82a9e54700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a9402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45452/0 (socket says 172.21.15.114:45452) 2023-10-18T14:05:40.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f82a9e54700 1 -- 172.21.15.114:0/509268265 learned_addr learned my addr 172.21.15.114:0/509268265 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f82a8e52700 1 --2- 172.21.15.114:0/509268265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 0x55c25a9434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f82a9653700 1 --2- 172.21.15.114:0/509268265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 0x55c25a9531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f82a9e54700 1 -- 172.21.15.114:0/509268265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 msgr2=0x55c25a9531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f82a9e54700 1 --2- 172.21.15.114:0/509268265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 0x55c25a9531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f82a9e54700 1 -- 172.21.15.114:0/509268265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 msgr2=0x55c25a9434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f82a9e54700 1 --2- 172.21.15.114:0/509268265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 0x55c25a9434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f82a9e54700 1 -- 172.21.15.114:0/509268265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c25a69fc60 con 0x55c25a942100 2023-10-18T14:05:40.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f82a9e54700 1 --2- 172.21.15.114:0/509268265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a9402e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f829c00c010 tx=0x7f829c003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8cd9f772416c87 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f828ffff700 1 -- 172.21.15.114:0/509268265 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c004a50 con 0x55c25a942100 2023-10-18T14:05:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f828ffff700 1 -- 172.21.15.114:0/509268265 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f829c00f040 con 0x55c25a942100 2023-10-18T14:05:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.420+0000 7f828ffff700 1 -- 172.21.15.114:0/509268265 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c0079e0 con 0x55c25a942100 2023-10-18T14:05:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.421+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/509268265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 msgr2=0x55c25a9402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.421+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/509268265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a9402e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f829c00c010 tx=0x7f829c003c30 comp rx=0 tx=0).stop 2023-10-18T14:05:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.421+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/509268265 shutdown_connections 2023-10-18T14:05:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.421+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/509268265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a9402e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.421+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/509268265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 0x55c25a9531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.421+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/509268265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 0x55c25a9434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.421+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/509268265 >> 172.21.15.114:0/509268265 conn(0x55c25a8ad720 msgr2=0x55c25a946150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.421+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/509268265 shutdown_connections 2023-10-18T14:05:40.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.421+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/509268265 wait complete. 2023-10-18T14:05:40.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.421+0000 7f82b7aa0b80 1 -- start start 2023-10-18T14:05:40.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.421+0000 7f82b7aa0b80 1 Processor -- start 2023-10-18T14:05:40.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82b7aa0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 0x55c25a946df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82b7aa0b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 0x55c25a9424e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82b7aa0b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a942a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82b7aa0b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c25a9473c0 con 0x55c25a942100 2023-10-18T14:05:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82b7aa0b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c25a947500 con 0x55c25a93dfb0 2023-10-18T14:05:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82b7aa0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c25a942f60 con 0x55c25a93d690 2023-10-18T14:05:40.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82b7aa0b80 10 client.0 _ll_register_callbacks cb 0x55c25a772a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:40.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82a9e54700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a942a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82a9e54700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a942a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45458/0 (socket says 172.21.15.114:45458) 2023-10-18T14:05:40.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82a9e54700 1 -- 172.21.15.114:0/4038463377 learned_addr learned my addr 172.21.15.114:0/4038463377 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82a9653700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 0x55c25a946df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82a8e52700 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 0x55c25a9424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82a9e54700 1 -- 172.21.15.114:0/4038463377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 msgr2=0x55c25a946df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82a9e54700 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 0x55c25a946df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82a9e54700 1 -- 172.21.15.114:0/4038463377 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 msgr2=0x55c25a9424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82a9e54700 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 0x55c25a9424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82a9e54700 1 -- 172.21.15.114:0/4038463377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c25a6b6de0 con 0x55c25a942100 2023-10-18T14:05:40.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82a9653700 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 0x55c25a946df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:40.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.422+0000 7f82a8e52700 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 0x55c25a9424e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:40.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f82a9e54700 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a942a20 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f829c004920 tx=0x7f829c003a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f651e08719ac277 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f828cff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:40.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f828cff9700 1 -- 172.21.15.114:0/4038463377 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c016910 con 0x55c25a942100 2023-10-18T14:05:40.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/4038463377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82a00a2390 con 0x55c25a942100 2023-10-18T14:05:40.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f828cff9700 1 -- 172.21.15.114:0/4038463377 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f829c0078c0 con 0x55c25a942100 2023-10-18T14:05:40.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f828cff9700 1 -- 172.21.15.114:0/4038463377 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f829c007a80 con 0x55c25a942100 2023-10-18T14:05:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f82b7aa0b80 10 client.16164 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/4038463377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c25a6dd250 con 0x55c25a942100 2023-10-18T14:05:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f828cff9700 1 -- 172.21.15.114:0/4038463377 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82a00a2390 con 0x55c25a942100 2023-10-18T14:05:40.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f828cff9700 1 -- 172.21.15.114:0/4038463377 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f829c014050 con 0x55c25a942100 2023-10-18T14:05:40.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f82b7aa0b80 10 client.16164 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:40.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f82b7aa0b80 10 client.16164 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.b 2023-10-18T14:05:40.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f82b7aa0b80 20 client.16164 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:40.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55c25a9b03d0 0x55c25a9b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f82b7aa0b80 4 client.16164 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:05:40.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.423+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/4038463377 --> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c25a884e50 con 0x55c25a9b03d0 2023-10-18T14:05:40.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f82a9653700 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55c25a9b03d0 0x55c25a9b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f82a9653700 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55c25a9b03d0 0x55c25a9b27c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bdc367c3d8981a7f server_cookie=a4f0e206f14da167 in_seq=0 out_seq=0 2023-10-18T14:05:40.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f828cff9700 10 client.16164 ms_handle_connect on v2:172.21.15.158:6838/2616400572 2023-10-18T14:05:40.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f828cff9700 1 -- 172.21.15.114:0/4038463377 <== mds.3 v2:172.21.15.158:6838/2616400572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c25a884e50 con 0x55c25a9b03d0 2023-10-18T14:05:40.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f828cff9700 10 client.16164 handle_command_reply: tid=0 2023-10-18T14:05:40.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f82b7aa0b80 1 client.16164 shutdown 2023-10-18T14:05:40.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/4038463377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 msgr2=0x55c25a942a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a942a20 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f829c004920 tx=0x7f829c003a00 comp rx=0 tx=0).stop 2023-10-18T14:05:40.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/4038463377 shutdown_connections 2023-10-18T14:05:40.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55c25a9b03d0 0x55c25a9b27c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c25a942100 0x55c25a942a20 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c25a93d690 0x55c25a946df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f82b7aa0b80 1 --2- 172.21.15.114:0/4038463377 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c25a93dfb0 0x55c25a9424e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/4038463377 >> 172.21.15.114:0/4038463377 conn(0x55c25a8ad720 msgr2=0x55c25a92d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f828cff9700 0 client.16164 ms_handle_reset on v2:172.21.15.158:6838/2616400572 2023-10-18T14:05:40.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.424+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/4038463377 shutdown_connections 2023-10-18T14:05:40.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82b7aa0b80 1 -- 172.21.15.114:0/4038463377 wait complete. 2023-10-18T14:05:40.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82b7aa0b80 20 client.16164 trim_cache size 0 max 16384 2023-10-18T14:05:40.452 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:05:40.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82ab8b7700 1 -- 172.21.15.114:0/1804036512 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f82900a15f0 msgr2=0x7f82900a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82ab8b7700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f82900a15f0 0x7f82900a3ab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8294006010 tx=0x7f829401a040 comp rx=0 tx=0).stop 2023-10-18T14:05:40.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82ab8b7700 1 -- 172.21.15.114:0/1804036512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a4100700 msgr2=0x7f82a419c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82ab8b7700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a4100700 0x7f82a419c830 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c9b0 tx=0x7f82a000ccc0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82ab8b7700 1 -- 172.21.15.114:0/1804036512 shutdown_connections 2023-10-18T14:05:40.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82ab8b7700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f82900a15f0 0x7f82900a3ab0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82ab8b7700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a4106710 0x7f82a41968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82ab8b7700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a4100700 0x7f82a419c830 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82ab8b7700 1 --2- 172.21.15.114:0/1804036512 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f82a41010c0 0x7f82a419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82ab8b7700 1 -- 172.21.15.114:0/1804036512 >> 172.21.15.114:0/1804036512 conn(0x7f82a40fc1d0 msgr2=0x7f82a40fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82ab8b7700 1 -- 172.21.15.114:0/1804036512 shutdown_connections 2023-10-18T14:05:40.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.425+0000 7f82ab8b7700 1 -- 172.21.15.114:0/1804036512 wait complete. 2023-10-18T14:05:40.456 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-18T14:05:40.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.617+0000 7fa9bad11700 1 -- 172.21.15.114:0/3327930301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b4067d40 msgr2=0x7fa9b4068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.617+0000 7fa9bad11700 1 --2- 172.21.15.114:0/3327930301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b4067d40 0x7fa9b4068120 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80099c0 tx=0x7fa9a8009cd0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.617+0000 7fa9bad11700 1 -- 172.21.15.114:0/3327930301 shutdown_connections 2023-10-18T14:05:40.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.617+0000 7fa9bad11700 1 --2- 172.21.15.114:0/3327930301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b4105b30 0x7fa9b410d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.617+0000 7fa9bad11700 1 --2- 172.21.15.114:0/3327930301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b4067d40 0x7fa9b4068120 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.617+0000 7fa9bad11700 1 --2- 172.21.15.114:0/3327930301 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9b4105170 0x7fa9b41055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.617+0000 7fa9bad11700 1 -- 172.21.15.114:0/3327930301 >> 172.21.15.114:0/3327930301 conn(0x7fa9b40767f0 msgr2=0x7fa9b4076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.617+0000 7fa9bad11700 1 -- 172.21.15.114:0/3327930301 shutdown_connections 2023-10-18T14:05:40.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.617+0000 7fa9bad11700 1 -- 172.21.15.114:0/3327930301 wait complete. 2023-10-18T14:05:40.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.618+0000 7fa9bad11700 1 Processor -- start 2023-10-18T14:05:40.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.618+0000 7fa9bad11700 1 -- start start 2023-10-18T14:05:40.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.618+0000 7fa9bad11700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9b4067d40 0x7fa9b40ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.618+0000 7fa9bad11700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b4105170 0x7fa9b40ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.618+0000 7fa9bad11700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b4105b30 0x7fa9b4100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.618+0000 7fa9bad11700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b41a4f70 con 0x7fa9b4105b30 2023-10-18T14:05:40.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.618+0000 7fa9bad11700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b41a50e0 con 0x7fa9b4067d40 2023-10-18T14:05:40.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.618+0000 7fa9bad11700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b41a52a0 con 0x7fa9b4105170 2023-10-18T14:05:40.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.618+0000 7fa9b92ae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b4105b30 0x7fa9b4100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.618+0000 7fa9b92ae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b4105b30 0x7fa9b4100130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45472/0 (socket says 172.21.15.114:45472) 2023-10-18T14:05:40.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.618+0000 7fa9b92ae700 1 -- 172.21.15.114:0/38784351 learned_addr learned my addr 172.21.15.114:0/38784351 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.618+0000 7fa9b3fff700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b4105170 0x7fa9b40ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.618+0000 7fa9b8aad700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9b4067d40 0x7fa9b40ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.619+0000 7fa9b92ae700 1 -- 172.21.15.114:0/38784351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b4105170 msgr2=0x7fa9b40ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.619+0000 7fa9b92ae700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b4105170 0x7fa9b40ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.619+0000 7fa9b92ae700 1 -- 172.21.15.114:0/38784351 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9b4067d40 msgr2=0x7fa9b40ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.619+0000 7fa9b92ae700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9b4067d40 0x7fa9b40ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.619+0000 7fa9b92ae700 1 -- 172.21.15.114:0/38784351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a80095f0 con 0x7fa9b4105b30 2023-10-18T14:05:40.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.619+0000 7fa9b92ae700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b4105b30 0x7fa9b4100130 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00efc0 tx=0x7fa9ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.619+0000 7fa9b1ffb700 1 -- 172.21.15.114:0/38784351 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac018070 con 0x7fa9b4105b30 2023-10-18T14:05:40.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.619+0000 7fa9bad11700 1 -- 172.21.15.114:0/38784351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b41a5520 con 0x7fa9b4105b30 2023-10-18T14:05:40.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.619+0000 7fa9b1ffb700 1 -- 172.21.15.114:0/38784351 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9ac00f040 con 0x7fa9b4105b30 2023-10-18T14:05:40.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.619+0000 7fa9b1ffb700 1 -- 172.21.15.114:0/38784351 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac00cc10 con 0x7fa9b4105b30 2023-10-18T14:05:40.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.619+0000 7fa9bad11700 1 -- 172.21.15.114:0/38784351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b41a59e0 con 0x7fa9b4105b30 2023-10-18T14:05:40.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.621+0000 7fa9b1ffb700 1 -- 172.21.15.114:0/38784351 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fa9ac003a00 con 0x7fa9b4105b30 2023-10-18T14:05:40.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.622+0000 7fa9b1ffb700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa9a40a15f0 0x7fa9a40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.622+0000 7fa9b8aad700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa9a40a15f0 0x7fa9a40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.622+0000 7fa9b1ffb700 1 -- 172.21.15.114:0/38784351 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa9ac0cca60 con 0x7fa9b4105b30 2023-10-18T14:05:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.622+0000 7fa9b8aad700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa9a40a15f0 0x7fa9a40a3ab0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009fd0 tx=0x7fa9a8019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9c6efab80 1 Processor -- start 2023-10-18T14:05:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9c6efab80 1 -- start start 2023-10-18T14:05:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9c6efab80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e77069be0 0x558e77069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9c6efab80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 0x558e77064090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9c6efab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e77064a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9c6efab80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e76fd76e0 con 0x558e7706a500 2023-10-18T14:05:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9c6efab80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e76fbdc60 con 0x558e77069be0 2023-10-18T14:05:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9c6efab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e76fbb580 con 0x558e770645d0 2023-10-18T14:05:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9b3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 0x558e77064090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9b3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 0x558e77064090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45478/0 (socket says 172.21.15.114:45478) 2023-10-18T14:05:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9b3fff700 1 -- 172.21.15.114:0/1838191482 learned_addr learned my addr 172.21.15.114:0/1838191482 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9b92ae700 1 --2- 172.21.15.114:0/1838191482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e77064a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9b8aad700 1 --2- 172.21.15.114:0/1838191482 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e77069be0 0x558e77069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9b3fff700 1 -- 172.21.15.114:0/1838191482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 msgr2=0x558e77064a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9b3fff700 1 --2- 172.21.15.114:0/1838191482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e77064a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9b3fff700 1 -- 172.21.15.114:0/1838191482 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e77069be0 msgr2=0x558e77069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9b3fff700 1 --2- 172.21.15.114:0/1838191482 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e77069be0 0x558e77069fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.623+0000 7fa9b3fff700 1 -- 172.21.15.114:0/1838191482 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e76f743f0 con 0x558e7706a500 2023-10-18T14:05:40.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.624+0000 7fa9b3fff700 1 --2- 172.21.15.114:0/1838191482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 0x558e77064090 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000ac80 tx=0x7fa9a000af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bb6474ee934e19 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.624+0000 7fa99effd700 1 -- 172.21.15.114:0/1838191482 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a000fde0 con 0x558e7706a500 2023-10-18T14:05:40.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.624+0000 7fa99effd700 1 -- 172.21.15.114:0/1838191482 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9a0018900 con 0x558e7706a500 2023-10-18T14:05:40.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.624+0000 7fa99effd700 1 -- 172.21.15.114:0/1838191482 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00108b0 con 0x558e7706a500 2023-10-18T14:05:40.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.624+0000 7fa9c6efab80 1 -- 172.21.15.114:0/1838191482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 msgr2=0x558e77064090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.624+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/1838191482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 0x558e77064090 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000ac80 tx=0x7fa9a000af90 comp rx=0 tx=0).stop 2023-10-18T14:05:40.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.624+0000 7fa9c6efab80 1 -- 172.21.15.114:0/1838191482 shutdown_connections 2023-10-18T14:05:40.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.624+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/1838191482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e77064a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.624+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/1838191482 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e77069be0 0x558e77069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.624+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/1838191482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 0x558e77064090 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.624+0000 7fa9c6efab80 1 -- 172.21.15.114:0/1838191482 >> 172.21.15.114:0/1838191482 conn(0x558e76fd8720 msgr2=0x558e7705eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.624+0000 7fa9c6efab80 1 -- 172.21.15.114:0/1838191482 shutdown_connections 2023-10-18T14:05:40.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9c6efab80 1 -- 172.21.15.114:0/1838191482 wait complete. 2023-10-18T14:05:40.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9c6efab80 1 -- start start 2023-10-18T14:05:40.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9c6efab80 1 Processor -- start 2023-10-18T14:05:40.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9c6efab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e770705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9c6efab80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 0x558e7706d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9c6efab80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e7706a500 0x558e7706df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9c6efab80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e76fb6e70 con 0x558e77069be0 2023-10-18T14:05:40.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9c6efab80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e76f53710 con 0x558e7706a500 2023-10-18T14:05:40.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9c6efab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e76f533b0 con 0x558e770645d0 2023-10-18T14:05:40.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9c6efab80 10 client.0 _ll_register_callbacks cb 0x558e76e9da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:40.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9b3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 0x558e7706d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9b8aad700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e770705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9b3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 0x558e7706d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45484/0 (socket says 172.21.15.114:45484) 2023-10-18T14:05:40.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.625+0000 7fa9b3fff700 1 -- 172.21.15.114:0/970503500 learned_addr learned my addr 172.21.15.114:0/970503500 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa9b92ae700 1 --2- 172.21.15.114:0/970503500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e7706a500 0x558e7706df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa9b3fff700 1 -- 172.21.15.114:0/970503500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 msgr2=0x558e770705a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa9b3fff700 1 --2- 172.21.15.114:0/970503500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e770705a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa9b3fff700 1 -- 172.21.15.114:0/970503500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e7706a500 msgr2=0x558e7706df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa9b3fff700 1 --2- 172.21.15.114:0/970503500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e7706a500 0x558e7706df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa9b3fff700 1 -- 172.21.15.114:0/970503500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a000a8b0 con 0x558e77069be0 2023-10-18T14:05:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa9b8aad700 1 --2- 172.21.15.114:0/970503500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e770705a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa9b3fff700 1 --2- 172.21.15.114:0/970503500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 0x558e7706d820 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000f6a0 tx=0x7fa9a0018d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2bc5f8b6f977ba server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa993fff700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa993fff700 1 -- 172.21.15.114:0/970503500 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0005040 con 0x558e77069be0 2023-10-18T14:05:40.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa993fff700 1 -- 172.21.15.114:0/970503500 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa9a00051a0 con 0x558e77069be0 2023-10-18T14:05:40.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa9c6efab80 1 -- 172.21.15.114:0/970503500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e76fbbef0 con 0x558e77069be0 2023-10-18T14:05:40.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa993fff700 1 -- 172.21.15.114:0/970503500 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9a0005360 con 0x558e77069be0 2023-10-18T14:05:40.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa9c6efab80 10 client.16176 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:40.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa9c6efab80 1 -- 172.21.15.114:0/970503500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x558e76de1de0 con 0x558e77069be0 2023-10-18T14:05:40.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa993fff700 1 -- 172.21.15.114:0/970503500 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558e76fbbef0 con 0x558e77069be0 2023-10-18T14:05:40.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.626+0000 7fa993fff700 1 -- 172.21.15.114:0/970503500 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa9a0010570 con 0x558e77069be0 2023-10-18T14:05:40.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.627+0000 7fa9c6efab80 10 client.16176 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:40.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.627+0000 7fa9c6efab80 10 client.16176 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-18T14:05:40.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.627+0000 7fa9c6efab80 20 client.16176 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:40.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.627+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/970503500 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x558e7707de60 0x558e77080280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.627+0000 7fa9c6efab80 4 client.16176 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:40.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.627+0000 7fa9c6efab80 1 -- 172.21.15.114:0/970503500 --> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e770338b0 con 0x558e7707de60 2023-10-18T14:05:40.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.627+0000 7fa9b8aad700 1 --2- 172.21.15.114:0/970503500 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x558e7707de60 0x558e77080280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.627+0000 7fa993fff700 10 client.16176 ms_handle_connect on v2:172.21.15.172:6834/2655563129 2023-10-18T14:05:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.627+0000 7fa9b8aad700 1 --2- 172.21.15.114:0/970503500 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x558e7707de60 0x558e77080280 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=51b5b197986a8c3 server_cookie=6ce5680f5e91baed in_seq=0 out_seq=0 2023-10-18T14:05:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa993fff700 1 -- 172.21.15.114:0/970503500 <== mds.2 v2:172.21.15.172:6834/2655563129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558e770338b0 con 0x558e7707de60 2023-10-18T14:05:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa993fff700 10 client.16176 handle_command_reply: tid=0 2023-10-18T14:05:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa9c6efab80 1 client.16176 shutdown 2023-10-18T14:05:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa9c6efab80 1 -- 172.21.15.114:0/970503500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 msgr2=0x558e7706d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/970503500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 0x558e7706d820 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000f6a0 tx=0x7fa9a0018d20 comp rx=0 tx=0).stop 2023-10-18T14:05:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa9c6efab80 1 -- 172.21.15.114:0/970503500 shutdown_connections 2023-10-18T14:05:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/970503500 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x558e7707de60 0x558e77080280 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/970503500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e7706a500 0x558e7706df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/970503500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e770705a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/970503500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 0x558e7706d820 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa993fff700 0 client.16176 ms_handle_reset on v2:172.21.15.172:6834/2655563129 2023-10-18T14:05:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa9c6efab80 1 -- 172.21.15.114:0/970503500 >> 172.21.15.114:0/970503500 conn(0x558e76fd8720 msgr2=0x558e77063080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa9c6efab80 1 -- 172.21.15.114:0/970503500 shutdown_connections 2023-10-18T14:05:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa9c6efab80 1 -- 172.21.15.114:0/970503500 wait complete. 2023-10-18T14:05:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.628+0000 7fa9c6efab80 20 client.16176 trim_cache size 0 max 16384 2023-10-18T14:05:40.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.642+0000 7fa9c6efab80 1 Processor -- start 2023-10-18T14:05:40.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.642+0000 7fa9c6efab80 1 -- start start 2023-10-18T14:05:40.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.642+0000 7fa9c6efab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e770595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.642+0000 7fa9c6efab80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 0x558e77074ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.642+0000 7fa9c6efab80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e7706a500 0x558e770649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.642+0000 7fa9c6efab80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e76e37920 con 0x558e77069be0 2023-10-18T14:05:40.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.642+0000 7fa9c6efab80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e7706e7a0 con 0x558e7706a500 2023-10-18T14:05:40.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.642+0000 7fa9c6efab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e7705b330 con 0x558e770645d0 2023-10-18T14:05:40.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.642+0000 7fa9b3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 0x558e77074ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.642+0000 7fa9b8aad700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e770595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.642+0000 7fa9b3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 0x558e77074ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45492/0 (socket says 172.21.15.114:45492) 2023-10-18T14:05:40.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.642+0000 7fa9b3fff700 1 -- 172.21.15.114:0/3167168160 learned_addr learned my addr 172.21.15.114:0/3167168160 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.642+0000 7fa9b92ae700 1 --2- 172.21.15.114:0/3167168160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e7706a500 0x558e770649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.643+0000 7fa9b3fff700 1 -- 172.21.15.114:0/3167168160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 msgr2=0x558e770595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.643+0000 7fa9b3fff700 1 --2- 172.21.15.114:0/3167168160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e770595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.643+0000 7fa9b3fff700 1 -- 172.21.15.114:0/3167168160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e7706a500 msgr2=0x558e770649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.643+0000 7fa9b3fff700 1 --2- 172.21.15.114:0/3167168160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e7706a500 0x558e770649b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.643+0000 7fa9b3fff700 1 -- 172.21.15.114:0/3167168160 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e76dcac60 con 0x558e77069be0 2023-10-18T14:05:40.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.643+0000 7fa9b8aad700 1 --2- 172.21.15.114:0/3167168160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e770595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:40.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.643+0000 7fa9b3fff700 1 --2- 172.21.15.114:0/3167168160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 0x558e77074ee0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000a340 tx=0x7fa9a0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca1ca18d13204e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.643+0000 7fa99f7fe700 1 -- 172.21.15.114:0/3167168160 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0010c70 con 0x558e77069be0 2023-10-18T14:05:40.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.643+0000 7fa99f7fe700 1 -- 172.21.15.114:0/3167168160 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9a000f6d0 con 0x558e77069be0 2023-10-18T14:05:40.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.643+0000 7fa99f7fe700 1 -- 172.21.15.114:0/3167168160 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00053c0 con 0x558e77069be0 2023-10-18T14:05:40.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.644+0000 7fa9c6efab80 1 -- 172.21.15.114:0/3167168160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 msgr2=0x558e77074ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.644+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/3167168160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 0x558e77074ee0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000a340 tx=0x7fa9a0000bc0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.644+0000 7fa9c6efab80 1 -- 172.21.15.114:0/3167168160 shutdown_connections 2023-10-18T14:05:40.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.644+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/3167168160 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e7706a500 0x558e770649b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.644+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/3167168160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e770645d0 0x558e770595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.644+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/3167168160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e77069be0 0x558e77074ee0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.644+0000 7fa9c6efab80 1 -- 172.21.15.114:0/3167168160 >> 172.21.15.114:0/3167168160 conn(0x558e76fd8720 msgr2=0x558e770605e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.644+0000 7fa9c6efab80 1 -- 172.21.15.114:0/3167168160 shutdown_connections 2023-10-18T14:05:40.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.644+0000 7fa9c6efab80 1 -- 172.21.15.114:0/3167168160 wait complete. 2023-10-18T14:05:40.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.644+0000 7fa9c6efab80 1 -- start start 2023-10-18T14:05:40.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.644+0000 7fa9c6efab80 1 Processor -- start 2023-10-18T14:05:40.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9c6efab80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e770645d0 0x558e77072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9c6efab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e77069be0 0x558e77073400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9c6efab80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 0x558e77073940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9c6efab80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e770d0da0 con 0x558e7706a500 2023-10-18T14:05:40.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9c6efab80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e770d0f10 con 0x558e770645d0 2023-10-18T14:05:40.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9c6efab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e770d10d0 con 0x558e77069be0 2023-10-18T14:05:40.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9c6efab80 10 client.0 _ll_register_callbacks cb 0x558e76e9da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:40.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9b92ae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 0x558e77073940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9b92ae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 0x558e77073940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45500/0 (socket says 172.21.15.114:45500) 2023-10-18T14:05:40.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9b92ae700 1 -- 172.21.15.114:0/3015445090 learned_addr learned my addr 172.21.15.114:0/3015445090 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9b3fff700 1 --2- 172.21.15.114:0/3015445090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e77069be0 0x558e77073400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9b8aad700 1 --2- 172.21.15.114:0/3015445090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e770645d0 0x558e77072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9b92ae700 1 -- 172.21.15.114:0/3015445090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e77069be0 msgr2=0x558e77073400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9b92ae700 1 --2- 172.21.15.114:0/3015445090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e77069be0 0x558e77073400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9b92ae700 1 -- 172.21.15.114:0/3015445090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e770645d0 msgr2=0x558e77072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9b92ae700 1 --2- 172.21.15.114:0/3015445090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e770645d0 0x558e77072ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9b92ae700 1 -- 172.21.15.114:0/3015445090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a8028040 con 0x558e7706a500 2023-10-18T14:05:40.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa9b92ae700 1 --2- 172.21.15.114:0/3015445090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 0x558e77073940 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac004de0 tx=0x7fa9ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24900c6e482d297 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa993fff700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:40.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa993fff700 1 -- 172.21.15.114:0/3015445090 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac01b320 con 0x558e7706a500 2023-10-18T14:05:40.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.645+0000 7fa993fff700 1 -- 172.21.15.114:0/3015445090 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa9ac09a1b0 con 0x558e7706a500 2023-10-18T14:05:40.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.646+0000 7fa9c6efab80 1 -- 172.21.15.114:0/3015445090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa9a0018900 con 0x558e7706a500 2023-10-18T14:05:40.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.646+0000 7fa993fff700 1 -- 172.21.15.114:0/3015445090 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9ac099ab0 con 0x558e7706a500 2023-10-18T14:05:40.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.646+0000 7fa9c6efab80 10 client.16182 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:40.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.646+0000 7fa9c6efab80 1 -- 172.21.15.114:0/3015445090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x558e76de1de0 con 0x558e7706a500 2023-10-18T14:05:40.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.646+0000 7fa993fff700 1 -- 172.21.15.114:0/3015445090 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9ac0b6080 con 0x558e7706a500 2023-10-18T14:05:40.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.646+0000 7fa993fff700 1 -- 172.21.15.114:0/3015445090 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa9ac099da0 con 0x558e7706a500 2023-10-18T14:05:40.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.646+0000 7fa9c6efab80 10 client.16182 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:40.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.646+0000 7fa9c6efab80 10 client.16182 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-18T14:05:40.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.646+0000 7fa9c6efab80 20 client.16182 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:40.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.646+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/3015445090 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x558e770d2960 0x558e770d4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.646+0000 7fa9c6efab80 4 client.16182 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:05:40.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.646+0000 7fa9c6efab80 1 -- 172.21.15.114:0/3015445090 --> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558e76fafe50 con 0x558e770d2960 2023-10-18T14:05:40.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.646+0000 7fa9b8aad700 1 --2- 172.21.15.114:0/3015445090 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x558e770d2960 0x558e770d4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa993fff700 10 client.16182 ms_handle_connect on v2:172.21.15.172:6834/2655563129 2023-10-18T14:05:40.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa9b8aad700 1 --2- 172.21.15.114:0/3015445090 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x558e770d2960 0x558e770d4d80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4ad92402c034cf3 server_cookie=e787a050d4414865 in_seq=0 out_seq=0 2023-10-18T14:05:40.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa993fff700 1 -- 172.21.15.114:0/3015445090 <== mds.2 v2:172.21.15.172:6834/2655563129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558e76fafe50 con 0x558e770d2960 2023-10-18T14:05:40.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa993fff700 10 client.16182 handle_command_reply: tid=0 2023-10-18T14:05:40.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa9c6efab80 1 client.16182 shutdown 2023-10-18T14:05:40.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa9c6efab80 1 -- 172.21.15.114:0/3015445090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 msgr2=0x558e77073940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/3015445090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 0x558e77073940 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac004de0 tx=0x7fa9ac009da0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa9c6efab80 1 -- 172.21.15.114:0/3015445090 shutdown_connections 2023-10-18T14:05:40.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/3015445090 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x558e770d2960 0x558e770d4d80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/3015445090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558e7706a500 0x558e77073940 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/3015445090 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558e770645d0 0x558e77072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa9c6efab80 1 --2- 172.21.15.114:0/3015445090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e77069be0 0x558e77073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa9c6efab80 1 -- 172.21.15.114:0/3015445090 >> 172.21.15.114:0/3015445090 conn(0x558e76fd8720 msgr2=0x558e7705e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa993fff700 0 client.16182 ms_handle_reset on v2:172.21.15.172:6834/2655563129 2023-10-18T14:05:40.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa9c6efab80 1 -- 172.21.15.114:0/3015445090 shutdown_connections 2023-10-18T14:05:40.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa9c6efab80 1 -- 172.21.15.114:0/3015445090 wait complete. 2023-10-18T14:05:40.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.647+0000 7fa9c6efab80 20 client.16182 trim_cache size 0 max 16384 2023-10-18T14:05:40.679 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:05:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.648+0000 7fa9bad11700 1 -- 172.21.15.114:0/38784351 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa9a40a15f0 msgr2=0x7fa9a40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.648+0000 7fa9bad11700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa9a40a15f0 0x7fa9a40a3ab0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009fd0 tx=0x7fa9a8019040 comp rx=0 tx=0).stop 2023-10-18T14:05:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.648+0000 7fa9bad11700 1 -- 172.21.15.114:0/38784351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b4105b30 msgr2=0x7fa9b4100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.648+0000 7fa9bad11700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b4105b30 0x7fa9b4100130 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00efc0 tx=0x7fa9ac00c3a0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.648+0000 7fa9bad11700 1 -- 172.21.15.114:0/38784351 shutdown_connections 2023-10-18T14:05:40.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.648+0000 7fa9bad11700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa9a40a15f0 0x7fa9a40a3ab0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.648+0000 7fa9bad11700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b4105b30 0x7fa9b4100130 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.648+0000 7fa9bad11700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa9b4067d40 0x7fa9b40ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.648+0000 7fa9bad11700 1 --2- 172.21.15.114:0/38784351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b4105170 0x7fa9b40ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.648+0000 7fa9bad11700 1 -- 172.21.15.114:0/38784351 >> 172.21.15.114:0/38784351 conn(0x7fa9b40767f0 msgr2=0x7fa9b40fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.648+0000 7fa9bad11700 1 -- 172.21.15.114:0/38784351 shutdown_connections 2023-10-18T14:05:40.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.648+0000 7fa9bad11700 1 -- 172.21.15.114:0/38784351 wait complete. 2023-10-18T14:05:40.684 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-18T14:05:40.707 INFO:tasks.workunit.client.0.smithi114.stdout:config.status: creating include/builddefs 2023-10-18T14:05:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.805+0000 7fa4df46d700 1 -- 172.21.15.114:0/2357323943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4d8105650 msgr2=0x7fa4d8105a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.805+0000 7fa4df46d700 1 --2- 172.21.15.114:0/2357323943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4d8105650 0x7fa4d8105a30 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009990 tx=0x7fa4d4009ca0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.805+0000 7fa4df46d700 1 -- 172.21.15.114:0/2357323943 shutdown_connections 2023-10-18T14:05:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.805+0000 7fa4df46d700 1 --2- 172.21.15.114:0/2357323943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d8100000 0x7fa4d810c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.805+0000 7fa4df46d700 1 --2- 172.21.15.114:0/2357323943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4d8105650 0x7fa4d8105a30 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.805+0000 7fa4df46d700 1 --2- 172.21.15.114:0/2357323943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4d80ff640 0x7fa4d80ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.805+0000 7fa4df46d700 1 -- 172.21.15.114:0/2357323943 >> 172.21.15.114:0/2357323943 conn(0x7fa4d8076790 msgr2=0x7fa4d8076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.805+0000 7fa4df46d700 1 -- 172.21.15.114:0/2357323943 shutdown_connections 2023-10-18T14:05:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.805+0000 7fa4df46d700 1 -- 172.21.15.114:0/2357323943 wait complete. 2023-10-18T14:05:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.806+0000 7fa4df46d700 1 Processor -- start 2023-10-18T14:05:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.806+0000 7fa4df46d700 1 -- start start 2023-10-18T14:05:40.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.806+0000 7fa4df46d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d80ff640 0x7fa4d8101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.806+0000 7fa4df46d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4d8100000 0x7fa4d8101750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.806+0000 7fa4df46d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4d8105650 0x7fa4d8101c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.806+0000 7fa4df46d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d81a4fe0 con 0x7fa4d8100000 2023-10-18T14:05:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.806+0000 7fa4df46d700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d81a5150 con 0x7fa4d8105650 2023-10-18T14:05:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.806+0000 7fa4df46d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d81a5310 con 0x7fa4d80ff640 2023-10-18T14:05:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.806+0000 7fa4dca08700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4d8100000 0x7fa4d8101750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.806+0000 7fa4dca08700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4d8100000 0x7fa4d8101750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45512/0 (socket says 172.21.15.114:45512) 2023-10-18T14:05:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.806+0000 7fa4dca08700 1 -- 172.21.15.114:0/2007788143 learned_addr learned my addr 172.21.15.114:0/2007788143 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.806+0000 7fa4dd209700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d80ff640 0x7fa4d8101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.807+0000 7fa4dda0a700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4d8105650 0x7fa4d8101c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.807+0000 7fa4dca08700 1 -- 172.21.15.114:0/2007788143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d80ff640 msgr2=0x7fa4d8101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.807+0000 7fa4dca08700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d80ff640 0x7fa4d8101210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.807+0000 7fa4dca08700 1 -- 172.21.15.114:0/2007788143 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4d8105650 msgr2=0x7fa4d8101c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.807+0000 7fa4dca08700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4d8105650 0x7fa4d8101c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.807+0000 7fa4dca08700 1 -- 172.21.15.114:0/2007788143 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d40095f0 con 0x7fa4d8100000 2023-10-18T14:05:40.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.807+0000 7fa4dca08700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4d8100000 0x7fa4d8101750 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800b530 tx=0x7fa4c800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.807+0000 7fa4ce7fc700 1 -- 172.21.15.114:0/2007788143 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8011830 con 0x7fa4d8100000 2023-10-18T14:05:40.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.807+0000 7fa4ce7fc700 1 -- 172.21.15.114:0/2007788143 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4c8011e50 con 0x7fa4d8100000 2023-10-18T14:05:40.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.807+0000 7fa4df46d700 1 -- 172.21.15.114:0/2007788143 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d81a55f0 con 0x7fa4d8100000 2023-10-18T14:05:40.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.807+0000 7fa4ce7fc700 1 -- 172.21.15.114:0/2007788143 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800f2e0 con 0x7fa4d8100000 2023-10-18T14:05:40.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.807+0000 7fa4df46d700 1 -- 172.21.15.114:0/2007788143 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d81a5b00 con 0x7fa4d8100000 2023-10-18T14:05:40.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.809+0000 7fa4ce7fc700 1 -- 172.21.15.114:0/2007788143 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fa4c8010380 con 0x7fa4d8100000 2023-10-18T14:05:40.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.810+0000 7fa4ce7fc700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa4c40a15f0 0x7fa4c40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.810+0000 7fa4dd209700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa4c40a15f0 0x7fa4c40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.810+0000 7fa4ce7fc700 1 -- 172.21.15.114:0/2007788143 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa4c80ccb10 con 0x7fa4d8100000 2023-10-18T14:05:40.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.810+0000 7fa4dd209700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa4c40a15f0 0x7fa4c40a3ab0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400b5c0 tx=0x7fa4d4005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4eb656b80 1 Processor -- start 2023-10-18T14:05:40.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4eb656b80 1 -- start start 2023-10-18T14:05:40.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4eb656b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 0x563119b8afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4eb656b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 0x563119b85090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4eb656b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b85a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4eb656b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x563119af86e0 con 0x563119b8abe0 2023-10-18T14:05:40.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4eb656b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x563119adec60 con 0x563119b855d0 2023-10-18T14:05:40.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4eb656b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563119adc580 con 0x563119b8b500 2023-10-18T14:05:40.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4dd209700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 0x563119b8afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4dd209700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 0x563119b8afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45518/0 (socket says 172.21.15.114:45518) 2023-10-18T14:05:40.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4dd209700 1 -- 172.21.15.114:0/1321705659 learned_addr learned my addr 172.21.15.114:0/1321705659 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4dca08700 1 --2- 172.21.15.114:0/1321705659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 0x563119b85090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4dda0a700 1 --2- 172.21.15.114:0/1321705659 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b85a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4dd209700 1 -- 172.21.15.114:0/1321705659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 msgr2=0x563119b85090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4dd209700 1 --2- 172.21.15.114:0/1321705659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 0x563119b85090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4dd209700 1 -- 172.21.15.114:0/1321705659 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 msgr2=0x563119b85a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4dd209700 1 --2- 172.21.15.114:0/1321705659 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b85a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4dd209700 1 -- 172.21.15.114:0/1321705659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563119a953f0 con 0x563119b8abe0 2023-10-18T14:05:40.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.811+0000 7fa4dda0a700 1 --2- 172.21.15.114:0/1321705659 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b85a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:40.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.812+0000 7fa4dd209700 1 --2- 172.21.15.114:0/1321705659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 0x563119b8afc0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4015000 tx=0x7fa4d4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b956c626fdc6a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.812+0000 7fa4c37fe700 1 -- 172.21.15.114:0/1321705659 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d402b070 con 0x563119b8abe0 2023-10-18T14:05:40.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.812+0000 7fa4c37fe700 1 -- 172.21.15.114:0/1321705659 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4d401e040 con 0x563119b8abe0 2023-10-18T14:05:40.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.812+0000 7fa4c37fe700 1 -- 172.21.15.114:0/1321705659 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d400fa40 con 0x563119b8abe0 2023-10-18T14:05:40.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.812+0000 7fa4eb656b80 1 -- 172.21.15.114:0/1321705659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 msgr2=0x563119b8afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.812+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/1321705659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 0x563119b8afc0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4015000 tx=0x7fa4d4020000 comp rx=0 tx=0).stop 2023-10-18T14:05:40.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.812+0000 7fa4eb656b80 1 -- 172.21.15.114:0/1321705659 shutdown_connections 2023-10-18T14:05:40.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/1321705659 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b85a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/1321705659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 0x563119b8afc0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/1321705659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 0x563119b85090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 -- 172.21.15.114:0/1321705659 >> 172.21.15.114:0/1321705659 conn(0x563119af9720 msgr2=0x563119b7fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 -- 172.21.15.114:0/1321705659 shutdown_connections 2023-10-18T14:05:40.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 -- 172.21.15.114:0/1321705659 wait complete. 2023-10-18T14:05:40.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 -- start start 2023-10-18T14:05:40.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 Processor -- start 2023-10-18T14:05:40.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b914a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8abe0 0x563119b8e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8b500 0x563119b8ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x563119ad7e70 con 0x563119b8b500 2023-10-18T14:05:40.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x563119a74710 con 0x563119b855d0 2023-10-18T14:05:40.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563119a743b0 con 0x563119b8abe0 2023-10-18T14:05:40.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4eb656b80 10 client.0 _ll_register_callbacks cb 0x5631199bea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:40.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4dda0a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8b500 0x563119b8ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4dda0a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8b500 0x563119b8ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45528/0 (socket says 172.21.15.114:45528) 2023-10-18T14:05:40.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4dca08700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8abe0 0x563119b8e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.813+0000 7fa4dda0a700 1 -- 172.21.15.114:0/3051267502 learned_addr learned my addr 172.21.15.114:0/3051267502 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4dd209700 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b914a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4dda0a700 1 -- 172.21.15.114:0/3051267502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8abe0 msgr2=0x563119b8e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4dda0a700 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8abe0 0x563119b8e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4dda0a700 1 -- 172.21.15.114:0/3051267502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 msgr2=0x563119b914a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4dda0a700 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b914a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4dda0a700 1 -- 172.21.15.114:0/3051267502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d810ce10 con 0x563119b8b500 2023-10-18T14:05:40.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4dca08700 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8abe0 0x563119b8e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:40.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4dd209700 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b914a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:40.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4dda0a700 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8b500 0x563119b8ef70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0008c40 tx=0x7fa4d0008f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a398810c5578c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:40.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4c0ff9700 1 -- 172.21.15.114:0/3051267502 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0019070 con 0x563119b8b500 2023-10-18T14:05:40.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4c0ff9700 1 -- 172.21.15.114:0/3051267502 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa4d0004bb0 con 0x563119b8b500 2023-10-18T14:05:40.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3051267502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563119adcef0 con 0x563119b8b500 2023-10-18T14:05:40.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4c0ff9700 1 -- 172.21.15.114:0/3051267502 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4d0007b90 con 0x563119b8b500 2023-10-18T14:05:40.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4eb656b80 10 client.16194 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:40.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.814+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3051267502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x563119902de0 con 0x563119b8b500 2023-10-18T14:05:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.815+0000 7fa4c0ff9700 1 -- 172.21.15.114:0/3051267502 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4d0023020 con 0x563119b8b500 2023-10-18T14:05:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.815+0000 7fa4c0ff9700 1 -- 172.21.15.114:0/3051267502 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa4d001c030 con 0x563119b8b500 2023-10-18T14:05:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.815+0000 7fa4eb656b80 10 client.16194 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.815+0000 7fa4eb656b80 10 client.16194 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-18T14:05:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.815+0000 7fa4eb656b80 20 client.16194 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:40.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.815+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x563119b9ef30 0x563119ba1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.815+0000 7fa4eb656b80 4 client.16194 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:40.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.815+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3051267502 --> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563119b548b0 con 0x563119b9ef30 2023-10-18T14:05:40.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.815+0000 7fa4dd209700 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x563119b9ef30 0x563119ba1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.815+0000 7fa4c0ff9700 10 client.16194 ms_handle_connect on v2:172.21.15.172:6836/1821444438 2023-10-18T14:05:40.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.815+0000 7fa4dd209700 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x563119b9ef30 0x563119ba1350 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=217d0058a55008bb server_cookie=b6b82d86908bc4fe in_seq=0 out_seq=0 2023-10-18T14:05:40.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4c0ff9700 1 -- 172.21.15.114:0/3051267502 <== mds.1 v2:172.21.15.172:6836/1821444438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563119b548b0 con 0x563119b9ef30 2023-10-18T14:05:40.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4c0ff9700 10 client.16194 handle_command_reply: tid=0 2023-10-18T14:05:40.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4eb656b80 1 client.16194 shutdown 2023-10-18T14:05:40.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3051267502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8b500 msgr2=0x563119b8ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8b500 0x563119b8ef70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0008c40 tx=0x7fa4d0008f50 comp rx=0 tx=0).stop 2023-10-18T14:05:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3051267502 shutdown_connections 2023-10-18T14:05:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8b500 0x563119b8ef70 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b914a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x563119b9ef30 0x563119ba1350 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/3051267502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8abe0 0x563119b8e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4c0ff9700 0 client.16194 ms_handle_reset on v2:172.21.15.172:6836/1821444438 2023-10-18T14:05:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3051267502 >> 172.21.15.114:0/3051267502 conn(0x563119af9720 msgr2=0x563119b84080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3051267502 shutdown_connections 2023-10-18T14:05:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.816+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3051267502 wait complete. 2023-10-18T14:05:40.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.817+0000 7fa4eb656b80 20 client.16194 trim_cache size 0 max 16384 2023-10-18T14:05:40.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.829+0000 7fa4eb656b80 1 Processor -- start 2023-10-18T14:05:40.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.829+0000 7fa4eb656b80 1 -- start start 2023-10-18T14:05:40.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.829+0000 7fa4eb656b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b855d0 0x563119b95e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.829+0000 7fa4eb656b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b8abe0 0x563119b910d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.829+0000 7fa4eb656b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 0x563119b91610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.829+0000 7fa4eb656b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x563119958920 con 0x563119b855d0 2023-10-18T14:05:40.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.829+0000 7fa4eb656b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x563119b9b990 con 0x563119b8abe0 2023-10-18T14:05:40.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.829+0000 7fa4eb656b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563119b813b0 con 0x563119b8b500 2023-10-18T14:05:40.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.829+0000 7fa4dd209700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b855d0 0x563119b95e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.830+0000 7fa4dd209700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b855d0 0x563119b95e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45532/0 (socket says 172.21.15.114:45532) 2023-10-18T14:05:40.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.830+0000 7fa4dd209700 1 -- 172.21.15.114:0/4095469546 learned_addr learned my addr 172.21.15.114:0/4095469546 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.830+0000 7fa4dda0a700 1 --2- 172.21.15.114:0/4095469546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 0x563119b91610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.830+0000 7fa4dca08700 1 --2- 172.21.15.114:0/4095469546 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b8abe0 0x563119b910d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.830+0000 7fa4dd209700 1 -- 172.21.15.114:0/4095469546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 msgr2=0x563119b91610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.830+0000 7fa4dd209700 1 --2- 172.21.15.114:0/4095469546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 0x563119b91610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.830+0000 7fa4dd209700 1 -- 172.21.15.114:0/4095469546 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b8abe0 msgr2=0x563119b910d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.830+0000 7fa4dd209700 1 --2- 172.21.15.114:0/4095469546 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b8abe0 0x563119b910d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.830+0000 7fa4dd209700 1 -- 172.21.15.114:0/4095469546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631198ebc60 con 0x563119b855d0 2023-10-18T14:05:40.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.830+0000 7fa4dd209700 1 --2- 172.21.15.114:0/4095469546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b855d0 0x563119b95e50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009990 tx=0x7fa4d40058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a550cc3621f80bd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.830+0000 7fa4c3fff700 1 -- 172.21.15.114:0/4095469546 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d402b050 con 0x563119b855d0 2023-10-18T14:05:40.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.830+0000 7fa4c3fff700 1 -- 172.21.15.114:0/4095469546 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4d4028040 con 0x563119b855d0 2023-10-18T14:05:40.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.830+0000 7fa4c3fff700 1 -- 172.21.15.114:0/4095469546 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d403d2d0 con 0x563119b855d0 2023-10-18T14:05:40.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 -- 172.21.15.114:0/4095469546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b855d0 msgr2=0x563119b95e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/4095469546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b855d0 0x563119b95e50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009990 tx=0x7fa4d40058e0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 -- 172.21.15.114:0/4095469546 shutdown_connections 2023-10-18T14:05:40.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/4095469546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 0x563119b91610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/4095469546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b855d0 0x563119b95e50 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/4095469546 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b8abe0 0x563119b910d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 -- 172.21.15.114:0/4095469546 >> 172.21.15.114:0/4095469546 conn(0x563119af9720 msgr2=0x563119ba5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 -- 172.21.15.114:0/4095469546 shutdown_connections 2023-10-18T14:05:40.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 -- 172.21.15.114:0/4095469546 wait complete. 2023-10-18T14:05:40.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 -- start start 2023-10-18T14:05:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 Processor -- start 2023-10-18T14:05:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b94020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 0x563119b94560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 0x563119bf1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x563119bf2260 con 0x563119b8abe0 2023-10-18T14:05:40.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x563119bf23a0 con 0x563119b855d0 2023-10-18T14:05:40.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.831+0000 7fa4eb656b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563119bf2510 con 0x563119b8b500 2023-10-18T14:05:40.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4eb656b80 10 client.0 _ll_register_callbacks cb 0x5631199bea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:40.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4dca08700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 0x563119b94560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4dca08700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 0x563119b94560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45540/0 (socket says 172.21.15.114:45540) 2023-10-18T14:05:40.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4dca08700 1 -- 172.21.15.114:0/3770103622 learned_addr learned my addr 172.21.15.114:0/3770103622 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:40.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4dda0a700 1 --2- 172.21.15.114:0/3770103622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 0x563119bf1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4dd209700 1 --2- 172.21.15.114:0/3770103622 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b94020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4dca08700 1 -- 172.21.15.114:0/3770103622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 msgr2=0x563119bf1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4dca08700 1 --2- 172.21.15.114:0/3770103622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 0x563119bf1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4dca08700 1 -- 172.21.15.114:0/3770103622 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 msgr2=0x563119b94020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:40.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4dca08700 1 --2- 172.21.15.114:0/3770103622 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b94020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4dca08700 1 -- 172.21.15.114:0/3770103622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563119a953f0 con 0x563119b8abe0 2023-10-18T14:05:40.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4dca08700 1 --2- 172.21.15.114:0/3770103622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 0x563119b94560 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8099980 tx=0x7fa4c809a4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b925a521c881a59 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:40.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:40.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4c0ff9700 1 -- 172.21.15.114:0/3770103622 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8099370 con 0x563119b8abe0 2023-10-18T14:05:40.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4c0ff9700 1 -- 172.21.15.114:0/3770103622 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa4c809ddd0 con 0x563119b8abe0 2023-10-18T14:05:40.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3770103622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4d401e040 con 0x563119b8abe0 2023-10-18T14:05:40.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4c0ff9700 1 -- 172.21.15.114:0/3770103622 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4c80a2010 con 0x563119b8abe0 2023-10-18T14:05:40.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4eb656b80 10 client.16200 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:40.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3770103622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x563119929250 con 0x563119b8abe0 2023-10-18T14:05:40.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.832+0000 7fa4c0ff9700 1 -- 172.21.15.114:0/3770103622 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4c8063020 con 0x563119b8abe0 2023-10-18T14:05:40.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4c0ff9700 1 -- 172.21.15.114:0/3770103622 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa4c8095a70 con 0x563119b8abe0 2023-10-18T14:05:40.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 10 client.16200 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:40.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 10 client.16200 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-18T14:05:40.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 20 client.16200 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:40.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/3770103622 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x563119bf3d00 0x563119bf6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:40.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 4 client.16200 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:05:40.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3770103622 --> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563119ad0e50 con 0x563119bf3d00 2023-10-18T14:05:40.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4dd209700 1 --2- 172.21.15.114:0/3770103622 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x563119bf3d00 0x563119bf6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:40.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4c0ff9700 10 client.16200 ms_handle_connect on v2:172.21.15.172:6836/1821444438 2023-10-18T14:05:40.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4dd209700 1 --2- 172.21.15.114:0/3770103622 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x563119bf3d00 0x563119bf6120 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=61ffacbc294dcf1c server_cookie=68c97c9a6502c7e4 in_seq=0 out_seq=0 2023-10-18T14:05:40.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4c0ff9700 1 -- 172.21.15.114:0/3770103622 <== mds.1 v2:172.21.15.172:6836/1821444438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563119ad0e50 con 0x563119bf3d00 2023-10-18T14:05:40.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4c0ff9700 10 client.16200 handle_command_reply: tid=0 2023-10-18T14:05:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 1 client.16200 shutdown 2023-10-18T14:05:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3770103622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 msgr2=0x563119b94560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/3770103622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 0x563119b94560 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8099980 tx=0x7fa4c809a4f0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3770103622 shutdown_connections 2023-10-18T14:05:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/3770103622 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x563119bf3d00 0x563119bf6120 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/3770103622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563119b8b500 0x563119bf1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/3770103622 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x563119b855d0 0x563119b94020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4c0ff9700 0 client.16200 ms_handle_reset on v2:172.21.15.172:6836/1821444438 2023-10-18T14:05:40.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 1 --2- 172.21.15.114:0/3770103622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563119b8abe0 0x563119b94560 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.833+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3770103622 >> 172.21.15.114:0/3770103622 conn(0x563119af9720 msgr2=0x563119b8d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3770103622 shutdown_connections 2023-10-18T14:05:40.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4eb656b80 1 -- 172.21.15.114:0/3770103622 wait complete. 2023-10-18T14:05:40.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4eb656b80 20 client.16200 trim_cache size 0 max 16384 2023-10-18T14:05:40.865 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:05:40.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4df46d700 1 -- 172.21.15.114:0/2007788143 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa4c40a15f0 msgr2=0x7fa4c40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4df46d700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa4c40a15f0 0x7fa4c40a3ab0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400b5c0 tx=0x7fa4d4005960 comp rx=0 tx=0).stop 2023-10-18T14:05:40.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4df46d700 1 -- 172.21.15.114:0/2007788143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4d8100000 msgr2=0x7fa4d8101750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:40.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4df46d700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4d8100000 0x7fa4d8101750 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800b530 tx=0x7fa4c800b840 comp rx=0 tx=0).stop 2023-10-18T14:05:40.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4df46d700 1 -- 172.21.15.114:0/2007788143 shutdown_connections 2023-10-18T14:05:40.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4df46d700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa4c40a15f0 0x7fa4c40a3ab0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4df46d700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa4d8105650 0x7fa4d8101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4df46d700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d80ff640 0x7fa4d8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4df46d700 1 --2- 172.21.15.114:0/2007788143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4d8100000 0x7fa4d8101750 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:40.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4df46d700 1 -- 172.21.15.114:0/2007788143 >> 172.21.15.114:0/2007788143 conn(0x7fa4d8076790 msgr2=0x7fa4d80691a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:40.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4df46d700 1 -- 172.21.15.114:0/2007788143 shutdown_connections 2023-10-18T14:05:40.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:40.834+0000 7fa4df46d700 1 -- 172.21.15.114:0/2007788143 wait complete. 2023-10-18T14:05:40.869 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-18T14:05:40.931 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:40 smithi114 ceph-mon[99494]: pgmap v329: 97 pgs: 97 active+clean; 54 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 1.63k op/s 2023-10-18T14:05:40.931 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:40 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3865636672' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:05:40.956 INFO:tasks.workunit.client.0.smithi114.stdout:config.status: creating include/config.h 2023-10-18T14:05:41.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:40 smithi158 ceph-mon[103317]: pgmap v329: 97 pgs: 97 active+clean; 54 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 1.63k op/s 2023-10-18T14:05:41.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:40 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3865636672' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:05:41.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.033+0000 7f1295c6b700 1 -- 172.21.15.114:0/4238470287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1290100000 msgr2=0x7f129010c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.033+0000 7f1295c6b700 1 --2- 172.21.15.114:0/4238470287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1290100000 0x7f129010c4a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f128800b0a0 tx=0x7f128800b3b0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.033+0000 7f1295c6b700 1 -- 172.21.15.114:0/4238470287 shutdown_connections 2023-10-18T14:05:41.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.033+0000 7f1295c6b700 1 --2- 172.21.15.114:0/4238470287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1290100000 0x7f129010c4a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.033+0000 7f1295c6b700 1 --2- 172.21.15.114:0/4238470287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12901056e0 0x7f1290105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.033+0000 7f1295c6b700 1 --2- 172.21.15.114:0/4238470287 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12900ff640 0x7f12900ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.033+0000 7f1295c6b700 1 -- 172.21.15.114:0/4238470287 >> 172.21.15.114:0/4238470287 conn(0x7f12900767f0 msgr2=0x7f1290076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:41.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.033+0000 7f1295c6b700 1 -- 172.21.15.114:0/4238470287 shutdown_connections 2023-10-18T14:05:41.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.033+0000 7f1295c6b700 1 -- 172.21.15.114:0/4238470287 wait complete. 2023-10-18T14:05:41.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.034+0000 7f1295c6b700 1 Processor -- start 2023-10-18T14:05:41.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.034+0000 7f1295c6b700 1 -- start start 2023-10-18T14:05:41.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.034+0000 7f1295c6b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12900ff640 0x7f129019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.034+0000 7f1295c6b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1290100000 0x7f129019bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.034+0000 7f1295c6b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12901056e0 0x7f12901959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.034+0000 7f1295c6b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1290196030 con 0x7f1290100000 2023-10-18T14:05:41.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.034+0000 7f1295c6b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12901961a0 con 0x7f12901056e0 2023-10-18T14:05:41.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.034+0000 7f1295c6b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1290196360 con 0x7f12900ff640 2023-10-18T14:05:41.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.034+0000 7f128effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1290100000 0x7f129019bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.034+0000 7f128effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1290100000 0x7f129019bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45554/0 (socket says 172.21.15.114:45554) 2023-10-18T14:05:41.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.034+0000 7f128effd700 1 -- 172.21.15.114:0/1718501038 learned_addr learned my addr 172.21.15.114:0/1718501038 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:41.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.034+0000 7f128f7fe700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12900ff640 0x7f129019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.035+0000 7f128ffff700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12901056e0 0x7f12901959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.035+0000 7f128effd700 1 -- 172.21.15.114:0/1718501038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12900ff640 msgr2=0x7f129019b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.035+0000 7f128effd700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12900ff640 0x7f129019b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.035+0000 7f128effd700 1 -- 172.21.15.114:0/1718501038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12901056e0 msgr2=0x7f12901959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.035+0000 7f128effd700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12901056e0 0x7f12901959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.035+0000 7f128effd700 1 -- 172.21.15.114:0/1718501038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288009d00 con 0x7f1290100000 2023-10-18T14:05:41.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.035+0000 7f128effd700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1290100000 0x7f129019bde0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f128000e9a0 tx=0x7f128000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:41.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.035+0000 7f128cff9700 1 -- 172.21.15.114:0/1718501038 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1280009790 con 0x7f1290100000 2023-10-18T14:05:41.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.035+0000 7f128cff9700 1 -- 172.21.15.114:0/1718501038 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1280010430 con 0x7f1290100000 2023-10-18T14:05:41.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.035+0000 7f1295c6b700 1 -- 172.21.15.114:0/1718501038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1290196640 con 0x7f1290100000 2023-10-18T14:05:41.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.035+0000 7f128cff9700 1 -- 172.21.15.114:0/1718501038 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1280018680 con 0x7f1290100000 2023-10-18T14:05:41.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.035+0000 7f1295c6b700 1 -- 172.21.15.114:0/1718501038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12901a2890 con 0x7f1290100000 2023-10-18T14:05:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.038+0000 7f128cff9700 1 -- 172.21.15.114:0/1718501038 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f12800105a0 con 0x7f1290100000 2023-10-18T14:05:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.038+0000 7f128cff9700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f12780a15f0 0x7f12780a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f128cff9700 1 -- 172.21.15.114:0/1718501038 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f1280014070 con 0x7f1290100000 2023-10-18T14:05:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f128f7fe700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f12780a15f0 0x7f12780a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f12a1e54b80 1 Processor -- start 2023-10-18T14:05:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f12a1e54b80 1 -- start start 2023-10-18T14:05:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f12a1e54b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc2823a0 0x559edc282780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f128f7fe700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f12780a15f0 0x7f12780a3ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1284009be0 tx=0x7f1284009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:41.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f12a1e54b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc275090 0x559edc2754f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f12a1e54b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275a30 0x559edc28a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f12a1e54b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559edc1e86e0 con 0x559edc275a30 2023-10-18T14:05:41.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f12a1e54b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559edc1cec60 con 0x559edc2823a0 2023-10-18T14:05:41.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f12a1e54b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559edc1cc580 con 0x559edc275090 2023-10-18T14:05:41.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f128ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275a30 0x559edc28a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f128effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc275090 0x559edc2754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f128f7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc2823a0 0x559edc282780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f128ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275a30 0x559edc28a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45564/0 (socket says 172.21.15.114:45564) 2023-10-18T14:05:41.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.039+0000 7f128ffff700 1 -- 172.21.15.114:0/1774100574 learned_addr learned my addr 172.21.15.114:0/1774100574 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.040+0000 7f128ffff700 1 -- 172.21.15.114:0/1774100574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc275090 msgr2=0x559edc2754f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.040+0000 7f128ffff700 1 --2- 172.21.15.114:0/1774100574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc275090 0x559edc2754f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.040+0000 7f128ffff700 1 -- 172.21.15.114:0/1774100574 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc2823a0 msgr2=0x559edc282780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.040+0000 7f128ffff700 1 --2- 172.21.15.114:0/1774100574 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc2823a0 0x559edc282780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.040+0000 7f128ffff700 1 -- 172.21.15.114:0/1774100574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559edc1853f0 con 0x559edc275a30 2023-10-18T14:05:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.040+0000 7f128f7fe700 1 --2- 172.21.15.114:0/1774100574 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc2823a0 0x559edc282780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.040+0000 7f128effd700 1 --2- 172.21.15.114:0/1774100574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc275090 0x559edc2754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.040+0000 7f128ffff700 1 --2- 172.21.15.114:0/1774100574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275a30 0x559edc28a210 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1288009c90 tx=0x7f12880092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3465645487a6f6f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.040+0000 7f1275ffb700 1 -- 172.21.15.114:0/1774100574 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128800e040 con 0x559edc275a30 2023-10-18T14:05:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.040+0000 7f1275ffb700 1 -- 172.21.15.114:0/1774100574 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1288007d30 con 0x559edc275a30 2023-10-18T14:05:41.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.040+0000 7f1275ffb700 1 -- 172.21.15.114:0/1774100574 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288007740 con 0x559edc275a30 2023-10-18T14:05:41.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.041+0000 7f12a1e54b80 1 -- 172.21.15.114:0/1774100574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275a30 msgr2=0x559edc28a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.041+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/1774100574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275a30 0x559edc28a210 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1288009c90 tx=0x7f12880092e0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.041+0000 7f12a1e54b80 1 -- 172.21.15.114:0/1774100574 shutdown_connections 2023-10-18T14:05:41.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.041+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/1774100574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275a30 0x559edc28a210 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.041+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/1774100574 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc2823a0 0x559edc282780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.041+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/1774100574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc275090 0x559edc2754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.041+0000 7f12a1e54b80 1 -- 172.21.15.114:0/1774100574 >> 172.21.15.114:0/1774100574 conn(0x559edc1e9720 msgr2=0x559edc26f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:41.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.041+0000 7f12a1e54b80 1 -- 172.21.15.114:0/1774100574 shutdown_connections 2023-10-18T14:05:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.041+0000 7f12a1e54b80 1 -- 172.21.15.114:0/1774100574 wait complete. 2023-10-18T14:05:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.041+0000 7f12a1e54b80 1 -- start start 2023-10-18T14:05:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.041+0000 7f12a1e54b80 1 Processor -- start 2023-10-18T14:05:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f12a1e54b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc28a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f12a1e54b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc275a30 0x559edc287490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f12a1e54b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc2823a0 0x559edc287aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f12a1e54b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559edc1c7e70 con 0x559edc275090 2023-10-18T14:05:41.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f12a1e54b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559edc164710 con 0x559edc275a30 2023-10-18T14:05:41.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f12a1e54b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559edc1643b0 con 0x559edc2823a0 2023-10-18T14:05:41.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f12a1e54b80 10 client.0 _ll_register_callbacks cb 0x559edc0aea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:41.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f128f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc28a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f128f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc28a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45566/0 (socket says 172.21.15.114:45566) 2023-10-18T14:05:41.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f128f7fe700 1 -- 172.21.15.114:0/2674022755 learned_addr learned my addr 172.21.15.114:0/2674022755 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:41.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f128effd700 1 --2- 172.21.15.114:0/2674022755 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc275a30 0x559edc287490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f128f7fe700 1 -- 172.21.15.114:0/2674022755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc2823a0 msgr2=0x559edc287aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f128f7fe700 1 --2- 172.21.15.114:0/2674022755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc2823a0 0x559edc287aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f128f7fe700 1 -- 172.21.15.114:0/2674022755 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc275a30 msgr2=0x559edc287490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f128f7fe700 1 --2- 172.21.15.114:0/2674022755 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc275a30 0x559edc287490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f128f7fe700 1 -- 172.21.15.114:0/2674022755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1284017070 con 0x559edc275090 2023-10-18T14:05:41.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f128f7fe700 1 --2- 172.21.15.114:0/2674022755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc28a150 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f128401f850 tx=0x7f12840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f00c4fadb2e478 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:41.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f126effd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:41.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.042+0000 7f126effd700 1 -- 172.21.15.114:0/2674022755 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128401d6c0 con 0x559edc275090 2023-10-18T14:05:41.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f126effd700 1 -- 172.21.15.114:0/2674022755 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f128401d820 con 0x559edc275090 2023-10-18T14:05:41.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f12a1e54b80 1 -- 172.21.15.114:0/2674022755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559edc1ccef0 con 0x559edc275090 2023-10-18T14:05:41.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f126effd700 1 -- 172.21.15.114:0/2674022755 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f128401d9e0 con 0x559edc275090 2023-10-18T14:05:41.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f12a1e54b80 10 client.16212 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:41.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f12a1e54b80 1 -- 172.21.15.114:0/2674022755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f129010cd90 con 0x559edc275090 2023-10-18T14:05:41.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f126effd700 1 -- 172.21.15.114:0/2674022755 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559edc1ccef0 con 0x559edc275090 2023-10-18T14:05:41.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f126effd700 1 -- 172.21.15.114:0/2674022755 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1284028cf0 con 0x559edc275090 2023-10-18T14:05:41.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f12a1e54b80 10 client.16212 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:41.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f12a1e54b80 10 client.16212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:41.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f12a1e54b80 20 client.16212 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:41.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/2674022755 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559edc297850 0x559edc299c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f12a1e54b80 4 client.16212 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:41.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f12a1e54b80 1 -- 172.21.15.114:0/2674022755 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559edc2448b0 con 0x559edc297850 2023-10-18T14:05:41.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.043+0000 7f128effd700 1 --2- 172.21.15.114:0/2674022755 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559edc297850 0x559edc299c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.044+0000 7f126effd700 10 client.16212 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:41.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.044+0000 7f128effd700 1 --2- 172.21.15.114:0/2674022755 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559edc297850 0x559edc299c70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b6d3f4574f69107 server_cookie=1866d6152d473d66 in_seq=0 out_seq=0 2023-10-18T14:05:41.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f126effd700 1 -- 172.21.15.114:0/2674022755 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559edc2448b0 con 0x559edc297850 2023-10-18T14:05:41.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f126effd700 10 client.16212 handle_command_reply: tid=0 2023-10-18T14:05:41.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f12a1e54b80 1 client.16212 shutdown 2023-10-18T14:05:41.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f12a1e54b80 1 -- 172.21.15.114:0/2674022755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 msgr2=0x559edc28a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/2674022755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc28a150 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f128401f850 tx=0x7f12840047c0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f12a1e54b80 1 -- 172.21.15.114:0/2674022755 shutdown_connections 2023-10-18T14:05:41.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/2674022755 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559edc297850 0x559edc299c70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/2674022755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc2823a0 0x559edc287aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/2674022755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc28a150 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f126effd700 0 client.16212 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:41.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/2674022755 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc275a30 0x559edc287490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f12a1e54b80 1 -- 172.21.15.114:0/2674022755 >> 172.21.15.114:0/2674022755 conn(0x559edc1e9720 msgr2=0x559edc274080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:41.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f12a1e54b80 1 -- 172.21.15.114:0/2674022755 shutdown_connections 2023-10-18T14:05:41.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f12a1e54b80 1 -- 172.21.15.114:0/2674022755 wait complete. 2023-10-18T14:05:41.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.045+0000 7f12a1e54b80 20 client.16212 trim_cache size 0 max 16384 2023-10-18T14:05:41.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:40 smithi172 ceph-mon[103574]: pgmap v329: 97 pgs: 97 active+clean; 54 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 1.63k op/s 2023-10-18T14:05:41.073 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:40 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3865636672' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:05:41.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.059+0000 7f12a1e54b80 1 Processor -- start 2023-10-18T14:05:41.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.059+0000 7f12a1e54b80 1 -- start start 2023-10-18T14:05:41.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.059+0000 7f12a1e54b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc26a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.059+0000 7f12a1e54b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc275a30 0x559edc289c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.059+0000 7f12a1e54b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc2823a0 0x559edc281550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.059+0000 7f12a1e54b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559edc048920 con 0x559edc275090 2023-10-18T14:05:41.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.059+0000 7f12a1e54b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559edc2880d0 con 0x559edc2823a0 2023-10-18T14:05:41.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.059+0000 7f12a1e54b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559edc275860 con 0x559edc275a30 2023-10-18T14:05:41.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.059+0000 7f128f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc26a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.059+0000 7f128f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc26a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45574/0 (socket says 172.21.15.114:45574) 2023-10-18T14:05:41.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.059+0000 7f128f7fe700 1 -- 172.21.15.114:0/2921278051 learned_addr learned my addr 172.21.15.114:0/2921278051 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:41.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.059+0000 7f128effd700 1 --2- 172.21.15.114:0/2921278051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc275a30 0x559edc289c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.059+0000 7f128ffff700 1 --2- 172.21.15.114:0/2921278051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc2823a0 0x559edc281550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.060+0000 7f128f7fe700 1 -- 172.21.15.114:0/2921278051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc275a30 msgr2=0x559edc289c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.060+0000 7f128f7fe700 1 --2- 172.21.15.114:0/2921278051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc275a30 0x559edc289c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.060+0000 7f128f7fe700 1 -- 172.21.15.114:0/2921278051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc2823a0 msgr2=0x559edc281550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.060+0000 7f128f7fe700 1 --2- 172.21.15.114:0/2921278051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc2823a0 0x559edc281550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.060+0000 7f128f7fe700 1 -- 172.21.15.114:0/2921278051 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559edbff2de0 con 0x559edc275090 2023-10-18T14:05:41.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.060+0000 7f128f7fe700 1 --2- 172.21.15.114:0/2921278051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc26a5d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1284016040 tx=0x7f1284004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad246735ad6dba5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:41.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.060+0000 7f12767fc700 1 -- 172.21.15.114:0/2921278051 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128401a620 con 0x559edc275090 2023-10-18T14:05:41.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.060+0000 7f12767fc700 1 -- 172.21.15.114:0/2921278051 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f128401a780 con 0x559edc275090 2023-10-18T14:05:41.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.060+0000 7f12767fc700 1 -- 172.21.15.114:0/2921278051 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128401de40 con 0x559edc275090 2023-10-18T14:05:41.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.061+0000 7f12a1e54b80 1 -- 172.21.15.114:0/2921278051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 msgr2=0x559edc26a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.061+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/2921278051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc26a5d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1284016040 tx=0x7f1284004750 comp rx=0 tx=0).stop 2023-10-18T14:05:41.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.061+0000 7f12a1e54b80 1 -- 172.21.15.114:0/2921278051 shutdown_connections 2023-10-18T14:05:41.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.061+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/2921278051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc2823a0 0x559edc281550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.061+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/2921278051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc26a5d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.061+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/2921278051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc275a30 0x559edc289c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.061+0000 7f12a1e54b80 1 -- 172.21.15.114:0/2921278051 >> 172.21.15.114:0/2921278051 conn(0x559edc1e9720 msgr2=0x559edc26f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:41.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.061+0000 7f12a1e54b80 1 -- 172.21.15.114:0/2921278051 shutdown_connections 2023-10-18T14:05:41.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.061+0000 7f12a1e54b80 1 -- 172.21.15.114:0/2921278051 wait complete. 2023-10-18T14:05:41.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.061+0000 7f12a1e54b80 1 -- start start 2023-10-18T14:05:41.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.061+0000 7f12a1e54b80 1 Processor -- start 2023-10-18T14:05:41.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f12a1e54b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc28e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f12a1e54b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc275a30 0x559edc288c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f12a1e54b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc2823a0 0x559edc2891b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f12a1e54b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559edc289880 con 0x559edc275090 2023-10-18T14:05:41.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f12a1e54b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559edc2899f0 con 0x559edc275a30 2023-10-18T14:05:41.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f12a1e54b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559edc2eb6c0 con 0x559edc2823a0 2023-10-18T14:05:41.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f12a1e54b80 10 client.0 _ll_register_callbacks cb 0x559edc0aea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:41.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f128f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc28e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f128f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc28e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45580/0 (socket says 172.21.15.114:45580) 2023-10-18T14:05:41.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f128f7fe700 1 -- 172.21.15.114:0/3083621312 learned_addr learned my addr 172.21.15.114:0/3083621312 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:41.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f128ffff700 1 --2- 172.21.15.114:0/3083621312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc2823a0 0x559edc2891b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f128effd700 1 --2- 172.21.15.114:0/3083621312 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc275a30 0x559edc288c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f128f7fe700 1 -- 172.21.15.114:0/3083621312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc2823a0 msgr2=0x559edc2891b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f128f7fe700 1 --2- 172.21.15.114:0/3083621312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc2823a0 0x559edc2891b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f128f7fe700 1 -- 172.21.15.114:0/3083621312 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc275a30 msgr2=0x559edc288c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f128f7fe700 1 --2- 172.21.15.114:0/3083621312 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc275a30 0x559edc288c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f128f7fe700 1 -- 172.21.15.114:0/3083621312 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129010cd90 con 0x559edc275090 2023-10-18T14:05:41.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f128f7fe700 1 --2- 172.21.15.114:0/3083621312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc28e760 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1284000c00 tx=0x7f128401ddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58eaf74a7077fcd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:41.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f126effd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:41.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f126effd700 1 -- 172.21.15.114:0/3083621312 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128401ab00 con 0x559edc275090 2023-10-18T14:05:41.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.062+0000 7f126effd700 1 -- 172.21.15.114:0/3083621312 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f128401ac60 con 0x559edc275090 2023-10-18T14:05:41.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.063+0000 7f12a1e54b80 1 -- 172.21.15.114:0/3083621312 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1288007d30 con 0x559edc275090 2023-10-18T14:05:41.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.063+0000 7f126effd700 1 -- 172.21.15.114:0/3083621312 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f128401ae20 con 0x559edc275090 2023-10-18T14:05:41.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.063+0000 7f12a1e54b80 10 client.16218 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:41.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.063+0000 7f12a1e54b80 1 -- 172.21.15.114:0/3083621312 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x559edbfdbc60 con 0x559edc275090 2023-10-18T14:05:41.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.063+0000 7f126effd700 1 -- 172.21.15.114:0/3083621312 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1288007d30 con 0x559edc275090 2023-10-18T14:05:41.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.063+0000 7f126effd700 1 -- 172.21.15.114:0/3083621312 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1284004c50 con 0x559edc275090 2023-10-18T14:05:41.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.063+0000 7f12a1e54b80 10 client.16218 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:41.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.063+0000 7f12a1e54b80 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:41.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.063+0000 7f12a1e54b80 20 client.16218 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:41.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.063+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/3083621312 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559edc2eca60 0x559edc2eee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.063+0000 7f12a1e54b80 4 client.16218 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:05:41.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.063+0000 7f12a1e54b80 1 -- 172.21.15.114:0/3083621312 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559edc1c0e50 con 0x559edc2eca60 2023-10-18T14:05:41.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.063+0000 7f128effd700 1 --2- 172.21.15.114:0/3083621312 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559edc2eca60 0x559edc2eee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.064+0000 7f126effd700 10 client.16218 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:41.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.064+0000 7f128effd700 1 --2- 172.21.15.114:0/3083621312 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559edc2eca60 0x559edc2eee80 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3687476bfca7a473 server_cookie=a32c652b629cf3fe in_seq=0 out_seq=0 2023-10-18T14:05:41.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f126effd700 1 -- 172.21.15.114:0/3083621312 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559edc1c0e50 con 0x559edc2eca60 2023-10-18T14:05:41.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f126effd700 10 client.16218 handle_command_reply: tid=0 2023-10-18T14:05:41.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f12a1e54b80 1 client.16218 shutdown 2023-10-18T14:05:41.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f12a1e54b80 1 -- 172.21.15.114:0/3083621312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 msgr2=0x559edc28e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/3083621312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc28e760 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1284000c00 tx=0x7f128401ddb0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f12a1e54b80 1 -- 172.21.15.114:0/3083621312 shutdown_connections 2023-10-18T14:05:41.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/3083621312 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559edc2eca60 0x559edc2eee80 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/3083621312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559edc2823a0 0x559edc2891b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/3083621312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559edc275090 0x559edc28e760 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f126effd700 0 client.16218 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:41.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f12a1e54b80 1 --2- 172.21.15.114:0/3083621312 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559edc275a30 0x559edc288c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f12a1e54b80 1 -- 172.21.15.114:0/3083621312 >> 172.21.15.114:0/3083621312 conn(0x559edc1e9720 msgr2=0x559edc285cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:41.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f12a1e54b80 1 -- 172.21.15.114:0/3083621312 shutdown_connections 2023-10-18T14:05:41.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f12a1e54b80 1 -- 172.21.15.114:0/3083621312 wait complete. 2023-10-18T14:05:41.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.067+0000 7f12a1e54b80 20 client.16218 trim_cache size 0 max 16384 2023-10-18T14:05:41.097 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:05:41.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.068+0000 7f1295c6b700 1 -- 172.21.15.114:0/1718501038 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f12780a15f0 msgr2=0x7f12780a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.068+0000 7f1295c6b700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f12780a15f0 0x7f12780a3ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1284009be0 tx=0x7f1284009260 comp rx=0 tx=0).stop 2023-10-18T14:05:41.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.068+0000 7f1295c6b700 1 -- 172.21.15.114:0/1718501038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1290100000 msgr2=0x7f129019bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.068+0000 7f1295c6b700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1290100000 0x7f129019bde0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f128000e9a0 tx=0x7f128000ecb0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.068+0000 7f1295c6b700 1 -- 172.21.15.114:0/1718501038 shutdown_connections 2023-10-18T14:05:41.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.068+0000 7f1295c6b700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f12780a15f0 0x7f12780a3ab0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.068+0000 7f1295c6b700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12901056e0 0x7f12901959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.068+0000 7f1295c6b700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12900ff640 0x7f129019b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.068+0000 7f1295c6b700 1 --2- 172.21.15.114:0/1718501038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1290100000 0x7f129019bde0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.068+0000 7f1295c6b700 1 -- 172.21.15.114:0/1718501038 >> 172.21.15.114:0/1718501038 conn(0x7f12900767f0 msgr2=0x7f12900fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:41.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.068+0000 7f1295c6b700 1 -- 172.21.15.114:0/1718501038 shutdown_connections 2023-10-18T14:05:41.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:41.068+0000 7f1295c6b700 1 -- 172.21.15.114:0/1718501038 wait complete. 2023-10-18T14:05:41.101 INFO:tasks.workunit.client.0.smithi114.stdout:config.status: executing libtool commands 2023-10-18T14:05:41.411 INFO:tasks.workunit.client.0.smithi114.stdout:Building include 2023-10-18T14:05:41.411 INFO:tasks.workunit.client.0.smithi114.stdout:Building lib 2023-10-18T14:05:41.411 INFO:tasks.workunit.client.0.smithi114.stdout:Building tests 2023-10-18T14:05:41.419 INFO:tasks.workunit.client.0.smithi114.stdout: [LTDEP] 2023-10-18T14:05:41.561 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] dataascii.lo 2023-10-18T14:05:41.561 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] databin.lo 2023-10-18T14:05:41.561 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] datapid.lo 2023-10-18T14:05:41.561 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] file_lock.lo 2023-10-18T14:05:41.721 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] forker.lo 2023-10-18T14:05:41.755 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] pattern.lo 2023-10-18T14:05:41.772 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] open_flags.lo 2023-10-18T14:05:41.778 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] random_range.lo 2023-10-18T14:05:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.861+0000 7f81482b3700 1 -- 172.21.15.114:0/1105378653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8140067fd0 msgr2=0x7f81400683b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.861+0000 7f81482b3700 1 --2- 172.21.15.114:0/1105378653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8140067fd0 0x7f81400683b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f813c0099c0 tx=0x7f813c009cd0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.861+0000 7f81482b3700 1 -- 172.21.15.114:0/1105378653 shutdown_connections 2023-10-18T14:05:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.861+0000 7f81482b3700 1 --2- 172.21.15.114:0/1105378653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8140105ae0 0x7f814010d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.861+0000 7f81482b3700 1 --2- 172.21.15.114:0/1105378653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8140067fd0 0x7f81400683b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.861+0000 7f81482b3700 1 --2- 172.21.15.114:0/1105378653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8140105120 0x7f81401055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.861+0000 7f81482b3700 1 -- 172.21.15.114:0/1105378653 >> 172.21.15.114:0/1105378653 conn(0x7f8140076790 msgr2=0x7f8140076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.861+0000 7f81482b3700 1 -- 172.21.15.114:0/1105378653 shutdown_connections 2023-10-18T14:05:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.861+0000 7f81482b3700 1 -- 172.21.15.114:0/1105378653 wait complete. 2023-10-18T14:05:41.868 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.862+0000 7f81482b3700 1 Processor -- start 2023-10-18T14:05:41.869 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.862+0000 7f81482b3700 1 -- start start 2023-10-18T14:05:41.869 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.862+0000 7f81482b3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8140067fd0 0x7f814019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.869 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.862+0000 7f81482b3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8140105120 0x7f814019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.869 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.862+0000 7f81482b3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8140105ae0 0x7f8140194790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.870 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.862+0000 7f81482b3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8140194e00 con 0x7f8140067fd0 2023-10-18T14:05:41.870 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.862+0000 7f81482b3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8140194f70 con 0x7f8140105120 2023-10-18T14:05:41.870 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.862+0000 7f81482b3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8140195130 con 0x7f8140105ae0 2023-10-18T14:05:41.870 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f8146850700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8140105ae0 0x7f8140194790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.870 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f814604f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8140067fd0 0x7f814019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.871 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f8146850700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8140105ae0 0x7f8140194790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49530/0 (socket says 172.21.15.114:49530) 2023-10-18T14:05:41.871 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f8146850700 1 -- 172.21.15.114:0/1581334348 learned_addr learned my addr 172.21.15.114:0/1581334348 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:41.871 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f814584e700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8140105120 0x7f814019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.871 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f814604f700 1 -- 172.21.15.114:0/1581334348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8140105ae0 msgr2=0x7f8140194790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.871 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f814604f700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8140105ae0 0x7f8140194790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.872 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f814604f700 1 -- 172.21.15.114:0/1581334348 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8140105120 msgr2=0x7f814019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.872 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f814604f700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8140105120 0x7f814019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.872 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f814604f700 1 -- 172.21.15.114:0/1581334348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c0095f0 con 0x7f8140067fd0 2023-10-18T14:05:41.872 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f8146850700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8140105ae0 0x7f8140194790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:41.872 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f814584e700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8140105120 0x7f814019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f814604f700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8140067fd0 0x7f814019a660 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f813c0098e0 tx=0x7f813c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f81377fe700 1 -- 172.21.15.114:0/1581334348 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c01c070 con 0x7f8140067fd0 2023-10-18T14:05:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f81482b3700 1 -- 172.21.15.114:0/1581334348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81401953b0 con 0x7f8140067fd0 2023-10-18T14:05:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f81377fe700 1 -- 172.21.15.114:0/1581334348 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f813c00fd80 con 0x7f8140067fd0 2023-10-18T14:05:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f81377fe700 1 -- 172.21.15.114:0/1581334348 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c022c10 con 0x7f8140067fd0 2023-10-18T14:05:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.863+0000 7f81482b3700 1 -- 172.21.15.114:0/1581334348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81401a1650 con 0x7f8140067fd0 2023-10-18T14:05:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.866+0000 7f81377fe700 1 -- 172.21.15.114:0/1581334348 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f813c020070 con 0x7f8140067fd0 2023-10-18T14:05:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.867+0000 7f81377fe700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f812c0a15f0 0x7f812c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.867+0000 7f81377fe700 1 -- 172.21.15.114:0/1581334348 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f813c0cd9b0 con 0x7f8140067fd0 2023-10-18T14:05:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.868+0000 7f815449cb80 1 Processor -- start 2023-10-18T14:05:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.868+0000 7f814584e700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f812c0a15f0 0x7f812c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.869+0000 7f815449cb80 1 -- start start 2023-10-18T14:05:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.869+0000 7f814584e700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f812c0a15f0 0x7f812c0a3ab0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8140195bb0 tx=0x7f8130009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.869+0000 7f815449cb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557db3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.869+0000 7f815449cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557db3f50 0x55c557daded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.869+0000 7f815449cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557dae410 0x55c557dae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.869+0000 7f815449cb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c557d21680 con 0x55c557db3630 2023-10-18T14:05:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.869+0000 7f815449cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c557d07c00 con 0x55c557db3f50 2023-10-18T14:05:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.869+0000 7f815449cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c557d05520 con 0x55c557dae410 2023-10-18T14:05:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.869+0000 7f814604f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557db3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.869+0000 7f814604f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557db3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45600/0 (socket says 172.21.15.114:45600) 2023-10-18T14:05:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.869+0000 7f814604f700 1 -- 172.21.15.114:0/1401241955 learned_addr learned my addr 172.21.15.114:0/1401241955 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.869+0000 7f8146850700 1 --2- 172.21.15.114:0/1401241955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557dae410 0x55c557dae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.869+0000 7f814584e700 1 --2- 172.21.15.114:0/1401241955 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557db3f50 0x55c557daded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.870+0000 7f814604f700 1 -- 172.21.15.114:0/1401241955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557dae410 msgr2=0x55c557dae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.870+0000 7f814604f700 1 --2- 172.21.15.114:0/1401241955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557dae410 0x55c557dae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.870+0000 7f814604f700 1 -- 172.21.15.114:0/1401241955 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557db3f50 msgr2=0x55c557daded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.870+0000 7f814604f700 1 --2- 172.21.15.114:0/1401241955 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557db3f50 0x55c557daded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.870+0000 7f814604f700 1 -- 172.21.15.114:0/1401241955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c557cbe390 con 0x55c557db3630 2023-10-18T14:05:41.882 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.870+0000 7f8146850700 1 --2- 172.21.15.114:0/1401241955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557dae410 0x55c557dae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:41.882 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.870+0000 7f814604f700 1 --2- 172.21.15.114:0/1401241955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557db3a10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f813c096fa0 tx=0x7f813c09a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1e2ef452c484ec server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:41.882 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.870+0000 7f8134d82700 1 -- 172.21.15.114:0/1401241955 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c09aaa0 con 0x55c557db3630 2023-10-18T14:05:41.882 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.870+0000 7f8134d82700 1 -- 172.21.15.114:0/1401241955 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f813c09ebf0 con 0x55c557db3630 2023-10-18T14:05:41.882 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.870+0000 7f8134d82700 1 -- 172.21.15.114:0/1401241955 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c099f90 con 0x55c557db3630 2023-10-18T14:05:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.871+0000 7f815449cb80 1 -- 172.21.15.114:0/1401241955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 msgr2=0x55c557db3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.871+0000 7f815449cb80 1 --2- 172.21.15.114:0/1401241955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557db3a10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f813c096fa0 tx=0x7f813c09a8f0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.871+0000 7f815449cb80 1 -- 172.21.15.114:0/1401241955 shutdown_connections 2023-10-18T14:05:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.871+0000 7f815449cb80 1 --2- 172.21.15.114:0/1401241955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557dae410 0x55c557dae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.871+0000 7f815449cb80 1 --2- 172.21.15.114:0/1401241955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557db3a10 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.871+0000 7f815449cb80 1 --2- 172.21.15.114:0/1401241955 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557db3f50 0x55c557daded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.871+0000 7f815449cb80 1 -- 172.21.15.114:0/1401241955 >> 172.21.15.114:0/1401241955 conn(0x55c557d226c0 msgr2=0x55c557da85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.871+0000 7f815449cb80 1 -- 172.21.15.114:0/1401241955 shutdown_connections 2023-10-18T14:05:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.871+0000 7f815449cb80 1 -- 172.21.15.114:0/1401241955 wait complete. 2023-10-18T14:05:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.871+0000 7f815449cb80 1 -- start start 2023-10-18T14:05:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.871+0000 7f815449cb80 1 Processor -- start 2023-10-18T14:05:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f815449cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557dae410 0x55c557db9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f815449cb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557db7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f815449cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557db3f50 0x55c557db7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f815449cb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c557d00e10 con 0x55c557db3630 2023-10-18T14:05:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f815449cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c557c9d6b0 con 0x55c557db3f50 2023-10-18T14:05:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f815449cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c557c9d350 con 0x55c557dae410 2023-10-18T14:05:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f815449cb80 10 client.0 _ll_register_callbacks cb 0x55c557be7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f814604f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557dae410 0x55c557db9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f8146850700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557db3f50 0x55c557db7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f814604f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557dae410 0x55c557db9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49542/0 (socket says 172.21.15.114:49542) 2023-10-18T14:05:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f8146850700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557db3f50 0x55c557db7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41752/0 (socket says 172.21.15.114:41752) 2023-10-18T14:05:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f814604f700 1 -- 172.21.15.114:0/2272261176 learned_addr learned my addr 172.21.15.114:0/2272261176 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f814584e700 1 --2- 172.21.15.114:0/2272261176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557db7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f8146850700 1 -- 172.21.15.114:0/2272261176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557dae410 msgr2=0x55c557db9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f8146850700 1 --2- 172.21.15.114:0/2272261176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557dae410 0x55c557db9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f8146850700 1 -- 172.21.15.114:0/2272261176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 msgr2=0x55c557db7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f8146850700 1 --2- 172.21.15.114:0/2272261176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557db7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f8146850700 1 -- 172.21.15.114:0/2272261176 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81380090f0 con 0x55c557db3f50 2023-10-18T14:05:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.872+0000 7f814584e700 1 --2- 172.21.15.114:0/2272261176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557db7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f8146850700 1 --2- 172.21.15.114:0/2272261176 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557db3f50 0x55c557db7800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f814019b360 tx=0x7f813800e7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a310ec40cbcdcc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f8129ffb700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:05:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f8129ffb700 1 -- 172.21.15.114:0/2272261176 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813800eee0 con 0x55c557db3f50 2023-10-18T14:05:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f815449cb80 1 -- 172.21.15.114:0/2272261176 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c557d05e90 con 0x55c557db3f50 2023-10-18T14:05:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f8129ffb700 1 -- 172.21.15.114:0/2272261176 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8138016610 con 0x55c557db3f50 2023-10-18T14:05:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f8129ffb700 1 -- 172.21.15.114:0/2272261176 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81380167d0 con 0x55c557db3f50 2023-10-18T14:05:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f815449cb80 10 client.25379 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f815449cb80 1 -- 172.21.15.114:0/2272261176 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f81401a1650 con 0x55c557db3f50 2023-10-18T14:05:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f8129ffb700 1 -- 172.21.15.114:0/2272261176 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c557d05e90 con 0x55c557db3f50 2023-10-18T14:05:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f8129ffb700 1 -- 172.21.15.114:0/2272261176 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f813801eb30 con 0x55c557db3f50 2023-10-18T14:05:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f815449cb80 10 client.25379 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f815449cb80 10 client.25379 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f815449cb80 20 client.25379 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f815449cb80 1 --2- 172.21.15.114:0/2272261176 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c557dd8720 0x55c557ddab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f815449cb80 4 client.25379 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.873+0000 7f815449cb80 1 -- 172.21.15.114:0/2272261176 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c557d7d850 con 0x55c557dd8720 2023-10-18T14:05:41.894 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.874+0000 7f814604f700 1 --2- 172.21.15.114:0/2272261176 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c557dd8720 0x55c557ddab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.894 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.874+0000 7f8129ffb700 10 client.25379 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:41.894 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.874+0000 7f814604f700 1 --2- 172.21.15.114:0/2272261176 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c557dd8720 0x55c557ddab40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2262cf4a80a3b19b server_cookie=1481ca8b582a4583 in_seq=0 out_seq=0 2023-10-18T14:05:41.894 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f8129ffb700 1 -- 172.21.15.114:0/2272261176 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c557d7d850 con 0x55c557dd8720 2023-10-18T14:05:41.894 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f8129ffb700 10 client.25379 handle_command_reply: tid=0 2023-10-18T14:05:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f815449cb80 1 client.25379 shutdown 2023-10-18T14:05:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f815449cb80 1 -- 172.21.15.114:0/2272261176 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557db3f50 msgr2=0x55c557db7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f815449cb80 1 --2- 172.21.15.114:0/2272261176 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557db3f50 0x55c557db7800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f814019b360 tx=0x7f813800e7d0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f815449cb80 1 -- 172.21.15.114:0/2272261176 shutdown_connections 2023-10-18T14:05:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f815449cb80 1 --2- 172.21.15.114:0/2272261176 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c557dd8720 0x55c557ddab40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f815449cb80 1 --2- 172.21.15.114:0/2272261176 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557db3f50 0x55c557db7800 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f815449cb80 1 --2- 172.21.15.114:0/2272261176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557dae410 0x55c557db9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f8129ffb700 0 client.25379 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f815449cb80 1 --2- 172.21.15.114:0/2272261176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557db7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f815449cb80 1 -- 172.21.15.114:0/2272261176 >> 172.21.15.114:0/2272261176 conn(0x55c557d226c0 msgr2=0x55c557da7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f815449cb80 1 -- 172.21.15.114:0/2272261176 shutdown_connections 2023-10-18T14:05:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f815449cb80 1 -- 172.21.15.114:0/2272261176 wait complete. 2023-10-18T14:05:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.875+0000 7f815449cb80 20 client.25379 trim_cache size 0 max 16384 2023-10-18T14:05:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.894+0000 7f815449cb80 1 Processor -- start 2023-10-18T14:05:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.894+0000 7f815449cb80 1 -- start start 2023-10-18T14:05:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f815449cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557dae410 0x55c557dcf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f815449cb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557da84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f815449cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557db3f50 0x55c557db5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f815449cb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c557b818c0 con 0x55c557db3630 2023-10-18T14:05:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f815449cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c557db8230 con 0x55c557dae410 2023-10-18T14:05:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f815449cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c557da9690 con 0x55c557db3f50 2023-10-18T14:05:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f814584e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557da84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f814604f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557dae410 0x55c557dcf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f814584e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557da84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45616/0 (socket says 172.21.15.114:45616) 2023-10-18T14:05:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f814604f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557dae410 0x55c557dcf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41758/0 (socket says 172.21.15.114:41758) 2023-10-18T14:05:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f814584e700 1 -- 172.21.15.114:0/1007412874 learned_addr learned my addr 172.21.15.114:0/1007412874 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f8146850700 1 --2- 172.21.15.114:0/1007412874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557db3f50 0x55c557db5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f814604f700 1 -- 172.21.15.114:0/1007412874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557db3f50 msgr2=0x55c557db5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f814604f700 1 --2- 172.21.15.114:0/1007412874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557db3f50 0x55c557db5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f814604f700 1 -- 172.21.15.114:0/1007412874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 msgr2=0x55c557da84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f814604f700 1 --2- 172.21.15.114:0/1007412874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557da84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f814604f700 1 -- 172.21.15.114:0/1007412874 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c557b2bd80 con 0x55c557dae410 2023-10-18T14:05:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f814584e700 1 --2- 172.21.15.114:0/1007412874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557da84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.895+0000 7f814604f700 1 --2- 172.21.15.114:0/1007412874 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557dae410 0x55c557dcf630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f813c0cb700 tx=0x7f813c0ba040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a704b2b72ed20668 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.896+0000 7f8135583700 1 -- 172.21.15.114:0/1007412874 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c098e40 con 0x55c557dae410 2023-10-18T14:05:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.896+0000 7f8135583700 1 -- 172.21.15.114:0/1007412874 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f813c0b3270 con 0x55c557dae410 2023-10-18T14:05:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.896+0000 7f8135583700 1 -- 172.21.15.114:0/1007412874 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c09a1f0 con 0x55c557dae410 2023-10-18T14:05:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.896+0000 7f815449cb80 1 -- 172.21.15.114:0/1007412874 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557dae410 msgr2=0x55c557dcf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.896+0000 7f815449cb80 1 --2- 172.21.15.114:0/1007412874 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557dae410 0x55c557dcf630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f813c0cb700 tx=0x7f813c0ba040 comp rx=0 tx=0).stop 2023-10-18T14:05:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.896+0000 7f815449cb80 1 -- 172.21.15.114:0/1007412874 shutdown_connections 2023-10-18T14:05:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.896+0000 7f815449cb80 1 --2- 172.21.15.114:0/1007412874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557db3f50 0x55c557db5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.896+0000 7f815449cb80 1 --2- 172.21.15.114:0/1007412874 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557dae410 0x55c557dcf630 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.896+0000 7f815449cb80 1 --2- 172.21.15.114:0/1007412874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3630 0x55c557da84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.896+0000 7f815449cb80 1 -- 172.21.15.114:0/1007412874 >> 172.21.15.114:0/1007412874 conn(0x55c557d226c0 msgr2=0x55c557db71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.896+0000 7f815449cb80 1 -- 172.21.15.114:0/1007412874 shutdown_connections 2023-10-18T14:05:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.896+0000 7f815449cb80 1 -- 172.21.15.114:0/1007412874 wait complete. 2023-10-18T14:05:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f815449cb80 1 -- start start 2023-10-18T14:05:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f815449cb80 1 Processor -- start 2023-10-18T14:05:41.909 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f815449cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557dae410 0x55c557dcd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.909 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f815449cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557db3630 0x55c557dcdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.909 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f815449cb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3f50 0x55c557e25590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f815449cb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c557e25ad0 con 0x55c557db3f50 2023-10-18T14:05:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f815449cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c557e25c40 con 0x55c557dae410 2023-10-18T14:05:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f815449cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c557e25e00 con 0x55c557db3630 2023-10-18T14:05:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f815449cb80 10 client.0 _ll_register_callbacks cb 0x55c557be7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f814584e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557db3630 0x55c557dcdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f814584e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557db3630 0x55c557dcdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49558/0 (socket says 172.21.15.114:49558) 2023-10-18T14:05:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f814584e700 1 -- 172.21.15.114:0/1950161223 learned_addr learned my addr 172.21.15.114:0/1950161223 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f8146850700 1 --2- 172.21.15.114:0/1950161223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3f50 0x55c557e25590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.897+0000 7f814604f700 1 --2- 172.21.15.114:0/1950161223 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557dae410 0x55c557dcd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.898+0000 7f814584e700 1 -- 172.21.15.114:0/1950161223 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557dae410 msgr2=0x55c557dcd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.912 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.898+0000 7f814584e700 1 --2- 172.21.15.114:0/1950161223 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557dae410 0x55c557dcd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.912 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.898+0000 7f814584e700 1 -- 172.21.15.114:0/1950161223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3f50 msgr2=0x55c557e25590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:41.912 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.898+0000 7f814584e700 1 --2- 172.21.15.114:0/1950161223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3f50 0x55c557e25590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:41.912 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.898+0000 7f814584e700 1 -- 172.21.15.114:0/1950161223 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813001b6b0 con 0x55c557db3630 2023-10-18T14:05:41.912 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.898+0000 7f814584e700 1 --2- 172.21.15.114:0/1950161223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557db3630 0x55c557dcdd40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f813001c720 tx=0x7f81300047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f7eb292300260df server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:41.912 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.898+0000 7f8129ffb700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-10-18T14:05:41.913 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.898+0000 7f8129ffb700 1 -- 172.21.15.114:0/1950161223 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813000f220 con 0x55c557db3630 2023-10-18T14:05:41.913 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.898+0000 7f8129ffb700 1 -- 172.21.15.114:0/1950161223 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f813000f380 con 0x55c557db3630 2023-10-18T14:05:41.913 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.898+0000 7f815449cb80 1 -- 172.21.15.114:0/1950161223 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f813c09ebf0 con 0x55c557db3630 2023-10-18T14:05:41.913 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.898+0000 7f8129ffb700 1 -- 172.21.15.114:0/1950161223 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f813000f540 con 0x55c557db3630 2023-10-18T14:05:41.913 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.898+0000 7f815449cb80 10 client.25618 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:41.914 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.898+0000 7f815449cb80 1 -- 172.21.15.114:0/1950161223 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c557cbe390 con 0x55c557db3630 2023-10-18T14:05:41.914 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.899+0000 7f8129ffb700 1 -- 172.21.15.114:0/1950161223 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f813c09ebf0 con 0x55c557db3630 2023-10-18T14:05:41.914 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.899+0000 7f8129ffb700 1 -- 172.21.15.114:0/1950161223 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f813002b8c0 con 0x55c557db3630 2023-10-18T14:05:41.914 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.899+0000 7f815449cb80 10 client.25618 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:41.914 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.899+0000 7f815449cb80 10 client.25618 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.899+0000 7f815449cb80 20 client.25618 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.899+0000 7f815449cb80 1 --2- 172.21.15.114:0/1950161223 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c557dd8720 0x55c557e2f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.899+0000 7f815449cb80 4 client.25618 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:05:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.899+0000 7f815449cb80 1 -- 172.21.15.114:0/1950161223 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c557cf9df0 con 0x55c557dd8720 2023-10-18T14:05:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.899+0000 7f814604f700 1 --2- 172.21.15.114:0/1950161223 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c557dd8720 0x55c557e2f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.899+0000 7f8129ffb700 10 client.25618 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:41.899+0000 7f814604f700 1 --2- 172.21.15.114:0/1950161223 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c557dd8720 0x55c557e2f880 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c59aec0be5957901 server_cookie=2fad85d493a52121 in_seq=0 out_seq=0 2023-10-18T14:05:42.014 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] string_to_tokens.lo 2023-10-18T14:05:42.017 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.013+0000 7f8129ffb700 1 -- 172.21.15.114:0/1950161223 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c557cf9df0 con 0x55c557dd8720 2023-10-18T14:05:42.017 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.013+0000 7f8129ffb700 10 client.25618 handle_command_reply: tid=0 2023-10-18T14:05:42.018 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.013+0000 7f815449cb80 1 client.25618 shutdown 2023-10-18T14:05:42.019 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.014+0000 7f815449cb80 1 -- 172.21.15.114:0/1950161223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557db3630 msgr2=0x55c557dcdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.019 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.014+0000 7f815449cb80 1 --2- 172.21.15.114:0/1950161223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557db3630 0x55c557dcdd40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f813001c720 tx=0x7f81300047c0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.019 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.014+0000 7f815449cb80 1 -- 172.21.15.114:0/1950161223 shutdown_connections 2023-10-18T14:05:42.019 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.014+0000 7f815449cb80 1 --2- 172.21.15.114:0/1950161223 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55c557dd8720 0x55c557e2f880 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.014+0000 7f815449cb80 1 --2- 172.21.15.114:0/1950161223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c557db3f50 0x55c557e25590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.014+0000 7f815449cb80 1 --2- 172.21.15.114:0/1950161223 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55c557dae410 0x55c557dcd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.014+0000 7f815449cb80 1 --2- 172.21.15.114:0/1950161223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c557db3630 0x55c557dcdd40 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f813001c720 tx=0x7f81300047c0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.014+0000 7f815449cb80 1 -- 172.21.15.114:0/1950161223 >> 172.21.15.114:0/1950161223 conn(0x55c557d226c0 msgr2=0x55c557db2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.014+0000 7f8129ffb700 0 client.25618 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:42.021 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.014+0000 7f815449cb80 1 -- 172.21.15.114:0/1950161223 shutdown_connections 2023-10-18T14:05:42.021 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.014+0000 7f815449cb80 1 -- 172.21.15.114:0/1950161223 wait complete. 2023-10-18T14:05:42.021 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.015+0000 7f815449cb80 20 client.25618 trim_cache size 0 max 16384 2023-10-18T14:05:42.021 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:05:42.022 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:05:42.022 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:05:42.022 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:05:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.015+0000 7f81482b3700 1 -- 172.21.15.114:0/1581334348 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f812c0a15f0 msgr2=0x7f812c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.015+0000 7f81482b3700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f812c0a15f0 0x7f812c0a3ab0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8140195bb0 tx=0x7f8130009260 comp rx=0 tx=0).stop 2023-10-18T14:05:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.015+0000 7f81482b3700 1 -- 172.21.15.114:0/1581334348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8140067fd0 msgr2=0x7f814019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.015+0000 7f81482b3700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8140067fd0 0x7f814019a660 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f813c0098e0 tx=0x7f813c00f690 comp rx=0 tx=0).stop 2023-10-18T14:05:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.015+0000 7f81482b3700 1 -- 172.21.15.114:0/1581334348 shutdown_connections 2023-10-18T14:05:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.015+0000 7f81482b3700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f812c0a15f0 0x7f812c0a3ab0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.015+0000 7f81482b3700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8140105ae0 0x7f8140194790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.015+0000 7f81482b3700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8140067fd0 0x7f814019a660 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.015+0000 7f81482b3700 1 --2- 172.21.15.114:0/1581334348 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8140105120 0x7f814019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.015+0000 7f81482b3700 1 -- 172.21.15.114:0/1581334348 >> 172.21.15.114:0/1581334348 conn(0x7f8140076790 msgr2=0x7f81400fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.019+0000 7f81482b3700 1 -- 172.21.15.114:0/1581334348 shutdown_connections 2023-10-18T14:05:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:42.019+0000 7f81482b3700 1 -- 172.21.15.114:0/1581334348 wait complete. 2023-10-18T14:05:42.044 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] str_to_bytes.lo 2023-10-18T14:05:42.055 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] tlibio.lo 2023-10-18T14:05:42.102 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-18T14:05:42.103 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-18T14:05:42.177 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] write_log.lo 2023-10-18T14:05:42.242 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] random.lo 2023-10-18T14:05:42.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.279+0000 7fb6864bc700 1 -- 172.21.15.114:0/4052174310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6800ffd40 msgr2=0x7fb6801039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.279+0000 7fb6864bc700 1 --2- 172.21.15.114:0/4052174310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6800ffd40 0x7fb6801039e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb67000ba80 tx=0x7fb67000bd90 comp rx=0 tx=0).stop 2023-10-18T14:05:42.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.279+0000 7fb6864bc700 1 -- 172.21.15.114:0/4052174310 shutdown_connections 2023-10-18T14:05:42.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.279+0000 7fb6864bc700 1 --2- 172.21.15.114:0/4052174310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680104110 0x7fb68010bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.279+0000 7fb6864bc700 1 --2- 172.21.15.114:0/4052174310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6800ff390 0x7fb6800ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.279+0000 7fb6864bc700 1 --2- 172.21.15.114:0/4052174310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6800ffd40 0x7fb6801039e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.279+0000 7fb6864bc700 1 -- 172.21.15.114:0/4052174310 >> 172.21.15.114:0/4052174310 conn(0x7fb680074890 msgr2=0x7fb680074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.279+0000 7fb6864bc700 1 -- 172.21.15.114:0/4052174310 shutdown_connections 2023-10-18T14:05:42.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.279+0000 7fb6864bc700 1 -- 172.21.15.114:0/4052174310 wait complete. 2023-10-18T14:05:42.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.280+0000 7fb6864bc700 1 Processor -- start 2023-10-18T14:05:42.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.280+0000 7fb6864bc700 1 -- start start 2023-10-18T14:05:42.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.280+0000 7fb6864bc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6800ff390 0x7fb680198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.280+0000 7fb6864bc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680104110 0x7fb680199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.280+0000 7fb6864bc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb68019d6f0 0x7fb68019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.280+0000 7fb6864bc700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68019e170 con 0x7fb68019d6f0 2023-10-18T14:05:42.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.280+0000 7fb6864bc700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68019e2e0 con 0x7fb680104110 2023-10-18T14:05:42.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.280+0000 7fb6864bc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68019e4a0 con 0x7fb6800ff390 2023-10-18T14:05:42.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.280+0000 7fb684a59700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb68019d6f0 0x7fb68019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.280+0000 7fb67ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6800ff390 0x7fb680198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.280+0000 7fb67ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6800ff390 0x7fb680198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49570/0 (socket says 172.21.15.114:49570) 2023-10-18T14:05:42.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.280+0000 7fb67ffff700 1 -- 172.21.15.114:0/1117108216 learned_addr learned my addr 172.21.15.114:0/1117108216 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:42.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680104110 0x7fb680199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb67ffff700 1 -- 172.21.15.114:0/1117108216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680104110 msgr2=0x7fb680199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb67ffff700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680104110 0x7fb680199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb67ffff700 1 -- 172.21.15.114:0/1117108216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb68019d6f0 msgr2=0x7fb68019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb67ffff700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb68019d6f0 0x7fb68019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb67ffff700 1 -- 172.21.15.114:0/1117108216 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67800ad20 con 0x7fb6800ff390 2023-10-18T14:05:42.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb684a59700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb68019d6f0 0x7fb68019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:42.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680104110 0x7fb680199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:05:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb67ffff700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6800ff390 0x7fb680198e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb67800e460 tx=0x7fb67800e770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb67d7fa700 1 -- 172.21.15.114:0/1117108216 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67801a070 con 0x7fb6800ff390 2023-10-18T14:05:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb67d7fa700 1 -- 172.21.15.114:0/1117108216 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb678004020 con 0x7fb6800ff390 2023-10-18T14:05:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb67d7fa700 1 -- 172.21.15.114:0/1117108216 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800f040 con 0x7fb6800ff390 2023-10-18T14:05:42.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb6864bc700 1 -- 172.21.15.114:0/1117108216 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67000b730 con 0x7fb6800ff390 2023-10-18T14:05:42.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.281+0000 7fb6864bc700 1 -- 172.21.15.114:0/1117108216 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6801a5d00 con 0x7fb6800ff390 2023-10-18T14:05:42.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.284+0000 7fb67d7fa700 1 -- 172.21.15.114:0/1117108216 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fb678004490 con 0x7fb6800ff390 2023-10-18T14:05:42.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.285+0000 7fb67d7fa700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb6680a15f0 0x7fb6680a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.285+0000 7fb67d7fa700 1 -- 172.21.15.114:0/1117108216 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb6780cd2b0 con 0x7fb6800ff390 2023-10-18T14:05:42.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.285+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb6680a15f0 0x7fb6680a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb6680a15f0 0x7fb6680a3ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb670005e90 tx=0x7fb670005e20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:42.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb6926a5b80 1 Processor -- start 2023-10-18T14:05:42.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb6926a5b80 1 -- start start 2023-10-18T14:05:42.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb6926a5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed8c60 0x55bb38ed9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb6926a5b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ed3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb6926a5b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed3650 0x55bb38ed3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb6926a5b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb38e46760 con 0x55bb38ed9580 2023-10-18T14:05:42.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb6926a5b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb38e2cce0 con 0x55bb38ed3650 2023-10-18T14:05:42.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb6926a5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb38e2a600 con 0x55bb38ed8c60 2023-10-18T14:05:42.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb67f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ed3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb67ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed8c60 0x55bb38ed9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb67ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed8c60 0x55bb38ed9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49578/0 (socket says 172.21.15.114:49578) 2023-10-18T14:05:42.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb684a59700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed3650 0x55bb38ed3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.286+0000 7fb67ffff700 1 -- 172.21.15.114:0/1686782727 learned_addr learned my addr 172.21.15.114:0/1686782727 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:42.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.287+0000 7fb67f7fe700 1 -- 172.21.15.114:0/1686782727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed8c60 msgr2=0x55bb38ed9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:42.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.287+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/1686782727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed8c60 0x55bb38ed9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.287+0000 7fb67f7fe700 1 -- 172.21.15.114:0/1686782727 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed3650 msgr2=0x55bb38ed3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:42.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.287+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/1686782727 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed3650 0x55bb38ed3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.287+0000 7fb67f7fe700 1 -- 172.21.15.114:0/1686782727 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb38de3470 con 0x55bb38ed9580 2023-10-18T14:05:42.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.287+0000 7fb67ffff700 1 --2- 172.21.15.114:0/1686782727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed8c60 0x55bb38ed9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:42.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.287+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/1686782727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ed3110 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb68019a360 tx=0x7fb67001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb7ae20d5370eed server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:42.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.287+0000 7fb6667fc700 1 -- 172.21.15.114:0/1686782727 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670005240 con 0x55bb38ed9580 2023-10-18T14:05:42.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.287+0000 7fb6667fc700 1 -- 172.21.15.114:0/1686782727 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb670014430 con 0x55bb38ed9580 2023-10-18T14:05:42.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.287+0000 7fb6667fc700 1 -- 172.21.15.114:0/1686782727 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67002a460 con 0x55bb38ed9580 2023-10-18T14:05:42.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.288+0000 7fb6926a5b80 1 -- 172.21.15.114:0/1686782727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 msgr2=0x55bb38ed3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.288+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/1686782727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ed3110 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb68019a360 tx=0x7fb67001c000 comp rx=0 tx=0).stop 2023-10-18T14:05:42.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.288+0000 7fb6926a5b80 1 -- 172.21.15.114:0/1686782727 shutdown_connections 2023-10-18T14:05:42.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.288+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/1686782727 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed3650 0x55bb38ed3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.288+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/1686782727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed8c60 0x55bb38ed9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.288+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/1686782727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ed3110 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.288+0000 7fb6926a5b80 1 -- 172.21.15.114:0/1686782727 >> 172.21.15.114:0/1686782727 conn(0x55bb38e477a0 msgr2=0x55bb38ecdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.288+0000 7fb6926a5b80 1 -- 172.21.15.114:0/1686782727 shutdown_connections 2023-10-18T14:05:42.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.288+0000 7fb6926a5b80 1 -- 172.21.15.114:0/1686782727 wait complete. 2023-10-18T14:05:42.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.288+0000 7fb6926a5b80 1 -- start start 2023-10-18T14:05:42.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.289+0000 7fb6926a5b80 1 Processor -- start 2023-10-18T14:05:42.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.289+0000 7fb6926a5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38edf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.289+0000 7fb6926a5b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed8c60 0x55bb38edc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.289+0000 7fb6926a5b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed9580 0x55bb38edcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.289+0000 7fb6926a5b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb38e25ef0 con 0x55bb38ed8c60 2023-10-18T14:05:42.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.289+0000 7fb6926a5b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb38dc2790 con 0x55bb38ed9580 2023-10-18T14:05:42.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.289+0000 7fb6926a5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb38dc2430 con 0x55bb38ed3650 2023-10-18T14:05:42.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.289+0000 7fb6926a5b80 10 client.0 _ll_register_callbacks cb 0x55bb38d0cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:42.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.289+0000 7fb67ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38edf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.289+0000 7fb67ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38edf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49584/0 (socket says 172.21.15.114:49584) 2023-10-18T14:05:42.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.289+0000 7fb67ffff700 1 -- 172.21.15.114:0/851780340 learned_addr learned my addr 172.21.15.114:0/851780340 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:42.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.289+0000 7fb684a59700 1 --2- 172.21.15.114:0/851780340 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed9580 0x55bb38edcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb67ffff700 1 -- 172.21.15.114:0/851780340 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed9580 msgr2=0x55bb38edcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:42.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb67ffff700 1 --2- 172.21.15.114:0/851780340 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed9580 0x55bb38edcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb67ffff700 1 -- 172.21.15.114:0/851780340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed8c60 msgr2=0x55bb38edc840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T14:05:42.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb67ffff700 1 --2- 172.21.15.114:0/851780340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed8c60 0x55bb38edc840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb67ffff700 1 -- 172.21.15.114:0/851780340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6801a5d00 con 0x55bb38ed3650 2023-10-18T14:05:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb67ffff700 1 --2- 172.21.15.114:0/851780340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38edf550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb67809a040 tx=0x7fb678099d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fa6b06a92763276 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb65f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-10-18T14:05:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb65f7fe700 1 -- 172.21.15.114:0/851780340 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780b0020 con 0x55bb38ed3650 2023-10-18T14:05:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb65f7fe700 1 -- 172.21.15.114:0/851780340 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb67809e490 con 0x55bb38ed3650 2023-10-18T14:05:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb6926a5b80 1 -- 172.21.15.114:0/851780340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb38e2af70 con 0x55bb38ed3650 2023-10-18T14:05:42.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb65f7fe700 1 -- 172.21.15.114:0/851780340 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6780a2640 con 0x55bb38ed3650 2023-10-18T14:05:42.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb6926a5b80 10 client.25630 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:42.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb6926a5b80 1 -- 172.21.15.114:0/851780340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7fb68010c500 con 0x55bb38ed3650 2023-10-18T14:05:42.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb65f7fe700 1 -- 172.21.15.114:0/851780340 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bb38e2af70 con 0x55bb38ed3650 2023-10-18T14:05:42.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.290+0000 7fb65f7fe700 1 -- 172.21.15.114:0/851780340 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb67809a5a0 con 0x55bb38ed3650 2023-10-18T14:05:42.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.291+0000 7fb6926a5b80 10 client.25630 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:42.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.291+0000 7fb6926a5b80 10 client.25630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:42.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.291+0000 7fb6926a5b80 20 client.25630 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:42.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.291+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/851780340 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb38eecf80 0x55bb38eef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.291+0000 7fb6926a5b80 4 client.25630 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:42.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.291+0000 7fb6926a5b80 1 -- 172.21.15.114:0/851780340 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb38ea2930 con 0x55bb38eecf80 2023-10-18T14:05:42.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.291+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/851780340 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb38eecf80 0x55bb38eef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.291+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/851780340 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb38eecf80 0x55bb38eef3a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66efd2757a06a84c server_cookie=dfa6f2ca148343f0 in_seq=0 out_seq=0 2023-10-18T14:05:42.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.291+0000 7fb65f7fe700 10 client.25630 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:42.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb65f7fe700 1 -- 172.21.15.114:0/851780340 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bb38ea2930 con 0x55bb38eecf80 2023-10-18T14:05:42.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb65f7fe700 10 client.25630 handle_command_reply: tid=0 2023-10-18T14:05:42.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb6926a5b80 1 client.25630 shutdown 2023-10-18T14:05:42.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb6926a5b80 1 -- 172.21.15.114:0/851780340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 msgr2=0x55bb38edf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/851780340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38edf550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb67809a040 tx=0x7fb678099d20 comp rx=0 tx=0).stop 2023-10-18T14:05:42.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb6926a5b80 1 -- 172.21.15.114:0/851780340 shutdown_connections 2023-10-18T14:05:42.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/851780340 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb38eecf80 0x55bb38eef3a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/851780340 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed9580 0x55bb38edcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb65f7fe700 0 client.25630 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:42.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/851780340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38edf550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/851780340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed8c60 0x55bb38edc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb6926a5b80 1 -- 172.21.15.114:0/851780340 >> 172.21.15.114:0/851780340 conn(0x55bb38e477a0 msgr2=0x55bb38ed2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb6926a5b80 1 -- 172.21.15.114:0/851780340 shutdown_connections 2023-10-18T14:05:42.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.292+0000 7fb6926a5b80 1 -- 172.21.15.114:0/851780340 wait complete. 2023-10-18T14:05:42.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.293+0000 7fb6926a5b80 20 client.25630 trim_cache size 0 max 16384 2023-10-18T14:05:42.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb6926a5b80 1 Processor -- start 2023-10-18T14:05:42.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb6926a5b80 1 -- start start 2023-10-18T14:05:42.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb6926a5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38ed6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb6926a5b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed8c60 0x55bb38ee3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb6926a5b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ee8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb6926a5b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb38ca69a0 con 0x55bb38ed9580 2023-10-18T14:05:42.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb6926a5b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb38ecf430 con 0x55bb38ed8c60 2023-10-18T14:05:42.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb6926a5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb38eca360 con 0x55bb38ed3650 2023-10-18T14:05:42.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb684a59700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ee8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb684a59700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ee8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45658/0 (socket says 172.21.15.114:45658) 2023-10-18T14:05:42.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb684a59700 1 -- 172.21.15.114:0/2202236993 learned_addr learned my addr 172.21.15.114:0/2202236993 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:42.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/2202236993 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed8c60 0x55bb38ee3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb684a59700 1 -- 172.21.15.114:0/2202236993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 msgr2=0x55bb38ed6f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-18T14:05:42.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.323+0000 7fb684a59700 1 --2- 172.21.15.114:0/2202236993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38ed6f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.324+0000 7fb684a59700 1 -- 172.21.15.114:0/2202236993 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed8c60 msgr2=0x55bb38ee3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:42.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.324+0000 7fb684a59700 1 --2- 172.21.15.114:0/2202236993 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed8c60 0x55bb38ee3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.324+0000 7fb684a59700 1 -- 172.21.15.114:0/2202236993 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb38ef3f90 con 0x55bb38ed9580 2023-10-18T14:05:42.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.324+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/2202236993 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed8c60 0x55bb38ee3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:05:42.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.324+0000 7fb684a59700 1 --2- 172.21.15.114:0/2202236993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ee8d30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb674010840 tx=0x7fb674009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad99db1de9b71b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:42.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.324+0000 7fb666ffd700 1 -- 172.21.15.114:0/2202236993 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674017040 con 0x55bb38ed9580 2023-10-18T14:05:42.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.324+0000 7fb666ffd700 1 -- 172.21.15.114:0/2202236993 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb674005020 con 0x55bb38ed9580 2023-10-18T14:05:42.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.324+0000 7fb666ffd700 1 -- 172.21.15.114:0/2202236993 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67400f960 con 0x55bb38ed9580 2023-10-18T14:05:42.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.325+0000 7fb6926a5b80 1 -- 172.21.15.114:0/2202236993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 msgr2=0x55bb38ee8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.325+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/2202236993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ee8d30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb674010840 tx=0x7fb674009260 comp rx=0 tx=0).stop 2023-10-18T14:05:42.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.325+0000 7fb6926a5b80 1 -- 172.21.15.114:0/2202236993 shutdown_connections 2023-10-18T14:05:42.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.325+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/2202236993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ee8d30 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.325+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/2202236993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38ed6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.325+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/2202236993 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed8c60 0x55bb38ee3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.325+0000 7fb6926a5b80 1 -- 172.21.15.114:0/2202236993 >> 172.21.15.114:0/2202236993 conn(0x55bb38e477a0 msgr2=0x55bb38ee8620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.325+0000 7fb6926a5b80 1 -- 172.21.15.114:0/2202236993 shutdown_connections 2023-10-18T14:05:42.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.325+0000 7fb6926a5b80 1 -- 172.21.15.114:0/2202236993 wait complete. 2023-10-18T14:05:42.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.325+0000 7fb6926a5b80 1 -- start start 2023-10-18T14:05:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.326+0000 7fb6926a5b80 1 Processor -- start 2023-10-18T14:05:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.326+0000 7fb6926a5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38f3a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.326+0000 7fb6926a5b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed8c60 0x55bb38f3a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.326+0000 7fb6926a5b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ee2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.326+0000 7fb6926a5b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb38ee3530 con 0x55bb38ed9580 2023-10-18T14:05:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.326+0000 7fb6926a5b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb38ee36a0 con 0x55bb38ed8c60 2023-10-18T14:05:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.326+0000 7fb6926a5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb38ee3860 con 0x55bb38ed3650 2023-10-18T14:05:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.326+0000 7fb6926a5b80 10 client.0 _ll_register_callbacks cb 0x55bb38d0cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.326+0000 7fb67ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38f3a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.326+0000 7fb67ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38f3a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49596/0 (socket says 172.21.15.114:49596) 2023-10-18T14:05:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.326+0000 7fb67ffff700 1 -- 172.21.15.114:0/2816438344 learned_addr learned my addr 172.21.15.114:0/2816438344 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.326+0000 7fb684a59700 1 --2- 172.21.15.114:0/2816438344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ee2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.326+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/2816438344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed8c60 0x55bb38f3a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb67ffff700 1 -- 172.21.15.114:0/2816438344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed8c60 msgr2=0x55bb38f3a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb67ffff700 1 --2- 172.21.15.114:0/2816438344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed8c60 0x55bb38f3a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb67ffff700 1 -- 172.21.15.114:0/2816438344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 msgr2=0x55bb38ee2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:42.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb67ffff700 1 --2- 172.21.15.114:0/2816438344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ee2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb67ffff700 1 -- 172.21.15.114:0/2816438344 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6740104f0 con 0x55bb38ed3650 2023-10-18T14:05:42.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb67ffff700 1 --2- 172.21.15.114:0/2816438344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38f3a0e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb678098690 tx=0x7fb67809aad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b6962d55a0a2ffc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:42.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb65f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-10-18T14:05:42.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb65f7fe700 1 -- 172.21.15.114:0/2816438344 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780b0070 con 0x55bb38ed3650 2023-10-18T14:05:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb65f7fe700 1 -- 172.21.15.114:0/2816438344 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb6780b7020 con 0x55bb38ed3650 2023-10-18T14:05:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb6926a5b80 1 -- 172.21.15.114:0/2816438344 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb38ed40c0 con 0x55bb38ed3650 2023-10-18T14:05:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb65f7fe700 1 -- 172.21.15.114:0/2816438344 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb678096680 con 0x55bb38ed3650 2023-10-18T14:05:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb6926a5b80 10 client.25633 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb6926a5b80 1 -- 172.21.15.114:0/2816438344 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55bb38c50e60 con 0x55bb38ed3650 2023-10-18T14:05:42.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.327+0000 7fb65f7fe700 1 -- 172.21.15.114:0/2816438344 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bb38ed40c0 con 0x55bb38ed3650 2023-10-18T14:05:42.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.328+0000 7fb65f7fe700 1 -- 172.21.15.114:0/2816438344 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb678003a00 con 0x55bb38ed3650 2023-10-18T14:05:42.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.328+0000 7fb6926a5b80 10 client.25633 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:42.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.328+0000 7fb6926a5b80 10 client.25633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:42.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.328+0000 7fb6926a5b80 20 client.25633 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:42.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.328+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/2816438344 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb38f42e50 0x55bb38f45270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.328+0000 7fb6926a5b80 4 client.25633 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-18T14:05:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.328+0000 7fb6926a5b80 1 -- 172.21.15.114:0/2816438344 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7fb670014430 con 0x55bb38f42e50 2023-10-18T14:05:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.328+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/2816438344 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb38f42e50 0x55bb38f45270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.328+0000 7fb67f7fe700 1 --2- 172.21.15.114:0/2816438344 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb38f42e50 0x55bb38f45270 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=550c0c1f3fb0fd71 server_cookie=caf9e0ac8a36980e in_seq=0 out_seq=0 2023-10-18T14:05:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.328+0000 7fb65f7fe700 10 client.25633 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:42.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.329+0000 7fb65f7fe700 1 -- 172.21.15.114:0/2816438344 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7fb670011080 con 0x55bb38f42e50 2023-10-18T14:05:42.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.329+0000 7fb65f7fe700 10 client.25633 handle_command_reply: tid=0 2023-10-18T14:05:42.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.329+0000 7fb6926a5b80 1 client.25633 shutdown 2023-10-18T14:05:42.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.330+0000 7fb6926a5b80 1 -- 172.21.15.114:0/2816438344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 msgr2=0x55bb38f3a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.330+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/2816438344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38f3a0e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb678098690 tx=0x7fb67809aad0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.330+0000 7fb6926a5b80 1 -- 172.21.15.114:0/2816438344 shutdown_connections 2023-10-18T14:05:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.330+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/2816438344 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55bb38f42e50 0x55bb38f45270 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.330+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/2816438344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bb38ed9580 0x55bb38ee2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.330+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/2816438344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb38ed3650 0x55bb38f3a0e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.330+0000 7fb6926a5b80 1 --2- 172.21.15.114:0/2816438344 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55bb38ed8c60 0x55bb38f3a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.330+0000 7fb6926a5b80 1 -- 172.21.15.114:0/2816438344 >> 172.21.15.114:0/2816438344 conn(0x55bb38e477a0 msgr2=0x55bb38ed7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.330+0000 7fb65f7fe700 0 client.25633 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.330+0000 7fb6926a5b80 1 -- 172.21.15.114:0/2816438344 shutdown_connections 2023-10-18T14:05:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.330+0000 7fb6926a5b80 1 -- 172.21.15.114:0/2816438344 wait complete. 2023-10-18T14:05:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.330+0000 7fb6926a5b80 20 client.25633 trim_cache size 0 max 16384 2023-10-18T14:05:42.349 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:05:42.349 INFO:teuthology.orchestra.run.smithi114.stdout: "return_code": 0, 2023-10-18T14:05:42.349 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_tag": "94d18228-30fd-45a0-94d1-b2bec5a6db1a", 2023-10-18T14:05:42.350 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": "asynchronous" 2023-10-18T14:05:42.350 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:05:42.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.331+0000 7fb6864bc700 1 -- 172.21.15.114:0/1117108216 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb6680a15f0 msgr2=0x7fb6680a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.331+0000 7fb6864bc700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb6680a15f0 0x7fb6680a3ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb670005e90 tx=0x7fb670005e20 comp rx=0 tx=0).stop 2023-10-18T14:05:42.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.331+0000 7fb6864bc700 1 -- 172.21.15.114:0/1117108216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6800ff390 msgr2=0x7fb680198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.331+0000 7fb6864bc700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6800ff390 0x7fb680198e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb67800e460 tx=0x7fb67800e770 comp rx=0 tx=0).stop 2023-10-18T14:05:42.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.331+0000 7fb6864bc700 1 -- 172.21.15.114:0/1117108216 shutdown_connections 2023-10-18T14:05:42.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.331+0000 7fb6864bc700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb6680a15f0 0x7fb6680a3ab0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.331+0000 7fb6864bc700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb68019d6f0 0x7fb68019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.331+0000 7fb6864bc700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6800ff390 0x7fb680198e10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.331+0000 7fb6864bc700 1 --2- 172.21.15.114:0/1117108216 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb680104110 0x7fb680199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.331+0000 7fb6864bc700 1 -- 172.21.15.114:0/1117108216 >> 172.21.15.114:0/1117108216 conn(0x7fb680074890 msgr2=0x7fb6800fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.331+0000 7fb6864bc700 1 -- 172.21.15.114:0/1117108216 shutdown_connections 2023-10-18T14:05:42.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.331+0000 7fb6864bc700 1 -- 172.21.15.114:0/1117108216 wait complete. 2023-10-18T14:05:42.362 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:05:42.383 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.371+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000816 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/199.out auth v1088 ap=1 s=505 n(v0 b505 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff57600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000816:[<0x10000000403/199.out v806>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000816:[<0x10000000403/199.out v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.383 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.377+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001453 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/370 auth v1098 ap=1 s=1469 n(v0 rc2023-10-18T14:05:24.962996+0000 b1469 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff58680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001453:[<0x10000000403/370 v1074>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001453:[<0x10000000403/370 v1098>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.559+0000 7fb4f1da0700 1 -- 172.21.15.114:0/2188252330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4ec100000 msgr2=0x7fb4ec10c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.559+0000 7fb4f1da0700 1 --2- 172.21.15.114:0/2188252330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4ec100000 0x7fb4ec10c4a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400b0a0 tx=0x7fb4e400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.559+0000 7fb4f1da0700 1 -- 172.21.15.114:0/2188252330 shutdown_connections 2023-10-18T14:05:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.559+0000 7fb4f1da0700 1 --2- 172.21.15.114:0/2188252330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4ec100000 0x7fb4ec10c4a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.559+0000 7fb4f1da0700 1 --2- 172.21.15.114:0/2188252330 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4ec1056e0 0x7fb4ec105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.559+0000 7fb4f1da0700 1 --2- 172.21.15.114:0/2188252330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4ec0ff640 0x7fb4ec0ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.559+0000 7fb4f1da0700 1 -- 172.21.15.114:0/2188252330 >> 172.21.15.114:0/2188252330 conn(0x7fb4ec0767f0 msgr2=0x7fb4ec076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.559+0000 7fb4f1da0700 1 -- 172.21.15.114:0/2188252330 shutdown_connections 2023-10-18T14:05:42.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.559+0000 7fb4f1da0700 1 -- 172.21.15.114:0/2188252330 wait complete. 2023-10-18T14:05:42.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.560+0000 7fb4f1da0700 1 Processor -- start 2023-10-18T14:05:42.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.560+0000 7fb4f1da0700 1 -- start start 2023-10-18T14:05:42.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.560+0000 7fb4f1da0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4ec0ff640 0x7fb4ec1a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.560+0000 7fb4f1da0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4ec100000 0x7fb4ec1a3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4f1da0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4ec1056e0 0x7fb4ec19d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4f1da0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec19da80 con 0x7fb4ec1056e0 2023-10-18T14:05:42.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4f1da0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec19dbf0 con 0x7fb4ec0ff640 2023-10-18T14:05:42.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4f1da0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec19ddb0 con 0x7fb4ec100000 2023-10-18T14:05:42.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4eb7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4ec0ff640 0x7fb4ec1a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4eb7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4ec0ff640 0x7fb4ec1a2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41824/0 (socket says 172.21.15.114:41824) 2023-10-18T14:05:42.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4eb7fe700 1 -- 172.21.15.114:0/1212136235 learned_addr learned my addr 172.21.15.114:0/1212136235 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:42.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4ebfff700 1 --2- 172.21.15.114:0/1212136235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4ec1056e0 0x7fb4ec19d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4eb7fe700 1 -- 172.21.15.114:0/1212136235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4ec100000 msgr2=0x7fb4ec1a3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4eb7fe700 1 --2- 172.21.15.114:0/1212136235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4ec100000 0x7fb4ec1a3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4eb7fe700 1 -- 172.21.15.114:0/1212136235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4ec1056e0 msgr2=0x7fb4ec19d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4eb7fe700 1 --2- 172.21.15.114:0/1212136235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4ec1056e0 0x7fb4ec19d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4eb7fe700 1 -- 172.21.15.114:0/1212136235 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e4009d00 con 0x7fb4ec0ff640 2023-10-18T14:05:42.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4eb7fe700 1 --2- 172.21.15.114:0/1212136235 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4ec0ff640 0x7fb4ec1a2f30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00e9a0 tx=0x7fb4dc00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:42.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.561+0000 7fb4e8ff9700 1 -- 172.21.15.114:0/1212136235 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc009790 con 0x7fb4ec0ff640 2023-10-18T14:05:42.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.562+0000 7fb4f1da0700 1 -- 172.21.15.114:0/1212136235 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ec19e090 con 0x7fb4ec0ff640 2023-10-18T14:05:42.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.562+0000 7fb4e8ff9700 1 -- 172.21.15.114:0/1212136235 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4dc00cbd0 con 0x7fb4ec0ff640 2023-10-18T14:05:42.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.562+0000 7fb4e8ff9700 1 -- 172.21.15.114:0/1212136235 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc018680 con 0x7fb4ec0ff640 2023-10-18T14:05:42.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.562+0000 7fb4f1da0700 1 -- 172.21.15.114:0/1212136235 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec1a9fb0 con 0x7fb4ec0ff640 2023-10-18T14:05:42.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.564+0000 7fb4e8ff9700 1 -- 172.21.15.114:0/1212136235 <== mon.2 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fb4dc00cd40 con 0x7fb4ec0ff640 2023-10-18T14:05:42.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.565+0000 7fb4e8ff9700 1 --2- 172.21.15.114:0/1212136235 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb4d40a15f0 0x7fb4d40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.565+0000 7fb4e8ff9700 1 -- 172.21.15.114:0/1212136235 <== mon.2 v2:172.21.15.158:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb4dc014070 con 0x7fb4ec0ff640 2023-10-18T14:05:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.565+0000 7fb4eaffd700 1 --2- 172.21.15.114:0/1212136235 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb4d40a15f0 0x7fb4d40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.565+0000 7fb4eaffd700 1 --2- 172.21.15.114:0/1212136235 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb4d40a15f0 0x7fb4d40a3ab0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0005950 tx=0x7fb4e00058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.567+0000 7fb4fdf89b80 1 Processor -- start 2023-10-18T14:05:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.567+0000 7fb4fdf89b80 1 -- start start 2023-10-18T14:05:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.567+0000 7fb4fdf89b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 0x562e84f41fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.567+0000 7fb4fdf89b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f42500 0x562e84f3c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.567+0000 7fb4fdf89b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f3c5d0 0x562e84f3ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.567+0000 7fb4fdf89b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e84eaf6e0 con 0x562e84f41be0 2023-10-18T14:05:42.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.567+0000 7fb4fdf89b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e84e95c60 con 0x562e84f3c5d0 2023-10-18T14:05:42.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.567+0000 7fb4fdf89b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e84e93580 con 0x562e84f42500 2023-10-18T14:05:42.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.567+0000 7fb4eb7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 0x562e84f41fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.567+0000 7fb4eb7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 0x562e84f41fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45688/0 (socket says 172.21.15.114:45688) 2023-10-18T14:05:42.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.567+0000 7fb4eb7fe700 1 -- 172.21.15.114:0/2878389343 learned_addr learned my addr 172.21.15.114:0/2878389343 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:42.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.567+0000 7fb4ebfff700 1 --2- 172.21.15.114:0/2878389343 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f3c5d0 0x562e84f3ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.568+0000 7fb4eb7fe700 1 -- 172.21.15.114:0/2878389343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f42500 msgr2=0x562e84f3c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:42.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.568+0000 7fb4eb7fe700 1 --2- 172.21.15.114:0/2878389343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f42500 0x562e84f3c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.568+0000 7fb4eb7fe700 1 -- 172.21.15.114:0/2878389343 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f3c5d0 msgr2=0x562e84f3ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:42.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.568+0000 7fb4eb7fe700 1 --2- 172.21.15.114:0/2878389343 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f3c5d0 0x562e84f3ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.568+0000 7fb4eb7fe700 1 -- 172.21.15.114:0/2878389343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e84e4c3f0 con 0x562e84f41be0 2023-10-18T14:05:42.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.568+0000 7fb4eb7fe700 1 --2- 172.21.15.114:0/2878389343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 0x562e84f41fc0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0968d0 tx=0x7fb4dc09aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289aafbd64a5723a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:42.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.568+0000 7fb4d1ffb700 1 -- 172.21.15.114:0/2878389343 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0a2760 con 0x562e84f41be0 2023-10-18T14:05:42.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.568+0000 7fb4d1ffb700 1 -- 172.21.15.114:0/2878389343 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4dc09e170 con 0x562e84f41be0 2023-10-18T14:05:42.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.568+0000 7fb4d1ffb700 1 -- 172.21.15.114:0/2878389343 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc099b70 con 0x562e84f41be0 2023-10-18T14:05:42.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.569+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/2878389343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 msgr2=0x562e84f41fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.569+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/2878389343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 0x562e84f41fc0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0968d0 tx=0x7fb4dc09aad0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.569+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/2878389343 shutdown_connections 2023-10-18T14:05:42.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.569+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/2878389343 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f3c5d0 0x562e84f3ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.569+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/2878389343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 0x562e84f41fc0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.569+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/2878389343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f42500 0x562e84f3c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.569+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/2878389343 >> 172.21.15.114:0/2878389343 conn(0x562e84eb0720 msgr2=0x562e84f36b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.569+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/2878389343 shutdown_connections 2023-10-18T14:05:42.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.569+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/2878389343 wait complete. 2023-10-18T14:05:42.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.570+0000 7fb4fdf89b80 1 -- start start 2023-10-18T14:05:42.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.570+0000 7fb4fdf89b80 1 Processor -- start 2023-10-18T14:05:42.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.570+0000 7fb4fdf89b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 0x562e84f45aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.570+0000 7fb4fdf89b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 0x562e84f45fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.570+0000 7fb4fdf89b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 0x562e84f51f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.570+0000 7fb4fdf89b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e84e8ee70 con 0x562e84f41be0 2023-10-18T14:05:42.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.570+0000 7fb4fdf89b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e84e2b710 con 0x562e84f46520 2023-10-18T14:05:42.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.570+0000 7fb4fdf89b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e84e2b3b0 con 0x562e84f3c5d0 2023-10-18T14:05:42.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.570+0000 7fb4fdf89b80 10 client.0 _ll_register_callbacks cb 0x562e84d75a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:42.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4ebfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 0x562e84f51f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4ebfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 0x562e84f51f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41840/0 (socket says 172.21.15.114:41840) 2023-10-18T14:05:42.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4ebfff700 1 -- 172.21.15.114:0/1306972436 learned_addr learned my addr 172.21.15.114:0/1306972436 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:42.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4eb7fe700 1 --2- 172.21.15.114:0/1306972436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 0x562e84f45aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4eaffd700 1 --2- 172.21.15.114:0/1306972436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 0x562e84f45fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4ebfff700 1 -- 172.21.15.114:0/1306972436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 msgr2=0x562e84f45aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:42.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4ebfff700 1 --2- 172.21.15.114:0/1306972436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 0x562e84f45aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4ebfff700 1 -- 172.21.15.114:0/1306972436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 msgr2=0x562e84f45fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:42.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4ebfff700 1 --2- 172.21.15.114:0/1306972436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 0x562e84f45fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4ebfff700 1 -- 172.21.15.114:0/1306972436 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec1a9fb0 con 0x562e84f46520 2023-10-18T14:05:42.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4ebfff700 1 --2- 172.21.15.114:0/1306972436 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 0x562e84f51f60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4015000 tx=0x7fb4e4007e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=106c2a4418e721c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:42.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4caffd700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:05:42.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4caffd700 1 -- 172.21.15.114:0/1306972436 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400e040 con 0x562e84f46520 2023-10-18T14:05:42.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4caffd700 1 -- 172.21.15.114:0/1306972436 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb4e4004a50 con 0x562e84f46520 2023-10-18T14:05:42.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/1306972436 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e84e93ef0 con 0x562e84f46520 2023-10-18T14:05:42.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4caffd700 1 -- 172.21.15.114:0/1306972436 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4e4004c10 con 0x562e84f46520 2023-10-18T14:05:42.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4fdf89b80 10 client.25412 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:42.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.571+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/1306972436 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562e84cb9de0 con 0x562e84f46520 2023-10-18T14:05:42.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.572+0000 7fb4caffd700 1 -- 172.21.15.114:0/1306972436 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562e84e93ef0 con 0x562e84f46520 2023-10-18T14:05:42.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.572+0000 7fb4caffd700 1 -- 172.21.15.114:0/1306972436 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb4e4024030 con 0x562e84f46520 2023-10-18T14:05:42.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.572+0000 7fb4fdf89b80 10 client.25412 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:42.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.572+0000 7fb4fdf89b80 10 client.25412 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:42.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.572+0000 7fb4fdf89b80 20 client.25412 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:42.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.572+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/1306972436 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x562e84f564f0 0x562e84f58910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.572+0000 7fb4fdf89b80 4 client.25412 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:42.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.572+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/1306972436 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e84f0b8b0 con 0x562e84f564f0 2023-10-18T14:05:42.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.572+0000 7fb4eb7fe700 1 --2- 172.21.15.114:0/1306972436 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x562e84f564f0 0x562e84f58910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.573+0000 7fb4eb7fe700 1 --2- 172.21.15.114:0/1306972436 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x562e84f564f0 0x562e84f58910 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fdc88ebafd0caf7 server_cookie=7304693c0121dd91 in_seq=0 out_seq=0 2023-10-18T14:05:42.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.573+0000 7fb4caffd700 10 client.25412 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:42.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4caffd700 1 -- 172.21.15.114:0/1306972436 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x7fb4dc0b2e90 con 0x562e84f564f0 2023-10-18T14:05:42.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4caffd700 10 client.25412 handle_command_reply: tid=0 2023-10-18T14:05:42.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4fdf89b80 1 client.25412 shutdown 2023-10-18T14:05:42.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/1306972436 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 msgr2=0x562e84f51f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/1306972436 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 0x562e84f51f60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4015000 tx=0x7fb4e4007e80 comp rx=0 tx=0).stop 2023-10-18T14:05:42.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/1306972436 shutdown_connections 2023-10-18T14:05:42.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/1306972436 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x562e84f564f0 0x562e84f58910 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/1306972436 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 0x562e84f51f60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4caffd700 0 client.25412 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:42.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/1306972436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 0x562e84f45aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/1306972436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 0x562e84f45fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/1306972436 >> 172.21.15.114:0/1306972436 conn(0x562e84eb0720 msgr2=0x562e84f3b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/1306972436 shutdown_connections 2023-10-18T14:05:42.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/1306972436 wait complete. 2023-10-18T14:05:42.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.574+0000 7fb4fdf89b80 20 client.25412 trim_cache size 0 max 16384 2023-10-18T14:05:42.594 INFO:tasks.workunit.client.0.smithi114.stdout: [LD] 2023-10-18T14:05:42.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.594+0000 7fb4fdf89b80 1 Processor -- start 2023-10-18T14:05:42.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.594+0000 7fb4fdf89b80 1 -- start start 2023-10-18T14:05:42.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.594+0000 7fb4fdf89b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 0x562e84f45360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.594+0000 7fb4fdf89b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f41be0 0x562e84f4ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.594+0000 7fb4fdf89b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f46520 0x562e84f3bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.594+0000 7fb4fdf89b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e84d0f920 con 0x562e84f46520 2023-10-18T14:05:42.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.594+0000 7fb4fdf89b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e84f3f890 con 0x562e84f41be0 2023-10-18T14:05:42.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.594+0000 7fb4fdf89b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e84f370a0 con 0x562e84f3c5d0 2023-10-18T14:05:42.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.594+0000 7fb4eaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f41be0 0x562e84f4ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.594+0000 7fb4eb7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 0x562e84f45360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.594+0000 7fb4eaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f41be0 0x562e84f4ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41848/0 (socket says 172.21.15.114:41848) 2023-10-18T14:05:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.594+0000 7fb4eaffd700 1 -- 172.21.15.114:0/2298184423 learned_addr learned my addr 172.21.15.114:0/2298184423 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.595+0000 7fb4ebfff700 1 --2- 172.21.15.114:0/2298184423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f46520 0x562e84f3bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.595+0000 7fb4eaffd700 1 -- 172.21.15.114:0/2298184423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 msgr2=0x562e84f45360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.595+0000 7fb4eaffd700 1 --2- 172.21.15.114:0/2298184423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 0x562e84f45360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.595+0000 7fb4eaffd700 1 -- 172.21.15.114:0/2298184423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f46520 msgr2=0x562e84f3bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:42.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.595+0000 7fb4eaffd700 1 --2- 172.21.15.114:0/2298184423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f46520 0x562e84f3bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.595+0000 7fb4eaffd700 1 -- 172.21.15.114:0/2298184423 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e84ca2c60 con 0x562e84f41be0 2023-10-18T14:05:42.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.595+0000 7fb4eaffd700 1 --2- 172.21.15.114:0/2298184423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f41be0 0x562e84f4ceb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec19e780 tx=0x7fb4e0011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cef8abf513e68c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:42.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.595+0000 7fb4d27fc700 1 -- 172.21.15.114:0/2298184423 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0004a30 con 0x562e84f41be0 2023-10-18T14:05:42.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.595+0000 7fb4d27fc700 1 -- 172.21.15.114:0/2298184423 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4e001dcd0 con 0x562e84f41be0 2023-10-18T14:05:42.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.595+0000 7fb4d27fc700 1 -- 172.21.15.114:0/2298184423 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00054e0 con 0x562e84f41be0 2023-10-18T14:05:42.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.596+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/2298184423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f41be0 msgr2=0x562e84f4ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.596+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/2298184423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f41be0 0x562e84f4ceb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec19e780 tx=0x7fb4e0011000 comp rx=0 tx=0).stop 2023-10-18T14:05:42.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.596+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/2298184423 shutdown_connections 2023-10-18T14:05:42.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.596+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/2298184423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f46520 0x562e84f3bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.596+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/2298184423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 0x562e84f45360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.596+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/2298184423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f41be0 0x562e84f4ceb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.596+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/2298184423 >> 172.21.15.114:0/2298184423 conn(0x562e84eb0720 msgr2=0x562e84f45aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.596+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/2298184423 shutdown_connections 2023-10-18T14:05:42.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.596+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/2298184423 wait complete. 2023-10-18T14:05:42.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.596+0000 7fb4fdf89b80 1 -- start start 2023-10-18T14:05:42.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4fdf89b80 1 Processor -- start 2023-10-18T14:05:42.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4fdf89b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 0x562e84f4cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4fdf89b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 0x562e84f4b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4fdf89b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 0x562e84f4b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4fdf89b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e84f4bec0 con 0x562e84f41be0 2023-10-18T14:05:42.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4fdf89b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e84f4c030 con 0x562e84f46520 2023-10-18T14:05:42.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4fdf89b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e84faa330 con 0x562e84f3c5d0 2023-10-18T14:05:42.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4fdf89b80 10 client.0 _ll_register_callbacks cb 0x562e84d75a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:42.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4ebfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 0x562e84f4b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4ebfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 0x562e84f4b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41856/0 (socket says 172.21.15.114:41856) 2023-10-18T14:05:42.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4ebfff700 1 -- 172.21.15.114:0/3536151395 learned_addr learned my addr 172.21.15.114:0/3536151395 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:42.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4ebfff700 1 -- 172.21.15.114:0/3536151395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 msgr2=0x562e84f4cc20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-18T14:05:42.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4ebfff700 1 --2- 172.21.15.114:0/3536151395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 0x562e84f4cc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4ebfff700 1 -- 172.21.15.114:0/3536151395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 msgr2=0x562e84f4b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:42.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4ebfff700 1 --2- 172.21.15.114:0/3536151395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 0x562e84f4b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.597+0000 7fb4ebfff700 1 -- 172.21.15.114:0/3536151395 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e000e940 con 0x562e84f46520 2023-10-18T14:05:42.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4ebfff700 1 --2- 172.21.15.114:0/3536151395 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 0x562e84f4b7e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4005bd0 tx=0x7fb4e4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=569d028ee1b349c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:42.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4caffd700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:05:42.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4caffd700 1 -- 172.21.15.114:0/3536151395 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400e040 con 0x562e84f46520 2023-10-18T14:05:42.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4caffd700 1 -- 172.21.15.114:0/3536151395 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fb4e402b030 con 0x562e84f46520 2023-10-18T14:05:42.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/3536151395 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e84f3d040 con 0x562e84f46520 2023-10-18T14:05:42.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4caffd700 1 -- 172.21.15.114:0/3536151395 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4e40078b0 con 0x562e84f46520 2023-10-18T14:05:42.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4fdf89b80 10 client.25418 fetch_fsmap learned FSMap version 29 2023-10-18T14:05:42.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/3536151395 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562e84ce0250 con 0x562e84f46520 2023-10-18T14:05:42.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4caffd700 1 -- 172.21.15.114:0/3536151395 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4e403d020 con 0x562e84f46520 2023-10-18T14:05:42.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4caffd700 1 -- 172.21.15.114:0/3536151395 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 29) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb4e4019040 con 0x562e84f46520 2023-10-18T14:05:42.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4fdf89b80 10 client.25418 fetch_fsmap finished waiting for FSMap version 29 2023-10-18T14:05:42.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4fdf89b80 10 client.25418 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:42.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4fdf89b80 20 client.25418 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:42.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/3536151395 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x562e84f564f0 0x562e84fad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:42.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4fdf89b80 4 client.25418 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:05:42.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.598+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/3536151395 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7fb4dc09e170 con 0x562e84f564f0 2023-10-18T14:05:42.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.599+0000 7fb4eb7fe700 1 --2- 172.21.15.114:0/3536151395 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x562e84f564f0 0x562e84fad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:42.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.599+0000 7fb4caffd700 10 client.25418 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:42.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.599+0000 7fb4eb7fe700 1 --2- 172.21.15.114:0/3536151395 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x562e84f564f0 0x562e84fad870 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eea2bda2422928f server_cookie=8bb6a3b758949466 in_seq=0 out_seq=0 2023-10-18T14:05:42.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4caffd700 1 -- 172.21.15.114:0/3536151395 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x7fb4dc09e170 con 0x562e84f564f0 2023-10-18T14:05:42.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4caffd700 10 client.25418 handle_command_reply: tid=0 2023-10-18T14:05:42.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4fdf89b80 1 client.25418 shutdown 2023-10-18T14:05:42.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/3536151395 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 msgr2=0x562e84f4b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/3536151395 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 0x562e84f4b7e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4005bd0 tx=0x7fb4e4009b80 comp rx=0 tx=0).stop 2023-10-18T14:05:42.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/3536151395 shutdown_connections 2023-10-18T14:05:42.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/3536151395 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x562e84f564f0 0x562e84fad870 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/3536151395 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x562e84f46520 0x562e84f4b7e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/3536151395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e84f3c5d0 0x562e84f4cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4fdf89b80 1 --2- 172.21.15.114:0/3536151395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562e84f41be0 0x562e84f4b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/3536151395 >> 172.21.15.114:0/3536151395 conn(0x562e84eb0720 msgr2=0x562e84f40b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4caffd700 0 client.25418 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:42.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/3536151395 shutdown_connections 2023-10-18T14:05:42.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4fdf89b80 1 -- 172.21.15.114:0/3536151395 wait complete. 2023-10-18T14:05:42.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.600+0000 7fb4fdf89b80 20 client.25418 trim_cache size 0 max 16384 2023-10-18T14:05:42.621 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:05:42.622 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "scrub active (9 inodes in the stack)", 2023-10-18T14:05:42.622 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": { 2023-10-18T14:05:42.622 INFO:teuthology.orchestra.run.smithi114.stdout: "94d18228-30fd-45a0-94d1-b2bec5a6db1a": { 2023-10-18T14:05:42.622 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/", 2023-10-18T14:05:42.622 INFO:teuthology.orchestra.run.smithi114.stdout: "tag": "94d18228-30fd-45a0-94d1-b2bec5a6db1a", 2023-10-18T14:05:42.623 INFO:teuthology.orchestra.run.smithi114.stdout: "options": "recursive,force" 2023-10-18T14:05:42.623 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:05:42.623 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:05:42.623 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:05:42.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.601+0000 7fb4f1da0700 1 -- 172.21.15.114:0/1212136235 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb4d40a15f0 msgr2=0x7fb4d40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.601+0000 7fb4f1da0700 1 --2- 172.21.15.114:0/1212136235 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb4d40a15f0 0x7fb4d40a3ab0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0005950 tx=0x7fb4e00058e0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.601+0000 7fb4f1da0700 1 -- 172.21.15.114:0/1212136235 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4ec0ff640 msgr2=0x7fb4ec1a2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:42.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.601+0000 7fb4f1da0700 1 --2- 172.21.15.114:0/1212136235 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4ec0ff640 0x7fb4ec1a2f30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00e9a0 tx=0x7fb4dc00ed60 comp rx=0 tx=0).stop 2023-10-18T14:05:42.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.601+0000 7fb4f1da0700 1 -- 172.21.15.114:0/1212136235 shutdown_connections 2023-10-18T14:05:42.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.601+0000 7fb4f1da0700 1 --2- 172.21.15.114:0/1212136235 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb4d40a15f0 0x7fb4d40a3ab0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.601+0000 7fb4f1da0700 1 --2- 172.21.15.114:0/1212136235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4ec1056e0 0x7fb4ec19d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.601+0000 7fb4f1da0700 1 --2- 172.21.15.114:0/1212136235 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb4ec0ff640 0x7fb4ec1a2f30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.601+0000 7fb4f1da0700 1 --2- 172.21.15.114:0/1212136235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4ec100000 0x7fb4ec1a3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:42.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.601+0000 7fb4f1da0700 1 -- 172.21.15.114:0/1212136235 >> 172.21.15.114:0/1212136235 conn(0x7fb4ec0767f0 msgr2=0x7fb4ec0679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:42.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.601+0000 7fb4f1da0700 1 -- 172.21.15.114:0/1212136235 shutdown_connections 2023-10-18T14:05:42.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:05:42.601+0000 7fb4f1da0700 1 -- 172.21.15.114:0/1212136235 wait complete. 2023-10-18T14:05:42.628 INFO:tasks.cephfs.filesystem:scrub status for tag:94d18228-30fd-45a0-94d1-b2bec5a6db1a - {'path': '/', 'tag': '94d18228-30fd-45a0-94d1-b2bec5a6db1a', 'options': 'recursive,force'} 2023-10-18T14:05:42.670 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.337+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000648 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/auxiliary-programs.txt auth v28 ap=1 s=3098 n(v0 b3098 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c78c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000648:[<0x10000000026/auxiliary-programs.txt v4>,<0x100000005e4/doc v328>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000648:[<0x10000000026/auxiliary-programs.txt v28>,<0x100000005e4/doc v3558>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.670 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.337+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001324 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/requirement-checking.txt auth v26 ap=1 s=3608 n(v0 rc2023-10-18T14:05:22.812040+0000 b3608 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c79180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001324:[<0x10000000026/requirement-checking.txt v22>,<0x100000005e4/doc v1187>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001324:[<0x10000000026/requirement-checking.txt v26>,<0x100000005e4/doc v3558>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.670 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-i[143420]: 2023-10-18T14:05:42.348+0000 7f30417a7700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000002e [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/ auth{1=1,2=1,3=1,4=1} v1917 ap=2 f(v5 m2023-10-18T14:05:28.931914+0000 23=23+0) n(v1 rc2023-10-18T14:05:28.933914+0000 b356199 24=23+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={25030=pAsLsXsFs/pAsLsXsFsxcral@114} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5640766d3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000002e:[<0x100000005e4/m4 v456>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x1000000002e:[<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2304>,<0x100000005e2/tmp v66>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v93>,<0x10000000000/_nogroup v77>,<0x1/volumes v75>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:28.921915+0000 22=22+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:28.933914+0000 b356199 24=23+1)","memory_value.dirstat":"f(v5 m2023-10-18T14:05:28.931914+0000 23=23+0)","memory_value.rstat":"n(v1 rc2023-10-18T14:05:28.933914+0000 b356199 24=23+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-10-18T14:05:42.671 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.337+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000027 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/CHANGES auth v24 ap=1 s=293 n(v0 b293 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c79700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000027:[<0x10000000026/CHANGES v2>,<0x100000005e4/doc v328>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000027:[<0x10000000026/CHANGES v24>,<0x100000005e4/doc v3558>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.671 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.340+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000667 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/string_to_tokens.c auth v30 ap=1 s=2449 n(v0 b2449 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@4},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c9c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000667:[<0x1000000002a/string_to_tokens.c v24>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000667:[<0x1000000002a/string_to_tokens.c v30>,<0x100000005e4/lib v3627>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.671 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.341+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000661 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/forker.c auth v34 ap=1 s=7659 n(v0 b7659 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@4},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c9d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000661:[<0x1000000002a/forker.c v12>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000661:[<0x1000000002a/forker.c v34>,<0x100000005e4/lib v3627>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.672 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: pgmap v330: 97 pgs: 97 active+clean; 55 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 1.36k op/s 2023-10-18T14:05:42.672 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:05:42.673 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.342+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/databin.c auth v50 ap=1 s=7024 n(v0 b7024 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@4},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c9cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000065e:[<0x1000000002a/databin.c v6>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000065e:[<0x1000000002a/databin.c v50>,<0x100000005e4/lib v3627>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.673 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.342+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/dataascii.c auth v44 ap=1 s=4719 n(v0 b4719 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@4},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c9d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000065d:[<0x1000000002a/dataascii.c v4>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000065d:[<0x1000000002a/dataascii.c v44>,<0x100000005e4/lib v3627>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.673 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.343+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000666 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/str_to_bytes.c auth v36 ap=1 s=4158 n(v0 b4158 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@4},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ca2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000666:[<0x1000000002a/str_to_bytes.c v22>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000666:[<0x1000000002a/str_to_bytes.c v36>,<0x100000005e4/lib v3627>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.673 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.344+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000669 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/write_log.c auth v52 ap=1 s=12024 n(v0 b12024 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@4},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ca2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000669:[<0x1000000002a/write_log.c v28>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000669:[<0x1000000002a/write_log.c v52>,<0x100000005e4/lib v3627>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.674 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.344+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000668 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/tlibio.c auth v42 ap=1 s=36312 n(v0 b36312 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@4},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ca2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000668:[<0x1000000002a/tlibio.c v26>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000668:[<0x1000000002a/tlibio.c v42>,<0x100000005e4/lib v3627>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.674 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.370+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/114.out auth v1114 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83962000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000038a:[<0x10000000403/114.out v466>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000038a:[<0x10000000403/114.out v1114>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.674 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.374+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ca [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/222 auth v1102 ap=1 s=2542 n(v0 b2542 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83962b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ca:[<0x10000000403/222 v1074>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012ca:[<0x10000000403/222 v1102>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.675 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.344+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000660 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/file_lock.c auth v48 ap=1 s=4573 n(v0 b4573 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@4},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ca3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000660:[<0x1000000002a/file_lock.c v10>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000660:[<0x1000000002a/file_lock.c v48>,<0x100000005e4/lib v3627>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.675 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.345+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000665 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/random_range.c auth v32 ap=1 s=21314 n(v0 b21314 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@4},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ca3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000665:[<0x1000000002a/random_range.c v20>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000665:[<0x1000000002a/random_range.c v32>,<0x100000005e4/lib v3627>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.675 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.345+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/datapid.c auth v40 ap=1 s=4216 n(v0 b4216 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@4},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ca3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000065f:[<0x1000000002a/datapid.c v8>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000065f:[<0x1000000002a/datapid.c v40>,<0x100000005e4/lib v3627>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.676 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.374+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001471 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/397.out auth v1120 ap=1 s=746 n(v0 b746 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83963600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001471:[<0x10000000403/397.out v1078>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001471:[<0x10000000403/397.out v1120>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.676 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.375+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/328.out auth v1092 ap=1 s=510 n(v0 b510 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83962580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000043c:[<0x10000000403/328.out v878>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000043c:[<0x10000000403/328.out v1092>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.676 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.375+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004de [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/409.out auth v1094 ap=1 s=5922 n(v0 b5922 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83963080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004de:[<0x10000000403/409.out v910>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004de:[<0x10000000403/409.out v1094>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.677 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.345+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000662 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/open_flags.c auth v54 ap=1 s=7197 n(v0 b7197 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@4},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ca4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000662:[<0x1000000002a/open_flags.c v14>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000662:[<0x1000000002a/open_flags.c v54>,<0x100000005e4/lib v3627>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.677 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.346+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000002b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/Makefile auth v56 ap=1 s=633 n(v0 rc2023-10-18T14:05:08.547333+0000 b633 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@3},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ca4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000002b:[<0x1000000002a/Makefile v2>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000002b:[<0x1000000002a/Makefile v56>,<0x100000005e4/lib v3627>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.677 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.375+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/220 auth v1100 ap=1 s=2269 n(v0 b2269 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83963b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012c8:[<0x10000000403/220 v1070>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012c8:[<0x10000000403/220 v1100>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.678 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.375+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000123c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/086.out auth v1118 ap=1 s=520 n(v0 b520 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83964100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000123c:[<0x10000000403/086.out v1058>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000123c:[<0x10000000403/086.out v1118>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.678 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.350+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000663 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/pattern.c auth v38 ap=1 s=2737 n(v0 b2737 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@4},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ca4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000663:[<0x1000000002a/pattern.c v16>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000663:[<0x1000000002a/pattern.c v38>,<0x100000005e4/lib v3631>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.678 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.351+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000653 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/file_lock.h auth v44 ap=1 s=308 n(v0 b308 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@2},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c6c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000653:[<0x10000000028/file_lock.h v16>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000653:[<0x10000000028/file_lock.h v44>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.679 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.352+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000657 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/pattern.h auth v72 ap=1 s=2687 n(v0 b2687 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@2},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c6cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000657:[<0x10000000028/pattern.h v24>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000657:[<0x10000000028/pattern.h v72>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.679 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.375+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000376 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/104.out auth v1110 ap=1 s=79 n(v0 b79 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83964680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000376:[<0x10000000403/104.out v426>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000376:[<0x10000000403/104.out v1110>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.679 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.376+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/203 auth v1122 ap=1 s=1602 n(v0 b1602 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83965180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b7:[<0x10000000403/203 v1066>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012b7:[<0x10000000403/203 v1122>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.679 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.376+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/228.out auth v1090 ap=1 s=209 n(v0 b209 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83964c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081b:[<0x10000000403/228.out v834>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000081b:[<0x10000000403/228.out v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.680 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.352+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/string_to_tokens.h auth v68 ap=1 s=625 n(v0 b625 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@2},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c6d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000065a:[<0x10000000028/string_to_tokens.h v30>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000065a:[<0x10000000028/string_to_tokens.h v68>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.680 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.353+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/write_log.h auth v52 ap=1 s=4653 n(v0 b4653 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@2},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c6d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000065c:[<0x10000000028/write_log.h v34>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000065c:[<0x10000000028/write_log.h v52>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.680 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.353+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000650 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/buildrules auth v70 ap=1 s=3547 n(v0 b3547 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@3},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c6db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000650:[<0x10000000028/buildrules v10>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000650:[<0x10000000028/buildrules v70>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.681 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.376+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000041f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/214.out auth v1088 ap=1 s=2272 n(v0 b2272 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83754580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000041f:[<0x10000000403/214.out v826>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000041f:[<0x10000000403/214.out v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.682 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.376+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000560 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/474.out auth v1108 ap=1 s=28 n(v0 b28 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83754b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000560:[<0x10000000403/474.out v938>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000560:[<0x10000000403/474.out v1108>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.682 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.377+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000476 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/357.out auth v1096 ap=1 s=140 n(v0 b140 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83755080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000476:[<0x10000000403/357.out v890>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000476:[<0x10000000403/357.out v1096>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.682 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.377+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001503 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/533 auth v1106 ap=1 s=3078 n(v0 b3078 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83965700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001503:[<0x10000000403/533 v1086>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001503:[<0x10000000403/533 v1106>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.682 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.377+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ec [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/027 auth v1104 ap=1 s=1940 n(v0 b1940 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83754000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ec:[<0x10000000403/027 v1054>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011ec:[<0x10000000403/027 v1104>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.683 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.353+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000655 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/install-sh auth v62 ap=1 s=6973 n(v0 b6973 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@4},l=25030 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c6e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000655:[<0x10000000028/install-sh v20>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000655:[<0x10000000028/install-sh v62>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.683 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.353+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000029 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/Makefile auth v54 ap=1 s=370 n(v0 rc2023-10-18T14:05:08.536333+0000 b370 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@2},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c6e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000029:[<0x10000000028/Makefile v2>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000029:[<0x10000000028/Makefile v54>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.685 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.378+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/181 auth v1112 ap=1 s=1682 n(v0 b1682 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83755600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000129f:[<0x10000000403/181 v1062>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000129f:[<0x10000000403/181 v1112>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.685 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.378+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/432.out auth v1098 ap=1 s=751 n(v0 b751 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83755b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000050c:[<0x10000000403/432.out v924>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000050c:[<0x10000000403/432.out v1098>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.685 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.378+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/448.out auth v1142 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83993180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000052c:[<0x10000000403/448.out v942>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000052c:[<0x10000000403/448.out v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.686 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.354+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000064f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/buildmacros auth v58 ap=1 s=4489 n(v0 b4489 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@3},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c6f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000064f:[<0x10000000028/buildmacros v8>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000064f:[<0x10000000028/buildmacros v58>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.686 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.354+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000652 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/databin.h auth v66 ap=1 s=1361 n(v0 b1361 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@2},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c6f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000652:[<0x10000000028/databin.h v14>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000652:[<0x10000000028/databin.h v66>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.687 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.355+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000654 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/forker.h auth v48 ap=1 s=1306 n(v0 b1306 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@2},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c76000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000654:[<0x10000000028/forker.h v18>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000654:[<0x10000000028/forker.h v48>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.688 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.378+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/461 auth v1116 ap=1 s=1308 n(v0 b1308 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83756100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b6:[<0x10000000403/461 v1082>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014b6:[<0x10000000403/461 v1116>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.689 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.378+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000392 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/118.out auth v1134 ap=1 s=450 n(v0 b450 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8368e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000392:[<0x10000000403/118.out v482>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000392:[<0x10000000403/118.out v1134>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.689 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.378+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/501.out auth v1162 ap=1 s=200 n(v0 b200 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8368eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e2:[<0x10000000403/501.out v1120>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014e2:[<0x10000000403/501.out v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.689 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.379+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/514.out auth v1138 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8368f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005b0:[<0x10000000403/514.out v986>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005b0:[<0x10000000403/514.out v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.689 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.379+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000141a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/315 auth v1156 ap=1 s=1826 n(v0 b1826 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83993700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000141a:[<0x10000000403/315 v1104>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000141a:[<0x10000000403/315 v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.690 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.355+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/tlibio.h auth v64 ap=1 s=2774 n(v0 b2774 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@2},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c76580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000065b:[<0x10000000028/tlibio.h v32>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000065b:[<0x10000000028/tlibio.h v64>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.690 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.355+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000651 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/dataascii.h auth v50 ap=1 s=1322 n(v0 b1322 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@2},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c76b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000651:[<0x10000000028/dataascii.h v12>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000651:[<0x10000000028/dataascii.h v50>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.690 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.356+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000656 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/open_flags.h auth v60 ap=1 s=1922 n(v0 b1922 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@2},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c77600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000656:[<0x10000000028/open_flags.h v22>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000656:[<0x10000000028/open_flags.h v60>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.692 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.379+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/505 auth v1164 ap=1 s=1746 n(v0 b1746 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8368e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e6:[<0x10000000403/505 v1124>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014e6:[<0x10000000403/505 v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.692 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.379+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000433 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/224.out auth v1144 ap=1 s=51 n(v0 b51 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8368f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000433:[<0x10000000403/224.out v826>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000433:[<0x10000000403/224.out v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.693 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.379+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ff [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/275 auth v1150 ap=1 s=2225 n(v0 b2225 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8368fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ff:[<0x10000000403/275 v1100>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012ff:[<0x10000000403/275 v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.693 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.380+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/476 auth v1160 ap=1 s=986 n(v0 b986 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83690100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c6:[<0x10000000403/476 v1112>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014c6:[<0x10000000403/476 v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.693 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.380+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/500 auth v1148 ap=1 s=2818 n(v0 b2818 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83690680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e0:[<0x10000000403/500 v1116>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014e0:[<0x10000000403/500 v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.694 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.356+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000659 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/str_to_bytes.h auth v56 ap=1 s=275 n(v0 b275 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@2},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c6ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000659:[<0x10000000028/str_to_bytes.h v28>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000659:[<0x10000000028/str_to_bytes.h v56>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.694 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.356+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000664 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/random.c auth v46 ap=1 s=4175 n(v0 b4175 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@4},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ca5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000664:[<0x1000000002a/random.c v18>,<0x100000005e4/lib v394>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000664:[<0x1000000002a/random.c v46>,<0x100000005e4/lib v3631>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.695 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.380+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000423 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/216.out auth v1136 ap=1 s=112 n(v0 b112 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83690c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000423:[<0x10000000403/216.out v818>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000423:[<0x10000000403/216.out v1136>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.696 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.380+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/158.out auth v1140 ap=1 s=912 n(v0 b912 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83691180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e2:[<0x10000000403/158.out v642>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003e2:[<0x10000000403/158.out v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.696 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.380+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/035.out.nfs auth v1146 ap=1 s=146 n(v0 b146 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83691700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e3:[<0x10000000403/035.out.nfs v144>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002e3:[<0x10000000403/035.out.nfs v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.697 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.356+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001175 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_dmapidev.m4 auth v111 ap=1 s=938 n(v0 b938 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ac0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001175:[<0x1000000002e/package_dmapidev.m4 v48>,<0x100000005e4/m4 v1235>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001175:[<0x1000000002e/package_dmapidev.m4 v111>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.697 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.357+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_libbtrfs.m4 auth v93 ap=1 s=190 n(v0 b190 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ac1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000067a:[<0x1000000002e/package_libbtrfs.m4 v16>,<0x100000005e4/m4 v456>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000067a:[<0x1000000002e/package_libbtrfs.m4 v93>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.697 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.358+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000676 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_acldev.m4 auth v83 ap=1 s=1217 n(v0 b1217 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ac1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000676:[<0x1000000002e/package_acldev.m4 v8>,<0x100000005e4/m4 v456>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000676:[<0x1000000002e/package_acldev.m4 v83>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.697 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.378+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001201 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/043 auth v1100 ap=1 s=1774 n(v0 b1774 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff58c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001201:[<0x10000000403/043 v1058>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001201:[<0x10000000403/043 v1100>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.698 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.378+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/473 auth v1102 ap=1 s=2474 n(v0 b2474 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff58100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c3:[<0x10000000403/473 v1082>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014c3:[<0x10000000403/473 v1102>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.698 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.378+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/286 auth v1116 ap=1 s=4961 n(v0 b4961 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff57b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130a:[<0x10000000403/286 v1070>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000130a:[<0x10000000403/286 v1116>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.698 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.378+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011f7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/033.out auth v1114 ap=1 s=83 n(v0 b83 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff59180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011f7:[<0x10000000403/033.out v1054>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011f7:[<0x10000000403/033.out v1114>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.698 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.379+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000309 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.nojournal auth v1090 ap=1 s=795 n(v0 b795 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff72580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000309:[<0x10000000403/050.out.nojournal v208>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000309:[<0x10000000403/050.out.nojournal v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.699 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.379+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/587 auth v1112 ap=1 s=3748 n(v0 b3748 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff59700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153f:[<0x10000000403/587 v1086>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000153f:[<0x10000000403/587 v1112>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.699 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.380+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/444 auth v1110 ap=1 s=1007 n(v0 b1007 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff72b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a5:[<0x10000000403/444 v1078>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014a5:[<0x10000000403/444 v1110>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.699 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.380+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001266 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/127 auth v1104 ap=1 s=2268 n(v0 b2268 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff73b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001266:[<0x10000000403/127 v1066>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001266:[<0x10000000403/127 v1104>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.699 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.381+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000085f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/262.out auth v1094 ap=1 s=486 n(v0 b486 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff74100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000085f:[<0x10000000403/262.out v844>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000085f:[<0x10000000403/262.out v1094>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.699 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.381+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/193.out auth v1092 ap=1 s=1930 n(v0 b1930 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff74680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000080a:[<0x10000000403/193.out v782>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000080a:[<0x10000000403/193.out v1092>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.700 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.381+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000059a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/503.out auth v1096 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff73080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000059a:[<0x10000000403/503.out v948>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000059a:[<0x10000000403/503.out v1096>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.700 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.382+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001230 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/075 auth v1106 ap=1 s=3406 n(v0 rc2023-10-18T14:05:24.273010+0000 b3406 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff72000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001230:[<0x10000000403/075 v1062>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001230:[<0x10000000403/075 v1106>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.700 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.382+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/418.out auth v1108 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff73600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f0:[<0x10000000403/418.out v918>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004f0:[<0x10000000403/418.out v1108>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.700 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.382+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000883 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/280.out auth v1146 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff2f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000883:[<0x10000000403/280.out v840>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000883:[<0x10000000403/280.out v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.700 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.382+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/100.out auth v1152 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff3eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000036e:[<0x10000000403/100.out v410>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000036e:[<0x10000000403/100.out v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.701 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.382+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/195.out auth v1142 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff3e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000080e:[<0x10000000403/195.out v790>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000080e:[<0x10000000403/195.out v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.701 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.383+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000853 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/256.out auth v1148 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff3fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000853:[<0x10000000403/256.out v830>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000853:[<0x10000000403/256.out v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.701 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.383+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/266 auth v1170 ap=1 s=1798 n(v0 rc2023-10-18T14:05:24.705001+0000 b1798 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff3f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f6:[<0x10000000403/266 v1100>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012f6:[<0x10000000403/266 v1170>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.701 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.383+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/178 auth v1190 ap=1 s=1329 n(v0 b1329 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff3f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000129c:[<0x10000000403/178 v1092>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000129c:[<0x10000000403/178 v1190>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.702 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.384+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008df [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/326.out auth v1144 ap=1 s=376 n(v0 b376 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff40100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008df:[<0x10000000403/326.out v854>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008df:[<0x10000000403/326.out v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.702 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.384+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014df [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/499 auth v1174 ap=1 s=1226 n(v0 b1226 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff3e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014df:[<0x10000000403/499 v1132>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014df:[<0x10000000403/499 v1174>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.702 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.384+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002eb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/039.out auth v1150 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff40680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002eb:[<0x10000000403/039.out v160>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002eb:[<0x10000000403/039.out v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.702 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.384+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012dc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/240 auth v1188 ap=1 s=1551 n(v0 b1551 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff40c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012dc:[<0x10000000403/240 v1096>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012dc:[<0x10000000403/240 v1188>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.702 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.384+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ec [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/511 auth v1168 ap=1 s=1170 n(v0 rc2023-10-18T14:05:25.294989+0000 b1170 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff41700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ec:[<0x10000000403/511 v1136>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014ec:[<0x10000000403/511 v1168>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.703 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.384+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/038.out auth v1138 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff41180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e9:[<0x10000000403/038.out v156>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002e9:[<0x10000000403/038.out v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.703 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.385+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/538.out auth v1158 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff4c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005e0:[<0x10000000403/538.out v982>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005e0:[<0x10000000403/538.out v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.703 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.385+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000841 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/247.out auth v1154 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff4cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000841:[<0x10000000403/247.out v826>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000841:[<0x10000000403/247.out v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.703 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.385+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000522 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/443.out auth v1156 ap=1 s=39 n(v0 b39 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff4c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000522:[<0x10000000403/443.out v934>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000522:[<0x10000000403/443.out v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.704 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.385+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001429 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/330 auth v1172 ap=1 s=1813 n(v0 b1813 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff4d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001429:[<0x10000000403/330 v1108>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001429:[<0x10000000403/330 v1172>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.704 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.386+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000142d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/334 auth v1164 ap=1 s=1917 n(v0 b1917 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff4d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000142d:[<0x10000000403/334 v1112>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000142d:[<0x10000000403/334 v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.704 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.386+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001220 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/059 auth v1182 ap=1 s=3986 n(v0 b3986 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff4db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001220:[<0x10000000403/059 v1084>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001220:[<0x10000000403/059 v1182>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.704 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.386+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000142f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/336 auth v1180 ap=1 s=2119 n(v0 b2119 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff4f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000142f:[<0x10000000403/336 v1116>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000142f:[<0x10000000403/336 v1180>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.704 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.387+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000141f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/320 auth v1166 ap=1 s=1652 n(v0 b1652 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff4f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000141f:[<0x10000000403/320 v1104>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000141f:[<0x10000000403/320 v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.705 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.387+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001454 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/371 auth v1176 ap=1 s=1232 n(v0 b1232 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff4e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001454:[<0x10000000403/371 v1124>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001454:[<0x10000000403/371 v1176>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.705 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.387+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001438 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/345 auth v1186 ap=1 s=899 n(v0 b899 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff4ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001438:[<0x10000000403/345 v1120>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001438:[<0x10000000403/345 v1186>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.705 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.387+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/311.out auth v1140 ap=1 s=9633 n(v0 b9633 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff56000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c1:[<0x10000000403/311.out v848>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008c1:[<0x10000000403/311.out v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.705 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.388+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001207 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/049 auth v1178 ap=1 s=1899 n(v0 rc2023-10-18T14:05:24.223011+0000 b1899 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff56580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001207:[<0x10000000403/049 v1080>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001207:[<0x10000000403/049 v1178>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.706 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.388+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011f1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/030.out auth v1162 ap=1 s=1956 n(v0 b1956 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff57080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011f1:[<0x10000000403/030.out v1076>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011f1:[<0x10000000403/030.out v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.706 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.388+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001547 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/group auth v1108 ap=1 s=13538 n(v0 rc2023-10-18T14:05:25.509985+0000 b13538 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffc3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001547:[<0x10000000403/group v1070>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001547:[<0x10000000403/group v1108>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.706 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.390+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000144e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/365 auth v1110 ap=1 s=1312 n(v0 b1312 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffc3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000144e:[<0x10000000403/365 v1052>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000144e:[<0x10000000403/365 v1110>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.706 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.390+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000466 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/349.out auth v1090 ap=1 s=277 n(v0 b277 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffc4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000466:[<0x10000000403/349.out v892>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000466:[<0x10000000403/349.out v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.706 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.391+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/161.out auth v1080 ap=1 s=82 n(v0 b82 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffc4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e8:[<0x10000000403/161.out v654>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003e8:[<0x10000000403/161.out v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.707 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.392+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/090.out auth v1076 ap=1 s=551 n(v0 b551 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffc5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000035a:[<0x10000000403/090.out v370>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000035a:[<0x10000000403/090.out v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.707 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.393+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/486 auth v1116 ap=1 s=1491 n(v0 b1491 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffc5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d1:[<0x10000000403/486 v1060>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014d1:[<0x10000000403/486 v1116>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.707 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.393+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001464 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/385 auth v1184 ap=1 s=1698 n(v0 b1698 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff4e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001464:[<0x10000000403/385 v1128>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001464:[<0x10000000403/385 v1184>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.707 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.394+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001516 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/552 auth v1106 ap=1 s=2834 n(v0 b2834 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001516:[<0x10000000403/552 v1064>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001516:[<0x10000000403/552 v1106>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.708 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.394+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a31 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/581.out auth v1082 ap=1 s=2615 n(v0 rc2023-10-18T14:05:14.658207+0000 b2615 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a31:[<0x10000000403/581.out v996>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000a31:[<0x10000000403/581.out v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.708 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.395+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000307 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.cfg auth v1074 ap=1 s=40 n(v0 b40 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffcab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000307:[<0x10000000403/050.cfg v204>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000307:[<0x10000000403/050.cfg v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.708 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.395+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/215 auth v1112 ap=1 s=1296 n(v0 b1296 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffcb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012c3:[<0x10000000403/215 v1044>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012c3:[<0x10000000403/215 v1112>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.708 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.396+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004da [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/407.out auth v1086 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffc4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004da:[<0x10000000403/407.out v920>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004da:[<0x10000000403/407.out v1086>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.708 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.396+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000444 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/332.out auth v1072 ap=1 s=373 n(v0 b373 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffc3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000444:[<0x10000000403/332.out v878>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000444:[<0x10000000403/332.out v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.709 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.396+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001286 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/156 auth v1160 ap=1 s=2973 n(v0 b2973 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff56b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001286:[<0x10000000403/156 v1088>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001286:[<0x10000000403/156 v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.709 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.397+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/254.out auth v1078 ap=1 s=486 n(v0 b486 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffcb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000084f:[<0x10000000403/254.out v846>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000084f:[<0x10000000403/254.out v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.709 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.397+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000454 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/340.out auth v1088 ap=1 s=1102 n(v0 b1102 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffcbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000454:[<0x10000000403/340.out v884>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000454:[<0x10000000403/340.out v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.709 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.398+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001256 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/111 auth v1096 ap=1 s=2587 n(v0 b2587 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffcc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001256:[<0x10000000403/111 v1032>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001256:[<0x10000000403/111 v1096>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.709 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.398+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001534 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/577 auth v1102 ap=1 s=4072 n(v0 b4072 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001534:[<0x10000000403/577 v1068>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001534:[<0x10000000403/577 v1102>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.710 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.398+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/005 auth v1118 ap=1 s=1487 n(v0 rc2023-10-18T14:05:23.699022+0000 b1487 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffcc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d5:[<0x10000000403/005 v1024>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011d5:[<0x10000000403/005 v1118>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.710 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.398+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012da [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/238 auth v1092 ap=1 s=3998 n(v0 rc2023-10-18T14:05:24.633003+0000 b3998 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffcd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012da:[<0x10000000403/238 v1048>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012da:[<0x10000000403/238 v1092>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.710 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.399+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/392 auth v1100 ap=1 s=2569 n(v0 b2569 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffcd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000146b:[<0x10000000403/392 v1056>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000146b:[<0x10000000403/392 v1100>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.710 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.399+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/184 auth v1104 ap=1 s=695 n(v0 b695 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffdb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a2:[<0x10000000403/184 v1036>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012a2:[<0x10000000403/184 v1104>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.711 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.400+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/516.out auth v1070 ap=1 s=473 n(v0 b473 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff23600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005b4:[<0x10000000403/516.out v968>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005b4:[<0x10000000403/516.out v1070>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.711 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.401+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/245.out auth v1114 ap=1 s=105 n(v0 b105 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffda000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000083d:[<0x10000000403/245.out v840>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000083d:[<0x10000000403/245.out v1114>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.711 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.401+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/021 auth v1094 ap=1 s=1205 n(v0 b1205 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffdab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e6:[<0x10000000403/021 v1028>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011e6:[<0x10000000403/021 v1094>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.711 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.401+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012aa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/191 auth v1098 ap=1 s=1911 n(v0 b1911 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffdb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012aa:[<0x10000000403/191 v1040>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012aa:[<0x10000000403/191 v1098>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.711 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.401+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000845 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/249.out auth v1084 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffda580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000845:[<0x10000000403/249.out v842>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000845:[<0x10000000403/249.out v1084>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.712 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.401+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000413 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/208.out auth v1062 ap=1 s=68 n(v0 b68 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff24100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000413:[<0x10000000403/208.out v816>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000413:[<0x10000000403/208.out v1062>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.712 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.402+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ea [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/415.out auth v1064 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff23b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ea:[<0x10000000403/415.out v926>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004ea:[<0x10000000403/415.out v1064>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.712 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.402+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014eb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/510 auth v1082 ap=1 s=1831 n(v0 b1831 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff25180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014eb:[<0x10000000403/510 v1050>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014eb:[<0x10000000403/510 v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.712 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.403+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/022.out auth v1056 ap=1 s=1216 n(v0 b1216 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff2c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002c7:[<0x10000000403/022.out v88>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002c7:[<0x10000000403/022.out v1056>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.712 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.404+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000143d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/350 auth v1074 ap=1 s=1260 n(v0 b1260 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff24680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000143d:[<0x10000000403/350 v1042>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000143d:[<0x10000000403/350 v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.713 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.404+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000126e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/135 auth v1078 ap=1 s=1385 n(v0 b1385 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff25700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000126e:[<0x10000000403/135 v1034>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000126e:[<0x10000000403/135 v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.713 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.404+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/159.out auth v1058 ap=1 s=142 n(v0 b142 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff2d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e4:[<0x10000000403/159.out v646>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003e4:[<0x10000000403/159.out v1058>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.713 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.405+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003dc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/155.out auth v1054 ap=1 s=397 n(v0 b397 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff2d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003dc:[<0x10000000403/155.out v630>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003dc:[<0x10000000403/155.out v1054>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.713 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.405+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/351.out auth v1060 ap=1 s=892 n(v0 b892 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff2cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000046a:[<0x10000000403/351.out v896>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000046a:[<0x10000000403/351.out v1060>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.713 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.406+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003da [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/154.out auth v1080 ap=1 s=397 n(v0 b397 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff2db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003da:[<0x10000000403/154.out v626>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003da:[<0x10000000403/154.out v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.714 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.406+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ff [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/041 auth v1076 ap=1 s=3383 n(v0 b3383 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff2e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ff:[<0x10000000403/041 v1022>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011ff:[<0x10000000403/041 v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.714 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.407+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012dd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/241 auth v1072 ap=1 s=859 n(v0 b859 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff2ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012dd:[<0x10000000403/241 v1038>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012dd:[<0x10000000403/241 v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.714 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.407+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008fb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/552.out auth v1078 ap=1 s=215 n(v0 b215 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffe7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008fb:[<0x10000000403/552.out v970>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008fb:[<0x10000000403/552.out v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.714 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.408+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001219 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/052 auth v1066 ap=1 s=1585 n(v0 b1585 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff24c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001219:[<0x10000000403/052 v1026>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001219:[<0x10000000403/052 v1066>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.715 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.408+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000088d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/285.out auth v1052 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff2c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000088d:[<0x10000000403/285.out v864>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000088d:[<0x10000000403/285.out v1052>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.715 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.408+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000125c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/117 auth v1068 ap=1 s=1851 n(v0 b1851 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff2e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000125c:[<0x10000000403/117 v1030>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000125c:[<0x10000000403/117 v1068>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.715 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.408+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001468 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/389 auth v1084 ap=1 s=1103 n(v0 b1103 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff2f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001468:[<0x10000000403/389 v1046>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001468:[<0x10000000403/389 v1084>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.715 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.408+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001510 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/546 auth v1100 ap=1 s=2099 n(v0 b2099 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffe7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001510:[<0x10000000403/546 v1040>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001510:[<0x10000000403/546 v1100>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.715 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.409+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003de [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/156.out auth v1064 ap=1 s=427 n(v0 b427 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380000580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003de:[<0x10000000403/156.out v634>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003de:[<0x10000000403/156.out v1064>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.716 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.410+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003fe [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/172.out auth v1066 ap=1 s=244 n(v0 b244 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380000b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003fe:[<0x10000000403/172.out v698>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003fe:[<0x10000000403/172.out v1066>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.716 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.410+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001545 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/592 auth v1092 ap=1 s=845 n(v0 b845 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380001600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001545:[<0x10000000403/592 v1056>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001545:[<0x10000000403/592 v1092>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.716 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.410+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001304 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/280 auth v1108 ap=1 s=1103 n(v0 b1103 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380001b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001304:[<0x10000000403/280 v1032>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001304:[<0x10000000403/280 v1108>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.716 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.410+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/550.out auth v1082 ap=1 s=266 n(v0 b266 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380000000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008f7:[<0x10000000403/550.out v966>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008f7:[<0x10000000403/550.out v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.717 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.410+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/421.out auth v1070 ap=1 s=39 n(v0 b39 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380001080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f6:[<0x10000000403/421.out v916>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004f6:[<0x10000000403/421.out v1070>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.717 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.411+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000125b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/116 auth v1088 ap=1 s=2055 n(v0 b2055 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380002100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000125b:[<0x10000000403/116 v1016>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000125b:[<0x10000000403/116 v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.717 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.411+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000370 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/101.out auth v1102 ap=1 s=673 n(v0 b673 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380002680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000370:[<0x10000000403/101.out v414>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000370:[<0x10000000403/101.out v1102>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.717 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.411+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/584 auth v1096 ap=1 s=943 n(v0 b943 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380002c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153c:[<0x10000000403/584 v1052>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000153c:[<0x10000000403/584 v1096>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.717 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.411+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001473 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/399 auth v1104 ap=1 s=5299 n(v0 rc2023-10-18T14:05:25.031994+0000 b5299 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380003180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001473:[<0x10000000403/399 v1036>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001473:[<0x10000000403/399 v1104>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.718 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.412+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/245 auth v1094 ap=1 s=1184 n(v0 b1184 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380003700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e1:[<0x10000000403/245 v1028>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012e1:[<0x10000000403/245 v1094>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.718 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.412+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000151f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/560 auth v1106 ap=1 s=2407 n(v0 b2407 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380008000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000151f:[<0x10000000403/560 v1044>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000151f:[<0x10000000403/560 v1106>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.718 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.413+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ae [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/195 auth v1080 ap=1 s=2016 n(v0 b2016 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380009080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ae:[<0x10000000403/195 v1024>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012ae:[<0x10000000403/195 v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.718 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.413+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001271 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/138 auth v1086 ap=1 s=4429 n(v0 b4429 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380009600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001271:[<0x10000000403/138 v1020>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001271:[<0x10000000403/138 v1086>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.719 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.413+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/143.out auth v1062 ap=1 s=298 n(v0 b298 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380009b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c4:[<0x10000000403/143.out v582>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003c4:[<0x10000000403/143.out v1062>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.719 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.414+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000821 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/231.out auth v1098 ap=1 s=529 n(v0 b529 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038000a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000821:[<0x10000000403/231.out v820>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000821:[<0x10000000403/231.out v1098>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.719 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.414+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000804 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/190.out auth v1060 ap=1 s=505 n(v0 b505 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038000b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000804:[<0x10000000403/190.out v770>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000804:[<0x10000000403/190.out v1060>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.719 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.414+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/335.out auth v1074 ap=1 s=224 n(v0 b224 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380008580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000044a:[<0x10000000403/335.out v870>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000044a:[<0x10000000403/335.out v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.720 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.415+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001530 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/574.out auth v1084 ap=1 s=3783 n(v0 b3783 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380008b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001530:[<0x10000000403/574.out v1048>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001530:[<0x10000000403/574.out v1084>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.720 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.415+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/176.out auth v1072 ap=1 s=88 n(v0 b88 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038000b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e8:[<0x10000000403/176.out v714>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000007e8:[<0x10000000403/176.out v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.720 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.415+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/344.out auth v1068 ap=1 s=1467 n(v0 b1467 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038000a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000045c:[<0x10000000403/344.out v874>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000045c:[<0x10000000403/344.out v1068>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.720 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.416+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000121f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/058 auth v1090 ap=1 s=1182 n(v0 b1182 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038001a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000121f:[<0x10000000403/058 v1012>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000121f:[<0x10000000403/058 v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.720 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.416+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001259 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/114 auth v1072 ap=1 s=1118 n(v0 b1118 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffdc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001259:[<0x10000000403/114 v1024>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001259:[<0x10000000403/114 v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.721 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.417+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001457 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/373.out auth v1078 ap=1 s=299 n(v0 b299 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffdcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001457:[<0x10000000403/373.out v1044>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001457:[<0x10000000403/373.out v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.721 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.417+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002cf [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/026.out auth v1066 ap=1 s=190 n(v0 b190 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffdd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002cf:[<0x10000000403/026.out v104>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002cf:[<0x10000000403/026.out v1066>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.721 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.418+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001515 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/551 auth v1084 ap=1 s=2031 n(v0 b2031 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffdc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001515:[<0x10000000403/551 v1060>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001515:[<0x10000000403/551 v1084>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.721 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.418+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001285 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/155 auth v1080 ap=1 s=2958 n(v0 b2958 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffdbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001285:[<0x10000000403/155 v1028>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001285:[<0x10000000403/155 v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.722 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.419+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/036.out auth v1058 ap=1 s=47 n(v0 b47 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038000ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e5:[<0x10000000403/036.out v148>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002e5:[<0x10000000403/036.out v1058>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.722 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.420+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000141b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/316 auth v1074 ap=1 s=1197 n(v0 b1197 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffe4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000141b:[<0x10000000403/316 v1040>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000141b:[<0x10000000403/316 v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.722 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.420+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/299.out auth v1070 ap=1 s=93 n(v0 b93 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffe4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a9:[<0x10000000403/299.out v870>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008a9:[<0x10000000403/299.out v1070>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.722 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.420+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000121b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/054 auth v1076 ap=1 s=3061 n(v0 b3061 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038001a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000121b:[<0x10000000403/054 v1008>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000121b:[<0x10000000403/054 v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.722 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.420+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/574 auth v1092 ap=1 s=3845 n(v0 b3845 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffdd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152f:[<0x10000000403/574 v1064>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000152f:[<0x10000000403/574 v1092>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.723 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.421+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001465 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/386 auth v1094 ap=1 s=3437 n(v0 b3437 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffe6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001465:[<0x10000000403/386 v1048>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001465:[<0x10000000403/386 v1094>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.723 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.422+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/187 auth v1076 ap=1 s=3827 n(v0 b3827 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffe5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a6:[<0x10000000403/187 v1036>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012a6:[<0x10000000403/187 v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.723 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.424+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001289 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/159 auth v1088 ap=1 s=1393 n(v0 b1393 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffe4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001289:[<0x10000000403/159 v1032>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001289:[<0x10000000403/159 v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.723 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.424+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002cd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/025.out auth v1086 ap=1 s=1945 n(v0 b1945 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffe6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002cd:[<0x10000000403/025.out v100>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002cd:[<0x10000000403/025.out v1086>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.724 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.424+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001478 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/404 auth v1090 ap=1 s=3564 n(v0 b3564 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffe5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001478:[<0x10000000403/404 v1052>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001478:[<0x10000000403/404 v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.724 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.425+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/542 auth v1200 ap=1 s=2516 n(v0 b2516 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038001ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000150c:[<0x10000000403/542 v1162>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000150c:[<0x10000000403/542 v1200>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.724 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.425+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001498 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/433 auth v1082 ap=1 s=1963 n(v0 b1963 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffe5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001498:[<0x10000000403/433 v1056>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001498:[<0x10000000403/433 v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.724 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.425+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000090f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/562.out auth v1068 ap=1 s=134 n(v0 b134 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ffe6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000090f:[<0x10000000403/562.out v996>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000090f:[<0x10000000403/562.out v1068>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: pgmap v330: 97 pgs: 97 active+clean; 55 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 1.36k op/s 2023-10-18T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:05:42.726 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000816 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/199.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.726 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001453 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/370) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.726 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001201 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/043) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.726 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014c3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/473) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.727 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000130a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/286) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.727 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/033.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.727 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000309 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.nojournal) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.727 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000153f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/587) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.727 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014a5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/444) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.728 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001266 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/127) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.728 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000085f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/262.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.728 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000080a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/193.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.728 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000059a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/503.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.728 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001230 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/075) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.728 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/418.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000883 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/280.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000036e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/100.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000080e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/195.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000853 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/256.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/266) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000129c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/178) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/326.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/499) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/039.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/240) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.731 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/511) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.731 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/038.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.731 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/538.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.731 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000841 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/247.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.731 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000522 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/443.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.732 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001429 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/330) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.732 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000142d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/334) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.732 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001220 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/059) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.732 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000142f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/336) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.733 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000141f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/320) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.733 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001454 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/371) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.733 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001438 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/345) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.733 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008c1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/311.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.733 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001207 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/049) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.734 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/030.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.734 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001547 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/group) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.734 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000144e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/365) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.734 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000466 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/349.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.734 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/161.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.735 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000035a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/090.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.735 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/486) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.735 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001464 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/385) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.735 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001516 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/552) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.735 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000a31 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/581.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.736 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000307 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.cfg) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.736 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012c3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/215) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.736 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004da (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/407.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.736 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000444 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/332.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.736 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001286 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/156) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.737 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000084f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/254.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.737 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000454 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/340.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.737 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001256 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/111) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.737 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001534 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/577) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.737 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011d5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/005) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.738 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012da (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/238) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.738 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000146b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/392) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.738 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/184) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.738 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005b4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/516.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.738 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000083d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/245.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.739 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/021) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.739 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012aa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/191) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.739 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000845 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/249.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.740 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.380+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001521 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/562 auth v1154 ap=1 s=2334 n(v0 b2334 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001521:[<0x10000000403/562 v1132>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001521:[<0x10000000403/562 v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.740 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.381+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001420 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/321 auth v1166 ap=1 s=2741 n(v0 b2741 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001420:[<0x10000000403/321 v1108>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001420:[<0x10000000403/321 v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.741 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.381+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000151e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/559 auth v1158 ap=1 s=1498 n(v0 b1498 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83acab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000151e:[<0x10000000403/559 v1128>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000151e:[<0x10000000403/559 v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.741 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.381+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ef [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/259 auth v1168 ap=1 s=1907 n(v0 b1907 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83acb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ef:[<0x10000000403/259 v1096>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012ef:[<0x10000000403/259 v1168>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.741 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.382+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/186.out auth v1124 ap=1 s=619 n(v0 b619 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832fe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fc:[<0x10000000403/186.out v754>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000007fc:[<0x10000000403/186.out v1124>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.741 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.425+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000558 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/470.out auth v1168 ap=1 s=47 n(v0 b47 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038001b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000558:[<0x10000000403/470.out v958>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000558:[<0x10000000403/470.out v1168>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.742 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.426+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001469 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/390 auth v1182 ap=1 s=1700 n(v0 b1700 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038001b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001469:[<0x10000000403/390 v1150>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001469:[<0x10000000403/390 v1182>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.742 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.426+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002bb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/016.out auth v1180 ap=1 s=1216 n(v0 b1216 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038001bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002bb:[<0x10000000403/016.out v64>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002bb:[<0x10000000403/016.out v1180>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.742 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.426+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001298 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/174 auth v1190 ap=1 s=2170 n(v0 b2170 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038001cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001298:[<0x10000000403/174 v1130>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001298:[<0x10000000403/174 v1190>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.742 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.426+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/023 auth v1202 ap=1 s=736 n(v0 b736 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038001c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e8:[<0x10000000403/023 v1126>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011e8:[<0x10000000403/023 v1202>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.743 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.426+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/007 auth v1188 ap=1 s=1137 n(v0 b1137 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038001c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d7:[<0x10000000403/007 v1122>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011d7:[<0x10000000403/007 v1188>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.743 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.427+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/152.out auth v1176 ap=1 s=275 n(v0 b275 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380026000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d6:[<0x10000000403/152.out v618>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003d6:[<0x10000000403/152.out v1176>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.743 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.427+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/407 auth v1184 ap=1 s=1434 n(v0 b1434 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038001d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000147c:[<0x10000000403/407 v1154>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000147c:[<0x10000000403/407 v1184>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.743 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.428+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001448 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/359 auth v1186 ap=1 s=2011 n(v0 b2011 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380027080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001448:[<0x10000000403/359 v1142>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001448:[<0x10000000403/359 v1186>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.744 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.428+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000419 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/211.out auth v1174 ap=1 s=69 n(v0 b69 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56038001d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000419:[<0x10000000403/211.out v818>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000419:[<0x10000000403/211.out v1174>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.744 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.428+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000145c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/377 auth v1192 ap=1 s=1888 n(v0 b1888 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380027600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000145c:[<0x10000000403/377 v1146>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000145c:[<0x10000000403/377 v1192>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.744 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.358+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000681 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_utilies.m4 auth v95 ap=1 s=3880 n(v0 b3880 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ac1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000681:[<0x1000000002e/package_utilies.m4 v30>,<0x100000005e4/m4 v456>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000681:[<0x1000000002e/package_utilies.m4 v95>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.745 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.359+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000658 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/random_range.h auth v46 ap=1 s=646 n(v0 rc2023-10-18T14:05:08.537333+0000 b646 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@2},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c77080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000658:[<0x10000000028/random_range.h v26>,<0x100000005e4/include v364>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000658:[<0x10000000028/random_range.h v46>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.745 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.360+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000675 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/multilib.m4 auth v99 ap=1 s=1836 n(v0 b1836 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ac0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000675:[<0x1000000002e/multilib.m4 v6>,<0x100000005e4/m4 v456>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000675:[<0x1000000002e/multilib.m4 v99>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.745 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000413 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/208.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.745 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/415.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.746 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/510) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.746 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002c7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/022.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.746 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000143d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/350) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.746 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000126e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/135) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.747 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/159.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.747 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/155.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.747 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000046a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/351.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.747 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003da (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/154.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.747 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/041) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.748 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012dd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/241) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.748 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008fb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/552.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.748 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001219 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/052) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.748 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000088d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/285.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.748 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000125c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/117) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.748 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001468 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/389) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.749 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001510 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/546) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.749 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/156.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.749 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/172.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.749 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001545 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/592) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.749 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001304 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/280) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.750 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/550.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.750 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/421.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.750 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000125b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/116) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.750 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000370 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/101.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.750 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000153c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/584) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.751 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001473 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/399) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.751 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/245) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.751 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000151f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/560) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.751 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/195) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.751 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001271 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/138) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.752 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003c4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/143.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.752 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000821 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/231.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.752 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000804 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/190.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.752 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000044a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/335.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.752 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001530 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/574.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.753 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/176.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.753 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000045c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/344.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.753 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000121f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/058) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.753 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001259 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/114) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.753 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001457 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/373.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.754 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002cf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/026.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.754 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001515 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/551) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.754 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001285 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/155) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.754 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/036.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:42.755 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.382+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/027.out auth v1142 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832f9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002d1:[<0x10000000403/027.out v108>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002d1:[<0x10000000403/027.out v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.756 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.382+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000582 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/491.out auth v1134 ap=1 s=32 n(v0 b32 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832fe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000582:[<0x10000000403/491.out v968>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000582:[<0x10000000403/491.out v1134>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.756 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.382+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/322.out auth v1122 ap=1 s=261 n(v0 b261 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832feb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d7:[<0x10000000403/322.out v868>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008d7:[<0x10000000403/322.out v1122>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.756 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.360+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001326 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/Makefile auth v101 ap=1 s=598 n(v0 rc2023-10-18T14:05:22.831040+0000 b598 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@2},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ac2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001326:[<0x1000000002e/Makefile v44>,<0x100000005e4/m4 v1235>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001326:[<0x1000000002e/Makefile v101>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.757 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.360+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001325 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/builddefs.in auth v74 ap=1 s=2330 n(v0 rc2023-10-18T14:05:22.814040+0000 b2330 1=1+0) (iversion lock) caps={25030=pAsLsXsFscr/-@3},l=25030(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c77b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001325:[<0x10000000028/builddefs.in v40>,<0x100000005e4/include v1191>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001325:[<0x10000000028/builddefs.in v74>,<0x100000005e4/include v3629>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.758 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.382+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001407 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/296 auth v1136 ap=1 s=1924 n(v0 b1924 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832ff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001407:[<0x10000000403/296 v1102>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001407:[<0x10000000403/296 v1136>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.759 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.383+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012cc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/224 auth v1152 ap=1 s=1845 n(v0 b1845 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83acb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012cc:[<0x10000000403/224 v1092>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012cc:[<0x10000000403/224 v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.759 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.383+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000316 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/056.out auth v1116 ap=1 s=291 n(v0 b291 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83300100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000316:[<0x10000000403/056.out v234>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000316:[<0x10000000403/056.out v1116>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.759 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.383+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/217 auth v1126 ap=1 s=2573 n(v0 rc2023-10-18T14:05:24.580004+0000 b2573 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83300c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012c5:[<0x10000000403/217 v1098>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012c5:[<0x10000000403/217 v1126>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.759 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.383+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001496 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/431 auth v1146 ap=1 s=1892 n(v0 b1892 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832ffb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001496:[<0x10000000403/431 v1106>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001496:[<0x10000000403/431 v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.760 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.361+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000678 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_gdbmdev.m4 auth v97 ap=1 s=1572 n(v0 b1572 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ac2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000678:[<0x1000000002e/package_gdbmdev.m4 v12>,<0x100000005e4/m4 v456>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000678:[<0x1000000002e/package_gdbmdev.m4 v97>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.760 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.361+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000677 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_aiodev.m4 auth v85 ap=1 s=130 n(v0 b130 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ac2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000677:[<0x1000000002e/package_aiodev.m4 v10>,<0x100000005e4/m4 v456>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000677:[<0x1000000002e/package_aiodev.m4 v85>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.760 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.361+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001176 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_libcdev.m4 auth v103 ap=1 s=2530 n(v0 b2530 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ac3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001176:[<0x1000000002e/package_libcdev.m4 v52>,<0x100000005e4/m4 v1235>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001176:[<0x1000000002e/package_libcdev.m4 v103>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.762 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.384+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/494 auth v1130 ap=1 s=1044 n(v0 b1044 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832ff080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d9:[<0x10000000403/494 v1114>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014d9:[<0x10000000403/494 v1130>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.762 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.384+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/167.out auth v1118 ap=1 s=102 n(v0 b102 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8398a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f4:[<0x10000000403/167.out v678>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003f4:[<0x10000000403/167.out v1118>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.762 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.384+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001283 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/153 auth v1132 ap=1 s=2514 n(v0 b2514 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83301180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001283:[<0x10000000403/153 v1090>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001283:[<0x10000000403/153 v1132>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.763 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.385+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000324 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/063.out auth v1148 ap=1 s=1889 n(v0 b1889 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83300680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000324:[<0x10000000403/063.out v262>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000324:[<0x10000000403/063.out v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.763 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.385+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011fc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/038 auth v1138 ap=1 s=4714 n(v0 b4714 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83301700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011fc:[<0x10000000403/038 v1086>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011fc:[<0x10000000403/038 v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.763 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.385+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000407 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/202.out auth v1120 ap=1 s=486 n(v0 b486 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8398a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000407:[<0x10000000403/202.out v812>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000407:[<0x10000000403/202.out v1120>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.764 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.362+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001178 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_xfslibs.m4 auth v105 ap=1 s=3621 n(v0 b3621 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ac3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001178:[<0x1000000002e/package_xfslibs.m4 v60>,<0x100000005e4/m4 v1235>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001178:[<0x1000000002e/package_xfslibs.m4 v105>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.764 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.362+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_pthread.m4 auth v79 ap=1 s=469 n(v0 b469 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ace000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000067f:[<0x1000000002e/package_pthread.m4 v26>,<0x100000005e4/m4 v456>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000067f:[<0x1000000002e/package_pthread.m4 v79>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.766 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.385+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/464 auth v1140 ap=1 s=2522 n(v0 rc2023-10-18T14:05:25.179991+0000 b2522 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8398ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b9:[<0x10000000403/464 v1110>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014b9:[<0x10000000403/464 v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.766 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.385+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ba [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/206 auth v1128 ap=1 s=2512 n(v0 b2512 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8398b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ba:[<0x10000000403/206 v1094>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012ba:[<0x10000000403/206 v1128>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.766 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.385+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000093e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/588.out auth v1144 ap=1 s=545 n(v0 b545 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8398b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000093e:[<0x10000000403/588.out v1016>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000093e:[<0x10000000403/588.out v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.766 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.386+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000126b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/132 auth v1156 ap=1 s=6190 n(v0 b6190 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8364f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000126b:[<0x10000000403/132 v1092>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000126b:[<0x10000000403/132 v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.767 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.386+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/236 auth v1160 ap=1 s=1086 n(v0 rc2023-10-18T14:05:24.628003+0000 b1086 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8364fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d8:[<0x10000000403/236 v1100>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012d8:[<0x10000000403/236 v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.767 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.362+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000684 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/visibility_hidden.m4 auth v81 ap=1 s=768 n(v0 b768 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ace580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000684:[<0x1000000002e/visibility_hidden.m4 v36>,<0x100000005e4/m4 v456>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000684:[<0x1000000002e/visibility_hidden.m4 v81>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.768 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.363+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000680 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_types.m4 auth v87 ap=1 s=1378 n(v0 b1378 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01aceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000680:[<0x1000000002e/package_types.m4 v28>,<0x100000005e4/m4 v456>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000680:[<0x1000000002e/package_types.m4 v87>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.768 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.363+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001177 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_ncurses.m4 auth v113 ap=1 s=952 n(v0 b952 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01acf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001177:[<0x1000000002e/package_ncurses.m4 v56>,<0x100000005e4/m4 v1235>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001177:[<0x1000000002e/package_ncurses.m4 v113>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.769 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.386+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/020.out auth v1142 ap=1 s=2331 n(v0 b2331 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83651180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e5:[<0x10000000403/020.out v1084>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011e5:[<0x10000000403/020.out v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.770 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.386+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012bf [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/211 auth v1162 ap=1 s=656 n(v0 b656 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83650680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012bf:[<0x10000000403/211 v1096>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012bf:[<0x10000000403/211 v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.770 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.387+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000508 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/430.out auth v1140 ap=1 s=1076 n(v0 b1076 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83650c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000508:[<0x10000000403/430.out v924>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000508:[<0x10000000403/430.out v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.770 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.387+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000330 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/069.out auth v1138 ap=1 s=268 n(v0 b268 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83650100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000330:[<0x10000000403/069.out v286>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000330:[<0x10000000403/069.out v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.770 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.387+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/420.out auth v1126 ap=1 s=141 n(v0 b141 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a5e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f4:[<0x10000000403/420.out v912>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004f4:[<0x10000000403/420.out v1126>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.771 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.364+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000682 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_uuiddev.m4 auth v89 ap=1 s=760 n(v0 b760 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01acf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000682:[<0x1000000002e/package_uuiddev.m4 v32>,<0x100000005e4/m4 v456>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000682:[<0x1000000002e/package_uuiddev.m4 v89>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.771 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.364+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000674 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/manual_format.m4 auth v91 ap=1 s=489 n(v0 b489 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01acfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000674:[<0x1000000002e/manual_format.m4 v4>,<0x100000005e4/m4 v456>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000674:[<0x1000000002e/manual_format.m4 v91>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.771 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.364+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001174 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_attrdev.m4 auth v119 ap=1 s=1980 n(v0 b1980 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ad0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001174:[<0x1000000002e/package_attrdev.m4 v46>,<0x100000005e4/m4 v1235>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001174:[<0x1000000002e/package_attrdev.m4 v119>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.772 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.387+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000450 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/338.out auth v1128 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a5e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000450:[<0x10000000403/338.out v870>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000450:[<0x10000000403/338.out v1128>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.773 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.388+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000088f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/286.out auth v1130 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a5eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000088f:[<0x10000000403/286.out v844>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000088f:[<0x10000000403/286.out v1130>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.773 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.388+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001524 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/565 auth v1158 ap=1 s=1442 n(v0 b1442 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83651700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001524:[<0x10000000403/565 v1116>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001524:[<0x10000000403/565 v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.774 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.364+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000679 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_globals.m4 auth v77 ap=1 s=1292 n(v0 b1292 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@3},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ad0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000679:[<0x1000000002e/package_globals.m4 v14>,<0x100000005e4/m4 v456>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000679:[<0x1000000002e/package_globals.m4 v77>,<0x100000005e4/m4 v1917>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.774 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.366+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/description auth v258 ap=1 s=73 n(v0 rc2023-10-18T14:05:06.463375+0000 b73 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a26680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005e7:[<0x100000005e5/description v4>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005e7:[<0x100000005e5/description v258>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.775 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.388+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000145f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/380 auth v1148 ap=1 s=1479 n(v0 b1479 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a5f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000145f:[<0x10000000403/380 v1104>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000145f:[<0x10000000403/380 v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.776 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.389+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/395 auth v1150 ap=1 s=4134 n(v0 b4134 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a60c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000146e:[<0x10000000403/395 v1108>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000146e:[<0x10000000403/395 v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.776 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.389+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000091f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/570.out auth v1132 ap=1 s=231 n(v0 b231 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a60680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000091f:[<0x10000000403/570.out v1002>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000091f:[<0x10000000403/570.out v1132>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.776 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.389+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/519 auth v1154 ap=1 s=2363 n(v0 b2363 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a61180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f4:[<0x10000000403/519 v1112>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014f4:[<0x10000000403/519 v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.776 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.390+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001247 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/096 auth v1152 ap=1 s=1146 n(v0 b1146 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a60100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001247:[<0x10000000403/096 v1088>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001247:[<0x10000000403/096 v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.777 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.366+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/ auth{2=1,3=1,4=1} v203 ap=1 f(v0 m2023-10-18T14:05:06.527374+0000 2=0+2) n(v1 rc2023-10-18T14:05:08.471334+0000 b12877962 5=2+3) (inest mix) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fd016fd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000006:[<0x100000005e5/objects v134>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x10000000006:[<0x100000005e5/objects v203>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:06.527374+0000 2=0+2)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:08.471334+0000 b12877962 5=2+3)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:06.527374+0000 2=0+2)","memory_value.rstat":"n(v1 rc2023-10-18T14:05:08.471334+0000 b12877962 5=2+3)","error_str":""},"return_code":0} 2023-10-18T14:05:42.778 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.367+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007de [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/ auth v270 ap=1 f(v0 m2023-10-18T14:05:06.468375+0000 13=13+0) n(v0 rc2023-10-18T14:05:06.468375+0000 b23442 14=13+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a27180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000007de:[<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x100000007de:[<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:06.468375+0000 13=13+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:06.468375+0000 b23442 14=13+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:06.468375+0000 13=13+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:06.468375+0000 b23442 14=13+1)","error_str":""},"return_code":0} 2023-10-18T14:05:42.779 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.390+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/175.out auth v1136 ap=1 s=102 n(v0 b102 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a5fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e6:[<0x10000000403/175.out v710>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000007e6:[<0x10000000403/175.out v1136>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.780 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.390+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000054c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/464.out auth v1134 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aa2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000054c:[<0x10000000403/464.out v944>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000054c:[<0x10000000403/464.out v1134>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.780 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.390+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ec [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/178.out auth v1136 ap=1 s=315 n(v0 b315 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8326c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ec:[<0x10000000403/178.out v722>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000007ec:[<0x10000000403/178.out v1136>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.780 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.391+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001540 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/588 auth v1146 ap=1 s=2217 n(v0 b2217 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a5f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001540:[<0x10000000403/588 v1124>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001540:[<0x10000000403/588 v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.780 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.392+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001525 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/566 auth v1144 ap=1 s=1378 n(v0 b1378 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a61700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001525:[<0x10000000403/566 v1120>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001525:[<0x10000000403/566 v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.781 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.429+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/389.out auth v1178 ap=1 s=214 n(v0 b214 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380027b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b6:[<0x10000000403/389.out v914>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004b6:[<0x10000000403/389.out v1178>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.781 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.429+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000500 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/426.out auth v1172 ap=1 s=174 n(v0 b174 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380028100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000500:[<0x10000000403/426.out v934>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000500:[<0x10000000403/426.out v1172>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.781 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.429+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/252.out auth v1166 ap=1 s=291 n(v0 b291 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380028680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000084b:[<0x10000000403/252.out v842>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000084b:[<0x10000000403/252.out v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.782 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.430+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014dd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/497 auth v1194 ap=1 s=2062 n(v0 b2062 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380029180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014dd:[<0x10000000403/497 v1158>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014dd:[<0x10000000403/497 v1194>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.782 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.430+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000827 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/234.out auth v1170 ap=1 s=81 n(v0 b81 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380026580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000827:[<0x10000000403/234.out v832>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000827:[<0x10000000403/234.out v1170>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.782 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.430+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000140a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/299 auth v1198 ap=1 s=2969 n(v0 b2969 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380028c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000140a:[<0x10000000403/299 v1138>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000140a:[<0x10000000403/299 v1198>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.782 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.430+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/128.out auth v1164 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380026b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a6:[<0x10000000403/128.out v522>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003a6:[<0x10000000403/128.out v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.782 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.431+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/262 auth v1196 ap=1 s=2052 n(v0 b2052 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560380029700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f2:[<0x10000000403/262 v1134>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012f2:[<0x10000000403/262 v1196>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.783 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.431+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/517.out auth v1192 ap=1 s=1591 n(v0 b1591 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff84000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005b6:[<0x10000000403/517.out v984>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005b6:[<0x10000000403/517.out v1192>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.783 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.431+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000865 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/265.out auth v1166 ap=1 s=312 n(v0 b312 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff74c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000865:[<0x10000000403/265.out v854>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000865:[<0x10000000403/265.out v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.783 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.432+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/012.out auth v1174 ap=1 s=1216 n(v0 b1216 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff75180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b3:[<0x10000000403/012.out v48>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002b3:[<0x10000000403/012.out v1174>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.783 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.432+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000126c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/133 auth v1182 ap=1 s=1695 n(v0 b1695 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff84580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000126c:[<0x10000000403/133 v1122>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000126c:[<0x10000000403/133 v1182>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.784 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.432+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/003.out auth v1200 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff75700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a1:[<0x10000000403/003.out v12>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002a1:[<0x10000000403/003.out v1200>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.784 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.432+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/475 auth v1184 ap=1 s=2239 n(v0 b2239 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff85080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c5:[<0x10000000403/475 v1150>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014c5:[<0x10000000403/475 v1184>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.784 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.432+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001422 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/323 auth v1206 ap=1 s=1053 n(v0 b1053 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff85600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001422:[<0x10000000403/323 v1138>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001422:[<0x10000000403/323 v1206>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.784 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.433+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000538 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/454.out auth v1204 ap=1 s=123 n(v0 b123 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff85b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000538:[<0x10000000403/454.out v948>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000538:[<0x10000000403/454.out v1204>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.784 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.433+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/314.out auth v1180 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff86680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c7:[<0x10000000403/314.out v880>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008c7:[<0x10000000403/314.out v1180>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.785 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.434+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/455 auth v1190 ap=1 s=2722 n(v0 b2722 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff86c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b0:[<0x10000000403/455 v1146>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014b0:[<0x10000000403/455 v1190>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.785 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.434+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000566 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/477.out auth v1168 ap=1 s=185 n(v0 b185 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff86100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000566:[<0x10000000403/477.out v966>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000566:[<0x10000000403/477.out v1168>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.785 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.434+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/542.out auth v1158 ap=1 s=622 n(v0 b622 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff84b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008e7:[<0x10000000403/542.out v1006>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008e7:[<0x10000000403/542.out v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.785 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.434+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ff [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/554.out auth v1156 ap=1 s=79 n(v0 b79 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff87180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ff:[<0x10000000403/554.out v1012>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008ff:[<0x10000000403/554.out v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.786 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.434+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/157.out auth v1152 ap=1 s=725 n(v0 b725 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff87700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e0:[<0x10000000403/157.out v638>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003e0:[<0x10000000403/157.out v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.786 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.435+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/541.out auth v1188 ap=1 s=752 n(v0 b752 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff92000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008e5:[<0x10000000403/541.out v1002>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008e5:[<0x10000000403/541.out v1188>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.786 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.435+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/126.out auth v1162 ap=1 s=1066 n(v0 b1066 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff93600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a2:[<0x10000000403/126.out v514>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003a2:[<0x10000000403/126.out v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.786 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.438+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/439.out auth v1178 ap=1 s=1145 n(v0 b1145 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff92580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000051a:[<0x10000000403/439.out v938>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000051a:[<0x10000000403/439.out v1178>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.786 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.438+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000053e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/457.out auth v1198 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff92b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000053e:[<0x10000000403/457.out v952>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000053e:[<0x10000000403/457.out v1198>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.787 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.438+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ca [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/399.out auth v1202 ap=1 s=76 n(v0 b76 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff93080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ca:[<0x10000000403/399.out v920>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004ca:[<0x10000000403/399.out v1202>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.787 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.438+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014aa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/449 auth v1196 ap=1 s=2089 n(v0 b2089 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff93b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014aa:[<0x10000000403/449 v1142>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014aa:[<0x10000000403/449 v1196>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.787 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.438+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000122c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/071 auth v1208 ap=1 s=1604 n(v0 b1604 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff94100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000122c:[<0x10000000403/071 v1118>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000122c:[<0x10000000403/071 v1208>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.787 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.439+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/181.out auth v1160 ap=1 s=257 n(v0 b257 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff94c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f2:[<0x10000000403/181.out v734>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000007f2:[<0x10000000403/181.out v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.788 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.439+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000855 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/257.out auth v1176 ap=1 s=34 n(v0 b34 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff94680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000855:[<0x10000000403/257.out v846>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000855:[<0x10000000403/257.out v1176>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.788 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.439+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000594 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/500.out auth v1164 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff95180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000594:[<0x10000000403/500.out v976>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000594:[<0x10000000403/500.out v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.788 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.439+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/291 auth v1172 ap=1 s=1970 n(v0 b1970 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff95700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130f:[<0x10000000403/291 v1134>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000130f:[<0x10000000403/291 v1172>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.788 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.439+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000326 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/064.out auth v1154 ap=1 s=64 n(v0 b64 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff9e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000326:[<0x10000000403/064.out v266>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000326:[<0x10000000403/064.out v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.788 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.440+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ce [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/226 auth v1170 ap=1 s=1291 n(v0 b1291 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff9e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ce:[<0x10000000403/226 v1130>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012ce:[<0x10000000403/226 v1170>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.789 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.440+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001297 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/173 auth v1186 ap=1 s=2147 n(v0 b2147 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff9eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001297:[<0x10000000403/173 v1126>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001297:[<0x10000000403/173 v1186>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.789 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.440+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000091b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/568.out auth v1194 ap=1 s=148 n(v0 b148 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff9f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000091b:[<0x10000000403/568.out v1016>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000091b:[<0x10000000403/568.out v1194>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.789 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.440+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e69 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/390.out auth v1228 ap=1 s=137 n(v0 b137 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fea6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e69:[<0x10000000d33/390.out v1022>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e69:[<0x10000000d33/390.out v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.789 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.441+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e9f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/417.out auth v1222 ap=1 s=107 n(v0 b107 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fea7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e9f:[<0x10000000d33/417.out v1034>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e9f:[<0x10000000d33/417.out v1222>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.789 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.441+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016fa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/004 auth v1248 ap=1 s=2750 n(v0 rc2023-10-18T14:05:25.726980+0000 b2750 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fea6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016fa:[<0x10000000d33/004 v1178>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016fa:[<0x10000000d33/004 v1248>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.790 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.441+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000159f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.op auth v1226 ap=1 s=218785 n(v0 b218785 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe9b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000159f:[<0x10000000d33/018.op v1180>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000159f:[<0x10000000d33/018.op v1226>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.790 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.441+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/459.out auth v1214 ap=1 s=75 n(v0 b75 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fea7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ef3:[<0x10000000d33/459.out v1050>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ef3:[<0x10000000d33/459.out v1214>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.790 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.442+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/442.out auth v1218 ap=1 s=141 n(v0 b141 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fea8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ed1:[<0x10000000d33/442.out v1044>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ed1:[<0x10000000d33/442.out v1218>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.790 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.442+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/316.out auth v1216 ap=1 s=499 n(v0 b499 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037feb4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd4:[<0x10000000d33/316.out v988>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dd4:[<0x10000000d33/316.out v1216>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.791 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.442+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dde [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/321.out auth v1220 ap=1 s=525 n(v0 b525 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037feb4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dde:[<0x10000000d33/321.out v990>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dde:[<0x10000000d33/321.out v1220>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.791 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.443+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e08 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/342.out auth v1224 ap=1 s=139 n(v0 b139 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fea9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e08:[<0x10000000d33/342.out v1002>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e08:[<0x10000000d33/342.out v1224>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.791 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.443+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d86 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/277.out auth v1240 ap=1 s=106 n(v0 b106 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037feb5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d86:[<0x10000000d33/277.out v970>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d86:[<0x10000000d33/277.out v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.791 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.443+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000edd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/448.out auth v1242 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fed0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000edd:[<0x10000000d33/448.out v1070>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000edd:[<0x10000000d33/448.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.791 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.444+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f46 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/501.out auth v1258 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fed2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f46:[<0x10000000d33/501.out v1104>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f46:[<0x10000000d33/501.out v1258>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.792 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.444+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/118.out auth v1252 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fed1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3c:[<0x10000000d33/118.out v480>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c3c:[<0x10000000d33/118.out v1252>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.792 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.444+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d12 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/224.out auth v1248 ap=1 s=516 n(v0 b516 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fed2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d12:[<0x10000000d33/224.out v908>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d12:[<0x10000000d33/224.out v1248>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.792 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.445+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/292.out auth v1286 ap=1 s=162 n(v0 b162 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd9b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da4:[<0x10000000d33/292.out v976>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000da4:[<0x10000000d33/292.out v1286>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.792 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.446+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000edf [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/449.out auth v1262 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd9d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000edf:[<0x10000000d33/449.out v1072>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000edf:[<0x10000000d33/449.out v1262>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.793 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.446+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d88 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/278.out auth v1260 ap=1 s=48 n(v0 b48 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdaa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d88:[<0x10000000d33/278.out v966>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d88:[<0x10000000d33/278.out v1260>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.793 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.447+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f4c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/504.out auth v1270 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdaa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f4c:[<0x10000000d33/504.out v1106>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f4c:[<0x10000000d33/504.out v1270>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.793 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.447+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ead [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/424.out auth v1284 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdab600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ead:[<0x10000000d33/424.out v1054>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ead:[<0x10000000d33/424.out v1284>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.793 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.448+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cec [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/206.out auth v1246 ap=1 s=1653 n(v0 b1653 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdf2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cec:[<0x10000000d33/206.out v832>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cec:[<0x10000000d33/206.out v1246>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.793 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.449+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f03 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/467.out auth v1256 ap=1 s=104 n(v0 b104 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdf2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f03:[<0x10000000d33/467.out v1078>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f03:[<0x10000000d33/467.out v1256>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.794 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.450+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ebb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/431.out auth v1268 ap=1 s=124 n(v0 b124 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdf3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ebb:[<0x10000000d33/431.out v1058>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ebb:[<0x10000000d33/431.out v1268>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.794 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.450+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e2d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/360.out auth v1244 ap=1 s=89 n(v0 b89 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdf4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e2d:[<0x10000000d33/360.out v1014>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e2d:[<0x10000000d33/360.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.794 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.451+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000df2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/331.out auth v1250 ap=1 s=80 n(v0 b80 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe02000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000df2:[<0x10000000d33/331.out v992>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000df2:[<0x10000000d33/331.out v1250>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.794 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.452+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e9d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/416.out auth v1266 ap=1 s=107 n(v0 b107 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdf4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e9d:[<0x10000000d33/416.out v1042>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e9d:[<0x10000000d33/416.out v1266>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.795 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.452+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016fc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/006 auth v1252 ap=1 s=2256 n(v0 rc2023-10-18T14:05:25.733980+0000 b2256 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdf2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016fc:[<0x10000000d33/006 v1214>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016fc:[<0x10000000d33/006 v1252>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.795 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.453+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/480.out auth v1270 ap=1 s=128 n(v0 b128 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe02b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f1d:[<0x10000000d33/480.out v1084>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f1d:[<0x10000000d33/480.out v1270>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.795 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.454+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c16 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/102.out auth v1256 ap=1 s=222 n(v0 b222 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe0a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c16:[<0x10000000d33/102.out v416>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c16:[<0x10000000d33/102.out v1256>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.795 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.455+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d3e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/241.out auth v1228 ap=1 s=373 n(v0 b373 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdd1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d3e:[<0x10000000d33/241.out v960>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d3e:[<0x10000000d33/241.out v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.795 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.456+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d7e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/273.out auth v1222 ap=1 s=56 n(v0 b56 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdd0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d7e:[<0x10000000d33/273.out v978>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d7e:[<0x10000000d33/273.out v1222>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.796 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.457+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ba6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/047.out auth v1224 ap=1 s=9027 n(v0 b9027 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fde0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ba6:[<0x10000000d33/047.out v192>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ba6:[<0x10000000d33/047.out v1224>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.796 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.457+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c09 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/096.out.external auth v1226 ap=1 s=2158 n(v0 b2158 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fddf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c09:[<0x10000000d33/096.out.external v390>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c09:[<0x10000000d33/096.out.external v1226>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.796 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.457+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eff [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/465.out auth v1248 ap=1 s=103 n(v0 b103 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fddfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eff:[<0x10000000d33/465.out v1068>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000eff:[<0x10000000d33/465.out v1248>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.796 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.457+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/453.out auth v1246 ap=1 s=85 n(v0 b85 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fde0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ee7:[<0x10000000d33/453.out v1060>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ee7:[<0x10000000d33/453.out v1246>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.797 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.458+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bbc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/058.out auth v1238 ap=1 s=770 n(v0 b770 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fde0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bbc:[<0x10000000d33/058.out v236>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bbc:[<0x10000000d33/058.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.797 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.458+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f3e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/497.out auth v1254 ap=1 s=158 n(v0 b158 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fde1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f3e:[<0x10000000d33/497.out v1082>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f3e:[<0x10000000d33/497.out v1254>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.797 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.458+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000baa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/049.out auth v1266 ap=1 s=367 n(v0 b367 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe8e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000baa:[<0x10000000d33/049.out v200>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000baa:[<0x10000000d33/049.out v1266>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.797 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.459+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f21 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/482.out auth v1280 ap=1 s=97 n(v0 b97 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe90100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f21:[<0x10000000d33/482.out v1064>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f21:[<0x10000000d33/482.out v1280>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.797 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.459+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/473.out auth v1260 ap=1 s=137 n(v0 b137 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe8f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f0f:[<0x10000000d33/473.out v1062>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f0f:[<0x10000000d33/473.out v1260>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.798 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.459+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d84 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/276.out auth v1258 ap=1 s=134 n(v0 b134 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe91180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d84:[<0x10000000d33/276.out v972>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d84:[<0x10000000d33/276.out v1258>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.798 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.460+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bf3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/085.out auth v1286 ap=1 s=210 n(v0 b210 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe91700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bf3:[<0x10000000d33/085.out v346>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bf3:[<0x10000000d33/085.out v1286>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.798 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.460+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bb4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/054.out auth v1256 ap=1 s=87 n(v0 b87 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe99080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bb4:[<0x10000000d33/054.out v220>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bb4:[<0x10000000d33/054.out v1256>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.798 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.461+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c5a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/133.out auth v1264 ap=1 s=112 n(v0 rc2023-10-18T14:05:15.064199+0000 b112 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe99600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c5a:[<0x10000000d33/133.out v540>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c5a:[<0x10000000d33/133.out v1264>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.799 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.461+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e12 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/347.out auth v1276 ap=1 s=315 n(v0 b315 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe99b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e12:[<0x10000000d33/347.out v1010>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e12:[<0x10000000d33/347.out v1276>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.799 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.462+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e37 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/365.out auth v1258 ap=1 s=75 n(v0 b75 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdb6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e37:[<0x10000000d33/365.out v1018>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e37:[<0x10000000d33/365.out v1258>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.799 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.462+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/437.out auth v1262 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdb6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ec7:[<0x10000000d33/437.out v1052>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ec7:[<0x10000000d33/437.out v1262>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.799 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.463+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c98 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/164.out auth v1252 ap=1 s=741 n(v0 b741 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdb7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c98:[<0x10000000d33/164.out v664>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c98:[<0x10000000d33/164.out v1252>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.799 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.463+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f2c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/488.out auth v1246 ap=1 s=83 n(v0 b83 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdb8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f2c:[<0x10000000d33/488.out v1068>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f2c:[<0x10000000d33/488.out v1246>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.800 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.463+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c40 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/120.out auth v1238 ap=1 s=216 n(v0 b216 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdb9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c40:[<0x10000000d33/120.out v488>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c40:[<0x10000000d33/120.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.800 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.464+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e0e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/345.out auth v1244 ap=1 s=315 n(v0 b315 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e0e:[<0x10000000d33/345.out v1008>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e0e:[<0x10000000d33/345.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.800 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.464+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bcc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/066.out auth v1260 ap=1 s=1572 n(v0 b1572 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdce580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bcc:[<0x10000000d33/066.out v268>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bcc:[<0x10000000d33/066.out v1260>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.800 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.465+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e97 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/413.out auth v1242 ap=1 s=104 n(v0 b104 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fdcf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e97:[<0x10000000d33/413.out v1042>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e97:[<0x10000000d33/413.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.800 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.465+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d0a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/220.out auth v1250 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fcf5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d0a:[<0x10000000d33/220.out v892>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d0a:[<0x10000000d33/220.out v1250>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.801 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.465+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f3c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/496.out auth v1234 ap=1 s=158 n(v0 b158 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fcf6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f3c:[<0x10000000d33/496.out v1088>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f3c:[<0x10000000d33/496.out v1234>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.801 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.465+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c62 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/137.out auth v1256 ap=1 s=72 n(v0 b72 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fcf5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c62:[<0x10000000d33/137.out v556>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c62:[<0x10000000d33/137.out v1256>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.801 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.466+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001704 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/013 auth v1258 ap=1 s=3451 n(v0 rc2023-10-18T14:05:25.763979+0000 b3451 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fcf6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001704:[<0x10000000d33/013 v1204>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001704:[<0x10000000d33/013 v1258>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.801 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.466+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e29 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/358.out auth v1232 ap=1 s=85 n(v0 b85 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fcf6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e29:[<0x10000000d33/358.out v1022>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e29:[<0x10000000d33/358.out v1232>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.802 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.466+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/462.out auth v1236 ap=1 s=87 n(v0 b87 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fcf7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ef9:[<0x10000000d33/462.out v1070>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ef9:[<0x10000000d33/462.out v1236>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.802 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.466+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/438.out auth v1238 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd0e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ec9:[<0x10000000d33/438.out v1056>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ec9:[<0x10000000d33/438.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.802 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.467+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c52 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/129.out auth v1230 ap=1 s=139 n(v0 b139 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fcf7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c52:[<0x10000000d33/129.out v524>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c52:[<0x10000000d33/129.out v1230>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.802 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.467+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c5e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/135.out auth v1226 ap=1 s=307 n(v0 b307 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd0f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c5e:[<0x10000000d33/135.out v548>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c5e:[<0x10000000d33/135.out v1226>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.802 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.467+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/458.out auth v1242 ap=1 s=89 n(v0 b89 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd10100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ef1:[<0x10000000d33/458.out v1066>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ef1:[<0x10000000d33/458.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.803 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.468+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bc0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/060.out auth v1240 ap=1 s=6458 n(v0 b6458 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd10680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bc0:[<0x10000000d33/060.out v244>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bc0:[<0x10000000d33/060.out v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.803 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.469+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dba [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/303.out auth v1228 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd10c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dba:[<0x10000000d33/303.out v992>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dba:[<0x10000000d33/303.out v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.803 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.469+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b5e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/012.out auth v1254 ap=1 s=447 n(v0 b447 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd48c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b5e:[<0x10000000d33/012.out v48>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b5e:[<0x10000000d33/012.out v1254>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.803 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.470+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d6e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/265.out auth v1256 ap=1 s=237 n(v0 b237 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd48680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d6e:[<0x10000000d33/265.out v976>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d6e:[<0x10000000d33/265.out v1256>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.803 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.470+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b4c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/003.out auth v1248 ap=1 s=211 n(v0 b211 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd49180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b4c:[<0x10000000d33/003.out v12>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b4c:[<0x10000000d33/003.out v1248>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.804 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.471+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/454.out auth v1270 ap=1 s=71 n(v0 b71 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd5cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ee9:[<0x10000000d33/454.out v1070>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ee9:[<0x10000000d33/454.out v1270>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.804 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.471+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f17 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/477.out auth v1264 ap=1 s=143 n(v0 b143 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd5d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f17:[<0x10000000d33/477.out v1088>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f17:[<0x10000000d33/477.out v1264>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.804 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.471+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/314.out auth v1276 ap=1 s=597 n(v0 b597 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd5d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd0:[<0x10000000d33/314.out v1002>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dd0:[<0x10000000d33/314.out v1276>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.804 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.472+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c4c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/126.out auth v1250 ap=1 s=230 n(v0 b230 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd5f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c4c:[<0x10000000d33/126.out v512>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c4c:[<0x10000000d33/126.out v1250>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.805 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.472+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eef [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/457.out auth v1268 ap=1 s=85 n(v0 b85 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd5ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eef:[<0x10000000d33/457.out v1074>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000eef:[<0x10000000d33/457.out v1268>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.805 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.472+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e7b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/399.out auth v1266 ap=1 s=143 n(v0 b143 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd5f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e7b:[<0x10000000d33/399.out v1042>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e7b:[<0x10000000d33/399.out v1266>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.805 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.473+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d5e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/257.out auth v1284 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd6cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d5e:[<0x10000000d33/257.out v968>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d5e:[<0x10000000d33/257.out v1284>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.805 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.473+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cba [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/181.out auth v1290 ap=1 s=306 n(v0 b306 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd6d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cba:[<0x10000000d33/181.out v732>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cba:[<0x10000000d33/181.out v1290>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.805 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.474+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bc8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/064.out auth v1252 ap=1 s=36194 n(v0 b36194 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd6e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bc8:[<0x10000000d33/064.out v260>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bc8:[<0x10000000d33/064.out v1252>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.806 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.474+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f52 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/507.out auth v1252 ap=1 s=163 n(v0 b163 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe69180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f52:[<0x10000000d33/507.out v1102>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f52:[<0x10000000d33/507.out v1252>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.806 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.476+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c4a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/125.out auth v1242 ap=1 s=230 n(v0 b230 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe7ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c4a:[<0x10000000d33/125.out v508>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c4a:[<0x10000000d33/125.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.806 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.478+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ca2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/169.out auth v1248 ap=1 s=186 n(v0 b186 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe7d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ca2:[<0x10000000d33/169.out v684>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ca2:[<0x10000000d33/169.out v1248>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.806 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.479+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ecb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/439.out auth v1294 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd5e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ecb:[<0x10000000d33/439.out v1060>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ecb:[<0x10000000d33/439.out v1294>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.806 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.479+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f44 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/500.out auth v1282 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd6d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f44:[<0x10000000d33/500.out v1098>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f44:[<0x10000000d33/500.out v1282>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.807 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.480+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f15 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/476.out auth v1246 ap=1 s=149 n(v0 b149 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fcde000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f15:[<0x10000000d33/476.out v1076>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f15:[<0x10000000d33/476.out v1246>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.807 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.480+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/179.out auth v1254 ap=1 s=208 n(v0 b208 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fcdf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb6:[<0x10000000d33/179.out v724>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cb6:[<0x10000000d33/179.out v1254>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.807 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.480+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/323.out auth v1244 ap=1 s=409 n(v0 b409 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fcdf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de2:[<0x10000000d33/323.out v1004>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000de2:[<0x10000000d33/323.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.807 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.481+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/435.out auth v1260 ap=1 s=108 n(v0 b108 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fce1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ec3:[<0x10000000d33/435.out v1056>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ec3:[<0x10000000d33/435.out v1260>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.808 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.482+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d24 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/233.out auth v1252 ap=1 s=95 n(v0 b95 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fcf4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d24:[<0x10000000d33/233.out v944>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d24:[<0x10000000d33/233.out v1252>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.808 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.482+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/291.out auth v1238 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd6f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da2:[<0x10000000d33/291.out v990>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000da2:[<0x10000000d33/291.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.808 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.482+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e3b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/367.out auth v1248 ap=1 s=77 n(v0 b77 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd84000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e3b:[<0x10000000d33/367.out v1022>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e3b:[<0x10000000d33/367.out v1248>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.808 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.482+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/434.out auth v1268 ap=1 s=233 n(v0 b233 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd6f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ec1:[<0x10000000d33/434.out v1054>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ec1:[<0x10000000d33/434.out v1268>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.808 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.484+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e73 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/395.out auth v1242 ap=1 s=134 n(v0 b134 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd85600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e73:[<0x10000000d33/395.out v1038>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e73:[<0x10000000d33/395.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.809 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.484+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/444.out auth v1246 ap=1 s=233 n(v0 b233 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd86680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ed5:[<0x10000000d33/444.out v1060>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ed5:[<0x10000000d33/444.out v1246>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.809 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.484+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e99 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/414.out auth v1244 ap=1 s=95 n(v0 b95 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd86c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e99:[<0x10000000d33/414.out v1048>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e99:[<0x10000000d33/414.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.809 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.485+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f5a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/511.out auth v1240 ap=1 s=87 n(v0 b87 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd9a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f5a:[<0x10000000d33/511.out v1096>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f5a:[<0x10000000d33/511.out v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.809 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.485+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f23 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/483.out auth v1236 ap=1 s=85 n(v0 b85 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe3eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f23:[<0x10000000d33/483.out v1082>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f23:[<0x10000000d33/483.out v1236>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.810 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.485+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f2a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/487.out auth v1238 ap=1 s=82 n(v0 b82 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe3f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f2a:[<0x10000000d33/487.out v1086>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f2a:[<0x10000000d33/487.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.810 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.485+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e3f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/369.out auth v1228 ap=1 s=87 n(v0 b87 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe3f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e3f:[<0x10000000d33/369.out v1026>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e3f:[<0x10000000d33/369.out v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.810 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.485+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/479.out auth v1266 ap=1 s=137 n(v0 b137 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd9ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f1b:[<0x10000000d33/479.out v1080>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f1b:[<0x10000000d33/479.out v1266>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.810 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.486+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/429.out auth v1264 ap=1 s=85 n(v0 b85 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fd9b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eb7:[<0x10000000d33/429.out v1052>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000eb7:[<0x10000000d33/429.out v1264>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.811 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.486+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b92 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/037.out auth v1234 ap=1 s=4426 n(v0 b4426 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe40680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b92:[<0x10000000d33/037.out v152>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b92:[<0x10000000d33/037.out v1234>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.811 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.487+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dae [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/297.out auth v1230 ap=1 s=66 n(v0 b66 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe40100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dae:[<0x10000000d33/297.out v996>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dae:[<0x10000000d33/297.out v1230>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.811 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.487+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c32 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/113.out auth v1244 ap=1 s=222 n(v0 b222 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe41700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c32:[<0x10000000d33/113.out v460>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c32:[<0x10000000d33/113.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.811 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.487+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d44 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/244.out auth v1250 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe56580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d44:[<0x10000000d33/244.out v966>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d44:[<0x10000000d33/244.out v1250>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.811 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.488+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bce [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/067.out auth v1232 ap=1 s=2436 n(v0 b2436 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe56b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bce:[<0x10000000d33/067.out v272>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bce:[<0x10000000d33/067.out v1232>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.812 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.488+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e87 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/405.out auth v1248 ap=1 s=128 n(v0 b128 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe57080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e87:[<0x10000000d33/405.out v1044>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e87:[<0x10000000d33/405.out v1248>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.812 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.489+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000295 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/307.out auth v322 ap=1 s=89 n(v0 b89 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037feef700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000295:[<0x10000000304/307.out v274>,<0x10000000135/ext4 v1518>,<0x100000005e4/tests v794>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000295:[<0x10000000304/307.out v322>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.812 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.489+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000df8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/334.out auth v1256 ap=1 s=189 n(v0 b189 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037fe56000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000df8:[<0x10000000d33/334.out v1010>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000df8:[<0x10000000d33/334.out v1256>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.812 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.489+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/009 auth v334 ap=1 s=2785 n(v0 rc2023-10-18T14:05:23.571024+0000 b2785 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff02000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011a2:[<0x10000000304/009 v300>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011a2:[<0x10000000304/009 v334>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.812 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.490+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000223 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/010.out auth v326 ap=1 s=200 n(v0 b200 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff02580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000223:[<0x10000000304/010.out v46>,<0x10000000135/ext4 v1518>,<0x100000005e4/tests v794>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000223:[<0x10000000304/010.out v326>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.813 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.490+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000241 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/025.out auth v332 ap=1 s=138 n(v0 b138 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff03080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000241:[<0x10000000304/025.out v106>,<0x10000000135/ext4 v1518>,<0x100000005e4/tests v794>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000241:[<0x10000000304/025.out v332>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.813 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.490+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000028d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/303.out auth v330 ap=1 s=54 n(v0 b54 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff03b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000028d:[<0x10000000304/303.out v258>,<0x10000000135/ext4 v1518>,<0x100000005e4/tests v794>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000028d:[<0x10000000304/303.out v330>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.813 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.490+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/013 auth v336 ap=1 s=2608 n(v0 b2608 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff03600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011a6:[<0x10000000304/013 v304>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011a6:[<0x10000000304/013 v336>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.813 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.491+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000243 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/026.out auth v338 ap=1 s=1271 n(v0 b1271 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff02b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000243:[<0x10000000304/026.out v110>,<0x10000000135/ext4 v1518>,<0x100000005e4/tests v794>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000243:[<0x10000000304/026.out v338>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.813 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.491+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000263 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/042.out auth v318 ap=1 s=77 n(v0 b77 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff05180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000263:[<0x10000000304/042.out v174>,<0x10000000135/ext4 v1518>,<0x100000005e4/tests v794>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000263:[<0x10000000304/042.out v318>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.814 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.491+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000291 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/305.out auth v340 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff04c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000291:[<0x10000000304/305.out v266>,<0x10000000135/ext4 v1518>,<0x100000005e4/tests v794>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000291:[<0x10000000304/305.out v340>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.814 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.492+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/015 auth v342 ap=1 s=2213 n(v0 b2213 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff04100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011a8:[<0x10000000304/015 v308>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011a8:[<0x10000000304/015 v342>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.814 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.492+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011b3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/026 auth v346 ap=1 s=2686 n(v0 b2686 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff04680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011b3:[<0x10000000304/026 v312>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011b3:[<0x10000000304/026 v346>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.814 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.492+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/014.out auth v324 ap=1 s=235 n(v0 b235 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff05700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000022b:[<0x10000000304/014.out v62>,<0x10000000135/ext4 v1518>,<0x100000005e4/tests v794>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000022b:[<0x10000000304/014.out v324>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.815 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.492+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/024.out auth v320 ap=1 s=39 n(v0 b39 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff0c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000023f:[<0x10000000304/024.out v102>,<0x10000000135/ext4 v1518>,<0x100000005e4/tests v794>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000023f:[<0x10000000304/024.out v320>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.815 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.492+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/023.out auth v328 ap=1 s=51 n(v0 b51 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff0c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000023d:[<0x10000000304/023.out v98>,<0x10000000135/ext4 v1518>,<0x100000005e4/tests v794>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000023d:[<0x10000000304/023.out v328>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.815 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.493+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011cb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/307 auth v348 ap=1 s=1499 n(v0 b1499 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff0cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011cb:[<0x10000000304/307 v316>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011cb:[<0x10000000304/307 v348>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.815 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:05:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:05:42.493+0000 7f733eba5700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001402 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/001 auth v344 ap=1 s=1170 n(v0 rc2023-10-18T14:05:23.546025+0000 b1170 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56037ff0d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001402:[<0x10000000304/001 v296>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001402:[<0x10000000304/001 v344>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.816 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.367+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000e [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/ auth v282 ap=1 f(v0 m2023-10-18T14:05:08.447335+0000 2=1+1) n(v5 rc2023-10-18T14:05:28.416925+0000 b807 8=3+5) (inest lock dirty) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | dirtyscattered=1 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a27700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000000e:[<0x100000005e5/logs v171>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x1000000000e:[<0x100000005e5/logs v282>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:08.447335+0000 2=1+1)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:28.416925+0000 b807 8=3+5)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:08.447335+0000 2=1+1)","memory_value.rstat":"n(v5 rc2023-10-18T14:05:28.416925+0000 b807 8=3+5)","error_str":""},"return_code":0} 2023-10-18T14:05:42.816 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.368+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000602 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/packed-refs auth v248 ap=1 s=5114 n(v0 rc2023-10-18T14:05:08.432335+0000 b5114 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a25b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000602:[<0x100000005e5/packed-refs v150>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000602:[<0x100000005e5/packed-refs v248>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.816 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.368+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000606 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/config auth v244 ap=1 s=262 n(v0 rc2023-10-18T14:05:08.465334+0000 b262 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a25600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000606:[<0x100000005e5/config v190>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000606:[<0x100000005e5/config v244>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.818 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.392+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/471 auth v1152 ap=1 s=1682 n(v0 b1682 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8326c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c0:[<0x10000000403/471 v1118>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014c0:[<0x10000000403/471 v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.818 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.392+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ee [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/029 auth v1150 ap=1 s=3675 n(v0 b3675 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8326d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ee:[<0x10000000403/029 v1086>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011ee:[<0x10000000403/029 v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.818 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.392+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000308 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.default auth v1154 ap=1 s=865 n(v0 b865 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8326cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000308:[<0x10000000403/050.out.default v206>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000308:[<0x10000000403/050.out.default v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.819 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.368+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007dc [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/info/ auth v232 ap=1 f(v0 m2023-10-18T14:05:06.464375+0000 1=1+0) n(v0 rc2023-10-18T14:05:06.466375+0000 b240 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a25080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000007dc:[<0x100000005e5/info v8>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x100000007dc:[<0x100000005e5/info v232>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:06.464375+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:06.466375+0000 b240 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:06.464375+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:06.466375+0000 b240 2=1+1)","error_str":""},"return_code":0} 2023-10-18T14:05:42.819 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.369+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e0 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/ auth{2=1,3=1,4=1} v280 ap=1 f(v0 m2023-10-18T14:05:08.434335+0000 3=0+3) n(v2 rc2023-10-18T14:05:08.450334+0000 b73 7=2+5) (inest mix) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55fd0140f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000007e0:[<0x100000005e5/refs v156>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x100000007e0:[<0x100000005e5/refs v280>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:08.434335+0000 3=0+3)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:08.450334+0000 b73 7=2+5)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:08.434335+0000 3=0+3)","memory_value.rstat":"n(v2 rc2023-10-18T14:05:08.450334+0000 b73 7=2+5)","error_str":""},"return_code":0} 2023-10-18T14:05:42.820 INFO:tasks.workunit.client.0.smithi114.stdout:Building ltp 2023-10-18T14:05:42.820 INFO:tasks.workunit.client.0.smithi114.stdout:Building src 2023-10-18T14:05:42.821 INFO:tasks.workunit.client.0.smithi114.stdout:Building m4 2023-10-18T14:05:42.821 INFO:tasks.workunit.client.0.smithi114.stdout:Building common 2023-10-18T14:05:42.821 INFO:tasks.workunit.client.0.smithi114.stdout: [DEP] 2023-10-18T14:05:42.821 INFO:tasks.workunit.client.0.smithi114.stdout: [DEP] 2023-10-18T14:05:42.822 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.392+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000142b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/332 auth v1138 ap=1 s=1787 n(v0 b1787 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8326d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000142b:[<0x10000000403/332 v1102>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000142b:[<0x10000000403/332 v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.823 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.392+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014da [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/495 auth v1162 ap=1 s=1495 n(v0 b1495 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8396e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014da:[<0x10000000403/495 v1122>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014da:[<0x10000000403/495 v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.823 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.393+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000093c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/587.out auth v1134 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8396e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000093c:[<0x10000000403/587.out v1008>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000093c:[<0x10000000403/587.out v1134>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.823 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.393+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000142a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/331 auth v1146 ap=1 s=2032 n(v0 b2032 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8396f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000142a:[<0x10000000403/331 v1098>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000142a:[<0x10000000403/331 v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.823 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.393+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001411 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/306 auth v1160 ap=1 s=2310 n(v0 b2310 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8396eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001411:[<0x10000000403/306 v1094>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001411:[<0x10000000403/306 v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.824 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.369+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000600 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/shallow auth v240 ap=1 s=41 n(v0 rc2023-10-18T14:05:08.416335+0000 b41 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a24b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000600:[<0x100000005e5/shallow v140>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000600:[<0x100000005e5/shallow v240>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.824 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.372+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e6 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/branches/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/AsLsXsFsx@2},l=25030 | importingcaps=0 dirfrag=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55fd01a24580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000005e6:[<0x100000005e5/branches v2>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x100000005e6:[<0x100000005e5/branches v2>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":0} 2023-10-18T14:05:42.825 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.382+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000647 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/xfscrash auth v12 ap=1 s=10879 n(v0 b10879 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01cb6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000647:[<0x10000000024/xfscrash v6>,<0x100000005e4/crash v314>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000647:[<0x10000000024/xfscrash v12>,<0x100000005e4/crash v3552>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.825 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.364+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000159c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/102 auth v24 ap=1 s=758 n(v0 b758 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f72c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000159c:[<0x10000000d31/102 v10>,<0x10000000135/udf v13696>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000159c:[<0x10000000d31/102 v24>,<0x10000000135/udf v18937>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.825 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.364+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b46 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/102.out auth v18 ap=1 s=34 n(v0 b34 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f72680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b46:[<0x10000000d31/102.out v4>,<0x10000000135/udf v13696>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b46:[<0x10000000d31/102.out v18>,<0x10000000135/udf v18937>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.825 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.364+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000159e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/group auth v20 ap=1 s=180 n(v0 b180 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f72100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000159e:[<0x10000000d31/group v16>,<0x10000000135/udf v13696>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000159e:[<0x10000000d31/group v20>,<0x10000000135/udf v18937>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.826 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.365+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000159d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/Makefile auth v22 ap=1 s=426 n(v0 b426 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f71b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000159d:[<0x10000000d31/Makefile v14>,<0x10000000135/udf v13696>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000159d:[<0x10000000d31/Makefile v22>,<0x10000000135/udf v18937>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.826 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.371+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ce [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/401.out auth v1156 ap=1 s=58 n(v0 b58 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149e3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ce:[<0x10000000403/401.out v912>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004ce:[<0x10000000403/401.out v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.826 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.374+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008af [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/302.out auth v1150 ap=1 s=315 n(v0 rc2023-10-18T14:05:11.247277+0000 b315 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149e3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008af:[<0x10000000403/302.out v856>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008af:[<0x10000000403/302.out v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.826 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.374+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001258 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/113 auth v1180 ap=1 s=1877 n(v0 b1877 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149e3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001258:[<0x10000000403/113 v1108>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001258:[<0x10000000403/113 v1180>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.827 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.374+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001282 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/152 auth v1160 ap=1 s=2328 n(v0 rc2023-10-18T14:05:24.425007+0000 b2328 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149e4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001282:[<0x10000000403/152 v1120>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001282:[<0x10000000403/152 v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.827 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.374+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/149.out auth v1148 ap=1 s=941 n(v0 b941 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149e4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d0:[<0x10000000403/149.out v606>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003d0:[<0x10000000403/149.out v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.827 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.375+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001260 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/121 auth v1170 ap=1 s=2055 n(v0 b2055 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149e4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001260:[<0x10000000403/121 v1116>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001260:[<0x10000000403/121 v1170>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.827 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.375+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000144b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/362 auth v1168 ap=1 s=2051 n(v0 b2051 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149e5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000144b:[<0x10000000403/362 v1124>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000144b:[<0x10000000403/362 v1168>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.828 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.376+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000568 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/478.out auth v1152 ap=1 s=1695 n(v0 b1695 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a04000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000568:[<0x10000000403/478.out v962>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000568:[<0x10000000403/478.out v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.828 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.376+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001222 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/061 auth v1178 ap=1 s=1182 n(v0 b1182 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149e5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001222:[<0x10000000403/061 v1100>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001222:[<0x10000000403/061 v1178>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.828 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.376+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/441 auth v1182 ap=1 s=1907 n(v0 b1907 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a04580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a2:[<0x10000000403/441 v1136>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014a2:[<0x10000000403/441 v1182>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.828 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.376+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001228 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/067 auth v1172 ap=1 s=3251 n(v0 b3251 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a04b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001228:[<0x10000000403/067 v1104>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001228:[<0x10000000403/067 v1172>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.828 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.376+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000125d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/118 auth v1174 ap=1 s=2179 n(v0 b2179 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a05080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000125d:[<0x10000000403/118 v1112>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000125d:[<0x10000000403/118 v1174>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.829 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.377+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/462 auth v1162 ap=1 s=2142 n(v0 b2142 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a05600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b7:[<0x10000000403/462 v1140>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014b7:[<0x10000000403/462 v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.829 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.377+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000314 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/055.out auth v1146 ap=1 s=5457 n(v0 b5457 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a05b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000314:[<0x10000000403/055.out v230>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000314:[<0x10000000403/055.out v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.829 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.377+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/396 auth v1164 ap=1 s=1634 n(v0 b1634 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a06100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000146f:[<0x10000000403/396 v1132>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000146f:[<0x10000000403/396 v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.829 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.377+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000092b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/576.out auth v1158 ap=1 s=318 n(v0 b318 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a06680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000092b:[<0x10000000403/576.out v1010>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000092b:[<0x10000000403/576.out v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.830 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.377+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/160.out auth v1154 ap=1 s=141 n(v0 b141 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a07180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e6:[<0x10000000403/160.out v650>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003e6:[<0x10000000403/160.out v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.830 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.378+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/518 auth v1176 ap=1 s=1607 n(v0 b1607 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a07700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f3:[<0x10000000403/518 v1144>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014f3:[<0x10000000403/518 v1176>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.830 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.378+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/361.out auth v1148 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a12580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000047e:[<0x10000000403/361.out v880>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000047e:[<0x10000000403/361.out v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.830 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.378+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001451 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/368 auth v1162 ap=1 s=1199 n(v0 b1199 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a13080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001451:[<0x10000000403/368 v1120>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001451:[<0x10000000403/368 v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.830 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.378+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001458 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/374 auth v1166 ap=1 s=1439 n(v0 rc2023-10-18T14:05:24.972996+0000 b1439 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a06c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001458:[<0x10000000403/374 v1128>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001458:[<0x10000000403/374 v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.831 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.379+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/019 auth v1160 ap=1 s=4008 n(v0 b4008 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a12000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e3:[<0x10000000403/019 v1088>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011e3:[<0x10000000403/019 v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.831 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.379+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001276 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/140.out auth v1170 ap=1 s=771 n(v0 b771 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a12b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001276:[<0x10000000403/140.out v1108>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001276:[<0x10000000403/140.out v1170>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.831 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.379+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001261 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/122 auth v1156 ap=1 s=2148 n(v0 b2148 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a13600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001261:[<0x10000000403/122 v1104>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001261:[<0x10000000403/122 v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.831 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.380+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001474 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/400 auth v1164 ap=1 s=1554 n(v0 b1554 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a14100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001474:[<0x10000000403/400 v1128>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001474:[<0x10000000403/400 v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.832 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.380+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001410 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/305 auth v1166 ap=1 s=2009 n(v0 b2009 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a13b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001410:[<0x10000000403/305 v1116>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001410:[<0x10000000403/305 v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.832 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.380+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000128c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/162 auth v1158 ap=1 s=1569 n(v0 b1569 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a14c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000128c:[<0x10000000403/162 v1112>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000128c:[<0x10000000403/162 v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.832 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.381+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001472 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/398 auth v1172 ap=1 s=5150 n(v0 rc2023-10-18T14:05:25.029994+0000 b5150 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914955b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001472:[<0x10000000403/398 v1124>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001472:[<0x10000000403/398 v1172>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.832 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.381+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001244 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/093.out auth v1152 ap=1 s=372 n(v0 rc2023-10-18T14:05:24.312009+0000 b372 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a14680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001244:[<0x10000000403/093.out v1100>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001244:[<0x10000000403/093.out v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.832 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.381+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/381.out auth v1168 ap=1 s=372 n(v0 b372 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a15180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a6:[<0x10000000403/381.out v894>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004a6:[<0x10000000403/381.out v1168>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.833 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.381+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000897 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/290.out auth v1144 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a15700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000897:[<0x10000000403/290.out v846>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000897:[<0x10000000403/290.out v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.833 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.382+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/423.out auth v1142 ap=1 s=258 n(v0 b258 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a1c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004fa:[<0x10000000403/423.out v924>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004fa:[<0x10000000403/423.out v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.833 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.382+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000089d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/293.out auth v1146 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a1c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000089d:[<0x10000000403/293.out v850>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000089d:[<0x10000000403/293.out v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.833 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.382+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000936 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/584.out auth v1150 ap=1 s=282 n(v0 b282 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a1d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000936:[<0x10000000403/584.out v1014>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000936:[<0x10000000403/584.out v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.834 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.382+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/392.out auth v1140 ap=1 s=415 n(v0 b415 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a1db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004bc:[<0x10000000403/392.out v904>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004bc:[<0x10000000403/392.out v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.834 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.382+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/022 auth v1154 ap=1 s=1217 n(v0 b1217 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a1d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e7:[<0x10000000403/022 v1092>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011e7:[<0x10000000403/022 v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.834 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.382+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014cc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/482 auth v1178 ap=1 s=2711 n(v0 b2711 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a1e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014cc:[<0x10000000403/482 v1136>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014cc:[<0x10000000403/482 v1178>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.834 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.383+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/376.out auth v1138 ap=1 s=88 n(v0 b88 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a1e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049c:[<0x10000000403/376.out v890>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000049c:[<0x10000000403/376.out v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.834 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.383+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000149e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/438 auth v1176 ap=1 s=1338 n(v0 b1338 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a1cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000149e:[<0x10000000403/438 v1132>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000149e:[<0x10000000403/438 v1176>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.835 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.383+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000122f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/074 auth v1174 ap=1 s=3206 n(v0 b3206 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914a1ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000122f:[<0x10000000403/074 v1096>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000122f:[<0x10000000403/074 v1174>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.835 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.383+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001239 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/084 auth v1130 ap=1 s=1595 n(v0 b1595 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c2f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001239:[<0x10000000403/084 v1086>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001239:[<0x10000000403/084 v1130>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.835 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.384+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001292 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/168 auth v1124 ap=1 s=1622 n(v0 b1622 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914dbe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001292:[<0x10000000403/168 v1090>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001292:[<0x10000000403/168 v1124>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.835 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.384+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/174.out auth v1112 ap=1 s=244 n(v0 b244 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914dbe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e4:[<0x10000000403/174.out v706>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000007e4:[<0x10000000403/174.out v1112>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.836 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.384+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000934 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/583.out auth v1120 ap=1 s=166 n(v0 b166 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914dbf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000934:[<0x10000000403/583.out v1004>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000934:[<0x10000000403/583.out v1120>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.836 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.384+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ed [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/257 auth v1126 ap=1 s=782 n(v0 b782 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914dbf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ed:[<0x10000000403/257 v1102>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012ed:[<0x10000000403/257 v1126>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.836 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.385+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/179 auth v1122 ap=1 s=2041 n(v0 b2041 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914dbeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000129d:[<0x10000000403/179 v1094>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000129d:[<0x10000000403/179 v1122>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.836 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.385+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ab [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/450 auth v1132 ap=1 s=3997 n(v0 b3997 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914dc0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ab:[<0x10000000403/450 v1106>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014ab:[<0x10000000403/450 v1132>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.837 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.385+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000386 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/112.out auth v1114 ap=1 s=575 n(v0 b575 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914dc0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000386:[<0x10000000403/112.out v458>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000386:[<0x10000000403/112.out v1114>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.837 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.385+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014bd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/468 auth v1134 ap=1 s=2403 n(v0 b2403 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914dc1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014bd:[<0x10000000403/468 v1110>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014bd:[<0x10000000403/468 v1134>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.837 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.385+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/252 auth v1128 ap=1 s=2267 n(v0 b2267 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914dc1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e8:[<0x10000000403/252 v1098>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012e8:[<0x10000000403/252 v1128>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.837 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.386+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000126a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/131 auth v1128 ap=1 s=610 n(v0 rc2023-10-18T14:05:24.382008+0000 b610 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914af2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000126a:[<0x10000000403/131 v1094>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000126a:[<0x10000000403/131 v1128>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.837 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.386+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/406 auth v1144 ap=1 s=1217 n(v0 b1217 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914af2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000147b:[<0x10000000403/406 v1114>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000147b:[<0x10000000403/406 v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.838 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.386+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001262 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/123 auth v1146 ap=1 s=1283 n(v0 b1283 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914af3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001262:[<0x10000000403/123 v1090>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001262:[<0x10000000403/123 v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.838 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.386+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000145b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/376 auth v1126 ap=1 s=1345 n(v0 b1345 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914af3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000145b:[<0x10000000403/376 v1110>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000145b:[<0x10000000403/376 v1126>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.838 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.387+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/504 auth v1132 ap=1 s=1357 n(v0 b1357 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914af3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e5:[<0x10000000403/504 v1122>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014e5:[<0x10000000403/504 v1132>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.838 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.387+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000869 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/267.out auth v1124 ap=1 s=312 n(v0 b312 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914af4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000869:[<0x10000000403/267.out v838>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000869:[<0x10000000403/267.out v1124>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.838 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.387+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000128a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/160 auth v1130 ap=1 s=1389 n(v0 b1389 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914af5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000128a:[<0x10000000403/160 v1098>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000128a:[<0x10000000403/160 v1130>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.839 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.388+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/127.out auth v1136 ap=1 s=508 n(v0 b508 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914af4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a4:[<0x10000000403/127.out v518>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003a4:[<0x10000000403/127.out v1136>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.839 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.388+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000808 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/192.out auth v1138 ap=1 s=88 n(v0 b88 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914af5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000808:[<0x10000000403/192.out v778>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000808:[<0x10000000403/192.out v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.839 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.388+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000128f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/165 auth v1148 ap=1 s=1925 n(v0 b1925 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b00000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000128f:[<0x10000000403/165 v1102>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000128f:[<0x10000000403/165 v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.839 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.389+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/490 auth v1140 ap=1 s=1045 n(v0 b1045 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b00580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d5:[<0x10000000403/490 v1118>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014d5:[<0x10000000403/490 v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.840 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.389+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000124c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/101 auth v1142 ap=1 s=2870 n(v0 b2870 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b00b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000124c:[<0x10000000403/101 v1086>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000124c:[<0x10000000403/101 v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.840 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.389+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000871 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/271.out auth v1048 ap=1 s=312 n(v0 b312 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b01080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000871:[<0x10000000403/271.out v852>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000871:[<0x10000000403/271.out v1048>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.840 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.389+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ab [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/192 auth v1082 ap=1 s=1261 n(v0 rc2023-10-18T14:05:24.513005+0000 b1261 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b01600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ab:[<0x10000000403/192 v1038>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012ab:[<0x10000000403/192 v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.840 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.390+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004cc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/400.out auth v1066 ap=1 s=305 n(v0 b305 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b01b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004cc:[<0x10000000403/400.out v912>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004cc:[<0x10000000403/400.out v1066>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.840 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.390+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000124e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/103 auth v1064 ap=1 s=1805 n(v0 b1805 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b02100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000124e:[<0x10000000403/103 v1034>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000124e:[<0x10000000403/103 v1064>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.841 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.390+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000588 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/494.out auth v1078 ap=1 s=157 n(v0 b157 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b02680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000588:[<0x10000000403/494.out v954>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000588:[<0x10000000403/494.out v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.841 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.390+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001431 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/338 auth v1134 ap=1 s=1541 n(v0 b1541 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914af4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001431:[<0x10000000403/338 v1106>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001431:[<0x10000000403/338 v1134>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.841 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.391+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000879 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/275.out auth v1060 ap=1 s=116 n(v0 b116 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b02c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000879:[<0x10000000403/275.out v856>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000879:[<0x10000000403/275.out v1060>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.841 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.391+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000121a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/053 auth v1088 ap=1 s=1398 n(v0 b1398 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b03180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000121a:[<0x10000000403/053 v1022>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000121a:[<0x10000000403/053 v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.842 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.391+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/547.out auth v1068 ap=1 s=28 n(v0 b28 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b03700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008f1:[<0x10000000403/547.out v984>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008f1:[<0x10000000403/547.out v1068>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.842 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.391+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000085d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/261.out auth v1054 ap=1 s=486 n(v0 b486 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b14000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000085d:[<0x10000000403/261.out v850>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000085d:[<0x10000000403/261.out v1054>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.842 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.391+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ac [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/384.out auth v1118 ap=1 s=117 n(v0 b117 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914dbfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ac:[<0x10000000403/384.out v896>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004ac:[<0x10000000403/384.out v1118>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.842 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.391+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000480 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/362.out auth v1116 ap=1 s=1903 n(v0 b1903 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914dc0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000480:[<0x10000000403/362.out v886>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000480:[<0x10000000403/362.out v1116>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.842 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.392+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/539.out auth v1074 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b14580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008e1:[<0x10000000403/539.out v978>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008e1:[<0x10000000403/539.out v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.843 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.392+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000123a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/085 auth v1076 ap=1 s=1977 n(v0 b1977 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b14b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000123a:[<0x10000000403/085 v1030>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000123a:[<0x10000000403/085 v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.843 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.392+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/166.out auth v1056 ap=1 s=102 n(v0 b102 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b15080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f2:[<0x10000000403/166.out v674>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003f2:[<0x10000000403/166.out v1056>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.843 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.392+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ef [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/029.out auth v1086 ap=1 s=2702 n(v0 b2702 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b15600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ef:[<0x10000000403/029.out v1018>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011ef:[<0x10000000403/029.out v1086>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.843 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.393+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000534 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/452.out auth v1070 ap=1 s=77 n(v0 b77 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b15b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000534:[<0x10000000403/452.out v934>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000534:[<0x10000000403/452.out v1070>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.844 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.393+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/406.out auth v1052 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b16100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d8:[<0x10000000403/406.out v918>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004d8:[<0x10000000403/406.out v1052>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.844 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.393+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001234 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/079 auth v1072 ap=1 s=1095 n(v0 b1095 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b16680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001234:[<0x10000000403/079 v1026>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001234:[<0x10000000403/079 v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.844 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.393+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000881 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/279.out auth v1062 ap=1 s=312 n(v0 b312 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b16c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000881:[<0x10000000403/279.out v860>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000881:[<0x10000000403/279.out v1062>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.844 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.393+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001482 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/413 auth v1080 ap=1 s=2731 n(v0 b2731 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b17180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001482:[<0x10000000403/413 v1042>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001482:[<0x10000000403/413 v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.844 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.393+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000342 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/078.out auth v1050 ap=1 s=1933 n(v0 b1933 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b17700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000342:[<0x10000000403/078.out v322>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000342:[<0x10000000403/078.out v1050>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.845 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.394+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002bd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/017.out auth v1058 ap=1 s=28 n(v0 b28 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b1e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002bd:[<0x10000000403/017.out v68>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002bd:[<0x10000000403/017.out v1058>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.845 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.394+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001447 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/358 auth v1068 ap=1 s=1545 n(v0 b1545 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914de1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001447:[<0x10000000403/358 v1026>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001447:[<0x10000000403/358 v1068>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.845 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.394+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/457 auth v1062 ap=1 s=2857 n(v0 b2857 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914de1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b2:[<0x10000000403/457 v1038>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014b2:[<0x10000000403/457 v1062>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.845 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.394+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000546 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/461.out auth v1052 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914de0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000546:[<0x10000000403/461.out v942>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000546:[<0x10000000403/461.out v1052>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.846 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.394+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001232 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/077 auth v1060 ap=1 s=1838 n(v0 rc2023-10-18T14:05:24.277010+0000 b1838 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914de0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001232:[<0x10000000403/077 v1018>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001232:[<0x10000000403/077 v1060>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.846 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.394+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001456 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/373 auth v1064 ap=1 s=1435 n(v0 b1435 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c2c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001456:[<0x10000000403/373 v1030>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001456:[<0x10000000403/373 v1064>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.846 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.395+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000409 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/203.out auth v1050 ap=1 s=486 n(v0 b486 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c2c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000409:[<0x10000000403/203.out v812>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000409:[<0x10000000403/203.out v1050>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.846 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.395+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008bb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/308.out auth v1056 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c2cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008bb:[<0x10000000403/308.out v870>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008bb:[<0x10000000403/308.out v1056>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.846 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.395+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000384 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/111.out auth v1048 ap=1 s=1469 n(v0 b1469 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c2db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000384:[<0x10000000403/111.out v454>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000384:[<0x10000000403/111.out v1048>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.847 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.395+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/459 auth v1084 ap=1 s=4538 n(v0 rc2023-10-18T14:05:25.167992+0000 b4538 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b1e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b4:[<0x10000000403/459 v1046>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014b4:[<0x10000000403/459 v1084>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.847 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.395+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000837 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/242.out auth v1046 ap=1 s=486 n(v0 b486 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c2d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000837:[<0x10000000403/242.out v838>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000837:[<0x10000000403/242.out v1046>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.847 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.396+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012eb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/255 auth v1066 ap=1 s=1166 n(v0 b1166 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c2e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012eb:[<0x10000000403/255 v1022>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012eb:[<0x10000000403/255 v1066>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.847 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.396+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001523 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/564 auth v1058 ap=1 s=3991 n(v0 b3991 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c2e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001523:[<0x10000000403/564 v1042>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001523:[<0x10000000403/564 v1058>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.847 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.396+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000806 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/191.out auth v1044 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c2ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000806:[<0x10000000403/191.out v774>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000806:[<0x10000000403/191.out v1044>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.848 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.396+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/116.out auth v1054 ap=1 s=335 n(v0 b335 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c2f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000038e:[<0x10000000403/116.out v474>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000038e:[<0x10000000403/116.out v1054>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.848 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.396+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/447 auth v1070 ap=1 s=2035 n(v0 b2035 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c2d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a8:[<0x10000000403/447 v1034>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014a8:[<0x10000000403/447 v1070>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.848 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.396+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001483 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/414 auth v1106 ap=1 s=2550 n(v0 b2550 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ab4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001483:[<0x10000000403/414 v1050>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001483:[<0x10000000403/414 v1106>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.848 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.396+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000378 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/105.out auth v1076 ap=1 s=57 n(v0 b57 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ab4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000378:[<0x10000000403/105.out v430>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000378:[<0x10000000403/105.out v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.849 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.397+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/403.out auth v1084 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ab5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d2:[<0x10000000403/403.out v916>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004d2:[<0x10000000403/403.out v1084>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.849 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.397+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001502 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/532 auth v1098 ap=1 s=1709 n(v0 b1709 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ab4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001502:[<0x10000000403/532 v1058>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001502:[<0x10000000403/532 v1098>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.849 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.397+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/035.cfg auth v1070 ap=1 s=9 n(v0 b9 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914aca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e1:[<0x10000000403/035.cfg v140>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002e1:[<0x10000000403/035.cfg v1070>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.849 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.397+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ad [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/009.out auth v1082 ap=1 s=8125 n(v0 b8125 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ab5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ad:[<0x10000000403/009.out v36>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002ad:[<0x10000000403/009.out v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.849 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.397+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/508.out auth v1088 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914aca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005a4:[<0x10000000403/508.out v962>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005a4:[<0x10000000403/508.out v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.850 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.397+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001279 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/143 auth v1096 ap=1 s=1812 n(v0 b1812 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914acab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001279:[<0x10000000403/143 v1030>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001279:[<0x10000000403/143 v1096>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.850 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.398+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000148a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/420 auth v1104 ap=1 s=1079 n(v0 rc2023-10-18T14:05:25.079993+0000 b1079 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914acb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000148a:[<0x10000000403/420 v1054>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000148a:[<0x10000000403/420 v1104>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.850 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.398+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/540 auth v1092 ap=1 s=2493 n(v0 b2493 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914acb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000150a:[<0x10000000403/540 v1062>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000150a:[<0x10000000403/540 v1092>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.850 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.398+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/180 auth v1108 ap=1 s=2043 n(v0 b2043 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914acc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000129e:[<0x10000000403/180 v1042>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000129e:[<0x10000000403/180 v1108>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.851 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.398+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/006.out auth v1068 ap=1 s=278 n(v0 b278 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914acbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a7:[<0x10000000403/006.out v24>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002a7:[<0x10000000403/006.out v1068>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.851 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.398+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/545 auth v1094 ap=1 s=1905 n(v0 b1905 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914acc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000150f:[<0x10000000403/545 v1066>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000150f:[<0x10000000403/545 v1094>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.851 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.398+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000128b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/161 auth v1090 ap=1 s=1136 n(v0 b1136 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914acd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000128b:[<0x10000000403/161 v1034>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000128b:[<0x10000000403/161 v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.851 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.398+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001265 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/126 auth v1086 ap=1 s=1393 n(v0 b1393 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914accc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001265:[<0x10000000403/126 v1026>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001265:[<0x10000000403/126 v1086>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.851 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.399+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/394.out auth v1080 ap=1 s=50 n(v0 b50 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914acd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c0:[<0x10000000403/394.out v910>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004c0:[<0x10000000403/394.out v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.852 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.399+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000885 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/281.out auth v1078 ap=1 s=313 n(v0 b313 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ad4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000885:[<0x10000000403/281.out v862>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000885:[<0x10000000403/281.out v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.852 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.399+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005c0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/522.out auth v1074 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ad4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005c0:[<0x10000000403/522.out v970>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005c0:[<0x10000000403/522.out v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.852 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.399+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/532.out auth v1072 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ad5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005d4:[<0x10000000403/532.out v976>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005d4:[<0x10000000403/532.out v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.852 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.399+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001501 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/531 auth v1052 ap=1 s=1881 n(v0 b1881 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914742c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001501:[<0x10000000403/531 v1034>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001501:[<0x10000000403/531 v1052>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.853 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.400+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/176 auth v1102 ap=1 s=2077 n(v0 b2077 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ad5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000129a:[<0x10000000403/176 v1038>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000129a:[<0x10000000403/176 v1102>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.853 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.400+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000125a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/115 auth v1054 ap=1 s=1708 n(v0 b1708 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bd2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000125a:[<0x10000000403/115 v1010>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000125a:[<0x10000000403/115 v1054>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.853 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.400+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/485 auth v1050 ap=1 s=2694 n(v0 b2694 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bd2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d0:[<0x10000000403/485 v1030>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014d0:[<0x10000000403/485 v1050>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.853 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.400+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004dc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/408.out auth v1048 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914743180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004dc:[<0x10000000403/408.out v908>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004dc:[<0x10000000403/408.out v1048>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.853 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.401+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/200 auth v1058 ap=1 s=2125 n(v0 b2125 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914743700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b3:[<0x10000000403/200 v1014>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012b3:[<0x10000000403/200 v1058>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.854 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.401+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/204 auth v1100 ap=1 s=2292 n(v0 b2292 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ad4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b8:[<0x10000000403/204 v1046>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012b8:[<0x10000000403/204 v1100>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.854 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.401+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/134.out auth v1046 ap=1 s=747 n(v0 b747 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bd3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b2:[<0x10000000403/134.out v546>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003b2:[<0x10000000403/134.out v1046>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.854 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.401+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000354 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/087.out auth v1042 ap=1 s=371 n(v0 b371 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bd3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000354:[<0x10000000403/087.out v358>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000354:[<0x10000000403/087.out v1042>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.854 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.401+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000122d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/072 auth v1064 ap=1 s=1425 n(v0 b1425 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bd3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000122d:[<0x10000000403/072 v1006>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000122d:[<0x10000000403/072 v1064>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.855 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.401+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000030a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.xfsquota auth v1044 ap=1 s=794 n(v0 b794 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bd4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000030a:[<0x10000000403/050.out.xfsquota v210>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000030a:[<0x10000000403/050.out.xfsquota v1044>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.855 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.402+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000029f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/002.out auth v1040 ap=1 s=49 n(v0 b49 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bd4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000029f:[<0x10000000403/002.out v8>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000029f:[<0x10000000403/002.out v1040>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.855 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.402+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001441 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/353 auth v1066 ap=1 s=1821 n(v0 b1821 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bd4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001441:[<0x10000000403/353 v1022>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001441:[<0x10000000403/353 v1066>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.855 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.402+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001308 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/284 auth v1060 ap=1 s=1906 n(v0 b1906 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bd5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001308:[<0x10000000403/284 v1018>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001308:[<0x10000000403/284 v1060>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.856 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.402+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/165.out auth v1050 ap=1 s=113 n(v0 b113 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391483ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f0:[<0x10000000403/165.out v670>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003f0:[<0x10000000403/165.out v1050>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.856 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.403+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000123f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/089 auth v1078 ap=1 s=1429 n(v0 b1429 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391483b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000123f:[<0x10000000403/089 v1018>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000123f:[<0x10000000403/089 v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.856 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.403+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/336.out auth v1056 ap=1 s=216 n(v0 b216 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391483b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000044c:[<0x10000000403/336.out v872>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000044c:[<0x10000000403/336.out v1056>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.856 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.403+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001287 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/157 auth v1094 ap=1 s=2839 n(v0 b2839 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391483bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001287:[<0x10000000403/157 v1030>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001287:[<0x10000000403/157 v1094>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.856 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.403+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/008 auth v1062 ap=1 s=1039 n(v0 rc2023-10-18T14:05:23.706022+0000 b1039 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391483c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d8:[<0x10000000403/008 v1002>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011d8:[<0x10000000403/008 v1062>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.857 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.404+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/082.out auth v1046 ap=1 s=118 n(v0 b118 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391483d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000034a:[<0x10000000403/082.out v338>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000034a:[<0x10000000403/082.out v1046>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.857 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.404+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001506 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/536 auth v1082 ap=1 s=2240 n(v0 b2240 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391483d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001506:[<0x10000000403/536 v1042>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001506:[<0x10000000403/536 v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.857 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.404+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/007.out auth v1044 ap=1 s=1359 n(v0 b1359 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391483cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a9:[<0x10000000403/007.out v28>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002a9:[<0x10000000403/007.out v1044>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.857 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.404+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000843 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/248.out auth v1076 ap=1 s=52 n(v0 b52 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914770000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000843:[<0x10000000403/248.out v828>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000843:[<0x10000000403/248.out v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.858 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.405+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001249 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/098 auth v1074 ap=1 s=2664 n(v0 b2664 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914770580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001249:[<0x10000000403/098 v1026>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001249:[<0x10000000403/098 v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.858 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.405+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001546 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/Makefile auth v1062 ap=1 s=438 n(v0 b438 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bd2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001546:[<0x10000000403/Makefile v1038>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001546:[<0x10000000403/Makefile v1062>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.858 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.405+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ad [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/452 auth v1056 ap=1 s=1211 n(v0 b1211 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bd5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ad:[<0x10000000403/452 v1026>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014ad:[<0x10000000403/452 v1056>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.858 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.405+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001495 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/430 auth v1084 ap=1 s=2741 n(v0 b2741 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391483c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001495:[<0x10000000403/430 v1038>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001495:[<0x10000000403/430 v1084>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.858 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.405+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000398 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/121.out auth v1054 ap=1 s=334 n(v0 b334 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914770b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000398:[<0x10000000403/121.out v494>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000398:[<0x10000000403/121.out v1054>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.859 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.405+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/068.out auth v1048 ap=1 s=738 n(v0 b738 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914771080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000032e:[<0x10000000403/068.out v282>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000032e:[<0x10000000403/068.out v1048>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.859 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.406+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000322 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/062.out auth v1052 ap=1 s=16262 n(v0 b16262 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914772100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000322:[<0x10000000403/062.out v258>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000322:[<0x10000000403/062.out v1052>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.859 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.406+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000121c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/055 auth v1064 ap=1 s=3151 n(v0 b3151 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914772680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000121c:[<0x10000000403/055 v1010>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000121c:[<0x10000000403/055 v1064>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.859 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.406+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001224 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/063 auth v1090 ap=1 s=1204 n(v0 b1204 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914771b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001224:[<0x10000000403/063 v1014>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001224:[<0x10000000403/063 v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.860 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.406+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/024 auth v1068 ap=1 s=759 n(v0 b759 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914771600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e9:[<0x10000000403/024 v1006>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011e9:[<0x10000000403/024 v1068>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.860 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.407+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000913 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/564.out auth v1066 ap=1 s=1010 n(v0 b1010 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914772c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000913:[<0x10000000403/564.out v982>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000913:[<0x10000000403/564.out v1066>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.860 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.407+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001296 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/172 auth v1072 ap=1 s=2024 n(v0 b2024 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914773700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001296:[<0x10000000403/172 v1034>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001296:[<0x10000000403/172 v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.860 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.407+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001243 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/093 auth v1092 ap=1 s=1774 n(v0 rc2023-10-18T14:05:24.310009+0000 b1774 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914928000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001243:[<0x10000000403/093 v1022>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001243:[<0x10000000403/093 v1092>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.860 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.407+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000488 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/366.out auth v1060 ap=1 s=449 n(v0 b449 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914928580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000488:[<0x10000000403/366.out v888>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000488:[<0x10000000403/366.out v1060>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.861 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.407+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a2f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/580.out auth v1058 ap=1 s=3320 n(v0 rc2023-10-18T14:05:14.655207+0000 b3320 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914928b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a2f:[<0x10000000403/580.out v990>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000a2f:[<0x10000000403/580.out v1058>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.861 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.407+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000867 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/266.out auth v1080 ap=1 s=313 n(v0 b313 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914929080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000867:[<0x10000000403/266.out v834>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000867:[<0x10000000403/266.out v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.861 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.408+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000057e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/489.out auth v1088 ap=1 s=240 n(v0 b240 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914929600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000057e:[<0x10000000403/489.out v938>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000057e:[<0x10000000403/489.out v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.861 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.408+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001437 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/344 auth v1120 ap=1 s=967 n(v0 b967 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391492a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001437:[<0x10000000403/344 v1070>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001437:[<0x10000000403/344 v1120>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.861 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.408+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/230.out auth v1088 ap=1 s=844 n(v0 b844 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391492ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081f:[<0x10000000403/230.out v830>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000081f:[<0x10000000403/230.out v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.862 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.408+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/551.out auth v1070 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914929b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008f9:[<0x10000000403/551.out v968>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008f9:[<0x10000000403/551.out v1070>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.862 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.408+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011df [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/015 auth v1104 ap=1 s=2005 n(v0 b2005 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391492b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011df:[<0x10000000403/015 v1030>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011df:[<0x10000000403/015 v1104>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.862 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.409+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000125f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/120 auth v1102 ap=1 s=2042 n(v0 b2042 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391492b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000125f:[<0x10000000403/120 v1050>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000125f:[<0x10000000403/120 v1102>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.862 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.409+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001274 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/139.out auth v1134 ap=1 s=783 n(v0 b783 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391494a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001274:[<0x10000000403/139.out v1058>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001274:[<0x10000000403/139.out v1134>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.863 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.409+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/585 auth v1108 ap=1 s=1219 n(v0 b1219 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391492a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153d:[<0x10000000403/585 v1086>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000153d:[<0x10000000403/585 v1108>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.863 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.410+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005c6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/525.out auth v1086 ap=1 s=50 n(v0 b50 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914773180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005c6:[<0x10000000403/525.out v952>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005c6:[<0x10000000403/525.out v1086>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.863 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.410+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001255 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/110 auth v1122 ap=1 s=1785 n(v0 b1785 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391494a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001255:[<0x10000000403/110 v1046>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001255:[<0x10000000403/110 v1122>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.863 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.410+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001490 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/426 auth v1124 ap=1 s=1548 n(v0 b1548 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391494b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001490:[<0x10000000403/426 v1074>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001490:[<0x10000000403/426 v1124>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.863 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.410+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000580 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/490.out auth v1100 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391494c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000580:[<0x10000000403/490.out v966>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000580:[<0x10000000403/490.out v1100>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.864 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.411+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000149c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/436 auth v1128 ap=1 s=885 n(v0 b885 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391494ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000149c:[<0x10000000403/436 v1078>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000149c:[<0x10000000403/436 v1128>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.864 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.411+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000849 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/251.out auth v1112 ap=1 s=49 n(v0 b49 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391494b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000849:[<0x10000000403/251.out v842>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000849:[<0x10000000403/251.out v1112>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.864 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.411+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/202 auth v1116 ap=1 s=1588 n(v0 b1588 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391494c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b6:[<0x10000000403/202 v1062>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012b6:[<0x10000000403/202 v1116>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.864 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.411+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/267 auth v1118 ap=1 s=1783 n(v0 b1783 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391494bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f7:[<0x10000000403/267 v1066>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012f7:[<0x10000000403/267 v1118>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.865 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.411+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000901 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/555.out auth v1090 ap=1 s=339 n(v0 b339 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391494cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000901:[<0x10000000403/555.out v988>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000901:[<0x10000000403/555.out v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.865 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.412+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/099.out auth v1092 ap=1 s=6887 n(v0 b6887 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391494d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000036c:[<0x10000000403/099.out v406>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000036c:[<0x10000000403/099.out v1092>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.865 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.412+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001270 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/137 auth v1130 ap=1 s=3235 n(v0 b3235 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56391494d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001270:[<0x10000000403/137 v1054>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001270:[<0x10000000403/137 v1130>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.865 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.412+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000889 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/283.out auth v1098 ap=1 s=320 n(v0 b320 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914954000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000889:[<0x10000000403/283.out v856>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000889:[<0x10000000403/283.out v1098>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.866 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.412+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/572.out auth v1132 ap=1 s=2247 n(v0 b2247 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914954580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152d:[<0x10000000403/572.out v1082>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000152d:[<0x10000000403/572.out v1132>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.866 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.412+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000911 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/563.out auth v1114 ap=1 s=250 n(v0 b250 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914954b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000911:[<0x10000000403/563.out v1000>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000911:[<0x10000000403/563.out v1114>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.866 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.413+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ea [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/177.out auth v1096 ap=1 s=451 n(v0 b451 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914955080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ea:[<0x10000000403/177.out v718>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000007ea:[<0x10000000403/177.out v1096>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.866 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.413+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001225 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/064 auth v1126 ap=1 s=2178 n(v0 b2178 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914955600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001225:[<0x10000000403/064 v1038>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001225:[<0x10000000403/064 v1126>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.866 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.413+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001240 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/090 auth v1106 ap=1 s=2488 n(v0 b2488 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914956680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001240:[<0x10000000403/090 v1042>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001240:[<0x10000000403/090 v1106>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.867 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.413+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011eb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/026 auth v1110 ap=1 s=2552 n(v0 b2552 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914956100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011eb:[<0x10000000403/026 v1034>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011eb:[<0x10000000403/026 v1110>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.867 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.413+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/145.out auth v1094 ap=1 s=945 n(v0 b945 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914956c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c8:[<0x10000000403/145.out v590>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003c8:[<0x10000000403/145.out v1094>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.867 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.413+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/231 auth v1164 ap=1 s=2001 n(v0 b2001 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146b2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d3:[<0x10000000403/231 v1126>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012d3:[<0x10000000403/231 v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.867 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.413+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/269.out auth v1152 ap=1 s=67 n(v0 b67 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146b3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086d:[<0x10000000403/269.out v858>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000086d:[<0x10000000403/269.out v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.868 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.414+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000532 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/451.out auth v1148 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146b3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000532:[<0x10000000403/451.out v946>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000532:[<0x10000000403/451.out v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.868 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.414+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/214 auth v1170 ap=1 s=3530 n(v0 b3530 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012c2:[<0x10000000403/214 v1122>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012c2:[<0x10000000403/214 v1170>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.868 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.414+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001445 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/356 auth v1174 ap=1 s=1118 n(v0 b1118 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146b4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001445:[<0x10000000403/356 v1142>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001445:[<0x10000000403/356 v1174>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.868 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.414+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/304.out auth v1158 ap=1 s=705 n(v0 b705 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b3:[<0x10000000403/304.out v876>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008b3:[<0x10000000403/304.out v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.868 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.415+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000366 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/096.out auth v1150 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000366:[<0x10000000403/096.out v394>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000366:[<0x10000000403/096.out v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.869 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.415+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000140f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/304 auth v1160 ap=1 s=2616 n(v0 b2616 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146c0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000140f:[<0x10000000403/304 v1138>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000140f:[<0x10000000403/304 v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.869 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.415+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011f6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/033 auth v1156 ap=1 s=1914 n(v0 b1914 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146c0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011f6:[<0x10000000403/033 v1118>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011f6:[<0x10000000403/033 v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.869 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.415+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011f4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/032 auth v1162 ap=1 s=2192 n(v0 b2192 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146b4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011f4:[<0x10000000403/032 v1114>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011f4:[<0x10000000403/032 v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.869 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.415+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001305 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/281 auth v1172 ap=1 s=1931 n(v0 b1931 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001305:[<0x10000000403/281 v1130>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001305:[<0x10000000403/281 v1172>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.869 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.416+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012bd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/209 auth v1168 ap=1 s=648 n(v0 b648 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c10b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012bd:[<0x10000000403/209 v1118>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012bd:[<0x10000000403/209 v1168>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.870 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.416+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/253 auth v1174 ap=1 s=1896 n(v0 b1896 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c11080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e9:[<0x10000000403/253 v1126>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012e9:[<0x10000000403/253 v1174>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.870 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.416+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/570 auth v1170 ap=1 s=1299 n(v0 b1299 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c11600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152a:[<0x10000000403/570 v1142>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000152a:[<0x10000000403/570 v1170>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.870 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.417+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001459 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/374.out auth v1166 ap=1 s=301 n(v0 b301 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001459:[<0x10000000403/374.out v1146>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001459:[<0x10000000403/374.out v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.870 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.417+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001436 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/343 auth v1166 ap=1 s=1775 n(v0 b1775 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c11b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001436:[<0x10000000403/343 v1130>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001436:[<0x10000000403/343 v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.871 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.417+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005c4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/524.out auth v1164 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c12100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005c4:[<0x10000000403/524.out v990>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005c4:[<0x10000000403/524.out v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.871 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.417+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/359.out auth v1156 ap=1 s=963 n(v0 b963 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c12680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000047a:[<0x10000000403/359.out v904>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000047a:[<0x10000000403/359.out v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.871 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.417+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/320.out auth v1148 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c12c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d3:[<0x10000000403/320.out v882>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008d3:[<0x10000000403/320.out v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.871 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.418+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000802 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/189.out auth v1144 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c13180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000802:[<0x10000000403/189.out v766>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000802:[<0x10000000403/189.out v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.871 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.419+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001245 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/094 auth v1172 ap=1 s=1130 n(v0 b1130 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c13700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001245:[<0x10000000403/094 v1114>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001245:[<0x10000000403/094 v1172>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.872 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.419+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/527.out auth v1160 ap=1 s=151 n(v0 b151 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914cfd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014fd:[<0x10000000403/527.out v1138>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014fd:[<0x10000000403/527.out v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.872 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.419+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/289 auth v1168 ap=1 s=1979 n(v0 b1979 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146c1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130d:[<0x10000000403/289 v1134>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000130d:[<0x10000000403/289 v1168>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.872 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.419+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/091.out auth v1150 ap=1 s=420 n(v0 b420 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914cfd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000035c:[<0x10000000403/091.out v374>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000035c:[<0x10000000403/091.out v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.872 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.420+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003fc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/171.out auth v1146 ap=1 s=244 n(v0 b244 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914cfdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003fc:[<0x10000000403/171.out v694>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003fc:[<0x10000000403/171.out v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.873 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.420+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000839 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/243.out auth v1154 ap=1 s=486 n(v0 b486 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914cfe100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000839:[<0x10000000403/243.out v834>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000839:[<0x10000000403/243.out v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.873 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.420+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ac [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/451 auth v1158 ap=1 s=1763 n(v0 rc2023-10-18T14:05:25.150992+0000 b1763 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914cfe680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ac:[<0x10000000403/451 v1134>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014ac:[<0x10000000403/451 v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.873 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.420+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/329.out auth v1154 ap=1 s=413 n(v0 b413 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639146c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000043e:[<0x10000000403/329.out v888>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000043e:[<0x10000000403/329.out v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.873 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.421+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/249 auth v1162 ap=1 s=990 n(v0 b990 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914cff180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e5:[<0x10000000403/249 v1122>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012e5:[<0x10000000403/249 v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.873 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.421+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000598 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/502.out auth v1152 ap=1 s=202 n(v0 b202 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914cfec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000598:[<0x10000000403/502.out v978>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000598:[<0x10000000403/502.out v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.874 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.421+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000859 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/259.out auth v1154 ap=1 s=486 n(v0 b486 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639152d9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000859:[<0x10000000403/259.out v850>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000859:[<0x10000000403/259.out v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.874 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.421+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/122.out auth v1138 ap=1 s=555 n(v0 b555 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639152d9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039a:[<0x10000000403/122.out v498>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000039a:[<0x10000000403/122.out v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.874 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.421+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/408 auth v1156 ap=1 s=1463 n(v0 b1463 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639152d9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000147d:[<0x10000000403/408 v1120>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000147d:[<0x10000000403/408 v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.874 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.421+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/005.out auth v1136 ap=1 s=126 n(v0 b126 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639152da680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a5:[<0x10000000403/005.out v20>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002a5:[<0x10000000403/005.out v1136>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.875 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.422+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000056e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/481.out auth v1142 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639152da100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000056e:[<0x10000000403/481.out v968>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000056e:[<0x10000000403/481.out v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.875 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.422+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000368 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/097.out auth v1152 ap=1 s=1196 n(v0 b1196 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639152dac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000368:[<0x10000000403/097.out v398>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000368:[<0x10000000403/097.out v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.875 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.422+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000586 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/493.out auth v1140 ap=1 s=167 n(v0 b167 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639152db700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000586:[<0x10000000403/493.out v972>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000586:[<0x10000000403/493.out v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.875 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.422+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/019.out auth v1144 ap=1 s=209 n(v0 b209 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d2c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002c1:[<0x10000000403/019.out v76>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002c1:[<0x10000000403/019.out v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.875 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.422+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000390 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/117.out auth v1146 ap=1 s=295 n(v0 b295 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d2cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000390:[<0x10000000403/117.out v478>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000390:[<0x10000000403/117.out v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.876 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.422+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000340 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/077.out auth v1132 ap=1 s=158 n(v0 b158 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d2c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000340:[<0x10000000403/077.out v318>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000340:[<0x10000000403/077.out v1132>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.876 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.423+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000472 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/355.out auth v1134 ap=1 s=331 n(v0 b331 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d2d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000472:[<0x10000000403/355.out v896>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000472:[<0x10000000403/355.out v1134>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.876 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.423+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000576 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/485.out auth v1160 ap=1 s=88 n(v0 b88 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639152db180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000576:[<0x10000000403/485.out v970>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000576:[<0x10000000403/485.out v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.876 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.423+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/379.out auth v1158 ap=1 s=2567 n(v0 b2567 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d2d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a2:[<0x10000000403/379.out v912>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004a2:[<0x10000000403/379.out v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.877 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.423+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/221 auth v1150 ap=1 s=664 n(v0 b664 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d2db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012c9:[<0x10000000403/221 v1116>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012c9:[<0x10000000403/221 v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.877 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.423+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/229.out auth v1130 ap=1 s=1546 n(v0 b1546 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d2e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081d:[<0x10000000403/229.out v828>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000081d:[<0x10000000403/229.out v1130>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.877 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.423+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001541 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/589 auth v1162 ap=1 s=4254 n(v0 b4254 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d2e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001541:[<0x10000000403/589 v1124>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001541:[<0x10000000403/589 v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.877 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.424+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/393 auth v1144 ap=1 s=3563 n(v0 b3563 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d58000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000146c:[<0x10000000403/393 v1118>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000146c:[<0x10000000403/393 v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.877 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.424+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001288 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/158 auth v1142 ap=1 s=3501 n(v0 b3501 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d58580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001288:[<0x10000000403/158 v1106>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001288:[<0x10000000403/158 v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.878 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.424+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/548.out auth v1130 ap=1 s=147 n(v0 b147 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d59080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008f3:[<0x10000000403/548.out v978>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008f3:[<0x10000000403/548.out v1130>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.878 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.424+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001543 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/591 auth v1148 ap=1 s=803 n(v0 b803 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d2ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001543:[<0x10000000403/591 v1128>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001543:[<0x10000000403/591 v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.878 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.424+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000556 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/469.out auth v1134 ap=1 s=245 n(v0 b245 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d58b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000556:[<0x10000000403/469.out v938>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000556:[<0x10000000403/469.out v1134>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.878 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.425+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ed [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/040.out auth v1124 ap=1 s=109 n(v0 b109 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d59600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ed:[<0x10000000403/040.out v164>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002ed:[<0x10000000403/040.out v1124>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.879 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.425+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014dc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/496 auth v1146 ap=1 s=1928 n(v0 rc2023-10-18T14:05:25.253990+0000 b1928 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d59b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014dc:[<0x10000000403/496 v1122>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014dc:[<0x10000000403/496 v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.879 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.425+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/115.out auth v1126 ap=1 s=378 n(v0 b378 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000038c:[<0x10000000403/115.out v470>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000038c:[<0x10000000403/115.out v1126>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.879 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.425+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/295.out auth v1128 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a1:[<0x10000000403/295.out v860>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008a1:[<0x10000000403/295.out v1128>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.879 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.426+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/016 auth v1132 ap=1 s=1226 n(v0 b1226 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e0:[<0x10000000403/016 v1098>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011e0:[<0x10000000403/016 v1132>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.880 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.426+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012df [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/243 auth v1138 ap=1 s=2147 n(v0 b2147 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012df:[<0x10000000403/243 v1110>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012df:[<0x10000000403/243 v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.880 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.426+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001449 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/360 auth v1140 ap=1 s=1005 n(v0 b1005 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001449:[<0x10000000403/360 v1114>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001449:[<0x10000000403/360 v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.880 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.426+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001251 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/106 auth v1136 ap=1 s=1788 n(v0 b1788 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001251:[<0x10000000403/106 v1102>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001251:[<0x10000000403/106 v1136>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.880 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.426+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000490 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/370.out auth v1126 ap=1 s=649 n(v0 b649 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000490:[<0x10000000403/370.out v894>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000490:[<0x10000000403/370.out v1126>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.880 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.427+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000800 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/188.out auth v1128 ap=1 s=505 n(v0 b505 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000800:[<0x10000000403/188.out v762>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000800:[<0x10000000403/188.out v1128>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.881 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.427+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000494 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/372.out auth v1120 ap=1 s=311 n(v0 b311 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000494:[<0x10000000403/372.out v896>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000494:[<0x10000000403/372.out v1120>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.881 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.427+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012be [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/210 auth v1140 ap=1 s=642 n(v0 b642 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012be:[<0x10000000403/210 v1100>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012be:[<0x10000000403/210 v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.881 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.427+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/315.out auth v1118 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c9:[<0x10000000403/315.out v864>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008c9:[<0x10000000403/315.out v1118>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.881 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.427+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/265 auth v1134 ap=1 s=1822 n(v0 b1822 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f5:[<0x10000000403/265 v1108>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012f5:[<0x10000000403/265 v1134>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.881 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.428+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/218 auth v1142 ap=1 s=2262 n(v0 b2262 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012c6:[<0x10000000403/218 v1104>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012c6:[<0x10000000403/218 v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.882 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.428+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000382 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/110.out auth v1132 ap=1 s=774 n(v0 b774 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000382:[<0x10000000403/110.out v450>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000382:[<0x10000000403/110.out v1132>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.882 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.428+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/396.out auth v1122 ap=1 s=673 n(v0 b673 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c4:[<0x10000000403/396.out v906>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004c4:[<0x10000000403/396.out v1122>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.882 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.428+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/583 auth v1136 ap=1 s=876 n(v0 b876 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d78000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153b:[<0x10000000403/583 v1116>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000153b:[<0x10000000403/583 v1136>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.882 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.428+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/246.out auth v1130 ap=1 s=124 n(v0 b124 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d78b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000083f:[<0x10000000403/246.out v834>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000083f:[<0x10000000403/246.out v1130>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.883 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.429+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003fa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/170.out auth v1124 ap=1 s=92 n(v0 b92 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d5f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003fa:[<0x10000000403/170.out v690>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003fa:[<0x10000000403/170.out v1124>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.883 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.429+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/446 auth v1140 ap=1 s=1737 n(v0 b1737 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d79080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a7:[<0x10000000403/446 v1110>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014a7:[<0x10000000403/446 v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.883 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.429+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/290 auth v1138 ap=1 s=2003 n(v0 b2003 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d78580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130e:[<0x10000000403/290 v1112>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000130e:[<0x10000000403/290 v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.883 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.429+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/003 auth v1128 ap=1 s=6519 n(v0 b6519 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d79b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d3:[<0x10000000403/003 v1094>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011d3:[<0x10000000403/003 v1128>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.884 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.430+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001233 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/078 auth v1134 ap=1 s=757 n(v0 rc2023-10-18T14:05:24.279010+0000 b757 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d79600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001233:[<0x10000000403/078 v1098>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001233:[<0x10000000403/078 v1134>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.884 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.430+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/237.out auth v1120 ap=1 s=91 n(v0 b91 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d7a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082d:[<0x10000000403/237.out v822>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000082d:[<0x10000000403/237.out v1120>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.884 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.430+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ef [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/514 auth v1136 ap=1 s=1073 n(v0 b1073 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d7a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ef:[<0x10000000403/514 v1114>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014ef:[<0x10000000403/514 v1136>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.884 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.430+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/136.out auth v1122 ap=1 s=849 n(v0 b849 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d7ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b6:[<0x10000000403/136.out v554>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003b6:[<0x10000000403/136.out v1122>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.885 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.430+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/319.out auth v1124 ap=1 s=314 n(v0 b314 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d7b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d1:[<0x10000000403/319.out v868>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008d1:[<0x10000000403/319.out v1124>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.885 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.430+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001532 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/575.out auth v1132 ap=1 s=125 n(v0 b125 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d7c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001532:[<0x10000000403/575.out v1118>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001532:[<0x10000000403/575.out v1132>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.885 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.431+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000053c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/456.out auth v1126 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d7cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000053c:[<0x10000000403/456.out v932>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000053c:[<0x10000000403/456.out v1126>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.885 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.431+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fe [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/274 auth v1130 ap=1 s=2490 n(v0 b2490 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d7c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fe:[<0x10000000403/274 v1102>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012fe:[<0x10000000403/274 v1130>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.886 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.432+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/405 auth v1138 ap=1 s=1471 n(v0 b1471 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d7b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000147a:[<0x10000000403/405 v1106>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000147a:[<0x10000000403/405 v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.886 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.432+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d60 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/258.out auth v1220 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f2db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d60:[<0x10000000d33/258.out v960>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d60:[<0x10000000d33/258.out v1220>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.886 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.432+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ce8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/204.out auth v1214 ap=1 s=315 n(v0 b315 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f2e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ce8:[<0x10000000d33/204.out v824>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ce8:[<0x10000000d33/204.out v1214>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.886 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.433+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c6a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/141.out auth v1212 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bcd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c6a:[<0x10000000d33/141.out v572>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c6a:[<0x10000000d33/141.out v1212>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.886 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.433+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cde [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/199.out auth v1214 ap=1 s=102 n(v0 b102 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914d48c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cde:[<0x10000000d33/199.out v804>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cde:[<0x10000000d33/199.out v1214>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.887 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.435+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f4a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/503.out auth v1208 ap=1 s=147 n(v0 b147 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914cb1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f4a:[<0x10000000d33/503.out v1066>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f4a:[<0x10000000d33/503.out v1208>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.887 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.435+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ea1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/418.out auth v1202 ap=1 s=85 n(v0 b85 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914cb1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ea1:[<0x10000000d33/418.out v1036>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ea1:[<0x10000000d33/418.out v1202>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.887 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.435+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d68 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/262.out auth v1212 ap=1 s=66 n(v0 b66 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914cb2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d68:[<0x10000000d33/262.out v962>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d68:[<0x10000000d33/262.out v1212>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.887 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.436+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c1c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/105.out auth v1238 ap=1 s=222 n(v0 b222 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ba0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c1c:[<0x10000000d33/105.out v428>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c1c:[<0x10000000d33/105.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.888 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.436+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/193.out auth v1200 ap=1 s=315 n(v0 b315 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914cb2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd2:[<0x10000000d33/193.out v780>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cd2:[<0x10000000d33/193.out v1200>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.888 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.436+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b58 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/009.out auth v1226 ap=1 s=3188 n(v0 b3188 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ba0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b58:[<0x10000000d33/009.out v36>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b58:[<0x10000000d33/009.out v1226>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.888 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.436+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f54 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/508.out auth v1232 ap=1 s=1149 n(v0 b1149 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ba1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f54:[<0x10000000d33/508.out v1086>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f54:[<0x10000000d33/508.out v1232>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.888 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.437+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e83 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/403.out auth v1254 ap=1 s=137 n(v0 b137 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914ba0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e83:[<0x10000000d33/403.out v1040>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e83:[<0x10000000d33/403.out v1254>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.888 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.437+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016fd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/006.out auth v1234 ap=1 s=294 n(v0 rc2023-10-18T14:05:25.737980+0000 b294 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bb2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016fd:[<0x10000000d33/006.out v1192>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016fd:[<0x10000000d33/006.out v1234>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.889 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.438+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d8e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/281.out auth v1244 ap=1 s=4143 n(v0 b4143 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bb4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d8e:[<0x10000000d33/281.out v986>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d8e:[<0x10000000d33/281.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.889 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.438+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ea7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/421.out auth v1260 ap=1 s=1375 n(v0 b1375 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b5b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ea7:[<0x10000000d33/421.out v1048>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ea7:[<0x10000000d33/421.out v1260>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.889 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.439+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e71 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/394.out auth v1230 ap=1 s=134 n(v0 b134 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bb3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e71:[<0x10000000d33/394.out v1034>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e71:[<0x10000000d33/394.out v1230>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.889 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.440+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c14 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/101.out auth v1286 ap=1 s=222 n(v0 b222 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b66580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c14:[<0x10000000d33/101.out v412>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c14:[<0x10000000d33/101.out v1286>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.890 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.440+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dfa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/335.out auth v1282 ap=1 s=164 n(v0 b164 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b67600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dfa:[<0x10000000d33/335.out v1002>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dfa:[<0x10000000d33/335.out v1282>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.890 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.442+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e0c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/344.out auth v1258 ap=1 s=315 n(v0 b315 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b68c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e0c:[<0x10000000d33/344.out v1006>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e0c:[<0x10000000d33/344.out v1258>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.890 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.442+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d20 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/231.out auth v1264 ap=1 s=582 n(v0 b582 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b69180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d20:[<0x10000000d33/231.out v936>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d20:[<0x10000000d33/231.out v1264>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.890 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.443+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b90 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/036.out auth v1256 ap=1 s=4426 n(v0 rc2023-10-18T14:05:15.055199+0000 b4426 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b69700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b90:[<0x10000000d33/036.out v148>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b90:[<0x10000000d33/036.out v1256>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.890 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.443+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ccc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/190.out auth v1262 ap=1 s=107 n(v0 b107 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b6e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ccc:[<0x10000000d33/190.out v768>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ccc:[<0x10000000d33/190.out v1262>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.891 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.444+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c9a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/165.out auth v1280 ap=1 s=119676 n(v0 b119676 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bb5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c9a:[<0x10000000d33/165.out v668>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c9a:[<0x10000000d33/165.out v1280>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.891 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.445+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ca8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/172.out auth v1272 ap=1 s=266 n(v0 b266 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b5ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ca8:[<0x10000000d33/172.out v696>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ca8:[<0x10000000d33/172.out v1272>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.891 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.446+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016ff [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/008 auth v1292 ap=1 s=2927 n(v0 rc2023-10-18T14:05:25.744980+0000 b2927 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bc0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016ff:[<0x10000000d33/008 v1212>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016ff:[<0x10000000d33/008 v1292>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.891 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.446+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b54 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/007.out auth v1276 ap=1 s=365 n(v0 b365 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bc1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b54:[<0x10000000d33/007.out v28>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b54:[<0x10000000d33/007.out v1276>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.892 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.447+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d4c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/248.out auth v1294 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bc2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d4c:[<0x10000000d33/248.out v960>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d4c:[<0x10000000d33/248.out v1294>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.892 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.448+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c42 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/121.out auth v1284 ap=1 s=297 n(v0 b297 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bc2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c42:[<0x10000000d33/121.out v492>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c42:[<0x10000000d33/121.out v1284>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.892 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.448+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bd0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/068.out auth v1256 ap=1 s=1736 n(v0 b1736 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bc3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bd0:[<0x10000000d33/068.out v276>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bd0:[<0x10000000d33/068.out v1256>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.892 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.450+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bc4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/062.out auth v1278 ap=1 s=117 n(v0 b117 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bcab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bc4:[<0x10000000d33/062.out v252>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bc4:[<0x10000000d33/062.out v1278>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.892 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.452+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e39 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/366.out auth v1258 ap=1 s=77 n(v0 b77 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bcc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e39:[<0x10000000d33/366.out v1020>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e39:[<0x10000000d33/366.out v1258>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.893 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.452+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d70 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/266.out auth v1272 ap=1 s=6401 n(v0 b6401 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bcc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d70:[<0x10000000d33/266.out v966>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d70:[<0x10000000d33/266.out v1272>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.893 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.452+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f2e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/489.out auth v1262 ap=1 s=85 n(v0 b85 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f2e:[<0x10000000d33/489.out v1070>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f2e:[<0x10000000d33/489.out v1262>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.893 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.454+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d1e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/230.out auth v1264 ap=1 s=525 n(v0 b525 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b6fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d1e:[<0x10000000d33/230.out v932>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d1e:[<0x10000000d33/230.out v1264>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.893 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.454+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dfc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/336.out auth v1288 ap=1 s=165 n(v0 b165 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914bc0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dfc:[<0x10000000d33/336.out v1004>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dfc:[<0x10000000d33/336.out v1288>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.894 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.454+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001706 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/015 auth v1276 ap=1 s=2235 n(v0 rc2023-10-18T14:05:25.769979+0000 b2235 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b70100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001706:[<0x10000000d33/015 v1204>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001706:[<0x10000000d33/015 v1276>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.894 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.455+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c66 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/139.out auth v1288 ap=1 s=220 n(v0 b220 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b70c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c66:[<0x10000000d33/139.out v564>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c66:[<0x10000000d33/139.out v1288>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.894 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.455+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f30 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/490.out auth v1262 ap=1 s=75 n(v0 b75 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b7f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f30:[<0x10000000d33/490.out v1086>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f30:[<0x10000000d33/490.out v1262>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.894 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.456+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d52 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/251.out auth v1258 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b7e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d52:[<0x10000000d33/251.out v962>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d52:[<0x10000000d33/251.out v1258>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.894 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.456+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d92 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/283.out auth v1260 ap=1 s=6254 n(v0 b6254 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b80680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d92:[<0x10000000d33/283.out v976>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d92:[<0x10000000d33/283.out v1260>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.895 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.457+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d62 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/259.out auth v1242 ap=1 s=897 n(v0 b897 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914cb3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d62:[<0x10000000d33/259.out v972>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d62:[<0x10000000d33/259.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.895 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.458+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/481.out auth v1220 ap=1 s=91 n(v0 b91 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914822580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f1f:[<0x10000000d33/481.out v1090>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f1f:[<0x10000000d33/481.out v1220>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.895 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.458+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c10 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/099.out auth v1270 ap=1 s=222 n(v0 b222 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b7fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c10:[<0x10000000d33/099.out v404>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c10:[<0x10000000d33/099.out v1270>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.895 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.458+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b50 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/005.out auth v1214 ap=1 s=146 n(v0 b146 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914822b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b50:[<0x10000000d33/005.out v20>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b50:[<0x10000000d33/005.out v1214>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.896 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.459+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c0c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/097.out auth v1228 ap=1 s=236 n(v0 b236 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914823080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c0c:[<0x10000000d33/097.out v396>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c0c:[<0x10000000d33/097.out v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.896 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.459+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000170c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/019.out auth v1230 ap=1 s=2525 n(v0 rc2023-10-18T14:05:25.798979+0000 b2525 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914824100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000170c:[<0x10000000d33/019.out v1200>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000170c:[<0x10000000d33/019.out v1230>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.896 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.459+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f27 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/485.out auth v1226 ap=1 s=95 n(v0 b95 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914823600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f27:[<0x10000000d33/485.out v1092>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f27:[<0x10000000d33/485.out v1226>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.896 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.460+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/077.out auth v1240 ap=1 s=473 n(v0 b473 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914824680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be3:[<0x10000000d33/077.out v314>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000be3:[<0x10000000d33/077.out v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.896 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.460+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e23 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/355.out auth v1216 ap=1 s=117 n(v0 b117 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914825700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e23:[<0x10000000d33/355.out v1018>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e23:[<0x10000000d33/355.out v1216>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.897 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.460+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f36 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/493.out auth v1234 ap=1 s=95 n(v0 b95 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914823b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f36:[<0x10000000d33/493.out v1094>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f36:[<0x10000000d33/493.out v1234>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.897 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.460+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e53 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/379.out auth v1238 ap=1 s=104 n(v0 b104 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914825180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e53:[<0x10000000d33/379.out v1034>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e53:[<0x10000000d33/379.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.897 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.461+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/117.out auth v1218 ap=1 s=236 n(v0 b236 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914824c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3a:[<0x10000000d33/117.out v476>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c3a:[<0x10000000d33/117.out v1218>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.897 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.461+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d1c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/229.out auth v1222 ap=1 s=74 n(v0 b74 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c52580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d1c:[<0x10000000d33/229.out v928>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d1c:[<0x10000000d33/229.out v1222>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.898 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.461+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f07 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/469.out auth v1246 ap=1 s=131 n(v0 b131 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b1f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f07:[<0x10000000d33/469.out v1072>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f07:[<0x10000000d33/469.out v1246>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.898 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.461+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b8a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/033.out.default auth v1242 ap=1 s=7634 n(v0 b7634 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b20100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b8a:[<0x10000000d33/033.out.default v136>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b8a:[<0x10000000d33/033.out.default v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.898 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.462+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b98 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/040.out auth v1238 ap=1 s=5177 n(v0 b5177 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b1fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b98:[<0x10000000d33/040.out v164>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b98:[<0x10000000d33/040.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.898 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.462+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001707 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/016 auth v1244 ap=1 s=7840 n(v0 rc2023-10-18T14:05:25.773979+0000 b7840 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b21700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001707:[<0x10000000d33/016 v1212>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001707:[<0x10000000d33/016 v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.898 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.462+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c36 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/115.out auth v1240 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b20c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c36:[<0x10000000d33/115.out v468>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c36:[<0x10000000d33/115.out v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.899 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.462+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000daa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/295.out auth v1252 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b21180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000daa:[<0x10000000d33/295.out v994>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000daa:[<0x10000000d33/295.out v1252>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.899 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.463+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cc8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/188.out auth v1218 ap=1 s=3008 n(v0 b3008 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c53080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cc8:[<0x10000000d33/188.out v760>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cc8:[<0x10000000d33/188.out v1218>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.899 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.463+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/315.out auth v1222 ap=1 s=493 n(v0 b493 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c53b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd2:[<0x10000000d33/315.out v998>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dd2:[<0x10000000d33/315.out v1222>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.899 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.464+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e75 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/396.out auth v1226 ap=1 s=149 n(v0 rc2023-10-18T14:05:15.622187+0000 b149 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c55700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e75:[<0x10000000d33/396.out v1040>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e75:[<0x10000000d33/396.out v1226>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.899 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.464+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c26 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/110.out auth v1232 ap=1 s=1059 n(v0 b1059 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c54c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c26:[<0x10000000d33/110.out v448>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c26:[<0x10000000d33/110.out v1232>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.900 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.465+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c0a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/096.out.internal auth v1254 ap=1 s=2196 n(v0 b2196 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b8b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c0a:[<0x10000000d33/096.out.internal v392>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c0a:[<0x10000000d33/096.out.internal v1254>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.900 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.467+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e41 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/370.out auth v1230 ap=1 s=91 n(v0 b91 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c52b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e41:[<0x10000000d33/370.out v1028>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e41:[<0x10000000d33/370.out v1230>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.900 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.467+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d48 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/246.out auth v1220 ap=1 s=149 n(v0 b149 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f2d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d48:[<0x10000000d33/246.out v968>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d48:[<0x10000000d33/246.out v1220>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.900 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.468+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d3c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/240.out auth v1280 ap=1 s=403 n(v0 b403 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b8d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d3c:[<0x10000000d33/240.out v960>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d3c:[<0x10000000d33/240.out v1280>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.901 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.468+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e45 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/372.out auth v1224 ap=1 s=85 n(v0 b85 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914c53600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e45:[<0x10000000d33/372.out v1030>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e45:[<0x10000000d33/372.out v1224>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.901 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.468+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d80 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/274.out auth v1264 ap=1 s=124 n(v0 b124 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b8bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d80:[<0x10000000d33/274.out v986>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d80:[<0x10000000d33/274.out v1264>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.901 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.468+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f34 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/492.out auth v1282 ap=1 s=78 n(v0 b78 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b94580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f34:[<0x10000000d33/492.out v1088>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f34:[<0x10000000d33/492.out v1282>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.901 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.469+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b9a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/041.out auth v1266 ap=1 s=507 n(v0 b507 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b94000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b9a:[<0x10000000d33/041.out v168>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b9a:[<0x10000000d33/041.out v1266>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.901 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.469+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d7c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/272.out auth v1256 ap=1 s=133 n(v0 b133 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b95080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d7c:[<0x10000000d33/272.out v980>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d7c:[<0x10000000d33/272.out v1256>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.902 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.469+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b8c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/034.out auth v1258 ap=1 s=67 n(v0 b67 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b94b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b8c:[<0x10000000d33/034.out v140>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b8c:[<0x10000000d33/034.out v1258>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.902 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.469+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d28 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/235.out auth v1270 ap=1 s=210 n(v0 b210 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b95600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d28:[<0x10000000d33/235.out v952>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d28:[<0x10000000d33/235.out v1270>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.902 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.469+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ba4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/046.out auth v1262 ap=1 s=1448 n(v0 b1448 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b95b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ba4:[<0x10000000d33/046.out v188>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ba4:[<0x10000000d33/046.out v1262>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.902 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.470+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000efb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/463.out auth v1278 ap=1 s=91 n(v0 b91 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b96680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000efb:[<0x10000000d33/463.out v1068>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000efb:[<0x10000000d33/463.out v1278>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.903 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.470+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000170a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.out auth v1276 ap=1 s=2093 n(v0 rc2023-10-18T14:05:25.787979+0000 b2093 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b96c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000170a:[<0x10000000d33/018.out v1208>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000170a:[<0x10000000d33/018.out v1276>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.903 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.470+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b9e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/043.out auth v1286 ap=1 s=5220 n(v0 b5220 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b97180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b9e:[<0x10000000d33/043.out v176>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b9e:[<0x10000000d33/043.out v1286>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.903 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.470+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000170d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/020 auth v1290 ap=1 s=1041 n(v0 rc2023-10-18T14:05:25.801979+0000 b1041 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b9e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000170d:[<0x10000000d33/020 v1212>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000170d:[<0x10000000d33/020 v1290>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.903 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.471+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b8e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/035.out auth v1260 ap=1 s=3736 n(v0 b3736 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b9eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b8e:[<0x10000000d33/035.out v144>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b8e:[<0x10000000d33/035.out v1260>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.903 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.471+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001703 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/012 auth v1268 ap=1 s=2697 n(v0 rc2023-10-18T14:05:25.759979+0000 b2697 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914b9f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001703:[<0x10000000d33/012 v1204>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001703:[<0x10000000d33/012 v1268>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.904 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.472+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016f9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/003 auth v1228 ap=1 s=1452 n(v0 rc2023-10-18T14:05:25.723980+0000 b1452 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f68b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016f9:[<0x10000000d33/003 v1196>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016f9:[<0x10000000d33/003 v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.904 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.472+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c60 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/136.out auth v1216 ap=1 s=145435 n(v0 b145435 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f69600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c60:[<0x10000000d33/136.out v552>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c60:[<0x10000000d33/136.out v1216>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.904 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.472+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d36 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/237.out auth v1214 ap=1 s=413 n(v0 b413 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f69080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d36:[<0x10000000d33/237.out v956>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d36:[<0x10000000d33/237.out v1214>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.904 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.472+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dda [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/319.out auth v1222 ap=1 s=461 n(v0 b461 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f69b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dda:[<0x10000000d33/319.out v1002>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dda:[<0x10000000d33/319.out v1222>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.905 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.473+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eed [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/456.out auth v1218 ap=1 s=71 n(v0 b71 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f6ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eed:[<0x10000000d33/456.out v1066>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000eed:[<0x10000000d33/456.out v1218>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.905 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.473+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001596 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/group auth v22 ap=1 s=9 n(v0 b9 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563915000000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001596:[<0x10000000d29/group v16>,<0x10000000135/perf v13668>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001596:[<0x10000000d29/group v22>,<0x10000000135/perf v18713>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.905 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.473+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001595 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/Makefile auth v18 ap=1 s=415 n(v0 b415 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f73700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001595:[<0x10000000d29/Makefile v14>,<0x10000000135/perf v13668>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001595:[<0x10000000d29/Makefile v18>,<0x10000000135/perf v18713>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.905 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.474+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b30 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/001.out auth v20 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563915000580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b30:[<0x10000000d29/001.out v4>,<0x10000000135/perf v13668>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b30:[<0x10000000d29/001.out v20>,<0x10000000135/perf v18713>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.905 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.474+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001594 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/001 auth v24 ap=1 s=1301 n(v0 b1301 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f73180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001594:[<0x10000000d29/001 v10>,<0x10000000135/perf v13668>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001594:[<0x10000000d29/001 v24>,<0x10000000135/perf v18713>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.906 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.474+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/008 auth v344 ap=1 s=2164 n(v0 b2164 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149c4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011a1:[<0x10000000304/008 v302>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011a1:[<0x10000000304/008 v344>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.906 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.474+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/007.out auth v332 ap=1 s=210 n(v0 b210 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149c5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000021d:[<0x10000000304/007.out v34>,<0x10000000135/ext4 v1518>,<0x100000005e4/tests v794>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000021d:[<0x10000000304/007.out v332>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.906 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.474+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011cc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/308 auth v350 ap=1 s=2462 n(v0 b2462 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149c5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011cc:[<0x10000000304/308 v326>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011cc:[<0x10000000304/308 v350>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.906 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.475+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011c6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/302 auth v352 ap=1 s=2265 n(v0 b2265 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149c6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011c6:[<0x10000000304/302 v322>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011c6:[<0x10000000304/302 v352>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.907 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.475+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000289 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/301.out auth v336 ap=1 s=54 n(v0 b54 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149c6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000289:[<0x10000000304/301.out v250>,<0x10000000135/ext4 v1518>,<0x100000005e4/tests v794>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000289:[<0x10000000304/301.out v336>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.907 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.475+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/010 auth v338 ap=1 s=2235 n(v0 b2235 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149c6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011a3:[<0x10000000304/010 v306>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011a3:[<0x10000000304/010 v338>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.907 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.475+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/011 auth v342 ap=1 s=1791 n(v0 b1791 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149c7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011a4:[<0x10000000304/011 v310>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011a4:[<0x10000000304/011 v342>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.907 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.475+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011b2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/025 auth v340 ap=1 s=1233 n(v0 b1233 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149c7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011b2:[<0x10000000304/025 v318>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011b2:[<0x10000000304/025 v340>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.907 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.476+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011cd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/Makefile auth v354 ap=1 s=429 n(v0 b429 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149e2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011cd:[<0x10000000304/Makefile v330>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011cd:[<0x10000000304/Makefile v354>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.908 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.476+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000257 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/036.out auth v334 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149e2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000257:[<0x10000000304/036.out v150>,<0x10000000135/ext4 v1518>,<0x100000005e4/tests v794>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000257:[<0x10000000304/036.out v334>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.908 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.476+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000119b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/002.out auth v346 ap=1 s=179 n(v0 b179 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149e2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000119b:[<0x10000000304/002.out v298>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000119b:[<0x10000000304/002.out v346>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.908 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.476+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000154b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/001 auth v24 ap=1 s=1855 n(v0 rc2023-10-18T14:05:25.517984+0000 b1855 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563915002100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000154b:[<0x10000000c2a/001 v10>,<0x10000000135/ocfs2 v13376>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000154b:[<0x10000000c2a/001 v24>,<0x10000000135/ocfs2 v18703>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.908 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.477+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001548 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/001 auth v20 ap=1 s=1716 n(v0 b1716 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563915000b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001548:[<0x10000000c28/001 v10>,<0x10000000135/nfs v13366>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001548:[<0x10000000c28/001 v20>,<0x10000000135/nfs v18333>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.909 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.477+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001549 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/Makefile auth v22 ap=1 s=412 n(v0 b412 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563915001080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001549:[<0x10000000c28/Makefile v14>,<0x10000000135/nfs v13366>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001549:[<0x10000000c28/Makefile v22>,<0x10000000135/nfs v18333>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.909 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.478+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000154a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/group auth v24 ap=1 s=200 n(v0 b200 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563915001600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000154a:[<0x10000000c28/group v16>,<0x10000000135/nfs v13366>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000154a:[<0x10000000c28/group v24>,<0x10000000135/nfs v18333>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.909 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.478+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000154c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/Makefile auth v20 ap=1 s=412 n(v0 b412 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563915002680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000154c:[<0x10000000c2a/Makefile v14>,<0x10000000135/ocfs2 v13376>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000154c:[<0x10000000c2a/Makefile v20>,<0x10000000135/ocfs2 v18703>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.909 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.478+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a64 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/001.out auth v18 ap=1 s=29 n(v0 b29 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563915001b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a64:[<0x10000000c28/001.out v4>,<0x10000000135/nfs v13366>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000a64:[<0x10000000c28/001.out v18>,<0x10000000135/nfs v18333>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.909 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.479+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000154d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/group auth v22 ap=1 s=21 n(v0 b21 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563915002c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000154d:[<0x10000000c2a/group v16>,<0x10000000135/ocfs2 v13376>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000154d:[<0x10000000c2a/group v22>,<0x10000000135/ocfs2 v18703>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.910 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.479+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a66 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/001.out auth v18 ap=1 s=621 n(v0 b621 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563915003180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a66:[<0x10000000c2a/001.out v4>,<0x10000000135/ocfs2 v13376>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000a66:[<0x10000000c2a/001.out v18>,<0x10000000135/ocfs2 v18703>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.910 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.479+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001597 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/002 auth v40 ap=1 s=2937 n(v0 b2937 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f47600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001597:[<0x10000000d2d/002 v18>,<0x10000000135/shared v13686>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001597:[<0x10000000d2d/002 v40>,<0x10000000135/shared v18085>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.910 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.479+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001598 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/032 auth v48 ap=1 s=2425 n(v0 b2425 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f47b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001598:[<0x10000000d2d/032 v22>,<0x10000000135/shared v13686>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001598:[<0x10000000d2d/032 v48>,<0x10000000135/shared v18085>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.910 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.479+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001599 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/298 auth v46 ap=1 s=5848 n(v0 b5848 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f48100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001599:[<0x10000000d2d/298 v26>,<0x10000000135/shared v13686>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001599:[<0x10000000d2d/298 v46>,<0x10000000135/shared v18085>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.911 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.480+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b42 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/298.out auth v36 ap=1 s=182 n(v0 b182 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f48680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b42:[<0x10000000d2d/298.out v12>,<0x10000000135/shared v13686>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b42:[<0x10000000d2d/298.out v36>,<0x10000000135/shared v18085>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.911 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.480+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000159a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/Makefile auth v42 ap=1 s=435 n(v0 b435 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f48c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000159a:[<0x10000000d2d/Makefile v30>,<0x10000000135/shared v13686>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000159a:[<0x10000000d2d/Makefile v42>,<0x10000000135/shared v18085>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.911 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.480+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b3e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/002.out auth v34 ap=1 s=48481 n(v0 b48481 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f49180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b3e:[<0x10000000d2d/002.out v4>,<0x10000000135/shared v13686>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b3e:[<0x10000000d2d/002.out v34>,<0x10000000135/shared v18085>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.911 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.480+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000159b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/group auth v44 ap=1 s=234 n(v0 b234 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f49700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000159b:[<0x10000000d2d/group v32>,<0x10000000135/shared v13686>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000159b:[<0x10000000d2d/group v44>,<0x10000000135/shared v18085>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.911 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.480+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011b1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/024 auth v348 ap=1 s=1828 n(v0 b1828 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5639149c5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011b1:[<0x10000000304/024 v314>,<0x10000000135/ext4 v10828>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011b1:[<0x10000000304/024 v348>,<0x10000000135/ext4 v18963>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.912 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:05:42.481+0000 7ff0d2a67700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b40 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/032.out auth v38 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x563914f4e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b40:[<0x10000000d2d/032.out v8>,<0x10000000135/shared v13686>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b40:[<0x10000000d2d/032.out v38>,<0x10000000135/shared v18085>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.912 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.394+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/448 auth v1142 ap=1 s=894 n(v0 b894 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8396f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a9:[<0x10000000403/448 v1114>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014a9:[<0x10000000403/448 v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.913 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.394+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001226 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/065 auth v1144 ap=1 s=5187 n(v0 b5187 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83970680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001226:[<0x10000000403/065 v1090>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001226:[<0x10000000403/065 v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.913 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.394+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000372 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/102.out auth v1132 ap=1 s=1055 n(v0 b1055 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83970100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000372:[<0x10000000403/102.out v418>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000372:[<0x10000000403/102.out v1132>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.913 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.394+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000149f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/439 auth v1158 ap=1 s=1777 n(v0 rc2023-10-18T14:05:25.122993+0000 b1777 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8396fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000149f:[<0x10000000403/439 v1110>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000149f:[<0x10000000403/439 v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.913 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.395+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/586 auth v1156 ap=1 s=934 n(v0 b934 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83970c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153e:[<0x10000000403/586 v1130>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000153e:[<0x10000000403/586 v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.914 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.382+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000646 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/rc.sysinit auth v10 ap=1 s=1055 n(v0 b1055 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01cb6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000646:[<0x10000000024/rc.sysinit v4>,<0x100000005e4/crash v314>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000646:[<0x10000000024/rc.sysinit v10>,<0x100000005e4/crash v3552>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.914 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.383+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000025 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/README auth v8 ap=1 s=5195 n(v0 b5195 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01cb6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000025:[<0x10000000024/README v2>,<0x100000005e4/crash v314>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000025:[<0x10000000024/README v8>,<0x100000005e4/crash v3552>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.914 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.383+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001173 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/iogen.c auth v54 ap=1 s=44056 n(v0 b44056 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ad0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001173:[<0x1000000002c/iogen.c v38>,<0x100000005e4/ltp v1215>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001173:[<0x1000000002c/iogen.c v54>,<0x100000005e4/ltp v3548>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.915 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.383+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000671 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/growfiles.c auth v42 ap=1 s=77176 n(v0 b77176 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ad1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000671:[<0x1000000002c/growfiles.c v14>,<0x100000005e4/ltp v418>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000671:[<0x1000000002c/growfiles.c v42>,<0x100000005e4/ltp v3548>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.915 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.383+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001170 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/doio.c auth v50 ap=1 s=84350 n(v0 rc2023-10-18T14:05:22.820040+0000 b84350 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ad1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001170:[<0x1000000002c/doio.c v26>,<0x100000005e4/ltp v1215>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001170:[<0x1000000002c/doio.c v50>,<0x100000005e4/ltp v3548>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.915 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.396+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001492 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/428 auth v1140 ap=1 s=900 n(v0 rc2023-10-18T14:05:25.095993+0000 b900 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83971180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001492:[<0x10000000403/428 v1106>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001492:[<0x10000000403/428 v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.916 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.396+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000516 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/437.out auth v1062 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838e6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000516:[<0x10000000403/437.out v920>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000516:[<0x10000000403/437.out v1062>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.916 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.397+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001514 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/550 auth v1148 ap=1 s=866 n(v0 b866 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83971700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001514:[<0x10000000403/550 v1126>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001514:[<0x10000000403/550 v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.916 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.397+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/540.out auth v1058 ap=1 s=622 n(v0 b622 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008e3:[<0x10000000403/540.out v960>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008e3:[<0x10000000403/540.out v1058>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.916 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.397+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000486 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/365.out auth v1054 ap=1 s=380 n(v0 b380 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838e6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000486:[<0x10000000403/365.out v886>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000486:[<0x10000000403/365.out v1054>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.916 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.397+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001485 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/416 auth v1068 ap=1 s=1811 n(v0 b1811 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838e7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001485:[<0x10000000403/416 v1032>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001485:[<0x10000000403/416 v1068>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.917 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.384+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/Makefile auth v56 ap=1 s=1109 n(v0 b1109 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ae6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116f:[<0x1000000002c/Makefile v22>,<0x100000005e4/ltp v1215>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000116f:[<0x1000000002c/Makefile v56>,<0x100000005e4/ltp v3548>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.917 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.384+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001172 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/fsx.c auth v48 ap=1 s=65709 n(v0 rc2023-10-18T14:05:22.826040+0000 b65709 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ae6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001172:[<0x1000000002c/fsx.c v34>,<0x100000005e4/ltp v1215>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001172:[<0x1000000002c/fsx.c v48>,<0x100000005e4/ltp v3548>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.917 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.385+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001171 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/fsstress.c auth v52 ap=1 s=113770 n(v0 rc2023-10-18T14:05:22.823040+0000 b113770 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ae7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001171:[<0x1000000002c/fsstress.c v30>,<0x100000005e4/ltp v1215>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001171:[<0x1000000002c/fsstress.c v52>,<0x100000005e4/ltp v3548>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.918 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.397+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ee [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/164.out auth v1050 ap=1 s=109 n(v0 b109 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83848000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ee:[<0x10000000403/164.out v666>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003ee:[<0x10000000403/164.out v1050>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.918 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.398+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001450 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/367 auth v1074 ap=1 s=1220 n(v0 b1220 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838e7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001450:[<0x10000000403/367 v1028>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001450:[<0x10000000403/367 v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.918 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.398+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001301 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/277 auth v1072 ap=1 s=1073 n(v0 b1073 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83849080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001301:[<0x10000000403/277 v1020>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001301:[<0x10000000403/277 v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.919 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.398+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003aa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/130.out auth v1056 ap=1 s=16291 n(v0 b16291 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83848580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003aa:[<0x10000000403/130.out v530>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003aa:[<0x10000000403/130.out v1056>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.919 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.398+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000057c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/488.out auth v1076 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83848b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000057c:[<0x10000000403/488.out v936>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000057c:[<0x10000000403/488.out v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.919 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.385+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000673 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/rwtest.sh auth v46 ap=1 s=6605 n(v0 b6605 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ae6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000673:[<0x1000000002c/rwtest.sh v18>,<0x100000005e4/ltp v418>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000673:[<0x1000000002c/rwtest.sh v46>,<0x100000005e4/ltp v3548>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.920 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.386+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/doio.h auth v44 ap=1 s=4982 n(v0 b4982 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ae7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000066e:[<0x1000000002c/doio.h v8>,<0x100000005e4/ltp v418>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000066e:[<0x1000000002c/doio.h v44>,<0x100000005e4/ltp v3548>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.920 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.386+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/aio-stress.c auth v40 ap=1 s=38493 n(v0 b38493 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01ae7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000066c:[<0x1000000002c/aio-stress.c v4>,<0x100000005e4/ltp v418>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000066c:[<0x1000000002c/aio-stress.c v40>,<0x100000005e4/ltp v3548>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.920 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.386+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000120d [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/ auth v43 ap=1 f(v0 m2023-10-18T14:05:22.754041+0000 6=1+5) n(v4 rc2023-10-18T14:05:22.801040+0000 b635813 139=125+14) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000120d:[<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x1000000120d:[<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.754041+0000 6=1+5)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.801040+0000 b635813 139=125+14)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.754041+0000 6=1+5)","memory_value.rstat":"n(v4 rc2023-10-18T14:05:22.801040+0000 b635813 139=125+14)","error_str":""},"return_code":0} 2023-10-18T14:05:42.920 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.387+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000120c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/Makefile auth v33 ap=1 s=215 n(v0 b215 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000120c:[<0x1000000120b/Makefile v2>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000120c:[<0x1000000120b/Makefile v33>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.921 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.398+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001413 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/308 auth v1060 ap=1 s=1434 n(v0 b1434 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83849b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001413:[<0x10000000403/308 v1024>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001413:[<0x10000000403/308 v1060>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.921 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.398+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001538 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/580 auth v1078 ap=1 s=3143 n(v0 b3143 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83849600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001538:[<0x10000000403/580 v1040>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001538:[<0x10000000403/580 v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.921 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.399+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/186 auth v1066 ap=1 s=3807 n(v0 b3807 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8384a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a5:[<0x10000000403/186 v1012>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012a5:[<0x10000000403/186 v1066>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.922 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.399+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/345.out auth v1044 ap=1 s=1491 n(v0 b1491 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8384b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000045e:[<0x10000000403/345.out v876>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000045e:[<0x10000000403/345.out v1044>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.922 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.399+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/237 auth v1070 ap=1 s=1140 n(v0 b1140 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8384b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d9:[<0x10000000403/237 v1016>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012d9:[<0x10000000403/237 v1070>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.923 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.387+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/repair auth v264 ap=1 s=4162 n(v0 b4162 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd016ff700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f7:[<0x10000000020/repair v218>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010f7:[<0x10000000020/repair v264>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.923 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.388+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/README auth v35 ap=1 s=346 n(v0 rc2023-10-18T14:05:22.720042+0000 b346 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fd:[<0x1000000120b/README v4>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010fd:[<0x1000000120b/README v35>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.923 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.388+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010eb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filter.btrfs auth v276 ap=1 s=3554 n(v0 b3554 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01803b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010eb:[<0x10000000020/filter.btrfs v170>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010eb:[<0x10000000020/filter.btrfs v276>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.923 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.388+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/report auth v286 ap=1 s=5000 n(v0 b5000 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01803600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f8:[<0x10000000020/report v222>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010f8:[<0x10000000020/report v286>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.924 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.388+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmlogwrites auth v266 ap=1 s=4963 n(v0 b4963 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01803080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e5:[<0x10000000020/dmlogwrites v146>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010e5:[<0x10000000020/dmlogwrites v266>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.924 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.389+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000634 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/perf auth v240 ap=1 s=937 n(v0 b937 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01802580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000634:[<0x10000000020/perf v64>,<0x100000005e4/common v298>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000634:[<0x10000000020/perf v240>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.924 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.389+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmerror auth v302 ap=1 s=2132 n(v0 b2132 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01804100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e3:[<0x10000000020/dmerror v138>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010e3:[<0x10000000020/dmerror v302>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.924 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.389+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000621 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmhugedisk auth v242 ap=1 s=1098 n(v0 b1098 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01804c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000621:[<0x10000000020/dmhugedisk v26>,<0x100000005e4/common v298>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000621:[<0x10000000020/dmhugedisk v242>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.925 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.390+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/xfs auth v312 ap=1 s=25020 n(v0 b25020 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd006bbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fb:[<0x10000000020/xfs v234>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010fb:[<0x10000000020/xfs v312>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.925 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.390+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/scsi_debug auth v292 ap=1 s=1757 n(v0 b1757 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01804680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f9:[<0x10000000020/scsi_debug v226>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010f9:[<0x10000000020/scsi_debug v292>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.925 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.390+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/verity auth v294 ap=1 s=6585 n(v0 b6585 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd016fcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fa:[<0x10000000020/verity v230>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010fa:[<0x10000000020/verity v294>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.925 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.391+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010df [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/casefold auth v258 ap=1 s=2061 n(v0 b2061 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01802b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010df:[<0x10000000020/casefold v124>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010df:[<0x10000000020/casefold v258>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.925 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.391+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000062f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/locktest auth v244 ap=1 s=1856 n(v0 b1856 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01627700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000062f:[<0x10000000020/locktest v54>,<0x100000005e4/common v298>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000062f:[<0x10000000020/locktest v244>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.926 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.391+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/config auth v300 ap=1 s=24608 n(v0 b24608 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0189e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e0:[<0x10000000020/config v128>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010e0:[<0x10000000020/config v300>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.926 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.400+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000396 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/120.out auth v1052 ap=1 s=245 n(v0 b245 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8384a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000396:[<0x10000000403/120.out v490>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000396:[<0x10000000403/120.out v1052>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.927 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.400+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/066.out auth v1042 ap=1 s=242 n(v0 b242 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8384ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000032a:[<0x10000000403/066.out v274>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000032a:[<0x10000000403/066.out v1042>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.927 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.400+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/413.out auth v1046 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83862000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e6:[<0x10000000403/413.out v910>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004e6:[<0x10000000403/413.out v1046>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.927 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.400+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/198 auth v1076 ap=1 s=816 n(v0 b816 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a41b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b1:[<0x10000000403/198 v1024>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012b1:[<0x10000000403/198 v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.927 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.401+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a2d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/579.out auth v1048 ap=1 s=43 n(v0 rc2023-10-18T14:05:14.652207+0000 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83862b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a2d:[<0x10000000403/579.out v990>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000a2d:[<0x10000000403/579.out v1048>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.928 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.401+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/219 auth v1074 ap=1 s=3025 n(v0 b3025 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a41600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012c7:[<0x10000000403/219 v1028>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012c7:[<0x10000000403/219 v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.928 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.401+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/523 auth v1064 ap=1 s=991 n(v0 b991 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83862580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f8:[<0x10000000403/523 v1036>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014f8:[<0x10000000403/523 v1064>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.928 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.401+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/298.out auth v1084 ap=1 s=177 n(v0 b177 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a42680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a7:[<0x10000000403/298.out v868>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008a7:[<0x10000000403/298.out v1084>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.928 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.402+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000468 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/350.out auth v1060 ap=1 s=244 n(v0 b244 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a43180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000468:[<0x10000000403/350.out v898>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000468:[<0x10000000403/350.out v1060>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.928 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.402+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/042.out auth v1068 ap=1 s=336 n(v0 b336 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a42100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f1:[<0x10000000403/042.out v172>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002f1:[<0x10000000403/042.out v1068>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.929 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.402+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001484 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/415 auth v1080 ap=1 s=1922 n(v0 b1922 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a42c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001484:[<0x10000000403/415 v1048>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001484:[<0x10000000403/415 v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.929 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.391+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filestreams auth v274 ap=1 s=4773 n(v0 b4773 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01805180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e9:[<0x10000000020/filestreams v162>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010e9:[<0x10000000020/filestreams v274>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.929 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.391+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/encrypt auth v296 ap=1 s=25372 n(v0 b25372 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01805700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e8:[<0x10000000020/encrypt v158>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010e8:[<0x10000000020/encrypt v296>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.930 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.391+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/rc auth v268 ap=1 s=98998 n(v0 rc2023-10-18T14:05:22.700042+0000 b98998 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0189e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f4:[<0x10000000020/rc v206>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010f4:[<0x10000000020/rc v268>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.930 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.392+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dump auth v308 ap=1 s=36228 n(v0 rc2023-10-18T14:05:22.673043+0000 b36228 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0189eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e7:[<0x10000000020/dump v154>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010e7:[<0x10000000020/dump v308>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.930 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.392+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000061a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/cgroup2 auth v248 ap=1 s=493 n(v0 b493 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0189f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000061a:[<0x10000000020/cgroup2 v12>,<0x100000005e4/common v298>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000061a:[<0x10000000020/cgroup2 v248>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.930 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.392+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000632 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/nfs auth v246 ap=1 s=794 n(v0 b794 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000632:[<0x10000000020/nfs v60>,<0x100000005e4/common v298>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000632:[<0x10000000020/nfs v246>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.931 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.392+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmflakey auth v252 ap=1 s=2790 n(v0 rc2023-10-18T14:05:22.666043+0000 b2790 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e4:[<0x10000000020/dmflakey v142>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010e4:[<0x10000000020/dmflakey v252>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.931 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.393+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/punch auth v280 ap=1 s=17202 n(v0 b17202 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f2:[<0x10000000020/punch v198>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010f2:[<0x10000000020/punch v280>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.931 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.393+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/renameat2 auth v282 ap=1 s=2497 n(v0 b2497 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0189f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f6:[<0x10000000020/renameat2 v214>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010f6:[<0x10000000020/renameat2 v282>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.931 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.393+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000021 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/Makefile auth v250 ap=1 s=305 n(v0 rc2023-10-18T14:05:08.498334+0000 b305 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0189fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000021:[<0x10000000020/Makefile v2>,<0x100000005e4/common v298>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000021:[<0x10000000020/Makefile v250>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.932 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.403+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000141c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/317 auth v1082 ap=1 s=2295 n(v0 rc2023-10-18T14:05:24.836998+0000 b2295 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce830b6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000141c:[<0x10000000403/317 v1036>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000141c:[<0x10000000403/317 v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.932 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.403+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000374 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/103.out auth v1066 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8379a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000374:[<0x10000000403/103.out v422>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000374:[<0x10000000403/103.out v1066>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.932 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.403+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000126f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/136 auth v1072 ap=1 s=3854 n(v0 b3854 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce82ff6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000126f:[<0x10000000403/136 v1016>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000126f:[<0x10000000403/136 v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.932 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.403+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000141d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/318 auth v1088 ap=1 s=2631 n(v0 b2631 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8379a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000141d:[<0x10000000403/318 v1040>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000141d:[<0x10000000403/318 v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.933 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.403+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/456 auth v1086 ap=1 s=1461 n(v0 b1461 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a43700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b1:[<0x10000000403/456 v1052>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014b1:[<0x10000000403/456 v1086>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.933 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.403+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/527 auth v1092 ap=1 s=2014 n(v0 b2014 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8379ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014fc:[<0x10000000403/527 v1056>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014fc:[<0x10000000403/527 v1092>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.933 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.404+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/151.out auth v1062 ap=1 s=276 n(v0 b276 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8379b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d4:[<0x10000000403/151.out v614>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003d4:[<0x10000000403/151.out v1062>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.933 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.404+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000088b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/284.out auth v1058 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8379b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000088b:[<0x10000000403/284.out v858>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000088b:[<0x10000000403/284.out v1058>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.934 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.404+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ad [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/194 auth v1064 ap=1 s=2055 n(v0 rc2023-10-18T14:05:24.518005+0000 b2055 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8379c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ad:[<0x10000000403/194 v1020>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012ad:[<0x10000000403/194 v1064>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.934 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.405+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001476 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/402 auth v1090 ap=1 s=2761 n(v0 b2761 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8379cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001476:[<0x10000000403/402 v1044>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001476:[<0x10000000403/402 v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.934 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.393+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ea [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filter auth v272 ap=1 s=17279 n(v0 rc2023-10-18T14:05:22.679043+0000 b17279 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ea:[<0x10000000020/filter v166>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010ea:[<0x10000000020/filter v272>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.935 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.394+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmdelay auth v260 ap=1 s=1892 n(v0 b1892 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e2:[<0x10000000020/dmdelay v134>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010e2:[<0x10000000020/dmdelay v260>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.935 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.394+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ef [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/module auth v278 ap=1 s=2588 n(v0 b2588 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018ec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ef:[<0x10000000020/module v186>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010ef:[<0x10000000020/module v278>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.935 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.394+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmapi auth v262 ap=1 s=813 n(v0 b813 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018ecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e1:[<0x10000000020/dmapi v130>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010e1:[<0x10000000020/dmapi v262>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.935 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.394+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/reflink auth v290 ap=1 s=11834 n(v0 b11834 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018ed080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f5:[<0x10000000020/reflink v210>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010f5:[<0x10000000020/reflink v290>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.935 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.394+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010de [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/btrfs auth v270 ap=1 s=10819 n(v0 b10819 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018ec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010de:[<0x10000000020/btrfs v120>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010de:[<0x10000000020/btrfs v270>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.936 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.394+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ec [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/fuzzy auth v288 ap=1 s=8728 n(v0 rc2023-10-18T14:05:22.683043+0000 b8728 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018ed600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ec:[<0x10000000020/fuzzy v174>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010ec:[<0x10000000020/fuzzy v288>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.936 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.395+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000063f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/test_names auth v236 ap=1 s=312 n(v0 b312 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018edb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000063f:[<0x10000000020/test_names v86>,<0x100000005e4/common v298>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000063f:[<0x10000000020/test_names v236>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.936 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.395+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/quota auth v256 ap=1 s=9460 n(v0 b9460 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018ee680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f3:[<0x10000000020/quota v202>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010f3:[<0x10000000020/quota v256>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.936 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.395+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmthin auth v306 ap=1 s=7528 n(v0 b7528 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018eec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e6:[<0x10000000020/dmthin v150>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010e6:[<0x10000000020/dmthin v306>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.937 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.396+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/overlay auth v254 ap=1 s=9026 n(v0 b9026 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018ef180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f0:[<0x10000000020/overlay v190>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010f0:[<0x10000000020/overlay v254>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.937 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.405+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001264 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/125 auth v1078 ap=1 s=1130 n(v0 b1130 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8379c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001264:[<0x10000000403/125 v1012>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001264:[<0x10000000403/125 v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.937 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.405+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/433.out auth v1082 ap=1 s=751 n(v0 b751 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aa2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000050e:[<0x10000000403/433.out v932>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000050e:[<0x10000000403/433.out v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.937 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.405+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/270 auth v1070 ap=1 s=2037 n(v0 b2037 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8379bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fa:[<0x10000000403/270 v1032>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012fa:[<0x10000000403/270 v1070>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.938 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.406+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000144d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/364 auth v1088 ap=1 s=1398 n(v0 b1398 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aa2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000144d:[<0x10000000403/364 v1048>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000144d:[<0x10000000403/364 v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.938 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.406+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/076.out auth v1076 ap=1 s=94 n(v0 b94 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aa3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000033e:[<0x10000000403/076.out v314>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000033e:[<0x10000000403/076.out v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.938 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.406+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014be [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/469 auth v1096 ap=1 s=3086 n(v0 b3086 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aa3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014be:[<0x10000000403/469 v1056>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014be:[<0x10000000403/469 v1096>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.938 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.406+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/305.out auth v1078 ap=1 s=376 n(v0 b376 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aa3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b5:[<0x10000000403/305.out v874>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008b5:[<0x10000000403/305.out v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.939 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.407+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000909 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/559.out auth v1072 ap=1 s=70 n(v0 b70 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aa4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000909:[<0x10000000403/559.out v994>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000909:[<0x10000000403/559.out v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.939 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.407+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000121d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/056 auth v1098 ap=1 s=2193 n(v0 b2193 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aa4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000121d:[<0x10000000403/056 v1028>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000121d:[<0x10000000403/056 v1098>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.939 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.407+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/472 auth v1102 ap=1 s=1678 n(v0 b1678 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aa5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c2:[<0x10000000403/472 v1060>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014c2:[<0x10000000403/472 v1102>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.939 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.407+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001443 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/354 auth v1080 ap=1 s=893 n(v0 b893 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aa5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001443:[<0x10000000403/354 v1044>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001443:[<0x10000000403/354 v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.940 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.396+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000120a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/attr auth v304 ap=1 s=6713 n(v0 rc2023-10-18T14:05:22.654043+0000 b6713 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018ee100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000120a:[<0x10000000020/attr v116>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000120a:[<0x10000000020/attr v304>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.940 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.396+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ed [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/inject auth v284 ap=1 s=3381 n(v0 b3381 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ed:[<0x10000000020/inject v178>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010ed:[<0x10000000020/inject v284>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.940 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.396+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/populate auth v298 ap=1 s=26946 n(v0 rc2023-10-18T14:05:22.693042+0000 b26946 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f1:[<0x10000000020/populate v194>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010f1:[<0x10000000020/populate v298>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.940 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.396+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ee [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/log auth v310 ap=1 s=15716 n(v0 b15716 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018ef700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ee:[<0x10000000020/log v182>,<0x100000005e4/common v1171>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010ee:[<0x10000000020/log v310>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.941 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.397+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000023 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/configs/example.config auth v8 ap=1 s=391 n(v0 b391 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01d63700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000023:[<0x10000000022/example.config v2>,<0x100000005e4/configs v304>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000023:[<0x10000000022/example.config v8>,<0x100000005e4/configs v1710>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.941 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.397+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000061c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/defrag auth v238 ap=1 s=4131 n(v0 rc2023-10-18T14:05:08.499333+0000 b4131 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000061c:[<0x10000000020/defrag v16>,<0x100000005e4/common v298>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000061c:[<0x10000000020/defrag v238>,<0x100000005e4/common v3554>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.941 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.397+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000644 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/configs/localhost.config auth v6 ap=1 s=286 n(v0 b286 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01cb9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000644:[<0x10000000022/localhost.config v4>,<0x100000005e4/configs v304>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000644:[<0x10000000022/localhost.config v6>,<0x100000005e4/configs v1710>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.941 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.398+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001c [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/ auth v30 ap=1 f(v0 m2023-10-18T14:05:22.648043+0000 3=3+0) n(v0 rc2023-10-18T14:05:22.648043+0000 b4375 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c9ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000001c:[<0x1000000001a/rpm v10>,<0x100000005e4/build v200>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x1000000001c:[<0x1000000001a/rpm v30>,<0x100000005e4/build v3556>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.648043+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.648043+0000 b4375 4=3+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.648043+0000 3=3+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:22.648043+0000 b4375 4=3+1)","error_str":""},"return_code":0} 2023-10-18T14:05:42.941 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.398+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001e [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/tar/ auth v28 ap=1 f(v0 m2023-10-18T14:05:08.494334+0000 1=1+0) n(v0 rc2023-10-18T14:05:08.495334+0000 b544 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c9a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000001e:[<0x1000000001a/tar v14>,<0x100000005e4/build v200>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x1000000001e:[<0x1000000001a/tar v28>,<0x100000005e4/build v3556>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:08.494334+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:08.495334+0000 b544 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:08.494334+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:08.495334+0000 b544 2=1+1)","error_str":""},"return_code":0} 2023-10-18T14:05:42.942 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.398+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/Makefile auth v22 ap=1 s=1419 n(v0 rc2023-10-18T14:05:08.490334+0000 b1419 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c9a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000001b:[<0x1000000001a/Makefile v2>,<0x100000005e4/build v200>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000001b:[<0x1000000001a/Makefile v22>,<0x100000005e4/build v3556>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.942 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.408+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/180.out auth v1068 ap=1 s=461 n(v0 b461 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aa4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f0:[<0x10000000403/180.out v730>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000007f0:[<0x10000000403/180.out v1068>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.943 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.408+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001424 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/325 auth v1090 ap=1 s=2466 n(v0 b2466 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83990000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001424:[<0x10000000403/325 v1040>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001424:[<0x10000000403/325 v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.943 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.408+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000427 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/218.out auth v1070 ap=1 s=112 n(v0 b112 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83991080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000427:[<0x10000000403/218.out v816>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000427:[<0x10000000403/218.out v1070>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.943 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.409+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000123e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/088 auth v1100 ap=1 s=763 n(v0 b763 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83990580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000123e:[<0x10000000403/088 v1032>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000123e:[<0x10000000403/088 v1100>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.943 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.409+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/518.out auth v1074 ap=1 s=360 n(v0 b360 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83990b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005b8:[<0x10000000403/518.out v974>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005b8:[<0x10000000403/518.out v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.943 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.409+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fe [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/528 auth v1094 ap=1 s=1286 n(v0 b1286 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83991b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014fe:[<0x10000000403/528 v1064>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014fe:[<0x10000000403/528 v1094>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.944 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.410+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000055c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/472.out auth v1092 ap=1 s=62 n(v0 b62 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83991600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000055c:[<0x10000000403/472.out v956>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000055c:[<0x10000000403/472.out v1092>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.944 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.410+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ae [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/453 auth v1084 ap=1 s=9156 n(v0 b9156 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83992680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ae:[<0x10000000403/453 v1052>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014ae:[<0x10000000403/453 v1084>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.944 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.410+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000030e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/052.out auth v1066 ap=1 s=488 n(v0 b488 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83992100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000030e:[<0x10000000403/052.out v218>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000030e:[<0x10000000403/052.out v1066>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.944 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.410+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/246 auth v1086 ap=1 s=827 n(v0 b827 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83992c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e2:[<0x10000000403/246 v1036>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012e2:[<0x10000000403/246 v1086>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.945 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.399+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/interop auth v54 ap=1 s=2084 n(v0 b2084 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c5f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d1:[<0x10000001208/interop v20>,<0x100000005e4/tools v1019>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010d1:[<0x10000001208/interop v54>,<0x100000005e4/tools v3560>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.945 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.400+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010cb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/compare-failures auth v60 ap=1 s=1253 n(v0 b1253 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c60680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010cb:[<0x10000001208/compare-failures v8>,<0x100000005e4/tools v1019>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010cb:[<0x10000001208/compare-failures v60>,<0x100000005e4/tools v3560>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.945 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.400+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010cf [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/fs-walk auth v66 ap=1 s=1907 n(v0 b1907 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c60c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010cf:[<0x10000001208/fs-walk v16>,<0x100000005e4/tools v1019>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010cf:[<0x10000001208/fs-walk v66>,<0x100000005e4/tools v3560>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.945 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.401+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010cd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/db-walk auth v62 ap=1 s=3659 n(v0 rc2023-10-18T14:05:16.352172+0000 b3659 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c61700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010cd:[<0x10000001208/db-walk v12>,<0x100000005e4/tools v1019>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010cd:[<0x10000001208/db-walk v62>,<0x100000005e4/tools v3560>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.946 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.401+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000008 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/info/ auth v4 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFs@2},l=25030 | importingcaps=0 dirfrag=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55fd0178e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000008:[<0x10000000006/info v4>,<0x100000005e5/objects v134>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x10000000008:[<0x10000000006/info v4>,<0x100000005e5/objects v203>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":0} 2023-10-18T14:05:42.946 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.401+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001209 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/README.auto-qa auth v50 ap=1 s=2542 n(v0 rc2023-10-18T14:05:16.351172+0000 b2542 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c61180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001209:[<0x10000001208/README.auto-qa v2>,<0x100000005e4/tools v1019>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001209:[<0x10000001208/README.auto-qa v50>,<0x100000005e4/tools v3560>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.946 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.402+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/ag-wipe auth v52 ap=1 s=4858 n(v0 b4858 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c6c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c9:[<0x10000001208/ag-wipe v4>,<0x100000005e4/tools v1019>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010c9:[<0x10000001208/ag-wipe v52>,<0x100000005e4/tools v3560>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.946 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.402+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack/ auth{2=1,3=1,4=1} v42 ap=1 f(v0 m2023-10-18T14:05:08.471334+0000 2=2+0) n(v0 rc2023-10-18T14:05:08.471334+0000 b12877962 3=2+1) (inest mix) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 authpin=1 discoverbase=0 scrubqueue=0 0x55fd016fd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000007:[<0x10000000006/pack v42>,<0x100000005e5/objects v134>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x10000000007:[<0x10000000006/pack v42>,<0x100000005e5/objects v203>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:08.471334+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:08.471334+0000 b12877962 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:08.471334+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:08.471334+0000 b12877962 3=2+1)","error_str":""},"return_code":0} 2023-10-18T14:05:42.947 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.402+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ee [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample auth v40 ap=1 s=416 n(v0 b416 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0178f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005ee:[<0x100000007de/pre-merge-commit.sample v16>,<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005ee:[<0x100000007de/pre-merge-commit.sample v40>,<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.947 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.403+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ef [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample auth v34 ap=1 s=4655 n(v0 b4655 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0178fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005ef:[<0x100000007de/fsmonitor-watchman.sample v18>,<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005ef:[<0x100000007de/fsmonitor-watchman.sample v34>,<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.947 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.403+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ec [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample auth v44 ap=1 s=4898 n(v0 b4898 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01790680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005ec:[<0x100000007de/pre-rebase.sample v12>,<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005ec:[<0x100000007de/pre-rebase.sample v44>,<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.947 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.411+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001307 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/283 auth v1076 ap=1 s=2223 n(v0 b2223 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce82fc0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001307:[<0x10000000403/283 v1036>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001307:[<0x10000000403/283 v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.948 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.411+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000891 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/287.out auth v1054 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce82fc1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000891:[<0x10000000403/287.out v860>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000891:[<0x10000000403/287.out v1054>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.948 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.411+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014cf [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/484.out auth v1080 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce839fc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014cf:[<0x10000000403/484.out v1052>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014cf:[<0x10000000403/484.out v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.948 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.411+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/377.out auth v1066 ap=1 s=287 n(v0 b287 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce839fc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049e:[<0x10000000403/377.out v914>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000049e:[<0x10000000403/377.out v1066>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.948 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.412+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000578 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/486.out auth v1064 ap=1 s=87 n(v0 b87 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce82fc1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000578:[<0x10000000403/486.out v964>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000578:[<0x10000000403/486.out v1064>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.949 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.412+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000492 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/371.out auth v1060 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce839fcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000492:[<0x10000000403/371.out v908>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000492:[<0x10000000403/371.out v1060>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.949 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.413+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/478 auth v1078 ap=1 s=8582 n(v0 b8582 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce82fc0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c8:[<0x10000000403/478 v1048>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014c8:[<0x10000000403/478 v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.949 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.413+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000905 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/557.out auth v1070 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce839fd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000905:[<0x10000000403/557.out v992>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000905:[<0x10000000403/557.out v1070>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.949 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.413+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000421 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/215.out auth v1084 ap=1 s=109 n(v0 b109 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce839fe100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000421:[<0x10000000403/215.out v814>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000421:[<0x10000000403/215.out v1084>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.949 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.413+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/098.out auth v1056 ap=1 s=723 n(v0 b723 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce839fdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000036a:[<0x10000000403/098.out v402>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000036a:[<0x10000000403/098.out v1056>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.950 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.413+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001204 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/046 auth v1068 ap=1 s=1779 n(v0 rc2023-10-18T14:05:24.217011+0000 b1779 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce839fec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001204:[<0x10000000403/046 v1028>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001204:[<0x10000000403/046 v1068>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.950 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.403+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005f2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample auth v28 ap=1 s=544 n(v0 b544 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01790c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005f2:[<0x100000007de/pre-receive.sample v24>,<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005f2:[<0x100000007de/pre-receive.sample v28>,<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.950 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.404+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007df [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample auth v48 ap=1 s=1492 n(v0 rc2023-10-18T14:05:06.468375+0000 b1492 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01791180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007df:[<0x100000007de/prepare-commit-msg.sample v2>,<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007df:[<0x100000007de/prepare-commit-msg.sample v48>,<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.951 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.404+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample auth v50 ap=1 s=1643 n(v0 b1643 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0178f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005e9:[<0x100000007de/pre-commit.sample v6>,<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005e9:[<0x100000007de/pre-commit.sample v50>,<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.951 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.404+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005eb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample auth v52 ap=1 s=896 n(v0 b896 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01790100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005eb:[<0x100000007de/commit-msg.sample v10>,<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005eb:[<0x100000007de/commit-msg.sample v52>,<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.951 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.405+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ea [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/update.sample auth v46 ap=1 s=3650 n(v0 b3650 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01791700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005ea:[<0x100000007de/update.sample v8>,<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005ea:[<0x100000007de/update.sample v46>,<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.952 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.414+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ca [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/146.out auth v1062 ap=1 s=942 n(v0 b942 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce839ff180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ca:[<0x10000000403/146.out v594>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003ca:[<0x10000000403/146.out v1062>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.952 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.414+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/307.out auth v1082 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce839ff700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b9:[<0x10000000403/307.out v878>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008b9:[<0x10000000403/307.out v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.952 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.414+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/200.out auth v1086 ap=1 s=505 n(v0 rc2023-10-18T14:05:09.843306+0000 b505 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83164580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008e0:[<0x10000000403/200.out v810>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000008e0:[<0x10000000403/200.out v1086>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.952 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.415+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000144f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/366 auth v1088 ap=1 s=1196 n(v0 b1196 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83164b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000144f:[<0x10000000403/366 v1044>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000144f:[<0x10000000403/366 v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.952 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.415+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001417 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/312 auth v1072 ap=1 s=1037 n(v0 b1037 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce839fd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001417:[<0x10000000403/312 v1040>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001417:[<0x10000000403/312 v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.953 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.415+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000861 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/263.out auth v1058 ap=1 s=149 n(v0 b149 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83165080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000861:[<0x10000000403/263.out v846>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000861:[<0x10000000403/263.out v1058>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.953 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.415+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000148d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/423 auth v1170 ap=1 s=3728 n(v0 b3728 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83803600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000148d:[<0x10000000403/423 v1126>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000148d:[<0x10000000403/423 v1170>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.953 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.416+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/440.out auth v1154 ap=1 s=338 n(v0 b338 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83803080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a1:[<0x10000000403/440.out v1130>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014a1:[<0x10000000403/440.out v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.954 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.405+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample auth v38 ap=1 s=1374 n(v0 b1374 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd017ac000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005e8:[<0x100000007de/pre-push.sample v4>,<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005e8:[<0x100000007de/pre-push.sample v38>,<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.954 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.405+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005f0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample auth v32 ap=1 s=424 n(v0 b424 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd017ac580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005f0:[<0x100000007de/pre-applypatch.sample v20>,<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005f0:[<0x100000007de/pre-applypatch.sample v32>,<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.954 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.416+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000041b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/212.out auth v1150 ap=1 s=81 n(v0 b81 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83803b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000041b:[<0x10000000403/212.out v820>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000041b:[<0x10000000403/212.out v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.954 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.416+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/004.out auth v1148 ap=1 s=237 n(v0 b237 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83804100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a3:[<0x10000000403/004.out v16>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002a3:[<0x10000000403/004.out v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.955 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.405+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ed [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample auth v30 ap=1 s=189 n(v0 b189 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd017ad080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005ed:[<0x100000007de/post-update.sample v14>,<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005ed:[<0x100000007de/post-update.sample v30>,<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.955 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.406+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005f1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample auth v42 ap=1 s=478 n(v0 b478 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd017ad600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005f1:[<0x100000007de/applypatch-msg.sample v22>,<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005f1:[<0x100000007de/applypatch-msg.sample v42>,<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.955 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.406+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000014 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/HEAD auth v18 ap=1 s=415 n(v0 rc2023-10-18T14:05:28.416925+0000 b415 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd017adb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000014:[<0x1000000000e/HEAD v6>,<0x100000005e5/logs v171>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000014:[<0x1000000000e/HEAD v18>,<0x100000005e5/logs v282>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.956 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.416+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005de [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/537.out auth v1144 ap=1 s=106 n(v0 b106 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83804680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005de:[<0x10000000403/537.out v998>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005de:[<0x10000000403/537.out v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.956 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.416+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000143a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/347 auth v1162 ap=1 s=1277 n(v0 b1277 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83804c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000143a:[<0x10000000403/347 v1114>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000143a:[<0x10000000403/347 v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.956 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.417+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ab [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/008.out auth v1142 ap=1 s=18914 n(v0 b18914 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83805180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ab:[<0x10000000403/008.out v32>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002ab:[<0x10000000403/008.out v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.957 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.406+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000f [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/ auth v25 ap=1 f(v0 m2023-10-18T14:05:08.448335+0000 2=0+2) n(v2 rc2023-10-18T14:05:08.450334+0000 b392 6=2+4) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd017ae100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000000f:[<0x1000000000e/refs v8>,<0x100000005e5/logs v171>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x1000000000f:[<0x1000000000e/refs v25>,<0x100000005e5/logs v282>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:08.448335+0000 2=0+2)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:08.450334+0000 b392 6=2+4)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:08.448335+0000 2=0+2)","memory_value.rstat":"n(v2 rc2023-10-18T14:05:08.450334+0000 b392 6=2+4)","error_str":""},"return_code":0} 2023-10-18T14:05:42.957 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.407+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e2 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/tags/ auth v4 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@2},l=25030 | importingcaps=0 dirfrag=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55fd01988b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000007e2:[<0x100000007e0/tags v4>,<0x100000005e5/refs v156>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x100000007e2:[<0x100000007e0/tags v4>,<0x100000005e5/refs v280>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":0} 2023-10-18T14:05:42.958 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.417+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/250 auth v1166 ap=1 s=2079 n(v0 b2079 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83805700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e6:[<0x10000000403/250 v1110>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012e6:[<0x10000000403/250 v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.958 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.417+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/411.out auth v1146 ap=1 s=219 n(v0 b219 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832f6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e2:[<0x10000000403/411.out v928>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004e2:[<0x10000000403/411.out v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.958 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.418+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/232 auth v1090 ap=1 s=1397 n(v0 rc2023-10-18T14:05:24.618003+0000 b1397 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce839fe680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d4:[<0x10000000403/232 v1032>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012d4:[<0x10000000403/232 v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.958 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.418+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/009 auth v1074 ap=1 s=1388 n(v0 b1388 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83164000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d9:[<0x10000000403/009 v1024>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011d9:[<0x10000000403/009 v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.958 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.418+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000544 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/460.out auth v1156 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832f7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000544:[<0x10000000403/460.out v954>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000544:[<0x10000000403/460.out v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.959 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.407+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007dd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/info/exclude auth v4 ap=1 s=240 n(v0 rc2023-10-18T14:05:06.466375+0000 b240 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01988580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007dd:[<0x100000007dc/exclude v2>,<0x100000005e5/info v8>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007dd:[<0x100000007dc/exclude v4>,<0x100000005e5/info v232>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.959 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.407+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e1 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/heads/ auth v23 ap=1 f(v0 m2023-10-18T14:05:08.450334+0000 1=1+0) n(v1 rc2023-10-18T14:05:08.450334+0000 b41 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01989080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000007e1:[<0x100000007e0/heads v14>,<0x100000005e5/refs v156>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x100000007e1:[<0x100000007e0/heads v23>,<0x100000005e5/refs v280>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:08.450334+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:08.450334+0000 b41 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:08.450334+0000 1=1+0)","memory_value.rstat":"n(v1 rc2023-10-18T14:05:08.450334+0000 b41 2=1+1)","error_str":""},"return_code":0} 2023-10-18T14:05:42.959 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.409+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001439 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/346 auth v1174 ap=1 s=827 n(v0 b827 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0228f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001439:[<0x10000000403/346 v1116>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001439:[<0x10000000403/346 v1174>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.960 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.419+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001446 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/357 auth v1168 ap=1 s=1145 n(v0 b1145 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832f7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001446:[<0x10000000403/357 v1118>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001446:[<0x10000000403/357 v1168>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.960 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.419+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/002 auth v1160 ap=1 s=1415 n(v0 b1415 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832f8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d2:[<0x10000000403/002 v1106>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011d2:[<0x10000000403/002 v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.960 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.419+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/011.out auth v1136 ap=1 s=121 n(v0 b121 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832f7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b1:[<0x10000000403/011.out v44>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002b1:[<0x10000000403/011.out v1136>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.961 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.409+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001499 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/434 auth v1176 ap=1 s=1578 n(v0 b1578 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0228e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001499:[<0x10000000403/434 v1128>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001499:[<0x10000000403/434 v1176>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.961 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.409+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005f3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample auth v36 ap=1 s=2783 n(v0 b2783 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd017acb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005f3:[<0x100000007de/push-to-checkout.sample v26>,<0x100000005e5/hooks v36>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005f3:[<0x100000007de/push-to-checkout.sample v36>,<0x100000005e5/hooks v270>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.961 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.420+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001479 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/404.out auth v1164 ap=1 s=20339 n(v0 b20339 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832f6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001479:[<0x10000000403/404.out v1122>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001479:[<0x10000000403/404.out v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.962 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.420+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/270.out auth v1140 ap=1 s=143 n(v0 rc2023-10-18T14:05:11.245277+0000 b143 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832f6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086f:[<0x10000000403/270.out v860>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000086f:[<0x10000000403/270.out v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.962 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.410+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000318 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/057.out auth v1138 ap=1 s=503 n(v0 b503 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0228eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000318:[<0x10000000403/057.out v238>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000318:[<0x10000000403/057.out v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.962 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.412+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000b [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes/ auth v25 ap=1 f(v0 m2023-10-18T14:05:08.435335+0000 1=0+1) n(v1 rc2023-10-18T14:05:08.442335+0000 b32 3=1+2) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01989600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000000b:[<0x100000007e0/remotes v8>,<0x100000005e5/refs v156>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x1000000000b:[<0x100000007e0/remotes v25>,<0x100000005e5/refs v280>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:08.435335+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:08.442335+0000 b32 3=1+2)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:08.435335+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-10-18T14:05:08.442335+0000 b32 3=1+2)","error_str":""},"return_code":0} 2023-10-18T14:05:42.962 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.412+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/382.out auth v1142 ap=1 s=447 n(v0 b447 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0228f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a8:[<0x10000000403/382.out v896>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004a8:[<0x10000000403/382.out v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.963 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.420+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005be [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/521.out auth v1158 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832f8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005be:[<0x10000000403/521.out v986>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005be:[<0x10000000403/521.out v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.963 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.420+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/541 auth v1152 ap=1 s=2779 n(v0 b2779 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832f8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000150b:[<0x10000000403/541 v1134>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000150b:[<0x10000000403/541 v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.963 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.420+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ce [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/529.out auth v1138 ap=1 s=66 n(v0 b66 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce832f9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005ce:[<0x10000000403/529.out v994>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005ce:[<0x10000000403/529.out v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.964 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.412+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001462 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/383 auth v1172 ap=1 s=1771 n(v0 b1771 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0228fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001462:[<0x10000000403/383 v1120>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001462:[<0x10000000403/383 v1172>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.964 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.412+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/264 auth v1146 ap=1 s=1875 n(v0 b1875 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02290100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f4:[<0x10000000403/264 v1100>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012f4:[<0x10000000403/264 v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.965 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.420+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/520 auth v1152 ap=1 s=3884 n(v0 b3884 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8379d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f5:[<0x10000000403/520 v1132>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014f5:[<0x10000000403/520 v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.965 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.421+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000564 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/476.out auth v1144 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8379d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000564:[<0x10000000403/476.out v942>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000564:[<0x10000000403/476.out v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.965 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.421+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001500 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/530 auth v1156 ap=1 s=1759 n(v0 b1759 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836c6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001500:[<0x10000000403/530 v1140>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001500:[<0x10000000403/530 v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.965 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.421+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/323.out auth v1148 ap=1 s=288 n(v0 b288 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836c7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d9:[<0x10000000403/323.out v870>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008d9:[<0x10000000403/323.out v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.966 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.421+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000127f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/149 auth v1158 ap=1 s=4108 n(v0 b4108 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836c6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000127f:[<0x10000000403/149 v1100>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000127f:[<0x10000000403/149 v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.966 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.412+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001428 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/329 auth v1156 ap=1 s=2015 n(v0 b2015 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02290680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001428:[<0x10000000403/329 v1112>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001428:[<0x10000000403/329 v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.966 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.413+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000151d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/558 auth v1154 ap=1 s=1710 n(v0 b1710 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02291180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000151d:[<0x10000000403/558 v1136>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000151d:[<0x10000000403/558 v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.967 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.413+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014bb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/466 auth v1158 ap=1 s=2447 n(v0 b2447 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02290c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014bb:[<0x10000000403/466 v1132>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014bb:[<0x10000000403/466 v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.967 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.422+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/503 auth v1162 ap=1 s=1845 n(v0 b1845 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836c6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e4:[<0x10000000403/503 v1128>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014e4:[<0x10000000403/503 v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.967 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.422+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001461 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/382 auth v1146 ap=1 s=2216 n(v0 rc2023-10-18T14:05:24.992995+0000 b2216 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836c7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001461:[<0x10000000403/382 v1112>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001461:[<0x10000000403/382 v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.968 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.422+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/487 auth v1168 ap=1 s=1992 n(v0 b1992 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836c8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d2:[<0x10000000403/487 v1120>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014d2:[<0x10000000403/487 v1168>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.968 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.413+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000127b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/145 auth v1168 ap=1 s=4404 n(v0 b4404 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02291700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000127b:[<0x10000000403/145 v1096>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000127b:[<0x10000000403/145 v1168>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.968 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.416+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000528 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/446.out auth v1144 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02252000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000528:[<0x10000000403/446.out v940>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000528:[<0x10000000403/446.out v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.968 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.416+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001303 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/279 auth v1160 ap=1 s=1954 n(v0 b1954 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02253080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001303:[<0x10000000403/279 v1104>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001303:[<0x10000000403/279 v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.969 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.422+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001254 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/109 auth v1172 ap=1 s=1432 n(v0 rc2023-10-18T14:05:24.342009+0000 b1432 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836c8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001254:[<0x10000000403/109 v1096>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001254:[<0x10000000403/109 v1172>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.969 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.422+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ff [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/529 auth v1170 ap=1 s=838 n(v0 b838 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836c8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ff:[<0x10000000403/529 v1136>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014ff:[<0x10000000403/529 v1170>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.969 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.423+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ee [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/179.out auth v1164 ap=1 s=462 n(v0 b462 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836c7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ee:[<0x10000000403/179.out v726>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000007ee:[<0x10000000403/179.out v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.970 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.416+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001421 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/322 auth v1162 ap=1 s=1974 n(v0 b1974 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02252580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001421:[<0x10000000403/322 v1108>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001421:[<0x10000000403/322 v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.970 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.417+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/368.out auth v1148 ap=1 s=269 n(v0 b269 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02253b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048c:[<0x10000000403/368.out v886>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000048c:[<0x10000000403/368.out v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.971 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.423+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012de [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/242 auth v1154 ap=1 s=2123 n(v0 b2123 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8364e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012de:[<0x10000000403/242 v1104>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012de:[<0x10000000403/242 v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.971 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.423+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001310 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/292 auth v1160 ap=1 s=1994 n(v0 b1994 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836c9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001310:[<0x10000000403/292 v1108>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001310:[<0x10000000403/292 v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.971 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.423+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000825 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/233.out auth v1142 ap=1 s=96 n(v0 b96 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8364eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000825:[<0x10000000403/233.out v818>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000825:[<0x10000000403/233.out v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.971 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.424+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ea [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/162.out auth v1150 ap=1 s=107 n(v0 rc2023-10-18T14:05:09.651310+0000 b107 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836c9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ea:[<0x10000000403/162.out v658>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003ea:[<0x10000000403/162.out v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.972 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.424+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000149b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/435.out auth v1166 ap=1 s=103 n(v0 b103 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8364e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000149b:[<0x10000000403/435.out v1116>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000149b:[<0x10000000403/435.out v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.972 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.417+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000053a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/455.out auth v1140 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02254680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000053a:[<0x10000000403/455.out v946>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000053a:[<0x10000000403/455.out v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.972 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.418+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/509.out auth v1152 ap=1 s=120 n(v0 b120 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02255180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005a6:[<0x10000000403/509.out v982>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005a6:[<0x10000000403/509.out v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.973 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.418+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ae [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/385.out auth v1164 ap=1 s=68034 n(v0 b68034 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02253600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ae:[<0x10000000403/385.out v900>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004ae:[<0x10000000403/385.out v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.973 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.419+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000514 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/436.out auth v1150 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02252b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000514:[<0x10000000403/436.out v932>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000514:[<0x10000000403/436.out v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.973 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.419+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000089b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/292.out auth v1148 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01deeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000089b:[<0x10000000403/292.out v848>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000089b:[<0x10000000403/292.out v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.973 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.419+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/443 auth v1176 ap=1 s=1084 n(v0 b1084 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01def080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a4:[<0x10000000403/443 v1124>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014a4:[<0x10000000403/443 v1176>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.974 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.419+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000917 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/566.out auth v1146 ap=1 s=95 n(v0 b95 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01def600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000917:[<0x10000000403/566.out v1008>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000917:[<0x10000000403/566.out v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.974 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.420+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/409 auth v1166 ap=1 s=3757 n(v0 b3757 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02254100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000147e:[<0x10000000403/409 v1124>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000147e:[<0x10000000403/409 v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.974 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.420+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001512 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/548 auth v1168 ap=1 s=790 n(v0 b790 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01df0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001512:[<0x10000000403/548 v1140>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001512:[<0x10000000403/548 v1168>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.974 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.421+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000590 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/498.out auth v1170 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02254c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000590:[<0x10000000403/498.out v972>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000590:[<0x10000000403/498.out v1170>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.975 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.421+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012af [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/196 auth v1180 ap=1 s=1930 n(v0 rc2023-10-18T14:05:24.523005+0000 b1930 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01df0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012af:[<0x10000000403/196 v1100>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012af:[<0x10000000403/196 v1180>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.975 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.421+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/449.out auth v1150 ap=1 s=36 n(v0 b36 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01df0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000052e:[<0x10000000403/449.out v944>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000052e:[<0x10000000403/449.out v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.975 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.422+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001263 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/124 auth v1184 ap=1 s=1390 n(v0 b1390 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01df1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001263:[<0x10000000403/124 v1092>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001263:[<0x10000000403/124 v1184>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.975 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.424+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000572 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/483.out auth v1126 ap=1 s=205 n(v0 b205 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83af5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000572:[<0x10000000403/483.out v948>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000572:[<0x10000000403/483.out v1126>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.976 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.424+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/501 auth v1174 ap=1 s=1843 n(v0 b1843 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8364f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e1:[<0x10000000403/501 v1124>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014e1:[<0x10000000403/501 v1174>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.976 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.424+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000942 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/590.out auth v1134 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83af6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000942:[<0x10000000403/590.out v1000>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000942:[<0x10000000403/590.out v1134>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.976 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.425+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/369.out auth v1120 ap=1 s=977 n(v0 rc2023-10-18T14:05:11.424274+0000 b977 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83af6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048e:[<0x10000000403/369.out v892>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000048e:[<0x10000000403/369.out v1120>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.976 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.425+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000057a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/487.out auth v1146 ap=1 s=115 n(v0 b115 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83af6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000057a:[<0x10000000403/487.out v952>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000057a:[<0x10000000403/487.out v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.977 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.425+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/474 auth v1144 ap=1 s=1892 n(v0 b1892 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83af7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c4:[<0x10000000403/474 v1106>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014c4:[<0x10000000403/474 v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.977 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.425+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/037.out auth v1124 ap=1 s=7025 n(v0 b7025 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83afc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e7:[<0x10000000403/037.out v152>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002e7:[<0x10000000403/037.out v1124>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.977 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.425+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/297.out auth v1118 ap=1 s=177 n(v0 b177 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83af7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a5:[<0x10000000403/297.out v862>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008a5:[<0x10000000403/297.out v1118>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.977 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.426+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001290 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/166 auth v1154 ap=1 s=1924 n(v0 b1924 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83afc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001290:[<0x10000000403/166 v1090>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001290:[<0x10000000403/166 v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.977 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.426+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ec [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/256 auth v1142 ap=1 s=2746 n(v0 b2746 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83afcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ec:[<0x10000000403/256 v1102>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012ec:[<0x10000000403/256 v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.978 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.422+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005bc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/520.out auth v1144 ap=1 s=2723 n(v0 b2723 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01df1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005bc:[<0x10000000403/520.out v992>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005bc:[<0x10000000403/520.out v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.978 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.422+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000087f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/278.out auth v1152 ap=1 s=320 n(v0 b320 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e28580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000087f:[<0x10000000403/278.out v838>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000087f:[<0x10000000403/278.out v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.978 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.425+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001238 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/083 auth v1182 ap=1 s=2022 n(v0 b2022 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e29600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001238:[<0x10000000403/083 v1088>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001238:[<0x10000000403/083 v1182>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.979 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.425+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000059c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/504.out auth v1142 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e28000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000059c:[<0x10000000403/504.out v978>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000059c:[<0x10000000403/504.out v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.979 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.425+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/516 auth v1160 ap=1 s=2336 n(v0 b2336 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e29080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f1:[<0x10000000403/516 v1136>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014f1:[<0x10000000403/516 v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.979 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.426+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000121e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/057 auth v1178 ap=1 s=2675 n(v0 b2675 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01defb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000121e:[<0x10000000403/057 v1084>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000121e:[<0x10000000403/057 v1178>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.979 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.426+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ca [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/480 auth v1166 ap=1 s=1662 n(v0 b1662 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e28b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ca:[<0x10000000403/480 v1132>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014ca:[<0x10000000403/480 v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.979 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.426+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/424.out auth v1154 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e29b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004fc:[<0x10000000403/424.out v926>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004fc:[<0x10000000403/424.out v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.980 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.426+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001488 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/419 auth v1156 ap=1 s=1777 n(v0 b1777 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e2a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001488:[<0x10000000403/419 v1120>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001488:[<0x10000000403/419 v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.980 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.427+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001487 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/418 auth v1158 ap=1 s=2391 n(v0 b2391 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e2a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001487:[<0x10000000403/418 v1116>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001487:[<0x10000000403/418 v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.980 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.427+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000140c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/301 auth v1162 ap=1 s=2114 n(v0 b2114 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e2ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000140c:[<0x10000000403/301 v1112>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000140c:[<0x10000000403/301 v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.981 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.426+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000388 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/113.out auth v1128 ap=1 s=683 n(v0 b683 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83afd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000388:[<0x10000000403/113.out v462>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000388:[<0x10000000403/113.out v1128>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.981 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.426+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000448 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/334.out auth v1138 ap=1 s=102 n(v0 b102 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83afd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000448:[<0x10000000403/334.out v876>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000448:[<0x10000000403/334.out v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.981 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.427+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/244.out auth v1122 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83afdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000083b:[<0x10000000403/244.out v832>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000083b:[<0x10000000403/244.out v1122>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.981 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.428+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/067.out auth v1116 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83afe680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000032c:[<0x10000000403/067.out v278>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000032c:[<0x10000000403/067.out v1116>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.981 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.428+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/405.out auth v1130 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83afec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d6:[<0x10000000403/405.out v910>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004d6:[<0x10000000403/405.out v1130>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.982 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.428+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/247 auth v1150 ap=1 s=1597 n(v0 b1597 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aff180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e3:[<0x10000000403/247 v1094>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012e3:[<0x10000000403/247 v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.982 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.428+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/530.out auth v1132 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aff700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005d0:[<0x10000000403/530.out v972>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005d0:[<0x10000000403/530.out v1132>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.982 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.428+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001531 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/575 auth v1152 ap=1 s=3447 n(v0 b3447 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83afe100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001531:[<0x10000000403/575 v1114>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001531:[<0x10000000403/575 v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.982 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.428+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/150.out auth v1136 ap=1 s=121 n(v0 b121 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aac000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d2:[<0x10000000403/150.out v610>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003d2:[<0x10000000403/150.out v1136>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.983 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.428+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/248 auth v1140 ap=1 s=743 n(v0 b743 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aac580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e4:[<0x10000000403/248 v1098>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012e4:[<0x10000000403/248 v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.983 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.429+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001528 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/568 auth v1148 ap=1 s=1513 n(v0 b1513 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83aacb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001528:[<0x10000000403/568 v1110>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001528:[<0x10000000403/568 v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.983 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.427+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/463 auth v1164 ap=1 s=779 n(v0 b779 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e2b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b8:[<0x10000000403/463 v1128>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014b8:[<0x10000000403/463 v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.984 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.428+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012db [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/239 auth v1170 ap=1 s=827 n(v0 b827 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e2b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012db:[<0x10000000403/239 v1104>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012db:[<0x10000000403/239 v1170>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.984 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.429+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/188 auth v1174 ap=1 s=1959 n(v0 b1959 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01af2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a7:[<0x10000000403/188 v1096>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012a7:[<0x10000000403/188 v1174>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.984 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.429+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/287 auth v1172 ap=1 s=1930 n(v0 b1930 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01af2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130b:[<0x10000000403/287 v1108>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000130b:[<0x10000000403/287 v1172>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.984 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.429+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/017 auth v1164 ap=1 s=1477 n(v0 b1477 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01af2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e1:[<0x10000000403/017 v1080>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011e1:[<0x10000000403/017 v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.984 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.429+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000460 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/346.out auth v1132 ap=1 s=1102 n(v0 b1102 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01af3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000460:[<0x10000000403/346.out v874>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000460:[<0x10000000403/346.out v1132>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.985 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.429+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001507 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/537 auth v1166 ap=1 s=1758 n(v0 b1758 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01af3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001507:[<0x10000000403/537 v1112>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001507:[<0x10000000403/537 v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.985 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.430+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/488 auth v1142 ap=1 s=950 n(v0 b950 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01af4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d3:[<0x10000000403/488 v1108>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014d3:[<0x10000000403/488 v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.985 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.429+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f42 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/499.out auth v1226 ap=1 s=92 n(v0 b92 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83903600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f42:[<0x10000000d33/499.out v1062>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f42:[<0x10000000d33/499.out v1226>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.986 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.429+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b7e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/028.out auth v1208 ap=1 s=8554 n(v0 b8554 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83903b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b7e:[<0x10000000d33/028.out v112>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b7e:[<0x10000000d33/028.out v1208>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.986 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.429+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ce2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/201.out auth v1214 ap=1 s=34 n(v0 b34 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83904100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ce2:[<0x10000000d33/201.out v812>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ce2:[<0x10000000d33/201.out v1214>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.986 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.430+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/450.out auth v1206 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83905700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ee1:[<0x10000000d33/450.out v1048>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ee1:[<0x10000000d33/450.out v1206>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.986 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.431+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/325.out auth v1212 ap=1 s=441 n(v0 b441 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce82fbeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de6:[<0x10000000d33/325.out v992>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000de6:[<0x10000000d33/325.out v1212>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.986 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.431+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c46 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/123.out auth v1222 ap=1 s=185 n(v0 b185 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce82fbf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c46:[<0x10000000d33/123.out v500>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c46:[<0x10000000d33/123.out v1222>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.987 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.432+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d9e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/289.out auth v1198 ap=1 s=996 n(v0 b996 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8385a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d9e:[<0x10000000d33/289.out v974>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d9e:[<0x10000000d33/289.out v1198>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.987 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.432+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/306.out auth v1224 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce82fc0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc0:[<0x10000000d33/306.out v984>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dc0:[<0x10000000d33/306.out v1224>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.987 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.433+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cdc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/198.out auth v1222 ap=1 s=315 n(v0 b315 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce831ac000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cdc:[<0x10000000d33/198.out v800>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cdc:[<0x10000000d33/198.out v1222>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.987 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.434+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e81 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/402.out auth v1208 ap=1 s=137 n(v0 b137 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8385ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e81:[<0x10000000d33/402.out v1026>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e81:[<0x10000000d33/402.out v1208>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.988 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.434+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cda [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/197.out auth v1210 ap=1 s=34 n(v0 b34 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce831acb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cda:[<0x10000000d33/197.out v796>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cda:[<0x10000000d33/197.out v1210>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.988 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.430+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000127e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/148 auth v1152 ap=1 s=3027 n(v0 b3027 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01af5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000127e:[<0x10000000403/148 v1088>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000127e:[<0x10000000403/148 v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.988 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.430+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/185.out auth v1124 ap=1 s=618 n(v0 b618 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01af4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fa:[<0x10000000403/185.out v750>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000007fa:[<0x10000000403/185.out v1124>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.988 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.430+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/422.out auth v1134 ap=1 s=939 n(v0 b939 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01af4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f8:[<0x10000000403/422.out v914>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004f8:[<0x10000000403/422.out v1134>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.989 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.431+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ae [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/513.out auth v1130 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01af3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005ae:[<0x10000000403/513.out v968>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005ae:[<0x10000000403/513.out v1130>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.989 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.431+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000810 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/196.out auth v1120 ap=1 s=505 n(v0 b505 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dce000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000810:[<0x10000000403/196.out v794>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000810:[<0x10000000403/196.out v1120>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.989 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.434+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f4e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/505.out auth v1204 ap=1 s=43 n(v0 rc2023-10-18T14:05:15.904182+0000 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce831ad600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f4e:[<0x10000000d33/505.out v1068>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f4e:[<0x10000000d33/505.out v1204>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.990 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.436+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dec [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/328.out auth v1212 ap=1 s=127 n(v0 b127 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8392e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dec:[<0x10000000d33/328.out v996>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dec:[<0x10000000d33/328.out v1212>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.990 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.436+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bdf [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/075.out auth v1216 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce831ae680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bdf:[<0x10000000d33/075.out v306>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bdf:[<0x10000000d33/075.out v1216>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.990 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.436+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c34 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/114.out auth v1192 ap=1 s=219 n(v0 b219 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8392e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c34:[<0x10000000d33/114.out v464>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c34:[<0x10000000d33/114.out v1192>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.990 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.436+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e8f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/409.out auth v1214 ap=1 s=97 n(v0 b97 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8392f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e8f:[<0x10000000d33/409.out v1028>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e8f:[<0x10000000d33/409.out v1214>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.990 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.437+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e77 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/397.out auth v1202 ap=1 s=149 n(v0 b149 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8392f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e77:[<0x10000000d33/397.out v1024>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e77:[<0x10000000d33/397.out v1202>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.991 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.437+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bf5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/086.out auth v1196 ap=1 s=305 n(v0 b305 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83930100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bf5:[<0x10000000d33/086.out v350>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bf5:[<0x10000000d33/086.out v1196>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.991 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.437+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c1a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/104.out auth v1198 ap=1 s=4085 n(v0 b4085 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83930680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c1a:[<0x10000000d33/104.out v424>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c1a:[<0x10000000d33/104.out v1198>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.991 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.437+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d1a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/228.out auth v1200 ap=1 s=525 n(v0 b525 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83930c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d1a:[<0x10000000d33/228.out v924>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d1a:[<0x10000000d33/228.out v1200>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.991 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.439+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cfc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/214.out auth v1206 ap=1 s=376 n(v0 b376 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838e4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cfc:[<0x10000000d33/214.out v864>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cfc:[<0x10000000d33/214.out v1206>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.992 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.431+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000504 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/428.out auth v1140 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dce580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000504:[<0x10000000403/428.out v920>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000504:[<0x10000000403/428.out v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.992 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.432+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000380 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/109.out auth v1118 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000380:[<0x10000000403/109.out v446>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000380:[<0x10000000403/109.out v1118>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.992 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.432+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000149a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/435 auth v1156 ap=1 s=2633 n(v0 b2633 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01af5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000149a:[<0x10000000403/435 v1100>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000149a:[<0x10000000403/435 v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.992 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.432+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001491 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/427 auth v1154 ap=1 s=1837 n(v0 b1837 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dcf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001491:[<0x10000000403/427 v1096>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001491:[<0x10000000403/427 v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.993 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.433+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000526 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/445.out auth v1122 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dcf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000526:[<0x10000000403/445.out v938>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000526:[<0x10000000403/445.out v1122>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.993 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.439+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f11 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/474.out auth v1218 ap=1 s=137 n(v0 b137 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838e4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f11:[<0x10000000d33/474.out v1056>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f11:[<0x10000000d33/474.out v1218>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.993 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.439+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e27 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/357.out auth v1210 ap=1 s=71 n(v0 b71 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838e4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e27:[<0x10000000d33/357.out v1008>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e27:[<0x10000000d33/357.out v1210>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.994 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.439+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cea [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/205.out auth v1224 ap=1 s=83 n(v0 b83 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838b1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cea:[<0x10000000d33/205.out v828>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cea:[<0x10000000d33/205.out v1224>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.994 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.441+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ebd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/432.out auth v1194 ap=1 s=135 n(v0 b135 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838e5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ebd:[<0x10000000d33/432.out v1042>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ebd:[<0x10000000d33/432.out v1194>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.994 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.441+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bac [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/050.out auth v1206 ap=1 s=7724 n(v0 b7724 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838b2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bac:[<0x10000000d33/050.out v204>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bac:[<0x10000000d33/050.out v1206>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.994 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.434+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000122b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/070 auth v1146 ap=1 s=944 n(v0 b944 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dcfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000122b:[<0x10000000403/070 v1084>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000122b:[<0x10000000403/070 v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.995 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.434+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000474 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/356.out auth v1126 ap=1 s=185 n(v0 b185 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dd0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000474:[<0x10000000403/356.out v880>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000474:[<0x10000000403/356.out v1126>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.995 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.435+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000358 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/089.out auth v1128 ap=1 s=400 n(v0 b400 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dd0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000358:[<0x10000000403/089.out v366>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000358:[<0x10000000403/089.out v1128>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.996 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.442+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cfa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/213.out auth v1210 ap=1 s=376 n(v0 b376 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8386eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cfa:[<0x10000000d33/213.out v860>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cfa:[<0x10000000d33/213.out v1210>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.996 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.442+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b48 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/001.out auth v1204 ap=1 s=4321 n(v0 b4321 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838b3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b48:[<0x10000000d33/001.out v4>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b48:[<0x10000000d33/001.out v1204>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.996 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.443+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b86 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/032.out auth v1208 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8386f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b86:[<0x10000000d33/032.out v128>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b86:[<0x10000000d33/032.out v1208>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.996 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.445+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e1f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/353.out auth v1258 ap=1 s=71 n(v0 b71 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83863b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e1f:[<0x10000000d33/353.out v1008>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e1f:[<0x10000000d33/353.out v1258>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.996 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.446+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e21 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/354.out auth v1246 ap=1 s=117 n(v0 b117 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83864680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e21:[<0x10000000d33/354.out v1010>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e21:[<0x10000000d33/354.out v1246>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.997 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.453+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.trans_buf auth v1216 ap=1 s=55885 n(v0 b55885 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83870100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a0:[<0x10000000d33/018.trans_buf v1174>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000015a0:[<0x10000000d33/018.trans_buf v1216>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.997 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.436+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/107.out auth v1158 ap=1 s=50 n(v0 b50 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dd0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000037c:[<0x10000000403/107.out v438>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000037c:[<0x10000000403/107.out v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.997 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.437+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/515.out auth v1138 ap=1 s=217 n(v0 b217 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dd1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005b2:[<0x10000000403/515.out v970>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005b2:[<0x10000000403/515.out v1138>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.998 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.437+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/440 auth v1162 ap=1 s=3247 n(v0 b3247 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e06000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a0:[<0x10000000403/440 v1104>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014a0:[<0x10000000403/440 v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.998 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.453+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/300.out auth v1218 ap=1 s=97 n(v0 b97 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83870680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db4:[<0x10000000d33/300.out v980>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000db4:[<0x10000000d33/300.out v1218>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.998 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.453+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e95 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/412.out auth v1256 ap=1 s=104 n(v0 b104 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83863600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e95:[<0x10000000d33/412.out v1040>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e95:[<0x10000000d33/412.out v1256>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.999 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.437+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000145a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/375 auth v1160 ap=1 s=1511 n(v0 b1511 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dd1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000145a:[<0x10000000403/375 v1092>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000145a:[<0x10000000403/375 v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.999 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.437+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ec [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/163.out auth v1144 ap=1 s=107 n(v0 b107 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e06580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ec:[<0x10000000403/163.out v662>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003ec:[<0x10000000403/163.out v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:42.999 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.454+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bdd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/074.out auth v1254 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83865700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bdd:[<0x10000000d33/074.out v302>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bdd:[<0x10000000d33/074.out v1254>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.000 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.454+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d10 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/223.out auth v1244 ap=1 s=525 n(v0 b525 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83786b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d10:[<0x10000000d33/223.out v904>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d10:[<0x10000000d33/223.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.000 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.455+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bae [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/051.out auth v1242 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83787080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bae:[<0x10000000d33/051.out v208>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bae:[<0x10000000d33/051.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.001 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.437+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005cc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/528.out auth v1150 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e06b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005cc:[<0x10000000403/528.out v978>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005cc:[<0x10000000403/528.out v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.001 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.438+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001267 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/128 auth v1078 ap=1 s=928 n(v0 b928 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021e2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001267:[<0x10000000403/128 v1008>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001267:[<0x10000000403/128 v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.001 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.439+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001513 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/549 auth v1148 ap=1 s=802 n(v0 b802 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e07080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001513:[<0x10000000403/549 v1116>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001513:[<0x10000000403/549 v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.001 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.439+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/229 auth v1054 ap=1 s=4002 n(v0 b4002 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02104000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d1:[<0x10000000403/229 v1024>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012d1:[<0x10000000403/229 v1054>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.002 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.439+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000127a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/144 auth v1060 ap=1 s=4106 n(v0 b4106 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02104580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000127a:[<0x10000000403/144 v1012>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000127a:[<0x10000000403/144 v1060>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.002 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.440+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/531.out auth v1050 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021e3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005d2:[<0x10000000403/531.out v972>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005d2:[<0x10000000403/531.out v1050>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.002 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.440+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000875 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/273.out auth v1048 ap=1 s=106 n(v0 b106 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021e3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000875:[<0x10000000403/273.out v854>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000875:[<0x10000000403/273.out v1048>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.002 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.440+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/386.out auth v1136 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e07600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b0:[<0x10000000403/386.out v900>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004b0:[<0x10000000403/386.out v1136>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.002 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.441+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000145d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/378 auth v1080 ap=1 s=1287 n(v0 rc2023-10-18T14:05:24.983995+0000 b1287 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02105600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000145d:[<0x10000000403/378 v1028>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000145d:[<0x10000000403/378 v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.003 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.441+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000835 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/241.out auth v1058 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02104b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000835:[<0x10000000403/241.out v836>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000835:[<0x10000000403/241.out v1058>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.003 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.441+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000127c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/146 auth v1072 ap=1 s=4108 n(v0 b4108 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02105080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000127c:[<0x10000000403/146 v1016>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000127c:[<0x10000000403/146 v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.003 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.441+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012cf [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/227 auth v1076 ap=1 s=2538 n(v0 b2538 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02106100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012cf:[<0x10000000403/227 v1020>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012cf:[<0x10000000403/227 v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.003 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.443+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001205 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/047 auth v1056 ap=1 s=1876 n(v0 rc2023-10-18T14:05:24.219011+0000 b1876 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02106680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001205:[<0x10000000403/047 v1004>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001205:[<0x10000000403/047 v1056>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.003 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.443+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/489 auth v1068 ap=1 s=1631 n(v0 b1631 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02105b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d4:[<0x10000000403/489 v1036>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014d4:[<0x10000000403/489 v1068>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.004 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.457+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d72 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/267.out auth v1264 ap=1 s=3233 n(v0 b3233 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83167700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d72:[<0x10000000d33/267.out v970>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d72:[<0x10000000d33/267.out v1264>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.004 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.457+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/192.out auth v1250 ap=1 s=315 n(v0 b315 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8326ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd0:[<0x10000000d33/192.out v776>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cd0:[<0x10000000d33/192.out v1250>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.004 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.459+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c4e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/127.out auth v1266 ap=1 s=130 n(v0 b130 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83167180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c4e:[<0x10000000d33/127.out v516>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c4e:[<0x10000000d33/127.out v1266>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.005 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.460+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/209.out auth v1220 ap=1 s=485 n(v0 b485 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a50680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf2:[<0x10000000d33/209.out v844>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cf2:[<0x10000000d33/209.out v1220>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.005 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.460+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d56 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/253.out auth v1216 ap=1 s=56 n(v0 b56 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a4f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d56:[<0x10000000d33/253.out v968>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d56:[<0x10000000d33/253.out v1216>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.005 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.461+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/194.out auth v1206 ap=1 s=981 n(v0 b981 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a51180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd4:[<0x10000000d33/194.out v784>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cd4:[<0x10000000d33/194.out v1206>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.005 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.461+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b70 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/021.out auth v1204 ap=1 s=1262 n(v0 b1262 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83852000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b70:[<0x10000000d33/021.out v84>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b70:[<0x10000000d33/021.out v1204>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.006 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.462+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bca [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/065.out auth v1232 ap=1 s=29358 n(v0 b29358 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83853600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bca:[<0x10000000d33/065.out v264>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bca:[<0x10000000d33/065.out v1232>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.006 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.462+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e8d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/408.out auth v1254 ap=1 s=97 n(v0 b97 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83870c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e8d:[<0x10000000d33/408.out v1040>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e8d:[<0x10000000d33/408.out v1254>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.006 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.462+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b64 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/015.out auth v1210 ap=1 s=49 n(v0 b49 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83852b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b64:[<0x10000000d33/015.out v60>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b64:[<0x10000000d33/015.out v1210>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.006 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.462+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e02 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/339.out auth v1208 ap=1 s=200 n(v0 b200 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83852580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e02:[<0x10000000d33/339.out v1006>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e02:[<0x10000000d33/339.out v1208>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.007 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.443+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001475 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/401 auth v1070 ap=1 s=1770 n(v0 b1770 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02107180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001475:[<0x10000000403/401 v1032>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001475:[<0x10000000403/401 v1070>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.007 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.443+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/582 auth v1062 ap=1 s=864 n(v0 b864 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02106c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153a:[<0x10000000403/582 v1044>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000153a:[<0x10000000403/582 v1062>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.007 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.444+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000054e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/465.out auth v1064 ap=1 s=55 n(v0 b55 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02107700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000054e:[<0x10000000403/465.out v944>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000054e:[<0x10000000403/465.out v1064>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.007 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.444+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002fb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/047.out auth v1046 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02044000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002fb:[<0x10000000403/047.out v192>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002fb:[<0x10000000403/047.out v1046>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.008 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.444+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001520 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/561 auth v1082 ap=1 s=2104 n(v0 b2104 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02044580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001520:[<0x10000000403/561 v1040>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001520:[<0x10000000403/561 v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.008 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.444+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000536 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/453.out auth v1052 ap=1 s=125 n(v0 b125 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02044b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000536:[<0x10000000403/453.out v936>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000536:[<0x10000000403/453.out v1052>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.008 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.444+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/058.out auth v1074 ap=1 s=1839 n(v0 b1839 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02045080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000031a:[<0x10000000403/058.out v242>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000031a:[<0x10000000403/058.out v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.008 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.445+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ce [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/484 auth v1104 ap=1 s=1152 n(v0 b1152 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022f3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ce:[<0x10000000403/484 v1064>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014ce:[<0x10000000403/484 v1104>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.009 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.445+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000356 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/088.out auth v1074 ap=1 s=397 n(v0 b397 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022ae580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000356:[<0x10000000403/088.out v362>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000356:[<0x10000000403/088.out v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.009 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.445+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000058e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/497.out auth v1066 ap=1 s=67 n(v0 b67 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02045600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000058e:[<0x10000000403/497.out v958>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000058e:[<0x10000000403/497.out v1066>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.009 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.463+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c5c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/134.out auth v1240 ap=1 s=112 n(v0 b112 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8375cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c5c:[<0x10000000d33/134.out v544>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c5c:[<0x10000000d33/134.out v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.009 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.465+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b4a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/002.out auth v1238 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8375db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b4a:[<0x10000000d33/002.out v8>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b4a:[<0x10000000d33/002.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.010 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.466+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bb2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/053.out auth v1232 ap=1 s=550 n(v0 b550 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8375f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bb2:[<0x10000000d33/053.out v216>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bb2:[<0x10000000d33/053.out v1232>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.010 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.467+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bf7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/087.out auth v1246 ap=1 s=236 n(v0 b236 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8375d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bf7:[<0x10000000d33/087.out v354>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bf7:[<0x10000000d33/087.out v1246>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.010 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.468+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dce [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/313.out auth v1230 ap=1 s=597 n(v0 b597 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a46580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dce:[<0x10000000d33/313.out v992>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dce:[<0x10000000d33/313.out v1230>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.011 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.468+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ecf [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/441.out auth v1250 ap=1 s=387 n(v0 b387 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a46b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ecf:[<0x10000000d33/441.out v1054>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ecf:[<0x10000000d33/441.out v1250>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.011 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.468+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d50 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/250.out auth v1242 ap=1 s=453 n(v0 b453 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a47b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d50:[<0x10000000d33/250.out v962>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d50:[<0x10000000d33/250.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.011 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.468+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d22 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/232.out auth v1244 ap=1 s=582 n(v0 b582 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a47080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d22:[<0x10000000d33/232.out v940>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d22:[<0x10000000d33/232.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.011 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.469+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d64 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/260.out auth v1240 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a49700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d64:[<0x10000000d33/260.out v964>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d64:[<0x10000000d33/260.out v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.011 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.469+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000edb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/447.out auth v1236 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a48c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000edb:[<0x10000000d33/447.out v1056>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000edb:[<0x10000000d33/447.out v1236>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.012 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.445+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000435 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/225.out auth v1070 ap=1 s=110 n(v0 b110 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022ae000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000435:[<0x10000000403/225.out v822>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000435:[<0x10000000403/225.out v1070>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.012 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.446+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/014.out auth v1072 ap=1 s=67 n(v0 b67 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022af600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b7:[<0x10000000403/014.out v56>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002b7:[<0x10000000403/014.out v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.012 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.446+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002cb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/024.out auth v1076 ap=1 s=1857 n(v0 b1857 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022afb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002cb:[<0x10000000403/024.out v96>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002cb:[<0x10000000403/024.out v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.013 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.446+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001408 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/297 auth v1102 ap=1 s=2416 n(v0 b2416 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022b0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001408:[<0x10000000403/297 v1044>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001408:[<0x10000000403/297 v1102>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.013 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.446+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ae [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/132.out auth v1100 ap=1 s=36183 n(v0 b36183 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022aeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ae:[<0x10000000403/132.out v538>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003ae:[<0x10000000403/132.out v1100>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.013 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.446+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000125e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/119 auth v1088 ap=1 s=5415 n(v0 b5415 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022af080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000125e:[<0x10000000403/119 v1032>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000125e:[<0x10000000403/119 v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.013 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.446+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ce [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/148.out auth v1082 ap=1 s=704 n(v0 b704 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022b0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ce:[<0x10000000403/148.out v602>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003ce:[<0x10000000403/148.out v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.014 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.447+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/108.out auth v1084 ap=1 s=51 n(v0 b51 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022b1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000037e:[<0x10000000403/108.out v442>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000037e:[<0x10000000403/108.out v1084>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.014 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.447+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/023.out auth v1068 ap=1 s=1933 n(v0 b1933 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022b0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002c9:[<0x10000000403/023.out v92>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002c9:[<0x10000000403/023.out v1068>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.014 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.447+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001218 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/051 auth v1094 ap=1 s=1888 n(v0 rc2023-10-18T14:05:24.227011+0000 b1888 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022b1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001218:[<0x10000000403/051 v1024>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001218:[<0x10000000403/051 v1094>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.014 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.447+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000148f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/425 auth v1108 ap=1 s=1748 n(v0 b1748 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0227e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000148f:[<0x10000000403/425 v1056>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000148f:[<0x10000000403/425 v1108>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.014 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.448+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/230 auth v1096 ap=1 s=4871 n(v0 rc2023-10-18T14:05:24.613003+0000 b4871 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0227e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d2:[<0x10000000403/230 v1036>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012d2:[<0x10000000403/230 v1096>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.015 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.448+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000143c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/349 auth v1106 ap=1 s=1345 n(v0 b1345 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0227f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000143c:[<0x10000000403/349 v1052>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000143c:[<0x10000000403/349 v1106>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.015 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.448+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/442 auth v1112 ap=1 s=976 n(v0 b976 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0227eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a3:[<0x10000000403/442 v1060>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014a3:[<0x10000000403/442 v1112>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.015 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.448+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/236.out auth v1078 ap=1 s=36 n(v0 b36 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0227f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082b:[<0x10000000403/236.out v836>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000082b:[<0x10000000403/236.out v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.015 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.448+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001229 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/068 auth v1092 ap=1 s=2553 n(v0 b2553 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0227fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001229:[<0x10000000403/068 v1028>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001229:[<0x10000000403/068 v1092>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.016 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.449+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000332 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/070.out auth v1066 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02280680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000332:[<0x10000000403/070.out v290>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000332:[<0x10000000403/070.out v1066>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.016 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.449+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/260 auth v1098 ap=1 s=5020 n(v0 b5020 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02280100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f0:[<0x10000000403/260 v1040>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012f0:[<0x10000000403/260 v1098>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.016 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.450+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000831 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/239.out auth v1080 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02281180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000831:[<0x10000000403/239.out v838>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000831:[<0x10000000403/239.out v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.016 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.450+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001412 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/307 auth v1090 ap=1 s=1393 n(v0 b1393 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02280c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001412:[<0x10000000403/307 v1048>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001412:[<0x10000000403/307 v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.016 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.451+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/506.out auth v1110 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0228e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005a0:[<0x10000000403/506.out v970>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005a0:[<0x10000000403/506.out v1110>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.017 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.469+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e63 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/387.out auth v1234 ap=1 s=134 n(v0 b134 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83a47600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e63:[<0x10000000d33/387.out v1030>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e63:[<0x10000000d33/387.out v1234>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.018 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.470+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e47 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/373.out auth v1230 ap=1 s=85 n(v0 b85 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83854680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e47:[<0x10000000d33/373.out v1032>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e47:[<0x10000000d33/373.out v1230>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.018 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.470+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b7a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/026.out auth v1228 ap=1 s=4027 n(v0 b4027 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83854c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b7a:[<0x10000000d33/026.out v104>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b7a:[<0x10000000d33/026.out v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.018 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.471+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/299.out auth v1226 ap=1 s=6624 n(v0 b6624 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83855700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db2:[<0x10000000d33/299.out v990>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000db2:[<0x10000000d33/299.out v1226>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.018 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.472+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b78 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/025.out auth v1244 ap=1 s=4402 n(v0 b4402 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83859b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b78:[<0x10000000d33/025.out v100>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b78:[<0x10000000d33/025.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.018 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.472+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e49 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/374.out auth v1234 ap=1 s=103 n(v0 b103 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836df700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e49:[<0x10000000d33/374.out v1028>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e49:[<0x10000000d33/374.out v1234>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.019 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.473+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/451.out auth v1236 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8390ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ee3:[<0x10000000d33/451.out v1068>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ee3:[<0x10000000d33/451.out v1236>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.019 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.473+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d76 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/269.out auth v1238 ap=1 s=95 n(v0 b95 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8390a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d76:[<0x10000000d33/269.out v980>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d76:[<0x10000000d33/269.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.019 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.473+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dbc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/304.out auth v1242 ap=1 s=146 n(v0 b146 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8390bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dbc:[<0x10000000d33/304.out v998>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dbc:[<0x10000000d33/304.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.019 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.475+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dee [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/329.out auth v1254 ap=1 s=279 n(v0 b279 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8390d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dee:[<0x10000000d33/329.out v1010>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dee:[<0x10000000d33/329.out v1254>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.019 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.476+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cca [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/189.out auth v1226 ap=1 s=1842 n(v0 b1842 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836dc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cca:[<0x10000000d33/189.out v764>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cca:[<0x10000000d33/189.out v1226>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.020 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.477+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ddc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/320.out auth v1234 ap=1 s=622 n(v0 b622 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836dc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ddc:[<0x10000000d33/320.out v1004>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ddc:[<0x10000000d33/320.out v1234>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.020 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.477+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bff [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/091.out auth v1250 ap=1 s=305 n(v0 b305 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836dd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bff:[<0x10000000d33/091.out v370>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bff:[<0x10000000d33/091.out v1250>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.020 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.477+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e2b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/359.out auth v1228 ap=1 s=85 n(v0 b85 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce8395d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e2b:[<0x10000000d33/359.out v1026>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e2b:[<0x10000000d33/359.out v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.020 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.478+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d42 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/243.out auth v1230 ap=1 s=835 n(v0 b835 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836ddb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d42:[<0x10000000d33/243.out v956>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d42:[<0x10000000d33/243.out v1230>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.021 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.478+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/471.out auth v1238 ap=1 s=134 n(v0 b134 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83788680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f0b:[<0x10000000d33/471.out v1082>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f0b:[<0x10000000d33/471.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.021 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.478+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f48 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/502.out auth v1242 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce836de680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f48:[<0x10000000d33/502.out v1100>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f48:[<0x10000000d33/502.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.021 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.479+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bdb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/073.out auth v1226 ap=1 s=2120 n(v0 b2120 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83788c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bdb:[<0x10000000d33/073.out v298>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bdb:[<0x10000000d33/073.out v1226>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.021 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.480+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cee [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/207.out auth v1228 ap=1 s=615 n(v0 b615 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83789700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cee:[<0x10000000d33/207.out v836>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cee:[<0x10000000d33/207.out v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.022 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.480+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cbe [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/183.out auth v1240 ap=1 s=134 n(v0 b134 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838d8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cbe:[<0x10000000d33/183.out v740>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cbe:[<0x10000000d33/183.out v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.022 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.481+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/119.out auth v1232 ap=1 s=159 n(v0 b159 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838d8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3e:[<0x10000000d33/119.out v484>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c3e:[<0x10000000d33/119.out v1232>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.022 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.481+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f13 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/475.out auth v1234 ap=1 s=134 n(v0 b134 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838d9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f13:[<0x10000000d33/475.out v1086>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f13:[<0x10000000d33/475.out v1234>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.022 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.481+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f05 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/468.out auth v1254 ap=1 s=89 n(v0 b89 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838da100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f05:[<0x10000000d33/468.out v1078>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f05:[<0x10000000d33/468.out v1254>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.022 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.481+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e6b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/391.out auth v1244 ap=1 s=137 n(v0 b137 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838da680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e6b:[<0x10000000d33/391.out v1040>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e6b:[<0x10000000d33/391.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.023 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.482+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c48 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/124.out auth v1246 ap=1 s=230 n(v0 b230 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838dac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c48:[<0x10000000d33/124.out v504>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c48:[<0x10000000d33/124.out v1246>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.023 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.482+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ba0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/044.out auth v1230 ap=1 s=1781 n(v0 b1781 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838db700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ba0:[<0x10000000d33/044.out v180>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ba0:[<0x10000000d33/044.out v1230>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.023 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.483+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ecd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/440.out auth v1228 ap=1 s=234 n(v0 b234 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83912580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ecd:[<0x10000000d33/440.out v1062>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ecd:[<0x10000000d33/440.out v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.023 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.483+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/212.out auth v1226 ap=1 s=512 n(v0 b512 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83913080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf8:[<0x10000000d33/212.out v856>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cf8:[<0x10000000d33/212.out v1226>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.024 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.483+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b4e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/004.out auth v1240 ap=1 s=358 n(v0 b358 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83913600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b4e:[<0x10000000d33/004.out v16>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b4e:[<0x10000000d33/004.out v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.024 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.484+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b56 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/008.out auth v1232 ap=1 s=536 n(v0 b536 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83914680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b56:[<0x10000000d33/008.out v32>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b56:[<0x10000000d33/008.out v1232>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.024 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.484+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.trans_inode auth v1244 ap=1 s=95688 n(v0 b95688 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83914100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a1:[<0x10000000d33/018.trans_inode v1204>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000015a1:[<0x10000000d33/018.trans_inode v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.024 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.484+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e93 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/411.out auth v1242 ap=1 s=85 n(v0 b85 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce83915180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e93:[<0x10000000d33/411.out v1050>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e93:[<0x10000000d33/411.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.025 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.451+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001404 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/001 auth v1086 ap=1 s=6036 n(v0 rc2023-10-18T14:05:23.690022+0000 b6036 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02281700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001404:[<0x10000000403/001 v1020>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001404:[<0x10000000403/001 v1086>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.025 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.452+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/508 auth v1104 ap=1 s=1899 n(v0 b1899 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02219180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e9:[<0x10000000403/508 v1068>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014e9:[<0x10000000403/508 v1104>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.025 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.452+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/220.out auth v1086 ap=1 s=112 n(v0 b112 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021dc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000042b:[<0x10000000403/220.out v820>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000042b:[<0x10000000403/220.out v1086>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.025 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.452+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000938 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/585.out auth v1082 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02219700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000938:[<0x10000000403/585.out v1006>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000938:[<0x10000000403/585.out v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.026 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.452+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/137.out auth v1084 ap=1 s=255 n(v0 b255 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021dc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b8:[<0x10000000403/137.out v558>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003b8:[<0x10000000403/137.out v1084>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.026 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.453+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/543 auth v1106 ap=1 s=2769 n(v0 b2769 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021dcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000150d:[<0x10000000403/543 v1072>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000150d:[<0x10000000403/543 v1106>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.026 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.453+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000058c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/496.out auth v1114 ap=1 s=51 n(v0 b51 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021dd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000058c:[<0x10000000403/496.out v968>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000058c:[<0x10000000403/496.out v1114>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.026 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.454+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011dd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/013 auth v1108 ap=1 s=2711 n(v0 b2711 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021dd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011dd:[<0x10000000403/013 v1048>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000011dd:[<0x10000000403/013 v1108>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.027 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.454+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/129.out auth v1078 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021de100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a8:[<0x10000000403/129.out v526>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003a8:[<0x10000000403/129.out v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.027 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.454+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000548 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/462.out auth v1102 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021de680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000548:[<0x10000000403/462.out v950>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000548:[<0x10000000403/462.out v1102>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.027 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.455+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000478 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/358.out auth v1090 ap=1 s=4176 n(v0 b4176 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021ddb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000478:[<0x10000000403/358.out v902>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000478:[<0x10000000403/358.out v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.027 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.455+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/185 auth v1118 ap=1 s=2392 n(v0 b2392 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021dec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a4:[<0x10000000403/185 v1052>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012a4:[<0x10000000403/185 v1118>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.027 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.455+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001311 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/293 auth v1092 ap=1 s=2100 n(v0 b2100 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021df700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001311:[<0x10000000403/293 v1060>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001311:[<0x10000000403/293 v1092>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.029 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.485+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e85 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/404.out auth v1246 ap=1 s=128 n(v0 b128 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838b0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e85:[<0x10000000d33/404.out v1044>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e85:[<0x10000000d33/404.out v1246>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.029 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.485+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b5c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/011.out auth v1230 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838b0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b5c:[<0x10000000d33/011.out v44>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b5c:[<0x10000000d33/011.out v1230>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.029 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.485+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016f8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/002 auth v1234 ap=1 s=1660 n(v0 rc2023-10-18T14:05:25.719980+0000 b1660 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838b1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016f8:[<0x10000000d33/002 v1202>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016f8:[<0x10000000d33/002 v1234>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.029 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:05:42.486+0000 7fe900d24700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/460.out auth v1250 ap=1 s=75 n(v0 b75 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ce838b0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ef5:[<0x10000000d33/460.out v1076>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ef5:[<0x10000000d33/460.out v1250>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.030 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] doio 2023-10-18T14:05:43.031 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] fsstress 2023-10-18T14:05:43.031 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] fsx 2023-10-18T14:05:43.032 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: pgmap v330: 97 pgs: 97 active+clean; 55 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 1.36k op/s 2023-10-18T14:05:43.032 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:05:43.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:05:43.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000816 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/199.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001453 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/370) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001201 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/043) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014c3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/473) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000130a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/286) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/033.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000309 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.nojournal) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000153f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/587) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014a5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/444) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001266 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/127) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000085f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/262.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000080a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/193.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000059a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/503.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001230 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/075) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/418.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000883 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/280.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000036e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/100.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000080e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/195.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.037 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000853 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/256.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.037 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/266) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.037 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000129c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/178) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.037 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/326.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.037 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/499) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.038 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/039.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.038 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/240) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.038 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/511) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.038 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/038.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.038 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/538.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000841 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/247.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000522 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/443.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001429 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/330) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000142d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/334) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001220 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/059) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000142f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/336) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000141f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/320) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001454 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/371) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001438 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/345) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008c1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/311.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001207 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/049) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/030.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001547 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/group) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000144e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/365) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000466 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/349.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/161.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000035a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/090.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/486) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001464 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/385) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001516 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/552) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000a31 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/581.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000307 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.cfg) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012c3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/215) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004da (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/407.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000444 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/332.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001286 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/156) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000084f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/254.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000454 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/340.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001256 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/111) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001534 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/577) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011d5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/005) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012da (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/238) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000146b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/392) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/184) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005b4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/516.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000083d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/245.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.046 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/021) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.046 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012aa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/191) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.046 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000845 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/249.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.046 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000413 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/208.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.046 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/415.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.047 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/510) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.047 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002c7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/022.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.047 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000143d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/350) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.047 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000126e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/135) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.047 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/159.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.048 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/155.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.048 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000046a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/351.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.048 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003da (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/154.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.048 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/041) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.048 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012dd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/241) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.049 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008fb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/552.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.049 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001219 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/052) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.049 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000088d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/285.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.049 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000125c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/117) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.049 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001468 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/389) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.050 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001510 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/546) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.050 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/156.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.050 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/172.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.050 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001545 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/592) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.050 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001304 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/280) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.051 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/550.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.051 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/421.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.051 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000125b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/116) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.051 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000370 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/101.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.051 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000153c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/584) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.051 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001473 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/399) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.052 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/245) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.052 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000151f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/560) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.052 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/195) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.052 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001271 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/138) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.052 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003c4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/143.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000821 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/231.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000804 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/190.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000044a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/335.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001530 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/574.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/176.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000045c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/344.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000121f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/058) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001259 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/114) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001457 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/373.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002cf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/026.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001515 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/551) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001285 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/155) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:42 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/036.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.061 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.455+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/228 auth v1098 ap=1 s=1768 n(v0 b1768 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021e0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d0:[<0x10000000403/228 v1056>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012d0:[<0x10000000403/228 v1098>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.061 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.456+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/135.out auth v1088 ap=1 s=257 n(v0 b257 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021e0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b4:[<0x10000000403/135.out v550>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003b4:[<0x10000000403/135.out v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.061 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.456+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001522 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/563 auth v1116 ap=1 s=3722 n(v0 b3722 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021e0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001522:[<0x10000000403/563 v1076>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001522:[<0x10000000403/563 v1116>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.061 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.456+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000518 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/438.out auth v1080 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021df180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000518:[<0x10000000403/438.out v936>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000518:[<0x10000000403/438.out v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.061 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.456+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000093a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/586.out auth v1096 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021e1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000093a:[<0x10000000403/586.out v1008>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000093a:[<0x10000000403/586.out v1096>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.062 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.456+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/460 auth v1110 ap=1 s=2663 n(v0 b2663 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021e1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b5:[<0x10000000403/460 v1064>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014b5:[<0x10000000403/460 v1110>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.062 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.457+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000540 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/458.out auth v1100 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021e1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000540:[<0x10000000403/458.out v946>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000540:[<0x10000000403/458.out v1100>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.062 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.457+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/060.out auth v1112 ap=1 s=1839 n(v0 b1839 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021e2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000031e:[<0x10000000403/060.out v250>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000031e:[<0x10000000403/060.out v1112>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.062 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.457+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/303.out auth v1094 ap=1 s=605 n(v0 b605 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021e2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b1:[<0x10000000403/303.out v872>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000008b1:[<0x10000000403/303.out v1094>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.063 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.457+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001409 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/298 auth v1110 ap=1 s=2429 n(v0 rc2023-10-18T14:05:24.787999+0000 b2429 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02202000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001409:[<0x10000000403/298 v1050>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001409:[<0x10000000403/298 v1110>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.063 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.458+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005dc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/536.out auth v1106 ap=1 s=39 n(v0 b39 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02229700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005dc:[<0x10000000403/536.out v982>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005dc:[<0x10000000403/536.out v1106>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.063 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.458+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014b3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/458 auth v1102 ap=1 s=1268 n(v0 b1268 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02202580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014b3:[<0x10000000403/458 v1062>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014b3:[<0x10000000403/458 v1102>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.063 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.458+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/398.out auth v1086 ap=1 s=1054 n(v0 b1054 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02203600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c8:[<0x10000000403/398.out v918>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004c8:[<0x10000000403/398.out v1086>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.063 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.458+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000334 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/071.out auth v1074 ap=1 s=274 n(v0 b274 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02203080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000334:[<0x10000000403/071.out v294>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000000334:[<0x10000000403/071.out v1074>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.064 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.458+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000863 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/264.out auth v1082 ap=1 s=486 n(v0 b486 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02203b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000863:[<0x10000000403/264.out v848>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000863:[<0x10000000403/264.out v1082>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.064 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.459+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/233 auth v1112 ap=1 s=1633 n(v0 b1633 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02202b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d5:[<0x10000000403/233 v1046>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012d5:[<0x10000000403/233 v1112>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.064 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.460+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/521 auth v1100 ap=1 s=1175 n(v0 b1175 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02204c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f6:[<0x10000000403/521 v1066>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000014f6:[<0x10000000403/521 v1100>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.064 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.461+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/045.out auth v1094 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02204680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f7:[<0x10000000403/045.out v184>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002f7:[<0x10000000403/045.out v1094>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.065 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.461+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002fd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/048.out auth v1096 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02205180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002fd:[<0x10000000403/048.out v196>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002fd:[<0x10000000403/048.out v1096>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.065 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.461+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000437 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/226.out auth v1078 ap=1 s=202 n(v0 b202 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02216000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000437:[<0x10000000403/226.out v824>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000437:[<0x10000000403/226.out v1078>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.065 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.462+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001418 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/313 auth v1088 ap=1 s=773 n(v0 b773 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02216580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001418:[<0x10000000403/313 v1054>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001418:[<0x10000000403/313 v1088>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.065 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.462+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002af [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/010.out auth v1076 ap=1 s=795 n(v0 b795 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02217080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002af:[<0x10000000403/010.out v40>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000002af:[<0x10000000403/010.out v1076>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.065 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.463+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/083.out auth v1072 ap=1 s=105 n(v0 b105 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02217600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000034c:[<0x10000000403/083.out v342>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000034c:[<0x10000000403/083.out v1072>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.066 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.464+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000440 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/330.out auth v1090 ap=1 s=373 n(v0 b373 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02217b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000440:[<0x10000000403/330.out v892>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000440:[<0x10000000403/330.out v1090>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.066 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.465+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000151c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/557 auth v1084 ap=1 s=1909 n(v0 b1909 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02218680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000151c:[<0x10000000403/557 v1070>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000151c:[<0x10000000403/557 v1084>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.066 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.471+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000946 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/592.out auth v1098 ap=1 s=175 n(v0 b175 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02204100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000946:[<0x10000000403/592.out v1006>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000946:[<0x10000000403/592.out v1098>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.066 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.471+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/142.out auth v1080 ap=1 s=298 n(v0 b298 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02205700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c2:[<0x10000000403/142.out v578>,<0x10000000135/generic v2346>,<0x100000005e4/tests v814>,<0x100000005e3/xfstests-dev v80>,<0x100000005e2/tmp v14>,<0x100000001fb/client.0 v12>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v28>,<0x10000000001/sv_1 v51>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000003c2:[<0x10000000403/142.out v1080>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.067 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.471+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001231 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/076 auth v1108 ap=1 s=1382 n(v0 rc2023-10-18T14:05:24.275010+0000 b1382 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02218100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001231:[<0x10000000403/076 v1038>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001231:[<0x10000000403/076 v1108>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.067 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.472+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/533.out auth v1148 ap=1 s=1930 n(v0 b1930 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02255700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005d6:[<0x10000000403/533.out v974>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005d6:[<0x10000000403/533.out v1148>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.067 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.472+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001455 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/372 auth v1104 ap=1 s=1805 n(v0 b1805 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02216b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001455:[<0x10000000403/372 v1058>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001455:[<0x10000000403/372 v1104>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.067 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.472+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001526 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/567 auth v1156 ap=1 s=1338 n(v0 b1338 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02244000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001526:[<0x10000000403/567 v1134>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001526:[<0x10000000403/567 v1156>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.067 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.473+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001242 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/092 auth v1092 ap=1 s=1434 n(v0 b1434 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02218c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001242:[<0x10000000403/092 v1042>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001242:[<0x10000000403/092 v1092>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.068 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.473+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000899 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/291.out auth v1164 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02244580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000899:[<0x10000000403/291.out v856>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000899:[<0x10000000403/291.out v1164>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.068 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.473+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000510 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/434.out auth v1154 ap=1 s=499 n(v0 b499 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02245600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000510:[<0x10000000403/434.out v920>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000510:[<0x10000000403/434.out v1154>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.068 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.473+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/572 auth v1174 ap=1 s=6054 n(v0 b6054 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02244b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152c:[<0x10000000403/572 v1138>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000152c:[<0x10000000403/572 v1174>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.068 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.473+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000932 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/582.out auth v1152 ap=1 s=160 n(v0 b160 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02245080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000932:[<0x10000000403/582.out v994>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000932:[<0x10000000403/582.out v1152>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.068 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.474+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000148c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/422 auth v1168 ap=1 s=2990 n(v0 b2990 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02246680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000148c:[<0x10000000403/422 v1126>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000148c:[<0x10000000403/422 v1168>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.069 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.474+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/367.out auth v1170 ap=1 s=429 n(v0 b429 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02245b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048a:[<0x10000000403/367.out v888>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000048a:[<0x10000000403/367.out v1170>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.069 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.475+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fd [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/273 auth v1166 ap=1 s=1957 n(v0 rc2023-10-18T14:05:24.723001+0000 b1957 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02246100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fd:[<0x10000000403/273 v1114>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012fd:[<0x10000000403/273 v1166>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.069 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.475+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/327.out auth v1144 ap=1 s=317 n(v0 b317 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02246c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000043a:[<0x10000000403/327.out v872>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000043a:[<0x10000000403/327.out v1144>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.069 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.476+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001430 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/337 auth v1180 ap=1 s=1588 n(v0 b1588 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02247700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001430:[<0x10000000403/337 v1118>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001430:[<0x10000000403/337 v1180>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.070 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.476+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c2 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/395.out auth v1142 ap=1 s=1829 n(v0 b1829 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02247180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c2:[<0x10000000403/395.out v904>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004c2:[<0x10000000403/395.out v1142>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.070 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.476+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000123b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/086 auth v1162 ap=1 s=1948 n(v0 b1948 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02226000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000123b:[<0x10000000403/086 v1102>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000123b:[<0x10000000403/086 v1162>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.070 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.476+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/414.out auth v1146 ap=1 s=397 n(v0 b397 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02226b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e8:[<0x10000000403/414.out v914>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000004e8:[<0x10000000403/414.out v1146>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.070 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.477+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000524 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/444.out auth v1176 ap=1 s=47 n(v0 b47 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02226580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000524:[<0x10000000403/444.out v926>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000524:[<0x10000000403/444.out v1176>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.070 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.477+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001467 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/388 auth v1182 ap=1 s=1993 n(v0 rc2023-10-18T14:05:25.005995+0000 b1993 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02227080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001467:[<0x10000000403/388 v1122>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001467:[<0x10000000403/388 v1182>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.071 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.477+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/269 auth v1178 ap=1 s=1543 n(v0 b1543 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02227600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f9:[<0x10000000403/269 v1110>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000012f9:[<0x10000000403/269 v1178>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.071 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.477+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000915 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/565.out auth v1150 ap=1 s=158 n(v0 b158 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02227b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000915:[<0x10000000403/565.out v980>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000915:[<0x10000000403/565.out v1150>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.071 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.477+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001250 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/105 auth v1160 ap=1 s=1748 n(v0 b1748 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02228100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001250:[<0x10000000403/105 v1106>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001250:[<0x10000000403/105 v1160>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.071 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.478+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005aa [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/511.out auth v1140 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02228680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005aa:[<0x10000000403/511.out v962>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000005aa:[<0x10000000403/511.out v1140>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.072 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.478+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001494 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/429.out auth v1158 ap=1 s=1230 n(v0 b1230 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02229180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001494:[<0x10000000403/429.out v1130>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001494:[<0x10000000403/429.out v1158>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.072 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.478+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e65 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/388.out auth v1220 ap=1 s=134 n(v0 b134 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01978100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e65:[<0x10000000d33/388.out v1020>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e65:[<0x10000000d33/388.out v1220>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.072 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.478+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c07 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/095.out auth v1232 ap=1 s=71 n(v0 b71 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01978680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c07:[<0x10000000d33/095.out v386>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c07:[<0x10000000d33/095.out v1232>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.072 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.478+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f58 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/510.out auth v1250 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01978c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f58:[<0x10000000d33/510.out v1072>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f58:[<0x10000000d33/510.out v1250>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.072 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.480+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000056a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/479.out auth v1172 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02228c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000056a:[<0x10000000403/479.out v946>,<0x10000000135/generic v13356>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000056a:[<0x10000000403/479.out v1172>,<0x10000000135/generic v18965>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.073 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.480+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e5b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/383.out auth v1218 ap=1 s=131 n(v0 b131 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dbc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e5b:[<0x10000000d33/383.out v1014>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e5b:[<0x10000000d33/383.out v1218>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.073 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.480+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bbe [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/059.out auth v1222 ap=1 s=4610 n(v0 b4610 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dbc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bbe:[<0x10000000d33/059.out v240>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bbe:[<0x10000000d33/059.out v1222>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.073 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.480+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d5a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/255.out auth v1228 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01dbd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d5a:[<0x10000000d33/255.out v958>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d5a:[<0x10000000d33/255.out v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.073 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.483+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/427.out auth v1216 ap=1 s=83 n(v0 b83 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e3e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eb3:[<0x10000000d33/427.out v1040>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000eb3:[<0x10000000d33/427.out v1216>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.073 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.483+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c01 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/092.out auth v1240 ap=1 s=297 n(v0 b297 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e3e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c01:[<0x10000000d33/092.out v374>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c01:[<0x10000000d33/092.out v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.074 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.484+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e59 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/382.out auth v1248 ap=1 s=131 n(v0 b131 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e08c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e59:[<0x10000000d33/382.out v1024>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e59:[<0x10000000d33/382.out v1248>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.074 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.487+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/436.out auth v1262 ap=1 s=233 n(v0 b233 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e63b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ec5:[<0x10000000d33/436.out v1060>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ec5:[<0x10000000d33/436.out v1262>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.074 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.487+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bba [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/057.out auth v1240 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e08100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bba:[<0x10000000d33/057.out v232>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bba:[<0x10000000d33/057.out v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.074 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.487+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed9 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/446.out auth v1238 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e63080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ed9:[<0x10000000d33/446.out v1068>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ed9:[<0x10000000d33/446.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.075 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.488+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e5f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/385.out auth v1244 ap=1 s=140 n(v0 b140 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e64680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e5f:[<0x10000000d33/385.out v1028>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e5f:[<0x10000000d33/385.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.075 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.488+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eeb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/455.out auth v1264 ap=1 s=117 n(v0 b117 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e65700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eeb:[<0x10000000d33/455.out v1074>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000eeb:[<0x10000000d33/455.out v1264>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.075 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.488+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f40 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/498.out auth v1272 ap=1 s=158 n(v0 b158 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022e4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f40:[<0x10000000d33/498.out v1100>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f40:[<0x10000000d33/498.out v1272>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.075 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.488+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/302.out auth v1246 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e3eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db8:[<0x10000000d33/302.out v984>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000db8:[<0x10000000d33/302.out v1246>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.075 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.489+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e7f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/401.out auth v1248 ap=1 s=137 n(v0 b137 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e3f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e7f:[<0x10000000d33/401.out v1040>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e7f:[<0x10000000d33/401.out v1248>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.076 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.489+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e3d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/368.out auth v1242 ap=1 s=87 n(v0 b87 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e64c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e3d:[<0x10000000d33/368.out v1014>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e3d:[<0x10000000d33/368.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.076 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.489+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f56 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/509.out auth v1250 ap=1 s=10321 n(v0 b10321 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022e4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f56:[<0x10000000d33/509.out v1110>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f56:[<0x10000000d33/509.out v1250>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.076 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.489+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c7a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/149.out auth v1262 ap=1 s=568 n(v0 b568 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e3fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c7a:[<0x10000000d33/149.out v604>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c7a:[<0x10000000d33/149.out v1262>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.076 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.490+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f19 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/478.out auth v1254 ap=1 s=137 n(v0 b137 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e41700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f19:[<0x10000000d33/478.out v1090>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f19:[<0x10000000d33/478.out v1254>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.076 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.492+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bb6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/055.out auth v1244 ap=1 s=4591 n(v0 b4591 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e1d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bb6:[<0x10000000d33/055.out v224>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bb6:[<0x10000000d33/055.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.077 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.492+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001708 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/017 auth v1278 ap=1 s=2070 n(v0 rc2023-10-18T14:05:25.777979+0000 b2070 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022a2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001708:[<0x10000000d33/017 v1212>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001708:[<0x10000000d33/017 v1278>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.077 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.493+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e10 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/346.out auth v1258 ap=1 s=315 n(v0 b315 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022a2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e10:[<0x10000000d33/346.out v1006>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e10:[<0x10000000d33/346.out v1258>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.077 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.493+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/196.out auth v1266 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0226b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd8:[<0x10000000d33/196.out v792>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cd8:[<0x10000000d33/196.out v1266>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.077 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.494+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c24 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/109.out auth v1260 ap=1 s=404 n(v0 b404 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0226bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c24:[<0x10000000d33/109.out v444>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c24:[<0x10000000d33/109.out v1260>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.078 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.494+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e25 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/356.out auth v1280 ap=1 s=71 n(v0 b71 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0226d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e25:[<0x10000000d33/356.out v1012>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e25:[<0x10000000d33/356.out v1280>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.078 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.495+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bfb [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/089.out auth v1270 ap=1 s=305 n(v0 b305 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0226d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bfb:[<0x10000000d33/089.out v362>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bfb:[<0x10000000d33/089.out v1270>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.078 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.495+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/428.out auth v1262 ap=1 s=83 n(v0 b83 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0226b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eb5:[<0x10000000d33/428.out v1052>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000eb5:[<0x10000000d33/428.out v1262>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.078 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.496+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed7 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/445.out auth v1264 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0226c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ed7:[<0x10000000d33/445.out v1070>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ed7:[<0x10000000d33/445.out v1264>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.078 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.497+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e61 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/386.out auth v1276 ap=1 s=134 n(v0 b134 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02259600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e61:[<0x10000000d33/386.out v1032>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e61:[<0x10000000d33/386.out v1276>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.079 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.497+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d8c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/280.out auth v1280 ap=1 s=311 n(v0 b311 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01d4a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d8c:[<0x10000000d33/280.out v972>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d8c:[<0x10000000d33/280.out v1280>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.079 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.497+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/195.out auth v1268 ap=1 s=346 n(v0 b346 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01d4a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd6:[<0x10000000d33/195.out v788>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cd6:[<0x10000000d33/195.out v1268>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.079 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.498+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c12 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/100.out auth v1270 ap=1 s=222 n(v0 b222 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01d4b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c12:[<0x10000000d33/100.out v408>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c12:[<0x10000000d33/100.out v1270>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.079 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.498+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d5c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/256.out auth v1310 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01d4c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d5c:[<0x10000000d33/256.out v962>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d5c:[<0x10000000d33/256.out v1310>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.080 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.498+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/326.out auth v1274 ap=1 s=597 n(v0 b597 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01d4c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de8:[<0x10000000d33/326.out v986>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000de8:[<0x10000000d33/326.out v1274>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.080 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.499+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b96 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/039.out auth v1306 ap=1 s=4591 n(v0 b4591 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01d4cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b96:[<0x10000000d33/039.out v160>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b96:[<0x10000000d33/039.out v1306>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.080 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.499+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b94 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/038.out auth v1272 ap=1 s=4516 n(v0 b4516 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01d4d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b94:[<0x10000000d33/038.out v156>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b94:[<0x10000000d33/038.out v1272>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.080 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.499+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed3 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/443.out auth v1286 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022cc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ed3:[<0x10000000d33/443.out v1066>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ed3:[<0x10000000d33/443.out v1286>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.080 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.500+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d4a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/247.out auth v1302 ap=1 s=42 n(v0 b42 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022ccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d4a:[<0x10000000d33/247.out v958>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d4a:[<0x10000000d33/247.out v1302>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.081 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.502+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dca [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/311.out auth v1308 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022b8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dca:[<0x10000000d33/311.out v980>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dca:[<0x10000000d33/311.out v1308>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.081 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.502+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e06 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/341.out auth v1230 ap=1 s=139 n(v0 b139 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02234100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e06:[<0x10000000d33/341.out v1012>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e06:[<0x10000000d33/341.out v1230>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.081 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.503+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e0a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/343.out auth v1244 ap=1 s=136 n(v0 b136 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02234c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e0a:[<0x10000000d33/343.out v1014>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e0a:[<0x10000000d33/343.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.081 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.503+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001705 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/014 auth v1240 ap=1 s=4887 n(v0 rc2023-10-18T14:05:25.766979+0000 b4887 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02234680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001705:[<0x10000000d33/014 v1180>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001705:[<0x10000000d33/014 v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.082 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.504+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/309.out auth v1246 ap=1 s=237 n(v0 b237 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02235700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc6:[<0x10000000d33/309.out v996>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dc6:[<0x10000000d33/309.out v1246>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.082 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.504+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001709 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018 auth v1258 ap=1 s=1571 n(v0 rc2023-10-18T14:05:25.780979+0000 b1571 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001709:[<0x10000000d33/018 v1184>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001709:[<0x10000000d33/018 v1258>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.082 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.505+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d0e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/222.out auth v1220 ap=1 s=51 n(v0 b51 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021fab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d0e:[<0x10000000d33/222.out v900>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d0e:[<0x10000000d33/222.out v1220>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.082 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.505+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f3a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/495.out auth v1228 ap=1 s=162 n(v0 b162 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02233b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f3a:[<0x10000000d33/495.out v1080>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f3a:[<0x10000000d33/495.out v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.082 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.505+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000df6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/333.out auth v1224 ap=1 s=139 n(v0 b139 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021fb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000df6:[<0x10000000d33/333.out v1004>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000df6:[<0x10000000d33/333.out v1224>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.083 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.507+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/318.out auth v1234 ap=1 s=392 n(v0 b392 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd8:[<0x10000000d33/318.out v1000>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dd8:[<0x10000000d33/318.out v1234>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.083 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.507+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dcc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/312.out auth v1218 ap=1 s=597 n(v0 b597 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dcc:[<0x10000000d33/312.out v998>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dcc:[<0x10000000d33/312.out v1218>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.083 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.507+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b84 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/031.out auth v1226 ap=1 s=3551 n(v0 b3551 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021fc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b84:[<0x10000000d33/031.out v124>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b84:[<0x10000000d33/031.out v1226>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.083 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.508+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c05 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/094.out auth v1232 ap=1 s=326 n(v0 b326 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c05:[<0x10000000d33/094.out v382>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c05:[<0x10000000d33/094.out v1232>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.084 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.508+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eaf [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/425.out auth v1236 ap=1 s=82 n(v0 b82 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021ea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eaf:[<0x10000000d33/425.out v1054>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000eaf:[<0x10000000d33/425.out v1236>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.084 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.508+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d7a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/271.out auth v1212 ap=1 s=300 n(v0 b300 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0209ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d7a:[<0x10000000d33/271.out v976>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d7a:[<0x10000000d33/271.out v1212>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.084 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.508+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e7d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/400.out auth v1228 ap=1 s=137 n(v0 b137 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0209b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e7d:[<0x10000000d33/400.out v1036>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e7d:[<0x10000000d33/400.out v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.084 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.509+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/294.out auth v1222 ap=1 s=61 n(v0 rc2023-10-18T14:05:15.614188+0000 b61 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd021ea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da8:[<0x10000000d33/294.out v990>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000da8:[<0x10000000d33/294.out v1222>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.084 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.509+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f38 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/494.out auth v1240 ap=1 s=91 n(v0 b91 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0209c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f38:[<0x10000000d33/494.out v1078>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f38:[<0x10000000d33/494.out v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.085 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.510+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d82 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/275.out auth v1226 ap=1 s=106 n(v0 b106 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0209c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d82:[<0x10000000d33/275.out v980>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d82:[<0x10000000d33/275.out v1226>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.085 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.510+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d66 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/261.out auth v1216 ap=1 s=44 n(v0 b44 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0209d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d66:[<0x10000000d33/261.out v974>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d66:[<0x10000000d33/261.out v1216>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.085 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.512+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c9c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/166.out auth v1222 ap=1 s=235 n(v0 b235 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd020a0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c9c:[<0x10000000d33/166.out v672>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c9c:[<0x10000000d33/166.out v1222>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.085 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.512+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/452.out auth v1236 ap=1 s=195 n(v0 b195 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd020a0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ee5:[<0x10000000d33/452.out v1058>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ee5:[<0x10000000d33/452.out v1236>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.086 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.512+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b80 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/029.out auth v1230 ap=1 s=1033 n(v0 b1033 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd020a0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b80:[<0x10000000d33/029.out v116>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b80:[<0x10000000d33/029.out v1230>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.086 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.513+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e89 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/406.out auth v1238 ap=1 s=91 n(v0 b91 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd020a1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e89:[<0x10000000d33/406.out v1042>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e89:[<0x10000000d33/406.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.086 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.513+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d8a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/279.out auth v1248 ap=1 s=750 n(v0 b750 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd020a1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d8a:[<0x10000000d33/279.out v984>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d8a:[<0x10000000d33/279.out v1248>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.086 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.514+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be5 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/078.out auth v1218 ap=1 s=6810 n(v0 b6810 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd020a2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be5:[<0x10000000d33/078.out v318>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000be5:[<0x10000000d33/078.out v1218>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.086 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.514+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b68 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/017.out auth v1214 ap=1 s=142 n(v0 b142 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd020a2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b68:[<0x10000000d33/017.out v68>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b68:[<0x10000000d33/017.out v1214>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.087 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.514+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e9b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/415.out auth v1250 ap=1 s=95 n(v0 b95 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e1ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e9b:[<0x10000000d33/415.out v1050>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e9b:[<0x10000000d33/415.out v1250>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.087 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.514+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/208.out auth v1238 ap=1 s=498 n(v0 b498 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01e1f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf0:[<0x10000000d33/208.out v840>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cf0:[<0x10000000d33/208.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.087 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.515+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b72 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/022.out auth v1228 ap=1 s=2170 n(v0 b2170 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd020fb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b72:[<0x10000000d33/022.out v88>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b72:[<0x10000000d33/022.out v1228>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.087 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.516+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e1b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/351.out auth v1242 ap=1 s=85 n(v0 b85 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd020fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e1b:[<0x10000000d33/351.out v1020>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e1b:[<0x10000000d33/351.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.088 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.517+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ebf [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/433.out auth v1238 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02073b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ebf:[<0x10000000d33/433.out v1052>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000ebf:[<0x10000000d33/433.out v1238>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.088 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.518+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dbe [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/305.out auth v1234 ap=1 s=140 n(v0 b140 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02074680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dbe:[<0x10000000d33/305.out v994>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dbe:[<0x10000000d33/305.out v1234>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.088 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.518+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/076.out auth v1236 ap=1 s=45 n(v0 b45 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd02074c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be1:[<0x10000000d33/076.out v310>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000be1:[<0x10000000d33/076.out v1236>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.088 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.518+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb8 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/180.out auth v1240 ap=1 s=376 n(v0 b376 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01920000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb8:[<0x10000000d33/180.out v728>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cb8:[<0x10000000d33/180.out v1240>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.088 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.519+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d06 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/218.out auth v1244 ap=1 s=516 n(v0 b516 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01921b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d06:[<0x10000000d33/218.out v884>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d06:[<0x10000000d33/218.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.089 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.520+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/472.out auth v1230 ap=1 s=134 n(v0 b134 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01922100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f0d:[<0x10000000d33/472.out v1076>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f0d:[<0x10000000d33/472.out v1230>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.089 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.520+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bb0 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/052.out auth v1232 ap=1 s=321 n(v0 b321 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01922680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bb0:[<0x10000000d33/052.out v212>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000bb0:[<0x10000000d33/052.out v1232>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.089 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.520+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f09 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/470.out auth v1270 ap=1 s=140 n(v0 b140 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022e4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f09:[<0x10000000d33/470.out v1080>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f09:[<0x10000000d33/470.out v1270>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.089 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.520+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b66 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/016.out auth v1244 ap=1 s=2210 n(v0 b2210 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022e5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b66:[<0x10000000d33/016.out v64>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000b66:[<0x10000000d33/016.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.090 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.521+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016fe [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/007 auth v1258 ap=1 s=1764 n(v0 rc2023-10-18T14:05:25.740980+0000 b1764 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022e6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016fe:[<0x10000000d33/007 v1202>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016fe:[<0x10000000d33/007 v1258>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.090 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.521+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/211.out auth v1250 ap=1 s=376 n(v0 b376 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf6:[<0x10000000d33/211.out v852>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cf6:[<0x10000000d33/211.out v1250>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.090 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.522+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d26 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/234.out auth v1256 ap=1 s=137 n(v0 b137 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022f0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d26:[<0x10000000d33/234.out v948>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d26:[<0x10000000d33/234.out v1256>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.090 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.522+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c50 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/128.out auth v1254 ap=1 s=1210 n(v0 b1210 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022f0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c50:[<0x10000000d33/128.out v520>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000c50:[<0x10000000d33/128.out v1254>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.090 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.523+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e67 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/389.out auth v1276 ap=1 s=134 n(v0 b134 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022f1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e67:[<0x10000000d33/389.out v1036>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e67:[<0x10000000d33/389.out v1276>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.091 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.523+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb1 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/426.out auth v1272 ap=1 s=82 n(v0 b82 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022f1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eb1:[<0x10000000d33/426.out v1056>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000eb1:[<0x10000000d33/426.out v1272>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.091 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.523+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d54 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/252.out auth v1246 ap=1 s=7697 n(v0 b7697 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd022f2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d54:[<0x10000000d33/252.out v964>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d54:[<0x10000000d33/252.out v1246>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.091 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.524+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d38 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/238.out auth v1242 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01fb6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d38:[<0x10000000d33/238.out v958>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000d38:[<0x10000000d33/238.out v1242>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.091 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.524+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f01 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/466.out auth v1254 ap=1 s=106 n(v0 b106 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01fb6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f01:[<0x10000000d33/466.out v1070>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000f01:[<0x10000000d33/466.out v1254>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.092 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.525+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd6 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/317.out auth v1252 ap=1 s=482 n(v0 b482 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01fb7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd6:[<0x10000000d33/317.out v1000>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000dd6:[<0x10000000d33/317.out v1252>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.092 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.525+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf4 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/210.out auth v1244 ap=1 s=717 n(v0 b717 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01fb9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf4:[<0x10000000d33/210.out v848>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000cf4:[<0x10000000d33/210.out v1244>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.092 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.527+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e35 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/364.out auth v1268 ap=1 s=75 n(v0 b75 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01977600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e35:[<0x10000000d33/364.out v1020>,<0x10000000135/xfs v13950>,<0x100000005e4/tests v1355>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000000e35:[<0x10000000d33/364.out v1268>,<0x10000000135/xfs v18967>,<0x100000005e4/tests v3532>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.092 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.528+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001314 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/ auth v143 ap=1 f(v0 m2023-10-18T14:05:22.754041+0000 3=2+1) n(v2 rc2023-10-18T14:05:22.754041+0000 b174669 54=52+2) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001314:[<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000001314:[<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.754041+0000 3=2+1)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.754041+0000 b174669 54=52+2)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.754041+0000 3=2+1)","memory_value.rstat":"n(v2 rc2023-10-18T14:05:22.754041+0000 b174669 54=52+2)","error_str":""},"return_code":0} 2023-10-18T14:05:43.092 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.528+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001312 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/ auth v141 ap=1 f(v0 m2023-10-18T14:05:22.744041+0000 7=7+0) n(v0 rc2023-10-18T14:05:22.744041+0000 b7222 8=7+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001312:[<0x1000000120d/simple v44>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000001312:[<0x1000000120d/simple v141>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.744041+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.744041+0000 b7222 8=7+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.744041+0000 7=7+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:22.744041+0000 b7222 8=7+1)","error_str":""},"return_code":0} 2023-10-18T14:05:43.093 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.529+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000120e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/Makefile auth v93 ap=1 s=347 n(v0 b347 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000120e:[<0x1000000120d/Makefile v2>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000120e:[<0x1000000120d/Makefile v93>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.093 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.529+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001318 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/ auth v149 ap=1 f(v0 m2023-10-18T14:05:22.797040+0000 11=6+5) n(v2 rc2023-10-18T14:05:22.801040+0000 b305397 50=44+6) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001318:[<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000001318:[<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.797040+0000 11=6+5)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.801040+0000 b305397 50=44+6)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.797040+0000 11=6+5)","memory_value.rstat":"n(v2 rc2023-10-18T14:05:22.801040+0000 b305397 50=44+6)","error_str":""},"return_code":0} 2023-10-18T14:05:43.093 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.529+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000120f [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/ auth v150 ap=1 f(v0 m2023-10-18T14:05:22.727042+0000 3=1+2) n(v2 rc2023-10-18T14:05:22.732042+0000 b89091 16=13+3) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd018a9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000120f:[<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x1000000120f:[<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.727042+0000 3=1+2)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.732042+0000 b89091 16=13+3)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.727042+0000 3=1+2)","memory_value.rstat":"n(v2 rc2023-10-18T14:05:22.732042+0000 b89091 16=13+3)","error_str":""},"return_code":0} 2023-10-18T14:05:43.093 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.529+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001215 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/ auth v139 ap=1 f(v0 m2023-10-18T14:05:22.737041+0000 8=8+0) n(v0 rc2023-10-18T14:05:22.738041+0000 b59087 9=8+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019a4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001215:[<0x1000000120d/sample_hsm v28>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000001215:[<0x1000000120d/sample_hsm v139>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.737041+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.738041+0000 b59087 9=8+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.737041+0000 8=8+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:22.738041+0000 b59087 9=8+1)","error_str":""},"return_code":0} 2023-10-18T14:05:43.094 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.530+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/tar/Makefile auth v4 ap=1 s=544 n(v0 rc2023-10-18T14:05:08.495334+0000 b544 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c9b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000001f:[<0x1000000001e/Makefile v2>,<0x1000000001a/tar v14>,<0x100000005e4/build v200>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000001f:[<0x1000000001e/Makefile v4>,<0x1000000001a/tar v28>,<0x100000005e4/build v3556>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.094 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.530+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/Makefile auth v12 ap=1 s=2216 n(v0 rc2023-10-18T14:05:08.492334+0000 b2216 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c9b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000001d:[<0x1000000001c/Makefile v2>,<0x1000000001a/rpm v10>,<0x100000005e4/build v200>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000001d:[<0x1000000001c/Makefile v12>,<0x1000000001a/rpm v30>,<0x100000005e4/build v3556>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.094 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.530+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010dc [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/xfstests.spec.in auth v16 ap=1 s=1317 n(v0 b1317 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c9c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010dc:[<0x1000000001c/xfstests.spec.in v10>,<0x1000000001a/rpm v19>,<0x100000005e4/build v1045>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010dc:[<0x1000000001c/xfstests.spec.in v16>,<0x1000000001a/rpm v30>,<0x100000005e4/build v3556>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.094 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.531+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000009 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack auth v131 ap=1 s=11600874 n(v0 rc2023-10-18T14:05:08.399336+0000 b11600874 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25030=0-25165824@2} caps={25030=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25030 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55fd0178e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000009:[<0x10000000007/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack v131>,<0x10000000006/pack v42>,<0x100000005e5/objects v134>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000009:[<0x10000000007/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack v131>,<0x10000000006/pack v42>,<0x100000005e5/objects v203>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.095 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.532+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000613 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/macros.template auth v14 ap=1 s=842 n(v0 b842 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01c9bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000613:[<0x1000000001c/macros.template v4>,<0x1000000001a/rpm v10>,<0x100000005e4/build v200>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000613:[<0x1000000001c/macros.template v14>,<0x1000000001a/rpm v30>,<0x100000005e4/build v3556>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.095 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.532+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx auth v134 ap=1 s=1277088 n(v0 rc2023-10-18T14:05:08.402335+0000 b1277088 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25030 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55fd0178eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000000a:[<0x10000000007/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx v134>,<0x10000000006/pack v42>,<0x100000005e5/objects v134>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000000a:[<0x10000000007/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx v134>,<0x10000000006/pack v42>,<0x100000005e5/objects v203>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.095 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.534+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000015 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/heads/ auth v15 ap=1 f(v0 m2023-10-18T14:05:08.449335+0000 1=1+0) n(v0 rc2023-10-18T14:05:08.450334+0000 b196 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd017ae680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000015:[<0x1000000000f/heads v8>,<0x1000000000e/refs v8>,<0x100000005e5/logs v171>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x10000000015:[<0x1000000000f/heads v15>,<0x1000000000e/refs v25>,<0x100000005e5/logs v282>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:08.449335+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:08.450334+0000 b196 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:08.449335+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:08.450334+0000 b196 2=1+1)","error_str":""},"return_code":0} 2023-10-18T14:05:43.095 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.534+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000010 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/ auth v13 ap=1 f(v0 m2023-10-18T14:05:08.440335+0000 1=0+1) n(v1 rc2023-10-18T14:05:08.442335+0000 b196 3=1+2) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd017aec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000010:[<0x1000000000f/remotes v4>,<0x1000000000e/refs v8>,<0x100000005e5/logs v171>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x10000000010:[<0x1000000000f/remotes v13>,<0x1000000000e/refs v25>,<0x100000005e5/logs v282>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:08.440335+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:08.442335+0000 b196 3=1+2)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:08.440335+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-10-18T14:05:08.442335+0000 b196 3=1+2)","error_str":""},"return_code":0} 2023-10-18T14:05:43.095 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.535+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000013 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/heads/master auth v8 ap=1 s=41 n(v0 rc2023-10-18T14:05:08.450334+0000 b41 1=1+0) (ifile excl) (iversion lock) cr={25030=0-4194304@2} caps={25030=pAsLsXsFsxcrwb/pFscr@2},l=25030 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01989b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000013:[<0x100000007e1/master v4>,<0x100000007e0/heads v14>,<0x100000005e5/refs v156>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000013:[<0x100000007e1/master v8>,<0x100000007e0/heads v23>,<0x100000005e5/refs v280>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.096 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.535+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000c [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/ auth v13 ap=1 f(v0 m2023-10-18T14:05:08.442335+0000 1=1+0) n(v1 rc2023-10-18T14:05:08.442335+0000 b32 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0198a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000000c:[<0x1000000000b/origin v8>,<0x100000007e0/remotes v8>,<0x100000005e5/refs v156>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x1000000000c:[<0x1000000000b/origin v13>,<0x100000007e0/remotes v25>,<0x100000005e5/refs v280>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:08.442335+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:08.442335+0000 b32 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:08.442335+0000 1=1+0)","memory_value.rstat":"n(v1 rc2023-10-18T14:05:08.442335+0000 b32 2=1+1)","error_str":""},"return_code":0} 2023-10-18T14:05:43.096 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.536+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001315 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/Makefile auth v115 ap=1 s=235 n(v0 rc2023-10-18T14:05:22.749041+0000 b235 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019a4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001315:[<0x10000001314/Makefile v2>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001315:[<0x10000001314/Makefile v115>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.096 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.536+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001316 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/ auth v211 ap=1 f(v0 m2023-10-18T14:05:22.754041+0000 50=50+0) n(v0 rc2023-10-18T14:05:22.754041+0000 b173211 51=50+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019a5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001316:[<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000001316:[<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.754041+0000 50=50+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.754041+0000 b173211 51=50+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.754041+0000 50=50+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:22.754041+0000 b173211 51=50+1)","error_str":""},"return_code":0} 2023-10-18T14:05:43.096 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.536+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001147 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/function_coverage auth v153 ap=1 s=1223 n(v0 b1223 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019a5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001147:[<0x10000001314/function_coverage v106>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001147:[<0x10000001314/function_coverage v153>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.096 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.536+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001113 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_getall_sessions.c auth v28 ap=1 s=1379 n(v0 rc2023-10-18T14:05:22.744041+0000 b1379 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019dc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001113:[<0x10000001312/dm_getall_sessions.c v10>,<0x1000000120d/simple v44>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001113:[<0x10000001312/dm_getall_sessions.c v28>,<0x1000000120d/simple v141>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.097 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.537+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001115 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_query_session.c auth v24 ap=1 s=1123 n(v0 b1123 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019dc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001115:[<0x10000001312/dm_query_session.c v14>,<0x1000000120d/simple v44>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001115:[<0x10000001312/dm_query_session.c v24>,<0x1000000120d/simple v141>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.097 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.537+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001313 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/Makefile auth v22 ap=1 s=593 n(v0 rc2023-10-18T14:05:22.743041+0000 b593 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019dcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001313:[<0x10000001312/Makefile v2>,<0x1000000120d/simple v44>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001313:[<0x10000001312/Makefile v22>,<0x1000000120d/simple v141>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.097 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.537+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001112 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_find_eventmsg.c auth v26 ap=1 s=1267 n(v0 b1267 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019dd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001112:[<0x10000001312/dm_find_eventmsg.c v8>,<0x1000000120d/simple v44>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001112:[<0x10000001312/dm_find_eventmsg.c v26>,<0x1000000120d/simple v141>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.097 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.538+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001111 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_destroy_session.c auth v16 ap=1 s=767 n(v0 b767 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019dd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001111:[<0x10000001312/dm_destroy_session.c v6>,<0x1000000120d/simple v44>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001111:[<0x10000001312/dm_destroy_session.c v16>,<0x1000000120d/simple v141>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.098 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.538+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001110 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_create_session.c auth v20 ap=1 s=872 n(v0 b872 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ddb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001110:[<0x10000001312/dm_create_session.c v4>,<0x1000000120d/simple v44>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001110:[<0x10000001312/dm_create_session.c v20>,<0x1000000120d/simple v141>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.098 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.538+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001114 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_getall_tokens.c auth v18 ap=1 s=1221 n(v0 b1221 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019de100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001114:[<0x10000001312/dm_getall_tokens.c v12>,<0x1000000120d/simple v44>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001114:[<0x10000001312/dm_getall_tokens.c v18>,<0x1000000120d/simple v141>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.098 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.539+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001152 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/create_cpio auth v169 ap=1 s=383 n(v0 b383 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019de680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001152:[<0x10000001318/create_cpio v28>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001152:[<0x10000001318/create_cpio v169>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.098 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.539+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001322 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/ auth v183 ap=1 f(v0 m2023-10-18T14:05:22.801040+0000 19=19+0) n(v0 rc2023-10-18T14:05:22.801040+0000 b161396 20=19+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019dec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001322:[<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000001322:[<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.801040+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.801040+0000 b161396 20=19+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.801040+0000 19=19+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:22.801040+0000 b161396 20=19+1)","error_str":""},"return_code":0} 2023-10-18T14:05:43.099 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.539+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/menu_test auth v101 ap=1 s=11053 n(v0 b11053 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019df180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115b:[<0x10000001318/menu_test v58>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000115b:[<0x10000001318/menu_test v101>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.099 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.540+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001319 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/DMAPI_aliases auth v121 ap=1 s=4915 n(v0 rc2023-10-18T14:05:22.778041+0000 b4915 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019df700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001319:[<0x10000001318/DMAPI_aliases v2>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001319:[<0x10000001318/DMAPI_aliases v121>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.099 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.540+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131a [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/ auth v177 ap=1 f(v0 m2023-10-18T14:05:22.783041+0000 8=8+0) n(v0 rc2023-10-18T14:05:22.783041+0000 b50962 9=8+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019e6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000131a:[<0x10000001318/bindir v26>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x1000000131a:[<0x10000001318/bindir v177>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.783041+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.783041+0000 b50962 9=8+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.783041+0000 8=8+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:22.783041+0000 b50962 9=8+1)","error_str":""},"return_code":0} 2023-10-18T14:05:43.099 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.540+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001148 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/Makefile auth v145 ap=1 s=235 n(v0 b235 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019e7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001148:[<0x10000001318/Makefile v4>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001148:[<0x10000001318/Makefile v145>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.099 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.540+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001320 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/lib/ auth v163 ap=1 f(v0 m2023-10-18T14:05:22.796040+0000 1=1+0) n(v0 rc2023-10-18T14:05:22.797040+0000 b5026 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019e6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001320:[<0x10000001318/lib v56>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000001320:[<0x10000001318/lib v163>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.796040+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.797040+0000 b5026 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.796040+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:22.797040+0000 b5026 2=1+1)","error_str":""},"return_code":0} 2023-10-18T14:05:43.100 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.541+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001149 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/README auth v123 ap=1 s=24623 n(v0 b24623 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019e7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001149:[<0x10000001318/README v6>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001149:[<0x10000001318/README v123>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.100 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.541+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131e [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/dist/ auth v111 ap=1 f(v0 m2023-10-18T14:05:22.794040+0000 1=1+0) n(v0 rc2023-10-18T14:05:22.795040+0000 b17157 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019e6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000131e:[<0x10000001318/dist v52>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x1000000131e:[<0x10000001318/dist v111>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.794040+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.795040+0000 b17157 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.794040+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:22.795040+0000 b17157 2=1+1)","error_str":""},"return_code":0} 2023-10-18T14:05:43.100 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.542+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/README_for_check_dmapi auth v149 ap=1 s=1032 n(v0 b1032 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019e7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114a:[<0x10000001318/README_for_check_dmapi v8>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000114a:[<0x10000001318/README_for_check_dmapi v149>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.100 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.543+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131c [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/ auth v187 ap=1 f(v0 m2023-10-18T14:05:22.789040+0000 9=9+0) n(v0 rc2023-10-18T14:05:22.789040+0000 b28615 10=9+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019e8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000131c:[<0x10000001318/data v48>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x1000000131c:[<0x10000001318/data v187>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.789040+0000 9=9+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.789040+0000 b28615 10=9+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.789040+0000 9=9+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:22.789040+0000 b28615 10=9+1)","error_str":""},"return_code":0} 2023-10-18T14:05:43.100 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.543+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001213 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/ auth v57 ap=1 f(v0 m2023-10-18T14:05:22.732042+0000 7=7+0) n(v0 rc2023-10-18T14:05:22.732042+0000 b73914 8=7+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a1c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001213:[<0x1000000120f/lib v30>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000001213:[<0x1000000120f/lib v57>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.732042+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.732042+0000 b73914 8=7+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.732042+0000 7=7+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:22.732042+0000 b73914 8=7+1)","error_str":""},"return_code":0} 2023-10-18T14:05:43.101 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.543+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001210 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/Makefile auth v39 ap=1 s=333 n(v0 rc2023-10-18T14:05:22.725042+0000 b333 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a1c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001210:[<0x1000000120f/Makefile v2>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001210:[<0x1000000120f/Makefile v39>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.101 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.543+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001211 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/ auth v55 ap=1 f(v0 m2023-10-18T14:05:22.727042+0000 5=5+0) n(v0 rc2023-10-18T14:05:22.727042+0000 b14844 6=5+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a1cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001211:[<0x1000000120f/cmd v14>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000001211:[<0x1000000120f/cmd v55>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:22.727042+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:22.727042+0000 b14844 6=5+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:22.727042+0000 5=5+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:22.727042+0000 b14844 6=5+1)","error_str":""},"return_code":0} 2023-10-18T14:05:43.101 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.544+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/wbee.c auth v24 ap=1 s=13636 n(v0 rc2023-10-18T14:05:22.738041+0000 b13636 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a6f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110f:[<0x10000001215/wbee.c v16>,<0x1000000120d/sample_hsm v28>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000110f:[<0x10000001215/wbee.c v24>,<0x1000000120d/sample_hsm v139>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.101 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.544+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001109 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migfind.c auth v18 ap=1 s=6746 n(v0 b6746 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a6fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001109:[<0x10000001215/migfind.c v6>,<0x1000000120d/sample_hsm v28>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001109:[<0x10000001215/migfind.c v18>,<0x1000000120d/sample_hsm v139>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.102 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.544+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migout.c auth v28 ap=1 s=13278 n(v0 b13278 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a70100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110b:[<0x10000001215/migout.c v10>,<0x1000000120d/sample_hsm v28>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000110b:[<0x10000001215/migout.c v28>,<0x1000000120d/sample_hsm v139>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.102 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.544+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migin.c auth v26 ap=1 s=8505 n(v0 b8505 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a70680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110a:[<0x10000001215/migin.c v8>,<0x1000000120d/sample_hsm v28>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000110a:[<0x10000001215/migin.c v26>,<0x1000000120d/sample_hsm v139>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.102 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.545+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/mrmean.c auth v22 ap=1 s=6584 n(v0 b6584 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a70c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110e:[<0x10000001215/mrmean.c v14>,<0x1000000120d/sample_hsm v28>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000110e:[<0x10000001215/mrmean.c v22>,<0x1000000120d/sample_hsm v139>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.102 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.546+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001216 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/Makefile auth v32 ap=1 s=563 n(v0 rc2023-10-18T14:05:22.737041+0000 b563 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a71180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001216:[<0x10000001215/Makefile v2>,<0x1000000120d/sample_hsm v28>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001216:[<0x10000001215/Makefile v32>,<0x1000000120d/sample_hsm v139>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.102 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.546+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001108 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/README auth v30 ap=1 s=2366 n(v0 b2366 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a71700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001108:[<0x10000001215/README v4>,<0x1000000120d/sample_hsm v28>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001108:[<0x10000001215/README v30>,<0x1000000120d/sample_hsm v139>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.103 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.546+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/mls.c auth v20 ap=1 s=7409 n(v0 b7409 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a24000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110d:[<0x10000001215/mls.c v12>,<0x1000000120d/sample_hsm v28>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000110d:[<0x10000001215/mls.c v20>,<0x1000000120d/sample_hsm v139>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.103 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.546+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000016 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master auth v4 ap=1 s=196 n(v0 rc2023-10-18T14:05:08.450334+0000 b196 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd017af180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000016:[<0x10000000015/master v2>,<0x1000000000f/heads v8>,<0x1000000000e/refs v8>,<0x100000005e5/logs v171>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000016:[<0x10000000015/master v4>,<0x1000000000f/heads v15>,<0x1000000000e/refs v25>,<0x100000005e5/logs v282>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.103 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.546+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000011 [...3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/ auth v7 ap=1 f(v0 m2023-10-18T14:05:08.440335+0000 1=1+0) n(v0 rc2023-10-18T14:05:08.442335+0000 b196 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={25030=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25030 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd017af700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000011:[<0x10000000010/origin v4>,<0x1000000000f/remotes v4>,<0x1000000000e/refs v8>,<0x100000005e5/logs v171>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x10000000011:[<0x10000000010/origin v7>,<0x1000000000f/remotes v13>,<0x1000000000e/refs v25>,<0x100000005e5/logs v282>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-18T14:05:08.440335+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-18T14:05:08.442335+0000 b196 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-18T14:05:08.440335+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-10-18T14:05:08.442335+0000 b196 2=1+1)","error_str":""},"return_code":0} 2023-10-18T14:05:43.103 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.547+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD auth v8 ap=1 s=32 n(v0 rc2023-10-18T14:05:08.442335+0000 b32 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd0198a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000000d:[<0x1000000000c/HEAD v4>,<0x1000000000b/origin v8>,<0x100000007e0/remotes v8>,<0x100000005e5/refs v156>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000000d:[<0x1000000000c/HEAD v8>,<0x1000000000b/origin v13>,<0x100000007e0/remotes v25>,<0x100000005e5/refs v280>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.104 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.547+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_dmattr.c auth v146 ap=1 s=2588 n(v0 b2588 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019a5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111d:[<0x10000001316/get_dmattr.c v18>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000111d:[<0x10000001316/get_dmattr.c v146>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.104 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.547+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001129 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/make_rt_sparse.c auth v140 ap=1 s=3033 n(v0 b3033 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019a6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001129:[<0x10000001316/make_rt_sparse.c v42>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001129:[<0x10000001316/make_rt_sparse.c v140>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.104 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.547+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001136 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/query_right.c auth v198 ap=1 s=2513 n(v0 b2513 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019a6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001136:[<0x10000001316/query_right.c v68>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001136:[<0x10000001316/query_right.c v198>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.104 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.548+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/respond_event.c auth v162 ap=1 s=1699 n(v0 b1699 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019a6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113b:[<0x10000001316/respond_event.c v78>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000113b:[<0x10000001316/respond_event.c v162>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.104 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.548+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001127 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/init_service.c auth v188 ap=1 s=775 n(v0 b775 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019a7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001127:[<0x10000001316/init_service.c v38>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001127:[<0x10000001316/init_service.c v188>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.105 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.548+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001134 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/probe_punch_xfsctl_hole.c auth v136 ap=1 s=3870 n(v0 b3870 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019a7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001134:[<0x10000001316/probe_punch_xfsctl_hole.c v64>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001134:[<0x10000001316/probe_punch_xfsctl_hole.c v136>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.105 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.548+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_config_events.c auth v192 ap=1 s=3822 n(v0 b3822 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019aa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111b:[<0x10000001316/get_config_events.c v14>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000111b:[<0x10000001316/get_config_events.c v192>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.105 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.548+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/make_sparse.c auth v124 ap=1 s=1577 n(v0 b1577 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019aa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112a:[<0x10000001316/make_sparse.c v44>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000112a:[<0x10000001316/make_sparse.c v124>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.105 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.549+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/security_hole2.c auth v122 ap=1 s=1761 n(v0 b1761 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019aab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113e:[<0x10000001316/security_hole2.c v84>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000113e:[<0x10000001316/security_hole2.c v122>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.106 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.549+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/rwt.c auth v138 ap=1 s=3400 n(v0 b3400 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ab080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113c:[<0x10000001316/rwt.c v80>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000113c:[<0x10000001316/rwt.c v138>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.106 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.549+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001144 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/sync_by_handle.c auth v104 ap=1 s=1802 n(v0 b1802 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ab600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001144:[<0x10000001316/sync_by_handle.c v96>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001144:[<0x10000001316/sync_by_handle.c v104>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.106 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.549+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_allocinfo.c auth v102 ap=1 s=9601 n(v0 b9601 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019abb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111a:[<0x10000001316/get_allocinfo.c v12>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000111a:[<0x10000001316/get_allocinfo.c v102>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.106 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.549+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/security_hole.c auth v184 ap=1 s=1772 n(v0 b1772 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ac100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113d:[<0x10000001316/security_hole.c v82>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000113d:[<0x10000001316/security_hole.c v184>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.106 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.550+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001133 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/probe_hole.c auth v142 ap=1 s=2254 n(v0 b2254 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001133:[<0x10000001316/probe_hole.c v62>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001133:[<0x10000001316/probe_hole.c v142>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.107 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.550+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_disp.c auth v132 ap=1 s=3332 n(v0 b3332 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019acc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113f:[<0x10000001316/set_disp.c v86>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000113f:[<0x10000001316/set_disp.c v132>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.107 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.551+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001118 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/downgrade_right.c auth v148 ap=1 s=2436 n(v0 b2436 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ad700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001118:[<0x10000001316/downgrade_right.c v8>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001118:[<0x10000001316/downgrade_right.c v148>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.107 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.551+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001119 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/fd_to_handle.c auth v150 ap=1 s=1271 n(v0 b1271 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ad180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001119:[<0x10000001316/fd_to_handle.c v10>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001119:[<0x10000001316/fd_to_handle.c v150>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.107 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.551+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_rele.c auth v190 ap=1 s=2425 n(v0 b2425 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019b8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112d:[<0x10000001316/obj_ref_rele.c v50>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000112d:[<0x10000001316/obj_ref_rele.c v190>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.108 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.552+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001121 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_mountinfo.c auth v120 ap=1 s=2665 n(v0 rc2023-10-18T14:05:22.752041+0000 b2665 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019b8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001121:[<0x10000001316/get_mountinfo.c v26>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001121:[<0x10000001316/get_mountinfo.c v120>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.108 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.552+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001126 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/handle_to_path.c auth v182 ap=1 s=3223 n(v0 b3223 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019b8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001126:[<0x10000001316/handle_to_path.c v36>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001126:[<0x10000001316/handle_to_path.c v182>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.108 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.552+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001142 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_fileattr.c auth v200 ap=1 s=7852 n(v0 b7852 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019b9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001142:[<0x10000001316/set_fileattr.c v92>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001142:[<0x10000001316/set_fileattr.c v200>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.108 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.553+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001139 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/remove_dmattr.c auth v168 ap=1 s=2016 n(v0 b2016 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019b9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001139:[<0x10000001316/remove_dmattr.c v74>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001139:[<0x10000001316/remove_dmattr.c v168>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.108 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.553+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001124 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/getall_dmattr.c auth v164 ap=1 s=2733 n(v0 b2733 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019b9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001124:[<0x10000001316/getall_dmattr.c v32>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001124:[<0x10000001316/getall_dmattr.c v164>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.109 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.553+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001128 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/link_test.c auth v186 ap=1 s=5825 n(v0 b5825 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001128:[<0x10000001316/link_test.c v40>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001128:[<0x10000001316/link_test.c v186>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.109 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.553+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001317 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/Makefile auth v114 ap=1 s=1462 n(v0 rc2023-10-18T14:05:22.751041+0000 b1462 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019bac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001317:[<0x10000001316/Makefile v2>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001317:[<0x10000001316/Makefile v114>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.109 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.554+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001117 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/dm_handle.c auth v130 ap=1 s=6784 n(v0 b6784 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ba680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001117:[<0x10000001316/dm_handle.c v6>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001117:[<0x10000001316/dm_handle.c v130>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.109 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.554+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/path_to_fshandle.c auth v110 ap=1 s=1244 n(v0 b1244 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019bb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112e:[<0x10000001316/path_to_fshandle.c v52>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000112e:[<0x10000001316/path_to_fshandle.c v110>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.110 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.554+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001140 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_dmattr.c auth v180 ap=1 s=2342 n(v0 b2342 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019bb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001140:[<0x10000001316/set_dmattr.c v88>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001140:[<0x10000001316/set_dmattr.c v180>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.110 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.554+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001145 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/test_assumption.c auth v178 ap=1 s=3356 n(v0 b3356 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019c0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001145:[<0x10000001316/test_assumption.c v98>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001145:[<0x10000001316/test_assumption.c v178>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.110 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.554+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001125 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/handle_to_fshandle.c auth v112 ap=1 s=1403 n(v0 b1403 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019c0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001125:[<0x10000001316/handle_to_fshandle.c v34>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001125:[<0x10000001316/handle_to_fshandle.c v112>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.110 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.555+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001141 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_eventlist.c auth v158 ap=1 s=3244 n(v0 b3244 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001141:[<0x10000001316/set_eventlist.c v90>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001141:[<0x10000001316/set_eventlist.c v158>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.110 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.555+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001137 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/randomize_file.c auth v126 ap=1 s=3021 n(v0 b3021 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019c1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001137:[<0x10000001316/randomize_file.c v70>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001137:[<0x10000001316/randomize_file.c v126>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.111 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.555+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001130 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/pending.c auth v160 ap=1 s=1198 n(v0 b1198 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019c1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001130:[<0x10000001316/pending.c v56>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001130:[<0x10000001316/pending.c v160>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.111 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.555+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_hold.c auth v174 ap=1 s=2425 n(v0 b2425 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019c1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112b:[<0x10000001316/obj_ref_hold.c v46>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000112b:[<0x10000001316/obj_ref_hold.c v174>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.111 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.555+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001122 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_region.c auth v166 ap=1 s=2424 n(v0 b2424 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019c2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001122:[<0x10000001316/get_region.c v28>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001122:[<0x10000001316/get_region.c v166>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.111 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.555+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_events.c auth v118 ap=1 s=2301 n(v0 b2301 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019c2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111f:[<0x10000001316/get_events.c v22>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000111f:[<0x10000001316/get_events.c v118>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.112 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.556+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001116 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/create_userevent.c auth v152 ap=1 s=1646 n(v0 b1646 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019c2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001116:[<0x10000001316/create_userevent.c v4>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001116:[<0x10000001316/create_userevent.c v152>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.112 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.556+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/request_right.c auth v156 ap=1 s=2967 n(v0 b2967 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113a:[<0x10000001316/request_right.c v76>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000113a:[<0x10000001316/request_right.c v156>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.112 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.556+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001143 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/struct_test.c auth v170 ap=1 s=5573 n(v0 b5573 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019c3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001143:[<0x10000001316/struct_test.c v94>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001143:[<0x10000001316/struct_test.c v170>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.112 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.556+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_dirattrs.c auth v194 ap=1 s=3396 n(v0 b3396 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ce000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111c:[<0x10000001316/get_dirattrs.c v16>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000111c:[<0x10000001316/get_dirattrs.c v194>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.112 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.556+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001135 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/punch_hole.c auth v172 ap=1 s=2092 n(v0 b2092 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ce580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001135:[<0x10000001316/punch_hole.c v66>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001135:[<0x10000001316/punch_hole.c v172>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.113 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.557+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001123 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/getall_disp.c auth v154 ap=1 s=2389 n(v0 b2389 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001123:[<0x10000001316/getall_disp.c v30>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001123:[<0x10000001316/getall_disp.c v154>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.113 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.557+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001138 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/release_right.c auth v106 ap=1 s=2429 n(v0 b2429 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001138:[<0x10000001316/release_right.c v72>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001138:[<0x10000001316/release_right.c v106>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.113 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.557+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001132 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/print_fshandle.c auth v176 ap=1 s=1311 n(v0 b1311 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019cf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001132:[<0x10000001316/print_fshandle.c v60>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001132:[<0x10000001316/print_fshandle.c v176>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.113 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.557+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001146 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/upgrade_right.c auth v108 ap=1 s=2429 n(v0 b2429 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019cfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001146:[<0x10000001316/upgrade_right.c v100>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001146:[<0x10000001316/upgrade_right.c v108>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.113 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.558+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001131 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/print_event.c auth v116 ap=1 s=32037 n(v0 rc2023-10-18T14:05:22.753041+0000 b32037 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019d0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001131:[<0x10000001316/print_event.c v58>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001131:[<0x10000001316/print_event.c v116>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.114 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.559+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/path_to_handle.c auth v134 ap=1 s=1218 n(v0 b1218 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019d1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112f:[<0x10000001316/path_to_handle.c v54>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000112f:[<0x10000001316/path_to_handle.c v134>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.114 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.559+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_eventlist.c auth v128 ap=1 s=4755 n(v0 b4755 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019d0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111e:[<0x10000001316/get_eventlist.c v20>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000111e:[<0x10000001316/get_eventlist.c v128>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.114 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.559+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_query.c auth v196 ap=1 s=2569 n(v0 b2569 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019d0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112c:[<0x10000001316/obj_ref_query.c v48>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000112c:[<0x10000001316/obj_ref_query.c v196>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.114 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.559+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001120 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_fileattr.c auth v144 ap=1 s=2951 n(v0 b2951 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019d1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001120:[<0x10000001316/get_fileattr.c v24>,<0x10000001314/cmd v104>,<0x1000000120d/suite1 v52>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001120:[<0x10000001316/get_fileattr.c v144>,<0x10000001314/cmd v211>,<0x1000000120d/suite1 v143>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.115 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.559+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001169 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_fileattr.c auth v70 ap=1 s=21346 n(v0 rc2023-10-18T14:05:22.801040+0000 b21346 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019e8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001169:[<0x10000001322/test_fileattr.c v30>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001169:[<0x10000001322/test_fileattr.c v70>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.115 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.560+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001165 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_bulkattr.c auth v54 ap=1 s=6593 n(v0 b6593 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019e8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001165:[<0x10000001322/test_bulkattr.c v22>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001165:[<0x10000001322/test_bulkattr.c v54>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.115 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.560+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_rights.c auth v64 ap=1 s=6861 n(v0 b6861 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019e9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116d:[<0x10000001322/test_rights.c v38>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000116d:[<0x10000001322/test_rights.c v64>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.115 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.560+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001160 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mmap.c auth v62 ap=1 s=6337 n(v0 b6337 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019e9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001160:[<0x10000001322/mmap.c v12>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001160:[<0x10000001322/mmap.c v62>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.115 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.560+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001164 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_bulkall.c auth v40 ap=1 s=7034 n(v0 b7034 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019f4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001164:[<0x10000001322/test_bulkall.c v20>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001164:[<0x10000001322/test_bulkall.c v40>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.116 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.560+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_hole.c auth v42 ap=1 s=9547 n(v0 b9547 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019f4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116a:[<0x10000001322/test_hole.c v32>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000116a:[<0x10000001322/test_hole.c v42>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.116 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.561+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001323 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/Makefile auth v48 ap=1 s=810 n(v0 b810 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019f4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001323:[<0x10000001322/Makefile v2>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001323:[<0x10000001322/Makefile v48>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.116 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.561+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/dm_test_daemon.c auth v56 ap=1 s=32794 n(v0 b32794 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019f5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115d:[<0x10000001322/dm_test_daemon.c v6>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000115d:[<0x10000001322/dm_test_daemon.c v56>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.116 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.561+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mm_fill.c auth v60 ap=1 s=1330 n(v0 b1330 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019f5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115f:[<0x10000001322/mm_fill.c v10>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000115f:[<0x10000001322/mm_fill.c v60>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.117 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.561+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/invis_test.c auth v44 ap=1 s=4898 n(v0 b4898 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115e:[<0x10000001322/invis_test.c v8>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000115e:[<0x10000001322/invis_test.c v44>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.117 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.562+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/check_dmapi.c auth v52 ap=1 s=5488 n(v0 b5488 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019f6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115c:[<0x10000001322/check_dmapi.c v4>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000115c:[<0x10000001322/check_dmapi.c v52>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.117 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.562+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001168 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_eventlist.c auth v58 ap=1 s=13049 n(v0 b13049 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019f6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001168:[<0x10000001322/test_eventlist.c v28>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001168:[<0x10000001322/test_eventlist.c v58>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.117 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.562+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001163 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/send_msg.c auth v76 ap=1 s=1796 n(v0 b1796 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019f6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001163:[<0x10000001322/send_msg.c v18>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001163:[<0x10000001322/send_msg.c v76>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.117 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.562+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_invis.c auth v50 ap=1 s=11929 n(v0 b11929 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019f7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116b:[<0x10000001322/test_invis.c v34>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000116b:[<0x10000001322/test_invis.c v50>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.118 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.562+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001167 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_efault.c auth v66 ap=1 s=6436 n(v0 b6436 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019f7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001167:[<0x10000001322/test_efault.c v26>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001167:[<0x10000001322/test_efault.c v66>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.118 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.563+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001162 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/region_test.c auth v68 ap=1 s=2806 n(v0 b2806 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019fe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001162:[<0x10000001322/region_test.c v16>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001162:[<0x10000001322/region_test.c v68>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.118 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.563+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001166 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_dmattr.c auth v74 ap=1 s=14402 n(v0 b14402 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019feb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001166:[<0x10000001322/test_dmattr.c v24>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001166:[<0x10000001322/test_dmattr.c v74>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.118 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.563+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001161 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mmap_cp.c auth v46 ap=1 s=1233 n(v0 b1233 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019fe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001161:[<0x10000001322/mmap_cp.c v14>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001161:[<0x10000001322/mmap_cp.c v46>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.119 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.563+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_region.c auth v72 ap=1 s=6707 n(v0 b6707 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019a4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116c:[<0x10000001322/test_region.c v36>,<0x10000001318/src v98>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000116c:[<0x10000001322/test_region.c v72>,<0x10000001318/src v183>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.119 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.564+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001321 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/lib/errtest.h auth v4 ap=1 s=5026 n(v0 rc2023-10-18T14:05:22.797040+0000 b5026 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ff080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001321:[<0x10000001320/errtest.h v2>,<0x10000001318/lib v56>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001321:[<0x10000001320/errtest.h v4>,<0x10000001318/lib v163>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.119 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.565+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/dist/README auth v4 ap=1 s=17157 n(v0 rc2023-10-18T14:05:22.795040+0000 b17157 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131f:[<0x1000000131e/README v2>,<0x10000001318/dist v52>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000131f:[<0x1000000131e/README v4>,<0x10000001318/dist v111>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.119 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.565+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114c [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/ls_to_copy auth v26 ap=1 s=29696 n(v0 b29696 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd019ffb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114c:[<0x1000000131a/ls_to_copy v6>,<0x10000001318/bindir v26>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000114c:[<0x1000000131a/ls_to_copy v26>,<0x10000001318/bindir v177>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.120 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.565+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114e [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/run_test auth v30 ap=1 s=16380 n(v0 b16380 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a00100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114e:[<0x1000000131a/run_test v10>,<0x10000001318/bindir v26>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000114e:[<0x1000000131a/run_test v30>,<0x10000001318/bindir v177>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.120 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.565+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001150 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/test_allocinfo_1 auth v32 ap=1 s=1736 n(v0 b1736 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a00680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001150:[<0x1000000131a/test_allocinfo_1 v14>,<0x10000001318/bindir v26>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001150:[<0x1000000131a/test_allocinfo_1 v32>,<0x10000001318/bindir v177>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.120 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.565+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001151 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/test_allocinfo_2 auth v22 ap=1 s=1846 n(v0 b1846 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a00c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001151:[<0x1000000131a/test_allocinfo_2 v16>,<0x10000001318/bindir v26>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001151:[<0x1000000131a/test_allocinfo_2 v22>,<0x10000001318/bindir v177>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.120 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.565+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/make_holey auth v24 ap=1 s=469 n(v0 b469 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a01180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114d:[<0x1000000131a/make_holey v8>,<0x10000001318/bindir v26>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000114d:[<0x1000000131a/make_holey v24>,<0x10000001318/bindir v177>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.120 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.566+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/ctf auth v20 ap=1 s=280 n(v0 b280 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a01700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114b:[<0x1000000131a/ctf v4>,<0x10000001318/bindir v26>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000114b:[<0x1000000131a/ctf v20>,<0x10000001318/bindir v177>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.121 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.566+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131b [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/crttf auth v28 ap=1 s=270 n(v0 rc2023-10-18T14:05:22.782041+0000 b270 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a0c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131b:[<0x1000000131a/crttf v2>,<0x10000001318/bindir v26>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000131b:[<0x1000000131a/crttf v28>,<0x10000001318/bindir v177>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.121 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.566+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114f [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/stf auth v18 ap=1 s=285 n(v0 b285 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a0c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114f:[<0x1000000131a/stf v12>,<0x10000001318/bindir v26>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000114f:[<0x1000000131a/stf v18>,<0x10000001318/bindir v177>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.121 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.566+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001157 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/realtime.dat auth v26 ap=1 s=2716 n(v0 b2716 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a0cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001157:[<0x1000000131c/realtime.dat v12>,<0x10000001318/data v48>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001157:[<0x1000000131c/realtime.dat v26>,<0x10000001318/data v187>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.121 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.567+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001156 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/pending_nfs.dat auth v20 ap=1 s=1007 n(v0 b1007 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a0d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001156:[<0x1000000131c/pending_nfs.dat v10>,<0x10000001318/data v48>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001156:[<0x1000000131c/pending_nfs.dat v20>,<0x10000001318/data v187>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.122 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.567+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001155 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/pending.dat auth v28 ap=1 s=1447 n(v0 b1447 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a0d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001155:[<0x1000000131c/pending.dat v8>,<0x10000001318/data v48>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001155:[<0x1000000131c/pending.dat v28>,<0x10000001318/data v187>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.122 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.567+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131d [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/fail.dat auth v34 ap=1 s=2342 n(v0 rc2023-10-18T14:05:22.789040+0000 b2342 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a0db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131d:[<0x1000000131c/fail.dat v2>,<0x10000001318/data v48>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000131d:[<0x1000000131c/fail.dat v34>,<0x10000001318/data v187>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.122 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.567+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001159 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/standard.dat auth v22 ap=1 s=7129 n(v0 b7129 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a0e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001159:[<0x1000000131c/standard.dat v16>,<0x10000001318/data v48>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001159:[<0x1000000131c/standard.dat v22>,<0x10000001318/data v187>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.122 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.568+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001158 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/smallq.dat auth v36 ap=1 s=1869 n(v0 b1869 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a0ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001158:[<0x1000000131c/smallq.dat v14>,<0x10000001318/data v48>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001158:[<0x1000000131c/smallq.dat v36>,<0x10000001318/data v187>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.122 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.568+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115a [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/standard_nfs.dat auth v30 ap=1 s=5246 n(v0 b5246 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a0e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115a:[<0x1000000131c/standard_nfs.dat v18>,<0x10000001318/data v48>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000115a:[<0x1000000131c/standard_nfs.dat v30>,<0x10000001318/data v187>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.123 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.568+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001154 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/nfs.dat auth v24 ap=1 s=3702 n(v0 b3702 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a0f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001154:[<0x1000000131c/nfs.dat v6>,<0x10000001318/data v48>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001154:[<0x1000000131c/nfs.dat v24>,<0x10000001318/data v187>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.123 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.568+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001103 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/find_session.c auth v24 ap=1 s=5074 n(v0 b5074 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a1d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001103:[<0x10000001213/find_session.c v6>,<0x1000000120f/lib v30>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001103:[<0x10000001213/find_session.c v24>,<0x1000000120f/lib v57>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.123 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.569+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001153 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/main.dat auth v32 ap=1 s=3157 n(v0 b3157 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a0f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001153:[<0x1000000131c/main.dat v4>,<0x10000001318/data v48>,<0x1000000120d/suite2 v76>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001153:[<0x1000000131c/main.dat v32>,<0x10000001318/data v187>,<0x1000000120d/suite2 v149>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.123 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.569+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001106 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/stubs.c auth v16 ap=1 s=9707 n(v0 b9707 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a1d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001106:[<0x10000001213/stubs.c v12>,<0x1000000120f/lib v30>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001106:[<0x10000001213/stubs.c v16>,<0x1000000120f/lib v57>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.123 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.569+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001104 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/hsm.h auth v28 ap=1 s=4046 n(v0 b4046 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a1e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001104:[<0x10000001213/hsm.h v8>,<0x1000000120f/lib v30>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001104:[<0x10000001213/hsm.h v28>,<0x1000000120f/lib v57>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.124 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.569+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001214 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/Makefile auth v22 ap=1 s=484 n(v0 rc2023-10-18T14:05:22.731042+0000 b484 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a1db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001214:[<0x10000001213/Makefile v2>,<0x1000000120f/lib v30>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001214:[<0x10000001213/Makefile v22>,<0x1000000120f/lib v57>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.124 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.570+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001105 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/print.c auth v20 ap=1 s=14336 n(v0 b14336 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a1e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001105:[<0x10000001213/print.c v10>,<0x1000000120f/lib v30>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001105:[<0x10000001213/print.c v20>,<0x1000000120f/lib v57>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.124 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.570+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001107 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/util.c auth v18 ap=1 s=21272 n(v0 b21272 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a1f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001107:[<0x10000001213/util.c v14>,<0x1000000120f/lib v30>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001107:[<0x10000001213/util.c v18>,<0x1000000120f/lib v57>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.124 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.570+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001102 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/dmport.h auth v26 ap=1 s=18995 n(v0 rc2023-10-18T14:05:22.732042+0000 b18995 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a1ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001102:[<0x10000001213/dmport.h v4>,<0x1000000120f/lib v30>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001102:[<0x10000001213/dmport.h v26>,<0x1000000120f/lib v57>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.125 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.570+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ff [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/set_region.c auth v14 ap=1 s=3250 n(v0 b3250 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a6e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ff:[<0x10000001211/set_region.c v6>,<0x1000000120f/cmd v14>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010ff:[<0x10000001211/set_region.c v14>,<0x1000000120f/cmd v55>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.125 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.571+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001100 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/set_return_on_destroy.c auth v18 ap=1 s=2762 n(v0 b2762 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a1f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001100:[<0x10000001211/set_return_on_destroy.c v8>,<0x1000000120f/cmd v14>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001100:[<0x10000001211/set_return_on_destroy.c v18>,<0x1000000120f/cmd v55>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.125 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.571+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001101 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/write_invis.c auth v12 ap=1 s=3858 n(v0 b3858 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a6eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001101:[<0x10000001211/write_invis.c v10>,<0x1000000120f/cmd v14>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001101:[<0x10000001211/write_invis.c v12>,<0x1000000120f/cmd v55>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.125 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.571+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fe [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/read_invis.c auth v20 ap=1 s=4413 n(v0 b4413 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a6f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fe:[<0x10000001211/read_invis.c v4>,<0x1000000120f/cmd v14>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000010fe:[<0x10000001211/read_invis.c v20>,<0x1000000120f/cmd v55>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.125 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.572+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001212 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/Makefile auth v16 ap=1 s=561 n(v0 rc2023-10-18T14:05:22.727042+0000 b561 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01a6e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001212:[<0x10000001211/Makefile v2>,<0x1000000120f/cmd v14>,<0x1000000120d/common v10>,<0x1000000120b/src v18>,<0x100000005e4/dmapi v1183>,<0x100000005e3/xfstests-dev v148>,<0x100000005e2/tmp v35>,<0x100000001fb/client.0 v28>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v44>,<0x10000000001/sv_1 v65>,<0x10000000000/_nogroup v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001212:[<0x10000001211/Makefile v16>,<0x1000000120f/cmd v55>,<0x1000000120d/common v150>,<0x1000000120b/src v43>,<0x100000005e4/dmapi v3635>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.126 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:05:42.572+0000 7f6e48bbf700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000012 [3,head] /volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD auth v4 ap=1 s=196 n(v0 rc2023-10-18T14:05:08.442335+0000 b196 1=1+0) (iversion lock) caps={25030=pAsLsXsFsc/-@1},l=25030(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fd01988000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000012:[<0x10000000011/HEAD v2>,<0x10000000010/origin v4>,<0x1000000000f/remotes v4>,<0x1000000000e/refs v8>,<0x100000005e5/logs v171>,<0x100000005e4/.git v164>,<0x100000005e3/xfstests-dev v74>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v26>,<0x10000000001/sv_1 v49>,<0x10000000000/_nogroup v35>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000012:[<0x10000000011/HEAD v4>,<0x10000000010/origin v7>,<0x1000000000f/remotes v13>,<0x1000000000e/refs v25>,<0x100000005e5/logs v282>,<0x100000005e4/.git v3633>,<0x100000005e3/xfstests-dev v2280>,<0x100000005e2/tmp v51>,<0x100000001fb/client.0 v57>,<0x100000001fa/613810c7-990b-4e91-aaf2-48e4fc84828c v71>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v27>,<0x1/volumes v75>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-18T14:05:43.127 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:05:43.127 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000816 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/199.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.127 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001453 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/370) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.127 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001201 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/043) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.127 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014c3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/473) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.128 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000130a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/286) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.128 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/033.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.128 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000309 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.nojournal) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.128 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000153f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/587) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.128 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014a5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/444) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001266 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/127) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000085f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/262.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000080a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/193.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000059a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/503.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001230 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/075) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/418.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000883 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/280.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000036e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/100.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000080e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/195.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000853 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/256.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.131 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/266) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.131 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000129c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/178) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.131 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/326.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.131 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/499) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.131 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/039.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.132 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/240) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.132 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/511) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.132 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/038.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.132 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/538.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.132 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000841 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/247.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000522 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/443.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001429 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/330) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000142d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/334) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001220 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/059) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000142f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/336) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000141f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/320) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001454 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/371) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001438 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/345) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008c1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/311.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001207 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/049) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/030.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001547 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/group) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000144e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/365) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000466 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/349.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/161.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000035a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/090.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/486) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001464 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/385) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001516 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/552) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000a31 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/581.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000307 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.cfg) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012c3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/215) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004da (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/407.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000444 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/332.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001286 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/156) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000084f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/254.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000454 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/340.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001256 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/111) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001534 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/577) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011d5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/005) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012da (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/238) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.139 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000146b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/392) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.139 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/184) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.139 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005b4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/516.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.139 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000083d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/245.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.139 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/021) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.140 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012aa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/191) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.140 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000845 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/249.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.140 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000413 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/208.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.140 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/415.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.140 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/510) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.140 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002c7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/022.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.141 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000143d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/350) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.141 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000126e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/135) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.141 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/159.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.141 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/155.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.141 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000046a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/351.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.142 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003da (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/154.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.142 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/041) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.142 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012dd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/241) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.142 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008fb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/552.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.143 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001219 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/052) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.143 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000088d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/285.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.143 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000125c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/117) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.143 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001468 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/389) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.143 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001510 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/546) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.143 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/156.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.144 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/172.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.144 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001545 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/592) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.144 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001304 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/280) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.144 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/550.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.144 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/421.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.145 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000125b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/116) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.145 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000370 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/101.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.145 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000153c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/584) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.145 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001473 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/399) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.145 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/245) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.146 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000151f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/560) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.146 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/195) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.146 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001271 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/138) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.146 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003c4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/143.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.146 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000821 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/231.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.147 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000804 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/190.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.147 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000044a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/335.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.147 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001530 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/574.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.147 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/176.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.147 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000045c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/344.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.148 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000121f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/058) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.148 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001259 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/114) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.148 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001457 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/373.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.148 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002cf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/026.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.148 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001515 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/551) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.149 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001285 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/155) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.149 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:42 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/036.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.179 INFO:tasks.workunit.client.0.smithi114.stderr:fsstress.c: In function 'attr_list_path': 2023-10-18T14:05:43.179 INFO:tasks.workunit.client.0.smithi114.stderr:fsstress.c:859:2: warning: 'attr_list' is deprecated: Use listxattr or llistxattr instead [-Wdeprecated-declarations] 2023-10-18T14:05:43.179 INFO:tasks.workunit.client.0.smithi114.stderr: rval = attr_list(name->path, buffer, buffersize, flags, cursor); 2023-10-18T14:05:43.179 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~ 2023-10-18T14:05:43.179 INFO:tasks.workunit.client.0.smithi114.stderr:In file included from ../src/global.h:25, 2023-10-18T14:05:43.180 INFO:tasks.workunit.client.0.smithi114.stderr: from fsstress.c:12: 2023-10-18T14:05:43.180 INFO:tasks.workunit.client.0.smithi114.stderr:/usr/include/attr/attributes.h:165:12: note: declared here 2023-10-18T14:05:43.180 INFO:tasks.workunit.client.0.smithi114.stderr: extern int attr_list(const char *__path, char *__buffer, const int __buffersize, 2023-10-18T14:05:43.180 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~~ 2023-10-18T14:05:43.180 INFO:tasks.workunit.client.0.smithi114.stderr:fsstress.c: In function 'attr_remove_path': 2023-10-18T14:05:43.181 INFO:tasks.workunit.client.0.smithi114.stderr:fsstress.c:878:2: warning: 'attr_remove' is deprecated: Use removexattr or lremovexattr instead [-Wdeprecated-declarations] 2023-10-18T14:05:43.181 INFO:tasks.workunit.client.0.smithi114.stderr: rval = attr_remove(name->path, attrname, flags); 2023-10-18T14:05:43.181 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~ 2023-10-18T14:05:43.181 INFO:tasks.workunit.client.0.smithi114.stderr:In file included from ../src/global.h:25, 2023-10-18T14:05:43.181 INFO:tasks.workunit.client.0.smithi114.stderr: from fsstress.c:12: 2023-10-18T14:05:43.182 INFO:tasks.workunit.client.0.smithi114.stderr:/usr/include/attr/attributes.h:152:12: note: declared here 2023-10-18T14:05:43.182 INFO:tasks.workunit.client.0.smithi114.stderr: extern int attr_remove (const char *__path, const char *__attrname, 2023-10-18T14:05:43.182 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~~~~ 2023-10-18T14:05:43.182 INFO:tasks.workunit.client.0.smithi114.stderr:fsstress.c: In function 'attr_set_path': 2023-10-18T14:05:43.183 INFO:tasks.workunit.client.0.smithi114.stderr:fsstress.c:898:2: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2023-10-18T14:05:43.183 INFO:tasks.workunit.client.0.smithi114.stderr: rval = attr_set(name->path, attrname, attrvalue, valuelength, flags); 2023-10-18T14:05:43.183 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~ 2023-10-18T14:05:43.183 INFO:tasks.workunit.client.0.smithi114.stderr:In file included from ../src/global.h:25, 2023-10-18T14:05:43.183 INFO:tasks.workunit.client.0.smithi114.stderr: from fsstress.c:12: 2023-10-18T14:05:43.183 INFO:tasks.workunit.client.0.smithi114.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2023-10-18T14:05:43.184 INFO:tasks.workunit.client.0.smithi114.stderr: extern int attr_set (const char *__path, const char *__attrname, 2023-10-18T14:05:43.184 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~ 2023-10-18T14:05:43.738 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: scrub queued for path: / 2023-10-18T14:05:43.738 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:43.739 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:05:43.739 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:05:43.739 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000648 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/auxiliary-programs.txt) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.739 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001324 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/requirement-checking.txt) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.739 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000027 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/CHANGES) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.740 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000667 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/string_to_tokens.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.740 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000661 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/forker.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.740 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000065e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/databin.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.740 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000065d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/dataascii.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.740 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000666 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/str_to_bytes.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.741 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000669 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/write_log.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.741 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000668 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/tlibio.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.741 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000660 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/file_lock.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.741 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000665 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/random_range.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.741 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000065f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/datapid.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.742 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000662 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/open_flags.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.742 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000002b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.742 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000002e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4) see mds.i log and `damage ls` output for details 2023-10-18T14:05:43.742 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000663 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/pattern.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.742 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000653 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/file_lock.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.743 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000657 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/pattern.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.743 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000065a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/string_to_tokens.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.743 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000065c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/write_log.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.743 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000650 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/buildrules) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.744 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000655 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/install-sh) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.744 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000029 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.744 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000064f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/buildmacros) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.744 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000652 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/databin.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.744 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000654 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/forker.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.744 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000065b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/tlibio.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.745 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000651 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/dataascii.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.745 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000656 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/open_flags.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.745 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000659 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/str_to_bytes.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.745 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000664 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/random.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.745 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001175 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_dmapidev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.746 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000067a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_libbtrfs.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.746 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000676 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_acldev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.746 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000681 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_utilies.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.746 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000658 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/random_range.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.746 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000675 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/multilib.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.747 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001326 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.747 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001325 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/builddefs.in) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.747 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000678 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_gdbmdev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.747 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000677 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_aiodev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.747 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001176 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_libcdev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.748 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001178 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_xfslibs.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.748 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000067f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_pthread.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.748 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000684 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/visibility_hidden.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.748 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000680 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_types.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.748 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:05:43.749 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001177 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_ncurses.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.749 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000159c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/102) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.749 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b46 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/102.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.750 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: scrub queued for path: / 2023-10-18T14:05:43.750 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:43.750 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:05:43.750 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:05:43.751 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000648 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/auxiliary-programs.txt) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.751 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001324 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/requirement-checking.txt) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.751 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000027 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/CHANGES) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.751 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000667 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/string_to_tokens.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.751 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000661 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/forker.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.752 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000065e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/databin.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.752 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000065d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/dataascii.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.752 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000666 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/str_to_bytes.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.752 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000669 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/write_log.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.752 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000668 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/tlibio.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000660 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/file_lock.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000665 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/random_range.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000065f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/datapid.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000662 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/open_flags.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000002b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000002e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4) see mds.i log and `damage ls` output for details 2023-10-18T14:05:43.757 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] growfiles 2023-10-18T14:05:43.760 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000663 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/pattern.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.760 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000653 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/file_lock.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.760 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000657 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/pattern.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.761 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000065a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/string_to_tokens.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.761 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000065c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/write_log.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.761 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000650 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/buildrules) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.761 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000655 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/install-sh) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.761 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000029 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.762 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000064f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/buildmacros) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.762 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000652 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/databin.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.762 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000654 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/forker.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.762 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000065b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/tlibio.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.762 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000651 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/dataascii.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000656 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/open_flags.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000659 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/str_to_bytes.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000664 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/random.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001175 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_dmapidev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000067a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_libbtrfs.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000676 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_acldev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000681 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_utilies.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000658 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/random_range.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000675 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/multilib.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001326 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001325 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/builddefs.in) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000678 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_gdbmdev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000677 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_aiodev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001176 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_libcdev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001178 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_xfslibs.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000067f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_pthread.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000684 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/visibility_hidden.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000680 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_types.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:05:43.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001177 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_ncurses.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000159c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/102) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b46 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/102.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000682 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_uuiddev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000159e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000159d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:43.768 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000674 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/manual_format.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.768 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001174 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_attrdev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.768 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000679 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_globals.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.768 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:05:43.768 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/description) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.769 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:05:43.769 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000006 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.769 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.769 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000000e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.769 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000602 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/packed-refs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.770 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000606 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/config) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.770 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/info) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.770 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.770 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000600 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/shallow) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.770 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/401.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.771 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000038a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/114.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.771 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/branches) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.771 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008af (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/302.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.771 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001258 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/113) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.771 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001282 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/152) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.772 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003d0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/149.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.772 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001260 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/121) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.772 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012ca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/222) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.772 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001471 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/397.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.772 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000144b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/362) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.773 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000043c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/328.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.773 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000568 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/478.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.773 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/409.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.773 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001222 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/061) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.773 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012c8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/220) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.774 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/441) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.774 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000123c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/086.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.774 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001228 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/067) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.774 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000376 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/104.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.774 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012b7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/203) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.775 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000125d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/118) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.775 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014b7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/462) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.775 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000081b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/228.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.775 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000314 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/055.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.775 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000041f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/214.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.776 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000146f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/396) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.776 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000560 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/474.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.776 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000092b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/576.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.776 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/160.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.776 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000476 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/357.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.777 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014f3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/518) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.777 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000047e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/361.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.777 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001503 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/533) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.777 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/027) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.777 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001451 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/368) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.778 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000129f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/181) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.778 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001458 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/374) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.778 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000050c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/432.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.778 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000052c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/448.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.778 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/019) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.779 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/461) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.779 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001276 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/140.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.779 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000392 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/118.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.779 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001261 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/122) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.779 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/501.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.780 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005b0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/514.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.780 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000141a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/315) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.780 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001474 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/400) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.780 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/505) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.780 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001410 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/305) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.780 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000433 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/224.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.781 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/275) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.781 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000128c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/162) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.781 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014c6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/476) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.781 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001472 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/398) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.782 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/500) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.782 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001244 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/093.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.782 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000423 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/216.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.782 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/158.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.782 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/381.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.782 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/035.out.nfs) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.783 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001521 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/562) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.783 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000897 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/290.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.783 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001420 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/321) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.783 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/423.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.783 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000151e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/559) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.784 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000089d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/293.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.784 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/259) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.784 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000936 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/584.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.784 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004bc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/392.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.784 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/022) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.785 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/482) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.785 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/186.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.785 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/027.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.785 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000049c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/376.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.785 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000647 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/xfscrash) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.786 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000582 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/491.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.786 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000149e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/438) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.786 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008d7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/322.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.786 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000122f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/074) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.786 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000646 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/rc.sysinit) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.787 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001407 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/296) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.787 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001239 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/084) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.787 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000025 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.787 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/224) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.787 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001292 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/168) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.787 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000316 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/056.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.788 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001173 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/iogen.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.788 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000671 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/growfiles.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.788 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/174.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.788 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012c5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/217) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.788 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000934 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/583.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.789 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001170 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/doio.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.789 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001496 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/431) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.789 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012ed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/257) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.789 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000116f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.789 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000129d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/179) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.790 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014d9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/494) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.790 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014ab (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/450) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.790 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001172 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/fsx.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.790 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000386 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/112.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.790 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014bd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/468) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.791 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/167.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.791 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/252) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.791 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001283 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/153) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.791 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000324 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/063.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.791 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/038) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.792 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001171 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/fsstress.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.792 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000126a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/131) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.792 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000407 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/202.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.792 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000147b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/406) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.792 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014b9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/464) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.793 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000673 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/rwtest.sh) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.793 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001262 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/123) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.793 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012ba (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/206) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.793 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000145b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/376) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.793 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000093e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/588.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.793 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000066e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/doio.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.794 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000126b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/132) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.794 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/504) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.794 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000066c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/aio-stress.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.794 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012d8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/236) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.794 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000120d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.795 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000869 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/267.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.795 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/020.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.795 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012bf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/211) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.795 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000128a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/160) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.795 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000508 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/430.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.796 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/127.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.796 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000330 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/069.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.796 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/420.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.796 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000120c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.796 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000808 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/192.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.797 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000450 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/338.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.797 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000128f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/165) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.797 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/repair) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.797 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000088f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/286.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.797 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.798 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014d5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/490) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.798 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001524 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/565) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.798 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filter.btrfs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.798 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000124c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/101) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.798 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000145f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/380) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.799 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010f8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/report) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.799 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000871 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/271.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.799 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmlogwrites) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.799 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012ab (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/192) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.799 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000146e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/395) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.800 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/400.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.800 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000634 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/perf) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.800 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000091f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/570.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.800 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmerror) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.800 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000124e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/103) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.801 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000621 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmhugedisk) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.801 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/519) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.801 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000588 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/494.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.801 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001247 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/096) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.801 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001431 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/338) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.802 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010fb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/xfs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.802 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000879 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/275.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.802 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000121a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/053) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.802 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/175.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.802 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010f9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/scsi_debug) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.803 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/547.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.803 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000054c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/464.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.803 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000085d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/261.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.803 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/verity) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.803 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/178.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.804 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004ac (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/384.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.804 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/casefold) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.804 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000480 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/362.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.804 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000062f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/locktest) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.804 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/539.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.805 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/config) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.805 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filestreams) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.805 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000123a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/085) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.805 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/encrypt) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.805 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/166.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.806 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001540 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/588) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.806 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/rc) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.806 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/029.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.806 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dump) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.806 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001525 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/566) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000534 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/452.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000061a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/cgroup2) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014c0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/471) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004d8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/406.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/029) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001234 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/079) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000632 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/nfs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000308 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.default) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000881 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/279.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000142b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/332) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmflakey) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001482 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/413) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014da (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/495) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000342 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/078.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000093c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/587.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002bd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/017.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/punch) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000142a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/331) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/renameat2) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001447 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/358) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000021 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014b2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/457) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000546 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/461.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filter) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001411 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/306) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001232 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/077) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmdelay) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014a9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/448) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001456 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/373) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/module) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000409 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/203.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmapi) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001226 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/065) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008bb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/308.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010f5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/reflink) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.814 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000372 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/102.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.814 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/btrfs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.814 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000149f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/439) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.814 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000384 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/111.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.814 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/fuzzy) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.815 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014b4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/459) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.815 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000153e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/586) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.815 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000837 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/242.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.815 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/255) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.815 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001523 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/564) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.815 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000806 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/191.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000063f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/test_names) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000038e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/116.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010f3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/quota) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014a8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/447) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmthin) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.817 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001483 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/414) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.817 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/overlay) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.817 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000378 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/105.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.817 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/403.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.817 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000120a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/attr) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.818 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001502 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/532) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.818 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010ed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/inject) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.818 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/035.cfg) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.818 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/populate) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.818 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001492 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/428) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.819 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002ad (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/009.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.819 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000516 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/437.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.819 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/508.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.819 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001514 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/550) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.819 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/log) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.819 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001279 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/143) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.820 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/540.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.820 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000148a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/420) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.820 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000023 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/configs/example.config) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.820 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000150a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/540) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.820 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000486 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/365.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.821 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000129e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/180) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.821 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000061c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/defrag) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.821 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001485 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/416) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.821 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002a7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/006.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.821 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000150f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/545) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.822 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/164.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.822 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000644 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/configs/localhost.config) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.822 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000128b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/161) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.822 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001450 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/367) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.822 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001265 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/126) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.823 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000001c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.823 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001301 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/277) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.823 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004c0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/394.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.823 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000001e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/tar) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.823 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003aa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/130.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.824 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000885 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/281.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.824 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.824 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000057c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/488.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.824 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005c0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/522.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.824 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001413 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/308) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.824 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005d4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/532.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.825 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001538 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/580) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.825 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001501 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/531) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.825 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000129a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/176) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.825 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012a5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/186) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.825 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/interop) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.826 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000125a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/115) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.826 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000045e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/345.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.826 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014d0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/485) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.826 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012d9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/237) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.826 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/408.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.827 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000396 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/120.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.827 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010cb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/compare-failures) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.827 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/200) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.827 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000032a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/066.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.827 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012b8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/204) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.828 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/413.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.828 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010cf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/fs-walk) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.828 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003b2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/134.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.828 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000354 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/087.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.828 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/198) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000122d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/072) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010cd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/db-walk) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000030a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.xfsquota) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000a2d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/579.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000029f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/002.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.829 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012c7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/219) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000008 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/info) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001441 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/353) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001308 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/284) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014f8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/523) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.830 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/165.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001209 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/README.auto-qa) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008a7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/298.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000468 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/350.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010c9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/ag-wipe) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000123f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/089) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/042.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000007 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000044c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/336.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001287 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/157) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.832 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001484 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/415) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011d8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/008) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000141c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/317) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000374 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/103.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000034a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/082.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000126f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/136) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000141d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/318) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001506 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/536) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.835 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/456) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.835 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002a9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/007.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.835 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/527) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.835 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.835 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000843 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/248.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.837 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003d4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/151.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.837 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001249 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/098) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.837 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.837 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000088b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/284.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001546 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014ad (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/452) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001495 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/430) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000398 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/121.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012ad (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/194) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/update.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000032e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/068.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001476 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/402) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.840 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000322 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/062.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.840 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001264 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/125) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.840 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.840 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000121c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/055) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.840 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005ed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.841 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000050e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/433.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.841 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001224 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/063) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.841 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/270) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.841 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/024) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.841 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.842 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000913 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/564.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.842 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000144d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/364) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.842 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000014 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/HEAD) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.842 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001296 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/172) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.842 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000033e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/076.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.843 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000000f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.843 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001243 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/093) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.843 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014be (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/469) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.843 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000488 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/366.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.843 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000a2f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/580.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.844 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008b5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/305.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.844 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000909 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/559.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.844 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000867 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/266.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.844 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000121d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/056) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.844 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/tags) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.845 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000057e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/489.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.845 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001437 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/344) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.845 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007dd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/info/exclude) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.845 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014c2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/472) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.845 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000081f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/230.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.845 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/heads) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.846 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001443 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/354) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.846 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008f9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/551.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.846 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/180.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.846 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/015) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.846 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001424 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/325) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.847 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000125f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/120) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.847 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001274 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/139.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.847 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000427 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/218.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.847 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000153d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/585) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.847 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005c6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/525.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.848 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001439 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/346) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.848 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000123e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/088) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.848 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005b8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/518.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.848 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001255 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/110) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.848 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001490 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/426) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.849 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001499 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/434) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.849 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/528) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.849 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005f3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.849 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000580 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/490.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.849 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000055c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/472.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000149c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/436) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/453) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000849 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/251.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000030e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/052.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000318 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/057.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.851 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/202) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.851 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/246) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.851 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/267) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.851 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001307 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/283) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.851 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000901 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/555.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.851 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000891 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/287.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.852 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000036c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/099.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.852 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001270 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/137) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.852 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014cf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/484.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.852 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000889 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/283.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.852 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000152d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/572.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.853 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000049e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/377.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.853 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000911 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/563.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.853 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000000b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.853 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/177.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.853 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004a8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/382.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.854 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001225 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/064) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.854 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001240 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/090) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.854 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001462 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/383) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.854 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000578 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/486.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.854 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/026) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.855 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/264) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.855 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000492 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/371.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.855 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003c8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/145.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.855 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001428 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/329) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.855 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012d3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/231) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.855 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014c8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/478) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.856 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000086d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/269.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.856 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000532 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/451.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.856 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000905 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/557.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.856 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000151d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/558) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.856 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012c2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/214) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.857 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000421 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/215.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.857 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014bb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/466) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.857 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000036a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/098.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.857 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001445 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/356) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.857 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000127b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/145) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.858 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/304.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.858 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001204 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/046) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.858 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000366 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/096.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.858 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003ca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/146.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.858 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008b9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/307.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000140f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/304) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/033) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/200.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/032) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000144f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/366) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.860 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001305 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/281) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.860 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001417 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/312) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.860 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012bd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/209) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.860 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000861 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/263.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.860 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/253) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.860 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000148d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/423) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.861 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000152a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/570) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.861 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/440.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.861 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000528 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/446.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.861 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001459 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/374.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.861 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001303 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/279) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.862 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000041b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/212.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.862 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001436 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/343) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.862 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005c4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/524.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.862 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002a3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/004.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.862 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001421 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/322) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/537.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000047a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/359.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000143a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/347) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008d3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/320.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000802 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/189.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.864 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000048c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/368.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.864 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000053a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/455.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.864 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002ab (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/008.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.864 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/250) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.865 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/411.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.865 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001245 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/094) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.865 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012d4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/232) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.865 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/509.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.865 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/527.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011d9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/009) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000130d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/289) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000544 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/460.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/385.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000035c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/091.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000514 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/436.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000089b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/292.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001446 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/357) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/171.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/002) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.868 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/443) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.868 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000839 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/243.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.868 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000917 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/566.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.868 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/011.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.868 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014ac (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/451) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.868 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001479 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/404.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000043e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/329.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000086f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/270.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/249) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000147e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/409) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000141b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/316) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005be (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/521.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000598 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/502.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008a9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/299.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000150b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/541) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000859 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/259.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000121b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/054) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000039a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/122.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000152f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/574) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/529.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001512 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/548) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000147d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/408) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014f5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/520) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002a5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/005.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000590 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/498.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000056e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/481.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012af (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/196) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000564 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/476.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000368 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/097.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000052e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/449.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001500 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/530) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000586 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/493.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002c1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/019.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001465 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/386) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008d9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/323.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000390 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/117.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000127f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/149) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000340 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/077.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/503) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000472 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/355.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000576 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/485.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/379.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001461 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/382) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001263 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/124) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012c9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/221) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/487) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.877 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000081d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/229.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.877 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005bc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/520.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.877 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001254 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/109) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.877 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001541 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/589) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.879 INFO:tasks.workunit.client.0.smithi114.stderr:fsx.c: In function 'main': 2023-10-18T14:05:43.879 INFO:tasks.workunit.client.0.smithi114.stderr:fsx.c:2662:5: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2023-10-18T14:05:43.879 INFO:tasks.workunit.client.0.smithi114.stderr: strncpy(opsfile, optarg, sizeof(opsfile)); 2023-10-18T14:05:43.880 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-18T14:05:43.880 INFO:tasks.workunit.client.0.smithi114.stderr:fsx.c:2632:4: warning: 'strncpy' specified bound 1024 equals destination size [-Wstringop-truncation] 2023-10-18T14:05:43.880 INFO:tasks.workunit.client.0.smithi114.stderr: strncpy(dname, optarg, sizeof(dname)); 2023-10-18T14:05:43.880 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-18T14:05:43.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/187) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/529) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000087f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/278.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/179.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000146c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/393) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001288 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/158) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008f3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/548.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/242) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001310 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/292) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001543 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/591) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000825 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/233.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000556 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/469.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/162.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002ed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/040.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000149b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/435.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/496) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001289 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/159) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000572 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/483.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000038c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/115.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/501) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/295.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002cd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/025.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000942 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/590.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.888 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001238 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/083) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.888 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001478 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/404) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.888 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000048e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/369.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.888 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/016) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.888 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000150c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/542) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.889 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000057a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/487.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.889 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001498 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/433) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.889 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/243) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.889 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014c4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/474) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.889 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000059c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/504.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001449 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/360) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000090f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/562.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/037.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/516) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001251 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/106) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000558 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/470.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008a5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/297.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000121e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/057) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000490 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/370.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001469 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/390) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014ca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/480) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001290 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/166) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002bb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/016.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000800 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/188.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000494 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/372.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/256) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/424.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001298 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/174) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000388 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/113.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012be (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/210) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000448 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/334.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/023) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008c9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/315.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001488 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/419) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012f5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/265) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011d7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/007) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000083b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/244.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001487 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/418) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012c6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/218) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000382 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/110.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.896 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000140c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/301) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.896 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003d6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/152.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.896 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004c4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/396.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.896 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014b8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/463) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.896 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000032c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/067.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.897 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000147c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/407) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.897 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000153b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/583) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.897 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000083f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/246.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.897 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004d6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/405.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.897 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/170.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.898 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012db (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/239) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.898 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014a7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/446) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.898 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/247) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.898 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005d0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/530.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.898 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001448 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/359) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.899 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001531 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/575) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.899 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/150.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.899 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000130e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/290) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.899 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000419 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/211.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.899 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/248) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.900 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000145c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/377) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.900 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001528 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/568) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.900 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011d3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/003) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.900 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012a7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/188) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.900 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001233 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/078) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.900 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f42 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/499.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.901 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000130b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/287) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.901 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000082d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/237.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.901 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/389.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.901 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b7e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/028.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.901 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/514) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.902 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/017) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.902 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000500 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/426.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.902 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/136.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.902 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ce2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/201.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.902 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000460 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/346.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.903 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/319.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.903 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000084b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/252.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.903 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001507 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/537) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.903 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001532 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/575.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.903 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000053c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/456.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.904 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014d3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/488) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.904 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ee1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/450.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.904 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000127e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/148) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.904 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014dd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/497) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.904 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/185.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.905 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000827 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/234.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.905 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000140a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/299) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.905 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004f8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/422.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.905 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/274) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.905 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/128.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.906 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/513.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.906 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/262) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.906 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000147a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/405) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.906 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000de6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/325.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.906 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d60 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/258.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.907 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/517.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.907 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ce8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/204.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.907 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000810 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/196.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.907 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000865 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/265.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.907 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c46 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/123.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.908 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000504 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/428.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.908 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000380 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/109.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.908 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d9e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/289.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.908 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/012.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.908 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c6a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/141.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.909 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000149a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/435) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.909 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dc0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/306.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.909 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000126c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/133) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.909 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001491 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/427) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.909 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/003.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.909 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014c5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/475) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.910 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001422 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/323) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.910 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cde (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/199.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.910 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000538 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/454.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.910 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000526 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/445.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.910 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cdc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/198.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.911 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e81 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/402.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.911 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008c7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/314.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.911 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f4a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/503.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.911 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014b0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/455) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.911 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cda (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/197.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.912 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ea1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/418.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.912 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000122b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/070) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.912 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000566 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/477.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.912 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/542.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.912 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f4e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/505.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.913 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/554.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.913 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d68 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/262.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.913 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/157.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.913 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000474 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/356.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.913 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c1c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/105.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.914 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cd2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/193.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.914 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000358 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/089.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.914 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/541.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.914 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/126.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.914 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b58 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/009.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.915 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f54 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/508.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.915 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e83 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/403.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.915 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/328.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.915 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000016fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/006.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.915 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bdf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/075.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.916 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c34 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/114.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.916 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e8f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/409.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.916 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000037c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/107.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.916 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e77 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/397.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.916 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005b2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/515.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.917 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d8e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/281.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.917 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014a0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/440) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.917 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bf5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/086.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.917 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000145a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/375) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.918 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c1a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/104.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.918 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ea7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/421.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.918 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/163.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.918 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d1a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/228.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.918 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/528.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.919 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000051a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/439.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.919 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001267 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/128) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.919 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000053e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/457.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.919 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004ca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/399.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.919 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e71 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/394.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.920 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014aa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/449) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.920 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000122c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/071) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.920 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cfc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/214.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.920 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001513 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/549) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.920 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000007f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/181.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.920 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f11 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/474.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.921 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e27 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/357.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.921 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000855 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/257.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.921 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c14 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/101.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.921 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000594 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/500.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.921 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000130f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/291) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.922 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/229) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.922 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000326 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/064.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.922 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000127a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/144) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.922 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/205.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.922 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dfa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/335.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.923 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/226) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.923 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/531.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.923 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001297 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/173) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.923 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000875 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/273.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.923 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000091b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/568.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.924 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004b0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/386.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.924 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e69 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/390.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.924 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ebd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/432.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.924 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000145d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/378) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.924 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e9f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/417.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.925 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bac (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/050.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.925 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000835 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/241.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.925 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e0c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/344.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.925 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000016fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/004) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.925 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000127c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/146) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.926 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012cf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/227) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.926 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000159f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.op) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.926 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ef3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/459.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.926 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d20 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/231.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.926 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cfa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/213.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.927 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ed1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/442.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.927 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b90 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/036.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.927 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ccc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/190.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.927 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dd4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/316.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.927 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b48 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/001.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.928 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dde (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/321.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.928 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c9a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/165.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.928 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b86 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/032.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.928 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e08 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/342.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.928 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001205 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/047) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.929 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d86 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/277.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.929 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014d4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/489) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.929 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001475 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/401) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.929 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000edd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/448.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.929 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000153a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/582) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.930 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000054e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/465.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.930 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f46 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/501.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.930 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002fb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/047.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.930 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001520 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/561) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.930 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c3c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/118.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.931 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000536 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/453.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.931 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d12 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/224.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.931 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ca8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/172.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.931 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000031a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/058.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.931 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e1f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/353.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.931 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/484) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.932 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000016ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/008) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.932 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000356 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/088.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.932 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000058e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/497.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.932 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000435 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/225.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.932 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000da4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/292.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.933 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b54 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/007.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.933 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e21 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/354.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.933 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002b7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/014.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.933 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002cb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/024.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.933 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001408 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/297) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.934 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/132.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.934 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d4c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/248.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.934 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000edf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/449.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.934 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000125e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/119) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.934 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d88 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/278.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.935 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/148.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.935 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000037e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/108.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.935 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c42 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/121.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.935 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f4c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/504.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.935 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002c9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/023.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.936 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bd0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/068.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.936 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001218 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/051) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.936 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000148f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/425) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.936 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ead (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/424.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.936 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/230) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.937 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000143c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/349) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.937 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014a3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/442) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.937 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000082b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/236.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.937 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/206.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.937 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001229 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/068) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.938 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000332 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/070.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.938 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bc4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/062.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.938 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/260) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.938 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f03 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/467.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.938 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ebb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/431.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.939 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000831 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/239.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.939 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e2d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/360.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.939 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001412 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/307) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.939 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005a0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/506.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.939 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000df2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/331.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.940 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e39 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/366.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.940 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d70 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/266.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.940 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001404 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/001) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.940 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f2e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/489.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.940 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/508) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.940 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000042b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/220.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.941 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000938 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/585.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.941 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e9d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/416.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.941 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003b8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/137.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.941 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000016fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/006) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.941 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000150d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/543) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000015a0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.trans_buf) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f1d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/480.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d1e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/230.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000058c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/496.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dfc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/336.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000db4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/300.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e95 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/412.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001706 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/015) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bdd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/074.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c66 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/139.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d10 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/223.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011dd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/013) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c16 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/102.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003a8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/129.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000548 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/462.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.945 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f30 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/490.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.945 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000478 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/358.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.945 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/185) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.945 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/051.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.945 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d52 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/251.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.946 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001311 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/293) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.946 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012d0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/228) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.946 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d3e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/241.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.946 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d92 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/283.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.946 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003b4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/135.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.947 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001522 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/563) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.947 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d7e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/273.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.947 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000518 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/438.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.947 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000093a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/586.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.947 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014b5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/460) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.948 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000540 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/458.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.948 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d62 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/259.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.948 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d72 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/267.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.948 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ba6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/047.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.948 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000031e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/060.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f1f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/481.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c09 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/096.out.external) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c10 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/099.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000008b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/303.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cd0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/192.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000eff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/465.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001409 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/298) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ee7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/453.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/536.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b50 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/005.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bbc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/058.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/458) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c0c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/097.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f3e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/497.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000baa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/049.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000170c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/019.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.952 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004c8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/398.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.952 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f27 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/485.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.952 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000334 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/071.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.952 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000863 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/264.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.952 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000be3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/077.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.953 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f21 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/482.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.953 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e23 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/355.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.953 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c4e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/127.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.953 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012d5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/233) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.953 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f0f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/473.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.954 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d84 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/276.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.954 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f36 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/493.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.954 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e53 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/379.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.954 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c3a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/117.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.954 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cf2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/209.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.955 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d1c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/229.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.955 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bf3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/085.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.955 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000014f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/521) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.955 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f07 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/469.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.955 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d56 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/253.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.956 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bb4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/054.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.956 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cd4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/194.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.956 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b8a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/033.out.default) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.956 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c5a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/133.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.956 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b98 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/040.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.957 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b70 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/021.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.957 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/045.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.957 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001707 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/016) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.957 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/048.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.957 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c36 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/115.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.958 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000daa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/295.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.958 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000437 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/226.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.958 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e12 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/347.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.958 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/065.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.958 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001418 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/313) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.959 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e37 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/365.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.959 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cc8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/188.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.959 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e8d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/408.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.959 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b64 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/015.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.959 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e02 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/339.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.960 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000002af (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/010.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.960 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dd2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/315.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.960 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ec7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/437.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.960 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000034c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/083.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.960 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c98 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/164.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.961 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f2c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/488.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.961 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e75 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/396.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.961 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c5c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/134.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.961 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c26 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/110.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.961 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c40 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/120.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.962 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e0e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/345.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.962 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000440 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/330.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.962 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bcc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/066.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.962 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c0a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/096.out.internal) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.962 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b4a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/002.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.963 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e97 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/413.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.963 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d0a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/220.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.963 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f3c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/496.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.963 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000151c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/557) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.963 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c62 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/137.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.964 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001704 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/013) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.964 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e29 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/358.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.964 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e41 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/370.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.964 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ef9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/462.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.964 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bb2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/053.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.964 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ec9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/438.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d48 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/246.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d3c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/240.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e45 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/372.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c52 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/129.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d80 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/274.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.966 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bf7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/087.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.966 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c5e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/135.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.966 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f34 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/492.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.966 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/313.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.966 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ef1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/458.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:43.967 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ecf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/441.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.967 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d50 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/250.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.970 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] iogen 2023-10-18T14:05:43.970 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000682 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_uuiddev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.970 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000159e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.971 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000159d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.971 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:43.971 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000674 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/manual_format.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.971 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001174 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_attrdev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.972 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000679 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_globals.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.972 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:05:43.972 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/description) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.972 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:05:43.972 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000006 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.973 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.973 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000000e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.973 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000602 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/packed-refs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.973 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000606 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/config) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.973 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/info) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.973 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.974 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000600 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/shallow) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.974 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/401.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.974 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000038a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/114.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.974 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/branches) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.975 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008af (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/302.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.975 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001258 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/113) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.975 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001282 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/152) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.975 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003d0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/149.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.975 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001260 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/121) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.975 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012ca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/222) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.976 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001471 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/397.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.976 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000144b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/362) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.976 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000043c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/328.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.976 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000568 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/478.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.977 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/409.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.977 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001222 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/061) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.977 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012c8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/220) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.977 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/441) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.977 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000123c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/086.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.977 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001228 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/067) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.978 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000376 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/104.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.978 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012b7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/203) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.978 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000125d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/118) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.978 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014b7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/462) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.979 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000081b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/228.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.979 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000314 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/055.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.979 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000041f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/214.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.979 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000146f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/396) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.979 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000560 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/474.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.979 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000092b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/576.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.980 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/160.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.980 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000476 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/357.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.980 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014f3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/518) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.980 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000047e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/361.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.980 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001503 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/533) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.981 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/027) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.981 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001451 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/368) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.981 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000129f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/181) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.981 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001458 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/374) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.981 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000050c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/432.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.982 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000052c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/448.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.982 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/019) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.982 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/461) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.982 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001276 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/140.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.982 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000392 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/118.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.983 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001261 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/122) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.983 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/501.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.983 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005b0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/514.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.983 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000141a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/315) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.983 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001474 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/400) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.984 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/505) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.984 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001410 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/305) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.984 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000433 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/224.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.984 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/275) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.984 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000128c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/162) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.985 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014c6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/476) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.985 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001472 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/398) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.985 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/500) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.985 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001244 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/093.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.985 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000423 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/216.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.986 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/158.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.986 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/381.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.986 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/035.out.nfs) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.986 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001521 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/562) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.987 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000897 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/290.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.987 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001420 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/321) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.987 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/423.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.987 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000151e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/559) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.987 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000089d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/293.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.987 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/259) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.988 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000936 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/584.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.988 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004bc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/392.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.988 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/022) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.988 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/482) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.988 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/186.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.989 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/027.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.989 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000049c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/376.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.989 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000647 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/xfscrash) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.989 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000582 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/491.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.989 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000149e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/438) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.990 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008d7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/322.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.990 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000122f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/074) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.990 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000646 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/rc.sysinit) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.990 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001407 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/296) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.990 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001239 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/084) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.991 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000025 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.991 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/224) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.991 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001292 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/168) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.991 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000316 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/056.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.991 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001173 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/iogen.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.992 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000671 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/growfiles.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.992 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/174.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.992 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012c5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/217) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.992 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000934 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/583.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.992 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001170 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/doio.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.993 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001496 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/431) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.993 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012ed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/257) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.993 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000116f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.993 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000129d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/179) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.993 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014d9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/494) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.994 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014ab (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/450) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.994 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001172 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/fsx.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.994 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000386 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/112.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.994 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014bd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/468) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.995 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/167.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.995 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/252) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.995 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001283 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/153) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.995 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000324 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/063.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.995 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/038) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.995 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001171 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/fsstress.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.996 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000126a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/131) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.996 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000407 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/202.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.996 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000147b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/406) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.996 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014b9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/464) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.996 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000673 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/rwtest.sh) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.997 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001262 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/123) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.997 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012ba (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/206) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.997 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000145b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/376) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.997 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000093e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/588.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.997 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000066e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/doio.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.998 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000126b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/132) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.998 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/504) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.998 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000066c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/aio-stress.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.998 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012d8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/236) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.998 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000120d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src) see mds.c log and `damage ls` output for details 2023-10-18T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000869 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/267.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/020.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012bf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/211) see mds.f log and `damage ls` output for details 2023-10-18T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000128a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/160) see mds.b log and `damage ls` output for details 2023-10-18T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000508 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/430.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/127.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000330 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/069.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/420.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000120c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000808 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/192.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000450 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/338.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000128f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/165) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/repair) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000088f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/286.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014d5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/490) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001524 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/565) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filter.btrfs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000124c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/101) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000145f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/380) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010f8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/report) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000871 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/271.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmlogwrites) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012ab (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/192) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000146e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/395) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/400.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.004 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000634 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/perf) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.004 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000091f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/570.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.004 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmerror) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.004 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000124e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/103) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.004 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000621 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmhugedisk) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.005 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/519) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.005 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000588 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/494.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.005 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001247 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/096) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.005 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001431 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/338) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.006 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010fb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/xfs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.006 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000879 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/275.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.006 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000121a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/053) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.006 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/175.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.006 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010f9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/scsi_debug) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.007 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/547.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.007 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000054c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/464.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.007 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000085d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/261.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.007 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/verity) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.007 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/178.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.008 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004ac (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/384.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.008 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/casefold) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.008 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000480 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/362.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.008 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000062f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/locktest) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.008 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/539.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.009 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/config) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.009 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filestreams) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.009 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000123a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/085) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.009 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/encrypt) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.009 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/166.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.010 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001540 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/588) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.010 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/rc) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.010 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/029.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.010 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dump) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.010 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001525 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/566) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.011 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000534 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/452.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.011 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000061a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/cgroup2) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.011 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014c0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/471) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.011 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004d8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/406.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.011 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/029) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.012 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001234 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/079) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.012 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000632 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/nfs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.012 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000308 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.default) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.012 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000881 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/279.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.012 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000142b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/332) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.013 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmflakey) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.013 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001482 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/413) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.013 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014da (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/495) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.013 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000342 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/078.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.013 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000093c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/587.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.014 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002bd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/017.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.014 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/punch) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.014 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000142a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/331) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.014 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/renameat2) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.014 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001447 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/358) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.015 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000021 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.015 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014b2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/457) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.015 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000546 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/461.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.015 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filter) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.015 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001411 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/306) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.016 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001232 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/077) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.016 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmdelay) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.016 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014a9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/448) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.016 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001456 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/373) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.016 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/module) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.017 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000409 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/203.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.017 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmapi) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.017 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001226 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/065) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.017 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008bb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/308.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.017 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010f5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/reflink) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.018 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000372 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/102.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.018 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/btrfs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.018 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000149f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/439) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.018 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000384 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/111.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.018 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/fuzzy) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.019 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014b4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/459) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.019 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000153e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/586) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.019 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000837 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/242.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.019 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/255) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.019 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001523 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/564) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.020 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000806 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/191.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.020 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000063f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/test_names) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.020 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000038e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/116.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.020 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010f3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/quota) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.020 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014a8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/447) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmthin) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001483 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/414) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/overlay) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000378 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/105.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/403.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000120a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/attr) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001502 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/532) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010ed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/inject) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/035.cfg) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/populate) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001492 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/428) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002ad (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/009.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000516 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/437.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/508.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001514 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/550) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/log) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001279 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/143) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/540.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000148a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/420) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000023 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/configs/example.config) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.025 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000150a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/540) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.025 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000486 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/365.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.025 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000129e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/180) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.025 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000061c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/defrag) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.025 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001485 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/416) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.026 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002a7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/006.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.026 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000150f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/545) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.026 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/164.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.026 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000644 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/configs/localhost.config) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.026 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000128b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/161) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.027 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001450 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/367) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.027 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001265 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/126) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.027 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000001c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.027 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001301 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/277) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.027 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004c0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/394.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.028 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000001e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/tar) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.028 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003aa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/130.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.028 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000885 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/281.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.028 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.028 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000057c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/488.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.028 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005c0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/522.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.029 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001413 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/308) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.029 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005d4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/532.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.029 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001538 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/580) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.029 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001501 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/531) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.029 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000129a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/176) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.030 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012a5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/186) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.030 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/interop) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.030 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000125a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/115) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.030 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000045e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/345.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.030 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014d0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/485) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.031 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012d9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/237) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.031 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/408.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.031 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000396 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/120.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.031 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010cb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/compare-failures) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.031 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/200) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.032 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000032a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/066.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.032 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012b8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/204) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.032 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/413.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.032 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010cf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/fs-walk) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.032 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003b2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/134.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000354 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/087.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/198) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000122d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/072) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010cd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/db-walk) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.033 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000030a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.xfsquota) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000a2d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/579.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000029f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/002.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012c7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/219) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000008 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/info) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.034 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001441 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/353) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001308 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/284) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014f8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/523) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/165.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001209 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/README.auto-qa) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.035 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008a7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/298.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000468 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/350.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010c9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/ag-wipe) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000123f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/089) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/042.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.036 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000007 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.037 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000044c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/336.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.037 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001287 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/157) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.037 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.037 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001484 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/415) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.037 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011d8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/008) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.038 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.038 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000141c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/317) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.038 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000374 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/103.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.038 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.038 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000034a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/082.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000126f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/136) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000141d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/318) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001506 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/536) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.039 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/456) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002a9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/007.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/527) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000843 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/248.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.040 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003d4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/151.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001249 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/098) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000088b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/284.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001546 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.041 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014ad (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/452) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001495 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/430) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000398 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/121.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012ad (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/194) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.042 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/update.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000032e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/068.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001476 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/402) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000322 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/062.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.043 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001264 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/125) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000121c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/055) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005ed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000050e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/433.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.044 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001224 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/063) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/270) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/024) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000913 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/564.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.045 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000144d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/364) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.046 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000014 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/HEAD) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.046 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001296 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/172) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.046 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000033e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/076.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.046 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000000f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.047 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001243 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/093) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.047 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014be (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/469) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.047 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000488 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/366.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.047 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000a2f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/580.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.047 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008b5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/305.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.048 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000909 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/559.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.048 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000867 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/266.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.048 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000121d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/056) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.048 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/tags) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.048 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000057e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/489.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.049 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001437 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/344) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.049 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007dd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/info/exclude) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.049 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014c2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/472) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.049 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000081f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/230.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.049 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/heads) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.050 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001443 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/354) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.050 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008f9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/551.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.050 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/180.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.050 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/015) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.050 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001424 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/325) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.051 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000125f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/120) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.051 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001274 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/139.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.051 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000427 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/218.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.051 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000153d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/585) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.051 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005c6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/525.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.051 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001439 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/346) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.052 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000123e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/088) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.052 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005b8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/518.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.052 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001255 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/110) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.052 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001490 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/426) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.052 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001499 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/434) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/528) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005f3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000580 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/490.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000055c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/472.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.053 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000149c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/436) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/453) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000849 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/251.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000030e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/052.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000318 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/057.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.054 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/202) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/246) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/267) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001307 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/283) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000901 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/555.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.055 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000891 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/287.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.056 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000036c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/099.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.056 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001270 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/137) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.056 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014cf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/484.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.056 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000889 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/283.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.056 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000152d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/572.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.057 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000049e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/377.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.057 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000911 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/563.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.057 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000000b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.057 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/177.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.057 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004a8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/382.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.058 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001225 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/064) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.058 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001240 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/090) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.058 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001462 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/383) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.058 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000578 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/486.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.058 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/026) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.059 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/264) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.059 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000492 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/371.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.059 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003c8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/145.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.059 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001428 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/329) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.059 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012d3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/231) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.060 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014c8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/478) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.060 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000086d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/269.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.060 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000532 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/451.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.060 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000905 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/557.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.060 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000151d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/558) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.061 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012c2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/214) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.061 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000421 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/215.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.061 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014bb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/466) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.061 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000036a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/098.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.061 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001445 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/356) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.062 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000127b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/145) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.062 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/304.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.062 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001204 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/046) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.062 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000366 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/096.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.063 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003ca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/146.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.063 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008b9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/307.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.063 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000140f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/304) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.063 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/033) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.063 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/200.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.064 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/032) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.064 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000144f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/366) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.064 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001305 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/281) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.064 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001417 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/312) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.064 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012bd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/209) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.064 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000861 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/263.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.065 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/253) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.065 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000148d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/423) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.065 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000152a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/570) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.065 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/440.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.065 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000528 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/446.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.066 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001459 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/374.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.066 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001303 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/279) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.066 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000041b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/212.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.066 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001436 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/343) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.066 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005c4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/524.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.067 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002a3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/004.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.067 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001421 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/322) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.067 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/537.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.067 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000047a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/359.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.067 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000143a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/347) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.068 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008d3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/320.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.068 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000802 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/189.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.068 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000048c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/368.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.068 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000053a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/455.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.069 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002ab (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/008.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.069 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/250) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.069 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/411.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.069 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001245 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/094) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.069 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012d4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/232) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.070 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/509.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.070 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/527.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.070 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011d9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/009) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.070 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000130d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/289) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.070 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000544 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/460.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.071 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/385.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.071 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000035c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/091.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.071 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000514 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/436.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.071 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000089b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/292.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.071 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001446 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/357) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.072 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/171.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.072 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/002) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.072 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/443) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.072 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000839 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/243.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.072 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000917 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/566.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.073 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/011.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.073 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014ac (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/451) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.073 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001479 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/404.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.073 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000043e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/329.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.073 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000086f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/270.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.074 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/249) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.074 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000147e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/409) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.074 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000141b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/316) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.074 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005be (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/521.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.074 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000598 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/502.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.075 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008a9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/299.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.075 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000150b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/541) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.075 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000859 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/259.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.075 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000121b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/054) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.075 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000039a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/122.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.076 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000152f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/574) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.076 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/529.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.076 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001512 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/548) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.076 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000147d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/408) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.076 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014f5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/520) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.077 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002a5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/005.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.077 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000590 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/498.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.077 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000056e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/481.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.077 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012af (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/196) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.077 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000564 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/476.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.078 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000368 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/097.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.078 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000052e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/449.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.078 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001500 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/530) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.078 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000586 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/493.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.078 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002c1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/019.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.079 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001465 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/386) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.079 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008d9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/323.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.079 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000390 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/117.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.079 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000127f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/149) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.079 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000340 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/077.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.079 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/503) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.080 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000472 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/355.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.080 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000576 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/485.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.080 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/379.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.080 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001461 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/382) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.080 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001263 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/124) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.081 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012c9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/221) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.081 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/487) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.081 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000081d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/229.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.081 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005bc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/520.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.081 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001254 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/109) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.082 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001541 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/589) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.082 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/187) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.082 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/529) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.082 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000087f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/278.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.082 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/179.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.083 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000146c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/393) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.083 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001288 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/158) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.083 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008f3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/548.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.083 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/242) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.084 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001310 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/292) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.084 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001543 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/591) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.084 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000825 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/233.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.084 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000556 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/469.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.084 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/162.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.084 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002ed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/040.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.085 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000149b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/435.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.085 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/496) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.085 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001289 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/159) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.085 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000572 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/483.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.085 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000038c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/115.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.086 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/501) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.086 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/295.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.086 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002cd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/025.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.086 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000942 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/590.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.086 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001238 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/083) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.087 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001478 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/404) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.087 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000048e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/369.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.087 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/016) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.087 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000150c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/542) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.087 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000057a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/487.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.088 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001498 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/433) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.088 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/243) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.088 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014c4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/474) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.088 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000059c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/504.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.088 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001449 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/360) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.089 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000090f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/562.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.089 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/037.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.089 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/516) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.089 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001251 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/106) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.089 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000558 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/470.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.090 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008a5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/297.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.090 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000121e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/057) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.090 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000490 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/370.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.090 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001469 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/390) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.091 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014ca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/480) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.091 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001290 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/166) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.091 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002bb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/016.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.091 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000800 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/188.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.091 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000494 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/372.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.092 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/256) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.092 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/424.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.092 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001298 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/174) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.092 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000388 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/113.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.092 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012be (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/210) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.093 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000448 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/334.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.093 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/023) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.093 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008c9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/315.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.093 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001488 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/419) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.093 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012f5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/265) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.093 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011d7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/007) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.094 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000083b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/244.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.094 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001487 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/418) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.094 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012c6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/218) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.094 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000382 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/110.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.095 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000140c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/301) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.095 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003d6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/152.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.095 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004c4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/396.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.095 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014b8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/463) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.095 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000032c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/067.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.095 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000147c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/407) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.096 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000153b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/583) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.096 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000083f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/246.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.096 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004d6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/405.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.096 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/170.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.096 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012db (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/239) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.097 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014a7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/446) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.097 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/247) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.097 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005d0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/530.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.097 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001448 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/359) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.097 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001531 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/575) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.098 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/150.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.098 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000130e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/290) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.098 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000419 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/211.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.098 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/248) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.098 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000145c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/377) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.099 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001528 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/568) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.099 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011d3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/003) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.099 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012a7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/188) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.099 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001233 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/078) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.099 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f42 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/499.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.100 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000130b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/287) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.100 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000082d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/237.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.100 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/389.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.100 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b7e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/028.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.100 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/514) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.101 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/017) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.101 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000500 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/426.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.101 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/136.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.101 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ce2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/201.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.101 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000460 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/346.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.102 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/319.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.102 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000084b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/252.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.102 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001507 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/537) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.102 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001532 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/575.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.102 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000053c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/456.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.103 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014d3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/488) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.103 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ee1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/450.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.103 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000127e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/148) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.103 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014dd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/497) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.103 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/185.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.104 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000827 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/234.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.104 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000140a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/299) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.104 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004f8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/422.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.104 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/274) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.104 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/128.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.105 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/513.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.105 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/262) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.105 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000147a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/405) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.105 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000de6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/325.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.105 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d60 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/258.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.105 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/517.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.106 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ce8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/204.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.106 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000810 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/196.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.106 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000865 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/265.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.106 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c46 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/123.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.107 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000504 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/428.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.107 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000380 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/109.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.107 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d9e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/289.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.107 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/012.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.107 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c6a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/141.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.107 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000149a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/435) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.108 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dc0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/306.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.108 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000126c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/133) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.108 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001491 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/427) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.108 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/003.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.108 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014c5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/475) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.109 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001422 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/323) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.109 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cde (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/199.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.109 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000538 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/454.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.109 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000526 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/445.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.109 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cdc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/198.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.110 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e81 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/402.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.110 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008c7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/314.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.110 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f4a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/503.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.110 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014b0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/455) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.110 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cda (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/197.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.111 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ea1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/418.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.111 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000122b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/070) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.111 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000566 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/477.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.111 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/542.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.111 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f4e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/505.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.112 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/554.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.112 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d68 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/262.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.112 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/157.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.112 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000474 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/356.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.112 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c1c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/105.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.113 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cd2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/193.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.113 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000358 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/089.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.113 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/541.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.113 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/126.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.113 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b58 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/009.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.114 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f54 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/508.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.114 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e83 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/403.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.114 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/328.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.114 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000016fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/006.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.114 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bdf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/075.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.114 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c34 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/114.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.115 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e8f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/409.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.115 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000037c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/107.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.115 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e77 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/397.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.115 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005b2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/515.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.115 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d8e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/281.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.116 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014a0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/440) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.116 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bf5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/086.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.116 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000145a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/375) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.116 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c1a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/104.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.116 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ea7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/421.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.117 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/163.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.117 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d1a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/228.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.117 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/528.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.117 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000051a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/439.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.117 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001267 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/128) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.118 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000053e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/457.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.118 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004ca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/399.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.118 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e71 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/394.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.118 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014aa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/449) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.118 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000122c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/071) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.119 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cfc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/214.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.119 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001513 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/549) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.119 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000007f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/181.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.119 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f11 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/474.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.119 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e27 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/357.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.120 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000855 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/257.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.120 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c14 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/101.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.120 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000594 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/500.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.120 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000130f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/291) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.120 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/229) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.121 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000326 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/064.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.121 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000127a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/144) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.121 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/205.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.121 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dfa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/335.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.121 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/226) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.121 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/531.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.122 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001297 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/173) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.122 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000875 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/273.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.122 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000091b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/568.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.122 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004b0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/386.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.122 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e69 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/390.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.123 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ebd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/432.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.123 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000145d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/378) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.123 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e9f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/417.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.123 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bac (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/050.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.123 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000835 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/241.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.124 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e0c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/344.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.124 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000016fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/004) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.124 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000127c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/146) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.124 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012cf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/227) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.124 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000159f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.op) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.125 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ef3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/459.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.125 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d20 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/231.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.125 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cfa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/213.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.125 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ed1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/442.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.125 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b90 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/036.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.126 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ccc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/190.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.126 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dd4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/316.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.126 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b48 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/001.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.126 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dde (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/321.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.126 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c9a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/165.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.127 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b86 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/032.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.127 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e08 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/342.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.127 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001205 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/047) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.127 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d86 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/277.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.127 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014d4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/489) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.127 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001475 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/401) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.128 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000edd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/448.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.128 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000153a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/582) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.128 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000054e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/465.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.128 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f46 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/501.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.128 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002fb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/047.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.129 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001520 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/561) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.129 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c3c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/118.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.129 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000536 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/453.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.129 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d12 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/224.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.129 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ca8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/172.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.130 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000031a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/058.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.130 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e1f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/353.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.130 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/484) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.130 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000016ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/008) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.130 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000356 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/088.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.131 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000058e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/497.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.131 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000435 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/225.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.131 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000da4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/292.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.131 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b54 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/007.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.131 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e21 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/354.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.132 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002b7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/014.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.132 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002cb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/024.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.132 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001408 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/297) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.132 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/132.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.132 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d4c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/248.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.133 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000edf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/449.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.133 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000125e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/119) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.133 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d88 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/278.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.133 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/148.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.133 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000037e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/108.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.134 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c42 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/121.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.134 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f4c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/504.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.134 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002c9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/023.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.134 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bd0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/068.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.135 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001218 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/051) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.135 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000148f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/425) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.135 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ead (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/424.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.135 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/230) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.135 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000143c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/349) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.135 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014a3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/442) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.136 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000082b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/236.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.136 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/206.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.136 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001229 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/068) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.136 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000332 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/070.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.136 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bc4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/062.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.137 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/260) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.137 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f03 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/467.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.137 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ebb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/431.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.137 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000831 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/239.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.137 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e2d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/360.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.138 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001412 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/307) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.138 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005a0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/506.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.138 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000df2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/331.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.138 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e39 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/366.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.138 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d70 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/266.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.139 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001404 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/001) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.139 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f2e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/489.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.139 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/508) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.139 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000042b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/220.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.139 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000938 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/585.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.140 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e9d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/416.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.140 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003b8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/137.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.140 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000016fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/006) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.140 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000150d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/543) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.140 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000015a0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.trans_buf) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.141 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f1d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/480.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.141 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d1e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/230.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.141 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000058c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/496.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.141 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dfc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/336.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.141 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000db4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/300.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.142 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e95 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/412.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.142 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001706 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/015) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.142 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bdd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/074.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.142 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c66 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/139.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.142 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d10 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/223.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.143 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011dd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/013) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.143 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c16 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/102.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.143 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003a8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/129.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.143 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000548 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/462.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.143 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f30 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/490.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.144 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000478 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/358.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.144 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/185) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.144 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/051.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.144 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d52 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/251.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.144 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001311 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/293) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.145 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012d0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/228) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.145 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d3e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/241.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.145 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d92 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/283.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.145 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003b4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/135.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.145 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001522 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/563) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.145 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d7e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/273.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.146 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000518 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/438.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.146 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000093a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/586.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.146 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014b5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/460) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.146 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000540 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/458.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.146 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d62 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/259.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.147 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d72 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/267.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.147 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ba6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/047.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.147 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000031e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/060.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.147 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f1f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/481.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.147 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c09 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/096.out.external) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.148 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c10 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/099.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.148 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000008b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/303.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.148 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cd0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/192.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.148 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000eff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/465.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.148 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001409 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/298) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.149 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ee7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/453.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.149 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/536.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.149 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b50 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/005.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.149 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bbc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/058.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.149 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/458) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.149 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c0c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/097.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.150 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f3e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/497.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.150 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000baa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/049.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.150 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000170c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/019.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.150 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004c8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/398.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.151 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f27 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/485.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.151 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000334 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/071.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.151 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000863 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/264.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.151 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000be3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/077.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.151 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f21 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/482.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.151 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e23 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/355.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.152 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c4e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/127.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.152 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012d5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/233) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.152 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f0f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/473.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.152 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d84 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/276.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.152 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f36 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/493.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.153 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e53 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/379.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.153 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c3a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/117.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.153 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cf2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/209.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.153 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d1c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/229.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.153 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bf3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/085.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.154 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000014f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/521) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.154 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f07 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/469.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.154 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d56 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/253.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.154 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bb4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/054.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.154 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cd4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/194.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.155 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b8a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/033.out.default) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.155 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c5a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/133.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.155 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b98 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/040.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.155 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b70 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/021.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.155 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/045.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.156 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001707 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/016) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.156 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/048.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.156 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c36 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/115.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.156 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000daa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/295.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.156 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000437 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/226.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.157 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e12 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/347.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.157 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/065.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.157 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001418 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/313) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.157 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e37 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/365.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.157 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cc8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/188.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.158 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e8d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/408.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.158 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b64 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/015.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.158 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e02 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/339.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.158 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000002af (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/010.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.158 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dd2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/315.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.159 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ec7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/437.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.159 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000034c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/083.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.159 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c98 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/164.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.159 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f2c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/488.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.159 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e75 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/396.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.160 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c5c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/134.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.160 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c26 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/110.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.160 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c40 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/120.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.160 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e0e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/345.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.160 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000440 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/330.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.161 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bcc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/066.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.161 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c0a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/096.out.internal) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.161 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b4a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/002.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.161 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e97 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/413.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.161 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d0a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/220.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.162 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f3c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/496.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.162 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000151c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/557) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.162 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c62 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/137.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.162 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001704 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/013) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.162 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e29 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/358.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.163 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e41 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/370.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.163 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ef9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/462.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.163 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bb2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/053.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.163 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ec9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/438.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.163 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d48 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/246.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.163 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d3c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/240.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.164 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e45 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/372.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.164 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c52 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/129.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.164 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d80 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/274.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.164 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bf7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/087.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.164 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c5e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/135.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.165 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f34 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/492.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.165 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/313.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.165 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ef1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/458.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.165 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ecf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/441.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.165 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d50 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/250.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.166 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b9a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/041.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.166 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bc0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/060.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.166 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d7c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/272.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.166 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b8c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/034.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.166 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d22 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/232.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.167 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d28 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/235.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.167 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ba4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/046.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.167 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000efb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/463.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.167 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000170a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.167 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d64 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/260.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.168 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dba (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/303.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.168 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000edb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/447.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.168 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b9e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/043.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.168 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e63 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/387.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.168 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b5e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/012.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.168 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000170d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/020) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.169 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d6e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/265.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.169 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b4c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/003.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.169 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b8e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/035.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.169 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e47 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/373.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.169 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001703 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/012) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.170 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b7a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/026.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.170 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000946 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/592.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.170 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000016f9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/003) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.170 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ee9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/454.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.170 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c60 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/136.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.171 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d36 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/237.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.171 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000db2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/299.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.171 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f17 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/477.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.171 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000003c2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/142.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.171 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dd0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/314.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.172 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001231 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/076) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.172 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dda (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/319.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.172 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005d6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/533.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.172 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001455 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/372) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.172 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000eed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/456.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.173 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b78 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/025.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.173 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001596 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.173 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e49 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/374.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.173 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c4c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/126.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.173 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001595 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.174 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001526 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/567) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.174 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000eef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/457.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.174 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e7b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/399.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.174 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001242 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/092) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.174 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ee3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/451.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.175 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000899 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/291.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.175 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b30 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/001.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.175 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d5e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/257.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.175 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d76 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/269.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.175 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000510 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/434.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.176 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001594 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/001) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.176 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000152c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/572) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.176 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/008) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.176 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cba (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/181.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.176 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dbc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/304.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.176 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000021d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/007.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.177 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000932 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/582.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.177 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/308) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.177 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bc8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/064.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.177 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011c6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/302) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.177 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000289 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/301.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.178 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000148c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/422) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.178 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011a3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/010) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.178 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000048a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/367.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.178 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/011) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.178 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f52 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/507.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.179 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011b2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/025) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.179 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011cd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.179 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000257 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/036.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.179 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/273) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.179 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000119b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/002.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.180 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/329.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.180 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000043a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/327.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.180 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000154b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/001) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.180 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001430 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/337) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.180 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c4a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/125.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.181 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004c2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/395.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.181 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001548 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/001) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.181 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000123b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/086) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.181 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/189.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.181 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000004e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/414.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.182 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001549 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.182 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000524 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/444.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.182 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001467 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/388) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.182 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ddc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/320.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.182 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000012f9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/269) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.183 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/091.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.183 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000154a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.183 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000915 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/565.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.183 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e2b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/359.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.183 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001250 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/105) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.184 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000154c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.184 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000a64 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/001.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.184 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d42 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/243.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.184 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000005aa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/511.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.184 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000154d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.184 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001494 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/429.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.185 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000a66 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/001.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.185 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e65 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/388.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.185 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c07 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/095.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.185 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001597 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/002) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.185 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f0b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/471.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.186 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f58 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/510.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.186 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001598 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/032) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.186 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ca2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/169.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.186 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f48 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/502.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.186 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001599 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/298) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.187 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b42 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/298.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.187 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000159a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.187 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b3e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/002.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.187 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ecb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/439.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.187 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000159b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.188 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bdb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/073.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.188 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f44 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/500.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.188 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/024) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.188 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000056a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/479.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.188 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f15 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/476.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.189 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e5b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/383.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.189 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/207.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.189 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cb6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/179.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.189 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bbe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/059.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.189 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cbe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/183.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.190 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d5a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/255.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.190 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000de2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/323.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.190 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b40 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/032.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.190 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.190 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c3e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/119.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.191 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f13 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/475.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.191 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f05 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/468.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.191 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e6b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/391.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.191 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ec3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/435.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.191 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c48 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/124.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.192 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d24 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/233.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.192 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000da2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/291.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.192 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ba0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/044.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.192 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e3b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/367.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.192 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ec1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/434.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.193 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000eb3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/427.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.193 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ecd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/440.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.193 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cf8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/212.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.193 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c01 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/092.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.193 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b4e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/004.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.194 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e73 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/395.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.194 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b56 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/008.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.194 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000015a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.trans_inode) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.194 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e59 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/382.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.194 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ed5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/444.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.195 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e93 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/411.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.195 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e99 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/414.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.195 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e85 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/404.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.195 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b5c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/011.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.195 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f5a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/511.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.196 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f23 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/483.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.196 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f2a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/487.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.196 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e3f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/369.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.196 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f1b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/479.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.196 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000016f8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/002) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.196 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ef5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/460.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.197 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000eb7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/429.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.197 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.197 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b92 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/037.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.197 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ec5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/436.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.197 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/297.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.198 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bba (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/057.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.198 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c32 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/113.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.198 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ed9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/446.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.198 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d44 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/244.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.198 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e5f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/385.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.199 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/067.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.199 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e87 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/405.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.199 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000eeb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/455.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.199 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f40 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/498.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.199 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000db8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/302.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.200 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e7f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/401.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.200 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000295 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/307.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.200 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e3d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/368.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.200 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000df8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/334.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.200 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/009) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.201 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f56 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/509.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.201 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c7a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/149.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.201 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000223 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/010.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.201 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000241 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/025.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.201 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000028d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/303.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.202 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/013) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.202 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f19 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/478.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.202 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000243 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/026.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.202 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000263 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/042.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.202 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000291 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/305.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.203 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bb6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/055.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.203 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011a8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/015) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.203 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/026) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.203 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000022b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/014.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.203 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001708 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/017) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.204 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000023f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/024.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.204 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000023d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/023.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.204 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e10 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/346.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.204 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000011cb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/307) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.204 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001402 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/001) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.204 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.205 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cd8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/196.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.205 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c24 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/109.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.205 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e25 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/356.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.205 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bfb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/089.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.205 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000eb5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/428.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.206 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ed7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/445.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.206 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e61 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/386.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.206 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d8c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/280.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.206 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cd6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/195.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.206 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c12 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/100.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.207 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d5c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/256.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.207 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000de8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/326.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.207 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b96 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/039.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.207 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b94 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/038.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.207 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ed3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/443.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.208 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d4a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/247.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.208 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/311.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.208 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e06 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/341.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.208 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e0a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/343.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.208 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001705 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/014) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.209 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dc6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/309.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.209 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001709 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.209 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d0e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/222.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.209 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f3a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/495.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.209 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000df6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/333.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.209 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dd8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/318.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.210 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dcc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/312.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.210 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b84 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/031.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.210 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c05 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/094.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.210 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000eaf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/425.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.210 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d7a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/271.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.211 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e7d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/400.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.211 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000da8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/294.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.211 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f38 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/494.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.211 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d82 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/275.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.211 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d66 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/261.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.212 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c9c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/166.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.212 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ee5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/452.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.212 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b80 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/029.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.212 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e89 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/406.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.212 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d8a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/279.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.213 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000be5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/078.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.213 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b68 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/017.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.213 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e9b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/415.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.213 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cf0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/208.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.213 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b72 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/022.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.214 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e1b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/351.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.214 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000ebf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/433.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.214 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dbe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/305.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.214 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000be1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/076.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.214 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cb8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/180.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.215 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d06 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/218.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.215 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f0d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/472.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.215 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000bb0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/052.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.215 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f09 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/470.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.215 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000b66 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/016.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.216 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000016fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/007) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.216 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cf6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/211.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.216 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d26 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/234.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.216 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000c50 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/128.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.216 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e67 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/389.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.217 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000eb1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/426.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.217 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d54 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/252.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.217 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000d38 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/238.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.217 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000f01 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/466.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.217 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000dd6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/317.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.218 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000cf4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/210.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.218 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000e35 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/364.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.218 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001314 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.218 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001312 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.218 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000120e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.219 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001318 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.219 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000120f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.219 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001215 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.219 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000001f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/tar/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.219 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000001d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.219 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/xfstests.spec.in) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.220 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000009 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.220 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000613 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/macros.template) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.220 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000000a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.220 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000015 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/heads) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.220 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000010 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.221 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000013 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/heads/master) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.221 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000000c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes/origin) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.221 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001315 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.221 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001316 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.221 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001147 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/function_coverage) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.222 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001113 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_getall_sessions.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.222 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001115 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_query_session.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.222 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001313 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.222 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001112 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_find_eventmsg.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.222 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001111 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_destroy_session.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.223 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001110 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_create_session.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.223 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001114 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_getall_tokens.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.223 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001152 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/create_cpio) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.223 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001322 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.223 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000115b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/menu_test) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.224 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001319 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/DMAPI_aliases) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.224 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000131a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.224 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001148 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.224 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001320 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/lib) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.224 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001149 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.224 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000131e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/dist) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.225 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000114a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/README_for_check_dmapi) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.225 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000131c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.225 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001213 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.225 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001210 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.225 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001211 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.226 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000110f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/wbee.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.226 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001109 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migfind.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.226 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000110b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migout.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.226 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000110a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migin.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.226 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000110e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/mrmean.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.227 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001216 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.227 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001108 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.227 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000110d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/mls.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.227 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000016 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.227 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000011 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.228 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000000d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.228 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000111d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.228 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001129 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/make_rt_sparse.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.228 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001136 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/query_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.228 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000113b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/respond_event.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.229 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001127 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/init_service.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.229 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001134 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/probe_punch_xfsctl_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.229 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000111b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_config_events.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.229 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000112a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/make_sparse.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.229 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000113e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/security_hole2.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.230 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000113c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/rwt.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.230 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001144 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/sync_by_handle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.230 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000111a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_allocinfo.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.230 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000113d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/security_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.230 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001133 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/probe_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.231 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000113f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_disp.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.231 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001118 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/downgrade_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.231 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001119 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/fd_to_handle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.231 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000112d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_rele.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.231 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001121 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_mountinfo.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.232 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001126 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/handle_to_path.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.232 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001142 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_fileattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.232 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001139 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/remove_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.232 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001124 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/getall_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.232 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001128 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/link_test.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.232 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001317 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.233 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001117 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/dm_handle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.233 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000112e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/path_to_fshandle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.233 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001140 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.233 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001145 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/test_assumption.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.233 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001125 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/handle_to_fshandle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.234 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001141 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_eventlist.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.234 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001137 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/randomize_file.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.234 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001130 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/pending.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.234 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000112b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_hold.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.235 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001122 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_region.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.235 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000111f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_events.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.235 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001116 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/create_userevent.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.235 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000113a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/request_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.235 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001143 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/struct_test.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.235 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000111c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_dirattrs.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.236 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001135 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/punch_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.236 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001123 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/getall_disp.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.236 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001138 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/release_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.236 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001132 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/print_fshandle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.236 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001146 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/upgrade_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.237 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001131 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/print_event.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.237 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000112f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/path_to_handle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.237 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000111e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_eventlist.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.237 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000112c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_query.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.237 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001120 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_fileattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.238 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001169 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_fileattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.238 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001165 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_bulkattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.238 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000116d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_rights.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.238 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001160 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mmap.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.238 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001164 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_bulkall.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.239 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000116a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.239 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001323 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.239 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000115d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/dm_test_daemon.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.239 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000115f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mm_fill.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.239 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000115e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/invis_test.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.240 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000115c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/check_dmapi.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.240 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001168 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_eventlist.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.240 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001163 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/send_msg.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.240 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000116b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_invis.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.240 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001167 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_efault.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.241 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001162 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/region_test.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.241 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001166 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.241 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001161 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mmap_cp.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.241 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000116c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_region.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.241 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001321 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/lib/errtest.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.241 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000131f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/dist/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.242 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000114c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/ls_to_copy) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.242 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000114e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/run_test) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.242 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001150 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/test_allocinfo_1) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.242 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001151 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/test_allocinfo_2) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.242 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000114d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/make_holey) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.243 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000114b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/ctf) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.243 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000131b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/crttf) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.243 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000114f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/stf) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.243 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001157 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/realtime.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.243 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001156 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/pending_nfs.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.244 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001155 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/pending.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.244 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000131d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/fail.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.244 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001159 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/standard.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.244 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001158 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/smallq.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.244 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x1000000115a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/standard_nfs.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.245 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001154 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/nfs.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.245 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001103 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/find_session.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.245 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001153 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/main.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.245 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001106 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/stubs.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.245 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001104 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/hsm.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.246 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001214 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.246 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001105 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/print.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.246 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001107 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/util.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.246 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001102 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/dmport.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.246 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/set_region.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.247 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001100 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/set_return_on_destroy.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.247 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001101 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/write_invis.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.247 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x100000010fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/read_invis.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.247 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000001212 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.247 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: Scrub error on inode 0x10000000012 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.247 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.248 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:05:44.248 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:05:44.248 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:05:44.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b9a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/041.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bc0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/060.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d7c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/272.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b8c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/034.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d22 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/232.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d28 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/235.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ba4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/046.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000efb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/463.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000170a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d64 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/260.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dba (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/303.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000edb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/447.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b9e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/043.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e63 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/387.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b5e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/012.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000170d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/020) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.258 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d6e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/265.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.258 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b4c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/003.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.258 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b8e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/035.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.258 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e47 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/373.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.258 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001703 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/012) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.259 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b7a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/026.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.259 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000946 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/592.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.259 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000016f9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/003) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.259 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ee9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/454.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.259 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c60 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/136.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.260 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d36 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/237.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.260 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000db2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/299.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.260 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f17 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/477.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.260 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000003c2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/142.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.260 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dd0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/314.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.261 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001231 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/076) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.261 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dda (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/319.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.261 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005d6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/533.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.261 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001455 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/372) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.261 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000eed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/456.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.262 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b78 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/025.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.262 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001596 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.262 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e49 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/374.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.262 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c4c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/126.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.262 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001595 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001526 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/567) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000eef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/457.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e7b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/399.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001242 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/092) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ee3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/451.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000899 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/291.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b30 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/001.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d5e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/257.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d76 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/269.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000510 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/434.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001594 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/001) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000152c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/572) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/008) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cba (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/181.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dbc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/304.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.266 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000021d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/007.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.266 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000932 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/582.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.266 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/308) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.266 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bc8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/064.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.266 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011c6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/302) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.267 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000289 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/301.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.267 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000148c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/422) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.267 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011a3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/010) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.267 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000048a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/367.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.267 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/011) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.268 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f52 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/507.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.268 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011b2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/025) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.268 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011cd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.268 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000257 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/036.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.268 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/273) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.269 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000119b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/002.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.269 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/329.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.269 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000043a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/327.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.269 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000154b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/001) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.269 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001430 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/337) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.270 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c4a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/125.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.270 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004c2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/395.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.270 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001548 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/001) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.270 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000123b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/086) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.270 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/189.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.271 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000004e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/414.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.271 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001549 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.271 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000524 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/444.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.271 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001467 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/388) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.271 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ddc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/320.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.271 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000012f9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/269) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.272 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/091.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.272 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000154a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.272 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000915 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/565.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.272 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e2b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/359.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.272 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001250 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/105) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.273 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000154c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.273 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000a64 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/001.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.273 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d42 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/243.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.273 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000005aa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/511.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.273 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000154d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.274 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001494 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/429.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.274 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000a66 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/001.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.274 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e65 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/388.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.274 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c07 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/095.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.274 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001597 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/002) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.275 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f0b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/471.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.275 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f58 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/510.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.275 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001598 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/032) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.275 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ca2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/169.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.275 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f48 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/502.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.276 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001599 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/298) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.276 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b42 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/298.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.276 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000159a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.276 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b3e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/002.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.276 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ecb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/439.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.277 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000159b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.277 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bdb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/073.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.277 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f44 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/500.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.277 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/024) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.277 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000056a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/479.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.278 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f15 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/476.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.278 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e5b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/383.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.278 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/207.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.278 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cb6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/179.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.278 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bbe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/059.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.279 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cbe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/183.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.279 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d5a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/255.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.279 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000de2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/323.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.279 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b40 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/032.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.279 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.280 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c3e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/119.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.280 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f13 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/475.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.280 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f05 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/468.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.280 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e6b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/391.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.280 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ec3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/435.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.281 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c48 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/124.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.281 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d24 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/233.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.281 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000da2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/291.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.281 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ba0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/044.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.281 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e3b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/367.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.281 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ec1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/434.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.282 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000eb3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/427.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.282 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ecd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/440.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.282 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cf8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/212.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.282 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c01 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/092.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.283 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b4e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/004.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.283 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e73 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/395.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.283 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b56 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/008.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.283 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000015a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.trans_inode) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.283 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e59 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/382.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.284 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ed5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/444.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.284 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e93 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/411.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.284 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e99 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/414.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.284 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e85 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/404.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.284 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b5c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/011.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f5a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/511.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f23 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/483.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f2a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/487.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e3f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/369.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f1b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/479.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.286 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000016f8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/002) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.286 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ef5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/460.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.286 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000eb7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/429.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.286 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.286 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b92 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/037.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.286 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ec5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/436.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.287 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/297.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.287 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bba (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/057.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.287 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c32 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/113.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.287 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ed9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/446.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.287 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d44 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/244.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.288 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e5f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/385.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.288 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/067.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.288 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e87 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/405.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.288 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000eeb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/455.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.288 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f40 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/498.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.289 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000db8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/302.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.289 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e7f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/401.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.289 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000295 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/307.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.289 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e3d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/368.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.289 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000df8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/334.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.290 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/009) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.290 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f56 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/509.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.290 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c7a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/149.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.290 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000223 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/010.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.290 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000241 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/025.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.291 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000028d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/303.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.291 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/013) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.291 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f19 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/478.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.291 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000243 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/026.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.291 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000263 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/042.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.292 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000291 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/305.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.292 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bb6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/055.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.292 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011a8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/015) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.292 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/026) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.292 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000022b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/014.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.293 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001708 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/017) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.293 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000023f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/024.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.293 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000023d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/023.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.293 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e10 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/346.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.293 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000011cb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/307) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.294 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001402 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/001) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.294 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.294 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cd8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/196.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.294 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c24 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/109.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.294 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e25 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/356.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.295 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bfb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/089.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.295 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000eb5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/428.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.295 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ed7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/445.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.295 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e61 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/386.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.295 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d8c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/280.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.296 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cd6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/195.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.296 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c12 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/100.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.296 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d5c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/256.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.296 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000de8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/326.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.296 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b96 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/039.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b94 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/038.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ed3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/443.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d4a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/247.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/311.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e06 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/341.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.298 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e0a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/343.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.298 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001705 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/014) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.298 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dc6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/309.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.298 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001709 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.298 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d0e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/222.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.299 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f3a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/495.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.299 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000df6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/333.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.299 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dd8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/318.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.299 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dcc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/312.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.299 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b84 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/031.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.300 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c05 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/094.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.300 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000eaf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/425.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.300 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d7a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/271.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.300 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e7d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/400.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.300 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000da8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/294.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.300 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f38 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/494.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.301 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d82 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/275.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.301 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d66 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/261.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.301 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c9c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/166.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.301 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ee5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/452.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.301 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b80 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/029.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.302 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e89 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/406.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.302 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d8a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/279.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.302 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000be5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/078.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.302 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b68 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/017.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.302 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e9b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/415.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.303 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cf0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/208.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.303 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b72 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/022.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.303 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e1b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/351.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.303 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000ebf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/433.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.303 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dbe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/305.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.304 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000be1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/076.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.304 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cb8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/180.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.304 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d06 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/218.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.304 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f0d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/472.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.304 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000bb0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/052.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.305 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f09 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/470.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.305 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000b66 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/016.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.305 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000016fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/007) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.305 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cf6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/211.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.305 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d26 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/234.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.306 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000c50 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/128.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.306 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e67 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/389.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.306 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000eb1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/426.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.306 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d54 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/252.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.306 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000d38 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/238.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.307 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000f01 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/466.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.307 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000dd6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/317.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.307 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000cf4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/210.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.307 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000e35 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/364.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.307 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001314 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.307 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001312 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.308 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000120e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.308 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001318 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.308 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000120f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.308 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001215 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.308 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000001f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/tar/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000001d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/xfstests.spec.in) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000009 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000613 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/macros.template) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000000a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000015 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/heads) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000010 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000013 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/heads/master) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000000c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes/origin) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001315 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001316 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001147 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/function_coverage) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001113 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_getall_sessions.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001115 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_query_session.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001313 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001112 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_find_eventmsg.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001111 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_destroy_session.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001110 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_create_session.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001114 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_getall_tokens.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001152 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/create_cpio) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001322 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000115b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/menu_test) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001319 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/DMAPI_aliases) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000131a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001148 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001320 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/lib) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001149 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000131e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/dist) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000114a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/README_for_check_dmapi) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000131c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.315 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001213 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.315 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001210 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.315 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001211 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.315 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000110f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/wbee.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.315 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001109 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migfind.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.316 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000110b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migout.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.316 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000110a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migin.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.316 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000110e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/mrmean.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.316 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001216 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.316 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001108 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.317 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000110d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/mls.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.317 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000016 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.317 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000011 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.317 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000000d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.317 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000111d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.318 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001129 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/make_rt_sparse.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.318 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001136 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/query_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.318 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000113b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/respond_event.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.318 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001127 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/init_service.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.318 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001134 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/probe_punch_xfsctl_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.319 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000111b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_config_events.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.319 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000112a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/make_sparse.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.319 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000113e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/security_hole2.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.319 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000113c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/rwt.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.319 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001144 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/sync_by_handle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.320 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000111a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_allocinfo.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.320 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000113d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/security_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.320 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001133 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/probe_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.320 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000113f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_disp.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.320 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001118 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/downgrade_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.321 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001119 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/fd_to_handle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.321 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000112d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_rele.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.321 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001121 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_mountinfo.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.321 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001126 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/handle_to_path.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.321 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001142 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_fileattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.322 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001139 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/remove_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.322 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001124 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/getall_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.322 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001128 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/link_test.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.322 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001317 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.322 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001117 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/dm_handle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000112e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/path_to_fshandle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001140 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001145 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/test_assumption.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001125 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/handle_to_fshandle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001141 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_eventlist.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001137 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/randomize_file.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001130 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/pending.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000112b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_hold.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001122 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_region.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000111f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_events.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001116 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/create_userevent.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000113a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/request_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001143 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/struct_test.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000111c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_dirattrs.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001135 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/punch_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001123 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/getall_disp.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.326 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001138 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/release_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.326 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001132 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/print_fshandle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.326 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001146 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/upgrade_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.326 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001131 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/print_event.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.326 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000112f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/path_to_handle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.327 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000111e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_eventlist.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.327 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000112c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_query.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.327 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001120 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_fileattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.327 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001169 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_fileattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.327 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001165 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_bulkattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.328 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000116d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_rights.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.328 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001160 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mmap.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.328 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001164 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_bulkall.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.328 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000116a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.328 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001323 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000115d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/dm_test_daemon.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000115f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mm_fill.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000115e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/invis_test.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000115c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/check_dmapi.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001168 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_eventlist.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001163 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/send_msg.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000116b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_invis.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001167 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_efault.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001162 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/region_test.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.330 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001166 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001161 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mmap_cp.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000116c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_region.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001321 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/lib/errtest.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000131f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/dist/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000114c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/ls_to_copy) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000114e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/run_test) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001150 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/test_allocinfo_1) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001151 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/test_allocinfo_2) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000114d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/make_holey) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000114b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/ctf) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000131b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/crttf) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000114f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/stf) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001157 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/realtime.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001156 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/pending_nfs.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001155 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/pending.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000131d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/fail.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001159 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/standard.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001158 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/smallq.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x1000000115a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/standard_nfs.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001154 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/nfs.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.335 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001103 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/find_session.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.335 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001153 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/main.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.335 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001106 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/stubs.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.335 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001104 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/hsm.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.335 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001214 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.336 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001105 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/print.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.336 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001107 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/util.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.336 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001102 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/dmport.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.336 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/set_region.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.336 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001100 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/set_return_on_destroy.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.337 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001101 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/write_invis.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.337 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x100000010fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/read_invis.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.337 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000001212 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.337 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: Scrub error on inode 0x10000000012 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.337 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.337 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:05:44.338 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:05:44.338 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:05:44.343 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: scrub queued for path: / 2023-10-18T14:05:44.343 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.343 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:05:44.343 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:05:44.343 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000648 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/auxiliary-programs.txt) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.344 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001324 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/requirement-checking.txt) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.344 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000027 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/CHANGES) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.344 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000667 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/string_to_tokens.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.344 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000661 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/forker.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.344 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000065e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/databin.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.345 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000065d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/dataascii.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.345 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000666 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/str_to_bytes.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.345 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000669 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/write_log.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.345 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000668 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/tlibio.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.345 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000660 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/file_lock.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.346 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000665 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/random_range.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.346 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000065f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/datapid.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.346 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000662 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/open_flags.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.346 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000002b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.346 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000002e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4) see mds.i log and `damage ls` output for details 2023-10-18T14:05:44.347 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000663 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/pattern.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.347 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000653 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/file_lock.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.347 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000657 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/pattern.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.347 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000065a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/string_to_tokens.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.347 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000065c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/write_log.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.348 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000650 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/buildrules) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.348 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000655 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/install-sh) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.348 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000029 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.348 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000064f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/buildmacros) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.348 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000652 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/databin.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.349 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000654 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/forker.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.349 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000065b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/tlibio.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.349 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000651 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/dataascii.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.349 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000656 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/open_flags.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.349 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000659 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/str_to_bytes.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.350 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000664 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/random.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.350 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001175 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_dmapidev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.350 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000067a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_libbtrfs.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.350 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000676 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_acldev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.351 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000681 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_utilies.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.351 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000658 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/random_range.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.351 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000675 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/multilib.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.351 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001326 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.351 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001325 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/builddefs.in) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.351 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000678 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_gdbmdev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.352 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000677 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_aiodev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.352 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001176 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_libcdev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.352 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001178 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_xfslibs.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.352 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000067f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_pthread.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.352 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000684 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/visibility_hidden.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.353 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000680 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_types.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.353 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:05:44.353 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001177 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_ncurses.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.353 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000159c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/102) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.353 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b46 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/102.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.354 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000682 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_uuiddev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.354 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000159e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.354 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000159d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.354 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.354 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000674 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/manual_format.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.355 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001174 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_attrdev.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.355 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000679 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_globals.m4) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.355 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:05:44.355 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/description) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.355 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:05:44.356 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000006 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.356 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.356 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000000e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.356 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000602 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/packed-refs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.356 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000606 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/config) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.357 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/info) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.357 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.357 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000600 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/shallow) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.357 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/401.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.357 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000038a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/114.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.358 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/branches) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.358 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008af (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/302.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.358 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001258 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/113) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.358 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001282 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/152) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.359 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003d0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/149.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.359 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001260 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/121) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.359 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012ca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/222) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.359 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001471 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/397.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.359 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000144b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/362) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.360 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000043c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/328.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.360 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000568 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/478.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.360 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/409.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.360 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001222 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/061) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.360 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012c8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/220) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.361 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/441) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.361 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000123c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/086.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.361 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001228 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/067) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.361 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000376 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/104.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.361 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012b7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/203) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.361 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000125d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/118) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.362 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014b7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/462) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.362 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000081b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/228.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.362 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000314 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/055.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.362 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000041f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/214.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.362 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000146f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/396) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.363 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000560 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/474.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.363 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000092b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/576.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.363 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/160.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.363 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000476 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/357.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.363 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014f3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/518) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.364 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000047e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/361.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.364 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001503 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/533) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.364 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/027) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.364 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001451 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/368) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.364 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000129f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/181) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.365 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001458 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/374) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.365 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000050c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/432.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.365 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000052c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/448.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.365 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/019) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.365 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/461) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.366 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001276 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/140.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.366 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000392 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/118.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.366 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001261 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/122) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.366 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/501.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.367 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005b0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/514.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.367 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000141a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/315) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.367 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001474 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/400) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.367 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/505) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.367 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001410 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/305) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.367 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000433 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/224.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.368 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/275) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.368 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000128c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/162) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.368 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014c6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/476) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.368 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001472 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/398) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.368 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/500) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.369 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001244 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/093.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.369 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000423 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/216.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.369 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/158.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.369 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/381.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.369 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/035.out.nfs) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.370 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001521 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/562) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.370 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000897 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/290.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.370 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001420 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/321) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.370 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/423.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.370 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000151e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/559) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.371 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000089d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/293.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.371 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/259) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.371 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000936 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/584.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.371 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004bc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/392.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.371 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/022) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.372 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/482) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.372 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/186.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.372 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/027.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.372 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000049c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/376.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.372 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000647 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/xfscrash) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.373 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000582 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/491.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.373 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000149e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/438) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.373 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008d7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/322.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.373 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000122f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/074) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.373 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000646 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/rc.sysinit) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.374 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001407 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/296) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.374 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001239 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/084) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.374 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000025 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.374 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/224) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.374 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001292 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/168) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.374 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000316 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/056.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.375 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001173 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/iogen.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.375 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000671 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/growfiles.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.375 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/174.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.375 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012c5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/217) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.375 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000934 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/583.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.376 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001170 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/doio.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.376 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001496 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/431) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.376 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012ed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/257) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.376 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000116f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.376 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000129d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/179) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.377 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014d9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/494) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.377 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014ab (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/450) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.377 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001172 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/fsx.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.377 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000386 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/112.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.377 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014bd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/468) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.378 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/167.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.378 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/252) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.378 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001283 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/153) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.378 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000324 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/063.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.378 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/038) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.379 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001171 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/fsstress.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.379 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000126a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/131) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.379 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000407 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/202.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.379 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000147b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/406) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.379 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014b9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/464) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.380 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000673 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/rwtest.sh) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.380 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001262 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/123) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.380 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012ba (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/206) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.380 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000145b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/376) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.380 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000093e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/588.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.381 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000066e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/doio.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.381 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000126b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/132) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.381 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/504) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.381 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000066c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/aio-stress.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.381 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012d8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/236) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.382 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000120d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.382 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000869 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/267.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.382 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/020.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.382 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012bf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/211) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.382 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000128a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/160) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.383 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000508 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/430.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.383 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/127.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.383 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000330 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/069.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.383 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/420.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.383 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000120c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.384 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000808 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/192.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.384 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000450 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/338.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.384 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000128f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/165) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.384 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/repair) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.384 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000088f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/286.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.385 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.385 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014d5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/490) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.385 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001524 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/565) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.385 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filter.btrfs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.385 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000124c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/101) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.386 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000145f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/380) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.386 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010f8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/report) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.386 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000871 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/271.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.386 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmlogwrites) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.386 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012ab (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/192) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.387 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000146e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/395) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.387 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/400.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.387 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000634 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/perf) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.387 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000091f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/570.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.387 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmerror) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.388 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000124e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/103) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.388 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000621 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmhugedisk) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.388 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/519) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.388 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000588 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/494.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.388 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001247 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/096) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.388 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001431 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/338) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.389 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010fb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/xfs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.389 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000879 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/275.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.389 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000121a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/053) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.389 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/175.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.389 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010f9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/scsi_debug) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.390 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/547.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.390 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000054c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/464.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.390 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000085d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/261.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.390 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/verity) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.390 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/178.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.391 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004ac (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/384.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.391 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/casefold) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.391 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000480 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/362.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.391 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000062f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/locktest) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.391 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/539.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.392 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/config) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.392 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filestreams) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.392 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000123a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/085) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.392 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/encrypt) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.392 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/166.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.393 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001540 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/588) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.393 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/rc) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.393 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/029.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.393 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dump) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.393 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001525 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/566) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.394 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000534 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/452.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.394 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000061a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/cgroup2) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.394 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014c0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/471) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.394 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004d8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/406.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.394 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/029) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.395 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001234 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/079) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.395 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000632 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/nfs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.395 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000308 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.default) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.395 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000881 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/279.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.395 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000142b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/332) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.396 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmflakey) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.396 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001482 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/413) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.396 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014da (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/495) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.396 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000342 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/078.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.396 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000093c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/587.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.397 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002bd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/017.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.397 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/punch) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.397 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000142a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/331) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.397 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/renameat2) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.397 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001447 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/358) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.398 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000021 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.398 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014b2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/457) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.398 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000546 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/461.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.398 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filter) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.398 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001411 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/306) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.399 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001232 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/077) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.399 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmdelay) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.399 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014a9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/448) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.399 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001456 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/373) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.399 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/module) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.400 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000409 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/203.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.400 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmapi) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.400 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001226 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/065) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.400 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008bb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/308.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.400 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010f5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/reflink) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.400 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000372 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/102.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.401 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/btrfs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.401 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000149f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/439) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.401 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000384 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/111.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.401 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/fuzzy) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.401 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014b4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/459) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.402 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000153e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/586) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.402 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000837 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/242.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.402 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/255) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.402 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001523 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/564) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.402 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000806 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/191.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.403 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000063f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/test_names) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.403 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000038e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/116.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.403 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010f3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/quota) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.403 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014a8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/447) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.403 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmthin) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.404 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001483 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/414) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.404 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/overlay) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.404 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000378 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/105.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.404 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/403.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.404 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000120a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/attr) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.405 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001502 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/532) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.405 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010ed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/inject) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.405 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/035.cfg) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.405 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/populate) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.405 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001492 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/428) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.406 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002ad (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/009.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.406 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000516 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/437.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.406 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/508.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.406 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001514 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/550) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.406 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/log) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.407 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001279 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/143) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.407 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/540.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.407 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000148a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/420) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.407 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000023 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/configs/example.config) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.407 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000150a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/540) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.407 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000486 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/365.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.408 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000129e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/180) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.408 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000061c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/defrag) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.408 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001485 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/416) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.408 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002a7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/006.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.408 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000150f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/545) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.409 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/164.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.409 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000644 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/configs/localhost.config) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.409 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000128b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/161) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.409 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001450 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/367) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.409 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001265 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/126) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.410 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000001c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.410 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001301 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/277) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.410 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004c0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/394.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.410 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000001e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/tar) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.410 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003aa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/130.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.411 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000885 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/281.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.411 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.411 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000057c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/488.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.411 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005c0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/522.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.411 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001413 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/308) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.411 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005d4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/532.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.412 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001538 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/580) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.412 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001501 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/531) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.412 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000129a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/176) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.412 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012a5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/186) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.412 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/interop) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.413 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000125a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/115) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.413 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000045e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/345.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.413 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014d0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/485) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.413 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012d9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/237) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.413 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/408.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.414 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000396 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/120.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.414 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010cb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/compare-failures) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.414 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/200) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.414 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000032a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/066.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.414 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012b8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/204) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.415 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/413.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.415 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010cf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/fs-walk) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.415 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003b2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/134.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.415 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000354 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/087.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.415 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/198) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.416 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000122d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/072) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.416 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010cd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/db-walk) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.416 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000030a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.xfsquota) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.416 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000a2d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/579.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.416 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000029f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/002.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.417 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012c7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/219) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.417 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000008 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/info) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.417 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001441 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/353) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.417 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001308 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/284) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.417 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014f8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/523) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.417 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/165.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.418 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001209 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/README.auto-qa) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.418 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008a7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/298.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.418 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000468 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/350.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.418 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010c9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/ag-wipe) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.419 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000123f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/089) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.419 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/042.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.419 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000007 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.419 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000044c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/336.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.419 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001287 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/157) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.420 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.420 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001484 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/415) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.420 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011d8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/008) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.420 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.420 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000141c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/317) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.421 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000374 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/103.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.421 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.421 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000034a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/082.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.421 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000126f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/136) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.421 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.422 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000141d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/318) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.422 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001506 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/536) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.422 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/456) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.422 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002a9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/007.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.422 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/527) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.423 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.423 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000843 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/248.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.423 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003d4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/151.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.423 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001249 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/098) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.423 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.424 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000088b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/284.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.424 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001546 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.424 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014ad (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/452) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.424 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001495 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/430) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.424 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.424 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000398 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/121.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.425 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012ad (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/194) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.425 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/update.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.425 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000032e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/068.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.425 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001476 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/402) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.425 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.426 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000322 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/062.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.426 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001264 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/125) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.426 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.426 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000121c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/055) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.426 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005ed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.427 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000050e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/433.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.427 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001224 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/063) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.427 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/270) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.427 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/024) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.427 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.428 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000913 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/564.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.428 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000144d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/364) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.428 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000014 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/HEAD) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.428 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001296 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/172) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.428 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000033e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/076.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.429 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000000f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.429 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001243 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/093) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.429 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014be (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/469) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.429 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000488 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/366.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.429 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000a2f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/580.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.430 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008b5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/305.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.430 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000909 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/559.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.430 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000867 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/266.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.430 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000121d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/056) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.430 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/tags) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.431 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000057e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/489.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.431 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001437 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/344) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.431 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007dd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/info/exclude) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.431 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014c2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/472) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.431 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000081f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/230.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.432 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/heads) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.432 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001443 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/354) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.432 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008f9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/551.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.432 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/180.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.432 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/015) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.433 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001424 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/325) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.433 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000125f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/120) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.433 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001274 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/139.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.433 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000427 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/218.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.433 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000153d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/585) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.434 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005c6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/525.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.434 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001439 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/346) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.434 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000123e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/088) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.434 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005b8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/518.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.434 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001255 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/110) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.435 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001490 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/426) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.435 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001499 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/434) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.435 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/528) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.435 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005f3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.435 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000580 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/490.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.435 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000055c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/472.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.436 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000149c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/436) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.436 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/453) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.436 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000849 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/251.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.436 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000030e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/052.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.436 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000318 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/057.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.437 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/202) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.437 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/246) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.437 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/267) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.437 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001307 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/283) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.437 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000901 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/555.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.438 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000891 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/287.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.438 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000036c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/099.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.438 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001270 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/137) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.438 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014cf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/484.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.438 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000889 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/283.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.439 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000152d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/572.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.439 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000049e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/377.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.439 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000911 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/563.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.439 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000000b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.439 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/177.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.440 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004a8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/382.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.440 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001225 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/064) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.440 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001240 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/090) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.440 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001462 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/383) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.441 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000578 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/486.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.441 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011eb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/026) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.441 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/264) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.441 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000492 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/371.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.441 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003c8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/145.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.442 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001428 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/329) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.442 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012d3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/231) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.442 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014c8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/478) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.442 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000086d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/269.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.442 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000532 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/451.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.443 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000905 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/557.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.443 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000151d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/558) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.443 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012c2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/214) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.443 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000421 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/215.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.443 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014bb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/466) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.444 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000036a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/098.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.444 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001445 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/356) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.444 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000127b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/145) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.444 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/304.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.444 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001204 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/046) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.445 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000366 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/096.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.445 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003ca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/146.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.445 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008b9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/307.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.445 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000140f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/304) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.445 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/033) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.446 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/200.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.446 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011f4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/032) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.446 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000144f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/366) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.446 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001305 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/281) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.446 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001417 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/312) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.447 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012bd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/209) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.447 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000861 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/263.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.447 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/253) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.447 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000148d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/423) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.447 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000152a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/570) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.448 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/440.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.448 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000528 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/446.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.448 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001459 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/374.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.448 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001303 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/279) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.448 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000041b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/212.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.448 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001436 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/343) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.449 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005c4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/524.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.449 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002a3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/004.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.449 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001421 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/322) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.449 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/537.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.449 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000047a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/359.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.450 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000143a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/347) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.450 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008d3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/320.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.450 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000802 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/189.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.450 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000048c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/368.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.450 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000053a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/455.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.451 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002ab (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/008.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.451 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012e6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/250) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.451 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004e2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/411.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.451 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001245 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/094) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.451 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012d4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/232) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.452 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/509.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.452 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/527.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.452 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011d9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/009) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.452 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000130d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/289) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.452 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000544 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/460.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.453 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/385.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.453 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000035c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/091.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.453 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000514 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/436.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.453 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000089b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/292.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.453 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001446 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/357) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.454 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/171.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.454 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/002) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.454 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/443) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.454 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000839 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/243.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.455 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000917 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/566.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.455 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/011.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.455 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014ac (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/451) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.455 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001479 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/404.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.455 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000043e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/329.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.455 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000086f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/270.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.456 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/249) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.456 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000147e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/409) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.456 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000141b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/316) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.456 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005be (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/521.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.456 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000598 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/502.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.457 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008a9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/299.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.457 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000150b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/541) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.457 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000859 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/259.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.457 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000121b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/054) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.457 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000039a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/122.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.457 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000152f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/574) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.458 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/529.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.458 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001512 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/548) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.458 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000147d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/408) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.458 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014f5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/520) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.458 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002a5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/005.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.459 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000590 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/498.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.459 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000056e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/481.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.459 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012af (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/196) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.459 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000564 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/476.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.459 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000368 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/097.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.460 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000052e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/449.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.460 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001500 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/530) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.460 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000586 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/493.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.460 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002c1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/019.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.460 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001465 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/386) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.461 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008d9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/323.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.461 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000390 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/117.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.461 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000127f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/149) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.461 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000340 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/077.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.461 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/503) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.462 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000472 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/355.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.462 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000576 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/485.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.462 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/379.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.462 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001461 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/382) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.462 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001263 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/124) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.463 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012c9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/221) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.463 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/487) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.465 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000081d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/229.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.465 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005bc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/520.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.465 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001254 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/109) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.466 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001541 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/589) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.466 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/187) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.466 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/529) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.466 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000087f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/278.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.466 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007ee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/179.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.467 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000146c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/393) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.467 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001288 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/158) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.467 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008f3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/548.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.467 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012de (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/242) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.467 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001310 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/292) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.468 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001543 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/591) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.468 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000825 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/233.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.468 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000556 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/469.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.468 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003ea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/162.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.468 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002ed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/040.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.468 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000149b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/435.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.469 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/496) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.469 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001289 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/159) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.469 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000572 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/483.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.469 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000038c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/115.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.469 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/501) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.470 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/295.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.470 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002cd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/025.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.470 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000942 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/590.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.470 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001238 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/083) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.470 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001478 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/404) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.471 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000048e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/369.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.471 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/016) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.471 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000150c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/542) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.471 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000057a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/487.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.471 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001498 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/433) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.472 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012df (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/243) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.472 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014c4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/474) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.472 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000059c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/504.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.472 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001449 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/360) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.472 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000090f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/562.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.473 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/037.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.473 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014f1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/516) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.473 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001251 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/106) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.473 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000558 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/470.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.473 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008a5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/297.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.473 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000121e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/057) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.474 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000490 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/370.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.474 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001469 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/390) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.474 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014ca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/480) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.474 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001290 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/166) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.474 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002bb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/016.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.475 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000800 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/188.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.475 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000494 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/372.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.475 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/256) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.475 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/424.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.475 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001298 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/174) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.476 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000388 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/113.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.476 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012be (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/210) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.476 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000448 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/334.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.476 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/023) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.476 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008c9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/315.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.477 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001488 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/419) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.477 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012f5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/265) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.477 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011d7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/007) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.477 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000083b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/244.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.477 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001487 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/418) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.478 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012c6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/218) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.478 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000382 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/110.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.478 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000140c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/301) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.478 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003d6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/152.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.478 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004c4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/396.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.479 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014b8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/463) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.479 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000032c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/067.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.479 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000147c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/407) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.479 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000153b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/583) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.479 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000083f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/246.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.479 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004d6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/405.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.480 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/170.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.480 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012db (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/239) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.480 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014a7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/446) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.480 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012e3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/247) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.480 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005d0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/530.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.481 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001448 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/359) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.481 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001531 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/575) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.481 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/150.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.481 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000130e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/290) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.481 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000419 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/211.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.482 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012e4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/248) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.482 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000145c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/377) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.482 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001528 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/568) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.482 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011d3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/003) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.482 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012a7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/188) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.483 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001233 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/078) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.483 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f42 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/499.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.483 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000130b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/287) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.483 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000082d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/237.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.483 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/389.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.484 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b7e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/028.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.484 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014ef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/514) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.484 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011e1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/017) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.484 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000500 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/426.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.484 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/136.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.485 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ce2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/201.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.485 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000460 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/346.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.485 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/319.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.485 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000084b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/252.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.485 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001507 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/537) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.486 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001532 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/575.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.486 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000053c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/456.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.486 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014d3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/488) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.486 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ee1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/450.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.486 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000127e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/148) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.487 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014dd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/497) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.487 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/185.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.487 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000827 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/234.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.487 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000140a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/299) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.487 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004f8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/422.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.487 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/274) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.488 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/128.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.488 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/513.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.488 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/262) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.488 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000147a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/405) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.488 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000de6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/325.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.489 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d60 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/258.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.489 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005b6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/517.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.489 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ce8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/204.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.489 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000810 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/196.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.489 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000865 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/265.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.490 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c46 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/123.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.490 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000504 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/428.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.490 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000380 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/109.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.490 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d9e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/289.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.490 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/012.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.491 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c6a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/141.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.491 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000149a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/435) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.491 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dc0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/306.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.491 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000126c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/133) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.491 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001491 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/427) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.492 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/003.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.492 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014c5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/475) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.492 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001422 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/323) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.492 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cde (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/199.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.492 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000538 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/454.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.492 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000526 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/445.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.493 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cdc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/198.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.493 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e81 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/402.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.493 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008c7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/314.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.493 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f4a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/503.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.493 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014b0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/455) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.494 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cda (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/197.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.494 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ea1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/418.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.494 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000122b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/070) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.494 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000566 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/477.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.494 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008e7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/542.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.495 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f4e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/505.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.495 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/554.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.495 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d68 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/262.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.495 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003e0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/157.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.495 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000474 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/356.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.496 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c1c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/105.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.496 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cd2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/193.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.496 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000358 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/089.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.496 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008e5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/541.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.496 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/126.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.497 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b58 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/009.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.497 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f54 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/508.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.497 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e83 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/403.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.497 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/328.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.497 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000016fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/006.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.498 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bdf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/075.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.498 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c34 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/114.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.498 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e8f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/409.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.498 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000037c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/107.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.498 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e77 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/397.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.499 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005b2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/515.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.499 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d8e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/281.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.499 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014a0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/440) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.499 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bf5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/086.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.499 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000145a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/375) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.499 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c1a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/104.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.500 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ea7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/421.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.500 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003ec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/163.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.500 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d1a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/228.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.500 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/528.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.500 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000051a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/439.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.501 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001267 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/128) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.501 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000053e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/457.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.501 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004ca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/399.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.501 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e71 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/394.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.501 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014aa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/449) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.502 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000122c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/071) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.502 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cfc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/214.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.502 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001513 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/549) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.502 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000007f2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/181.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.502 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f11 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/474.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.502 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e27 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/357.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.503 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000855 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/257.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.503 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c14 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/101.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.503 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000594 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/500.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.503 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000130f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/291) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.503 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012d1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/229) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.504 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000326 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/064.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.504 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000127a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/144) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.504 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cea (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/205.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.504 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dfa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/335.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.504 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/226) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.505 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/531.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.505 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001297 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/173) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.505 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000875 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/273.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.505 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000091b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/568.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.505 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004b0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/386.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.506 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e69 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/390.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.506 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ebd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/432.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.506 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000145d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/378) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.506 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e9f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/417.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.506 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bac (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/050.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.507 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000835 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/241.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.507 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e0c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/344.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.507 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000016fa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/004) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.507 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000127c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/146) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.507 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012cf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/227) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.507 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000159f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.op) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.508 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ef3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/459.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.508 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d20 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/231.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.508 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cfa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/213.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.508 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ed1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/442.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.508 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b90 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/036.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.509 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ccc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/190.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.509 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dd4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/316.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.509 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b48 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/001.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.509 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dde (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/321.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.509 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c9a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/165.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.510 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b86 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/032.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.510 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e08 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/342.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.510 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001205 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/047) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.510 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d86 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/277.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.510 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014d4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/489) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.511 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001475 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/401) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.511 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000edd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/448.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.511 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000153a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/582) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.511 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000054e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/465.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.511 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f46 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/501.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.511 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002fb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/047.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.512 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001520 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/561) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.512 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c3c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/118.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.512 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000536 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/453.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.512 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d12 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/224.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.512 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ca8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/172.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.513 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000031a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/058.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.513 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e1f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/353.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.513 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/484) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.513 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000016ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/008) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.513 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000356 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/088.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.514 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000058e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/497.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.514 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000435 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/225.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.514 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000da4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/292.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.514 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b54 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/007.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.514 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e21 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/354.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.515 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002b7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/014.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.515 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002cb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/024.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.515 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001408 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/297) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.515 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003ae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/132.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.515 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d4c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/248.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.516 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000edf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/449.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.516 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000125e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/119) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.516 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d88 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/278.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.516 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003ce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/148.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.516 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000037e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/108.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.516 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c42 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/121.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.517 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f4c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/504.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.517 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002c9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/023.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.517 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bd0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/068.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.517 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001218 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/051) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.517 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000148f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/425) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.518 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ead (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/424.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.518 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012d2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/230) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.518 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000143c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/349) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.518 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014a3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/442) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.518 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000082b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/236.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.519 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cec (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/206.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.519 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001229 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/068) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.519 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000332 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/070.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.519 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bc4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/062.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.519 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012f0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/260) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.520 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f03 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/467.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.520 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ebb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/431.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.520 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000831 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/239.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.520 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e2d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/360.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.520 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001412 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/307) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.521 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005a0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/506.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.521 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000df2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/331.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.521 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e39 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/366.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.521 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d70 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/266.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.521 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001404 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/001) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.522 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f2e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/489.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.522 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014e9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/508) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.522 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000042b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/220.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.522 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000938 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/585.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.522 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e9d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/416.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.523 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003b8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/137.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.523 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000016fc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/006) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.523 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000150d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/543) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.523 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000015a0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.trans_buf) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.523 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f1d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/480.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.523 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d1e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/230.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.524 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000058c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/496.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.524 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dfc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/336.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.524 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000db4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/300.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.524 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e95 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/412.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.524 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001706 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/015) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.525 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bdd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/074.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.525 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c66 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/139.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.525 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d10 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/223.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.525 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011dd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/013) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.525 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c16 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/102.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.526 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003a8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/129.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.526 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000548 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/462.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.526 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f30 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/490.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.526 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000478 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/358.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.526 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/185) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.527 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/051.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.527 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d52 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/251.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.527 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001311 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/293) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.527 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012d0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/228) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.527 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d3e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/241.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.528 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d92 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/283.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.528 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003b4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/135.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.528 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001522 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/563) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.528 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d7e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/273.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.528 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000518 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/438.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.528 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000093a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/586.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.529 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014b5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/460) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.529 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000540 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/458.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.529 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d62 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/259.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.529 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d72 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/267.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.529 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ba6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/047.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.530 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000031e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/060.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.530 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f1f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/481.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.530 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c09 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/096.out.external) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.530 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c10 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/099.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.530 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000008b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/303.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.531 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cd0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/192.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.531 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000eff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/465.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.531 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001409 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/298) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.531 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ee7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/453.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.531 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/536.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.532 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b50 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/005.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.532 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bbc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/058.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.532 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/458) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.532 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c0c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/097.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.532 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f3e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/497.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.533 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000baa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/049.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.533 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000170c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/019.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.533 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004c8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/398.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.533 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f27 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/485.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.533 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000334 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/071.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.534 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000863 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/264.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.534 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000be3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/077.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.534 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f21 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/482.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.534 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e23 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/355.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.534 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c4e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/127.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.535 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012d5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/233) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.535 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f0f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/473.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.535 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d84 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/276.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.535 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f36 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/493.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.535 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e53 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/379.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.536 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c3a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/117.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.536 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cf2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/209.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.536 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d1c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/229.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.536 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bf3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/085.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.536 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000014f6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/521) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.537 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f07 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/469.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.537 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d56 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/253.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.537 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bb4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/054.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.537 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cd4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/194.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.537 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b8a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/033.out.default) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.538 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c5a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/133.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.538 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b98 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/040.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.538 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b70 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/021.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.538 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002f7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/045.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.538 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001707 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/016) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.539 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/048.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.539 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c36 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/115.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.539 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000daa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/295.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.539 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000437 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/226.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.539 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e12 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/347.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.539 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/065.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.540 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001418 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/313) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.540 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e37 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/365.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.540 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cc8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/188.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.540 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e8d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/408.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.540 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b64 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/015.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.541 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e02 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/339.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.541 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000002af (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/010.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.541 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dd2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/315.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.541 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ec7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/437.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.541 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000034c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/083.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.542 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c98 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/164.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.542 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f2c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/488.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.542 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e75 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/396.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.542 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c5c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/134.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.542 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c26 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/110.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.543 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c40 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/120.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.543 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e0e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/345.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.543 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000440 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/330.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.543 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bcc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/066.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.543 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c0a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/096.out.internal) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.544 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b4a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/002.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.544 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e97 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/413.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.544 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d0a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/220.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.544 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f3c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/496.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.544 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000151c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/557) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.545 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c62 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/137.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.545 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001704 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/013) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.545 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e29 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/358.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.545 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e41 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/370.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.545 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ef9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/462.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.546 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bb2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/053.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.546 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ec9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/438.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.546 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d48 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/246.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.546 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d3c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/240.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.546 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e45 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/372.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.547 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c52 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/129.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.547 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d80 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/274.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.547 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bf7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/087.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.547 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c5e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/135.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.547 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f34 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/492.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.547 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/313.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.548 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ef1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/458.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.548 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ecf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/441.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.548 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d50 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/250.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.548 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b9a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/041.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.548 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bc0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/060.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.549 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d7c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/272.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.549 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b8c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/034.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.549 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d22 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/232.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.549 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d28 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/235.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.549 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ba4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/046.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.550 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000efb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/463.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.550 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000170a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.550 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d64 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/260.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.550 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dba (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/303.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.550 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000edb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/447.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.551 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b9e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/043.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.551 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e63 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/387.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.551 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b5e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/012.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.551 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000170d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/020) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.551 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d6e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/265.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.552 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b4c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/003.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.552 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b8e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/035.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.552 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e47 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/373.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.552 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001703 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/012) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.552 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b7a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/026.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.552 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000946 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/592.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.553 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000016f9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/003) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.553 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ee9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/454.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.553 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c60 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/136.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.553 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d36 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/237.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.553 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000db2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/299.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.554 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f17 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/477.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.554 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000003c2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/142.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.554 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dd0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/314.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.554 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001231 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/076) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.554 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dda (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/319.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.555 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005d6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/533.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.555 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001455 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/372) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.555 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000eed (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/456.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.555 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b78 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/025.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.555 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001596 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.556 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e49 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/374.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.556 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c4c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/126.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.556 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001595 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.556 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001526 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/567) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.556 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000eef (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/457.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.557 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e7b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/399.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.557 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001242 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/092) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.557 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ee3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/451.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.557 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000899 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/291.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.557 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b30 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/001.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.557 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d5e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/257.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.558 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d76 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/269.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.558 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000510 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/434.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.558 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001594 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/001) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.558 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000152c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/572) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.558 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/008) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.559 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cba (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/181.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.559 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dbc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/304.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.559 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000021d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/007.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.559 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000932 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/582.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.559 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011cc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/308) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.560 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bc8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/064.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.560 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011c6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/302) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.560 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000289 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/301.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.560 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000148c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/422) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.560 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011a3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/010) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.561 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000048a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/367.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.561 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011a4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/011) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.561 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f52 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/507.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.561 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011b2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/025) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.561 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011cd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.562 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000257 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/036.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.562 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012fd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/273) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.562 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000119b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/002.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.562 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/329.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.562 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000043a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/327.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.563 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000154b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/001) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.563 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001430 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/337) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.563 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c4a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/125.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.563 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004c2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/395.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.563 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001548 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/001) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.563 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000123b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/086) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.564 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/189.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.564 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000004e8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/414.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.564 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001549 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.564 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000524 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/444.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.564 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001467 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/388) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.565 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ddc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/320.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.565 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000012f9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/269) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.565 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/091.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.565 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000154a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.565 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000915 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/565.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.566 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e2b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/359.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.566 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001250 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/105) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.566 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000154c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.566 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000a64 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/001.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.566 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d42 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/243.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.567 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000005aa (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/511.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.567 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000154d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.567 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001494 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/429.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.567 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000a66 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/001.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.567 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e65 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/388.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.568 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c07 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/095.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.568 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001597 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/002) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.568 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f0b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/471.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.568 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f58 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/510.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.568 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001598 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/032) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.568 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ca2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/169.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.569 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f48 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/502.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.569 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001599 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/298) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.569 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b42 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/298.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.569 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000159a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/Makefile) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.569 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b3e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/002.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.570 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ecb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/439.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.570 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000159b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/group) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.570 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bdb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/073.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.570 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f44 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/500.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.570 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011b1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/024) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.571 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000056a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/479.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.571 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f15 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/476.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.571 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e5b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/383.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.571 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cee (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/207.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.571 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cb6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/179.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.572 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bbe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/059.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.572 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cbe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/183.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.572 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d5a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/255.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.572 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000de2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/323.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.572 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b40 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/032.out) see mds.b log and `damage ls` output for details 2023-10-18T14:05:44.572 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.573 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c3e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/119.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.573 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f13 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/475.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.573 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f05 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/468.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.573 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e6b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/391.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.573 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ec3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/435.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.574 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c48 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/124.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.574 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d24 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/233.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.574 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000da2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/291.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.574 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ba0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/044.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.574 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e3b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/367.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.575 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ec1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/434.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.575 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000eb3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/427.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.575 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ecd (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/440.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.575 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cf8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/212.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.575 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c01 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/092.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.576 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b4e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/004.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.576 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e73 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/395.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.576 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b56 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/008.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.576 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000015a1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.trans_inode) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.576 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e59 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/382.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.577 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ed5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/444.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.577 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e93 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/411.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.577 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e99 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/414.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.577 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e85 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/404.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.577 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b5c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/011.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.577 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f5a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/511.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.578 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f23 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/483.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.578 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f2a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/487.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.578 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e3f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/369.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.578 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f1b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/479.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.578 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000016f8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/002) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.579 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ef5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/460.out) see mds.f log and `damage ls` output for details 2023-10-18T14:05:44.579 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000eb7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/429.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.579 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.579 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b92 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/037.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.579 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ec5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/436.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.580 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dae (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/297.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.580 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bba (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/057.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.580 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c32 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/113.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.580 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ed9 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/446.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.580 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d44 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/244.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.581 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e5f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/385.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.581 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bce (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/067.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.581 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e87 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/405.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.581 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000eeb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/455.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.581 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f40 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/498.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.581 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000db8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/302.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.582 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e7f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/401.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.582 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000295 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/307.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.582 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e3d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/368.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.582 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000df8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/334.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.582 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011a2 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/009) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.583 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f56 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/509.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.583 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c7a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/149.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.583 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000223 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/010.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.583 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000241 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/025.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.583 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000028d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/303.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.584 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011a6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/013) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.584 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f19 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/478.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.584 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000243 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/026.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.584 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000263 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/042.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.584 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000291 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/305.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.585 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bb6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/055.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.585 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011a8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/015) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.585 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011b3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/026) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.585 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000022b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/014.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.585 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001708 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/017) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.586 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000023f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/024.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.586 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000023d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/023.out) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.586 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e10 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/346.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.586 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000011cb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/307) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.586 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001402 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/001) see mds.a log and `damage ls` output for details 2023-10-18T14:05:44.586 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.587 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cd8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/196.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.587 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c24 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/109.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.587 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e25 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/356.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.587 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bfb (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/089.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.587 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000eb5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/428.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ed7 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/445.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e61 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/386.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d8c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/280.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cd6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/195.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c12 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/100.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d5c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/256.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000de8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/326.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b96 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/039.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b94 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/038.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ed3 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/443.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d4a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/247.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dca (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/311.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e06 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/341.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e0a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/343.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.590 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001705 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/014) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dc6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/309.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001709 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d0e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/222.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f3a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/495.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.591 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000df6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/333.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dd8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/318.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dcc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/312.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b84 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/031.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c05 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/094.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000eaf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/425.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.592 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d7a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/271.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.593 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e7d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/400.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.593 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000da8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/294.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.593 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f38 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/494.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.593 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d82 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/275.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.593 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d66 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/261.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.594 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c9c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/166.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.594 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ee5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/452.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.594 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b80 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/029.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.594 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e89 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/406.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.594 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d8a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/279.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.595 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000be5 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/078.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.595 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b68 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/017.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.595 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e9b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/415.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.595 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cf0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/208.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.595 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b72 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/022.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.596 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e1b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/351.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.596 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000ebf (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/433.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.596 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dbe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/305.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.596 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000be1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/076.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.596 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cb8 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/180.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.596 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d06 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/218.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.597 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f0d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/472.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.597 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000bb0 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/052.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.597 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f09 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/470.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.597 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000b66 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/016.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.597 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000016fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/007) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.598 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cf6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/211.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.598 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d26 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/234.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.598 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000c50 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/128.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.598 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e67 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/389.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.598 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000eb1 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/426.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.599 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d54 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/252.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.599 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000d38 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/238.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.599 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000f01 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/466.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.599 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000dd6 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/317.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.599 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000cf4 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/210.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.600 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000e35 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/364.out) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.600 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001314 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.600 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001312 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.600 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000120e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.600 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001318 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.600 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000120f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.601 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001215 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.601 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000001f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/tar/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.601 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000001d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.601 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010dc (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/xfstests.spec.in) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.601 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000009 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.602 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000613 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/macros.template) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.602 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000000a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.602 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000015 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/heads) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.602 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000010 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.602 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000013 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/heads/master) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.603 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000000c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes/origin) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.603 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001315 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.603 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001316 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.603 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001147 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/function_coverage) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.603 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001113 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_getall_sessions.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.604 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001115 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_query_session.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.604 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001313 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.604 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001112 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_find_eventmsg.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.604 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001111 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_destroy_session.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.604 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001110 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_create_session.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.605 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001114 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_getall_tokens.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.605 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001152 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/create_cpio) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.605 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001322 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.605 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000115b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/menu_test) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.605 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001319 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/DMAPI_aliases) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.606 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000131a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.606 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001148 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.606 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001320 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/lib) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.606 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001149 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.606 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000131e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/dist) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.607 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000114a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/README_for_check_dmapi) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.607 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000131c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.607 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001213 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.607 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001210 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.607 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001211 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.608 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000110f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/wbee.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.608 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001109 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migfind.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.608 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000110b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migout.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.608 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000110a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migin.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.608 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000110e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/mrmean.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.609 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001216 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.609 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001108 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.609 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000110d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/mls.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.609 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000016 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.609 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000011 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.609 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000000d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.610 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000111d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.610 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001129 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/make_rt_sparse.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.610 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001136 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/query_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.610 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000113b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/respond_event.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.610 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001127 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/init_service.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.611 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001134 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/probe_punch_xfsctl_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.611 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000111b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_config_events.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.611 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000112a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/make_sparse.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.611 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000113e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/security_hole2.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.611 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000113c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/rwt.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.612 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001144 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/sync_by_handle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.612 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000111a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_allocinfo.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.612 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000113d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/security_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.612 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001133 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/probe_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.612 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000113f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_disp.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.613 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001118 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/downgrade_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.613 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001119 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/fd_to_handle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.613 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000112d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_rele.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.613 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001121 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_mountinfo.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.613 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001126 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/handle_to_path.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.614 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001142 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_fileattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.614 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001139 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/remove_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.614 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001124 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/getall_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.614 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001128 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/link_test.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.614 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001317 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.615 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001117 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/dm_handle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.615 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000112e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/path_to_fshandle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.615 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001140 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.615 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001145 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/test_assumption.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.615 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001125 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/handle_to_fshandle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.616 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001141 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_eventlist.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.616 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001137 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/randomize_file.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.616 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001130 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/pending.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.616 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000112b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_hold.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.616 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001122 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_region.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.616 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000111f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_events.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.617 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001116 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/create_userevent.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.617 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000113a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/request_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.617 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001143 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/struct_test.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.617 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000111c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_dirattrs.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.617 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001135 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/punch_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.618 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001123 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/getall_disp.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.618 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001138 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/release_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.618 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001132 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/print_fshandle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.618 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001146 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/upgrade_right.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.619 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001131 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/print_event.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.619 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000112f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/path_to_handle.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.619 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000111e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_eventlist.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.619 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000112c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_query.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.619 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001120 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_fileattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.620 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001169 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_fileattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.620 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001165 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_bulkattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.620 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000116d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_rights.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.620 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001160 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mmap.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.620 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001164 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_bulkall.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.621 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000116a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_hole.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.621 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001323 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.621 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000115d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/dm_test_daemon.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.621 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000115f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mm_fill.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.621 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000115e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/invis_test.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.622 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000115c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/check_dmapi.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.622 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001168 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_eventlist.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.622 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001163 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/send_msg.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.622 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000116b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_invis.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.622 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001167 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_efault.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.623 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001162 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/region_test.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.623 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001166 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_dmattr.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.623 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001161 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mmap_cp.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.623 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000116c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_region.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.623 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001321 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/lib/errtest.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.624 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000131f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/dist/README) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.624 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000114c (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/ls_to_copy) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.624 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000114e (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/run_test) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.624 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001150 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/test_allocinfo_1) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.624 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001151 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/test_allocinfo_2) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.625 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000114d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/make_holey) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.625 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000114b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/ctf) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.625 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000131b (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/crttf) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.625 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000114f (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/stf) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.625 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001157 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/realtime.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.626 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001156 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/pending_nfs.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.626 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001155 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/pending.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.626 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000131d (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/fail.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.626 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001159 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/standard.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.626 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001158 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/smallq.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.626 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x1000000115a (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/standard_nfs.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.627 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001154 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/nfs.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.627 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001103 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/find_session.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.627 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001153 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/main.dat) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.627 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001106 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/stubs.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.627 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001104 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/hsm.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.628 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001214 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.628 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001105 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/print.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.628 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001107 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/util.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.628 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001102 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/dmport.h) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.628 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010ff (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/set_region.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.629 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001100 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/set_return_on_destroy.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.629 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001101 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/write_invis.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.629 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x100000010fe (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/read_invis.c) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.629 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000001212 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/Makefile) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.629 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: Scrub error on inode 0x10000000012 (/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2023-10-18T14:05:44.630 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:44.630 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:05:44.630 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:05:44.630 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:05:44.631 INFO:tasks.workunit.client.0.smithi114.stdout: [DEP] 2023-10-18T14:05:44.631 INFO:tasks.workunit.client.0.smithi114.stdout: [DEP] 2023-10-18T14:05:44.632 INFO:tasks.workunit.client.0.smithi114.stdout: [DEP] 2023-10-18T14:05:44.632 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-stress 2023-10-18T14:05:44.632 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] dirstress 2023-10-18T14:05:44.632 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] fill 2023-10-18T14:05:44.632 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] fill2 2023-10-18T14:05:44.804 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] getpagesize 2023-10-18T14:05:44.877 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] holes 2023-10-18T14:05:44.888 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] lstat64 2023-10-18T14:05:44.894 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] nametest 2023-10-18T14:05:45.000 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] permname 2023-10-18T14:05:45.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:44 smithi158 ceph-mon[103317]: pgmap v331: 97 pgs: 97 active+clean; 42 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 1.40k op/s 2023-10-18T14:05:45.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:44 smithi172 ceph-mon[103574]: pgmap v331: 97 pgs: 97 active+clean; 42 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 1.40k op/s 2023-10-18T14:05:45.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:44 smithi114 ceph-mon[99494]: pgmap v331: 97 pgs: 97 active+clean; 42 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 1.40k op/s 2023-10-18T14:05:45.133 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] randholes 2023-10-18T14:05:45.158 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] runas 2023-10-18T14:05:45.197 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] truncfile 2023-10-18T14:05:45.267 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] usemem 2023-10-18T14:05:45.378 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] mmapcat 2023-10-18T14:05:45.425 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] append_reader 2023-10-18T14:05:45.462 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] append_writer 2023-10-18T14:05:45.462 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] dirperf 2023-10-18T14:05:45.561 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] metaperf 2023-10-18T14:05:45.610 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] devzero 2023-10-18T14:05:45.672 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] feature 2023-10-18T14:05:45.753 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] alloc 2023-10-18T14:05:46.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:45 smithi158 ceph-mon[103317]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-18T14:05:46.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:45 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] up:active 2023-10-18T14:05:46.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:45 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:46.052 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] fault 2023-10-18T14:05:46.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:45 smithi172 ceph-mon[103574]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-18T14:05:46.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:45 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] up:active 2023-10-18T14:05:46.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:45 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:46.062 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] fstest 2023-10-18T14:05:46.070 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_access_root 2023-10-18T14:05:46.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:45 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a[99470]: 2023-10-18T14:05:45.687+0000 7fdd357d7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-18T14:05:46.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:45 smithi114 ceph-mon[99494]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-18T14:05:46.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:45 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] up:active 2023-10-18T14:05:46.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:45 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:46.227 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] godown 2023-10-18T14:05:46.250 INFO:tasks.workunit.client.0.smithi114.stderr:fstest.c: In function 'run_child': 2023-10-18T14:05:46.250 INFO:tasks.workunit.client.0.smithi114.stderr:fstest.c:95:20: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2023-10-18T14:05:46.251 INFO:tasks.workunit.client.0.smithi114.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-10-18T14:05:46.251 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~ 2023-10-18T14:05:46.251 INFO:tasks.workunit.client.0.smithi114.stderr:fstest.c:95:17: note: directive argument in the range [0, 2147483647] 2023-10-18T14:05:46.251 INFO:tasks.workunit.client.0.smithi114.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-10-18T14:05:46.251 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~~~~ 2023-10-18T14:05:46.252 INFO:tasks.workunit.client.0.smithi114.stderr:fstest.c:95:2: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2023-10-18T14:05:46.252 INFO:tasks.workunit.client.0.smithi114.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-10-18T14:05:46.252 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-18T14:05:46.252 INFO:tasks.workunit.client.0.smithi114.stderr:fstest.c:166:20: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2023-10-18T14:05:46.252 INFO:tasks.workunit.client.0.smithi114.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-10-18T14:05:46.253 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~ 2023-10-18T14:05:46.253 INFO:tasks.workunit.client.0.smithi114.stderr:fstest.c:166:17: note: directive argument in the range [0, 2147483647] 2023-10-18T14:05:46.253 INFO:tasks.workunit.client.0.smithi114.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-10-18T14:05:46.253 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~~~~ 2023-10-18T14:05:46.253 INFO:tasks.workunit.client.0.smithi114.stderr:fstest.c:166:2: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2023-10-18T14:05:46.253 INFO:tasks.workunit.client.0.smithi114.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-10-18T14:05:46.254 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-18T14:05:46.271 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] resvtest 2023-10-18T14:05:46.292 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] writemod 2023-10-18T14:05:46.338 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] writev_on_pagefault 2023-10-18T14:05:46.452 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] makeextents 2023-10-18T14:05:46.510 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] itrash 2023-10-18T14:05:46.511 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] rename 2023-10-18T14:05:46.550 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] multi_open_unlink 2023-10-18T14:05:46.676 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] dmiperf 2023-10-18T14:05:46.686 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] unwritten_sync 2023-10-18T14:05:46.693 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] genhashnames 2023-10-18T14:05:46.724 INFO:tasks.workunit.client.0.smithi114.stderr:multi_open_unlink.c: In function 'main': 2023-10-18T14:05:46.724 INFO:tasks.workunit.client.0.smithi114.stderr:multi_open_unlink.c:101:4: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2023-10-18T14:05:46.724 INFO:tasks.workunit.client.0.smithi114.stderr: sts = attr_set(path, attrname, attrvalue, value_size, flags); 2023-10-18T14:05:46.725 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~ 2023-10-18T14:05:46.725 INFO:tasks.workunit.client.0.smithi114.stderr:In file included from multi_open_unlink.c:15: 2023-10-18T14:05:46.725 INFO:tasks.workunit.client.0.smithi114.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2023-10-18T14:05:46.725 INFO:tasks.workunit.client.0.smithi114.stderr: extern int attr_set (const char *__path, const char *__attrname, 2023-10-18T14:05:46.726 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~ 2023-10-18T14:05:46.787 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_holes 2023-10-18T14:05:46.859 INFO:tasks.workunit.client.0.smithi114.stderr:dmiperf.c: In function 'mkfile': 2023-10-18T14:05:46.860 INFO:tasks.workunit.client.0.smithi114.stderr:dmiperf.c:192:2: warning: 'attr_setf' is deprecated: Use fsetxattr instead [-Wdeprecated-declarations] 2023-10-18T14:05:46.860 INFO:tasks.workunit.client.0.smithi114.stderr: if (attr_setf(fd, DMFATTRNAME, attr, DMFATTRLEN, ATTR_ROOT) < 0) { 2023-10-18T14:05:46.860 INFO:tasks.workunit.client.0.smithi114.stderr: ^~ 2023-10-18T14:05:46.860 INFO:tasks.workunit.client.0.smithi114.stderr:In file included from dmiperf.c:20: 2023-10-18T14:05:46.860 INFO:tasks.workunit.client.0.smithi114.stderr:/usr/include/attr/attributes.h:143:12: note: declared here 2023-10-18T14:05:46.861 INFO:tasks.workunit.client.0.smithi114.stderr: extern int attr_setf (int __fd, const char *__attrname, 2023-10-18T14:05:46.861 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~~ 2023-10-18T14:05:46.923 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_mmap_writev 2023-10-18T14:05:46.969 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_truncate_cmtime 2023-10-18T14:05:46.971 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] dirhash_collide 2023-10-18T14:05:46.978 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_rename_overwrite 2023-10-18T14:05:47.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:46 smithi158 ceph-mon[103317]: pgmap v332: 97 pgs: 97 active+clean; 34 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 757 op/s 2023-10-18T14:05:47.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:46 smithi172 ceph-mon[103574]: pgmap v332: 97 pgs: 97 active+clean; 34 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 757 op/s 2023-10-18T14:05:47.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:46 smithi114 ceph-mon[99494]: pgmap v332: 97 pgs: 97 active+clean; 34 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 757 op/s 2023-10-18T14:05:47.128 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] holetest 2023-10-18T14:05:47.169 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_truncate_self 2023-10-18T14:05:47.171 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_mmap_dio 2023-10-18T14:05:47.219 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] af_unix 2023-10-18T14:05:47.370 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_mmap_stale_pmd 2023-10-18T14:05:47.374 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_mmap_cow_race 2023-10-18T14:05:47.402 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_mmap_fallocate 2023-10-18T14:05:47.409 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] fsync-err 2023-10-18T14:05:47.571 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_mmap_write_ro 2023-10-18T14:05:47.576 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_ext4_dax_journal_corruption 2023-10-18T14:05:47.596 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_ext4_dax_inline_corruption 2023-10-18T14:05:47.638 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_ofd_locks 2023-10-18T14:05:47.789 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_locks_execve 2023-10-18T14:05:47.790 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_mmap_collision 2023-10-18T14:05:47.799 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] mmap-write-concurrent 2023-10-18T14:05:47.904 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] xfsctl 2023-10-18T14:05:47.988 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] bstat 2023-10-18T14:05:48.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:47 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] up:active 2023-10-18T14:05:48.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:47 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] up:active 2023-10-18T14:05:48.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:47 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:48.026 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_mtab 2023-10-18T14:05:48.034 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] getdevicesize 2023-10-18T14:05:48.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:47 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] up:active 2023-10-18T14:05:48.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:47 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] up:active 2023-10-18T14:05:48.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:47 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:48.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:47 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] up:active 2023-10-18T14:05:48.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:47 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] up:active 2023-10-18T14:05:48.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:47 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:48.144 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] preallo_rw_pattern_reader 2023-10-18T14:05:48.244 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] preallo_rw_pattern_writer 2023-10-18T14:05:48.257 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] ftrunc 2023-10-18T14:05:48.261 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] trunc 2023-10-18T14:05:48.367 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] fs_perms 2023-10-18T14:05:48.459 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] testx 2023-10-18T14:05:48.461 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] looptest 2023-10-18T14:05:48.469 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] locktest 2023-10-18T14:05:48.577 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] unwritten_mmap 2023-10-18T14:05:48.642 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] bulkstat_unlink_test 2023-10-18T14:05:48.720 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] bulkstat_unlink_test_modified 2023-10-18T14:05:48.811 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_dir_offset 2023-10-18T14:05:48.855 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_futimens 2023-10-18T14:05:48.906 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_immutable 2023-10-18T14:05:48.964 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] stale_handle 2023-10-18T14:05:49.033 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] pwrite_mmap_blocked 2023-10-18T14:05:49.040 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_dir_offset2 2023-10-18T14:05:49.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:48 smithi172 ceph-mon[103574]: pgmap v333: 97 pgs: 97 active+clean; 34 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 643 op/s 2023-10-18T14:05:49.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:48 smithi114 ceph-mon[99494]: pgmap v333: 97 pgs: 97 active+clean; 34 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 643 op/s 2023-10-18T14:05:49.162 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] seek_sanity_test 2023-10-18T14:05:49.247 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] seek_copy_test 2023-10-18T14:05:49.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:48 smithi158 ceph-mon[103317]: pgmap v333: 97 pgs: 97 active+clean; 34 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 643 op/s 2023-10-18T14:05:49.275 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_readdir_1 2023-10-18T14:05:49.460 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_readdir_2 2023-10-18T14:05:49.468 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] fsync-tester 2023-10-18T14:05:49.680 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] nsexec 2023-10-18T14:05:49.696 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] cloner 2023-10-18T14:05:49.699 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] renameat2 2023-10-18T14:05:49.778 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_getcwd 2023-10-18T14:05:49.912 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] e4compact 2023-10-18T14:05:49.917 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] test-nextquota 2023-10-18T14:05:49.918 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] punch-alternating 2023-10-18T14:05:49.967 INFO:tasks.workunit.client.0.smithi114.stderr:t_getcwd.c: In function 'do_rename': 2023-10-18T14:05:49.967 INFO:tasks.workunit.client.0.smithi114.stderr:t_getcwd.c:40:2: warning: 'strncpy' specified bound 256 equals destination size [-Wstringop-truncation] 2023-10-18T14:05:49.967 INFO:tasks.workunit.client.0.smithi114.stderr: strncpy(c_name, prefix, BUF_SIZE); 2023-10-18T14:05:49.967 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-18T14:05:50.003 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] attr-list-by-handle-cursor-test 2023-10-18T14:05:50.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:49 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] up:active 2023-10-18T14:05:50.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:49 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:50.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:49 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] up:active 2023-10-18T14:05:50.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:49 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:50.120 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] listxattr 2023-10-18T14:05:50.122 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] dio-interleaved 2023-10-18T14:05:50.176 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_dir_type 2023-10-18T14:05:50.226 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] dio-invalidate-cache 2023-10-18T14:05:50.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:49 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] up:active 2023-10-18T14:05:50.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:49 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:05:50.301 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] stat_test 2023-10-18T14:05:50.321 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_encrypted_d_revalidate 2023-10-18T14:05:50.390 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] attr_replace_test 2023-10-18T14:05:50.484 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] swapon 2023-10-18T14:05:50.529 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] mkswap 2023-10-18T14:05:50.613 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_attr_corruption 2023-10-18T14:05:50.655 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_open_tmpfiles 2023-10-18T14:05:50.667 INFO:tasks.workunit.client.0.smithi114.stderr:swapon.c: In function 'main': 2023-10-18T14:05:50.668 INFO:tasks.workunit.client.0.smithi114.stderr:swapon.c:135:3: warning: 'p' may be used uninitialized in this function [-Wmaybe-uninitialized] 2023-10-18T14:05:50.668 INFO:tasks.workunit.client.0.smithi114.stderr: memcpy(p, buf, BUF_SIZE); 2023-10-18T14:05:50.668 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-18T14:05:50.717 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] fscrypt-crypt-util 2023-10-18T14:05:50.718 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] bulkstat_null_ocount 2023-10-18T14:05:50.821 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] splice-test 2023-10-18T14:05:50.901 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] fiemap-tester 2023-10-18T14:05:50.904 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] t_stripealign 2023-10-18T14:05:51.036 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] open_by_handle 2023-10-18T14:05:51.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:50 smithi172 ceph-mon[103574]: pgmap v334: 97 pgs: 97 active+clean; 35 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 540 op/s 2023-10-18T14:05:51.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:50 smithi114 ceph-mon[99494]: pgmap v334: 97 pgs: 97 active+clean; 35 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 540 op/s 2023-10-18T14:05:51.130 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] fssum 2023-10-18T14:05:51.239 INFO:tasks.workunit.client.0.smithi114.stdout:Building log-writes 2023-10-18T14:05:51.247 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] replay-log 2023-10-18T14:05:51.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:50 smithi158 ceph-mon[103317]: pgmap v334: 97 pgs: 97 active+clean; 35 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 540 op/s 2023-10-18T14:05:51.416 INFO:tasks.workunit.client.0.smithi114.stdout:Building perf 2023-10-18T14:05:51.417 INFO:tasks.workunit.client.0.smithi114.stdout:Building aio-dio-regress 2023-10-18T14:05:51.425 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-dio-append-write-fallocate-race 2023-10-18T14:05:51.425 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-dio-fcntl-race 2023-10-18T14:05:51.602 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-dio-subblock-eof-read 2023-10-18T14:05:51.625 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-dio-append-write-read-race 2023-10-18T14:05:51.626 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-dio-invalidate-readahead 2023-10-18T14:05:51.628 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-dio-hole-filling-race 2023-10-18T14:05:51.798 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-10-18T14:05:51.799 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-last-ref-held-by-io 2023-10-18T14:05:51.829 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-dio-cycle-write 2023-10-18T14:05:51.834 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-dio-extend-stat 2023-10-18T14:05:51.969 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-10-18T14:05:52.014 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aiocp 2023-10-18T14:05:52.030 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-dio-invalidate-failure 2023-10-18T14:05:52.043 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aiodio_sparse2 2023-10-18T14:05:52.133 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-dio-cow-race 2023-10-18T14:05:52.225 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-dio-write-verify 2023-10-18T14:05:52.244 INFO:tasks.workunit.client.0.smithi114.stderr:aiodio_sparse2.c: In function 'main': 2023-10-18T14:05:52.245 INFO:tasks.workunit.client.0.smithi114.stderr:aiodio_sparse2.c:404:2: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2023-10-18T14:05:52.245 INFO:tasks.workunit.client.0.smithi114.stderr: strncpy(filename, argv[argc-1], PATH_MAX); 2023-10-18T14:05:52.245 INFO:tasks.workunit.client.0.smithi114.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-18T14:05:52.285 INFO:tasks.workunit.client.0.smithi114.stdout: [CC] aio-dio-eof-race 2023-10-18T14:05:52.474 INFO:tasks.workunit.client.0.smithi114.stderr:+ cd .. 2023-10-18T14:05:52.474 INFO:tasks.workunit.client.0.smithi114.stderr:+ cp xfstests-dev/ltp/fsx . 2023-10-18T14:05:52.477 INFO:tasks.workunit.client.0.smithi114.stderr:+ OPTIONS=-z 2023-10-18T14:05:52.477 INFO:tasks.workunit.client.0.smithi114.stderr:+ ./fsx -z 1MB -N 50000 -p 10000 -l 1048576 2023-10-18T14:05:52.477 INFO:tasks.workunit.client.0.smithi114.stdout:Seed set to 1 2023-10-18T14:05:52.496 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support fallocate mode 0, disabling! 2023-10-18T14:05:52.497 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2023-10-18T14:05:52.499 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2023-10-18T14:05:52.499 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2023-10-18T14:05:52.499 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support clone range, disabling! 2023-10-18T14:05:52.501 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support dedupe range, disabling! 2023-10-18T14:05:52.508 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x38fe9 2023-10-18T14:05:52.534 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0xead53 2023-10-18T14:05:52.596 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0xf2cdd 2023-10-18T14:05:52.602 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0xfca47 2023-10-18T14:05:53.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:52 smithi172 ceph-mon[103574]: pgmap v335: 97 pgs: 97 active+clean; 35 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 556 KiB/s wr, 278 op/s 2023-10-18T14:05:53.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:52 smithi114 ceph-mon[99494]: pgmap v335: 97 pgs: 97 active+clean; 35 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 556 KiB/s wr, 278 op/s 2023-10-18T14:05:53.103 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0xfcdd6 2023-10-18T14:05:53.123 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0xfe854 2023-10-18T14:05:53.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:52 smithi158 ceph-mon[103317]: pgmap v335: 97 pgs: 97 active+clean; 35 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 556 KiB/s wr, 278 op/s 2023-10-18T14:05:53.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:53 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a[99470]: 2023-10-18T14:05:53.302+0000 7fdd357d7700 -1 log_channel(cluster) log [ERR] : Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-18T14:05:54.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:53 smithi172 ceph-mon[103574]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-18T14:05:54.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:53 smithi114 ceph-mon[99494]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-18T14:05:54.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:53 smithi158 ceph-mon[103317]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-18T14:05:54.466 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0xffce4 2023-10-18T14:05:55.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:54 smithi172 ceph-mon[103574]: pgmap v336: 97 pgs: 97 active+clean; 37 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 675 KiB/s wr, 303 op/s 2023-10-18T14:05:55.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:54 smithi114 ceph-mon[99494]: pgmap v336: 97 pgs: 97 active+clean; 37 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 675 KiB/s wr, 303 op/s 2023-10-18T14:05:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.142+0000 7f6e3e739700 1 -- 172.21.15.114:0/1905413110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e381040e0 msgr2=0x7f6e3810bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.142+0000 7f6e3e739700 1 --2- 172.21.15.114:0/1905413110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e381040e0 0x7f6e3810bc60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000b0a0 tx=0x7f6e3000b3b0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.142+0000 7f6e3e739700 1 -- 172.21.15.114:0/1905413110 shutdown_connections 2023-10-18T14:05:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.142+0000 7f6e3e739700 1 --2- 172.21.15.114:0/1905413110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e381040e0 0x7f6e3810bc60 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.142+0000 7f6e3e739700 1 --2- 172.21.15.114:0/1905413110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e380fefc0 0x7f6e380ff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.142+0000 7f6e3e739700 1 --2- 172.21.15.114:0/1905413110 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e380ff970 0x7f6e381039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.142+0000 7f6e3e739700 1 -- 172.21.15.114:0/1905413110 >> 172.21.15.114:0/1905413110 conn(0x7f6e38075bf0 msgr2=0x7f6e380fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.142+0000 7f6e3e739700 1 -- 172.21.15.114:0/1905413110 shutdown_connections 2023-10-18T14:05:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.142+0000 7f6e3e739700 1 -- 172.21.15.114:0/1905413110 wait complete. 2023-10-18T14:05:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.142+0000 7f6e3e739700 1 Processor -- start 2023-10-18T14:05:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.142+0000 7f6e3e739700 1 -- start start 2023-10-18T14:05:55.150 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e3e739700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e380fefc0 0x7f6e3819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.150 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e3e739700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e381040e0 0x7f6e3819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e3e739700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e38196ad0 0x7f6e38196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e3e739700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e38197550 con 0x7f6e380fefc0 2023-10-18T14:05:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e3e739700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e381976c0 con 0x7f6e38196ad0 2023-10-18T14:05:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e3e739700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e38197880 con 0x7f6e381040e0 2023-10-18T14:05:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e37fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e380fefc0 0x7f6e3819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e37fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e380fefc0 0x7f6e3819c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45722/0 (socket says 172.21.15.114:45722) 2023-10-18T14:05:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e37fff700 1 -- 172.21.15.114:0/2974221139 learned_addr learned my addr 172.21.15.114:0/2974221139 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e377fe700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e381040e0 0x7f6e3819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e3ccd6700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e38196ad0 0x7f6e38196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e37fff700 1 -- 172.21.15.114:0/2974221139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e381040e0 msgr2=0x7f6e3819cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e37fff700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e381040e0 0x7f6e3819cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e37fff700 1 -- 172.21.15.114:0/2974221139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e38196ad0 msgr2=0x7f6e38196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e37fff700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e38196ad0 0x7f6e38196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e37fff700 1 -- 172.21.15.114:0/2974221139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e30009d00 con 0x7f6e380fefc0 2023-10-18T14:05:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e37fff700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e380fefc0 0x7f6e3819c9a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800e9a0 tx=0x7f6e2800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.143+0000 7f6e357fa700 1 -- 172.21.15.114:0/2974221139 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28009790 con 0x7f6e380fefc0 2023-10-18T14:05:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.144+0000 7f6e3e739700 1 -- 172.21.15.114:0/2974221139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e381a3870 con 0x7f6e380fefc0 2023-10-18T14:05:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.144+0000 7f6e357fa700 1 -- 172.21.15.114:0/2974221139 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e2800cbd0 con 0x7f6e380fefc0 2023-10-18T14:05:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.144+0000 7f6e357fa700 1 -- 172.21.15.114:0/2974221139 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28018680 con 0x7f6e380fefc0 2023-10-18T14:05:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.144+0000 7f6e3e739700 1 -- 172.21.15.114:0/2974221139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e381a3da0 con 0x7f6e380fefc0 2023-10-18T14:05:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.146+0000 7f6e357fa700 1 -- 172.21.15.114:0/2974221139 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f6e280187e0 con 0x7f6e380fefc0 2023-10-18T14:05:55.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.147+0000 7f6e357fa700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6e200a15f0 0x7f6e200a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.147+0000 7f6e377fe700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6e200a15f0 0x7f6e200a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.147+0000 7f6e357fa700 1 -- 172.21.15.114:0/2974221139 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f6e28014070 con 0x7f6e380fefc0 2023-10-18T14:05:55.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e377fe700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6e200a15f0 0x7f6e200a3ab0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6e38197c90 tx=0x7f6e2c00a370 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e4a922b80 1 Processor -- start 2023-10-18T14:05:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e4a922b80 1 -- start start 2023-10-18T14:05:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e4a922b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b1d630 0x55f8e6b1da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e4a922b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b17ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e4a922b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b18410 0x55f8e6b18870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e4a922b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6a8b680 con 0x55f8e6b1df50 2023-10-18T14:05:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e4a922b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6a71c00 con 0x55f8e6b18410 2023-10-18T14:05:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e4a922b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6a6f520 con 0x55f8e6b1d630 2023-10-18T14:05:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e377fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b17ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e377fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b17ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45732/0 (socket says 172.21.15.114:45732) 2023-10-18T14:05:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e37fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b1d630 0x55f8e6b1da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e377fe700 1 -- 172.21.15.114:0/2557555606 learned_addr learned my addr 172.21.15.114:0/2557555606 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e3ccd6700 1 --2- 172.21.15.114:0/2557555606 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b18410 0x55f8e6b18870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e377fe700 1 -- 172.21.15.114:0/2557555606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b1d630 msgr2=0x55f8e6b1da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e377fe700 1 --2- 172.21.15.114:0/2557555606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b1d630 0x55f8e6b1da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e377fe700 1 -- 172.21.15.114:0/2557555606 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b18410 msgr2=0x55f8e6b18870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e377fe700 1 --2- 172.21.15.114:0/2557555606 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b18410 0x55f8e6b18870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e377fe700 1 -- 172.21.15.114:0/2557555606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8e6a28390 con 0x55f8e6b1df50 2023-10-18T14:05:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.148+0000 7f6e3ccd6700 1 --2- 172.21.15.114:0/2557555606 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b18410 0x55f8e6b18870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.149+0000 7f6e377fe700 1 --2- 172.21.15.114:0/2557555606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b17ed0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00ed80 tx=0x7f6e2c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d211618a9df37980 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.149+0000 7f6e1e7fc700 1 -- 172.21.15.114:0/2557555606 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c01f070 con 0x55f8e6b1df50 2023-10-18T14:05:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.149+0000 7f6e1e7fc700 1 -- 172.21.15.114:0/2557555606 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e2c00edb0 con 0x55f8e6b1df50 2023-10-18T14:05:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.149+0000 7f6e1e7fc700 1 -- 172.21.15.114:0/2557555606 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c013070 con 0x55f8e6b1df50 2023-10-18T14:05:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.149+0000 7f6e4a922b80 1 -- 172.21.15.114:0/2557555606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 msgr2=0x55f8e6b17ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.149+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/2557555606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b17ed0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00ed80 tx=0x7f6e2c013000 comp rx=0 tx=0).stop 2023-10-18T14:05:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.150+0000 7f6e4a922b80 1 -- 172.21.15.114:0/2557555606 shutdown_connections 2023-10-18T14:05:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.150+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/2557555606 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b18410 0x55f8e6b18870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.150+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/2557555606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b1d630 0x55f8e6b1da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.150+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/2557555606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b17ed0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.150+0000 7f6e4a922b80 1 -- 172.21.15.114:0/2557555606 >> 172.21.15.114:0/2557555606 conn(0x55f8e6a8c6c0 msgr2=0x55f8e6b125a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.150+0000 7f6e4a922b80 1 -- 172.21.15.114:0/2557555606 shutdown_connections 2023-10-18T14:05:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.150+0000 7f6e4a922b80 1 -- 172.21.15.114:0/2557555606 wait complete. 2023-10-18T14:05:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.150+0000 7f6e4a922b80 1 -- start start 2023-10-18T14:05:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.150+0000 7f6e4a922b80 1 Processor -- start 2023-10-18T14:05:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e4a922b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b18410 0x55f8e6b23ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e4a922b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b21200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e4a922b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b21880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e4a922b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6a6ae10 con 0x55f8e6b1df50 2023-10-18T14:05:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e4a922b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6a076b0 con 0x55f8e6b1d630 2023-10-18T14:05:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e4a922b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6a07350 con 0x55f8e6b18410 2023-10-18T14:05:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e4a922b80 10 client.0 _ll_register_callbacks cb 0x55f8e6951a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e37fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b18410 0x55f8e6b23ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e377fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b21200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e37fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b18410 0x55f8e6b23ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49672/0 (socket says 172.21.15.114:49672) 2023-10-18T14:05:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e3ccd6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b21880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e377fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b21200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41882/0 (socket says 172.21.15.114:41882) 2023-10-18T14:05:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e37fff700 1 -- 172.21.15.114:0/2415637667 learned_addr learned my addr 172.21.15.114:0/2415637667 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e37fff700 1 -- 172.21.15.114:0/2415637667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 msgr2=0x55f8e6b21200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e37fff700 1 --2- 172.21.15.114:0/2415637667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b21200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e37fff700 1 -- 172.21.15.114:0/2415637667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 msgr2=0x55f8e6b21880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e37fff700 1 --2- 172.21.15.114:0/2415637667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b21880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e37fff700 1 -- 172.21.15.114:0/2415637667 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3810c4d0 con 0x55f8e6b18410 2023-10-18T14:05:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e377fe700 1 --2- 172.21.15.114:0/2415637667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b21200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e3ccd6700 1 --2- 172.21.15.114:0/2415637667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b21880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:05:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e37fff700 1 --2- 172.21.15.114:0/2415637667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b18410 0x55f8e6b23ec0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6e280cab50 tx=0x7f6e2809ab20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=761f1cd410c157b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e177fe700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-10-18T14:05:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e177fe700 1 -- 172.21.15.114:0/2415637667 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2809e480 con 0x55f8e6b18410 2023-10-18T14:05:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e177fe700 1 -- 172.21.15.114:0/2415637667 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f6e280a26c0 con 0x55f8e6b18410 2023-10-18T14:05:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.151+0000 7f6e4a922b80 1 -- 172.21.15.114:0/2415637667 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8e6a6fe90 con 0x55f8e6b18410 2023-10-18T14:05:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.152+0000 7f6e177fe700 1 -- 172.21.15.114:0/2415637667 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e28099820 con 0x55f8e6b18410 2023-10-18T14:05:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.152+0000 7f6e4a922b80 10 client.25654 fetch_fsmap learned FSMap version 32 2023-10-18T14:05:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.152+0000 7f6e4a922b80 1 -- 172.21.15.114:0/2415637667 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f6e2c00ea30 con 0x55f8e6b18410 2023-10-18T14:05:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.152+0000 7f6e177fe700 1 -- 172.21.15.114:0/2415637667 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f8e6a6fe90 con 0x55f8e6b18410 2023-10-18T14:05:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.152+0000 7f6e177fe700 1 -- 172.21.15.114:0/2415637667 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 32) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f6e280b8280 con 0x55f8e6b18410 2023-10-18T14:05:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.152+0000 7f6e4a922b80 10 client.25654 fetch_fsmap finished waiting for FSMap version 32 2023-10-18T14:05:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.152+0000 7f6e4a922b80 10 client.25654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.152+0000 7f6e4a922b80 20 client.25654 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.152+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/2415637667 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f8e6b31a40 0x55f8e6b33e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.152+0000 7f6e4a922b80 4 client.25654 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:05:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.152+0000 7f6e4a922b80 1 -- 172.21.15.114:0/2415637667 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8e6ae7850 con 0x55f8e6b31a40 2023-10-18T14:05:55.176 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.152+0000 7f6e377fe700 1 --2- 172.21.15.114:0/2415637667 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f8e6b31a40 0x55f8e6b33e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.176 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.153+0000 7f6e177fe700 10 client.25654 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:55.176 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.153+0000 7f6e377fe700 1 --2- 172.21.15.114:0/2415637667 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f8e6b31a40 0x55f8e6b33e60 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5404784f92dcd242 server_cookie=3810e416d99a7075 in_seq=0 out_seq=0 2023-10-18T14:05:55.176 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e177fe700 1 -- 172.21.15.114:0/2415637667 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f8e6ae7850 con 0x55f8e6b31a40 2023-10-18T14:05:55.176 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e177fe700 10 client.25654 handle_command_reply: tid=0 2023-10-18T14:05:55.177 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e4a922b80 1 client.25654 shutdown 2023-10-18T14:05:55.177 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e4a922b80 1 -- 172.21.15.114:0/2415637667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b18410 msgr2=0x55f8e6b23ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:55.177 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/2415637667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b18410 0x55f8e6b23ec0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6e280cab50 tx=0x7f6e2809ab20 comp rx=0 tx=0).stop 2023-10-18T14:05:55.177 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e4a922b80 1 -- 172.21.15.114:0/2415637667 shutdown_connections 2023-10-18T14:05:55.177 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/2415637667 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f8e6b31a40 0x55f8e6b33e60 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/2415637667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b21880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e177fe700 0 client.25654 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/2415637667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b18410 0x55f8e6b23ec0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/2415637667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b21200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e4a922b80 1 -- 172.21.15.114:0/2415637667 >> 172.21.15.114:0/2415637667 conn(0x55f8e6a8c6c0 msgr2=0x55f8e6b11d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e4a922b80 1 -- 172.21.15.114:0/2415637667 shutdown_connections 2023-10-18T14:05:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e4a922b80 1 -- 172.21.15.114:0/2415637667 wait complete. 2023-10-18T14:05:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.155+0000 7f6e4a922b80 20 client.25654 trim_cache size 0 max 16384 2023-10-18T14:05:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.170+0000 7f6e4a922b80 1 Processor -- start 2023-10-18T14:05:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.170+0000 7f6e4a922b80 1 -- start start 2023-10-18T14:05:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e4a922b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b18410 0x55f8e6b124e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e4a922b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b2d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e4a922b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b20ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e4a922b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e68eb8c0 con 0x55f8e6b1df50 2023-10-18T14:05:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e4a922b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6b1bda0 con 0x55f8e6b1d630 2023-10-18T14:05:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e4a922b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6b1f750 con 0x55f8e6b18410 2023-10-18T14:05:55.186 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e3ccd6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b20ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.186 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e3ccd6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b20ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45748/0 (socket says 172.21.15.114:45748) 2023-10-18T14:05:55.186 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e3ccd6700 1 -- 172.21.15.114:0/887291761 learned_addr learned my addr 172.21.15.114:0/887291761 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:55.186 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e377fe700 1 --2- 172.21.15.114:0/887291761 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b2d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.186 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e37fff700 1 --2- 172.21.15.114:0/887291761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b18410 0x55f8e6b124e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e3ccd6700 1 -- 172.21.15.114:0/887291761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b18410 msgr2=0x55f8e6b124e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e3ccd6700 1 --2- 172.21.15.114:0/887291761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b18410 0x55f8e6b124e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e3ccd6700 1 -- 172.21.15.114:0/887291761 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 msgr2=0x55f8e6b2d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e3ccd6700 1 --2- 172.21.15.114:0/887291761 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b2d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e3ccd6700 1 -- 172.21.15.114:0/887291761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8e6895d80 con 0x55f8e6b1df50 2023-10-18T14:05:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e3ccd6700 1 --2- 172.21.15.114:0/887291761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b20ae0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6e30015000 tx=0x7f6e30009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5744fe0188211c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e1effd700 1 -- 172.21.15.114:0/887291761 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000e040 con 0x55f8e6b1df50 2023-10-18T14:05:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e1effd700 1 -- 172.21.15.114:0/887291761 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e3000bc50 con 0x55f8e6b1df50 2023-10-18T14:05:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.171+0000 7f6e1effd700 1 -- 172.21.15.114:0/887291761 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e300276e0 con 0x55f8e6b1df50 2023-10-18T14:05:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.172+0000 7f6e4a922b80 1 -- 172.21.15.114:0/887291761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 msgr2=0x55f8e6b20ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.172+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/887291761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b20ae0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6e30015000 tx=0x7f6e30009430 comp rx=0 tx=0).stop 2023-10-18T14:05:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.172+0000 7f6e4a922b80 1 -- 172.21.15.114:0/887291761 shutdown_connections 2023-10-18T14:05:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.172+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/887291761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b1df50 0x55f8e6b20ae0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.172+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/887291761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b18410 0x55f8e6b124e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.172+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/887291761 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b2d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.172+0000 7f6e4a922b80 1 -- 172.21.15.114:0/887291761 >> 172.21.15.114:0/887291761 conn(0x55f8e6a8c6c0 msgr2=0x55f8e6b2d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.172+0000 7f6e4a922b80 1 -- 172.21.15.114:0/887291761 shutdown_connections 2023-10-18T14:05:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.172+0000 7f6e4a922b80 1 -- 172.21.15.114:0/887291761 wait complete. 2023-10-18T14:05:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e4a922b80 1 -- start start 2023-10-18T14:05:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e4a922b80 1 Processor -- start 2023-10-18T14:05:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e4a922b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b18410 0x55f8e6b26940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e4a922b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b26e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e4a922b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b1df50 0x55f8e6b273c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e4a922b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6b84910 con 0x55f8e6b18410 2023-10-18T14:05:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e4a922b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6b84a80 con 0x55f8e6b1d630 2023-10-18T14:05:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e4a922b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6b84c40 con 0x55f8e6b1df50 2023-10-18T14:05:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e4a922b80 10 client.0 _ll_register_callbacks cb 0x55f8e6951a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:05:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e37fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b18410 0x55f8e6b26940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e37fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b18410 0x55f8e6b26940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45750/0 (socket says 172.21.15.114:45750) 2023-10-18T14:05:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e37fff700 1 -- 172.21.15.114:0/800858730 learned_addr learned my addr 172.21.15.114:0/800858730 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:05:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e377fe700 1 --2- 172.21.15.114:0/800858730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b26e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.193 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e3ccd6700 1 --2- 172.21.15.114:0/800858730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b1df50 0x55f8e6b273c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.193 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e37fff700 1 -- 172.21.15.114:0/800858730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b1df50 msgr2=0x55f8e6b273c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:55.193 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e37fff700 1 --2- 172.21.15.114:0/800858730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b1df50 0x55f8e6b273c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.193 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e37fff700 1 -- 172.21.15.114:0/800858730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 msgr2=0x55f8e6b26e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:05:55.193 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e37fff700 1 --2- 172.21.15.114:0/800858730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b26e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.173+0000 7f6e37fff700 1 -- 172.21.15.114:0/800858730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e30007e70 con 0x55f8e6b18410 2023-10-18T14:05:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e37fff700 1 --2- 172.21.15.114:0/800858730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b18410 0x55f8e6b26940 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6e2809a030 tx=0x7f6e280092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1b5863f2258919 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:05:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e177fe700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:05:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e177fe700 1 -- 172.21.15.114:0/800858730 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e280b8650 con 0x55f8e6b18410 2023-10-18T14:05:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e177fe700 1 -- 172.21.15.114:0/800858730 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f6e280a26c0 con 0x55f8e6b18410 2023-10-18T14:05:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e4a922b80 1 -- 172.21.15.114:0/800858730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e2c00edb0 con 0x55f8e6b18410 2023-10-18T14:05:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e177fe700 1 -- 172.21.15.114:0/800858730 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e2809e480 con 0x55f8e6b18410 2023-10-18T14:05:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e4a922b80 10 client.16284 fetch_fsmap learned FSMap version 32 2023-10-18T14:05:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e4a922b80 1 -- 172.21.15.114:0/800858730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55f8e687ec00 con 0x55f8e6b18410 2023-10-18T14:05:55.196 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e177fe700 1 -- 172.21.15.114:0/800858730 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e280a6020 con 0x55f8e6b18410 2023-10-18T14:05:55.196 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e177fe700 1 -- 172.21.15.114:0/800858730 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 32) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f6e28099390 con 0x55f8e6b18410 2023-10-18T14:05:55.196 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e4a922b80 10 client.16284 fetch_fsmap finished waiting for FSMap version 32 2023-10-18T14:05:55.196 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e4a922b80 10 client.16284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:05:55.196 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e4a922b80 20 client.16284 populate_metadata read hostname 'smithi114' 2023-10-18T14:05:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/800858730 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f8e6b860f0 0x55f8e6b88510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:05:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e4a922b80 4 client.16284 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:05:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e4a922b80 1 -- 172.21.15.114:0/800858730 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f8e6a63df0 con 0x55f8e6b860f0 2023-10-18T14:05:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.174+0000 7f6e377fe700 1 --2- 172.21.15.114:0/800858730 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f8e6b860f0 0x55f8e6b88510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:05:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.175+0000 7f6e177fe700 10 client.16284 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.175+0000 7f6e377fe700 1 --2- 172.21.15.114:0/800858730 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f8e6b860f0 0x55f8e6b88510 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ad15f5c64545096 server_cookie=571697433bf0a3f1 in_seq=0 out_seq=0 2023-10-18T14:05:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e177fe700 1 -- 172.21.15.114:0/800858730 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f8e6a63df0 con 0x55f8e6b860f0 2023-10-18T14:05:55.222 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e177fe700 10 client.16284 handle_command_reply: tid=0 2023-10-18T14:05:55.222 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e4a922b80 1 client.16284 shutdown 2023-10-18T14:05:55.222 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e4a922b80 1 -- 172.21.15.114:0/800858730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b18410 msgr2=0x55f8e6b26940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:55.222 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/800858730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b18410 0x55f8e6b26940 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6e2809a030 tx=0x7f6e280092f0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e4a922b80 1 -- 172.21.15.114:0/800858730 shutdown_connections 2023-10-18T14:05:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/800858730 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55f8e6b860f0 0x55f8e6b88510 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/800858730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8e6b1df50 0x55f8e6b273c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/800858730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8e6b18410 0x55f8e6b26940 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e177fe700 0 client.16284 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:05:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e4a922b80 1 --2- 172.21.15.114:0/800858730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55f8e6b1d630 0x55f8e6b26e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e4a922b80 1 -- 172.21.15.114:0/800858730 >> 172.21.15.114:0/800858730 conn(0x55f8e6a8c6c0 msgr2=0x55f8e6b2d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e4a922b80 1 -- 172.21.15.114:0/800858730 shutdown_connections 2023-10-18T14:05:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e4a922b80 1 -- 172.21.15.114:0/800858730 wait complete. 2023-10-18T14:05:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.217+0000 7f6e4a922b80 20 client.16284 trim_cache size 0 max 16384 2023-10-18T14:05:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:05:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:05:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:05:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:05:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.218+0000 7f6e3e739700 1 -- 172.21.15.114:0/2974221139 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6e200a15f0 msgr2=0x7f6e200a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.218+0000 7f6e3e739700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6e200a15f0 0x7f6e200a3ab0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6e38197c90 tx=0x7f6e2c00a370 comp rx=0 tx=0).stop 2023-10-18T14:05:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.218+0000 7f6e3e739700 1 -- 172.21.15.114:0/2974221139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e380fefc0 msgr2=0x7f6e3819c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:05:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.218+0000 7f6e3e739700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e380fefc0 0x7f6e3819c9a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800e9a0 tx=0x7f6e2800ecb0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.218+0000 7f6e3e739700 1 -- 172.21.15.114:0/2974221139 shutdown_connections 2023-10-18T14:05:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.218+0000 7f6e3e739700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6e200a15f0 0x7f6e200a3ab0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.218+0000 7f6e3e739700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e38196ad0 0x7f6e38196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.218+0000 7f6e3e739700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e380fefc0 0x7f6e3819c9a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.218+0000 7f6e3e739700 1 --2- 172.21.15.114:0/2974221139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e381040e0 0x7f6e3819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:05:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.218+0000 7f6e3e739700 1 -- 172.21.15.114:0/2974221139 >> 172.21.15.114:0/2974221139 conn(0x7f6e38075bf0 msgr2=0x7f6e38102280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:05:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.218+0000 7f6e3e739700 1 -- 172.21.15.114:0/2974221139 shutdown_connections 2023-10-18T14:05:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:05:55.218+0000 7f6e3e739700 1 -- 172.21.15.114:0/2974221139 wait complete. 2023-10-18T14:05:55.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:54 smithi158 ceph-mon[103317]: pgmap v336: 97 pgs: 97 active+clean; 37 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 675 KiB/s wr, 303 op/s 2023-10-18T14:05:57.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:56 smithi172 ceph-mon[103574]: pgmap v337: 97 pgs: 97 active+clean; 37 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 337 KiB/s wr, 132 op/s 2023-10-18T14:05:57.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:56 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:05:57.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:56 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:05:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:56 smithi114 ceph-mon[99494]: pgmap v337: 97 pgs: 97 active+clean; 37 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 337 KiB/s wr, 132 op/s 2023-10-18T14:05:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:56 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:05:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:56 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:05:57.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:56 smithi158 ceph-mon[103317]: pgmap v337: 97 pgs: 97 active+clean; 37 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 337 KiB/s wr, 132 op/s 2023-10-18T14:05:57.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:56 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:05:57.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:56 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:05:58.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:57 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:05:58.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:57 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:58.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:57 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:05:58.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:57 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:58.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:57 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:58.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:57 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:05:58.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:57 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:58.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:57 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:05:58.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:57 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:58.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:57 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:58.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:57 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:05:58.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:57 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:58.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:57 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:05:58.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:57 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:58.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:57 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:05:58.416 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0xfffc5 2023-10-18T14:05:59.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:05:58 smithi172 ceph-mon[103574]: pgmap v338: 97 pgs: 97 active+clean; 37 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 292 KiB/s wr, 83 op/s 2023-10-18T14:05:59.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:05:58 smithi114 ceph-mon[99494]: pgmap v338: 97 pgs: 97 active+clean; 37 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 292 KiB/s wr, 83 op/s 2023-10-18T14:05:59.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:05:58 smithi158 ceph-mon[103317]: pgmap v338: 97 pgs: 97 active+clean; 37 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 292 KiB/s wr, 83 op/s 2023-10-18T14:05:59.337 INFO:tasks.workunit.client.0.smithi114.stdout:10000 mapread 0x32cdc thru 0x3e88f (0xbbb4 bytes) 2023-10-18T14:06:01.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:00 smithi172 ceph-mon[103574]: pgmap v339: 97 pgs: 97 active+clean; 35 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 404 op/s 2023-10-18T14:06:01.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:00 smithi114 ceph-mon[99494]: pgmap v339: 97 pgs: 97 active+clean; 35 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 404 op/s 2023-10-18T14:06:01.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:00 smithi158 ceph-mon[103317]: pgmap v339: 97 pgs: 97 active+clean; 35 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 404 op/s 2023-10-18T14:06:03.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:02 smithi172 ceph-mon[103574]: pgmap v340: 97 pgs: 97 active+clean; 35 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 402 op/s 2023-10-18T14:06:03.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:02 smithi114 ceph-mon[99494]: pgmap v340: 97 pgs: 97 active+clean; 35 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 402 op/s 2023-10-18T14:06:03.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:02 smithi158 ceph-mon[103317]: pgmap v340: 97 pgs: 97 active+clean; 35 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 402 op/s 2023-10-18T14:06:04.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:04 smithi114 ceph-mon[99494]: pgmap v341: 97 pgs: 97 active+clean; 38 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 708 op/s 2023-10-18T14:06:04.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:04 smithi158 ceph-mon[103317]: pgmap v341: 97 pgs: 97 active+clean; 38 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 708 op/s 2023-10-18T14:06:04.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:04 smithi172 ceph-mon[103574]: pgmap v341: 97 pgs: 97 active+clean; 38 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 708 op/s 2023-10-18T14:06:07.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:06 smithi158 ceph-mon[103317]: pgmap v342: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 674 op/s 2023-10-18T14:06:07.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:06 smithi172 ceph-mon[103574]: pgmap v342: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 674 op/s 2023-10-18T14:06:07.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:06 smithi114 ceph-mon[99494]: pgmap v342: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 674 op/s 2023-10-18T14:06:08.351 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.347+0000 7f8e0b293700 1 -- 172.21.15.114:0/4074989033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e040ff8d0 msgr2=0x7f8e040ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:08.351 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.347+0000 7f8e0b293700 1 --2- 172.21.15.114:0/4074989033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e040ff8d0 0x7f8e040ffd50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f8df40099c0 tx=0x7f8df4009cd0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.351 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.347+0000 7f8e0b293700 1 -- 172.21.15.114:0/4074989033 shutdown_connections 2023-10-18T14:06:08.351 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.347+0000 7f8e0b293700 1 --2- 172.21.15.114:0/4074989033 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e04100290 0x7f8e0410c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.352 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.347+0000 7f8e0b293700 1 --2- 172.21.15.114:0/4074989033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e04105680 0x7f8e04105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.352 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.347+0000 7f8e0b293700 1 --2- 172.21.15.114:0/4074989033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e040ff8d0 0x7f8e040ffd50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.352 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.347+0000 7f8e0b293700 1 -- 172.21.15.114:0/4074989033 >> 172.21.15.114:0/4074989033 conn(0x7f8e040764c0 msgr2=0x7f8e040768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:08.352 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.348+0000 7f8e0b293700 1 -- 172.21.15.114:0/4074989033 shutdown_connections 2023-10-18T14:06:08.352 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.348+0000 7f8e0b293700 1 -- 172.21.15.114:0/4074989033 wait complete. 2023-10-18T14:06:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.348+0000 7f8e0b293700 1 Processor -- start 2023-10-18T14:06:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.348+0000 7f8e0b293700 1 -- start start 2023-10-18T14:06:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.348+0000 7f8e0b293700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e040ff8d0 0x7f8e0419b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.348+0000 7f8e0b293700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e04100290 0x7f8e0419bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.348+0000 7f8e0b293700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e04105680 0x7f8e04195880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.348+0000 7f8e0b293700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e04195ef0 con 0x7f8e04100290 2023-10-18T14:06:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.348+0000 7f8e0b293700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e04196060 con 0x7f8e04105680 2023-10-18T14:06:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.348+0000 7f8e0b293700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e04196220 con 0x7f8e040ff8d0 2023-10-18T14:06:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e0882e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e04100290 0x7f8e0419bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e0902f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e040ff8d0 0x7f8e0419b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e0882e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e04100290 0x7f8e0419bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45766/0 (socket says 172.21.15.114:45766) 2023-10-18T14:06:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e0882e700 1 -- 172.21.15.114:0/2526190919 learned_addr learned my addr 172.21.15.114:0/2526190919 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e09830700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e04105680 0x7f8e04195880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e0882e700 1 -- 172.21.15.114:0/2526190919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e040ff8d0 msgr2=0x7f8e0419b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e0882e700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e040ff8d0 0x7f8e0419b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e0882e700 1 -- 172.21.15.114:0/2526190919 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e04105680 msgr2=0x7f8e04195880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e0882e700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e04105680 0x7f8e04195880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e0882e700 1 -- 172.21.15.114:0/2526190919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df40095f0 con 0x7f8e04100290 2023-10-18T14:06:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e0902f700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e040ff8d0 0x7f8e0419b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e0882e700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e04100290 0x7f8e0419bc40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8df400f690 tx=0x7f8df400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8dfa7fc700 1 -- 172.21.15.114:0/2526190919 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df401c070 con 0x7f8e04100290 2023-10-18T14:06:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8dfa7fc700 1 -- 172.21.15.114:0/2526190919 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8df400fcf0 con 0x7f8e04100290 2023-10-18T14:06:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e0b293700 1 -- 172.21.15.114:0/2526190919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e041964a0 con 0x7f8e04100290 2023-10-18T14:06:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8dfa7fc700 1 -- 172.21.15.114:0/2526190919 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4022c60 con 0x7f8e04100290 2023-10-18T14:06:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.349+0000 7f8e0b293700 1 -- 172.21.15.114:0/2526190919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e04069050 con 0x7f8e04100290 2023-10-18T14:06:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.352+0000 7f8dfa7fc700 1 -- 172.21.15.114:0/2526190919 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f8df4020070 con 0x7f8e04100290 2023-10-18T14:06:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.352+0000 7f8dfa7fc700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8df00a3800 0x7f8df00a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.353+0000 7f8e0902f700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8df00a3800 0x7f8df00a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.365 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.353+0000 7f8dfa7fc700 1 -- 172.21.15.114:0/2526190919 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8df40cdec0 con 0x7f8e04100290 2023-10-18T14:06:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.353+0000 7f8e0902f700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8df00a3800 0x7f8df00a5cc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8e00011490 tx=0x7f8e00009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.354+0000 7f8e1747cb80 1 Processor -- start 2023-10-18T14:06:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.354+0000 7f8e1747cb80 1 -- start start 2023-10-18T14:06:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.354+0000 7f8e1747cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9f630 0x560a03e9fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.354+0000 7f8e1747cb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9ff50 0x560a03e99ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.354+0000 7f8e1747cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9a410 0x560a03e9a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.354+0000 7f8e1747cb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a03e0d680 con 0x560a03e9ff50 2023-10-18T14:06:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.354+0000 7f8e1747cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a03df3c00 con 0x560a03e9a410 2023-10-18T14:06:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.354+0000 7f8e1747cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a03df1520 con 0x560a03e9f630 2023-10-18T14:06:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.354+0000 7f8e0882e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9ff50 0x560a03e99ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.354+0000 7f8e0902f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9f630 0x560a03e9fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.354+0000 7f8e0882e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9ff50 0x560a03e99ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45772/0 (socket says 172.21.15.114:45772) 2023-10-18T14:06:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.354+0000 7f8e0882e700 1 -- 172.21.15.114:0/3112302411 learned_addr learned my addr 172.21.15.114:0/3112302411 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.354+0000 7f8e09830700 1 --2- 172.21.15.114:0/3112302411 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9a410 0x560a03e9a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.355+0000 7f8e0902f700 1 -- 172.21.15.114:0/3112302411 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9a410 msgr2=0x560a03e9a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.355+0000 7f8e0902f700 1 --2- 172.21.15.114:0/3112302411 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9a410 0x560a03e9a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.355+0000 7f8e0902f700 1 -- 172.21.15.114:0/3112302411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9ff50 msgr2=0x560a03e99ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.355+0000 7f8e0902f700 1 --2- 172.21.15.114:0/3112302411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9ff50 0x560a03e99ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.355+0000 7f8e0902f700 1 -- 172.21.15.114:0/3112302411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a03daa390 con 0x560a03e9f630 2023-10-18T14:06:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.355+0000 7f8e0882e700 1 --2- 172.21.15.114:0/3112302411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9ff50 0x560a03e99ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.355+0000 7f8e0902f700 1 --2- 172.21.15.114:0/3112302411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9f630 0x560a03e9fa10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8e000042f0 tx=0x7f8e00014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f0e787921d8d77 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.355+0000 7f8def7fe700 1 -- 172.21.15.114:0/3112302411 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00003d10 con 0x560a03e9f630 2023-10-18T14:06:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.355+0000 7f8def7fe700 1 -- 172.21.15.114:0/3112302411 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e00003e70 con 0x560a03e9f630 2023-10-18T14:06:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.355+0000 7f8def7fe700 1 -- 172.21.15.114:0/3112302411 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0001e7f0 con 0x560a03e9f630 2023-10-18T14:06:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.356+0000 7f8e1747cb80 1 -- 172.21.15.114:0/3112302411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9f630 msgr2=0x560a03e9fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.356+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/3112302411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9f630 0x560a03e9fa10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8e000042f0 tx=0x7f8e00014000 comp rx=0 tx=0).stop 2023-10-18T14:06:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.356+0000 7f8e1747cb80 1 -- 172.21.15.114:0/3112302411 shutdown_connections 2023-10-18T14:06:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.356+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/3112302411 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9a410 0x560a03e9a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.356+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/3112302411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9f630 0x560a03e9fa10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.356+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/3112302411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9ff50 0x560a03e99ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.356+0000 7f8e1747cb80 1 -- 172.21.15.114:0/3112302411 >> 172.21.15.114:0/3112302411 conn(0x560a03e0e6c0 msgr2=0x560a03e945a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.356+0000 7f8e1747cb80 1 -- 172.21.15.114:0/3112302411 shutdown_connections 2023-10-18T14:06:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.356+0000 7f8e1747cb80 1 -- 172.21.15.114:0/3112302411 wait complete. 2023-10-18T14:06:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.356+0000 7f8e1747cb80 1 -- start start 2023-10-18T14:06:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.356+0000 7f8e1747cb80 1 Processor -- start 2023-10-18T14:06:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e1747cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9a410 0x560a03ea5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e1747cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9f630 0x560a03ea3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e1747cb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9ff50 0x560a03ea3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e1747cb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a03dece10 con 0x560a03e9ff50 2023-10-18T14:06:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e1747cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a03d896b0 con 0x560a03e9a410 2023-10-18T14:06:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e1747cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a03d89350 con 0x560a03e9f630 2023-10-18T14:06:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e1747cb80 10 client.0 _ll_register_callbacks cb 0x560a03cd3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:06:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e09830700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9ff50 0x560a03ea3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e0902f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9a410 0x560a03ea5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e0882e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9f630 0x560a03ea3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e0902f700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9a410 0x560a03ea5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41920/0 (socket says 172.21.15.114:41920) 2023-10-18T14:06:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e0902f700 1 -- 172.21.15.114:0/974011005 learned_addr learned my addr 172.21.15.114:0/974011005 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e0902f700 1 -- 172.21.15.114:0/974011005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9f630 msgr2=0x560a03ea3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e0902f700 1 --2- 172.21.15.114:0/974011005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9f630 0x560a03ea3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e0902f700 1 -- 172.21.15.114:0/974011005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9ff50 msgr2=0x560a03ea3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e0902f700 1 --2- 172.21.15.114:0/974011005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9ff50 0x560a03ea3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.357+0000 7f8e0902f700 1 -- 172.21.15.114:0/974011005 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e04069050 con 0x560a03e9a410 2023-10-18T14:06:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.358+0000 7f8e0902f700 1 --2- 172.21.15.114:0/974011005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9a410 0x560a03ea5ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009790 tx=0x7f8e00005360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e84bd1bbf24194c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.358+0000 7f8decff9700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:06:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.358+0000 7f8decff9700 1 -- 172.21.15.114:0/974011005 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0002a070 con 0x560a03e9a410 2023-10-18T14:06:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.358+0000 7f8e1747cb80 1 -- 172.21.15.114:0/974011005 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a03df1e90 con 0x560a03e9a410 2023-10-18T14:06:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.358+0000 7f8decff9700 1 -- 172.21.15.114:0/974011005 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8e000048c0 con 0x560a03e9a410 2023-10-18T14:06:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.358+0000 7f8decff9700 1 -- 172.21.15.114:0/974011005 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e00004a80 con 0x560a03e9a410 2023-10-18T14:06:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.358+0000 7f8e1747cb80 10 client.25448 fetch_fsmap learned FSMap version 32 2023-10-18T14:06:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.358+0000 7f8e1747cb80 1 -- 172.21.15.114:0/974011005 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f8e00017070 con 0x560a03e9a410 2023-10-18T14:06:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.358+0000 7f8decff9700 1 -- 172.21.15.114:0/974011005 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560a03df1e90 con 0x560a03e9a410 2023-10-18T14:06:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.358+0000 7f8decff9700 1 -- 172.21.15.114:0/974011005 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 32) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f8e00024020 con 0x560a03e9a410 2023-10-18T14:06:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.358+0000 7f8e1747cb80 10 client.25448 fetch_fsmap finished waiting for FSMap version 32 2023-10-18T14:06:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.358+0000 7f8e1747cb80 10 client.25448 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:06:08.377 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.358+0000 7f8e1747cb80 20 client.25448 populate_metadata read hostname 'smithi114' 2023-10-18T14:06:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.359+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/974011005 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x560a03eb38d0 0x560a03eb5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.359+0000 7f8e1747cb80 4 client.25448 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:06:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.359+0000 7f8e1747cb80 1 -- 172.21.15.114:0/974011005 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a03e69850 con 0x560a03eb38d0 2023-10-18T14:06:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.359+0000 7f8e0882e700 1 --2- 172.21.15.114:0/974011005 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x560a03eb38d0 0x560a03eb5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.359+0000 7f8decff9700 10 client.25448 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.359+0000 7f8e0882e700 1 --2- 172.21.15.114:0/974011005 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x560a03eb38d0 0x560a03eb5cf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e98bf5592105386c server_cookie=f445553d16aca754 in_seq=0 out_seq=0 2023-10-18T14:06:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.361+0000 7f8decff9700 1 -- 172.21.15.114:0/974011005 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560a03e69850 con 0x560a03eb38d0 2023-10-18T14:06:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.361+0000 7f8decff9700 10 client.25448 handle_command_reply: tid=0 2023-10-18T14:06:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.361+0000 7f8e1747cb80 1 client.25448 shutdown 2023-10-18T14:06:08.379 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.361+0000 7f8e1747cb80 1 -- 172.21.15.114:0/974011005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9a410 msgr2=0x560a03ea5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.361+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/974011005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9a410 0x560a03ea5ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009790 tx=0x7f8e00005360 comp rx=0 tx=0).stop 2023-10-18T14:06:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.361+0000 7f8e1747cb80 1 -- 172.21.15.114:0/974011005 shutdown_connections 2023-10-18T14:06:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.361+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/974011005 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x560a03eb38d0 0x560a03eb5cf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.361+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/974011005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9ff50 0x560a03ea3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.361+0000 7f8decff9700 0 client.25448 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:08.380 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.361+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/974011005 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9a410 0x560a03ea5ed0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.361+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/974011005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9f630 0x560a03ea3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.361+0000 7f8e1747cb80 1 -- 172.21.15.114:0/974011005 >> 172.21.15.114:0/974011005 conn(0x560a03e0e6c0 msgr2=0x560a03e93d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.361+0000 7f8e1747cb80 1 -- 172.21.15.114:0/974011005 shutdown_connections 2023-10-18T14:06:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.362+0000 7f8e1747cb80 1 -- 172.21.15.114:0/974011005 wait complete. 2023-10-18T14:06:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.362+0000 7f8e1747cb80 20 client.25448 trim_cache size 0 max 16384 2023-10-18T14:06:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.377+0000 7f8e1747cb80 1 Processor -- start 2023-10-18T14:06:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.377+0000 7f8e1747cb80 1 -- start start 2023-10-18T14:06:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.377+0000 7f8e1747cb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 0x560a03e99ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e1747cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9f630 0x560a03eaa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e1747cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9ff50 0x560a03eaf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e1747cb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a03c6d8c0 con 0x560a03e9a410 2023-10-18T14:06:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e1747cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a03eaaee0 con 0x560a03e9f630 2023-10-18T14:06:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e1747cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a03e9e050 con 0x560a03e9ff50 2023-10-18T14:06:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e0902f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 0x560a03e99ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e0902f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 0x560a03e99ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45784/0 (socket says 172.21.15.114:45784) 2023-10-18T14:06:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e0882e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9f630 0x560a03eaa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e0902f700 1 -- 172.21.15.114:0/3122624246 learned_addr learned my addr 172.21.15.114:0/3122624246 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e09830700 1 --2- 172.21.15.114:0/3122624246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9ff50 0x560a03eaf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e0902f700 1 -- 172.21.15.114:0/3122624246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9ff50 msgr2=0x560a03eaf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e0902f700 1 --2- 172.21.15.114:0/3122624246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9ff50 0x560a03eaf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e0902f700 1 -- 172.21.15.114:0/3122624246 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9f630 msgr2=0x560a03eaa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e0902f700 1 --2- 172.21.15.114:0/3122624246 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9f630 0x560a03eaa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e0902f700 1 -- 172.21.15.114:0/3122624246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a03c17d80 con 0x560a03e9a410 2023-10-18T14:06:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e0882e700 1 --2- 172.21.15.114:0/3122624246 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9f630 0x560a03eaa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8e0902f700 1 --2- 172.21.15.114:0/3122624246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 0x560a03e99ed0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8e00003960 tx=0x7f8e00003990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d340aca2290c3602 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8deffff700 1 -- 172.21.15.114:0/3122624246 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0002a070 con 0x560a03e9a410 2023-10-18T14:06:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8deffff700 1 -- 172.21.15.114:0/3122624246 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e0002b040 con 0x560a03e9a410 2023-10-18T14:06:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.378+0000 7f8deffff700 1 -- 172.21.15.114:0/3122624246 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e000269a0 con 0x560a03e9a410 2023-10-18T14:06:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.379+0000 7f8e1747cb80 1 -- 172.21.15.114:0/3122624246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 msgr2=0x560a03e99ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.379+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/3122624246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 0x560a03e99ed0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8e00003960 tx=0x7f8e00003990 comp rx=0 tx=0).stop 2023-10-18T14:06:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.379+0000 7f8e1747cb80 1 -- 172.21.15.114:0/3122624246 shutdown_connections 2023-10-18T14:06:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.379+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/3122624246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9ff50 0x560a03eaf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.391 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.379+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/3122624246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 0x560a03e99ed0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.379+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/3122624246 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9f630 0x560a03eaa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.379+0000 7f8e1747cb80 1 -- 172.21.15.114:0/3122624246 >> 172.21.15.114:0/3122624246 conn(0x560a03e0e6c0 msgr2=0x560a03eaf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.379+0000 7f8e1747cb80 1 -- 172.21.15.114:0/3122624246 shutdown_connections 2023-10-18T14:06:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.379+0000 7f8e1747cb80 1 -- 172.21.15.114:0/3122624246 wait complete. 2023-10-18T14:06:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e1747cb80 1 -- start start 2023-10-18T14:06:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e1747cb80 1 Processor -- start 2023-10-18T14:06:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e1747cb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 0x560a03eaa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e1747cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9f630 0x560a03eaa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e1747cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9ff50 0x560a03ea8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e1747cb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a03ea91d0 con 0x560a03e9a410 2023-10-18T14:06:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e1747cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a03ea9340 con 0x560a03e9f630 2023-10-18T14:06:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e1747cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a03ea9500 con 0x560a03e9ff50 2023-10-18T14:06:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e1747cb80 10 client.0 _ll_register_callbacks cb 0x560a03cd3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:06:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e0902f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 0x560a03eaa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e0882e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9f630 0x560a03eaa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e0902f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 0x560a03eaa3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45790/0 (socket says 172.21.15.114:45790) 2023-10-18T14:06:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e0882e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9f630 0x560a03eaa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41936/0 (socket says 172.21.15.114:41936) 2023-10-18T14:06:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e0902f700 1 -- 172.21.15.114:0/2488445780 learned_addr learned my addr 172.21.15.114:0/2488445780 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.380+0000 7f8e09830700 1 --2- 172.21.15.114:0/2488445780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9ff50 0x560a03ea8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8e0902f700 1 -- 172.21.15.114:0/2488445780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9ff50 msgr2=0x560a03ea8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8e0902f700 1 --2- 172.21.15.114:0/2488445780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9ff50 0x560a03ea8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8e0902f700 1 -- 172.21.15.114:0/2488445780 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9f630 msgr2=0x560a03eaa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8e0902f700 1 --2- 172.21.15.114:0/2488445780 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9f630 0x560a03eaa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8e0902f700 1 -- 172.21.15.114:0/2488445780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e041964a0 con 0x560a03e9a410 2023-10-18T14:06:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8e0882e700 1 --2- 172.21.15.114:0/2488445780 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9f630 0x560a03eaa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8e0902f700 1 --2- 172.21.15.114:0/2488445780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 0x560a03eaa3e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8e00003e40 tx=0x7f8e00030ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb88e547430cd33 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8decff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:06:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8decff9700 1 -- 172.21.15.114:0/2488445780 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0002a070 con 0x560a03e9a410 2023-10-18T14:06:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8decff9700 1 -- 172.21.15.114:0/2488445780 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8e00026600 con 0x560a03e9a410 2023-10-18T14:06:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8e1747cb80 1 -- 172.21.15.114:0/2488445780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e00003e70 con 0x560a03e9a410 2023-10-18T14:06:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8decff9700 1 -- 172.21.15.114:0/2488445780 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e00026800 con 0x560a03e9a410 2023-10-18T14:06:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8e1747cb80 10 client.16302 fetch_fsmap learned FSMap version 32 2023-10-18T14:06:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8e1747cb80 1 -- 172.21.15.114:0/2488445780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f8e00017070 con 0x560a03e9a410 2023-10-18T14:06:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8decff9700 1 -- 172.21.15.114:0/2488445780 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e00051020 con 0x560a03e9a410 2023-10-18T14:06:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.381+0000 7f8decff9700 1 -- 172.21.15.114:0/2488445780 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 32) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f8e00003680 con 0x560a03e9a410 2023-10-18T14:06:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.382+0000 7f8e1747cb80 10 client.16302 fetch_fsmap finished waiting for FSMap version 32 2023-10-18T14:06:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.382+0000 7f8e1747cb80 10 client.16302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:06:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.382+0000 7f8e1747cb80 20 client.16302 populate_metadata read hostname 'smithi114' 2023-10-18T14:06:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.382+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/2488445780 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x560a03f08690 0x560a03f0aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.382+0000 7f8e1747cb80 4 client.16302 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:06:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.382+0000 7f8e1747cb80 1 -- 172.21.15.114:0/2488445780 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560a03de5df0 con 0x560a03f08690 2023-10-18T14:06:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.382+0000 7f8e0882e700 1 --2- 172.21.15.114:0/2488445780 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x560a03f08690 0x560a03f0aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.382+0000 7f8decff9700 10 client.16302 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.382+0000 7f8e0882e700 1 --2- 172.21.15.114:0/2488445780 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x560a03f08690 0x560a03f0aab0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16310d68840ab21f server_cookie=99060b4a5388cb8b in_seq=0 out_seq=0 2023-10-18T14:06:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8decff9700 1 -- 172.21.15.114:0/2488445780 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560a03de5df0 con 0x560a03f08690 2023-10-18T14:06:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8decff9700 10 client.16302 handle_command_reply: tid=0 2023-10-18T14:06:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8e1747cb80 1 client.16302 shutdown 2023-10-18T14:06:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8e1747cb80 1 -- 172.21.15.114:0/2488445780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 msgr2=0x560a03eaa3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/2488445780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 0x560a03eaa3e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8e00003e40 tx=0x7f8e00030ef0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8e1747cb80 1 -- 172.21.15.114:0/2488445780 shutdown_connections 2023-10-18T14:06:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/2488445780 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x560a03f08690 0x560a03f0aab0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/2488445780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a03e9ff50 0x560a03ea8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.410 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/2488445780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a03e9a410 0x560a03eaa3e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.410 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8decff9700 0 client.16302 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:08.410 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8e1747cb80 1 --2- 172.21.15.114:0/2488445780 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x560a03e9f630 0x560a03eaa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.410 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8e1747cb80 1 -- 172.21.15.114:0/2488445780 >> 172.21.15.114:0/2488445780 conn(0x560a03e0e6c0 msgr2=0x560a03eaf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:08.410 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8e1747cb80 1 -- 172.21.15.114:0/2488445780 shutdown_connections 2023-10-18T14:06:08.411 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8e1747cb80 1 -- 172.21.15.114:0/2488445780 wait complete. 2023-10-18T14:06:08.411 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.405+0000 7f8e1747cb80 20 client.16302 trim_cache size 0 max 16384 2023-10-18T14:06:08.411 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:06:08.412 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:06:08.412 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:06:08.412 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:06:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.406+0000 7f8e0b293700 1 -- 172.21.15.114:0/2526190919 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8df00a3800 msgr2=0x7f8df00a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.406+0000 7f8e0b293700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8df00a3800 0x7f8df00a5cc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8e00011490 tx=0x7f8e00009260 comp rx=0 tx=0).stop 2023-10-18T14:06:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.406+0000 7f8e0b293700 1 -- 172.21.15.114:0/2526190919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e04100290 msgr2=0x7f8e0419bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.406+0000 7f8e0b293700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e04100290 0x7f8e0419bc40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8df400f690 tx=0x7f8df400bfd0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.406+0000 7f8e0b293700 1 -- 172.21.15.114:0/2526190919 shutdown_connections 2023-10-18T14:06:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.406+0000 7f8e0b293700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f8df00a3800 0x7f8df00a5cc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.406+0000 7f8e0b293700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8e04105680 0x7f8e04195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.406+0000 7f8e0b293700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e040ff8d0 0x7f8e0419b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.406+0000 7f8e0b293700 1 --2- 172.21.15.114:0/2526190919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e04100290 0x7f8e0419bc40 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.406+0000 7f8e0b293700 1 -- 172.21.15.114:0/2526190919 >> 172.21.15.114:0/2526190919 conn(0x7f8e040764c0 msgr2=0x7f8e040fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.406+0000 7f8e0b293700 1 -- 172.21.15.114:0/2526190919 shutdown_connections 2023-10-18T14:06:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:08.406+0000 7f8e0b293700 1 -- 172.21.15.114:0/2526190919 wait complete. 2023-10-18T14:06:09.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:08 smithi158 ceph-mon[103317]: pgmap v343: 97 pgs: 97 active+clean; 40 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 725 op/s 2023-10-18T14:06:09.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:08 smithi172 ceph-mon[103574]: pgmap v343: 97 pgs: 97 active+clean; 40 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 725 op/s 2023-10-18T14:06:09.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:08 smithi114 ceph-mon[99494]: pgmap v343: 97 pgs: 97 active+clean; 40 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 725 op/s 2023-10-18T14:06:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:10 smithi158 ceph-mon[103317]: pgmap v344: 97 pgs: 97 active+clean; 42 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 956 op/s 2023-10-18T14:06:11.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:10 smithi172 ceph-mon[103574]: pgmap v344: 97 pgs: 97 active+clean; 42 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 956 op/s 2023-10-18T14:06:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:10 smithi114 ceph-mon[99494]: pgmap v344: 97 pgs: 97 active+clean; 42 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 956 op/s 2023-10-18T14:06:11.403 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0xfffe8 2023-10-18T14:06:12.629 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:06:12.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.776+0000 7fec72426700 1 -- 172.21.15.114:0/3436868034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec6c100290 msgr2=0x7fec6c10c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:12.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.776+0000 7fec72426700 1 --2- 172.21.15.114:0/3436868034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec6c100290 0x7fec6c10c640 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fec6400b0a0 tx=0x7fec6400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.777+0000 7fec72426700 1 -- 172.21.15.114:0/3436868034 shutdown_connections 2023-10-18T14:06:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.777+0000 7fec72426700 1 --2- 172.21.15.114:0/3436868034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec6c100290 0x7fec6c10c640 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.777+0000 7fec72426700 1 --2- 172.21.15.114:0/3436868034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec6c101640 0x7fec6c101a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.777+0000 7fec72426700 1 --2- 172.21.15.114:0/3436868034 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec6c0ff8f0 0x7fec6c0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.777+0000 7fec72426700 1 -- 172.21.15.114:0/3436868034 >> 172.21.15.114:0/3436868034 conn(0x7fec6c077570 msgr2=0x7fec6c077980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.777+0000 7fec72426700 1 -- 172.21.15.114:0/3436868034 shutdown_connections 2023-10-18T14:06:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.777+0000 7fec72426700 1 -- 172.21.15.114:0/3436868034 wait complete. 2023-10-18T14:06:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.777+0000 7fec72426700 1 Processor -- start 2023-10-18T14:06:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.778+0000 7fec72426700 1 -- start start 2023-10-18T14:06:12.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.778+0000 7fec72426700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec6c0ff8f0 0x7fec6c19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.778+0000 7fec72426700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec6c100290 0x7fec6c19bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.778+0000 7fec72426700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec6c101640 0x7fec6c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.778+0000 7fec72426700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c196130 con 0x7fec6c100290 2023-10-18T14:06:12.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.778+0000 7fec72426700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c1962a0 con 0x7fec6c0ff8f0 2023-10-18T14:06:12.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.778+0000 7fec72426700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c196460 con 0x7fec6c101640 2023-10-18T14:06:12.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.778+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec6c0ff8f0 0x7fec6c19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.778+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec6c100290 0x7fec6c19bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.778+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec6c0ff8f0 0x7fec6c19b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41948/0 (socket says 172.21.15.114:41948) 2023-10-18T14:06:12.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.778+0000 7fec6bfff700 1 -- 172.21.15.114:0/2325070369 learned_addr learned my addr 172.21.15.114:0/2325070369 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:12.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.778+0000 7fec709c3700 1 --2- 172.21.15.114:0/2325070369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec6c101640 0x7fec6c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.779+0000 7fec6b7fe700 1 -- 172.21.15.114:0/2325070369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec6c101640 msgr2=0x7fec6c195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:12.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.779+0000 7fec6b7fe700 1 --2- 172.21.15.114:0/2325070369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec6c101640 0x7fec6c195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.779+0000 7fec6b7fe700 1 -- 172.21.15.114:0/2325070369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec6c0ff8f0 msgr2=0x7fec6c19b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:12.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.779+0000 7fec6b7fe700 1 --2- 172.21.15.114:0/2325070369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec6c0ff8f0 0x7fec6c19b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.779+0000 7fec6b7fe700 1 -- 172.21.15.114:0/2325070369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec64009d00 con 0x7fec6c100290 2023-10-18T14:06:12.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.779+0000 7fec6b7fe700 1 --2- 172.21.15.114:0/2325070369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec6c100290 0x7fec6c19bee0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fec6000d750 tx=0x7fec6000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:12.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.779+0000 7fec697fa700 1 -- 172.21.15.114:0/2325070369 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60004020 con 0x7fec6c100290 2023-10-18T14:06:12.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.779+0000 7fec72426700 1 -- 172.21.15.114:0/2325070369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c196740 con 0x7fec6c100290 2023-10-18T14:06:12.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.779+0000 7fec697fa700 1 -- 172.21.15.114:0/2325070369 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec60004830 con 0x7fec6c100290 2023-10-18T14:06:12.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.779+0000 7fec697fa700 1 -- 172.21.15.114:0/2325070369 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec600054c0 con 0x7fec6c100290 2023-10-18T14:06:12.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.779+0000 7fec72426700 1 -- 172.21.15.114:0/2325070369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c1a2990 con 0x7fec6c100290 2023-10-18T14:06:12.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.782+0000 7fec697fa700 1 -- 172.21.15.114:0/2325070369 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fec600049a0 con 0x7fec6c100290 2023-10-18T14:06:12.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec7e60fb80 1 Processor -- start 2023-10-18T14:06:12.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec7e60fb80 1 -- start start 2023-10-18T14:06:12.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec697fa700 1 --2- 172.21.15.114:0/2325070369 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fec540a15f0 0x7fec540a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec7e60fb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa441cbe0 0x55efa441cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec7e60fb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa4417090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec7e60fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa44175d0 0x55efa4417a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec7e60fb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efa438a6e0 con 0x55efa441d500 2023-10-18T14:06:12.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec7e60fb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efa4370c60 con 0x55efa441cbe0 2023-10-18T14:06:12.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec7e60fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efa436e580 con 0x55efa44175d0 2023-10-18T14:06:12.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec709c3700 1 --2- 172.21.15.114:0/2325070369 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fec540a15f0 0x7fec540a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa4417090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa441cbe0 0x55efa441cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa441cbe0 0x55efa441cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41954/0 (socket says 172.21.15.114:41954) 2023-10-18T14:06:12.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec6bfff700 1 -- 172.21.15.114:0/1878628950 learned_addr learned my addr 172.21.15.114:0/1878628950 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:12.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec709c3700 1 --2- 172.21.15.114:0/1878628950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa44175d0 0x55efa4417a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec697fa700 1 -- 172.21.15.114:0/2325070369 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fec600cca40 con 0x7fec6c100290 2023-10-18T14:06:12.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec6bfff700 1 -- 172.21.15.114:0/1878628950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa44175d0 msgr2=0x55efa4417a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:12.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec6bfff700 1 --2- 172.21.15.114:0/1878628950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa44175d0 0x55efa4417a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec6bfff700 1 -- 172.21.15.114:0/1878628950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 msgr2=0x55efa4417090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:12.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec6bfff700 1 --2- 172.21.15.114:0/1878628950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa4417090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.783+0000 7fec6bfff700 1 -- 172.21.15.114:0/1878628950 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efa43273f0 con 0x55efa441cbe0 2023-10-18T14:06:12.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.784+0000 7fec6bfff700 1 --2- 172.21.15.114:0/1878628950 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa441cbe0 0x55efa441cfc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009dd0 tx=0x7fec5c011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ae67a9f37617b0a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:12.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.784+0000 7fec709c3700 1 --2- 172.21.15.114:0/2325070369 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fec540a15f0 0x7fec540a3ab0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fec64009610 tx=0x7fec640092e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:12.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.784+0000 7fec527fc700 1 -- 172.21.15.114:0/1878628950 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c004a30 con 0x55efa441cbe0 2023-10-18T14:06:12.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.784+0000 7fec527fc700 1 -- 172.21.15.114:0/1878628950 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec5c0054e0 con 0x55efa441cbe0 2023-10-18T14:06:12.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.784+0000 7fec527fc700 1 -- 172.21.15.114:0/1878628950 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c019830 con 0x55efa441cbe0 2023-10-18T14:06:12.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.785+0000 7fec7e60fb80 1 -- 172.21.15.114:0/1878628950 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa441cbe0 msgr2=0x55efa441cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:12.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.785+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/1878628950 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa441cbe0 0x55efa441cfc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009dd0 tx=0x7fec5c011720 comp rx=0 tx=0).stop 2023-10-18T14:06:12.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.785+0000 7fec7e60fb80 1 -- 172.21.15.114:0/1878628950 shutdown_connections 2023-10-18T14:06:12.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.785+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/1878628950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa44175d0 0x55efa4417a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.785+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/1878628950 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa441cbe0 0x55efa441cfc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.785+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/1878628950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa4417090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.785+0000 7fec7e60fb80 1 -- 172.21.15.114:0/1878628950 >> 172.21.15.114:0/1878628950 conn(0x55efa438b720 msgr2=0x55efa4411b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:12.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.785+0000 7fec7e60fb80 1 -- 172.21.15.114:0/1878628950 shutdown_connections 2023-10-18T14:06:12.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.785+0000 7fec7e60fb80 1 -- 172.21.15.114:0/1878628950 wait complete. 2023-10-18T14:06:12.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.785+0000 7fec7e60fb80 1 -- start start 2023-10-18T14:06:12.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.785+0000 7fec7e60fb80 1 Processor -- start 2023-10-18T14:06:12.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec7e60fb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa44175d0 0x55efa441e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec7e60fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 0x55efa441edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec7e60fb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa441f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec7e60fb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efa4369e70 con 0x55efa441d500 2023-10-18T14:06:12.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec7e60fb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efa4306710 con 0x55efa44175d0 2023-10-18T14:06:12.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec7e60fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efa43063b0 con 0x55efa441cbe0 2023-10-18T14:06:12.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec7e60fb80 10 client.0 _ll_register_callbacks cb 0x55efa4250a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:06:12.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec709c3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa441f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa44175d0 0x55efa441e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 0x55efa441edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec709c3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa441f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45822/0 (socket says 172.21.15.114:45822) 2023-10-18T14:06:12.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa44175d0 0x55efa441e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41962/0 (socket says 172.21.15.114:41962) 2023-10-18T14:06:12.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec709c3700 1 -- 172.21.15.114:0/3732344670 learned_addr learned my addr 172.21.15.114:0/3732344670 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:12.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec709c3700 1 -- 172.21.15.114:0/3732344670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 msgr2=0x55efa441edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:12.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec709c3700 1 --2- 172.21.15.114:0/3732344670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 0x55efa441edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec709c3700 1 -- 172.21.15.114:0/3732344670 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa44175d0 msgr2=0x55efa441e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:12.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec709c3700 1 --2- 172.21.15.114:0/3732344670 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa44175d0 0x55efa441e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec709c3700 1 -- 172.21.15.114:0/3732344670 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c009a30 con 0x55efa441d500 2023-10-18T14:06:12.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec709c3700 1 --2- 172.21.15.114:0/3732344670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa441f310 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fec640060c0 tx=0x7fec6400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff5bf287ddb5da4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:12.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec4b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:06:12.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec4b7fe700 1 -- 172.21.15.114:0/3732344670 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6400e040 con 0x55efa441d500 2023-10-18T14:06:12.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec4b7fe700 1 -- 172.21.15.114:0/3732344670 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fec640078f0 con 0x55efa441d500 2023-10-18T14:06:12.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec7e60fb80 1 -- 172.21.15.114:0/3732344670 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55efa436eef0 con 0x55efa441d500 2023-10-18T14:06:12.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.786+0000 7fec4b7fe700 1 -- 172.21.15.114:0/3732344670 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec640060f0 con 0x55efa441d500 2023-10-18T14:06:12.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.787+0000 7fec7e60fb80 10 client.16314 fetch_fsmap learned FSMap version 32 2023-10-18T14:06:12.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.787+0000 7fec7e60fb80 1 -- 172.21.15.114:0/3732344670 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55efa4194de0 con 0x55efa441d500 2023-10-18T14:06:12.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.787+0000 7fec4b7fe700 1 -- 172.21.15.114:0/3732344670 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec64038020 con 0x55efa441d500 2023-10-18T14:06:12.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.787+0000 7fec4b7fe700 1 -- 172.21.15.114:0/3732344670 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 32) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fec64020570 con 0x55efa441d500 2023-10-18T14:06:12.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.787+0000 7fec7e60fb80 10 client.16314 fetch_fsmap finished waiting for FSMap version 32 2023-10-18T14:06:12.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.787+0000 7fec7e60fb80 10 client.16314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:06:12.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.787+0000 7fec7e60fb80 20 client.16314 populate_metadata read hostname 'smithi114' 2023-10-18T14:06:12.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.787+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/3732344670 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55efa4430f50 0x55efa4433370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.787+0000 7fec7e60fb80 4 client.16314 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:06:12.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.787+0000 7fec7e60fb80 1 -- 172.21.15.114:0/3732344670 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55efa43e68b0 con 0x55efa4430f50 2023-10-18T14:06:12.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.787+0000 7fec6bfff700 1 --2- 172.21.15.114:0/3732344670 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55efa4430f50 0x55efa4433370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.788+0000 7fec6bfff700 1 --2- 172.21.15.114:0/3732344670 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55efa4430f50 0x55efa4433370 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e3b53bb18ff875d server_cookie=4e1a1ade6f4cf687 in_seq=0 out_seq=0 2023-10-18T14:06:12.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.788+0000 7fec4b7fe700 10 client.16314 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:12.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.788+0000 7fec4b7fe700 1 -- 172.21.15.114:0/3732344670 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55efa43e68b0 con 0x55efa4430f50 2023-10-18T14:06:12.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.788+0000 7fec4b7fe700 10 client.16314 handle_command_reply: tid=0 2023-10-18T14:06:12.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.788+0000 7fec7e60fb80 1 client.16314 shutdown 2023-10-18T14:06:12.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.789+0000 7fec7e60fb80 1 -- 172.21.15.114:0/3732344670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 msgr2=0x55efa441f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:12.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.789+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/3732344670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa441f310 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fec640060c0 tx=0x7fec6400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.789+0000 7fec7e60fb80 1 -- 172.21.15.114:0/3732344670 shutdown_connections 2023-10-18T14:06:12.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.789+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/3732344670 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55efa4430f50 0x55efa4433370 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.789+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/3732344670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa441f310 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.789+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/3732344670 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa44175d0 0x55efa441e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.789+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/3732344670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 0x55efa441edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.789+0000 7fec7e60fb80 1 -- 172.21.15.114:0/3732344670 >> 172.21.15.114:0/3732344670 conn(0x55efa438b720 msgr2=0x55efa4411ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:12.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.789+0000 7fec4b7fe700 0 client.16314 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:12.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.789+0000 7fec7e60fb80 1 -- 172.21.15.114:0/3732344670 shutdown_connections 2023-10-18T14:06:12.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.789+0000 7fec7e60fb80 1 -- 172.21.15.114:0/3732344670 wait complete. 2023-10-18T14:06:12.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.789+0000 7fec7e60fb80 20 client.16314 trim_cache size 0 max 16384 2023-10-18T14:06:12.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.811+0000 7fec7e60fb80 1 Processor -- start 2023-10-18T14:06:12.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.811+0000 7fec7e60fb80 1 -- start start 2023-10-18T14:06:12.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.811+0000 7fec7e60fb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa44175d0 0x55efa440c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.811+0000 7fec7e60fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 0x55efa4429e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.811+0000 7fec7e60fb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa441d500 0x55efa4418a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.811+0000 7fec7e60fb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efa41ea920 con 0x55efa44175d0 2023-10-18T14:06:12.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.811+0000 7fec7e60fb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efa4413570 con 0x55efa441d500 2023-10-18T14:06:12.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.811+0000 7fec7e60fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efa442a380 con 0x55efa441cbe0 2023-10-18T14:06:12.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.811+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa44175d0 0x55efa440c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.811+0000 7fec709c3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa441d500 0x55efa4418a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.811+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa44175d0 0x55efa440c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45826/0 (socket says 172.21.15.114:45826) 2023-10-18T14:06:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.811+0000 7fec6bfff700 1 -- 172.21.15.114:0/1923809653 learned_addr learned my addr 172.21.15.114:0/1923809653 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.811+0000 7fec6b7fe700 1 --2- 172.21.15.114:0/1923809653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 0x55efa4429e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.812+0000 7fec6bfff700 1 -- 172.21.15.114:0/1923809653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 msgr2=0x55efa4429e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.812+0000 7fec6bfff700 1 --2- 172.21.15.114:0/1923809653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 0x55efa4429e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.812+0000 7fec6bfff700 1 -- 172.21.15.114:0/1923809653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa441d500 msgr2=0x55efa4418a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.812+0000 7fec6bfff700 1 --2- 172.21.15.114:0/1923809653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa441d500 0x55efa4418a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.812+0000 7fec6bfff700 1 -- 172.21.15.114:0/1923809653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efa417dc60 con 0x55efa44175d0 2023-10-18T14:06:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.812+0000 7fec6bfff700 1 --2- 172.21.15.114:0/1923809653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa44175d0 0x55efa440c5d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009d20 tx=0x7fec5c0056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ae1ba42a799ea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.812+0000 7fec52ffd700 1 -- 172.21.15.114:0/1923809653 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0052d0 con 0x55efa44175d0 2023-10-18T14:06:12.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.812+0000 7fec52ffd700 1 -- 172.21.15.114:0/1923809653 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec5c003b40 con 0x55efa44175d0 2023-10-18T14:06:12.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.812+0000 7fec52ffd700 1 -- 172.21.15.114:0/1923809653 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c019a80 con 0x55efa44175d0 2023-10-18T14:06:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.813+0000 7fec7e60fb80 1 -- 172.21.15.114:0/1923809653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa44175d0 msgr2=0x55efa440c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.813+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/1923809653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa44175d0 0x55efa440c5d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009d20 tx=0x7fec5c0056a0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.813+0000 7fec7e60fb80 1 -- 172.21.15.114:0/1923809653 shutdown_connections 2023-10-18T14:06:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.813+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/1923809653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa441d500 0x55efa4418a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.813+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/1923809653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa44175d0 0x55efa440c5d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.813+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/1923809653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 0x55efa4429e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.813+0000 7fec7e60fb80 1 -- 172.21.15.114:0/1923809653 >> 172.21.15.114:0/1923809653 conn(0x55efa438b720 msgr2=0x55efa4432f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.813+0000 7fec7e60fb80 1 -- 172.21.15.114:0/1923809653 shutdown_connections 2023-10-18T14:06:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.813+0000 7fec7e60fb80 1 -- 172.21.15.114:0/1923809653 wait complete. 2023-10-18T14:06:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.813+0000 7fec7e60fb80 1 -- start start 2023-10-18T14:06:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec7e60fb80 1 Processor -- start 2023-10-18T14:06:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec7e60fb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa44175d0 0x55efa4429bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec7e60fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 0x55efa44281f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec7e60fb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa4428730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec7e60fb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efa4428e70 con 0x55efa441d500 2023-10-18T14:06:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec7e60fb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efa4428fe0 con 0x55efa44175d0 2023-10-18T14:06:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec7e60fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efa4484d90 con 0x55efa441cbe0 2023-10-18T14:06:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec7e60fb80 10 client.0 _ll_register_callbacks cb 0x55efa4250a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:06:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec709c3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa4428730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa44175d0 0x55efa4429bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa44175d0 0x55efa4429bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41974/0 (socket says 172.21.15.114:41974) 2023-10-18T14:06:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec6bfff700 1 -- 172.21.15.114:0/2498271109 learned_addr learned my addr 172.21.15.114:0/2498271109 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec709c3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa4428730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45834/0 (socket says 172.21.15.114:45834) 2023-10-18T14:06:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec6b7fe700 1 --2- 172.21.15.114:0/2498271109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 0x55efa44281f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec709c3700 1 -- 172.21.15.114:0/2498271109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 msgr2=0x55efa44281f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:12.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec709c3700 1 --2- 172.21.15.114:0/2498271109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 0x55efa44281f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec709c3700 1 -- 172.21.15.114:0/2498271109 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa44175d0 msgr2=0x55efa4429bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:12.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec709c3700 1 --2- 172.21.15.114:0/2498271109 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa44175d0 0x55efa4429bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec709c3700 1 -- 172.21.15.114:0/2498271109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55efa43273f0 con 0x55efa441d500 2023-10-18T14:06:12.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec6bfff700 1 --2- 172.21.15.114:0/2498271109 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa44175d0 0x55efa4429bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:12.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec709c3700 1 --2- 172.21.15.114:0/2498271109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa4428730 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fec64020950 tx=0x7fec64020d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76318fd906f16135 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:12.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.814+0000 7fec4b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:06:12.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec4b7fe700 1 -- 172.21.15.114:0/2498271109 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6400e070 con 0x55efa441d500 2023-10-18T14:06:12.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec7e60fb80 1 -- 172.21.15.114:0/2498271109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fec5c0054e0 con 0x55efa441d500 2023-10-18T14:06:12.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec4b7fe700 1 -- 172.21.15.114:0/2498271109 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fec64039080 con 0x55efa441d500 2023-10-18T14:06:12.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec4b7fe700 1 -- 172.21.15.114:0/2498271109 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec64003ce0 con 0x55efa441d500 2023-10-18T14:06:12.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec7e60fb80 10 client.16320 fetch_fsmap learned FSMap version 32 2023-10-18T14:06:12.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec7e60fb80 1 -- 172.21.15.114:0/2498271109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55efa41bb250 con 0x55efa441d500 2023-10-18T14:06:12.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec4b7fe700 1 -- 172.21.15.114:0/2498271109 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec5c0054e0 con 0x55efa441d500 2023-10-18T14:06:12.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec4b7fe700 1 -- 172.21.15.114:0/2498271109 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 32) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fec64005580 con 0x55efa441d500 2023-10-18T14:06:12.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec7e60fb80 10 client.16320 fetch_fsmap finished waiting for FSMap version 32 2023-10-18T14:06:12.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec7e60fb80 10 client.16320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:06:12.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec7e60fb80 20 client.16320 populate_metadata read hostname 'smithi114' 2023-10-18T14:06:12.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/2498271109 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55efa4486250 0x55efa4488670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:12.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec7e60fb80 4 client.16320 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:06:12.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.815+0000 7fec7e60fb80 1 -- 172.21.15.114:0/2498271109 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55efa4362e50 con 0x55efa4486250 2023-10-18T14:06:12.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.816+0000 7fec6bfff700 1 --2- 172.21.15.114:0/2498271109 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55efa4486250 0x55efa4488670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:12.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.816+0000 7fec4b7fe700 10 client.16320 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:12.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.816+0000 7fec6bfff700 1 --2- 172.21.15.114:0/2498271109 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55efa4486250 0x55efa4488670 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=755d508fad34ba42 server_cookie=30cd5bf7316cafd in_seq=0 out_seq=0 2023-10-18T14:06:12.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.816+0000 7fec4b7fe700 1 -- 172.21.15.114:0/2498271109 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55efa4362e50 con 0x55efa4486250 2023-10-18T14:06:12.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.816+0000 7fec4b7fe700 10 client.16320 handle_command_reply: tid=0 2023-10-18T14:06:12.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.816+0000 7fec7e60fb80 1 client.16320 shutdown 2023-10-18T14:06:12.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.816+0000 7fec7e60fb80 1 -- 172.21.15.114:0/2498271109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 msgr2=0x55efa4428730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:12.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.816+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/2498271109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa4428730 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fec64020950 tx=0x7fec64020d70 comp rx=0 tx=0).stop 2023-10-18T14:06:12.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.816+0000 7fec7e60fb80 1 -- 172.21.15.114:0/2498271109 shutdown_connections 2023-10-18T14:06:12.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/2498271109 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55efa4486250 0x55efa4488670 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/2498271109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55efa441d500 0x55efa4428730 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/2498271109 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55efa44175d0 0x55efa4429bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec4b7fe700 0 client.16320 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:12.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec7e60fb80 1 --2- 172.21.15.114:0/2498271109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55efa441cbe0 0x55efa44281f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec7e60fb80 1 -- 172.21.15.114:0/2498271109 >> 172.21.15.114:0/2498271109 conn(0x55efa438b720 msgr2=0x55efa4418a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:12.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec7e60fb80 1 -- 172.21.15.114:0/2498271109 shutdown_connections 2023-10-18T14:06:12.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec7e60fb80 1 -- 172.21.15.114:0/2498271109 wait complete. 2023-10-18T14:06:12.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec7e60fb80 20 client.16320 trim_cache size 0 max 16384 2023-10-18T14:06:12.834 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:06:12.834 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-18T14:06:12.835 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": { 2023-10-18T14:06:12.835 INFO:teuthology.orchestra.run.smithi114.stdout: "94d18228-30fd-45a0-94d1-b2bec5a6db1a": { 2023-10-18T14:06:12.835 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/", 2023-10-18T14:06:12.835 INFO:teuthology.orchestra.run.smithi114.stdout: "tag": "94d18228-30fd-45a0-94d1-b2bec5a6db1a", 2023-10-18T14:06:12.835 INFO:teuthology.orchestra.run.smithi114.stdout: "options": "recursive,force" 2023-10-18T14:06:12.836 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:06:12.836 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:06:12.836 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:06:12.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec72426700 1 -- 172.21.15.114:0/2325070369 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fec540a15f0 msgr2=0x7fec540a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:12.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec72426700 1 --2- 172.21.15.114:0/2325070369 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fec540a15f0 0x7fec540a3ab0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fec64009610 tx=0x7fec640092e0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec72426700 1 -- 172.21.15.114:0/2325070369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec6c100290 msgr2=0x7fec6c19bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:12.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec72426700 1 --2- 172.21.15.114:0/2325070369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec6c100290 0x7fec6c19bee0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fec6000d750 tx=0x7fec6000da60 comp rx=0 tx=0).stop 2023-10-18T14:06:12.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec72426700 1 -- 172.21.15.114:0/2325070369 shutdown_connections 2023-10-18T14:06:12.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec72426700 1 --2- 172.21.15.114:0/2325070369 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fec540a15f0 0x7fec540a3ab0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec72426700 1 --2- 172.21.15.114:0/2325070369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec6c101640 0x7fec6c195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec72426700 1 --2- 172.21.15.114:0/2325070369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fec6c0ff8f0 0x7fec6c19b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec72426700 1 --2- 172.21.15.114:0/2325070369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec6c100290 0x7fec6c19bee0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:12.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.817+0000 7fec72426700 1 -- 172.21.15.114:0/2325070369 >> 172.21.15.114:0/2325070369 conn(0x7fec6c077570 msgr2=0x7fec6c1068c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:12.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.819+0000 7fec72426700 1 -- 172.21.15.114:0/2325070369 shutdown_connections 2023-10-18T14:06:12.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:12.819+0000 7fec72426700 1 -- 172.21.15.114:0/2325070369 wait complete. 2023-10-18T14:06:12.840 INFO:tasks.cephfs.filesystem:scrub status for tag:94d18228-30fd-45a0-94d1-b2bec5a6db1a - {'path': '/', 'tag': '94d18228-30fd-45a0-94d1-b2bec5a6db1a', 'options': 'recursive,force'} 2023-10-18T14:06:13.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:12 smithi158 ceph-mon[103317]: pgmap v345: 97 pgs: 97 active+clean; 42 MiB data, 651 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 619 op/s 2023-10-18T14:06:13.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:12 smithi172 ceph-mon[103574]: pgmap v345: 97 pgs: 97 active+clean; 42 MiB data, 651 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 619 op/s 2023-10-18T14:06:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:12 smithi114 ceph-mon[99494]: pgmap v345: 97 pgs: 97 active+clean; 42 MiB data, 651 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 619 op/s 2023-10-18T14:06:14.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:14 smithi114 ceph-mon[99494]: pgmap v346: 97 pgs: 97 active+clean; 37 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.8 MiB/s wr, 859 op/s 2023-10-18T14:06:14.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:14 smithi158 ceph-mon[103317]: pgmap v346: 97 pgs: 97 active+clean; 37 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.8 MiB/s wr, 859 op/s 2023-10-18T14:06:14.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:14 smithi172 ceph-mon[103574]: pgmap v346: 97 pgs: 97 active+clean; 37 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.8 MiB/s wr, 859 op/s 2023-10-18T14:06:16.908 INFO:tasks.workunit.client.0.smithi114.stdout:30000 trunc from 0xf3838 to 0x7d16c 2023-10-18T14:06:17.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:16 smithi158 ceph-mon[103317]: pgmap v347: 97 pgs: 97 active+clean; 37 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 561 op/s 2023-10-18T14:06:17.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:16 smithi172 ceph-mon[103574]: pgmap v347: 97 pgs: 97 active+clean; 37 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 561 op/s 2023-10-18T14:06:17.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:16 smithi114 ceph-mon[99494]: pgmap v347: 97 pgs: 97 active+clean; 37 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 561 op/s 2023-10-18T14:06:19.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:18 smithi158 ceph-mon[103317]: pgmap v348: 97 pgs: 97 active+clean; 38 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 566 op/s 2023-10-18T14:06:19.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:18 smithi172 ceph-mon[103574]: pgmap v348: 97 pgs: 97 active+clean; 38 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 566 op/s 2023-10-18T14:06:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:18 smithi114 ceph-mon[99494]: pgmap v348: 97 pgs: 97 active+clean; 38 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 566 op/s 2023-10-18T14:06:21.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:20 smithi158 ceph-mon[103317]: pgmap v349: 97 pgs: 97 active+clean; 41 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 760 op/s 2023-10-18T14:06:21.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:20 smithi172 ceph-mon[103574]: pgmap v349: 97 pgs: 97 active+clean; 41 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 760 op/s 2023-10-18T14:06:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:20 smithi114 ceph-mon[99494]: pgmap v349: 97 pgs: 97 active+clean; 41 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 760 op/s 2023-10-18T14:06:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.537+0000 7fc0bfe5c700 1 -- 172.21.15.114:0/3544323122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0b81010a0 msgr2=0x7fc0b810d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.537+0000 7fc0bfe5c700 1 --2- 172.21.15.114:0/3544323122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0b81010a0 0x7fc0b810d5b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000b0a0 tx=0x7fc0b000b3b0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.537+0000 7fc0bfe5c700 1 -- 172.21.15.114:0/3544323122 shutdown_connections 2023-10-18T14:06:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.537+0000 7fc0bfe5c700 1 --2- 172.21.15.114:0/3544323122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0b81010a0 0x7fc0b810d5b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.537+0000 7fc0bfe5c700 1 --2- 172.21.15.114:0/3544323122 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0b81066f0 0x7fc0b8106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.537+0000 7fc0bfe5c700 1 --2- 172.21.15.114:0/3544323122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0b81006e0 0x7fc0b8100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.537+0000 7fc0bfe5c700 1 -- 172.21.15.114:0/3544323122 >> 172.21.15.114:0/3544323122 conn(0x7fc0b80fc1f0 msgr2=0x7fc0b80fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:21.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.537+0000 7fc0bfe5c700 1 -- 172.21.15.114:0/3544323122 shutdown_connections 2023-10-18T14:06:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.537+0000 7fc0bfe5c700 1 -- 172.21.15.114:0/3544323122 wait complete. 2023-10-18T14:06:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bfe5c700 1 Processor -- start 2023-10-18T14:06:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bfe5c700 1 -- start start 2023-10-18T14:06:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bfe5c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0b81006e0 0x7fc0b8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bfe5c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0b81010a0 0x7fc0b8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bfe5c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0b81066f0 0x7fc0b8073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bfe5c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b81a4e10 con 0x7fc0b81010a0 2023-10-18T14:06:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bfe5c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b81a4f80 con 0x7fc0b81006e0 2023-10-18T14:06:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bfe5c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b81a5140 con 0x7fc0b81066f0 2023-10-18T14:06:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bd3f7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0b81010a0 0x7fc0b8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bdbf8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0b81006e0 0x7fc0b8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bd3f7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0b81010a0 0x7fc0b8073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45846/0 (socket says 172.21.15.114:45846) 2023-10-18T14:06:21.558 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bd3f7700 1 -- 172.21.15.114:0/2685337071 learned_addr learned my addr 172.21.15.114:0/2685337071 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:21.558 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0be3f9700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0b81066f0 0x7fc0b8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.558 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bd3f7700 1 -- 172.21.15.114:0/2685337071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0b81066f0 msgr2=0x7fc0b8073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:21.558 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bd3f7700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0b81066f0 0x7fc0b8073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.558 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bd3f7700 1 -- 172.21.15.114:0/2685337071 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0b81006e0 msgr2=0x7fc0b8072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bd3f7700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0b81006e0 0x7fc0b8072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bd3f7700 1 -- 172.21.15.114:0/2685337071 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b0009d00 con 0x7fc0b81010a0 2023-10-18T14:06:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.538+0000 7fc0bdbf8700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0b81006e0 0x7fc0b8072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.539+0000 7fc0bd3f7700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0b81010a0 0x7fc0b8073030 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800d980 tx=0x7fc0a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.539+0000 7fc0aeffd700 1 -- 172.21.15.114:0/2685337071 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8004220 con 0x7fc0b81010a0 2023-10-18T14:06:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.539+0000 7fc0bfe5c700 1 -- 172.21.15.114:0/2685337071 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b81a5420 con 0x7fc0b81010a0 2023-10-18T14:06:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.539+0000 7fc0aeffd700 1 -- 172.21.15.114:0/2685337071 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0a8007640 con 0x7fc0b81010a0 2023-10-18T14:06:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.539+0000 7fc0aeffd700 1 -- 172.21.15.114:0/2685337071 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8005690 con 0x7fc0b81010a0 2023-10-18T14:06:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.539+0000 7fc0bfe5c700 1 -- 172.21.15.114:0/2685337071 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b81a5980 con 0x7fc0b81010a0 2023-10-18T14:06:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.541+0000 7fc0aeffd700 1 -- 172.21.15.114:0/2685337071 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fc0a8004750 con 0x7fc0b81010a0 2023-10-18T14:06:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.542+0000 7fc0aeffd700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc0a40a15f0 0x7fc0a40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.542+0000 7fc0bdbf8700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc0a40a15f0 0x7fc0a40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.542+0000 7fc0aeffd700 1 -- 172.21.15.114:0/2685337071 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc0a80cce20 con 0x7fc0b81010a0 2023-10-18T14:06:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.542+0000 7fc0bdbf8700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc0a40a15f0 0x7fc0a40a3ab0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009fd0 tx=0x7fc0b4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.543+0000 7fc0cc045b80 1 Processor -- start 2023-10-18T14:06:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.543+0000 7fc0cc045b80 1 -- start start 2023-10-18T14:06:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.543+0000 7fc0cc045b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6630 0x55dc3cbc6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.543+0000 7fc0cc045b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbc0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.543+0000 7fc0cc045b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc1410 0x55dc3cbc1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.543+0000 7fc0cc045b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cb34680 con 0x55dc3cbc6f50 2023-10-18T14:06:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.543+0000 7fc0cc045b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cb1ac00 con 0x55dc3cbc6630 2023-10-18T14:06:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.543+0000 7fc0cc045b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cb18520 con 0x55dc3cbc1410 2023-10-18T14:06:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0bdbf8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6630 0x55dc3cbc6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0bd3f7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbc0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0bdbf8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6630 0x55dc3cbc6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:41996/0 (socket says 172.21.15.114:41996) 2023-10-18T14:06:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0bdbf8700 1 -- 172.21.15.114:0/1740132237 learned_addr learned my addr 172.21.15.114:0/1740132237 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0be3f9700 1 --2- 172.21.15.114:0/1740132237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc1410 0x55dc3cbc1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0bdbf8700 1 -- 172.21.15.114:0/1740132237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc1410 msgr2=0x55dc3cbc1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0bdbf8700 1 --2- 172.21.15.114:0/1740132237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc1410 0x55dc3cbc1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0bdbf8700 1 -- 172.21.15.114:0/1740132237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6f50 msgr2=0x55dc3cbc0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0bdbf8700 1 --2- 172.21.15.114:0/1740132237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbc0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0bdbf8700 1 -- 172.21.15.114:0/1740132237 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc3cad1390 con 0x55dc3cbc6630 2023-10-18T14:06:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0bd3f7700 1 --2- 172.21.15.114:0/1740132237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbc0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0bdbf8700 1 --2- 172.21.15.114:0/1740132237 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6630 0x55dc3cbc6a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400e720 tx=0x7fc0b4014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d66423eab7570f55 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0a3fff700 1 -- 172.21.15.114:0/1740132237 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4026600 con 0x55dc3cbc6630 2023-10-18T14:06:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0a3fff700 1 -- 172.21.15.114:0/1740132237 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0b4026c20 con 0x55dc3cbc6630 2023-10-18T14:06:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.544+0000 7fc0a3fff700 1 -- 172.21.15.114:0/1740132237 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b401eb10 con 0x55dc3cbc6630 2023-10-18T14:06:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.545+0000 7fc0cc045b80 1 -- 172.21.15.114:0/1740132237 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6630 msgr2=0x55dc3cbc6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.545+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/1740132237 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6630 0x55dc3cbc6a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400e720 tx=0x7fc0b4014000 comp rx=0 tx=0).stop 2023-10-18T14:06:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.545+0000 7fc0cc045b80 1 -- 172.21.15.114:0/1740132237 shutdown_connections 2023-10-18T14:06:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.545+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/1740132237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc1410 0x55dc3cbc1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.545+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/1740132237 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6630 0x55dc3cbc6a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.545+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/1740132237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbc0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.545+0000 7fc0cc045b80 1 -- 172.21.15.114:0/1740132237 >> 172.21.15.114:0/1740132237 conn(0x55dc3cb356c0 msgr2=0x55dc3cbbb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.545+0000 7fc0cc045b80 1 -- 172.21.15.114:0/1740132237 shutdown_connections 2023-10-18T14:06:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.545+0000 7fc0cc045b80 1 -- 172.21.15.114:0/1740132237 wait complete. 2023-10-18T14:06:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.545+0000 7fc0cc045b80 1 -- start start 2023-10-18T14:06:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0cc045b80 1 Processor -- start 2023-10-18T14:06:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0cc045b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc1410 0x55dc3cbcced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0cc045b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc6630 0x55dc3cbca260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0cc045b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0cc045b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cb13e10 con 0x55dc3cbc1410 2023-10-18T14:06:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0cc045b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cab06b0 con 0x55dc3cbc6f50 2023-10-18T14:06:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0cc045b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cab0350 con 0x55dc3cbc6630 2023-10-18T14:06:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0cc045b80 10 client.0 _ll_register_callbacks cb 0x55dc3c9faa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:06:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0bd3f7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc6630 0x55dc3cbca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0bdbf8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc1410 0x55dc3cbcced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0bd3f7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc6630 0x55dc3cbca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49796/0 (socket says 172.21.15.114:49796) 2023-10-18T14:06:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0bd3f7700 1 -- 172.21.15.114:0/619957867 learned_addr learned my addr 172.21.15.114:0/619957867 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0be3f9700 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0bdbf8700 1 -- 172.21.15.114:0/619957867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc6630 msgr2=0x55dc3cbca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.546+0000 7fc0bdbf8700 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc6630 0x55dc3cbca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0bdbf8700 1 -- 172.21.15.114:0/619957867 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6f50 msgr2=0x55dc3cbca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0bdbf8700 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0bdbf8700 1 -- 172.21.15.114:0/619957867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b81a5980 con 0x55dc3cbc1410 2023-10-18T14:06:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0bd3f7700 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc6630 0x55dc3cbca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0be3f9700 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0bdbf8700 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc1410 0x55dc3cbcced0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400ed10 tx=0x7fc0b4005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67d67f6ec78cb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:21.573 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:06:21.573 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0a17fa700 1 -- 172.21.15.114:0/619957867 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b402c070 con 0x55dc3cbc1410 2023-10-18T14:06:21.573 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0a17fa700 1 -- 172.21.15.114:0/619957867 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc0b4026400 con 0x55dc3cbc1410 2023-10-18T14:06:21.573 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0cc045b80 1 -- 172.21.15.114:0/619957867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc3cb18e90 con 0x55dc3cbc1410 2023-10-18T14:06:21.573 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0a17fa700 1 -- 172.21.15.114:0/619957867 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0b40265c0 con 0x55dc3cbc1410 2023-10-18T14:06:21.573 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0cc045b80 10 client.16332 fetch_fsmap learned FSMap version 32 2023-10-18T14:06:21.574 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0cc045b80 1 -- 172.21.15.114:0/619957867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fc0b4017070 con 0x55dc3cbc1410 2023-10-18T14:06:21.574 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0a17fa700 1 -- 172.21.15.114:0/619957867 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dc3cb18e90 con 0x55dc3cbc1410 2023-10-18T14:06:21.574 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.547+0000 7fc0a17fa700 1 -- 172.21.15.114:0/619957867 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 32) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fc0b4024020 con 0x55dc3cbc1410 2023-10-18T14:06:21.574 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.548+0000 7fc0cc045b80 10 client.16332 fetch_fsmap finished waiting for FSMap version 32 2023-10-18T14:06:21.575 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.548+0000 7fc0cc045b80 10 client.16332 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:06:21.575 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.548+0000 7fc0cc045b80 20 client.16332 populate_metadata read hostname 'smithi114' 2023-10-18T14:06:21.575 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.548+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dc3cbda8d0 0x55dc3cbdccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.575 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.548+0000 7fc0cc045b80 4 client.16332 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:06:21.575 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.548+0000 7fc0cc045b80 1 -- 172.21.15.114:0/619957867 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc3cb90850 con 0x55dc3cbda8d0 2023-10-18T14:06:21.576 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.548+0000 7fc0bd3f7700 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dc3cbda8d0 0x55dc3cbdccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.576 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.548+0000 7fc0a17fa700 10 client.16332 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:21.576 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.548+0000 7fc0bd3f7700 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dc3cbda8d0 0x55dc3cbdccf0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6448c2f239050eb server_cookie=d3b05a146f15f10e in_seq=0 out_seq=0 2023-10-18T14:06:21.576 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.549+0000 7fc0a17fa700 1 -- 172.21.15.114:0/619957867 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dc3cb90850 con 0x55dc3cbda8d0 2023-10-18T14:06:21.577 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.549+0000 7fc0a17fa700 10 client.16332 handle_command_reply: tid=0 2023-10-18T14:06:21.577 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.549+0000 7fc0cc045b80 1 client.16332 shutdown 2023-10-18T14:06:21.577 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.549+0000 7fc0cc045b80 1 -- 172.21.15.114:0/619957867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc1410 msgr2=0x55dc3cbcced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:21.577 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.549+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc1410 0x55dc3cbcced0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400ed10 tx=0x7fc0b4005550 comp rx=0 tx=0).stop 2023-10-18T14:06:21.578 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.549+0000 7fc0cc045b80 1 -- 172.21.15.114:0/619957867 shutdown_connections 2023-10-18T14:06:21.578 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.550+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dc3cbda8d0 0x55dc3cbdccf0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.578 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.550+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.578 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.550+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc1410 0x55dc3cbcced0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.578 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.550+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/619957867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc6630 0x55dc3cbca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.579 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.550+0000 7fc0a17fa700 0 client.16332 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:21.579 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.550+0000 7fc0cc045b80 1 -- 172.21.15.114:0/619957867 >> 172.21.15.114:0/619957867 conn(0x55dc3cb356c0 msgr2=0x55dc3cbbad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:21.579 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.550+0000 7fc0cc045b80 1 -- 172.21.15.114:0/619957867 shutdown_connections 2023-10-18T14:06:21.579 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.550+0000 7fc0cc045b80 1 -- 172.21.15.114:0/619957867 wait complete. 2023-10-18T14:06:21.579 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.550+0000 7fc0cc045b80 20 client.16332 trim_cache size 0 max 16384 2023-10-18T14:06:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0cc045b80 1 Processor -- start 2023-10-18T14:06:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0cc045b80 1 -- start start 2023-10-18T14:06:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0cc045b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc1410 0x55dc3cbc0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0cc045b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6630 0x55dc3cbd1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0cc045b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbbb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0cc045b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3c9948c0 con 0x55dc3cbc6f50 2023-10-18T14:06:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0cc045b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cbcd4f0 con 0x55dc3cbc6630 2023-10-18T14:06:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0cc045b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cbb6d80 con 0x55dc3cbc1410 2023-10-18T14:06:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0be3f9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbbb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0bdbf8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc1410 0x55dc3cbc0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0be3f9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbbb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45868/0 (socket says 172.21.15.114:45868) 2023-10-18T14:06:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0be3f9700 1 -- 172.21.15.114:0/661958894 learned_addr learned my addr 172.21.15.114:0/661958894 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0bd3f7700 1 --2- 172.21.15.114:0/661958894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6630 0x55dc3cbd1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0be3f9700 1 -- 172.21.15.114:0/661958894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc1410 msgr2=0x55dc3cbc0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0be3f9700 1 --2- 172.21.15.114:0/661958894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc1410 0x55dc3cbc0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0be3f9700 1 -- 172.21.15.114:0/661958894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6630 msgr2=0x55dc3cbd1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0be3f9700 1 --2- 172.21.15.114:0/661958894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6630 0x55dc3cbd1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.568+0000 7fc0be3f9700 1 -- 172.21.15.114:0/661958894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc3cbc1ac0 con 0x55dc3cbc6f50 2023-10-18T14:06:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.569+0000 7fc0be3f9700 1 --2- 172.21.15.114:0/661958894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbbb4e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000bbc0 tx=0x7fc0b000bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01c5b99eb1610f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.569+0000 7fc0acff9700 1 -- 172.21.15.114:0/661958894 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b000e040 con 0x55dc3cbc6f50 2023-10-18T14:06:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.569+0000 7fc0acff9700 1 -- 172.21.15.114:0/661958894 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0b0007e90 con 0x55dc3cbc6f50 2023-10-18T14:06:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.569+0000 7fc0acff9700 1 -- 172.21.15.114:0/661958894 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0005400 con 0x55dc3cbc6f50 2023-10-18T14:06:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.570+0000 7fc0cc045b80 1 -- 172.21.15.114:0/661958894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6f50 msgr2=0x55dc3cbbb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.570+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/661958894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbbb4e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000bbc0 tx=0x7fc0b000bbf0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.570+0000 7fc0cc045b80 1 -- 172.21.15.114:0/661958894 shutdown_connections 2023-10-18T14:06:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.570+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/661958894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6f50 0x55dc3cbbb4e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.570+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/661958894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc1410 0x55dc3cbc0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.570+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/661958894 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc6630 0x55dc3cbd1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.570+0000 7fc0cc045b80 1 -- 172.21.15.114:0/661958894 >> 172.21.15.114:0/661958894 conn(0x55dc3cb356c0 msgr2=0x55dc3cbc8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.570+0000 7fc0cc045b80 1 -- 172.21.15.114:0/661958894 shutdown_connections 2023-10-18T14:06:21.591 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.570+0000 7fc0cc045b80 1 -- 172.21.15.114:0/661958894 wait complete. 2023-10-18T14:06:21.591 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.570+0000 7fc0cc045b80 1 -- start start 2023-10-18T14:06:21.591 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.570+0000 7fc0cc045b80 1 Processor -- start 2023-10-18T14:06:21.591 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0cc045b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc1410 0x55dc3cbcfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.591 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0cc045b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6630 0x55dc3cbd0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.592 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0cc045b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc6f50 0x55dc3cc2d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.592 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0cc045b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cc2dc00 con 0x55dc3cbc6630 2023-10-18T14:06:21.592 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0cc045b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cc2dd40 con 0x55dc3cbc1410 2023-10-18T14:06:21.592 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0cc045b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cc2de80 con 0x55dc3cbc6f50 2023-10-18T14:06:21.592 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0cc045b80 10 client.0 _ll_register_callbacks cb 0x55dc3c9faa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:06:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0bd3f7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6630 0x55dc3cbd0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0bd3f7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6630 0x55dc3cbd0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45874/0 (socket says 172.21.15.114:45874) 2023-10-18T14:06:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0bd3f7700 1 -- 172.21.15.114:0/1670857462 learned_addr learned my addr 172.21.15.114:0/1670857462 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0be3f9700 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc6f50 0x55dc3cc2d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0bdbf8700 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc1410 0x55dc3cbcfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0bd3f7700 1 -- 172.21.15.114:0/1670857462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc6f50 msgr2=0x55dc3cc2d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0bd3f7700 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc6f50 0x55dc3cc2d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0bd3f7700 1 -- 172.21.15.114:0/1670857462 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc1410 msgr2=0x55dc3cbcfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0bd3f7700 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc1410 0x55dc3cbcfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0bd3f7700 1 -- 172.21.15.114:0/1670857462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b810deb0 con 0x55dc3cbc6630 2023-10-18T14:06:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.571+0000 7fc0be3f9700 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc6f50 0x55dc3cc2d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0bd3f7700 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6630 0x55dc3cbd0040 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8017000 tx=0x7fc0a8005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eef5e988e9a1506 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:06:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0a17fa700 1 -- 172.21.15.114:0/1670857462 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a80b8070 con 0x55dc3cbc6630 2023-10-18T14:06:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0a17fa700 1 -- 172.21.15.114:0/1670857462 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fc0a80982e0 con 0x55dc3cbc6630 2023-10-18T14:06:21.596 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0cc045b80 1 -- 172.21.15.114:0/1670857462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc0b4026c20 con 0x55dc3cbc6630 2023-10-18T14:06:21.596 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0a17fa700 1 -- 172.21.15.114:0/1670857462 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0a809a2e0 con 0x55dc3cbc6630 2023-10-18T14:06:21.596 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0cc045b80 10 client.16338 fetch_fsmap learned FSMap version 32 2023-10-18T14:06:21.596 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0cc045b80 1 -- 172.21.15.114:0/1670857462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55dc3c93ed80 con 0x55dc3cbc6630 2023-10-18T14:06:21.596 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0a17fa700 1 -- 172.21.15.114:0/1670857462 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0a807c020 con 0x55dc3cbc6630 2023-10-18T14:06:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0a17fa700 1 -- 172.21.15.114:0/1670857462 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 32) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fc0a8098de0 con 0x55dc3cbc6630 2023-10-18T14:06:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0cc045b80 10 client.16338 fetch_fsmap finished waiting for FSMap version 32 2023-10-18T14:06:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0cc045b80 10 client.16338 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:06:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0cc045b80 20 client.16338 populate_metadata read hostname 'smithi114' 2023-10-18T14:06:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dc3cc2f5c0 0x55dc3cc319e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0cc045b80 4 client.16338 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:06:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0cc045b80 1 -- 172.21.15.114:0/1670857462 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dc3cb0cdf0 con 0x55dc3cc2f5c0 2023-10-18T14:06:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.572+0000 7fc0bdbf8700 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dc3cc2f5c0 0x55dc3cc319e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.573+0000 7fc0a17fa700 10 client.16338 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:21.599 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.573+0000 7fc0bdbf8700 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dc3cc2f5c0 0x55dc3cc319e0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afce12efc5450ae6 server_cookie=534092e21bd7849 in_seq=0 out_seq=0 2023-10-18T14:06:21.604 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.600+0000 7fc0a17fa700 1 -- 172.21.15.114:0/1670857462 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dc3cb0cdf0 con 0x55dc3cc2f5c0 2023-10-18T14:06:21.604 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.600+0000 7fc0a17fa700 10 client.16338 handle_command_reply: tid=0 2023-10-18T14:06:21.604 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.600+0000 7fc0cc045b80 1 client.16338 shutdown 2023-10-18T14:06:21.605 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.600+0000 7fc0cc045b80 1 -- 172.21.15.114:0/1670857462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6630 msgr2=0x55dc3cbd0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:21.605 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.600+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6630 0x55dc3cbd0040 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8017000 tx=0x7fc0a8005810 comp rx=0 tx=0).stop 2023-10-18T14:06:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0cc045b80 1 -- 172.21.15.114:0/1670857462 shutdown_connections 2023-10-18T14:06:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dc3cc2f5c0 0x55dc3cc319e0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cbc6f50 0x55dc3cc2d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.608 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cbc1410 0x55dc3cbcfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.608 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0a17fa700 0 client.16338 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:21.608 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0cc045b80 1 --2- 172.21.15.114:0/1670857462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cbc6630 0x55dc3cbd0040 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.608 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0cc045b80 1 -- 172.21.15.114:0/1670857462 >> 172.21.15.114:0/1670857462 conn(0x55dc3cb356c0 msgr2=0x55dc3cbcba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:21.608 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0cc045b80 1 -- 172.21.15.114:0/1670857462 shutdown_connections 2023-10-18T14:06:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0cc045b80 1 -- 172.21.15.114:0/1670857462 wait complete. 2023-10-18T14:06:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0cc045b80 20 client.16338 trim_cache size 0 max 16384 2023-10-18T14:06:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:06:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:06:21.610 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:06:21.610 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:06:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0bfe5c700 1 -- 172.21.15.114:0/2685337071 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc0a40a15f0 msgr2=0x7fc0a40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0bfe5c700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc0a40a15f0 0x7fc0a40a3ab0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009fd0 tx=0x7fc0b4009260 comp rx=0 tx=0).stop 2023-10-18T14:06:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0bfe5c700 1 -- 172.21.15.114:0/2685337071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0b81010a0 msgr2=0x7fc0b8073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0bfe5c700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0b81010a0 0x7fc0b8073030 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800d980 tx=0x7fc0a800dc90 comp rx=0 tx=0).stop 2023-10-18T14:06:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0bfe5c700 1 -- 172.21.15.114:0/2685337071 shutdown_connections 2023-10-18T14:06:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0bfe5c700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fc0a40a15f0 0x7fc0a40a3ab0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0bfe5c700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0b81066f0 0x7fc0b8073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0bfe5c700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc0b81006e0 0x7fc0b8072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0bfe5c700 1 --2- 172.21.15.114:0/2685337071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0b81010a0 0x7fc0b8073030 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.603+0000 7fc0bfe5c700 1 -- 172.21.15.114:0/2685337071 >> 172.21.15.114:0/2685337071 conn(0x7fc0b80fc1f0 msgr2=0x7fc0b80fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.604+0000 7fc0bfe5c700 1 -- 172.21.15.114:0/2685337071 shutdown_connections 2023-10-18T14:06:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:21.604+0000 7fc0bfe5c700 1 -- 172.21.15.114:0/2685337071 wait complete. 2023-10-18T14:06:22.310 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:06:21 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-l[142401]: ignoring --setuser ceph since I am not root 2023-10-18T14:06:22.310 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:06:21 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-l[142401]: ignoring --setgroup ceph since I am not root 2023-10-18T14:06:22.310 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:06:21 smithi172 ceph-mds[142425]: -- 172.21.15.172:0/3409996663 <== mon.2 v2:172.21.15.158:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56190b66b1e0 con 0x56190b640800 2023-10-18T14:06:22.310 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:06:21 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-l[142401]: starting mds.l at 2023-10-18T14:06:23.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:22 smithi158 ceph-mon[103317]: pgmap v350: 97 pgs: 97 active+clean; 41 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 528 op/s 2023-10-18T14:06:23.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:22 smithi158 ceph-mon[103317]: daemon mds.l restarted 2023-10-18T14:06:23.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:22 smithi172 ceph-mon[103574]: pgmap v350: 97 pgs: 97 active+clean; 41 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 528 op/s 2023-10-18T14:06:23.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:22 smithi172 ceph-mon[103574]: daemon mds.l restarted 2023-10-18T14:06:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:22 smithi114 ceph-mon[99494]: pgmap v350: 97 pgs: 97 active+clean; 41 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 528 op/s 2023-10-18T14:06:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:22 smithi114 ceph-mon[99494]: daemon mds.l restarted 2023-10-18T14:06:24.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:23 smithi158 ceph-mon[103317]: osdmap e86: 12 total, 12 up, 12 in 2023-10-18T14:06:24.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:23 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6832/1399361838,v1:172.21.15.172:6833/1399361838] up:boot 2023-10-18T14:06:24.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:23 smithi158 ceph-mon[103317]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-18T14:06:24.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:23 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-18T14:06:24.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:23 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:06:24.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:23 smithi172 ceph-mon[103574]: osdmap e86: 12 total, 12 up, 12 in 2023-10-18T14:06:24.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:23 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6832/1399361838,v1:172.21.15.172:6833/1399361838] up:boot 2023-10-18T14:06:24.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:23 smithi172 ceph-mon[103574]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-18T14:06:24.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:23 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-18T14:06:24.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:23 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:06:24.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:23 smithi114 ceph-mon[99494]: osdmap e86: 12 total, 12 up, 12 in 2023-10-18T14:06:24.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:23 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6832/1399361838,v1:172.21.15.172:6833/1399361838] up:boot 2023-10-18T14:06:24.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:23 smithi114 ceph-mon[99494]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-18T14:06:24.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:23 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-18T14:06:24.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:23 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:06:25.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:24 smithi158 ceph-mon[103317]: pgmap v352: 97 pgs: 97 active+clean; 37 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 574 op/s 2023-10-18T14:06:25.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:24 smithi172 ceph-mon[103574]: pgmap v352: 97 pgs: 97 active+clean; 37 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 574 op/s 2023-10-18T14:06:25.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:24 smithi114 ceph-mon[99494]: pgmap v352: 97 pgs: 97 active+clean; 37 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 574 op/s 2023-10-18T14:06:27.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:26 smithi158 ceph-mon[103317]: pgmap v353: 97 pgs: 97 active+clean; 38 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 567 op/s 2023-10-18T14:06:27.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:26 smithi172 ceph-mon[103574]: pgmap v353: 97 pgs: 97 active+clean; 38 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 567 op/s 2023-10-18T14:06:27.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:26 smithi114 ceph-mon[99494]: pgmap v353: 97 pgs: 97 active+clean; 38 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 567 op/s 2023-10-18T14:06:28.298 INFO:tasks.workunit.client.0.smithi114.stdout:40000 copy from 0x5dfcb to 0x607bc, (0x27f1 bytes) at 0xf5933 2023-10-18T14:06:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:28 smithi158 ceph-mon[103317]: pgmap v354: 97 pgs: 97 active+clean; 38 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 564 op/s 2023-10-18T14:06:29.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:28 smithi172 ceph-mon[103574]: pgmap v354: 97 pgs: 97 active+clean; 38 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 564 op/s 2023-10-18T14:06:29.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:28 smithi114 ceph-mon[99494]: pgmap v354: 97 pgs: 97 active+clean; 38 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 564 op/s 2023-10-18T14:06:31.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:30 smithi158 ceph-mon[103317]: pgmap v355: 97 pgs: 97 active+clean; 42 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 504 op/s 2023-10-18T14:06:31.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:30 smithi172 ceph-mon[103574]: pgmap v355: 97 pgs: 97 active+clean; 42 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 504 op/s 2023-10-18T14:06:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:30 smithi114 ceph-mon[99494]: pgmap v355: 97 pgs: 97 active+clean; 42 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 504 op/s 2023-10-18T14:06:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:32 smithi158 ceph-mon[103317]: pgmap v356: 97 pgs: 97 active+clean; 42 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 502 op/s 2023-10-18T14:06:33.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:32 smithi172 ceph-mon[103574]: pgmap v356: 97 pgs: 97 active+clean; 42 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 502 op/s 2023-10-18T14:06:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:32 smithi114 ceph-mon[99494]: pgmap v356: 97 pgs: 97 active+clean; 42 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 502 op/s 2023-10-18T14:06:34.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:34 smithi114 ceph-mon[99494]: pgmap v357: 97 pgs: 97 active+clean; 44 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 634 op/s 2023-10-18T14:06:34.733 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.728+0000 7fd3f1922700 1 -- 172.21.15.114:0/1867578868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3ec0ff970 msgr2=0x7fd3ec1039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:34.733 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.728+0000 7fd3f1922700 1 --2- 172.21.15.114:0/1867578868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3ec0ff970 0x7fd3ec1039b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009990 tx=0x7fd3e0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.733 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.729+0000 7fd3f1922700 1 -- 172.21.15.114:0/1867578868 shutdown_connections 2023-10-18T14:06:34.734 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.729+0000 7fd3f1922700 1 --2- 172.21.15.114:0/1867578868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ec1040e0 0x7fd3ec10bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.734 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.729+0000 7fd3f1922700 1 --2- 172.21.15.114:0/1867578868 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3ec0fefc0 0x7fd3ec0ff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.734 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.729+0000 7fd3f1922700 1 --2- 172.21.15.114:0/1867578868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3ec0ff970 0x7fd3ec1039b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.734 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.729+0000 7fd3f1922700 1 -- 172.21.15.114:0/1867578868 >> 172.21.15.114:0/1867578868 conn(0x7fd3ec075bf0 msgr2=0x7fd3ec0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:34.735 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.729+0000 7fd3f1922700 1 -- 172.21.15.114:0/1867578868 shutdown_connections 2023-10-18T14:06:34.735 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.729+0000 7fd3f1922700 1 -- 172.21.15.114:0/1867578868 wait complete. 2023-10-18T14:06:34.735 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.729+0000 7fd3f1922700 1 Processor -- start 2023-10-18T14:06:34.737 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3f1922700 1 -- start start 2023-10-18T14:06:34.737 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3f1922700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3ec0fefc0 0x7fd3ec198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.737 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3f1922700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3ec1040e0 0x7fd3ec199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.738 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3f1922700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ec19d6c0 0x7fd3ec19db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.738 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3f1922700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec19e140 con 0x7fd3ec1040e0 2023-10-18T14:06:34.738 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3f1922700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec19e2b0 con 0x7fd3ec0fefc0 2023-10-18T14:06:34.738 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3f1922700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec19e470 con 0x7fd3ec19d6c0 2023-10-18T14:06:34.738 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3eb7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ec19d6c0 0x7fd3ec19db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.739 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3eaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3ec0fefc0 0x7fd3ec198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.739 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3ea7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3ec1040e0 0x7fd3ec199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.739 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3eb7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ec19d6c0 0x7fd3ec19db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49824/0 (socket says 172.21.15.114:49824) 2023-10-18T14:06:34.739 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3eaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3ec0fefc0 0x7fd3ec198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42028/0 (socket says 172.21.15.114:42028) 2023-10-18T14:06:34.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3eb7fe700 1 -- 172.21.15.114:0/1602330958 learned_addr learned my addr 172.21.15.114:0/1602330958 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:34.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/1602330958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ec19d6c0 msgr2=0x7fd3ec19db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:34.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/1602330958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ec19d6c0 0x7fd3ec19db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/1602330958 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3ec0fefc0 msgr2=0x7fd3ec198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:34.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/1602330958 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3ec0fefc0 0x7fd3ec198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/1602330958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e00095f0 con 0x7fd3ec1040e0 2023-10-18T14:06:34.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.730+0000 7fd3eaffd700 1 --2- 172.21.15.114:0/1602330958 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3ec0fefc0 0x7fd3ec198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:34.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.731+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/1602330958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3ec1040e0 0x7fd3ec199320 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00098e0 tx=0x7fd3e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:34.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.731+0000 7fd3f0920700 1 -- 172.21.15.114:0/1602330958 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e001d070 con 0x7fd3ec1040e0 2023-10-18T14:06:34.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.731+0000 7fd3f1922700 1 -- 172.21.15.114:0/1602330958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ec1a5970 con 0x7fd3ec1040e0 2023-10-18T14:06:34.742 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.731+0000 7fd3f0920700 1 -- 172.21.15.114:0/1602330958 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3e0022470 con 0x7fd3ec1040e0 2023-10-18T14:06:34.742 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.731+0000 7fd3f0920700 1 -- 172.21.15.114:0/1602330958 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0017650 con 0x7fd3ec1040e0 2023-10-18T14:06:34.742 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.731+0000 7fd3f1922700 1 -- 172.21.15.114:0/1602330958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec1a5df0 con 0x7fd3ec1040e0 2023-10-18T14:06:34.742 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.733+0000 7fd3f0920700 1 -- 172.21.15.114:0/1602330958 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fd3e00225e0 con 0x7fd3ec1040e0 2023-10-18T14:06:34.748 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.734+0000 7fd3f0920700 1 --2- 172.21.15.114:0/1602330958 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3d40a15f0 0x7fd3d40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.748 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.734+0000 7fd3eaffd700 1 --2- 172.21.15.114:0/1602330958 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3d40a15f0 0x7fd3d40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.748 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.734+0000 7fd3f0920700 1 -- 172.21.15.114:0/1602330958 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd3e00ce250 con 0x7fd3ec1040e0 2023-10-18T14:06:34.748 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.734+0000 7fd3eaffd700 1 --2- 172.21.15.114:0/1602330958 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3d40a15f0 0x7fd3d40a3ab0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc011490 tx=0x7fd3dc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.735+0000 7fd3fdb0bb80 1 Processor -- start 2023-10-18T14:06:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.735+0000 7fd3fdb0bb80 1 -- start start 2023-10-18T14:06:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.735+0000 7fd3fdb0bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f6e630 0x5610c3f6ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.735+0000 7fd3fdb0bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 0x5610c3f68ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.735+0000 7fd3fdb0bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f69410 0x5610c3f69870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.735+0000 7fd3fdb0bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c3edc680 con 0x5610c3f69410 2023-10-18T14:06:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.735+0000 7fd3fdb0bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c3ec2c00 con 0x5610c3f6e630 2023-10-18T14:06:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.735+0000 7fd3fdb0bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c3ec0520 con 0x5610c3f6ef50 2023-10-18T14:06:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.735+0000 7fd3eaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f6e630 0x5610c3f6ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.735+0000 7fd3eaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f6e630 0x5610c3f6ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42036/0 (socket says 172.21.15.114:42036) 2023-10-18T14:06:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.735+0000 7fd3ea7fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 0x5610c3f68ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.735+0000 7fd3eaffd700 1 -- 172.21.15.114:0/3656197913 learned_addr learned my addr 172.21.15.114:0/3656197913 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.735+0000 7fd3eb7fe700 1 --2- 172.21.15.114:0/3656197913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f69410 0x5610c3f69870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.736+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/3656197913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f6e630 msgr2=0x5610c3f6ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:34.752 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.736+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/3656197913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f6e630 0x5610c3f6ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.752 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.736+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/3656197913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f69410 msgr2=0x5610c3f69870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:34.752 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.736+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/3656197913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f69410 0x5610c3f69870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.752 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.736+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/3656197913 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610c3e79390 con 0x5610c3f6ef50 2023-10-18T14:06:34.753 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.736+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/3656197913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 0x5610c3f68ed0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00cbab0 tx=0x7fd3e009af10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ceb7ddbbd7b0972 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:34.753 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.736+0000 7fd3d1ffb700 1 -- 172.21.15.114:0/3656197913 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e009b3d0 con 0x5610c3f6ef50 2023-10-18T14:06:34.753 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.736+0000 7fd3d1ffb700 1 -- 172.21.15.114:0/3656197913 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3e009f520 con 0x5610c3f6ef50 2023-10-18T14:06:34.753 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.736+0000 7fd3d1ffb700 1 -- 172.21.15.114:0/3656197913 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e009b630 con 0x5610c3f6ef50 2023-10-18T14:06:34.754 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.737+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/3656197913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 msgr2=0x5610c3f68ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:34.754 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.737+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/3656197913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 0x5610c3f68ed0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00cbab0 tx=0x7fd3e009af10 comp rx=0 tx=0).stop 2023-10-18T14:06:34.754 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.737+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/3656197913 shutdown_connections 2023-10-18T14:06:34.754 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.737+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/3656197913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f69410 0x5610c3f69870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.755 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.737+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/3656197913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f6e630 0x5610c3f6ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.755 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.737+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/3656197913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 0x5610c3f68ed0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.755 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.737+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/3656197913 >> 172.21.15.114:0/3656197913 conn(0x5610c3edd6c0 msgr2=0x5610c3f635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:34.755 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.737+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/3656197913 shutdown_connections 2023-10-18T14:06:34.755 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.737+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/3656197913 wait complete. 2023-10-18T14:06:34.756 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.737+0000 7fd3fdb0bb80 1 -- start start 2023-10-18T14:06:34.756 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3fdb0bb80 1 Processor -- start 2023-10-18T14:06:34.756 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3fdb0bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f69410 0x5610c3f74e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.756 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3fdb0bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f72110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.756 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3fdb0bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f6ef50 0x5610c3f726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3fdb0bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c3ebbe10 con 0x5610c3f6e630 2023-10-18T14:06:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3fdb0bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c3e586b0 con 0x5610c3f6ef50 2023-10-18T14:06:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3fdb0bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c3e58350 con 0x5610c3f69410 2023-10-18T14:06:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3fdb0bb80 10 client.0 _ll_register_callbacks cb 0x5610c3da2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:06:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3ea7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f72110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3eb7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f6ef50 0x5610c3f726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3ea7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f72110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45898/0 (socket says 172.21.15.114:45898) 2023-10-18T14:06:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/1609570182 learned_addr learned my addr 172.21.15.114:0/1609570182 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3eaffd700 1 --2- 172.21.15.114:0/1609570182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f69410 0x5610c3f74e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/1609570182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f69410 msgr2=0x5610c3f74e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/1609570182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f69410 0x5610c3f74e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/1609570182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f6ef50 msgr2=0x5610c3f726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.738+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/1609570182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f6ef50 0x5610c3f726f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.739+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/1609570182 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec1a5df0 con 0x5610c3f6e630 2023-10-18T14:06:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.739+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/1609570182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f72110 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd3e009b360 tx=0x7fd3e009bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6f072032c0d276 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.739+0000 7fd3caffd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:06:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.739+0000 7fd3caffd700 1 -- 172.21.15.114:0/1609570182 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00a36d0 con 0x5610c3f6e630 2023-10-18T14:06:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.739+0000 7fd3caffd700 1 -- 172.21.15.114:0/1609570182 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd3e009f120 con 0x5610c3f6e630 2023-10-18T14:06:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.739+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1609570182 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610c3ec0e90 con 0x5610c3f6e630 2023-10-18T14:06:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.739+0000 7fd3caffd700 1 -- 172.21.15.114:0/1609570182 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3e009f320 con 0x5610c3f6e630 2023-10-18T14:06:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.739+0000 7fd3fdb0bb80 10 client.16356 fetch_fsmap learned FSMap version 34 2023-10-18T14:06:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.739+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1609570182 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5610c3ce6d80 con 0x5610c3f6e630 2023-10-18T14:06:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.739+0000 7fd3caffd700 1 -- 172.21.15.114:0/1609570182 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5610c3ec0e90 con 0x5610c3f6e630 2023-10-18T14:06:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.740+0000 7fd3caffd700 1 -- 172.21.15.114:0/1609570182 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fd3e00b3070 con 0x5610c3f6e630 2023-10-18T14:06:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.740+0000 7fd3fdb0bb80 10 client.16356 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:06:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.740+0000 7fd3fdb0bb80 10 client.16356 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:06:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.740+0000 7fd3fdb0bb80 20 client.16356 populate_metadata read hostname 'smithi114' 2023-10-18T14:06:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.740+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/1609570182 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5610c3f82140 0x5610c3f84560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.740+0000 7fd3fdb0bb80 4 client.16356 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:06:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.740+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1609570182 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610c3f38850 con 0x5610c3f82140 2023-10-18T14:06:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.740+0000 7fd3eaffd700 1 --2- 172.21.15.114:0/1609570182 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5610c3f82140 0x5610c3f84560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.740+0000 7fd3caffd700 10 client.16356 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.740+0000 7fd3eaffd700 1 --2- 172.21.15.114:0/1609570182 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5610c3f82140 0x5610c3f84560 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2df07367d290467c server_cookie=237304b81aaa2cd9 in_seq=0 out_seq=0 2023-10-18T14:06:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3caffd700 1 -- 172.21.15.114:0/1609570182 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5610c3f38850 con 0x5610c3f82140 2023-10-18T14:06:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3caffd700 10 client.16356 handle_command_reply: tid=0 2023-10-18T14:06:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3fdb0bb80 1 client.16356 shutdown 2023-10-18T14:06:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1609570182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 msgr2=0x5610c3f72110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/1609570182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f72110 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd3e009b360 tx=0x7fd3e009bb90 comp rx=0 tx=0).stop 2023-10-18T14:06:34.765 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1609570182 shutdown_connections 2023-10-18T14:06:34.765 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/1609570182 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5610c3f82140 0x5610c3f84560 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.765 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/1609570182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f6ef50 0x5610c3f726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.765 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/1609570182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f69410 0x5610c3f74e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.766 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/1609570182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f72110 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.766 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3caffd700 0 client.16356 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:34.766 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1609570182 >> 172.21.15.114:0/1609570182 conn(0x5610c3edd6c0 msgr2=0x5610c3f62d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:34.766 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1609570182 shutdown_connections 2023-10-18T14:06:34.766 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1609570182 wait complete. 2023-10-18T14:06:34.767 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.741+0000 7fd3fdb0bb80 20 client.16356 trim_cache size 0 max 16384 2023-10-18T14:06:34.771 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3fdb0bb80 1 Processor -- start 2023-10-18T14:06:34.771 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3fdb0bb80 1 -- start start 2023-10-18T14:06:34.772 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3fdb0bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f69410 0x5610c3f68ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.772 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3fdb0bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f7e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.772 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3fdb0bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 0x5610c3f796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.772 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3fdb0bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c3d3c8c0 con 0x5610c3f6e630 2023-10-18T14:06:34.772 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3fdb0bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c3f5c080 con 0x5610c3f69410 2023-10-18T14:06:34.773 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3fdb0bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c3f5d790 con 0x5610c3f6ef50 2023-10-18T14:06:34.773 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3ea7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f7e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.773 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3ea7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f7e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45904/0 (socket says 172.21.15.114:45904) 2023-10-18T14:06:34.773 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/3600022304 learned_addr learned my addr 172.21.15.114:0/3600022304 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:34.773 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3eaffd700 1 --2- 172.21.15.114:0/3600022304 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f69410 0x5610c3f68ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3eb7fe700 1 --2- 172.21.15.114:0/3600022304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 0x5610c3f796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/3600022304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 msgr2=0x5610c3f796a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/3600022304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 0x5610c3f796a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/3600022304 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f69410 msgr2=0x5610c3f68ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/3600022304 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f69410 0x5610c3f68ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/3600022304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610c3f69ac0 con 0x5610c3f6e630 2023-10-18T14:06:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.761+0000 7fd3eaffd700 1 --2- 172.21.15.114:0/3600022304 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f69410 0x5610c3f68ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.762+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/3600022304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f7e510 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00cbb60 tx=0x7fd3e0099980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eac60cbb35dd717 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.762+0000 7fd3d27fc700 1 -- 172.21.15.114:0/3600022304 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00a36d0 con 0x5610c3f6e630 2023-10-18T14:06:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.762+0000 7fd3d27fc700 1 -- 172.21.15.114:0/3600022304 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3e009b630 con 0x5610c3f6e630 2023-10-18T14:06:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.762+0000 7fd3d27fc700 1 -- 172.21.15.114:0/3600022304 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e009ab00 con 0x5610c3f6e630 2023-10-18T14:06:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.763+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/3600022304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 msgr2=0x5610c3f7e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.763+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/3600022304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f7e510 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00cbb60 tx=0x7fd3e0099980 comp rx=0 tx=0).stop 2023-10-18T14:06:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.763+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/3600022304 shutdown_connections 2023-10-18T14:06:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.763+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/3600022304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 0x5610c3f796a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.763+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/3600022304 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f69410 0x5610c3f68ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.763+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/3600022304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f7e510 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.763+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/3600022304 >> 172.21.15.114:0/3600022304 conn(0x5610c3edd6c0 msgr2=0x5610c3f7de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.763+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/3600022304 shutdown_connections 2023-10-18T14:06:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.763+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/3600022304 wait complete. 2023-10-18T14:06:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.763+0000 7fd3fdb0bb80 1 -- start start 2023-10-18T14:06:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.763+0000 7fd3fdb0bb80 1 Processor -- start 2023-10-18T14:06:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3fdb0bb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f69410 0x5610c3f6b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3fdb0bb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f6a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3fdb0bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 0x5610c3f6a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3fdb0bb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c3f6be10 con 0x5610c3f6e630 2023-10-18T14:06:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3fdb0bb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c3f6bf80 con 0x5610c3f69410 2023-10-18T14:06:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3fdb0bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c3f6ac00 con 0x5610c3f6ef50 2023-10-18T14:06:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3fdb0bb80 10 client.0 _ll_register_callbacks cb 0x5610c3da2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:06:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3ea7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f6a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3ea7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f6a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45910/0 (socket says 172.21.15.114:45910) 2023-10-18T14:06:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3eaffd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f69410 0x5610c3f6b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/1838164381 learned_addr learned my addr 172.21.15.114:0/1838164381 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3eb7fe700 1 --2- 172.21.15.114:0/1838164381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 0x5610c3f6a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/1838164381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 msgr2=0x5610c3f6a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/1838164381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 0x5610c3f6a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/1838164381 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f69410 msgr2=0x5610c3f6b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/1838164381 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f69410 0x5610c3f6b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3ea7fc700 1 -- 172.21.15.114:0/1838164381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3dc017070 con 0x5610c3f6e630 2023-10-18T14:06:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3eaffd700 1 --2- 172.21.15.114:0/1838164381 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f69410 0x5610c3f6b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3ea7fc700 1 --2- 172.21.15.114:0/1838164381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f6a130 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00a31a0 tx=0x7fd3e0022c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62aaf556012ebcc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3caffd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:06:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3caffd700 1 -- 172.21.15.114:0/1838164381 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00a36d0 con 0x5610c3f6e630 2023-10-18T14:06:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3caffd700 1 -- 172.21.15.114:0/1838164381 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd3e009aad0 con 0x5610c3f6e630 2023-10-18T14:06:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.764+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1838164381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd3e009f520 con 0x5610c3f6e630 2023-10-18T14:06:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.765+0000 7fd3caffd700 1 -- 172.21.15.114:0/1838164381 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3e00a12d0 con 0x5610c3f6e630 2023-10-18T14:06:34.783 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.765+0000 7fd3fdb0bb80 10 client.16362 fetch_fsmap learned FSMap version 34 2023-10-18T14:06:34.783 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.765+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1838164381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5610c3ce6d80 con 0x5610c3f6e630 2023-10-18T14:06:34.783 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.765+0000 7fd3caffd700 1 -- 172.21.15.114:0/1838164381 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3e009f520 con 0x5610c3f6e630 2023-10-18T14:06:34.783 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.766+0000 7fd3caffd700 1 -- 172.21.15.114:0/1838164381 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fd3e00b3070 con 0x5610c3f6e630 2023-10-18T14:06:34.783 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.766+0000 7fd3fdb0bb80 10 client.16362 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:06:34.784 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.766+0000 7fd3fdb0bb80 10 client.16362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:06:34.784 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.766+0000 7fd3fdb0bb80 20 client.16362 populate_metadata read hostname 'smithi114' 2023-10-18T14:06:34.784 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.766+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/1838164381 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5610c3fd6cd0 0x5610c3fd90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:34.784 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.766+0000 7fd3fdb0bb80 4 client.16362 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:06:34.784 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.766+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1838164381 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5610c3eb4df0 con 0x5610c3fd6cd0 2023-10-18T14:06:34.785 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.766+0000 7fd3eaffd700 1 --2- 172.21.15.114:0/1838164381 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5610c3fd6cd0 0x5610c3fd90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:34.785 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.766+0000 7fd3caffd700 10 client.16362 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:34.785 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.766+0000 7fd3eaffd700 1 --2- 172.21.15.114:0/1838164381 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5610c3fd6cd0 0x5610c3fd90c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcfe507084b04531 server_cookie=1714844daba281e0 in_seq=0 out_seq=0 2023-10-18T14:06:34.786 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:34 smithi158 ceph-mon[103317]: pgmap v357: 97 pgs: 97 active+clean; 44 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 634 op/s 2023-10-18T14:06:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.781+0000 7fd3caffd700 1 -- 172.21.15.114:0/1838164381 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5610c3eb4df0 con 0x5610c3fd6cd0 2023-10-18T14:06:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.781+0000 7fd3caffd700 10 client.16362 handle_command_reply: tid=0 2023-10-18T14:06:34.787 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.781+0000 7fd3fdb0bb80 1 client.16362 shutdown 2023-10-18T14:06:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.781+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1838164381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 msgr2=0x5610c3f6a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.781+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/1838164381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f6a130 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00a31a0 tx=0x7fd3e0022c60 comp rx=0 tx=0).stop 2023-10-18T14:06:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.782+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1838164381 shutdown_connections 2023-10-18T14:06:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.782+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/1838164381 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5610c3fd6cd0 0x5610c3fd90c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.788 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.782+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/1838164381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610c3f6ef50 0x5610c3f6a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.782+0000 7fd3caffd700 0 client.16362 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.782+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/1838164381 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5610c3f69410 0x5610c3f6b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.782+0000 7fd3fdb0bb80 1 --2- 172.21.15.114:0/1838164381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5610c3f6e630 0x5610c3f6a130 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.782+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1838164381 >> 172.21.15.114:0/1838164381 conn(0x5610c3edd6c0 msgr2=0x5610c3f739b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.782+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1838164381 shutdown_connections 2023-10-18T14:06:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.782+0000 7fd3fdb0bb80 1 -- 172.21.15.114:0/1838164381 wait complete. 2023-10-18T14:06:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.782+0000 7fd3fdb0bb80 20 client.16362 trim_cache size 0 max 16384 2023-10-18T14:06:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:06:34.790 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:06:34.791 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:06:34.791 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:06:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.783+0000 7fd3f1922700 1 -- 172.21.15.114:0/1602330958 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3d40a15f0 msgr2=0x7fd3d40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.783+0000 7fd3f1922700 1 --2- 172.21.15.114:0/1602330958 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3d40a15f0 0x7fd3d40a3ab0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc011490 tx=0x7fd3dc009260 comp rx=0 tx=0).stop 2023-10-18T14:06:34.792 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.783+0000 7fd3f1922700 1 -- 172.21.15.114:0/1602330958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3ec1040e0 msgr2=0x7fd3ec199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.783+0000 7fd3f1922700 1 --2- 172.21.15.114:0/1602330958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3ec1040e0 0x7fd3ec199320 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00098e0 tx=0x7fd3e0004730 comp rx=0 tx=0).stop 2023-10-18T14:06:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.783+0000 7fd3f1922700 1 -- 172.21.15.114:0/1602330958 shutdown_connections 2023-10-18T14:06:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.783+0000 7fd3f1922700 1 --2- 172.21.15.114:0/1602330958 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3d40a15f0 0x7fd3d40a3ab0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.783+0000 7fd3f1922700 1 --2- 172.21.15.114:0/1602330958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ec19d6c0 0x7fd3ec19db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.793 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.783+0000 7fd3f1922700 1 --2- 172.21.15.114:0/1602330958 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3ec0fefc0 0x7fd3ec198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.783+0000 7fd3f1922700 1 --2- 172.21.15.114:0/1602330958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3ec1040e0 0x7fd3ec199320 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.783+0000 7fd3f1922700 1 -- 172.21.15.114:0/1602330958 >> 172.21.15.114:0/1602330958 conn(0x7fd3ec075bf0 msgr2=0x7fd3ec10e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.784+0000 7fd3f1922700 1 -- 172.21.15.114:0/1602330958 shutdown_connections 2023-10-18T14:06:34.794 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:34.784+0000 7fd3f1922700 1 -- 172.21.15.114:0/1602330958 wait complete. 2023-10-18T14:06:34.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:34 smithi172 ceph-mon[103574]: pgmap v357: 97 pgs: 97 active+clean; 44 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 634 op/s 2023-10-18T14:06:37.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:36 smithi158 ceph-mon[103317]: pgmap v358: 97 pgs: 97 active+clean; 44 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 396 op/s 2023-10-18T14:06:37.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:36 smithi172 ceph-mon[103574]: pgmap v358: 97 pgs: 97 active+clean; 44 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 396 op/s 2023-10-18T14:06:37.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:36 smithi114 ceph-mon[99494]: pgmap v358: 97 pgs: 97 active+clean; 44 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 396 op/s 2023-10-18T14:06:39.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:38 smithi158 ceph-mon[103317]: pgmap v359: 97 pgs: 97 active+clean; 44 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 395 op/s 2023-10-18T14:06:39.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:38 smithi172 ceph-mon[103574]: pgmap v359: 97 pgs: 97 active+clean; 44 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 395 op/s 2023-10-18T14:06:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:38 smithi114 ceph-mon[99494]: pgmap v359: 97 pgs: 97 active+clean; 44 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 395 op/s 2023-10-18T14:06:41.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:40 smithi158 ceph-mon[103317]: pgmap v360: 97 pgs: 97 active+clean; 42 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 565 op/s 2023-10-18T14:06:41.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:40 smithi172 ceph-mon[103574]: pgmap v360: 97 pgs: 97 active+clean; 42 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 565 op/s 2023-10-18T14:06:41.064 INFO:tasks.workunit.client.0.smithi114.stdout:50000 mapwrite 0xd9535 thru 0xdf124 (0x5bf0 bytes) 2023-10-18T14:06:41.069 INFO:tasks.workunit.client.0.smithi114.stdout:All 50000 operations completed A-OK! 2023-10-18T14:06:41.069 INFO:tasks.workunit.client.0.smithi114.stderr:+ ./fsx -z 10MB -N 50000 -p 10000 -l 10485760 2023-10-18T14:06:41.070 INFO:tasks.workunit.client.0.smithi114.stdout:Seed set to 1 2023-10-18T14:06:41.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:40 smithi114 ceph-mon[99494]: pgmap v360: 97 pgs: 97 active+clean; 42 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 565 op/s 2023-10-18T14:06:41.192 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support fallocate mode 0, disabling! 2023-10-18T14:06:41.192 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2023-10-18T14:06:41.194 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2023-10-18T14:06:41.195 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2023-10-18T14:06:41.195 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support clone range, disabling! 2023-10-18T14:06:41.198 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support dedupe range, disabling! 2023-10-18T14:06:41.200 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x5a0dfb 2023-10-18T14:06:41.212 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0x5c415c 2023-10-18T14:06:41.213 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x9c27b4 2023-10-18T14:06:41.277 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0x9d03f4 2023-10-18T14:06:41.352 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0x9f6462 2023-10-18T14:06:41.435 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0x9fa7e5 2023-10-18T14:06:42.841 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:06:42.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.985+0000 7f9f187df700 1 -- 172.21.15.114:0/3912859082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f100ff120 msgr2=0x7f9f100ff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:42.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.985+0000 7f9f187df700 1 --2- 172.21.15.114:0/3912859082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f100ff120 0x7f9f100ff5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009990 tx=0x7f9f00009ca0 comp rx=0 tx=0).stop 2023-10-18T14:06:42.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.985+0000 7f9f187df700 1 -- 172.21.15.114:0/3912859082 shutdown_connections 2023-10-18T14:06:42.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.985+0000 7f9f187df700 1 --2- 172.21.15.114:0/3912859082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f100ffae0 0x7f9f1010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:42.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.985+0000 7f9f187df700 1 --2- 172.21.15.114:0/3912859082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f10106860 0x7f9f10106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:42.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.985+0000 7f9f187df700 1 --2- 172.21.15.114:0/3912859082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f100ff120 0x7f9f100ff5a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:42.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.985+0000 7f9f187df700 1 -- 172.21.15.114:0/3912859082 >> 172.21.15.114:0/3912859082 conn(0x7f9f10074890 msgr2=0x7f9f10074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:42.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.985+0000 7f9f187df700 1 -- 172.21.15.114:0/3912859082 shutdown_connections 2023-10-18T14:06:42.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.985+0000 7f9f187df700 1 -- 172.21.15.114:0/3912859082 wait complete. 2023-10-18T14:06:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.986+0000 7f9f187df700 1 Processor -- start 2023-10-18T14:06:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.986+0000 7f9f187df700 1 -- start start 2023-10-18T14:06:42.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.986+0000 7f9f187df700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f100ff120 0x7f9f1019c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:42.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.986+0000 7f9f187df700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f100ffae0 0x7f9f1019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:42.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.986+0000 7f9f187df700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f10106860 0x7f9f10196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:42.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.986+0000 7f9f187df700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f10197070 con 0x7f9f100ffae0 2023-10-18T14:06:42.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.986+0000 7f9f187df700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f101971e0 con 0x7f9f100ff120 2023-10-18T14:06:42.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.986+0000 7f9f187df700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f101973a0 con 0x7f9f10106860 2023-10-18T14:06:42.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.986+0000 7f9f15d7a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f100ffae0 0x7f9f1019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:42.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.986+0000 7f9f15d7a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f100ffae0 0x7f9f1019ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45924/0 (socket says 172.21.15.114:45924) 2023-10-18T14:06:42.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.986+0000 7f9f15d7a700 1 -- 172.21.15.114:0/2377371059 learned_addr learned my addr 172.21.15.114:0/2377371059 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:42.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.986+0000 7f9f1657b700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f100ff120 0x7f9f1019c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:42.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.986+0000 7f9f16d7c700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f10106860 0x7f9f10196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:42.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.987+0000 7f9f15d7a700 1 -- 172.21.15.114:0/2377371059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f10106860 msgr2=0x7f9f10196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:42.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.987+0000 7f9f15d7a700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f10106860 0x7f9f10196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:42.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.987+0000 7f9f15d7a700 1 -- 172.21.15.114:0/2377371059 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f100ff120 msgr2=0x7f9f1019c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:42.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.987+0000 7f9f15d7a700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f100ff120 0x7f9f1019c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:42.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.987+0000 7f9f15d7a700 1 -- 172.21.15.114:0/2377371059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f000095f0 con 0x7f9f100ffae0 2023-10-18T14:06:42.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.987+0000 7f9f15d7a700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f100ffae0 0x7f9f1019ce20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9f00004760 tx=0x7f9f00004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:42.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.987+0000 7f9f077fe700 1 -- 172.21.15.114:0/2377371059 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0001d070 con 0x7f9f100ffae0 2023-10-18T14:06:42.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.987+0000 7f9f077fe700 1 -- 172.21.15.114:0/2377371059 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f00022470 con 0x7f9f100ffae0 2023-10-18T14:06:42.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.987+0000 7f9f187df700 1 -- 172.21.15.114:0/2377371059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f10197620 con 0x7f9f100ffae0 2023-10-18T14:06:42.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.987+0000 7f9f077fe700 1 -- 172.21.15.114:0/2377371059 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f00017650 con 0x7f9f100ffae0 2023-10-18T14:06:42.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.987+0000 7f9f187df700 1 -- 172.21.15.114:0/2377371059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f101a38d0 con 0x7f9f100ffae0 2023-10-18T14:06:42.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.990+0000 7f9f077fe700 1 -- 172.21.15.114:0/2377371059 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f9f000225e0 con 0x7f9f100ffae0 2023-10-18T14:06:43.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.991+0000 7f9f077fe700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9efc0a1740 0x7f9efc0a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.991+0000 7f9f077fe700 1 -- 172.21.15.114:0/2377371059 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9f000d0220 con 0x7f9f100ffae0 2023-10-18T14:06:43.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.991+0000 7f9f1657b700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9efc0a1740 0x7f9efc0a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.991+0000 7f9f1657b700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9efc0a1740 0x7f9efc0a3c00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c007be0 tx=0x7f9f0c0073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:43.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.992+0000 7f9f249c8b80 1 Processor -- start 2023-10-18T14:06:43.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.992+0000 7f9f249c8b80 1 -- start start 2023-10-18T14:06:43.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.992+0000 7f9f249c8b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e6be0 0x55868a8e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.992+0000 7f9f249c8b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e7500 0x55868a8e1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.992+0000 7f9f249c8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8e1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.992+0000 7f9f249c8b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868a8546e0 con 0x55868a8e6be0 2023-10-18T14:06:43.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.992+0000 7f9f249c8b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868a83ac60 con 0x55868a8e7500 2023-10-18T14:06:43.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.992+0000 7f9f249c8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868a838580 con 0x55868a8e15d0 2023-10-18T14:06:43.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.992+0000 7f9f1657b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e6be0 0x55868a8e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.992+0000 7f9f1657b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e6be0 0x55868a8e6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45930/0 (socket says 172.21.15.114:45930) 2023-10-18T14:06:43.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.992+0000 7f9f1657b700 1 -- 172.21.15.114:0/1792230171 learned_addr learned my addr 172.21.15.114:0/1792230171 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:43.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.993+0000 7f9f16d7c700 1 --2- 172.21.15.114:0/1792230171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8e1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.993+0000 7f9f15d7a700 1 --2- 172.21.15.114:0/1792230171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e7500 0x55868a8e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.993+0000 7f9f16d7c700 1 -- 172.21.15.114:0/1792230171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e7500 msgr2=0x55868a8e1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:43.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.993+0000 7f9f16d7c700 1 --2- 172.21.15.114:0/1792230171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e7500 0x55868a8e1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.993+0000 7f9f16d7c700 1 -- 172.21.15.114:0/1792230171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e6be0 msgr2=0x55868a8e6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:43.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.993+0000 7f9f16d7c700 1 --2- 172.21.15.114:0/1792230171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e6be0 0x55868a8e6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.993+0000 7f9f16d7c700 1 -- 172.21.15.114:0/1792230171 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55868a7f13f0 con 0x55868a8e15d0 2023-10-18T14:06:43.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.993+0000 7f9f16d7c700 1 --2- 172.21.15.114:0/1792230171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8e1a50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9f08011580 tx=0x7f9f08009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2087988eca75279 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:43.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.993+0000 7f9f04ff9700 1 -- 172.21.15.114:0/1792230171 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0800e040 con 0x55868a8e15d0 2023-10-18T14:06:43.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.994+0000 7f9f04ff9700 1 -- 172.21.15.114:0/1792230171 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f0800f040 con 0x55868a8e15d0 2023-10-18T14:06:43.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.994+0000 7f9f04ff9700 1 -- 172.21.15.114:0/1792230171 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08004370 con 0x55868a8e15d0 2023-10-18T14:06:43.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.994+0000 7f9f249c8b80 1 -- 172.21.15.114:0/1792230171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 msgr2=0x55868a8e1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:43.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.994+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/1792230171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8e1a50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9f08011580 tx=0x7f9f08009920 comp rx=0 tx=0).stop 2023-10-18T14:06:43.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.994+0000 7f9f249c8b80 1 -- 172.21.15.114:0/1792230171 shutdown_connections 2023-10-18T14:06:43.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.994+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/1792230171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8e1a50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.994+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/1792230171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e6be0 0x55868a8e6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.994+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/1792230171 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e7500 0x55868a8e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.994+0000 7f9f249c8b80 1 -- 172.21.15.114:0/1792230171 >> 172.21.15.114:0/1792230171 conn(0x55868a855720 msgr2=0x55868a8dbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:43.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.995+0000 7f9f249c8b80 1 -- 172.21.15.114:0/1792230171 shutdown_connections 2023-10-18T14:06:43.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.995+0000 7f9f249c8b80 1 -- 172.21.15.114:0/1792230171 wait complete. 2023-10-18T14:06:43.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.995+0000 7f9f249c8b80 1 -- start start 2023-10-18T14:06:43.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.995+0000 7f9f249c8b80 1 Processor -- start 2023-10-18T14:06:43.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.995+0000 7f9f249c8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8ed500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.995+0000 7f9f249c8b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e6be0 0x55868a8ea780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.995+0000 7f9f249c8b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e7500 0x55868a8eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.995+0000 7f9f249c8b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868a833e70 con 0x55868a8e7500 2023-10-18T14:06:43.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.995+0000 7f9f249c8b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868a7d0710 con 0x55868a8e6be0 2023-10-18T14:06:43.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.995+0000 7f9f249c8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868a7d03b0 con 0x55868a8e15d0 2023-10-18T14:06:43.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9f249c8b80 10 client.0 _ll_register_callbacks cb 0x55868a71aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:06:43.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9f16d7c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e7500 0x55868a8eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9f1657b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9f16d7c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e7500 0x55868a8eadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45938/0 (socket says 172.21.15.114:45938) 2023-10-18T14:06:43.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9f1657b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8ed500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49872/0 (socket says 172.21.15.114:49872) 2023-10-18T14:06:43.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9f16d7c700 1 -- 172.21.15.114:0/3305618435 learned_addr learned my addr 172.21.15.114:0/3305618435 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:43.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9f15d7a700 1 --2- 172.21.15.114:0/3305618435 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e6be0 0x55868a8ea780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9f16d7c700 1 -- 172.21.15.114:0/3305618435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 msgr2=0x55868a8ed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9f16d7c700 1 --2- 172.21.15.114:0/3305618435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8ed500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9f16d7c700 1 -- 172.21.15.114:0/3305618435 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e6be0 msgr2=0x55868a8ea780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9f16d7c700 1 --2- 172.21.15.114:0/3305618435 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e6be0 0x55868a8ea780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9f16d7c700 1 -- 172.21.15.114:0/3305618435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f08011230 con 0x55868a8e7500 2023-10-18T14:06:43.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9f16d7c700 1 --2- 172.21.15.114:0/3305618435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e7500 0x55868a8eadb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9f08004db0 tx=0x7f9f08004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4beeb42c1933ed34 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:43.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9ef9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:06:43.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.996+0000 7f9ef9ffb700 1 -- 172.21.15.114:0/3305618435 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0800e040 con 0x55868a8e7500 2023-10-18T14:06:43.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9ef9ffb700 1 -- 172.21.15.114:0/3305618435 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9f08003e30 con 0x55868a8e7500 2023-10-18T14:06:43.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9f249c8b80 1 -- 172.21.15.114:0/3305618435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55868a838ef0 con 0x55868a8e7500 2023-10-18T14:06:43.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9ef9ffb700 1 -- 172.21.15.114:0/3305618435 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f08004240 con 0x55868a8e7500 2023-10-18T14:06:43.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9f249c8b80 10 client.16374 fetch_fsmap learned FSMap version 34 2023-10-18T14:06:43.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9f249c8b80 1 -- 172.21.15.114:0/3305618435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55868a65ede0 con 0x55868a8e7500 2023-10-18T14:06:43.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9ef9ffb700 1 -- 172.21.15.114:0/3305618435 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55868a838ef0 con 0x55868a8e7500 2023-10-18T14:06:43.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9ef9ffb700 1 -- 172.21.15.114:0/3305618435 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f9f0801b020 con 0x55868a8e7500 2023-10-18T14:06:43.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9f249c8b80 10 client.16374 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:06:43.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9f249c8b80 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:06:43.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9f249c8b80 20 client.16374 populate_metadata read hostname 'smithi114' 2023-10-18T14:06:43.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/3305618435 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55868a8fad50 0x55868a8fd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9f249c8b80 4 client.16374 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:06:43.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9f249c8b80 1 -- 172.21.15.114:0/3305618435 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55868a8b08b0 con 0x55868a8fad50 2023-10-18T14:06:43.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.997+0000 7f9f1657b700 1 --2- 172.21.15.114:0/3305618435 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55868a8fad50 0x55868a8fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.998+0000 7f9ef9ffb700 10 client.16374 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:43.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.998+0000 7f9f1657b700 1 --2- 172.21.15.114:0/3305618435 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55868a8fad50 0x55868a8fd170 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99bf9034f82d3792 server_cookie=aed6e64001f40f08 in_seq=0 out_seq=0 2023-10-18T14:06:43.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9ef9ffb700 1 -- 172.21.15.114:0/3305618435 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55868a8b08b0 con 0x55868a8fad50 2023-10-18T14:06:43.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9ef9ffb700 10 client.16374 handle_command_reply: tid=0 2023-10-18T14:06:43.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9f249c8b80 1 client.16374 shutdown 2023-10-18T14:06:43.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9f249c8b80 1 -- 172.21.15.114:0/3305618435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e7500 msgr2=0x55868a8eadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:43.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/3305618435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e7500 0x55868a8eadb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9f08004db0 tx=0x7f9f08004de0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9f249c8b80 1 -- 172.21.15.114:0/3305618435 shutdown_connections 2023-10-18T14:06:43.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/3305618435 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55868a8fad50 0x55868a8fd170 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/3305618435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e7500 0x55868a8eadb0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9ef9ffb700 0 client.16374 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:43.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/3305618435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/3305618435 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e6be0 0x55868a8ea780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9f249c8b80 1 -- 172.21.15.114:0/3305618435 >> 172.21.15.114:0/3305618435 conn(0x55868a855720 msgr2=0x55868a8e0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:43.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9f249c8b80 1 -- 172.21.15.114:0/3305618435 shutdown_connections 2023-10-18T14:06:43.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9f249c8b80 1 -- 172.21.15.114:0/3305618435 wait complete. 2023-10-18T14:06:43.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:42.999+0000 7f9f249c8b80 20 client.16374 trim_cache size 0 max 16384 2023-10-18T14:06:43.024 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:42 smithi158 ceph-mon[103317]: pgmap v361: 97 pgs: 97 active+clean; 42 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 370 op/s 2023-10-18T14:06:43.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.022+0000 7f9f249c8b80 1 Processor -- start 2023-10-18T14:06:43.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.022+0000 7f9f249c8b80 1 -- start start 2023-10-18T14:06:43.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.022+0000 7f9f249c8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.022+0000 7f9f249c8b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e6be0 0x55868a8e0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.022+0000 7f9f249c8b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e7500 0x55868a8ea740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.022+0000 7f9f249c8b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868a6b4920 con 0x55868a8e6be0 2023-10-18T14:06:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.022+0000 7f9f249c8b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868a8ebdc0 con 0x55868a8e7500 2023-10-18T14:06:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.022+0000 7f9f249c8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868a8eb390 con 0x55868a8e15d0 2023-10-18T14:06:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.022+0000 7f9f15d7a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e6be0 0x55868a8e0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.022+0000 7f9f15d7a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e6be0 0x55868a8e0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45944/0 (socket says 172.21.15.114:45944) 2023-10-18T14:06:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.022+0000 7f9f15d7a700 1 -- 172.21.15.114:0/2787297786 learned_addr learned my addr 172.21.15.114:0/2787297786 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.023+0000 7f9f1657b700 1 --2- 172.21.15.114:0/2787297786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.023+0000 7f9f16d7c700 1 --2- 172.21.15.114:0/2787297786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e7500 0x55868a8ea740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.023+0000 7f9f15d7a700 1 -- 172.21.15.114:0/2787297786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 msgr2=0x55868a8f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:43.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.023+0000 7f9f15d7a700 1 --2- 172.21.15.114:0/2787297786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.023+0000 7f9f15d7a700 1 -- 172.21.15.114:0/2787297786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e7500 msgr2=0x55868a8ea740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:43.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.023+0000 7f9f15d7a700 1 --2- 172.21.15.114:0/2787297786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e7500 0x55868a8ea740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.023+0000 7f9f15d7a700 1 -- 172.21.15.114:0/2787297786 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55868a647c60 con 0x55868a8e6be0 2023-10-18T14:06:43.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.023+0000 7f9f16d7c700 1 --2- 172.21.15.114:0/2787297786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e7500 0x55868a8ea740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:06:43.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.023+0000 7f9f15d7a700 1 --2- 172.21.15.114:0/2787297786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e6be0 0x55868a8e0080 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000b690 tx=0x7f9f0001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17e9d35190e5393 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:43.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.023+0000 7f9f057fa700 1 -- 172.21.15.114:0/2787297786 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0009b800 con 0x55868a8e6be0 2023-10-18T14:06:43.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.023+0000 7f9f057fa700 1 -- 172.21.15.114:0/2787297786 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f000cbe90 con 0x55868a8e6be0 2023-10-18T14:06:43.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.023+0000 7f9f057fa700 1 -- 172.21.15.114:0/2787297786 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000228e0 con 0x55868a8e6be0 2023-10-18T14:06:43.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.024+0000 7f9f249c8b80 1 -- 172.21.15.114:0/2787297786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e6be0 msgr2=0x55868a8e0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:43.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.024+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/2787297786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e6be0 0x55868a8e0080 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000b690 tx=0x7f9f0001a040 comp rx=0 tx=0).stop 2023-10-18T14:06:43.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.024+0000 7f9f249c8b80 1 -- 172.21.15.114:0/2787297786 shutdown_connections 2023-10-18T14:06:43.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.024+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/2787297786 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e7500 0x55868a8ea740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.024+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/2787297786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e15d0 0x55868a8f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.024+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/2787297786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e6be0 0x55868a8e0080 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.024+0000 7f9f249c8b80 1 -- 172.21.15.114:0/2787297786 >> 172.21.15.114:0/2787297786 conn(0x55868a855720 msgr2=0x55868a8e19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:43.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.024+0000 7f9f249c8b80 1 -- 172.21.15.114:0/2787297786 shutdown_connections 2023-10-18T14:06:43.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.024+0000 7f9f249c8b80 1 -- 172.21.15.114:0/2787297786 wait complete. 2023-10-18T14:06:43.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.024+0000 7f9f249c8b80 1 -- start start 2023-10-18T14:06:43.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.024+0000 7f9f249c8b80 1 Processor -- start 2023-10-18T14:06:43.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f249c8b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e15d0 0x55868a8f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f249c8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e6be0 0x55868a8f0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f249c8b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e7500 0x55868a8f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f249c8b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868a8f0b10 con 0x55868a8e7500 2023-10-18T14:06:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f249c8b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868a8f0c80 con 0x55868a8e15d0 2023-10-18T14:06:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f249c8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868a8f0e40 con 0x55868a8e6be0 2023-10-18T14:06:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f249c8b80 10 client.0 _ll_register_callbacks cb 0x55868a71aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:06:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f1657b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e15d0 0x55868a8f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f15d7a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e6be0 0x55868a8f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f1657b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e15d0 0x55868a8f1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42094/0 (socket says 172.21.15.114:42094) 2023-10-18T14:06:43.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f1657b700 1 -- 172.21.15.114:0/1190452460 learned_addr learned my addr 172.21.15.114:0/1190452460 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:43.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f15d7a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e6be0 0x55868a8f0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49888/0 (socket says 172.21.15.114:49888) 2023-10-18T14:06:43.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f16d7c700 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e7500 0x55868a8f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f1657b700 1 -- 172.21.15.114:0/1190452460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e6be0 msgr2=0x55868a8f0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:43.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f1657b700 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e6be0 0x55868a8f0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f1657b700 1 -- 172.21.15.114:0/1190452460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e7500 msgr2=0x55868a8f05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:43.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f1657b700 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e7500 0x55868a8f05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f1657b700 1 -- 172.21.15.114:0/1190452460 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f101a38d0 con 0x55868a8e15d0 2023-10-18T14:06:43.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f16d7c700 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e7500 0x55868a8f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:43.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.025+0000 7f9f15d7a700 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e6be0 0x55868a8f0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:43.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9f1657b700 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e15d0 0x55868a8f1bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c030520 tx=0x7f9f0c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1af6d99a1cf04ea server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:43.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9ef9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:06:43.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9ef9ffb700 1 -- 172.21.15.114:0/1190452460 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c02b040 con 0x55868a8e15d0 2023-10-18T14:06:43.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9f249c8b80 1 -- 172.21.15.114:0/1190452460 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f0800f040 con 0x55868a8e15d0 2023-10-18T14:06:43.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9ef9ffb700 1 -- 172.21.15.114:0/1190452460 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f9f0c017040 con 0x55868a8e15d0 2023-10-18T14:06:43.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9ef9ffb700 1 -- 172.21.15.114:0/1190452460 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f0c004440 con 0x55868a8e15d0 2023-10-18T14:06:43.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9f249c8b80 10 client.25532 fetch_fsmap learned FSMap version 34 2023-10-18T14:06:43.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9f249c8b80 1 -- 172.21.15.114:0/1190452460 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55868a685250 con 0x55868a8e15d0 2023-10-18T14:06:43.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9ef9ffb700 1 -- 172.21.15.114:0/1190452460 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f0800f040 con 0x55868a8e15d0 2023-10-18T14:06:43.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9ef9ffb700 1 -- 172.21.15.114:0/1190452460 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f9f0c0039e0 con 0x55868a8e15d0 2023-10-18T14:06:43.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9f249c8b80 10 client.25532 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:06:43.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9f249c8b80 10 client.25532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:06:43.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9f249c8b80 20 client.25532 populate_metadata read hostname 'smithi114' 2023-10-18T14:06:43.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55868a8fad50 0x55868a9520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:43.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9f249c8b80 4 client.25532 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:06:43.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.026+0000 7f9f249c8b80 1 -- 172.21.15.114:0/1190452460 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55868a82ce50 con 0x55868a8fad50 2023-10-18T14:06:43.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.027+0000 7f9f15d7a700 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55868a8fad50 0x55868a9520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.027+0000 7f9ef9ffb700 10 client.25532 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.027+0000 7f9f15d7a700 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55868a8fad50 0x55868a9520a0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1a2ab8ad6d11eb4 server_cookie=b596efa8ba47894f in_seq=0 out_seq=0 2023-10-18T14:06:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.027+0000 7f9ef9ffb700 1 -- 172.21.15.114:0/1190452460 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55868a82ce50 con 0x55868a8fad50 2023-10-18T14:06:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.027+0000 7f9ef9ffb700 10 client.25532 handle_command_reply: tid=0 2023-10-18T14:06:43.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.027+0000 7f9f249c8b80 1 client.25532 shutdown 2023-10-18T14:06:43.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f249c8b80 1 -- 172.21.15.114:0/1190452460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e15d0 msgr2=0x55868a8f1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:43.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e15d0 0x55868a8f1bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c030520 tx=0x7f9f0c0047c0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f249c8b80 1 -- 172.21.15.114:0/1190452460 shutdown_connections 2023-10-18T14:06:43.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55868a8fad50 0x55868a9520a0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55868a8e7500 0x55868a8f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9ef9ffb700 0 client.25532 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:43.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55868a8e15d0 0x55868a8f1bf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f249c8b80 1 --2- 172.21.15.114:0/1190452460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55868a8e6be0 0x55868a8f0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f249c8b80 1 -- 172.21.15.114:0/1190452460 >> 172.21.15.114:0/1190452460 conn(0x55868a855720 msgr2=0x55868a8e46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:43.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f249c8b80 1 -- 172.21.15.114:0/1190452460 shutdown_connections 2023-10-18T14:06:43.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f249c8b80 1 -- 172.21.15.114:0/1190452460 wait complete. 2023-10-18T14:06:43.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f249c8b80 20 client.25532 trim_cache size 0 max 16384 2023-10-18T14:06:43.051 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:06:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-18T14:06:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": { 2023-10-18T14:06:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: "94d18228-30fd-45a0-94d1-b2bec5a6db1a": { 2023-10-18T14:06:43.051 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/", 2023-10-18T14:06:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: "tag": "94d18228-30fd-45a0-94d1-b2bec5a6db1a", 2023-10-18T14:06:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: "options": "recursive,force" 2023-10-18T14:06:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:06:43.052 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:06:43.053 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:06:43.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f187df700 1 -- 172.21.15.114:0/2377371059 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9efc0a1740 msgr2=0x7f9efc0a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:43.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f187df700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9efc0a1740 0x7f9efc0a3c00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c007be0 tx=0x7f9f0c0073d0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f187df700 1 -- 172.21.15.114:0/2377371059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f100ffae0 msgr2=0x7f9f1019ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:43.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f187df700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f100ffae0 0x7f9f1019ce20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9f00004760 tx=0x7f9f00004790 comp rx=0 tx=0).stop 2023-10-18T14:06:43.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f187df700 1 -- 172.21.15.114:0/2377371059 shutdown_connections 2023-10-18T14:06:43.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f187df700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f9efc0a1740 0x7f9efc0a3c00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f187df700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f10106860 0x7f9f10196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f187df700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9f100ff120 0x7f9f1019c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f187df700 1 --2- 172.21.15.114:0/2377371059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f100ffae0 0x7f9f1019ce20 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:43.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f187df700 1 -- 172.21.15.114:0/2377371059 >> 172.21.15.114:0/2377371059 conn(0x7f9f10074890 msgr2=0x7f9f100fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:43.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.028+0000 7f9f187df700 1 -- 172.21.15.114:0/2377371059 shutdown_connections 2023-10-18T14:06:43.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:06:43.029+0000 7f9f187df700 1 -- 172.21.15.114:0/2377371059 wait complete. 2023-10-18T14:06:43.056 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:42 smithi114 ceph-mon[99494]: pgmap v361: 97 pgs: 97 active+clean; 42 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 370 op/s 2023-10-18T14:06:43.057 INFO:tasks.cephfs.filesystem:scrub status for tag:94d18228-30fd-45a0-94d1-b2bec5a6db1a - {'path': '/', 'tag': '94d18228-30fd-45a0-94d1-b2bec5a6db1a', 'options': 'recursive,force'} 2023-10-18T14:06:43.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:42 smithi172 ceph-mon[103574]: pgmap v361: 97 pgs: 97 active+clean; 42 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 370 op/s 2023-10-18T14:06:43.843 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x9fd4ba 2023-10-18T14:06:44.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:06:44.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:06:44.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:06:44.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:44.324 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x9fe323 2023-10-18T14:06:45.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:44 smithi158 ceph-mon[103317]: pgmap v362: 97 pgs: 97 active+clean; 46 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.0 MiB/s wr, 549 op/s 2023-10-18T14:06:45.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:44 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:06:45.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:44 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:06:45.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:44 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:45.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:44 smithi172 ceph-mon[103574]: pgmap v362: 97 pgs: 97 active+clean; 46 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.0 MiB/s wr, 549 op/s 2023-10-18T14:06:45.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:44 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:06:45.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:44 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:06:45.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:44 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:45.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:44 smithi114 ceph-mon[99494]: pgmap v362: 97 pgs: 97 active+clean; 46 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.0 MiB/s wr, 549 op/s 2023-10-18T14:06:45.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:44 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:06:45.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:44 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:06:45.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:44 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:06:46.202 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x9fec09 2023-10-18T14:06:47.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:46 smithi158 ceph-mon[103317]: pgmap v363: 97 pgs: 97 active+clean; 48 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.5 MiB/s wr, 452 op/s 2023-10-18T14:06:47.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:46 smithi172 ceph-mon[103574]: pgmap v363: 97 pgs: 97 active+clean; 48 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.5 MiB/s wr, 452 op/s 2023-10-18T14:06:47.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:46 smithi114 ceph-mon[99494]: pgmap v363: 97 pgs: 97 active+clean; 48 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.5 MiB/s wr, 452 op/s 2023-10-18T14:06:47.742 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0x9ff6e7 2023-10-18T14:06:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.909+0000 7eff1b913700 1 -- 172.21.15.114:0/416346775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff140ff5d0 msgr2=0x7eff140ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.909+0000 7eff1b913700 1 --2- 172.21.15.114:0/416346775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff140ff5d0 0x7eff140ffa50 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7eff04009990 tx=0x7eff04009ca0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.910+0000 7eff1b913700 1 -- 172.21.15.114:0/416346775 shutdown_connections 2023-10-18T14:06:47.915 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.910+0000 7eff1b913700 1 --2- 172.21.15.114:0/416346775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff140fff90 0x7eff1410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.915 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.910+0000 7eff1b913700 1 --2- 172.21.15.114:0/416346775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff141045e0 0x7eff141049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.915 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.910+0000 7eff1b913700 1 --2- 172.21.15.114:0/416346775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff140ff5d0 0x7eff140ffa50 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.915 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.910+0000 7eff1b913700 1 -- 172.21.15.114:0/416346775 >> 172.21.15.114:0/416346775 conn(0x7eff14076790 msgr2=0x7eff14076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:47.916 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.910+0000 7eff1b913700 1 -- 172.21.15.114:0/416346775 shutdown_connections 2023-10-18T14:06:47.916 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.910+0000 7eff1b913700 1 -- 172.21.15.114:0/416346775 wait complete. 2023-10-18T14:06:47.918 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.910+0000 7eff1b913700 1 Processor -- start 2023-10-18T14:06:47.919 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.910+0000 7eff1b913700 1 -- start start 2023-10-18T14:06:47.919 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff1b913700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff140ff5d0 0x7eff1419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.919 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff1b913700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff140fff90 0x7eff1419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.919 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff1b913700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff141045e0 0x7eff14194700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff1b913700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff14194d60 con 0x7eff140ff5d0 2023-10-18T14:06:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff1b913700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff14194ed0 con 0x7eff141045e0 2023-10-18T14:06:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff1b913700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff14195090 con 0x7eff140fff90 2023-10-18T14:06:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff196af700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff140ff5d0 0x7eff1419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff196af700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff140ff5d0 0x7eff1419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45964/0 (socket says 172.21.15.114:45964) 2023-10-18T14:06:47.922 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff196af700 1 -- 172.21.15.114:0/3296615197 learned_addr learned my addr 172.21.15.114:0/3296615197 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:47.922 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff18eae700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff140fff90 0x7eff1419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.922 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff19eb0700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff141045e0 0x7eff14194700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.922 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff196af700 1 -- 172.21.15.114:0/3296615197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff140fff90 msgr2=0x7eff1419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:47.922 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff196af700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff140fff90 0x7eff1419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.923 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff196af700 1 -- 172.21.15.114:0/3296615197 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff141045e0 msgr2=0x7eff14194700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:47.923 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff196af700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff141045e0 0x7eff14194700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.923 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff196af700 1 -- 172.21.15.114:0/3296615197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040095f0 con 0x7eff140ff5d0 2023-10-18T14:06:47.923 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.911+0000 7eff196af700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff140ff5d0 0x7eff1419a5d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7eff10009c70 tx=0x7eff10009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:47.923 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.912+0000 7eff0a7fc700 1 -- 172.21.15.114:0/3296615197 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1001d070 con 0x7eff140ff5d0 2023-10-18T14:06:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.912+0000 7eff0a7fc700 1 -- 172.21.15.114:0/3296615197 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff10015040 con 0x7eff140ff5d0 2023-10-18T14:06:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.912+0000 7eff1b913700 1 -- 172.21.15.114:0/3296615197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff14195370 con 0x7eff140ff5d0 2023-10-18T14:06:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.912+0000 7eff0a7fc700 1 -- 172.21.15.114:0/3296615197 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100039f0 con 0x7eff140ff5d0 2023-10-18T14:06:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.912+0000 7eff1b913700 1 -- 172.21.15.114:0/3296615197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff141a15c0 con 0x7eff140ff5d0 2023-10-18T14:06:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.914+0000 7eff0a7fc700 1 -- 172.21.15.114:0/3296615197 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7eff10007980 con 0x7eff140ff5d0 2023-10-18T14:06:47.925 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.914+0000 7eff0a7fc700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7eff000a15f0 0x7eff000a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.925 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.914+0000 7eff0a7fc700 1 -- 172.21.15.114:0/3296615197 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7eff100d07c0 con 0x7eff140ff5d0 2023-10-18T14:06:47.925 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.914+0000 7eff18eae700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7eff000a15f0 0x7eff000a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.925 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.915+0000 7eff18eae700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7eff000a15f0 0x7eff000a3ab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7eff0400b2e0 tx=0x7eff04005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:47.931 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.915+0000 7eff27afcb80 1 Processor -- start 2023-10-18T14:06:47.931 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.915+0000 7eff27afcb80 1 -- start start 2023-10-18T14:06:47.932 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.915+0000 7eff27afcb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1630 0x5617944d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.932 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff27afcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944d1f50 0x5617944cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.932 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff27afcb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944cc410 0x5617944cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.932 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff27afcb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56179443f680 con 0x5617944cc410 2023-10-18T14:06:47.933 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff27afcb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794425c00 con 0x5617944d1630 2023-10-18T14:06:47.933 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff27afcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794423520 con 0x5617944d1f50 2023-10-18T14:06:47.933 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff19eb0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944cc410 0x5617944cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.933 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff19eb0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944cc410 0x5617944cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45976/0 (socket says 172.21.15.114:45976) 2023-10-18T14:06:47.934 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff19eb0700 1 -- 172.21.15.114:0/253391134 learned_addr learned my addr 172.21.15.114:0/253391134 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:47.934 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff196af700 1 --2- 172.21.15.114:0/253391134 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1630 0x5617944d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.934 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff18eae700 1 --2- 172.21.15.114:0/253391134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944d1f50 0x5617944cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.934 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff19eb0700 1 -- 172.21.15.114:0/253391134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944d1f50 msgr2=0x5617944cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:47.935 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff19eb0700 1 --2- 172.21.15.114:0/253391134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944d1f50 0x5617944cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.935 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff19eb0700 1 -- 172.21.15.114:0/253391134 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1630 msgr2=0x5617944d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:47.935 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff19eb0700 1 --2- 172.21.15.114:0/253391134 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1630 0x5617944d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.935 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff19eb0700 1 -- 172.21.15.114:0/253391134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617943dc390 con 0x5617944cc410 2023-10-18T14:06:47.936 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7eff19eb0700 1 --2- 172.21.15.114:0/253391134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944cc410 0x5617944cc870 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009550 tx=0x7eff0c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1ec9555fefb409 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:47.936 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7efeff7fe700 1 -- 172.21.15.114:0/253391134 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c003c00 con 0x5617944cc410 2023-10-18T14:06:47.936 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7efeff7fe700 1 -- 172.21.15.114:0/253391134 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff0c007e30 con 0x5617944cc410 2023-10-18T14:06:47.936 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.916+0000 7efeff7fe700 1 -- 172.21.15.114:0/253391134 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c004390 con 0x5617944cc410 2023-10-18T14:06:47.937 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.917+0000 7eff27afcb80 1 -- 172.21.15.114:0/253391134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944cc410 msgr2=0x5617944cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:47.937 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.917+0000 7eff27afcb80 1 --2- 172.21.15.114:0/253391134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944cc410 0x5617944cc870 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009550 tx=0x7eff0c009920 comp rx=0 tx=0).stop 2023-10-18T14:06:47.937 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.917+0000 7eff27afcb80 1 -- 172.21.15.114:0/253391134 shutdown_connections 2023-10-18T14:06:47.937 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.917+0000 7eff27afcb80 1 --2- 172.21.15.114:0/253391134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944cc410 0x5617944cc870 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.917+0000 7eff27afcb80 1 --2- 172.21.15.114:0/253391134 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1630 0x5617944d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.917+0000 7eff27afcb80 1 --2- 172.21.15.114:0/253391134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944d1f50 0x5617944cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.917+0000 7eff27afcb80 1 -- 172.21.15.114:0/253391134 >> 172.21.15.114:0/253391134 conn(0x5617944406c0 msgr2=0x5617944c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.917+0000 7eff27afcb80 1 -- 172.21.15.114:0/253391134 shutdown_connections 2023-10-18T14:06:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.917+0000 7eff27afcb80 1 -- 172.21.15.114:0/253391134 wait complete. 2023-10-18T14:06:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff27afcb80 1 -- start start 2023-10-18T14:06:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff27afcb80 1 Processor -- start 2023-10-18T14:06:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff27afcb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944cc410 0x5617944d7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff27afcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944d1630 0x5617944d5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff27afcb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1f50 0x5617944d58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff27afcb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56179441ee10 con 0x5617944d1f50 2023-10-18T14:06:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff27afcb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617943bb6b0 con 0x5617944cc410 2023-10-18T14:06:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff27afcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617943bb350 con 0x5617944d1630 2023-10-18T14:06:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff27afcb80 10 client.0 _ll_register_callbacks cb 0x561794305a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:06:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff19eb0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1f50 0x5617944d58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff19eb0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1f50 0x5617944d58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45982/0 (socket says 172.21.15.114:45982) 2023-10-18T14:06:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff19eb0700 1 -- 172.21.15.114:0/4158009797 learned_addr learned my addr 172.21.15.114:0/4158009797 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff196af700 1 --2- 172.21.15.114:0/4158009797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944cc410 0x5617944d7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.918+0000 7eff18eae700 1 --2- 172.21.15.114:0/4158009797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944d1630 0x5617944d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7eff19eb0700 1 -- 172.21.15.114:0/4158009797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944d1630 msgr2=0x5617944d5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7eff19eb0700 1 --2- 172.21.15.114:0/4158009797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944d1630 0x5617944d5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7eff19eb0700 1 -- 172.21.15.114:0/4158009797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944cc410 msgr2=0x5617944d7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7eff19eb0700 1 --2- 172.21.15.114:0/4158009797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944cc410 0x5617944d7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7eff19eb0700 1 -- 172.21.15.114:0/4158009797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c009200 con 0x5617944d1f50 2023-10-18T14:06:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7eff19eb0700 1 --2- 172.21.15.114:0/4158009797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1f50 0x5617944d58a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7eff0c012870 tx=0x7eff0c012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff4a1b60b79a249 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7efefcff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:06:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7efefcff9700 1 -- 172.21.15.114:0/4158009797 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c005240 con 0x5617944d1f50 2023-10-18T14:06:47.944 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7eff27afcb80 1 -- 172.21.15.114:0/4158009797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561794423e90 con 0x5617944d1f50 2023-10-18T14:06:47.944 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7efefcff9700 1 -- 172.21.15.114:0/4158009797 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7eff0c0053a0 con 0x5617944d1f50 2023-10-18T14:06:47.944 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7efefcff9700 1 -- 172.21.15.114:0/4158009797 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff0c005560 con 0x5617944d1f50 2023-10-18T14:06:47.944 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7eff27afcb80 10 client.16392 fetch_fsmap learned FSMap version 34 2023-10-18T14:06:47.945 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7eff27afcb80 1 -- 172.21.15.114:0/4158009797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x561794249d80 con 0x5617944d1f50 2023-10-18T14:06:47.945 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7efefcff9700 1 -- 172.21.15.114:0/4158009797 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561794423e90 con 0x5617944d1f50 2023-10-18T14:06:47.945 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7efefcff9700 1 -- 172.21.15.114:0/4158009797 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7eff0c01a8f0 con 0x5617944d1f50 2023-10-18T14:06:47.945 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7eff27afcb80 10 client.16392 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:06:47.946 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.919+0000 7eff27afcb80 10 client.16392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:06:47.946 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.920+0000 7eff27afcb80 20 client.16392 populate_metadata read hostname 'smithi114' 2023-10-18T14:06:47.946 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.920+0000 7eff27afcb80 1 --2- 172.21.15.114:0/4158009797 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5617944e5830 0x5617944e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.946 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.920+0000 7eff27afcb80 4 client.16392 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:06:47.947 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.920+0000 7eff27afcb80 1 -- 172.21.15.114:0/4158009797 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56179449b850 con 0x5617944e5830 2023-10-18T14:06:47.947 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.920+0000 7eff196af700 1 --2- 172.21.15.114:0/4158009797 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5617944e5830 0x5617944e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.947 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.920+0000 7eff196af700 1 --2- 172.21.15.114:0/4158009797 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5617944e5830 0x5617944e7c50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd820a0592bb6b70 server_cookie=d3da2c6261caa5c5 in_seq=0 out_seq=0 2023-10-18T14:06:47.948 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.920+0000 7efefcff9700 10 client.16392 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:47.948 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.922+0000 7efefcff9700 1 -- 172.21.15.114:0/4158009797 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56179449b850 con 0x5617944e5830 2023-10-18T14:06:47.948 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.922+0000 7efefcff9700 10 client.16392 handle_command_reply: tid=0 2023-10-18T14:06:47.948 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.922+0000 7eff27afcb80 1 client.16392 shutdown 2023-10-18T14:06:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.922+0000 7eff27afcb80 1 -- 172.21.15.114:0/4158009797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1f50 msgr2=0x5617944d58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.922+0000 7eff27afcb80 1 --2- 172.21.15.114:0/4158009797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1f50 0x5617944d58a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7eff0c012870 tx=0x7eff0c012950 comp rx=0 tx=0).stop 2023-10-18T14:06:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.922+0000 7eff27afcb80 1 -- 172.21.15.114:0/4158009797 shutdown_connections 2023-10-18T14:06:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.922+0000 7eff27afcb80 1 --2- 172.21.15.114:0/4158009797 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x5617944e5830 0x5617944e7c50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.922+0000 7eff27afcb80 1 --2- 172.21.15.114:0/4158009797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1f50 0x5617944d58a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.922+0000 7efefcff9700 0 client.16392 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.922+0000 7eff27afcb80 1 --2- 172.21.15.114:0/4158009797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944cc410 0x5617944d7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.922+0000 7eff27afcb80 1 --2- 172.21.15.114:0/4158009797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944d1630 0x5617944d5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.922+0000 7eff27afcb80 1 -- 172.21.15.114:0/4158009797 >> 172.21.15.114:0/4158009797 conn(0x5617944406c0 msgr2=0x5617944c5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.923+0000 7eff27afcb80 1 -- 172.21.15.114:0/4158009797 shutdown_connections 2023-10-18T14:06:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.923+0000 7eff27afcb80 1 -- 172.21.15.114:0/4158009797 wait complete. 2023-10-18T14:06:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.923+0000 7eff27afcb80 20 client.16392 trim_cache size 0 max 16384 2023-10-18T14:06:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff27afcb80 1 Processor -- start 2023-10-18T14:06:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff27afcb80 1 -- start start 2023-10-18T14:06:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff27afcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944cc410 0x5617944cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff27afcb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 0x5617944d57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff27afcb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1f50 0x5617944e1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff27afcb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56179429f8c0 con 0x5617944d1630 2023-10-18T14:06:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff27afcb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794423e90 con 0x5617944d1f50 2023-10-18T14:06:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff27afcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617944d61b0 con 0x5617944cc410 2023-10-18T14:06:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff18eae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 0x5617944d57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff19eb0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1f50 0x5617944e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff18eae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 0x5617944d57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45988/0 (socket says 172.21.15.114:45988) 2023-10-18T14:06:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff18eae700 1 -- 172.21.15.114:0/2331037109 learned_addr learned my addr 172.21.15.114:0/2331037109 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff196af700 1 --2- 172.21.15.114:0/2331037109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944cc410 0x5617944cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff19eb0700 1 -- 172.21.15.114:0/2331037109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944cc410 msgr2=0x5617944cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff19eb0700 1 --2- 172.21.15.114:0/2331037109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944cc410 0x5617944cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff19eb0700 1 -- 172.21.15.114:0/2331037109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 msgr2=0x5617944d57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff19eb0700 1 --2- 172.21.15.114:0/2331037109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 0x5617944d57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff19eb0700 1 -- 172.21.15.114:0/2331037109 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561794232c00 con 0x5617944d1f50 2023-10-18T14:06:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff18eae700 1 --2- 172.21.15.114:0/2331037109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 0x5617944d57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7eff19eb0700 1 --2- 172.21.15.114:0/2331037109 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1f50 0x5617944e1790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009180 tx=0x7eff0c02c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4ba729fa6908dc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7efefffff700 1 -- 172.21.15.114:0/2331037109 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c012a70 con 0x5617944d1f50 2023-10-18T14:06:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7efefffff700 1 -- 172.21.15.114:0/2331037109 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff0c027020 con 0x5617944d1f50 2023-10-18T14:06:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.940+0000 7efefffff700 1 -- 172.21.15.114:0/2331037109 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c02c9b0 con 0x5617944d1f50 2023-10-18T14:06:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.941+0000 7eff27afcb80 1 -- 172.21.15.114:0/2331037109 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1f50 msgr2=0x5617944e1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.941+0000 7eff27afcb80 1 --2- 172.21.15.114:0/2331037109 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1f50 0x5617944e1790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009180 tx=0x7eff0c02c4a0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.941+0000 7eff27afcb80 1 -- 172.21.15.114:0/2331037109 shutdown_connections 2023-10-18T14:06:47.962 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.941+0000 7eff27afcb80 1 --2- 172.21.15.114:0/2331037109 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1f50 0x5617944e1790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.962 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.941+0000 7eff27afcb80 1 --2- 172.21.15.114:0/2331037109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944cc410 0x5617944cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.962 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.941+0000 7eff27afcb80 1 --2- 172.21.15.114:0/2331037109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 0x5617944d57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.962 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.941+0000 7eff27afcb80 1 -- 172.21.15.114:0/2331037109 >> 172.21.15.114:0/2331037109 conn(0x5617944406c0 msgr2=0x5617944e1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:47.962 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.941+0000 7eff27afcb80 1 -- 172.21.15.114:0/2331037109 shutdown_connections 2023-10-18T14:06:47.963 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.941+0000 7eff27afcb80 1 -- 172.21.15.114:0/2331037109 wait complete. 2023-10-18T14:06:47.963 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.941+0000 7eff27afcb80 1 -- start start 2023-10-18T14:06:47.963 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.941+0000 7eff27afcb80 1 Processor -- start 2023-10-18T14:06:47.963 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff27afcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944cc410 0x5617944dbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.963 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff27afcb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 0x5617944dc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff27afcb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1f50 0x561794538640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff27afcb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617944dc9a0 con 0x5617944d1630 2023-10-18T14:06:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff27afcb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794538b80 con 0x5617944d1f50 2023-10-18T14:06:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff27afcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794538cc0 con 0x5617944cc410 2023-10-18T14:06:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff27afcb80 10 client.0 _ll_register_callbacks cb 0x561794305a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:06:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff18eae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 0x5617944dc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff18eae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 0x5617944dc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45994/0 (socket says 172.21.15.114:45994) 2023-10-18T14:06:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff18eae700 1 -- 172.21.15.114:0/512111652 learned_addr learned my addr 172.21.15.114:0/512111652 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:06:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff196af700 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944cc410 0x5617944dbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff19eb0700 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1f50 0x561794538640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff18eae700 1 -- 172.21.15.114:0/512111652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944cc410 msgr2=0x5617944dbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff18eae700 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944cc410 0x5617944dbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff18eae700 1 -- 172.21.15.114:0/512111652 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1f50 msgr2=0x561794538640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:06:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff18eae700 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1f50 0x561794538640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff18eae700 1 -- 172.21.15.114:0/512111652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1410cd90 con 0x5617944d1630 2023-10-18T14:06:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff196af700 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944cc410 0x5617944dbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:06:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7eff18eae700 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 0x5617944dc090 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7eff040059d0 tx=0x7eff04009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd720ffba12a68f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:06:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7efefcff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:06:47.968 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.942+0000 7efefcff9700 1 -- 172.21.15.114:0/512111652 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04004e80 con 0x5617944d1630 2023-10-18T14:06:47.968 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7efefcff9700 1 -- 172.21.15.114:0/512111652 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7eff0400f460 con 0x5617944d1630 2023-10-18T14:06:47.968 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7eff27afcb80 1 -- 172.21.15.114:0/512111652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff0c007e30 con 0x5617944d1630 2023-10-18T14:06:47.968 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7efefcff9700 1 -- 172.21.15.114:0/512111652 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff0400f620 con 0x5617944d1630 2023-10-18T14:06:47.968 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7eff27afcb80 10 client.16398 fetch_fsmap learned FSMap version 34 2023-10-18T14:06:47.968 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7eff27afcb80 1 -- 172.21.15.114:0/512111652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7eff0c012e70 con 0x5617944d1630 2023-10-18T14:06:47.969 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7efefcff9700 1 -- 172.21.15.114:0/512111652 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff0c007e30 con 0x5617944d1630 2023-10-18T14:06:47.969 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7efefcff9700 1 -- 172.21.15.114:0/512111652 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7eff040337f0 con 0x5617944d1630 2023-10-18T14:06:47.969 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7eff27afcb80 10 client.16398 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:06:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7eff27afcb80 10 client.16398 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:06:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7eff27afcb80 20 client.16398 populate_metadata read hostname 'smithi114' 2023-10-18T14:06:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7eff27afcb80 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56179453a420 0x56179453c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:06:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7eff27afcb80 4 client.16398 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:06:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7eff27afcb80 1 -- 172.21.15.114:0/512111652 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561794417df0 con 0x56179453a420 2023-10-18T14:06:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.943+0000 7eff196af700 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56179453a420 0x56179453c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:06:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.944+0000 7efefcff9700 10 client.16398 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:47.971 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.944+0000 7eff196af700 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56179453a420 0x56179453c840 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81160cbb98e6740 server_cookie=57d54f078b1b0f5c in_seq=0 out_seq=0 2023-10-18T14:06:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7efefcff9700 1 -- 172.21.15.114:0/512111652 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561794417df0 con 0x56179453a420 2023-10-18T14:06:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7efefcff9700 10 client.16398 handle_command_reply: tid=0 2023-10-18T14:06:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7eff27afcb80 1 client.16398 shutdown 2023-10-18T14:06:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7eff27afcb80 1 -- 172.21.15.114:0/512111652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 msgr2=0x5617944dc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7eff27afcb80 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 0x5617944dc090 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7eff040059d0 tx=0x7eff04009ca0 comp rx=0 tx=0).stop 2023-10-18T14:06:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7eff27afcb80 1 -- 172.21.15.114:0/512111652 shutdown_connections 2023-10-18T14:06:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7eff27afcb80 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56179453a420 0x56179453c840 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7eff27afcb80 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x5617944d1f50 0x561794538640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7eff27afcb80 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617944cc410 0x5617944dbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7eff27afcb80 1 --2- 172.21.15.114:0/512111652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5617944d1630 0x5617944dc090 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7eff27afcb80 1 -- 172.21.15.114:0/512111652 >> 172.21.15.114:0/512111652 conn(0x5617944406c0 msgr2=0x5617944d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7efefcff9700 0 client.16398 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:06:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7eff27afcb80 1 -- 172.21.15.114:0/512111652 shutdown_connections 2023-10-18T14:06:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7eff27afcb80 1 -- 172.21.15.114:0/512111652 wait complete. 2023-10-18T14:06:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.998+0000 7eff27afcb80 20 client.16398 trim_cache size 0 max 16384 2023-10-18T14:06:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:06:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:06:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:06:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:06:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.999+0000 7eff1b913700 1 -- 172.21.15.114:0/3296615197 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7eff000a15f0 msgr2=0x7eff000a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.999+0000 7eff1b913700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7eff000a15f0 0x7eff000a3ab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7eff0400b2e0 tx=0x7eff04005960 comp rx=0 tx=0).stop 2023-10-18T14:06:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.999+0000 7eff1b913700 1 -- 172.21.15.114:0/3296615197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff140ff5d0 msgr2=0x7eff1419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:06:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.999+0000 7eff1b913700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff140ff5d0 0x7eff1419a5d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7eff10009c70 tx=0x7eff10009f80 comp rx=0 tx=0).stop 2023-10-18T14:06:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.999+0000 7eff1b913700 1 -- 172.21.15.114:0/3296615197 shutdown_connections 2023-10-18T14:06:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.999+0000 7eff1b913700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7eff000a15f0 0x7eff000a3ab0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.999+0000 7eff1b913700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff141045e0 0x7eff14194700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.999+0000 7eff1b913700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff140ff5d0 0x7eff1419a5d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.999+0000 7eff1b913700 1 --2- 172.21.15.114:0/3296615197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff140fff90 0x7eff1419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:06:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.999+0000 7eff1b913700 1 -- 172.21.15.114:0/3296615197 >> 172.21.15.114:0/3296615197 conn(0x7eff14076790 msgr2=0x7eff140fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:06:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.999+0000 7eff1b913700 1 -- 172.21.15.114:0/3296615197 shutdown_connections 2023-10-18T14:06:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:06:47.999+0000 7eff1b913700 1 -- 172.21.15.114:0/3296615197 wait complete. 2023-10-18T14:06:49.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:48 smithi158 ceph-mon[103317]: pgmap v364: 97 pgs: 97 active+clean; 48 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.5 MiB/s wr, 451 op/s 2023-10-18T14:06:49.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:48 smithi172 ceph-mon[103574]: pgmap v364: 97 pgs: 97 active+clean; 48 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.5 MiB/s wr, 451 op/s 2023-10-18T14:06:49.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:48 smithi114 ceph-mon[99494]: pgmap v364: 97 pgs: 97 active+clean; 48 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.5 MiB/s wr, 451 op/s 2023-10-18T14:06:49.553 INFO:tasks.workunit.client.0.smithi114.stdout:10000 copy from 0x2ab252 to 0x2b6f08, (0xbcb6 bytes) at 0x1cd955 2023-10-18T14:06:51.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:50 smithi158 ceph-mon[103317]: pgmap v365: 97 pgs: 97 active+clean; 52 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.2 MiB/s wr, 774 op/s 2023-10-18T14:06:51.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:50 smithi172 ceph-mon[103574]: pgmap v365: 97 pgs: 97 active+clean; 52 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.2 MiB/s wr, 774 op/s 2023-10-18T14:06:51.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:50 smithi114 ceph-mon[99494]: pgmap v365: 97 pgs: 97 active+clean; 52 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.2 MiB/s wr, 774 op/s 2023-10-18T14:06:53.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:52 smithi158 ceph-mon[103317]: pgmap v366: 97 pgs: 97 active+clean; 52 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.1 MiB/s wr, 603 op/s 2023-10-18T14:06:53.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:52 smithi172 ceph-mon[103574]: pgmap v366: 97 pgs: 97 active+clean; 52 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.1 MiB/s wr, 603 op/s 2023-10-18T14:06:53.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:52 smithi114 ceph-mon[99494]: pgmap v366: 97 pgs: 97 active+clean; 52 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 3.1 MiB/s wr, 603 op/s 2023-10-18T14:06:54.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:54 smithi114 ceph-mon[99494]: pgmap v367: 97 pgs: 97 active+clean; 51 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.9 MiB/s wr, 791 op/s 2023-10-18T14:06:54.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:54 smithi158 ceph-mon[103317]: pgmap v367: 97 pgs: 97 active+clean; 51 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.9 MiB/s wr, 791 op/s 2023-10-18T14:06:54.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:54 smithi172 ceph-mon[103574]: pgmap v367: 97 pgs: 97 active+clean; 51 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.9 MiB/s wr, 791 op/s 2023-10-18T14:06:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:56 smithi158 ceph-mon[103317]: pgmap v368: 97 pgs: 97 active+clean; 53 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 3.7 MiB/s wr, 748 op/s 2023-10-18T14:06:57.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:56 smithi172 ceph-mon[103574]: pgmap v368: 97 pgs: 97 active+clean; 53 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 3.7 MiB/s wr, 748 op/s 2023-10-18T14:06:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:56 smithi114 ceph-mon[99494]: pgmap v368: 97 pgs: 97 active+clean; 53 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 3.7 MiB/s wr, 748 op/s 2023-10-18T14:06:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:06:58 smithi158 ceph-mon[103317]: pgmap v369: 97 pgs: 97 active+clean; 53 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 3.2 MiB/s wr, 659 op/s 2023-10-18T14:06:59.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:06:58 smithi172 ceph-mon[103574]: pgmap v369: 97 pgs: 97 active+clean; 53 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 3.2 MiB/s wr, 659 op/s 2023-10-18T14:06:59.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:06:58 smithi114 ceph-mon[99494]: pgmap v369: 97 pgs: 97 active+clean; 53 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 3.2 MiB/s wr, 659 op/s 2023-10-18T14:07:01.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:00 smithi158 ceph-mon[103317]: pgmap v370: 97 pgs: 97 active+clean; 53 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 4.7 MiB/s wr, 976 op/s 2023-10-18T14:07:01.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:00 smithi172 ceph-mon[103574]: pgmap v370: 97 pgs: 97 active+clean; 53 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 4.7 MiB/s wr, 976 op/s 2023-10-18T14:07:01.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:00 smithi114 ceph-mon[99494]: pgmap v370: 97 pgs: 97 active+clean; 53 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 4.7 MiB/s wr, 976 op/s 2023-10-18T14:07:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.118+0000 7fe3a6f7b700 1 -- 172.21.15.114:0/2788025355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a0103fe0 msgr2=0x7fe3a010bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.118+0000 7fe3a6f7b700 1 --2- 172.21.15.114:0/2788025355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a0103fe0 0x7fe3a010bb60 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe39800c210 tx=0x7fe39800c520 comp rx=0 tx=0).stop 2023-10-18T14:07:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.118+0000 7fe3a6f7b700 1 -- 172.21.15.114:0/2788025355 shutdown_connections 2023-10-18T14:07:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.118+0000 7fe3a6f7b700 1 --2- 172.21.15.114:0/2788025355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a0103fe0 0x7fe3a010bb60 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.118+0000 7fe3a6f7b700 1 --2- 172.21.15.114:0/2788025355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3a00feec0 0x7fe3a00ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.118+0000 7fe3a6f7b700 1 --2- 172.21.15.114:0/2788025355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3a00ff870 0x7fe3a01038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.123 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.118+0000 7fe3a6f7b700 1 -- 172.21.15.114:0/2788025355 >> 172.21.15.114:0/2788025355 conn(0x7fe3a0075b10 msgr2=0x7fe3a00fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:01.123 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.118+0000 7fe3a6f7b700 1 -- 172.21.15.114:0/2788025355 shutdown_connections 2023-10-18T14:07:01.123 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.118+0000 7fe3a6f7b700 1 -- 172.21.15.114:0/2788025355 wait complete. 2023-10-18T14:07:01.125 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe3a6f7b700 1 Processor -- start 2023-10-18T14:07:01.125 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe3a6f7b700 1 -- start start 2023-10-18T14:07:01.126 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe3a6f7b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3a00feec0 0x7fe3a019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.126 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe3a6f7b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a0103fe0 0x7fe3a019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.126 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe3a6f7b700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3a01947f0 0x7fe3a0194c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.126 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe3a6f7b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0195280 con 0x7fe3a0103fe0 2023-10-18T14:07:01.127 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe3a6f7b700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a01953f0 con 0x7fe3a01947f0 2023-10-18T14:07:01.127 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe3a6f7b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a01955b0 con 0x7fe3a00feec0 2023-10-18T14:07:01.127 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a0103fe0 0x7fe3a019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.127 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe3a4d17700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3a00feec0 0x7fe3a019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.127 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe3a4d17700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3a00feec0 0x7fe3a019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:49942/0 (socket says 172.21.15.114:49942) 2023-10-18T14:07:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a0103fe0 0x7fe3a019abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46008/0 (socket says 172.21.15.114:46008) 2023-10-18T14:07:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe3a4d17700 1 -- 172.21.15.114:0/4060376185 learned_addr learned my addr 172.21.15.114:0/4060376185 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.119+0000 7fe3a5518700 1 --2- 172.21.15.114:0/4060376185 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3a01947f0 0x7fe3a0194c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.120+0000 7fe39ffff700 1 -- 172.21.15.114:0/4060376185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3a00feec0 msgr2=0x7fe3a019a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.120+0000 7fe39ffff700 1 --2- 172.21.15.114:0/4060376185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3a00feec0 0x7fe3a019a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.120+0000 7fe39ffff700 1 -- 172.21.15.114:0/4060376185 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3a01947f0 msgr2=0x7fe3a0194c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.120+0000 7fe39ffff700 1 --2- 172.21.15.114:0/4060376185 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3a01947f0 0x7fe3a0194c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.120+0000 7fe39ffff700 1 -- 172.21.15.114:0/4060376185 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39800ae10 con 0x7fe3a0103fe0 2023-10-18T14:07:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.120+0000 7fe39ffff700 1 --2- 172.21.15.114:0/4060376185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a0103fe0 0x7fe3a019abe0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00e9c0 tx=0x7fe38c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.120+0000 7fe39dffb700 1 -- 172.21.15.114:0/4060376185 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00c9c0 con 0x7fe3a0103fe0 2023-10-18T14:07:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.120+0000 7fe39dffb700 1 -- 172.21.15.114:0/4060376185 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe38c010430 con 0x7fe3a0103fe0 2023-10-18T14:07:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.120+0000 7fe3a6f7b700 1 -- 172.21.15.114:0/4060376185 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a01a1550 con 0x7fe3a0103fe0 2023-10-18T14:07:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.120+0000 7fe39dffb700 1 -- 172.21.15.114:0/4060376185 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c018680 con 0x7fe3a0103fe0 2023-10-18T14:07:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.120+0000 7fe3a6f7b700 1 -- 172.21.15.114:0/4060376185 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a01a1ab0 con 0x7fe3a0103fe0 2023-10-18T14:07:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.123+0000 7fe39dffb700 1 -- 172.21.15.114:0/4060376185 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fe38c0187e0 con 0x7fe3a0103fe0 2023-10-18T14:07:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.123+0000 7fe39dffb700 1 --2- 172.21.15.114:0/4060376185 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe3900a1660 0x7fe3900a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.123+0000 7fe39dffb700 1 -- 172.21.15.114:0/4060376185 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe38c014070 con 0x7fe3a0103fe0 2023-10-18T14:07:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.124+0000 7fe3a4d17700 1 --2- 172.21.15.114:0/4060376185 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe3900a1660 0x7fe3900a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.124+0000 7fe3b3164b80 1 Processor -- start 2023-10-18T14:07:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.124+0000 7fe3a4d17700 1 --2- 172.21.15.114:0/4060376185 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe3900a1660 0x7fe3900a3b20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe394009d20 tx=0x7fe394009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.124+0000 7fe3b3164b80 1 -- start start 2023-10-18T14:07:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.124+0000 7fe3b3164b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83630 0x555fc2d83a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.124+0000 7fe3b3164b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 0x555fc2d7ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.124+0000 7fe3b3164b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d7e410 0x555fc2d7e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.124+0000 7fe3b3164b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc2cf1680 con 0x555fc2d83f50 2023-10-18T14:07:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.124+0000 7fe3b3164b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc2cd7c00 con 0x555fc2d83630 2023-10-18T14:07:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.124+0000 7fe3b3164b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc2cd5520 con 0x555fc2d7e410 2023-10-18T14:07:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 0x555fc2d7ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 0x555fc2d7ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46016/0 (socket says 172.21.15.114:46016) 2023-10-18T14:07:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe3a4d17700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83630 0x555fc2d83a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe39ffff700 1 -- 172.21.15.114:0/4233289927 learned_addr learned my addr 172.21.15.114:0/4233289927 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe3a5518700 1 --2- 172.21.15.114:0/4233289927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d7e410 0x555fc2d7e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe39ffff700 1 -- 172.21.15.114:0/4233289927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d7e410 msgr2=0x555fc2d7e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe39ffff700 1 --2- 172.21.15.114:0/4233289927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d7e410 0x555fc2d7e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe39ffff700 1 -- 172.21.15.114:0/4233289927 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83630 msgr2=0x555fc2d83a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe39ffff700 1 --2- 172.21.15.114:0/4233289927 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83630 0x555fc2d83a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe39ffff700 1 -- 172.21.15.114:0/4233289927 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fc2c8e390 con 0x555fc2d83f50 2023-10-18T14:07:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe3a4d17700 1 --2- 172.21.15.114:0/4233289927 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83630 0x555fc2d83a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe39ffff700 1 --2- 172.21.15.114:0/4233289927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 0x555fc2d7ded0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe38c09a100 tx=0x7fe38c099d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8566d2212d41f4eb server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe38affd700 1 -- 172.21.15.114:0/4233289927 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c09a170 con 0x555fc2d83f50 2023-10-18T14:07:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe38affd700 1 -- 172.21.15.114:0/4233289927 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe38c09e2c0 con 0x555fc2d83f50 2023-10-18T14:07:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.125+0000 7fe38affd700 1 -- 172.21.15.114:0/4233289927 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c09a3d0 con 0x555fc2d83f50 2023-10-18T14:07:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.126+0000 7fe3b3164b80 1 -- 172.21.15.114:0/4233289927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 msgr2=0x555fc2d7ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:01.142 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.126+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/4233289927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 0x555fc2d7ded0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe38c09a100 tx=0x7fe38c099d30 comp rx=0 tx=0).stop 2023-10-18T14:07:01.142 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.126+0000 7fe3b3164b80 1 -- 172.21.15.114:0/4233289927 shutdown_connections 2023-10-18T14:07:01.142 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.126+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/4233289927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d7e410 0x555fc2d7e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.142 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.126+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/4233289927 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83630 0x555fc2d83a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.142 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.126+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/4233289927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 0x555fc2d7ded0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.126+0000 7fe3b3164b80 1 -- 172.21.15.114:0/4233289927 >> 172.21.15.114:0/4233289927 conn(0x555fc2cf26c0 msgr2=0x555fc2d785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.127+0000 7fe3b3164b80 1 -- 172.21.15.114:0/4233289927 shutdown_connections 2023-10-18T14:07:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.127+0000 7fe3b3164b80 1 -- 172.21.15.114:0/4233289927 wait complete. 2023-10-18T14:07:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.127+0000 7fe3b3164b80 1 -- start start 2023-10-18T14:07:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.127+0000 7fe3b3164b80 1 Processor -- start 2023-10-18T14:07:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3b3164b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d7e410 0x555fc2d89f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3b3164b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d83630 0x555fc2d87240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3b3164b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 0x555fc2d87980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3b3164b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc2cd0e10 con 0x555fc2d83f50 2023-10-18T14:07:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3b3164b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc2c6d6b0 con 0x555fc2d7e410 2023-10-18T14:07:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3b3164b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc2c6d350 con 0x555fc2d83630 2023-10-18T14:07:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3b3164b80 10 client.0 _ll_register_callbacks cb 0x555fc2bb7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3a5518700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 0x555fc2d87980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3a5518700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 0x555fc2d87980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46024/0 (socket says 172.21.15.114:46024) 2023-10-18T14:07:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3a5518700 1 -- 172.21.15.114:0/2509463122 learned_addr learned my addr 172.21.15.114:0/2509463122 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3a4d17700 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d7e410 0x555fc2d89f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe39ffff700 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d83630 0x555fc2d87240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3a5518700 1 -- 172.21.15.114:0/2509463122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d83630 msgr2=0x555fc2d87240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:01.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3a5518700 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d83630 0x555fc2d87240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3a5518700 1 -- 172.21.15.114:0/2509463122 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d7e410 msgr2=0x555fc2d89f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:01.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3a5518700 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d7e410 0x555fc2d89f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3a5518700 1 -- 172.21.15.114:0/2509463122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe394017070 con 0x555fc2d83f50 2023-10-18T14:07:01.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3a4d17700 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d7e410 0x555fc2d89f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:01.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3a5518700 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 0x555fc2d87980 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe398008fd0 tx=0x7fe398003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549784a67caee8ff server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:01.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe37ffff700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:07:01.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe37ffff700 1 -- 172.21.15.114:0/2509463122 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39800f040 con 0x555fc2d83f50 2023-10-18T14:07:01.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe3b3164b80 1 -- 172.21.15.114:0/2509463122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555fc2cd5e90 con 0x555fc2d83f50 2023-10-18T14:07:01.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.128+0000 7fe37ffff700 1 -- 172.21.15.114:0/2509463122 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe398023070 con 0x555fc2d83f50 2023-10-18T14:07:01.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.129+0000 7fe37ffff700 1 -- 172.21.15.114:0/2509463122 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe39800ac90 con 0x555fc2d83f50 2023-10-18T14:07:01.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.129+0000 7fe3b3164b80 10 client.16410 fetch_fsmap learned FSMap version 34 2023-10-18T14:07:01.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.129+0000 7fe3b3164b80 1 -- 172.21.15.114:0/2509463122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7fe3a01a1ab0 con 0x555fc2d83f50 2023-10-18T14:07:01.149 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.129+0000 7fe37ffff700 1 -- 172.21.15.114:0/2509463122 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555fc2cd5e90 con 0x555fc2d83f50 2023-10-18T14:07:01.149 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.129+0000 7fe37ffff700 1 -- 172.21.15.114:0/2509463122 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fe39800c240 con 0x555fc2d83f50 2023-10-18T14:07:01.149 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.129+0000 7fe3b3164b80 10 client.16410 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:07:01.149 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.129+0000 7fe3b3164b80 10 client.16410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:01.149 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.129+0000 7fe3b3164b80 20 client.16410 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:01.150 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.129+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x555fc2d97a50 0x555fc2d99e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.150 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.129+0000 7fe3b3164b80 4 client.16410 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:07:01.150 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.129+0000 7fe3b3164b80 1 -- 172.21.15.114:0/2509463122 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555fc2d4d850 con 0x555fc2d97a50 2023-10-18T14:07:01.150 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.129+0000 7fe3a4d17700 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x555fc2d97a50 0x555fc2d99e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.150 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.130+0000 7fe37ffff700 10 client.16410 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:01.151 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.130+0000 7fe3a4d17700 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x555fc2d97a50 0x555fc2d99e70 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee63ca6b79714c3d server_cookie=ab6edcdfc914f424 in_seq=0 out_seq=0 2023-10-18T14:07:01.151 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.130+0000 7fe37ffff700 1 -- 172.21.15.114:0/2509463122 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555fc2d4d850 con 0x555fc2d97a50 2023-10-18T14:07:01.151 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.130+0000 7fe37ffff700 10 client.16410 handle_command_reply: tid=0 2023-10-18T14:07:01.151 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.130+0000 7fe3b3164b80 1 client.16410 shutdown 2023-10-18T14:07:01.151 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.131+0000 7fe3b3164b80 1 -- 172.21.15.114:0/2509463122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 msgr2=0x555fc2d87980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:01.152 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.131+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 0x555fc2d87980 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe398008fd0 tx=0x7fe398003c30 comp rx=0 tx=0).stop 2023-10-18T14:07:01.152 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.131+0000 7fe3b3164b80 1 -- 172.21.15.114:0/2509463122 shutdown_connections 2023-10-18T14:07:01.152 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.131+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x555fc2d97a50 0x555fc2d99e70 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.152 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.131+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83f50 0x555fc2d87980 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.152 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.131+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d7e410 0x555fc2d89f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.131+0000 7fe37ffff700 0 client.16410 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:01.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.131+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/2509463122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d83630 0x555fc2d87240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.131+0000 7fe3b3164b80 1 -- 172.21.15.114:0/2509463122 >> 172.21.15.114:0/2509463122 conn(0x555fc2cf26c0 msgr2=0x555fc2d77d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:01.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.131+0000 7fe3b3164b80 1 -- 172.21.15.114:0/2509463122 shutdown_connections 2023-10-18T14:07:01.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.131+0000 7fe3b3164b80 1 -- 172.21.15.114:0/2509463122 wait complete. 2023-10-18T14:07:01.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.131+0000 7fe3b3164b80 20 client.16410 trim_cache size 0 max 16384 2023-10-18T14:07:01.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.152+0000 7fe3b3164b80 1 Processor -- start 2023-10-18T14:07:01.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.152+0000 7fe3b3164b80 1 -- start start 2023-10-18T14:07:01.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.152+0000 7fe3b3164b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d7e410 0x555fc2d7ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.152+0000 7fe3b3164b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83630 0x555fc2d82ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.152+0000 7fe3b3164b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d83f50 0x555fc2d784e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.152+0000 7fe3b3164b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc2b518c0 con 0x555fc2d7e410 2023-10-18T14:07:01.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.152+0000 7fe3b3164b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc2d83d90 con 0x555fc2d83630 2023-10-18T14:07:01.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.152+0000 7fe3b3164b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc2d87ce0 con 0x555fc2d83f50 2023-10-18T14:07:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.152+0000 7fe3a4d17700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d7e410 0x555fc2d7ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.152+0000 7fe3a4d17700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d7e410 0x555fc2d7ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46028/0 (socket says 172.21.15.114:46028) 2023-10-18T14:07:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.152+0000 7fe3a4d17700 1 -- 172.21.15.114:0/599815276 learned_addr learned my addr 172.21.15.114:0/599815276 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.152+0000 7fe39ffff700 1 --2- 172.21.15.114:0/599815276 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83630 0x555fc2d82ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.152+0000 7fe3a5518700 1 --2- 172.21.15.114:0/599815276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d83f50 0x555fc2d784e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.160 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.153+0000 7fe3a4d17700 1 -- 172.21.15.114:0/599815276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d83f50 msgr2=0x555fc2d784e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:01.160 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.153+0000 7fe3a4d17700 1 --2- 172.21.15.114:0/599815276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d83f50 0x555fc2d784e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.160 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.153+0000 7fe3a4d17700 1 -- 172.21.15.114:0/599815276 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83630 msgr2=0x555fc2d82ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:01.160 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.153+0000 7fe3a4d17700 1 --2- 172.21.15.114:0/599815276 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83630 0x555fc2d82ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.160 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.153+0000 7fe3a4d17700 1 -- 172.21.15.114:0/599815276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fc2afbd80 con 0x555fc2d7e410 2023-10-18T14:07:01.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.153+0000 7fe3a5518700 1 --2- 172.21.15.114:0/599815276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d83f50 0x555fc2d784e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:07:01.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.153+0000 7fe3a4d17700 1 --2- 172.21.15.114:0/599815276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d7e410 0x555fc2d7ded0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x555fc2d9a760 tx=0x7fe394014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c732faaeab071ec2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:01.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.153+0000 7fe38b7fe700 1 -- 172.21.15.114:0/599815276 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe394023030 con 0x555fc2d7e410 2023-10-18T14:07:01.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.153+0000 7fe38b7fe700 1 -- 172.21.15.114:0/599815276 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe394024040 con 0x555fc2d7e410 2023-10-18T14:07:01.161 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.153+0000 7fe38b7fe700 1 -- 172.21.15.114:0/599815276 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39401daf0 con 0x555fc2d7e410 2023-10-18T14:07:01.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.154+0000 7fe3b3164b80 1 -- 172.21.15.114:0/599815276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d7e410 msgr2=0x555fc2d7ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:01.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.154+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/599815276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d7e410 0x555fc2d7ded0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x555fc2d9a760 tx=0x7fe394014000 comp rx=0 tx=0).stop 2023-10-18T14:07:01.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.154+0000 7fe3b3164b80 1 -- 172.21.15.114:0/599815276 shutdown_connections 2023-10-18T14:07:01.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.154+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/599815276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d83f50 0x555fc2d784e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.162 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.154+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/599815276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d7e410 0x555fc2d7ded0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.154+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/599815276 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83630 0x555fc2d82ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.154+0000 7fe3b3164b80 1 -- 172.21.15.114:0/599815276 >> 172.21.15.114:0/599815276 conn(0x555fc2cf26c0 msgr2=0x555fc2d93080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:01.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.154+0000 7fe3b3164b80 1 -- 172.21.15.114:0/599815276 shutdown_connections 2023-10-18T14:07:01.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.154+0000 7fe3b3164b80 1 -- 172.21.15.114:0/599815276 wait complete. 2023-10-18T14:07:01.163 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.154+0000 7fe3b3164b80 1 -- start start 2023-10-18T14:07:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.154+0000 7fe3b3164b80 1 Processor -- start 2023-10-18T14:07:01.166 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe3b3164b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d7e410 0x555fc2d8cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe3b3164b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83630 0x555fc2d8d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe3b3164b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83f50 0x555fc2dea860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe3b3164b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc2deada0 con 0x555fc2d83630 2023-10-18T14:07:01.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe3b3164b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc2deaee0 con 0x555fc2d83f50 2023-10-18T14:07:01.167 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe3b3164b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc2deb0a0 con 0x555fc2d7e410 2023-10-18T14:07:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe3b3164b80 10 client.0 _ll_register_callbacks cb 0x555fc2bb7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83630 0x555fc2d8d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83630 0x555fc2d8d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46034/0 (socket says 172.21.15.114:46034) 2023-10-18T14:07:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe39ffff700 1 -- 172.21.15.114:0/266024830 learned_addr learned my addr 172.21.15.114:0/266024830 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe3a4d17700 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d7e410 0x555fc2d8cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe3a5518700 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83f50 0x555fc2dea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe39ffff700 1 -- 172.21.15.114:0/266024830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d7e410 msgr2=0x555fc2d8cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:01.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe39ffff700 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d7e410 0x555fc2d8cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe39ffff700 1 -- 172.21.15.114:0/266024830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83f50 msgr2=0x555fc2dea860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:01.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe39ffff700 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83f50 0x555fc2dea860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe39ffff700 1 -- 172.21.15.114:0/266024830 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39401eb40 con 0x555fc2d83630 2023-10-18T14:07:01.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe3a5518700 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83f50 0x555fc2dea860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:07:01.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe39ffff700 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83630 0x555fc2d8d040 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00f010 tx=0x7fe38c098720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5cd2f532c8fa36 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:01.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.155+0000 7fe37ffff700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:07:01.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe37ffff700 1 -- 172.21.15.114:0/266024830 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c09a170 con 0x555fc2d83630 2023-10-18T14:07:01.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe37ffff700 1 -- 172.21.15.114:0/266024830 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fe38c0a2500 con 0x555fc2d83630 2023-10-18T14:07:01.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe3b3164b80 1 -- 172.21.15.114:0/266024830 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe38c09e2c0 con 0x555fc2d83630 2023-10-18T14:07:01.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe37ffff700 1 -- 172.21.15.114:0/266024830 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe38c0b82c0 con 0x555fc2d83630 2023-10-18T14:07:01.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe3b3164b80 10 client.16416 fetch_fsmap learned FSMap version 34 2023-10-18T14:07:01.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe3b3164b80 1 -- 172.21.15.114:0/266024830 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x555fc2ae4c00 con 0x555fc2d83630 2023-10-18T14:07:01.172 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe37ffff700 1 -- 172.21.15.114:0/266024830 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe38c09e2c0 con 0x555fc2d83630 2023-10-18T14:07:01.172 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe37ffff700 1 -- 172.21.15.114:0/266024830 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fe38c0a2070 con 0x555fc2d83630 2023-10-18T14:07:01.172 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe3b3164b80 10 client.16416 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:07:01.172 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe3b3164b80 10 client.16416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:01.172 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe3b3164b80 20 client.16416 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x555fc2dec6b0 0x555fc2deead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe3b3164b80 4 client.16416 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:07:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe3b3164b80 1 -- 172.21.15.114:0/266024830 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555fc2cc9df0 con 0x555fc2dec6b0 2023-10-18T14:07:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.156+0000 7fe3a4d17700 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x555fc2dec6b0 0x555fc2deead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.157+0000 7fe3a4d17700 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x555fc2dec6b0 0x555fc2deead0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3beedb130d26cd44 server_cookie=5f13c7949ada5832 in_seq=0 out_seq=0 2023-10-18T14:07:01.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.157+0000 7fe37ffff700 10 client.16416 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.180+0000 7fe37ffff700 1 -- 172.21.15.114:0/266024830 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555fc2cc9df0 con 0x555fc2dec6b0 2023-10-18T14:07:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.180+0000 7fe37ffff700 10 client.16416 handle_command_reply: tid=0 2023-10-18T14:07:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.180+0000 7fe3b3164b80 1 client.16416 shutdown 2023-10-18T14:07:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.180+0000 7fe3b3164b80 1 -- 172.21.15.114:0/266024830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83630 msgr2=0x555fc2d8d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.180+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83630 0x555fc2d8d040 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00f010 tx=0x7fe38c098720 comp rx=0 tx=0).stop 2023-10-18T14:07:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.183+0000 7fe3b3164b80 1 -- 172.21.15.114:0/266024830 shutdown_connections 2023-10-18T14:07:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.183+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x555fc2dec6b0 0x555fc2deead0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.183+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x555fc2d83f50 0x555fc2dea860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.183+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555fc2d7e410 0x555fc2d8cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.183+0000 7fe37ffff700 0 client.16416 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.183+0000 7fe3b3164b80 1 --2- 172.21.15.114:0/266024830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555fc2d83630 0x555fc2d8d040 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.183+0000 7fe3b3164b80 1 -- 172.21.15.114:0/266024830 >> 172.21.15.114:0/266024830 conn(0x555fc2cf26c0 msgr2=0x555fc2d93910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.183+0000 7fe3b3164b80 1 -- 172.21.15.114:0/266024830 shutdown_connections 2023-10-18T14:07:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.183+0000 7fe3b3164b80 1 -- 172.21.15.114:0/266024830 wait complete. 2023-10-18T14:07:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.183+0000 7fe3b3164b80 20 client.16416 trim_cache size 0 max 16384 2023-10-18T14:07:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:07:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:07:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:07:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:07:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.184+0000 7fe3a6f7b700 1 -- 172.21.15.114:0/4060376185 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe3900a1660 msgr2=0x7fe3900a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.184+0000 7fe3a6f7b700 1 --2- 172.21.15.114:0/4060376185 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe3900a1660 0x7fe3900a3b20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe394009d20 tx=0x7fe394009260 comp rx=0 tx=0).stop 2023-10-18T14:07:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.184+0000 7fe3a6f7b700 1 -- 172.21.15.114:0/4060376185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a0103fe0 msgr2=0x7fe3a019abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.184+0000 7fe3a6f7b700 1 --2- 172.21.15.114:0/4060376185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a0103fe0 0x7fe3a019abe0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00e9c0 tx=0x7fe38c00ecd0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.184+0000 7fe3a6f7b700 1 -- 172.21.15.114:0/4060376185 shutdown_connections 2023-10-18T14:07:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.184+0000 7fe3a6f7b700 1 --2- 172.21.15.114:0/4060376185 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe3900a1660 0x7fe3900a3b20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.184+0000 7fe3a6f7b700 1 --2- 172.21.15.114:0/4060376185 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3a01947f0 0x7fe3a0194c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.184+0000 7fe3a6f7b700 1 --2- 172.21.15.114:0/4060376185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3a00feec0 0x7fe3a019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.184+0000 7fe3a6f7b700 1 --2- 172.21.15.114:0/4060376185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a0103fe0 0x7fe3a019abe0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.184+0000 7fe3a6f7b700 1 -- 172.21.15.114:0/4060376185 >> 172.21.15.114:0/4060376185 conn(0x7fe3a0075b10 msgr2=0x7fe3a00fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.184+0000 7fe3a6f7b700 1 -- 172.21.15.114:0/4060376185 shutdown_connections 2023-10-18T14:07:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:01.184+0000 7fe3a6f7b700 1 -- 172.21.15.114:0/4060376185 wait complete. 2023-10-18T14:07:03.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:02 smithi158 ceph-mon[103317]: pgmap v371: 97 pgs: 97 active+clean; 53 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.1 MiB/s wr, 664 op/s 2023-10-18T14:07:03.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:02 smithi172 ceph-mon[103574]: pgmap v371: 97 pgs: 97 active+clean; 53 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.1 MiB/s wr, 664 op/s 2023-10-18T14:07:03.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:02 smithi114 ceph-mon[99494]: pgmap v371: 97 pgs: 97 active+clean; 53 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.1 MiB/s wr, 664 op/s 2023-10-18T14:07:04.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:04 smithi114 ceph-mon[99494]: pgmap v372: 97 pgs: 97 active+clean; 50 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 3.9 MiB/s wr, 828 op/s 2023-10-18T14:07:04.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:04 smithi158 ceph-mon[103317]: pgmap v372: 97 pgs: 97 active+clean; 50 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 3.9 MiB/s wr, 828 op/s 2023-10-18T14:07:04.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:04 smithi172 ceph-mon[103574]: pgmap v372: 97 pgs: 97 active+clean; 50 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 3.9 MiB/s wr, 828 op/s 2023-10-18T14:07:07.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:06 smithi158 ceph-mon[103317]: pgmap v373: 97 pgs: 97 active+clean; 55 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 3.8 MiB/s wr, 773 op/s 2023-10-18T14:07:07.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:06 smithi172 ceph-mon[103574]: pgmap v373: 97 pgs: 97 active+clean; 55 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 3.8 MiB/s wr, 773 op/s 2023-10-18T14:07:07.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:06 smithi114 ceph-mon[99494]: pgmap v373: 97 pgs: 97 active+clean; 55 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 3.8 MiB/s wr, 773 op/s 2023-10-18T14:07:09.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:08 smithi158 ceph-mon[103317]: pgmap v374: 97 pgs: 97 active+clean; 55 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.1 MiB/s wr, 636 op/s 2023-10-18T14:07:09.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:08 smithi172 ceph-mon[103574]: pgmap v374: 97 pgs: 97 active+clean; 55 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.1 MiB/s wr, 636 op/s 2023-10-18T14:07:09.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:08 smithi114 ceph-mon[99494]: pgmap v374: 97 pgs: 97 active+clean; 55 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.1 MiB/s wr, 636 op/s 2023-10-18T14:07:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:10 smithi158 ceph-mon[103317]: pgmap v375: 97 pgs: 97 active+clean; 57 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 4.5 MiB/s wr, 921 op/s 2023-10-18T14:07:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:10 smithi172 ceph-mon[103574]: pgmap v375: 97 pgs: 97 active+clean; 57 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 4.5 MiB/s wr, 921 op/s 2023-10-18T14:07:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:10 smithi114 ceph-mon[99494]: pgmap v375: 97 pgs: 97 active+clean; 57 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 4.5 MiB/s wr, 921 op/s 2023-10-18T14:07:13.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:12 smithi158 ceph-mon[103317]: pgmap v376: 97 pgs: 97 active+clean; 57 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.0 MiB/s wr, 606 op/s 2023-10-18T14:07:13.059 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:07:13.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:12 smithi172 ceph-mon[103574]: pgmap v376: 97 pgs: 97 active+clean; 57 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.0 MiB/s wr, 606 op/s 2023-10-18T14:07:13.084 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:12 smithi114 ceph-mon[99494]: pgmap v376: 97 pgs: 97 active+clean; 57 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.0 MiB/s wr, 606 op/s 2023-10-18T14:07:13.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.193+0000 7f74dc4f8700 1 -- 172.21.15.114:0/2600520473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74d40ff640 msgr2=0x7f74d40ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:13.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.193+0000 7f74dc4f8700 1 --2- 172.21.15.114:0/2600520473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74d40ff640 0x7f74d40ffac0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009990 tx=0x7f74c4009ca0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.193+0000 7f74dc4f8700 1 -- 172.21.15.114:0/2600520473 shutdown_connections 2023-10-18T14:07:13.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.193+0000 7f74dc4f8700 1 --2- 172.21.15.114:0/2600520473 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74d4100000 0x7f74d410c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.193+0000 7f74dc4f8700 1 --2- 172.21.15.114:0/2600520473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74d41056e0 0x7f74d4105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.193+0000 7f74dc4f8700 1 --2- 172.21.15.114:0/2600520473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74d40ff640 0x7f74d40ffac0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.193+0000 7f74dc4f8700 1 -- 172.21.15.114:0/2600520473 >> 172.21.15.114:0/2600520473 conn(0x7f74d40767f0 msgr2=0x7f74d4076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:13.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.193+0000 7f74dc4f8700 1 -- 172.21.15.114:0/2600520473 shutdown_connections 2023-10-18T14:07:13.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.193+0000 7f74dc4f8700 1 -- 172.21.15.114:0/2600520473 wait complete. 2023-10-18T14:07:13.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.194+0000 7f74dc4f8700 1 Processor -- start 2023-10-18T14:07:13.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.194+0000 7f74dc4f8700 1 -- start start 2023-10-18T14:07:13.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.194+0000 7f74dc4f8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74d40ff640 0x7f74d419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.194+0000 7f74dc4f8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74d4100000 0x7f74d419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.194+0000 7f74dc4f8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74d41056e0 0x7f74d41958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.194+0000 7f74dc4f8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d4195f50 con 0x7f74d41056e0 2023-10-18T14:07:13.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74dc4f8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d41960c0 con 0x7f74d40ff640 2023-10-18T14:07:13.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74dc4f8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d4196280 con 0x7f74d4100000 2023-10-18T14:07:13.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74daa95700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74d41056e0 0x7f74d41958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74daa95700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74d41056e0 0x7f74d41958f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46050/0 (socket says 172.21.15.114:46050) 2023-10-18T14:07:13.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74daa95700 1 -- 172.21.15.114:0/3455578739 learned_addr learned my addr 172.21.15.114:0/3455578739 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:13.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74da294700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74d40ff640 0x7f74d419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74daa95700 1 -- 172.21.15.114:0/3455578739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74d4100000 msgr2=0x7f74d419bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:13.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74daa95700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74d4100000 0x7f74d419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74daa95700 1 -- 172.21.15.114:0/3455578739 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74d40ff640 msgr2=0x7f74d419b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:13.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74daa95700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74d40ff640 0x7f74d419b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74daa95700 1 -- 172.21.15.114:0/3455578739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c40095f0 con 0x7f74d41056e0 2023-10-18T14:07:13.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74da294700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74d40ff640 0x7f74d419b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:13.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74daa95700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74d41056e0 0x7f74d41958f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00efc0 tx=0x7f74cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:13.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74cb7fe700 1 -- 172.21.15.114:0/3455578739 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc018070 con 0x7f74d41056e0 2023-10-18T14:07:13.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74cb7fe700 1 -- 172.21.15.114:0/3455578739 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74cc00f040 con 0x7f74d41056e0 2023-10-18T14:07:13.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74dc4f8700 1 -- 172.21.15.114:0/3455578739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d4196500 con 0x7f74d41056e0 2023-10-18T14:07:13.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74cb7fe700 1 -- 172.21.15.114:0/3455578739 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc00cc70 con 0x7f74d41056e0 2023-10-18T14:07:13.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.195+0000 7f74dc4f8700 1 -- 172.21.15.114:0/3455578739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d41a27b0 con 0x7f74d41056e0 2023-10-18T14:07:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.198+0000 7f74cb7fe700 1 -- 172.21.15.114:0/3455578739 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f74cc003a00 con 0x7f74d41056e0 2023-10-18T14:07:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.198+0000 7f74cb7fe700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f74c00a15f0 0x7f74c00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.199+0000 7f74da294700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f74c00a15f0 0x7f74c00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.199+0000 7f74cb7fe700 1 -- 172.21.15.114:0/3455578739 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f74cc0ccb60 con 0x7f74d41056e0 2023-10-18T14:07:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.199+0000 7f74e86e1b80 1 Processor -- start 2023-10-18T14:07:13.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74e86e1b80 1 -- start start 2023-10-18T14:07:13.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74e86e1b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03844be0 0x559f03844fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74e86e1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03845500 0x559f0383f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74e86e1b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 0x559f0383fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74e86e1b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f037b26e0 con 0x559f0383f5d0 2023-10-18T14:07:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74e86e1b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f03798c60 con 0x559f03844be0 2023-10-18T14:07:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74e86e1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f03796580 con 0x559f03845500 2023-10-18T14:07:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74daa95700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 0x559f0383fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74daa95700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 0x559f0383fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46056/0 (socket says 172.21.15.114:46056) 2023-10-18T14:07:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74daa95700 1 -- 172.21.15.114:0/206798597 learned_addr learned my addr 172.21.15.114:0/206798597 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74d9a93700 1 --2- 172.21.15.114:0/206798597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03845500 0x559f0383f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74daa95700 1 -- 172.21.15.114:0/206798597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03845500 msgr2=0x559f0383f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74daa95700 1 --2- 172.21.15.114:0/206798597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03845500 0x559f0383f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74daa95700 1 -- 172.21.15.114:0/206798597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03844be0 msgr2=0x559f03844fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T14:07:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74daa95700 1 --2- 172.21.15.114:0/206798597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03844be0 0x559f03844fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74daa95700 1 -- 172.21.15.114:0/206798597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f0374f3f0 con 0x559f0383f5d0 2023-10-18T14:07:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.200+0000 7f74daa95700 1 --2- 172.21.15.114:0/206798597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 0x559f0383fa50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f74cc096620 tx=0x7f74cc0996f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7954ecb807b059e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.201+0000 7f74da294700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f74c00a15f0 0x7f74c00a3ab0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009fd0 tx=0x7f74d0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.201+0000 7f74c8ff9700 1 -- 172.21.15.114:0/206798597 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc099bb0 con 0x559f0383f5d0 2023-10-18T14:07:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.201+0000 7f74c8ff9700 1 -- 172.21.15.114:0/206798597 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74cc09dd00 con 0x559f0383f5d0 2023-10-18T14:07:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.201+0000 7f74c8ff9700 1 -- 172.21.15.114:0/206798597 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc01b320 con 0x559f0383f5d0 2023-10-18T14:07:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.201+0000 7f74e86e1b80 1 -- 172.21.15.114:0/206798597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 msgr2=0x559f0383fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.201+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/206798597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 0x559f0383fa50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f74cc096620 tx=0x7f74cc0996f0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.201+0000 7f74e86e1b80 1 -- 172.21.15.114:0/206798597 shutdown_connections 2023-10-18T14:07:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.201+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/206798597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 0x559f0383fa50 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.201+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/206798597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03844be0 0x559f03844fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.201+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/206798597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03845500 0x559f0383f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.201+0000 7f74e86e1b80 1 -- 172.21.15.114:0/206798597 >> 172.21.15.114:0/206798597 conn(0x559f037b3720 msgr2=0x559f03839b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.201+0000 7f74e86e1b80 1 -- 172.21.15.114:0/206798597 shutdown_connections 2023-10-18T14:07:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.201+0000 7f74e86e1b80 1 -- 172.21.15.114:0/206798597 wait complete. 2023-10-18T14:07:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74e86e1b80 1 -- start start 2023-10-18T14:07:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74e86e1b80 1 Processor -- start 2023-10-18T14:07:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74e86e1b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 0x559f038488b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74e86e1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03844be0 0x559f03848df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74e86e1b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03845500 0x559f03849330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74e86e1b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f03791e70 con 0x559f0383f5d0 2023-10-18T14:07:13.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74e86e1b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f0372e710 con 0x559f03845500 2023-10-18T14:07:13.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74e86e1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f0372e3b0 con 0x559f03844be0 2023-10-18T14:07:13.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74e86e1b80 10 client.0 _ll_register_callbacks cb 0x559f03678a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:13.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74da294700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 0x559f038488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74da294700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 0x559f038488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46058/0 (socket says 172.21.15.114:46058) 2023-10-18T14:07:13.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74da294700 1 -- 172.21.15.114:0/486251679 learned_addr learned my addr 172.21.15.114:0/486251679 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:13.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74d9a93700 1 --2- 172.21.15.114:0/486251679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03844be0 0x559f03848df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.202+0000 7f74daa95700 1 --2- 172.21.15.114:0/486251679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03845500 0x559f03849330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74da294700 1 -- 172.21.15.114:0/486251679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03844be0 msgr2=0x559f03848df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:13.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74da294700 1 --2- 172.21.15.114:0/486251679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03844be0 0x559f03848df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74da294700 1 -- 172.21.15.114:0/486251679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03845500 msgr2=0x559f03849330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:13.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74da294700 1 --2- 172.21.15.114:0/486251679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03845500 0x559f03849330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74da294700 1 -- 172.21.15.114:0/486251679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d41a27b0 con 0x559f0383f5d0 2023-10-18T14:07:13.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74da294700 1 --2- 172.21.15.114:0/486251679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 0x559f038488b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f74d000ec70 tx=0x7f74d00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862ac6ed2c2b1cac server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:13.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:07:13.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74bdffb700 1 -- 172.21.15.114:0/486251679 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d000e560 con 0x559f0383f5d0 2023-10-18T14:07:13.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74bdffb700 1 -- 172.21.15.114:0/486251679 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f74d000fb60 con 0x559f0383f5d0 2023-10-18T14:07:13.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74e86e1b80 1 -- 172.21.15.114:0/486251679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f03796ef0 con 0x559f0383f5d0 2023-10-18T14:07:13.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74bdffb700 1 -- 172.21.15.114:0/486251679 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74d000fd20 con 0x559f0383f5d0 2023-10-18T14:07:13.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74e86e1b80 10 client.16428 fetch_fsmap learned FSMap version 34 2023-10-18T14:07:13.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74e86e1b80 1 -- 172.21.15.114:0/486251679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559f035bcde0 con 0x559f0383f5d0 2023-10-18T14:07:13.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74bdffb700 1 -- 172.21.15.114:0/486251679 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559f03796ef0 con 0x559f0383f5d0 2023-10-18T14:07:13.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.203+0000 7f74bdffb700 1 -- 172.21.15.114:0/486251679 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f74d0024020 con 0x559f0383f5d0 2023-10-18T14:07:13.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.204+0000 7f74e86e1b80 10 client.16428 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:07:13.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.204+0000 7f74e86e1b80 10 client.16428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:13.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.204+0000 7f74e86e1b80 20 client.16428 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:13.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.204+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/486251679 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559f0385d390 0x559f0385f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.204+0000 7f74e86e1b80 4 client.16428 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:07:13.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.204+0000 7f74e86e1b80 1 -- 172.21.15.114:0/486251679 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f0380e8b0 con 0x559f0385d390 2023-10-18T14:07:13.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.204+0000 7f74d9a93700 1 --2- 172.21.15.114:0/486251679 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559f0385d390 0x559f0385f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.204+0000 7f74bdffb700 10 client.16428 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:13.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.204+0000 7f74d9a93700 1 --2- 172.21.15.114:0/486251679 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559f0385d390 0x559f0385f7b0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=565601cb77c9067b server_cookie=76a5e7583158eb08 in_seq=0 out_seq=0 2023-10-18T14:07:13.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.206+0000 7f74bdffb700 1 -- 172.21.15.114:0/486251679 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559f0380e8b0 con 0x559f0385d390 2023-10-18T14:07:13.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.206+0000 7f74bdffb700 10 client.16428 handle_command_reply: tid=0 2023-10-18T14:07:13.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.206+0000 7f74e86e1b80 1 client.16428 shutdown 2023-10-18T14:07:13.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.206+0000 7f74e86e1b80 1 -- 172.21.15.114:0/486251679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 msgr2=0x559f038488b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:13.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.206+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/486251679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 0x559f038488b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f74d000ec70 tx=0x7f74d00047c0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.206+0000 7f74e86e1b80 1 -- 172.21.15.114:0/486251679 shutdown_connections 2023-10-18T14:07:13.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.206+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/486251679 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559f0385d390 0x559f0385f7b0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.206+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/486251679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03845500 0x559f03849330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.206+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/486251679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f0383f5d0 0x559f038488b0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.206+0000 7f74bdffb700 0 client.16428 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:13.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.206+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/486251679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03844be0 0x559f03848df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.207+0000 7f74e86e1b80 1 -- 172.21.15.114:0/486251679 >> 172.21.15.114:0/486251679 conn(0x559f037b3720 msgr2=0x559f0383e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:13.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.207+0000 7f74e86e1b80 1 -- 172.21.15.114:0/486251679 shutdown_connections 2023-10-18T14:07:13.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.207+0000 7f74e86e1b80 1 -- 172.21.15.114:0/486251679 wait complete. 2023-10-18T14:07:13.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.207+0000 7f74e86e1b80 20 client.16428 trim_cache size 0 max 16384 2023-10-18T14:07:13.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74e86e1b80 1 Processor -- start 2023-10-18T14:07:13.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74e86e1b80 1 -- start start 2023-10-18T14:07:13.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74e86e1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f0383f5d0 0x559f03854340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74e86e1b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03844be0 0x559f03839810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74e86e1b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 0x559f03843980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74e86e1b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f03612920 con 0x559f03845500 2023-10-18T14:07:13.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74e86e1b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f038362e0 con 0x559f03844be0 2023-10-18T14:07:13.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74e86e1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f0383b3b0 con 0x559f0383f5d0 2023-10-18T14:07:13.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74daa95700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 0x559f03843980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74da294700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f0383f5d0 0x559f03854340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74da294700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f0383f5d0 0x559f03854340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:50002/0 (socket says 172.21.15.114:50002) 2023-10-18T14:07:13.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74da294700 1 -- 172.21.15.114:0/421697 learned_addr learned my addr 172.21.15.114:0/421697 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:13.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74daa95700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 0x559f03843980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46070/0 (socket says 172.21.15.114:46070) 2023-10-18T14:07:13.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.228+0000 7f74d9a93700 1 --2- 172.21.15.114:0/421697 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03844be0 0x559f03839810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.229+0000 7f74da294700 1 -- 172.21.15.114:0/421697 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03844be0 msgr2=0x559f03839810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:13.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.229+0000 7f74da294700 1 --2- 172.21.15.114:0/421697 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03844be0 0x559f03839810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.229+0000 7f74da294700 1 -- 172.21.15.114:0/421697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 msgr2=0x559f03843980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:13.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.229+0000 7f74da294700 1 --2- 172.21.15.114:0/421697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 0x559f03843980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.229+0000 7f74da294700 1 -- 172.21.15.114:0/421697 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f035a5c60 con 0x559f0383f5d0 2023-10-18T14:07:13.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.229+0000 7f74d9a93700 1 --2- 172.21.15.114:0/421697 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03844be0 0x559f03839810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:13.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.229+0000 7f74daa95700 1 --2- 172.21.15.114:0/421697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 0x559f03843980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:13.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.229+0000 7f74da294700 1 --2- 172.21.15.114:0/421697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f0383f5d0 0x559f03854340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009340 tx=0x7f74d00046f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b602b3177e6f932e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:13.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.229+0000 7f74c97fa700 1 -- 172.21.15.114:0/421697 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0026870 con 0x559f0383f5d0 2023-10-18T14:07:13.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.229+0000 7f74c97fa700 1 -- 172.21.15.114:0/421697 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74d000fe20 con 0x559f0383f5d0 2023-10-18T14:07:13.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.229+0000 7f74c97fa700 1 -- 172.21.15.114:0/421697 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0030c70 con 0x559f0383f5d0 2023-10-18T14:07:13.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.230+0000 7f74e86e1b80 1 -- 172.21.15.114:0/421697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f0383f5d0 msgr2=0x559f03854340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:13.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.230+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/421697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f0383f5d0 0x559f03854340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009340 tx=0x7f74d00046f0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.230+0000 7f74e86e1b80 1 -- 172.21.15.114:0/421697 shutdown_connections 2023-10-18T14:07:13.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.230+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/421697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 0x559f03843980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.230+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/421697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f0383f5d0 0x559f03854340 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.230+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/421697 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f03844be0 0x559f03839810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.230+0000 7f74e86e1b80 1 -- 172.21.15.114:0/421697 >> 172.21.15.114:0/421697 conn(0x559f037b3720 msgr2=0x559f0383e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:13.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.230+0000 7f74e86e1b80 1 -- 172.21.15.114:0/421697 shutdown_connections 2023-10-18T14:07:13.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.230+0000 7f74e86e1b80 1 -- 172.21.15.114:0/421697 wait complete. 2023-10-18T14:07:13.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.230+0000 7f74e86e1b80 1 -- start start 2023-10-18T14:07:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.230+0000 7f74e86e1b80 1 Processor -- start 2023-10-18T14:07:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74e86e1b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f0383f5d0 0x559f038aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74e86e1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03844be0 0x559f038aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74e86e1b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 0x559f038a5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74e86e1b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f038a5820 con 0x559f03845500 2023-10-18T14:07:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74e86e1b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f038a5990 con 0x559f0383f5d0 2023-10-18T14:07:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74e86e1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f038a5b50 con 0x559f03844be0 2023-10-18T14:07:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74e86e1b80 10 client.0 _ll_register_callbacks cb 0x559f03678a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74daa95700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 0x559f038a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74da294700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f0383f5d0 0x559f038aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74daa95700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 0x559f038a5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46076/0 (socket says 172.21.15.114:46076) 2023-10-18T14:07:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74daa95700 1 -- 172.21.15.114:0/4121191139 learned_addr learned my addr 172.21.15.114:0/4121191139 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74d9a93700 1 --2- 172.21.15.114:0/4121191139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03844be0 0x559f038aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74da294700 1 -- 172.21.15.114:0/4121191139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03844be0 msgr2=0x559f038aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74da294700 1 --2- 172.21.15.114:0/4121191139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03844be0 0x559f038aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74da294700 1 -- 172.21.15.114:0/4121191139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 msgr2=0x559f038a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:13.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74da294700 1 --2- 172.21.15.114:0/4121191139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 0x559f038a5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74da294700 1 -- 172.21.15.114:0/4121191139 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d410cd90 con 0x559f0383f5d0 2023-10-18T14:07:13.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74daa95700 1 --2- 172.21.15.114:0/4121191139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 0x559f038a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:13.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74da294700 1 --2- 172.21.15.114:0/4121191139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f0383f5d0 0x559f038aa8c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74d0005a80 tx=0x7f74d0005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9da0957cbd18744 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:13.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:07:13.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.231+0000 7f74bdffb700 1 -- 172.21.15.114:0/4121191139 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0026a70 con 0x559f0383f5d0 2023-10-18T14:07:13.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74bdffb700 1 -- 172.21.15.114:0/4121191139 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f74d002b020 con 0x559f0383f5d0 2023-10-18T14:07:13.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74e86e1b80 1 -- 172.21.15.114:0/4121191139 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74cc09dd00 con 0x559f0383f5d0 2023-10-18T14:07:13.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74bdffb700 1 -- 172.21.15.114:0/4121191139 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74d000f960 con 0x559f0383f5d0 2023-10-18T14:07:13.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74e86e1b80 10 client.25583 fetch_fsmap learned FSMap version 34 2023-10-18T14:07:13.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74e86e1b80 1 -- 172.21.15.114:0/4121191139 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559f0374f3f0 con 0x559f0383f5d0 2023-10-18T14:07:13.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74bdffb700 1 -- 172.21.15.114:0/4121191139 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74cc09dd00 con 0x559f0383f5d0 2023-10-18T14:07:13.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74bdffb700 1 -- 172.21.15.114:0/4121191139 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f74d000eca0 con 0x559f0383f5d0 2023-10-18T14:07:13.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74e86e1b80 10 client.25583 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:07:13.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74e86e1b80 10 client.25583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:13.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74e86e1b80 20 client.25583 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:13.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/4121191139 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559f0385d390 0x559f038b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:13.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74e86e1b80 4 client.25583 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:07:13.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74e86e1b80 1 -- 172.21.15.114:0/4121191139 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559f0378ae50 con 0x559f0385d390 2023-10-18T14:07:13.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.232+0000 7f74d9a93700 1 --2- 172.21.15.114:0/4121191139 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559f0385d390 0x559f038b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:13.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74bdffb700 10 client.25583 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:13.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74d9a93700 1 --2- 172.21.15.114:0/4121191139 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559f0385d390 0x559f038b4340 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c8d83a42b46a096 server_cookie=e5c5ef09b48cb312 in_seq=0 out_seq=0 2023-10-18T14:07:13.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74bdffb700 1 -- 172.21.15.114:0/4121191139 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559f0378ae50 con 0x559f0385d390 2023-10-18T14:07:13.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74bdffb700 10 client.25583 handle_command_reply: tid=0 2023-10-18T14:07:13.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74e86e1b80 1 client.25583 shutdown 2023-10-18T14:07:13.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74e86e1b80 1 -- 172.21.15.114:0/4121191139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f0383f5d0 msgr2=0x559f038aa8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:13.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/4121191139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f0383f5d0 0x559f038aa8c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74d0005a80 tx=0x7f74d0005770 comp rx=0 tx=0).stop 2023-10-18T14:07:13.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74e86e1b80 1 -- 172.21.15.114:0/4121191139 shutdown_connections 2023-10-18T14:07:13.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/4121191139 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x559f0385d390 0x559f038b4340 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/4121191139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f03845500 0x559f038a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/4121191139 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x559f0383f5d0 0x559f038aa8c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74e86e1b80 1 --2- 172.21.15.114:0/4121191139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f03844be0 0x559f038aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74bdffb700 0 client.25583 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:13.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74e86e1b80 1 -- 172.21.15.114:0/4121191139 >> 172.21.15.114:0/4121191139 conn(0x559f037b3720 msgr2=0x559f03839810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:13.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74e86e1b80 1 -- 172.21.15.114:0/4121191139 shutdown_connections 2023-10-18T14:07:13.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74e86e1b80 1 -- 172.21.15.114:0/4121191139 wait complete. 2023-10-18T14:07:13.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.233+0000 7f74e86e1b80 20 client.25583 trim_cache size 0 max 16384 2023-10-18T14:07:13.254 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:07:13.255 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-18T14:07:13.255 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": { 2023-10-18T14:07:13.255 INFO:teuthology.orchestra.run.smithi114.stdout: "94d18228-30fd-45a0-94d1-b2bec5a6db1a": { 2023-10-18T14:07:13.255 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/", 2023-10-18T14:07:13.256 INFO:teuthology.orchestra.run.smithi114.stdout: "tag": "94d18228-30fd-45a0-94d1-b2bec5a6db1a", 2023-10-18T14:07:13.256 INFO:teuthology.orchestra.run.smithi114.stdout: "options": "recursive,force" 2023-10-18T14:07:13.256 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:07:13.256 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:07:13.256 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:07:13.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.234+0000 7f74dc4f8700 1 -- 172.21.15.114:0/3455578739 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f74c00a15f0 msgr2=0x7f74c00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:13.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.234+0000 7f74dc4f8700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f74c00a15f0 0x7f74c00a3ab0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009fd0 tx=0x7f74d0009260 comp rx=0 tx=0).stop 2023-10-18T14:07:13.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.234+0000 7f74dc4f8700 1 -- 172.21.15.114:0/3455578739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74d41056e0 msgr2=0x7f74d41958f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.234+0000 7f74dc4f8700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74d41056e0 0x7f74d41958f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00efc0 tx=0x7f74cc00c3a0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.234+0000 7f74dc4f8700 1 -- 172.21.15.114:0/3455578739 shutdown_connections 2023-10-18T14:07:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.234+0000 7f74dc4f8700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f74c00a15f0 0x7f74c00a3ab0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.234+0000 7f74dc4f8700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74d41056e0 0x7f74d41958f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.234+0000 7f74dc4f8700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f74d40ff640 0x7f74d419b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.234+0000 7f74dc4f8700 1 --2- 172.21.15.114:0/3455578739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74d4100000 0x7f74d419bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:13.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.234+0000 7f74dc4f8700 1 -- 172.21.15.114:0/3455578739 >> 172.21.15.114:0/3455578739 conn(0x7f74d40767f0 msgr2=0x7f74d40fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:13.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.234+0000 7f74dc4f8700 1 -- 172.21.15.114:0/3455578739 shutdown_connections 2023-10-18T14:07:13.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:13.234+0000 7f74dc4f8700 1 -- 172.21.15.114:0/3455578739 wait complete. 2023-10-18T14:07:13.260 INFO:tasks.cephfs.filesystem:scrub status for tag:94d18228-30fd-45a0-94d1-b2bec5a6db1a - {'path': '/', 'tag': '94d18228-30fd-45a0-94d1-b2bec5a6db1a', 'options': 'recursive,force'} 2023-10-18T14:07:14.303 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.299+0000 7fbdcd0d2700 1 -- 172.21.15.114:0/183550820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdc8105670 msgr2=0x7fbdc8105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:14.303 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.299+0000 7fbdcd0d2700 1 --2- 172.21.15.114:0/183550820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdc8105670 0x7fbdc8105a50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009990 tx=0x7fbdb8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.299+0000 7fbdcd0d2700 1 -- 172.21.15.114:0/183550820 shutdown_connections 2023-10-18T14:07:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.299+0000 7fbdcd0d2700 1 --2- 172.21.15.114:0/183550820 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbdc80fff90 0x7fbdc810c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.299+0000 7fbdcd0d2700 1 --2- 172.21.15.114:0/183550820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdc8105670 0x7fbdc8105a50 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.299+0000 7fbdcd0d2700 1 --2- 172.21.15.114:0/183550820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc80ff5d0 0x7fbdc80ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.299+0000 7fbdcd0d2700 1 -- 172.21.15.114:0/183550820 >> 172.21.15.114:0/183550820 conn(0x7fbdc80fb0c0 msgr2=0x7fbdc80fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:14.305 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.299+0000 7fbdcd0d2700 1 -- 172.21.15.114:0/183550820 shutdown_connections 2023-10-18T14:07:14.305 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.299+0000 7fbdcd0d2700 1 -- 172.21.15.114:0/183550820 wait complete. 2023-10-18T14:07:14.307 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.300+0000 7fbdcd0d2700 1 Processor -- start 2023-10-18T14:07:14.307 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.300+0000 7fbdcd0d2700 1 -- start start 2023-10-18T14:07:14.307 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.300+0000 7fbdcd0d2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc80ff5d0 0x7fbdc819c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.307 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.300+0000 7fbdcd0d2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbdc80fff90 0x7fbdc819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.300+0000 7fbdcd0d2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdc8105670 0x7fbdc81968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.300+0000 7fbdcd0d2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8196f50 con 0x7fbdc8105670 2023-10-18T14:07:14.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.300+0000 7fbdcd0d2700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc81970c0 con 0x7fbdc80fff90 2023-10-18T14:07:14.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.300+0000 7fbdcd0d2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8197280 con 0x7fbdc80ff5d0 2023-10-18T14:07:14.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.301+0000 7fbdc6d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc80ff5d0 0x7fbdc819c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.309 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.301+0000 7fbdc759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdc8105670 0x7fbdc81968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.309 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.301+0000 7fbdc6d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc80ff5d0 0x7fbdc819c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:50022/0 (socket says 172.21.15.114:50022) 2023-10-18T14:07:14.309 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.301+0000 7fbdc759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdc8105670 0x7fbdc81968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46088/0 (socket says 172.21.15.114:46088) 2023-10-18T14:07:14.309 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.301+0000 7fbdc6d9d700 1 -- 172.21.15.114:0/4239244187 learned_addr learned my addr 172.21.15.114:0/4239244187 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:14.309 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.301+0000 7fbdc659c700 1 --2- 172.21.15.114:0/4239244187 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbdc80fff90 0x7fbdc819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.301+0000 7fbdc759e700 1 -- 172.21.15.114:0/4239244187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc80ff5d0 msgr2=0x7fbdc819c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.301+0000 7fbdc759e700 1 --2- 172.21.15.114:0/4239244187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc80ff5d0 0x7fbdc819c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.301+0000 7fbdc759e700 1 -- 172.21.15.114:0/4239244187 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbdc80fff90 msgr2=0x7fbdc819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:14.310 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.301+0000 7fbdc759e700 1 --2- 172.21.15.114:0/4239244187 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbdc80fff90 0x7fbdc819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.301+0000 7fbdc759e700 1 -- 172.21.15.114:0/4239244187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb80095f0 con 0x7fbdc8105670 2023-10-18T14:07:14.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.301+0000 7fbdc759e700 1 --2- 172.21.15.114:0/4239244187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdc8105670 0x7fbdc81968f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000efc0 tx=0x7fbdc000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:14.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.302+0000 7fbdaffff700 1 -- 172.21.15.114:0/4239244187 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0018070 con 0x7fbdc8105670 2023-10-18T14:07:14.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.303+0000 7fbdaffff700 1 -- 172.21.15.114:0/4239244187 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbdc000f040 con 0x7fbdc8105670 2023-10-18T14:07:14.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.303+0000 7fbdcd0d2700 1 -- 172.21.15.114:0/4239244187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc8197500 con 0x7fbdc8105670 2023-10-18T14:07:14.312 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.303+0000 7fbdaffff700 1 -- 172.21.15.114:0/4239244187 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc000cd40 con 0x7fbdc8105670 2023-10-18T14:07:14.312 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.303+0000 7fbdcd0d2700 1 -- 172.21.15.114:0/4239244187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc81a37b0 con 0x7fbdc8105670 2023-10-18T14:07:14.318 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.305+0000 7fbdaffff700 1 -- 172.21.15.114:0/4239244187 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fbdc0003a00 con 0x7fbdc8105670 2023-10-18T14:07:14.318 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.306+0000 7fbdaffff700 1 --2- 172.21.15.114:0/4239244187 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbdb00a15f0 0x7fbdb00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.318 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.306+0000 7fbdc6d9d700 1 --2- 172.21.15.114:0/4239244187 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbdb00a15f0 0x7fbdb00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.318 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.306+0000 7fbdaffff700 1 -- 172.21.15.114:0/4239244187 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fbdc00ccc70 con 0x7fbdc8105670 2023-10-18T14:07:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.306+0000 7fbdc6d9d700 1 --2- 172.21.15.114:0/4239244187 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbdb00a15f0 0x7fbdb00a3ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800b6f0 tx=0x7fbdb8005bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdd92bbb80 1 Processor -- start 2023-10-18T14:07:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdd92bbb80 1 -- start start 2023-10-18T14:07:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdd92bbb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d28299da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.319 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdd92bbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299df50 0x55d282997ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdd92bbb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d282998410 0x55d282998870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdd92bbb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d28290b680 con 0x55d282998410 2023-10-18T14:07:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdd92bbb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2828f1c00 con 0x55d28299d630 2023-10-18T14:07:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdd92bbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2828ef520 con 0x55d28299df50 2023-10-18T14:07:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdc759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d282998410 0x55d282998870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdc6d9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d28299da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdc759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d282998410 0x55d282998870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46098/0 (socket says 172.21.15.114:46098) 2023-10-18T14:07:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdc759e700 1 -- 172.21.15.114:0/3077203847 learned_addr learned my addr 172.21.15.114:0/3077203847 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdc659c700 1 --2- 172.21.15.114:0/3077203847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299df50 0x55d282997ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdc6d9d700 1 -- 172.21.15.114:0/3077203847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299df50 msgr2=0x55d282997ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdc6d9d700 1 --2- 172.21.15.114:0/3077203847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299df50 0x55d282997ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdc6d9d700 1 -- 172.21.15.114:0/3077203847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d282998410 msgr2=0x55d282998870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdc6d9d700 1 --2- 172.21.15.114:0/3077203847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d282998410 0x55d282998870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.307+0000 7fbdc6d9d700 1 -- 172.21.15.114:0/3077203847 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2828a8390 con 0x55d28299d630 2023-10-18T14:07:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.308+0000 7fbdc6d9d700 1 --2- 172.21.15.114:0/3077203847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d28299da10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800b2e0 tx=0x7fbdb8020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d25a51cc85fab2df server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:14.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.308+0000 7fbdad7fa700 1 -- 172.21.15.114:0/3077203847 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8005720 con 0x55d28299d630 2023-10-18T14:07:14.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.308+0000 7fbdad7fa700 1 -- 172.21.15.114:0/3077203847 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbdb801e040 con 0x55d28299d630 2023-10-18T14:07:14.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.308+0000 7fbdad7fa700 1 -- 172.21.15.114:0/3077203847 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800f960 con 0x55d28299d630 2023-10-18T14:07:14.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/3077203847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 msgr2=0x55d28299da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:14.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/3077203847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d28299da10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800b2e0 tx=0x7fbdb8020000 comp rx=0 tx=0).stop 2023-10-18T14:07:14.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/3077203847 shutdown_connections 2023-10-18T14:07:14.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/3077203847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d282998410 0x55d282998870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/3077203847 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d28299da10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/3077203847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299df50 0x55d282997ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/3077203847 >> 172.21.15.114:0/3077203847 conn(0x55d28290c6c0 msgr2=0x55d2829925a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:14.325 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/3077203847 shutdown_connections 2023-10-18T14:07:14.325 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/3077203847 wait complete. 2023-10-18T14:07:14.325 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 -- start start 2023-10-18T14:07:14.325 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 Processor -- start 2023-10-18T14:07:14.325 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d282998410 0x55d2829a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299d630 0x55d2829a1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d28299df50 0x55d2829a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2828eae10 con 0x55d28299df50 2023-10-18T14:07:14.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2828876b0 con 0x55d282998410 2023-10-18T14:07:14.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d282887350 con 0x55d28299d630 2023-10-18T14:07:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.309+0000 7fbdd92bbb80 10 client.0 _ll_register_callbacks cb 0x55d2827d1a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdc6d9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d282998410 0x55d2829a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdc6d9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d282998410 0x55d2829a3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42244/0 (socket says 172.21.15.114:42244) 2023-10-18T14:07:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdc6d9d700 1 -- 172.21.15.114:0/2159111768 learned_addr learned my addr 172.21.15.114:0/2159111768 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdc759e700 1 --2- 172.21.15.114:0/2159111768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d28299df50 0x55d2829a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdc659c700 1 --2- 172.21.15.114:0/2159111768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299d630 0x55d2829a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdc6d9d700 1 -- 172.21.15.114:0/2159111768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299d630 msgr2=0x55d2829a1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdc6d9d700 1 --2- 172.21.15.114:0/2159111768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299d630 0x55d2829a1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdc6d9d700 1 -- 172.21.15.114:0/2159111768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d28299df50 msgr2=0x55d2829a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:14.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdc6d9d700 1 --2- 172.21.15.114:0/2159111768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d28299df50 0x55d2829a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdc6d9d700 1 -- 172.21.15.114:0/2159111768 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc810cda0 con 0x55d282998410 2023-10-18T14:07:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdc6d9d700 1 --2- 172.21.15.114:0/2159111768 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d282998410 0x55d2829a3f70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800f5e0 tx=0x7fbdb800f8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=833458543656d668 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdaaff5700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:07:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdaaff5700 1 -- 172.21.15.114:0/2159111768 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8005720 con 0x55d282998410 2023-10-18T14:07:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2159111768 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2828efe90 con 0x55d282998410 2023-10-18T14:07:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.310+0000 7fbdaaff5700 1 -- 172.21.15.114:0/2159111768 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fbdb8004910 con 0x55d282998410 2023-10-18T14:07:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.311+0000 7fbdaaff5700 1 -- 172.21.15.114:0/2159111768 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdb800be90 con 0x55d282998410 2023-10-18T14:07:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.311+0000 7fbdd92bbb80 10 client.25595 fetch_fsmap learned FSMap version 34 2023-10-18T14:07:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.311+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2159111768 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55d282715d80 con 0x55d282998410 2023-10-18T14:07:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.311+0000 7fbdaaff5700 1 -- 172.21.15.114:0/2159111768 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d2828efe90 con 0x55d282998410 2023-10-18T14:07:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.311+0000 7fbdaaff5700 1 -- 172.21.15.114:0/2159111768 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fbdb8038b10 con 0x55d282998410 2023-10-18T14:07:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.311+0000 7fbdd92bbb80 10 client.25595 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:07:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.311+0000 7fbdd92bbb80 10 client.25595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.311+0000 7fbdd92bbb80 20 client.25595 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.311+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/2159111768 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d2829b15c0 0x55d2829b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.311+0000 7fbdd92bbb80 4 client.25595 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:07:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.311+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2159111768 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d282967850 con 0x55d2829b15c0 2023-10-18T14:07:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.311+0000 7fbdc659c700 1 --2- 172.21.15.114:0/2159111768 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d2829b15c0 0x55d2829b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.312+0000 7fbdc659c700 1 --2- 172.21.15.114:0/2159111768 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d2829b15c0 0x55d2829b39e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d89f62f02dd9350 server_cookie=32bce2455263afef in_seq=0 out_seq=0 2023-10-18T14:07:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.312+0000 7fbdaaff5700 10 client.25595 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdaaff5700 1 -- 172.21.15.114:0/2159111768 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d282967850 con 0x55d2829b15c0 2023-10-18T14:07:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdaaff5700 10 client.25595 handle_command_reply: tid=0 2023-10-18T14:07:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdd92bbb80 1 client.25595 shutdown 2023-10-18T14:07:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2159111768 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d282998410 msgr2=0x55d2829a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/2159111768 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d282998410 0x55d2829a3f70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800f5e0 tx=0x7fbdb800f8f0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2159111768 shutdown_connections 2023-10-18T14:07:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/2159111768 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d2829b15c0 0x55d2829b39e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/2159111768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d28299df50 0x55d2829a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdaaff5700 0 client.25595 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/2159111768 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d282998410 0x55d2829a3f70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/2159111768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299d630 0x55d2829a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2159111768 >> 172.21.15.114:0/2159111768 conn(0x55d28290c6c0 msgr2=0x55d282991d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2159111768 shutdown_connections 2023-10-18T14:07:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2159111768 wait complete. 2023-10-18T14:07:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.313+0000 7fbdd92bbb80 20 client.25595 trim_cache size 0 max 16384 2023-10-18T14:07:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.331+0000 7fbdd92bbb80 1 Processor -- start 2023-10-18T14:07:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.331+0000 7fbdd92bbb80 1 -- start start 2023-10-18T14:07:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.331+0000 7fbdd92bbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d282998410 0x55d2829a1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.331+0000 7fbdd92bbb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d2829a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.331+0000 7fbdd92bbb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d28299df50 0x55d2829924e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.331+0000 7fbdd92bbb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d28276b8c0 con 0x55d28299df50 2023-10-18T14:07:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.331+0000 7fbdd92bbb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2829a21f0 con 0x55d28299d630 2023-10-18T14:07:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.331+0000 7fbdd92bbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d282998280 con 0x55d282998410 2023-10-18T14:07:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.331+0000 7fbdc759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d28299df50 0x55d2829924e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.331+0000 7fbdc659c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d2829a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.331+0000 7fbdc6d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d282998410 0x55d2829a1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.331+0000 7fbdc759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d28299df50 0x55d2829924e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46112/0 (socket says 172.21.15.114:46112) 2023-10-18T14:07:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.331+0000 7fbdc759e700 1 -- 172.21.15.114:0/3968360519 learned_addr learned my addr 172.21.15.114:0/3968360519 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.332+0000 7fbdc659c700 1 -- 172.21.15.114:0/3968360519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d282998410 msgr2=0x55d2829a1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.332+0000 7fbdc659c700 1 --2- 172.21.15.114:0/3968360519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d282998410 0x55d2829a1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.332+0000 7fbdc659c700 1 -- 172.21.15.114:0/3968360519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d28299df50 msgr2=0x55d2829924e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.332+0000 7fbdc659c700 1 --2- 172.21.15.114:0/3968360519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d28299df50 0x55d2829924e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.332+0000 7fbdc659c700 1 -- 172.21.15.114:0/3968360519 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2826fec00 con 0x55d28299d630 2023-10-18T14:07:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.332+0000 7fbdc6d9d700 1 --2- 172.21.15.114:0/3968360519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d282998410 0x55d2829a1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.332+0000 7fbdc759e700 1 --2- 172.21.15.114:0/3968360519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d28299df50 0x55d2829924e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.332+0000 7fbdc659c700 1 --2- 172.21.15.114:0/3968360519 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d2829a88d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55d2829b4280 tx=0x7fbdbc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=799c1aaf88c94a37 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.332+0000 7fbdadffb700 1 -- 172.21.15.114:0/3968360519 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc017070 con 0x55d28299d630 2023-10-18T14:07:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.332+0000 7fbdadffb700 1 -- 172.21.15.114:0/3968360519 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbdbc018040 con 0x55d28299d630 2023-10-18T14:07:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.332+0000 7fbdadffb700 1 -- 172.21.15.114:0/3968360519 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc010690 con 0x55d28299d630 2023-10-18T14:07:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/3968360519 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 msgr2=0x55d2829a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/3968360519 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d2829a88d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55d2829b4280 tx=0x7fbdbc009260 comp rx=0 tx=0).stop 2023-10-18T14:07:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/3968360519 shutdown_connections 2023-10-18T14:07:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/3968360519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d28299df50 0x55d2829924e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/3968360519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d282998410 0x55d2829a1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/3968360519 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d2829a88d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/3968360519 >> 172.21.15.114:0/3968360519 conn(0x55d28290c6c0 msgr2=0x55d2829a0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/3968360519 shutdown_connections 2023-10-18T14:07:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/3968360519 wait complete. 2023-10-18T14:07:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 -- start start 2023-10-18T14:07:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 Processor -- start 2023-10-18T14:07:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d282998410 0x55d2829a8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d2829a8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299df50 0x55d2829a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2829a7160 con 0x55d282998410 2023-10-18T14:07:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2829a72d0 con 0x55d28299d630 2023-10-18T14:07:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2829a7490 con 0x55d28299df50 2023-10-18T14:07:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.333+0000 7fbdd92bbb80 10 client.0 _ll_register_callbacks cb 0x55d2827d1a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdc6d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d282998410 0x55d2829a8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdc6d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d282998410 0x55d2829a8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46114/0 (socket says 172.21.15.114:46114) 2023-10-18T14:07:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdc659c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d2829a8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdc6d9d700 1 -- 172.21.15.114:0/2696825057 learned_addr learned my addr 172.21.15.114:0/2696825057 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdc759e700 1 --2- 172.21.15.114:0/2696825057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299df50 0x55d2829a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdc6d9d700 1 -- 172.21.15.114:0/2696825057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299df50 msgr2=0x55d2829a6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdc6d9d700 1 --2- 172.21.15.114:0/2696825057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299df50 0x55d2829a6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdc6d9d700 1 -- 172.21.15.114:0/2696825057 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 msgr2=0x55d2829a8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdc6d9d700 1 --2- 172.21.15.114:0/2696825057 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d2829a8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdc6d9d700 1 -- 172.21.15.114:0/2696825057 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d282715d80 con 0x55d282998410 2023-10-18T14:07:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdc759e700 1 --2- 172.21.15.114:0/2696825057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299df50 0x55d2829a6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:07:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdc6d9d700 1 --2- 172.21.15.114:0/2696825057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d282998410 0x55d2829a8350 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8000c00 tx=0x7fbdb8005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de9b2ed1c1ed96 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdaaff5700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:07:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdaaff5700 1 -- 172.21.15.114:0/2696825057 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8024a90 con 0x55d282998410 2023-10-18T14:07:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdaaff5700 1 -- 172.21.15.114:0/2696825057 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fbdb8024bf0 con 0x55d282998410 2023-10-18T14:07:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2696825057 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbdb801e040 con 0x55d282998410 2023-10-18T14:07:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdaaff5700 1 -- 172.21.15.114:0/2696825057 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdb80245e0 con 0x55d282998410 2023-10-18T14:07:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdd92bbb80 10 client.16452 fetch_fsmap learned FSMap version 34 2023-10-18T14:07:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.334+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2696825057 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7fbdc81a37b0 con 0x55d282998410 2023-10-18T14:07:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.335+0000 7fbdaaff5700 1 -- 172.21.15.114:0/2696825057 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbdb801e040 con 0x55d282998410 2023-10-18T14:07:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.335+0000 7fbdaaff5700 1 -- 172.21.15.114:0/2696825057 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fbdb8038430 con 0x55d282998410 2023-10-18T14:07:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.335+0000 7fbdd92bbb80 10 client.16452 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:07:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.335+0000 7fbdd92bbb80 10 client.16452 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.335+0000 7fbdd92bbb80 20 client.16452 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.335+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/2696825057 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d282a055b0 0x55d282a079d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.335+0000 7fbdd92bbb80 4 client.16452 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:07:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.335+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2696825057 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d2828e3df0 con 0x55d282a055b0 2023-10-18T14:07:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.335+0000 7fbdc659c700 1 --2- 172.21.15.114:0/2696825057 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d282a055b0 0x55d282a079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.335+0000 7fbdaaff5700 10 client.16452 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.335+0000 7fbdc659c700 1 --2- 172.21.15.114:0/2696825057 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d282a055b0 0x55d282a079d0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e59b3b4b4e3a4255 server_cookie=80df2402efeffff4 in_seq=0 out_seq=0 2023-10-18T14:07:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.360+0000 7fbdaaff5700 1 -- 172.21.15.114:0/2696825057 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d2828e3df0 con 0x55d282a055b0 2023-10-18T14:07:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.360+0000 7fbdaaff5700 10 client.16452 handle_command_reply: tid=0 2023-10-18T14:07:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.360+0000 7fbdd92bbb80 1 client.16452 shutdown 2023-10-18T14:07:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2696825057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d282998410 msgr2=0x55d2829a8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/2696825057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d282998410 0x55d2829a8350 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8000c00 tx=0x7fbdb8005a70 comp rx=0 tx=0).stop 2023-10-18T14:07:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2696825057 shutdown_connections 2023-10-18T14:07:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/2696825057 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d282a055b0 0x55d282a079d0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/2696825057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d28299df50 0x55d2829a6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdaaff5700 0 client.16452 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/2696825057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d282998410 0x55d2829a8350 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdd92bbb80 1 --2- 172.21.15.114:0/2696825057 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d28299d630 0x55d2829a8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2696825057 >> 172.21.15.114:0/2696825057 conn(0x55d28290c6c0 msgr2=0x55d28299e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:14.368 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2696825057 shutdown_connections 2023-10-18T14:07:14.368 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdd92bbb80 1 -- 172.21.15.114:0/2696825057 wait complete. 2023-10-18T14:07:14.368 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdd92bbb80 20 client.16452 trim_cache size 0 max 16384 2023-10-18T14:07:14.368 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:07:14.369 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:07:14.369 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:07:14.369 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:07:14.370 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdcd0d2700 1 -- 172.21.15.114:0/4239244187 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbdb00a15f0 msgr2=0x7fbdb00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:14.370 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdcd0d2700 1 --2- 172.21.15.114:0/4239244187 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbdb00a15f0 0x7fbdb00a3ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800b6f0 tx=0x7fbdb8005bc0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.370 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdcd0d2700 1 -- 172.21.15.114:0/4239244187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdc8105670 msgr2=0x7fbdc81968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdcd0d2700 1 --2- 172.21.15.114:0/4239244187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdc8105670 0x7fbdc81968f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000efc0 tx=0x7fbdc000c3a0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdcd0d2700 1 -- 172.21.15.114:0/4239244187 shutdown_connections 2023-10-18T14:07:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdcd0d2700 1 --2- 172.21.15.114:0/4239244187 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbdb00a15f0 0x7fbdb00a3ab0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdcd0d2700 1 --2- 172.21.15.114:0/4239244187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdc8105670 0x7fbdc81968f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdcd0d2700 1 --2- 172.21.15.114:0/4239244187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc80ff5d0 0x7fbdc819c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdcd0d2700 1 --2- 172.21.15.114:0/4239244187 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbdc80fff90 0x7fbdc819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.361+0000 7fbdcd0d2700 1 -- 172.21.15.114:0/4239244187 >> 172.21.15.114:0/4239244187 conn(0x7fbdc80fb0c0 msgr2=0x7fbdc80fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.362+0000 7fbdcd0d2700 1 -- 172.21.15.114:0/4239244187 shutdown_connections 2023-10-18T14:07:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:14.362+0000 7fbdcd0d2700 1 -- 172.21.15.114:0/4239244187 wait complete. 2023-10-18T14:07:14.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:14 smithi114 ceph-mon[99494]: pgmap v377: 97 pgs: 97 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.7 MiB/s wr, 741 op/s 2023-10-18T14:07:14.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:14 smithi158 ceph-mon[103317]: pgmap v377: 97 pgs: 97 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.7 MiB/s wr, 741 op/s 2023-10-18T14:07:14.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:14 smithi172 ceph-mon[103574]: pgmap v377: 97 pgs: 97 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.7 MiB/s wr, 741 op/s 2023-10-18T14:07:17.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:16 smithi158 ceph-mon[103317]: pgmap v378: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.6 MiB/s wr, 696 op/s 2023-10-18T14:07:17.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:16 smithi172 ceph-mon[103574]: pgmap v378: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.6 MiB/s wr, 696 op/s 2023-10-18T14:07:17.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:16 smithi114 ceph-mon[99494]: pgmap v378: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.6 MiB/s wr, 696 op/s 2023-10-18T14:07:18.137 INFO:tasks.workunit.client.0.smithi114.stdout:40000 copy from 0x19d87f to 0x1a73ec, (0x9b6d bytes) at 0x9241fd 2023-10-18T14:07:19.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:18 smithi158 ceph-mon[103317]: pgmap v379: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 2.9 MiB/s wr, 562 op/s 2023-10-18T14:07:19.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:18 smithi172 ceph-mon[103574]: pgmap v379: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 2.9 MiB/s wr, 562 op/s 2023-10-18T14:07:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:18 smithi114 ceph-mon[99494]: pgmap v379: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 2.9 MiB/s wr, 562 op/s 2023-10-18T14:07:21.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:20 smithi158 ceph-mon[103317]: pgmap v380: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.3 MiB/s wr, 817 op/s 2023-10-18T14:07:21.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:20 smithi172 ceph-mon[103574]: pgmap v380: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.3 MiB/s wr, 817 op/s 2023-10-18T14:07:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:20 smithi114 ceph-mon[99494]: pgmap v380: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.3 MiB/s wr, 817 op/s 2023-10-18T14:07:23.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:22 smithi158 ceph-mon[103317]: pgmap v381: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.8 MiB/s wr, 533 op/s 2023-10-18T14:07:23.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:22 smithi172 ceph-mon[103574]: pgmap v381: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.8 MiB/s wr, 533 op/s 2023-10-18T14:07:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:22 smithi114 ceph-mon[99494]: pgmap v381: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.8 MiB/s wr, 533 op/s 2023-10-18T14:07:24.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:24 smithi114 ceph-mon[99494]: pgmap v382: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.3 MiB/s wr, 635 op/s 2023-10-18T14:07:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:24 smithi158 ceph-mon[103317]: pgmap v382: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.3 MiB/s wr, 635 op/s 2023-10-18T14:07:24.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:24 smithi172 ceph-mon[103574]: pgmap v382: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.3 MiB/s wr, 635 op/s 2023-10-18T14:07:27.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:26 smithi158 ceph-mon[103317]: pgmap v383: 97 pgs: 97 active+clean; 59 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.4 MiB/s wr, 646 op/s 2023-10-18T14:07:27.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:26 smithi172 ceph-mon[103574]: pgmap v383: 97 pgs: 97 active+clean; 59 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.4 MiB/s wr, 646 op/s 2023-10-18T14:07:27.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:26 smithi114 ceph-mon[99494]: pgmap v383: 97 pgs: 97 active+clean; 59 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.4 MiB/s wr, 646 op/s 2023-10-18T14:07:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.493+0000 7f4a38616700 1 -- 172.21.15.114:0/3109248125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a300ff620 msgr2=0x7f4a3010d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.493+0000 7f4a38616700 1 --2- 172.21.15.114:0/3109248125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a300ff620 0x7f4a3010d570 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800b0a0 tx=0x7f4a2800b3b0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.493+0000 7f4a38616700 1 -- 172.21.15.114:0/3109248125 shutdown_connections 2023-10-18T14:07:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.493+0000 7f4a38616700 1 --2- 172.21.15.114:0/3109248125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a300ff620 0x7f4a3010d570 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.493+0000 7f4a38616700 1 --2- 172.21.15.114:0/3109248125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4a30106760 0x7f4a30106b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.493+0000 7f4a38616700 1 --2- 172.21.15.114:0/3109248125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a300fec60 0x7f4a300ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.493+0000 7f4a38616700 1 -- 172.21.15.114:0/3109248125 >> 172.21.15.114:0/3109248125 conn(0x7f4a30075bf0 msgr2=0x7f4a300fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.493+0000 7f4a38616700 1 -- 172.21.15.114:0/3109248125 shutdown_connections 2023-10-18T14:07:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.494+0000 7f4a38616700 1 -- 172.21.15.114:0/3109248125 wait complete. 2023-10-18T14:07:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.494+0000 7f4a38616700 1 Processor -- start 2023-10-18T14:07:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.494+0000 7f4a38616700 1 -- start start 2023-10-18T14:07:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.494+0000 7f4a38616700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a300fec60 0x7f4a3019c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.494+0000 7f4a38616700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a300ff620 0x7f4a3019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.494+0000 7f4a38616700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4a30106760 0x7f4a30196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.494+0000 7f4a38616700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a301970b0 con 0x7f4a300fec60 2023-10-18T14:07:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.494+0000 7f4a38616700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30197220 con 0x7f4a30106760 2023-10-18T14:07:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.494+0000 7f4a38616700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a301973e0 con 0x7f4a300ff620 2023-10-18T14:07:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.494+0000 7f4a363b2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a300fec60 0x7f4a3019c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a363b2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a300fec60 0x7f4a3019c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46128/0 (socket says 172.21.15.114:46128) 2023-10-18T14:07:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a363b2700 1 -- 172.21.15.114:0/2068605294 learned_addr learned my addr 172.21.15.114:0/2068605294 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a36bb3700 1 --2- 172.21.15.114:0/2068605294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4a30106760 0x7f4a30196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a35bb1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a300ff620 0x7f4a3019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a363b2700 1 -- 172.21.15.114:0/2068605294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a300ff620 msgr2=0x7f4a3019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a363b2700 1 --2- 172.21.15.114:0/2068605294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a300ff620 0x7f4a3019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a363b2700 1 -- 172.21.15.114:0/2068605294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4a30106760 msgr2=0x7f4a30196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a363b2700 1 --2- 172.21.15.114:0/2068605294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4a30106760 0x7f4a30196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a363b2700 1 -- 172.21.15.114:0/2068605294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a28009d00 con 0x7f4a300fec60 2023-10-18T14:07:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a363b2700 1 --2- 172.21.15.114:0/2068605294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a300fec60 0x7f4a3019c920 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00e9a0 tx=0x7f4a2c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a277fe700 1 -- 172.21.15.114:0/2068605294 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c009790 con 0x7f4a300fec60 2023-10-18T14:07:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a277fe700 1 -- 172.21.15.114:0/2068605294 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a2c010430 con 0x7f4a300fec60 2023-10-18T14:07:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a38616700 1 -- 172.21.15.114:0/2068605294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a301976c0 con 0x7f4a300fec60 2023-10-18T14:07:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a277fe700 1 -- 172.21.15.114:0/2068605294 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c018680 con 0x7f4a300fec60 2023-10-18T14:07:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.495+0000 7f4a38616700 1 -- 172.21.15.114:0/2068605294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a301a3910 con 0x7f4a300fec60 2023-10-18T14:07:27.511 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.499+0000 7f4a277fe700 1 -- 172.21.15.114:0/2068605294 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f4a2c0105a0 con 0x7f4a300fec60 2023-10-18T14:07:27.512 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.499+0000 7f4a447ffb80 1 Processor -- start 2023-10-18T14:07:27.512 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.499+0000 7f4a277fe700 1 --2- 172.21.15.114:0/2068605294 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4a1c0a15f0 0x7f4a1c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.512 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a36bb3700 1 --2- 172.21.15.114:0/2068605294 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4a1c0a15f0 0x7f4a1c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.512 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a277fe700 1 -- 172.21.15.114:0/2068605294 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f4a2c014070 con 0x7f4a300fec60 2023-10-18T14:07:27.512 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a447ffb80 1 -- start start 2023-10-18T14:07:27.513 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a447ffb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.513 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a447ffb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1f50 0x556f7d5abed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.513 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a447ffb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5ac410 0x556f7d5ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.513 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a447ffb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7d51f680 con 0x556f7d5b1f50 2023-10-18T14:07:27.514 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a447ffb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7d505c00 con 0x556f7d5ac410 2023-10-18T14:07:27.514 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a447ffb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7d503520 con 0x556f7d5b1630 2023-10-18T14:07:27.514 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a36bb3700 1 --2- 172.21.15.114:0/2068605294 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4a1c0a15f0 0x7f4a1c0a3ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009fd0 tx=0x7f4a2800b740 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:27.514 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a363b2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.514 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a363b2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:50072/0 (socket says 172.21.15.114:50072) 2023-10-18T14:07:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a363b2700 1 -- 172.21.15.114:0/4086652990 learned_addr learned my addr 172.21.15.114:0/4086652990 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a36bb3700 1 --2- 172.21.15.114:0/4086652990 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5ac410 0x556f7d5ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.500+0000 7f4a363b2700 1 -- 172.21.15.114:0/4086652990 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5ac410 msgr2=0x556f7d5ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.501+0000 7f4a363b2700 1 --2- 172.21.15.114:0/4086652990 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5ac410 0x556f7d5ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.515 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.501+0000 7f4a363b2700 1 -- 172.21.15.114:0/4086652990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1f50 msgr2=0x556f7d5abed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T14:07:27.516 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.501+0000 7f4a363b2700 1 --2- 172.21.15.114:0/4086652990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1f50 0x556f7d5abed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.516 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.501+0000 7f4a363b2700 1 -- 172.21.15.114:0/4086652990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f7d4bc390 con 0x556f7d5b1630 2023-10-18T14:07:27.516 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.501+0000 7f4a363b2700 1 --2- 172.21.15.114:0/4086652990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5b1a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0a2100 tx=0x7f4a2c09a9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d2617b8ab274880 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:27.516 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.503+0000 7f4a24ff9700 1 -- 172.21.15.114:0/4086652990 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0a2630 con 0x556f7d5b1630 2023-10-18T14:07:27.516 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.503+0000 7f4a24ff9700 1 -- 172.21.15.114:0/4086652990 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a2c098640 con 0x556f7d5b1630 2023-10-18T14:07:27.516 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.503+0000 7f4a24ff9700 1 -- 172.21.15.114:0/4086652990 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c099790 con 0x556f7d5b1630 2023-10-18T14:07:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.504+0000 7f4a447ffb80 1 -- 172.21.15.114:0/4086652990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 msgr2=0x556f7d5b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.504+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/4086652990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5b1a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0a2100 tx=0x7f4a2c09a9a0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.504+0000 7f4a447ffb80 1 -- 172.21.15.114:0/4086652990 shutdown_connections 2023-10-18T14:07:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.504+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/4086652990 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5ac410 0x556f7d5ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.504+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/4086652990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5b1a10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.518 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.504+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/4086652990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1f50 0x556f7d5abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.518 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.504+0000 7f4a447ffb80 1 -- 172.21.15.114:0/4086652990 >> 172.21.15.114:0/4086652990 conn(0x556f7d5206c0 msgr2=0x556f7d5a65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:27.518 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.504+0000 7f4a447ffb80 1 -- 172.21.15.114:0/4086652990 shutdown_connections 2023-10-18T14:07:27.518 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.504+0000 7f4a447ffb80 1 -- 172.21.15.114:0/4086652990 wait complete. 2023-10-18T14:07:27.518 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.504+0000 7f4a447ffb80 1 -- start start 2023-10-18T14:07:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.504+0000 7f4a447ffb80 1 Processor -- start 2023-10-18T14:07:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a447ffb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5ac410 0x556f7d5b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a447ffb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1630 0x556f7d5b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a447ffb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5b1f50 0x556f7d5b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a447ffb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7d4fee10 con 0x556f7d5b1630 2023-10-18T14:07:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a447ffb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7d49b6b0 con 0x556f7d5b1f50 2023-10-18T14:07:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a447ffb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7d49b350 con 0x556f7d5ac410 2023-10-18T14:07:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a447ffb80 10 client.0 _ll_register_callbacks cb 0x556f7d3e5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a36bb3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5b1f50 0x556f7d5b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a363b2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5ac410 0x556f7d5b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a36bb3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5b1f50 0x556f7d5b5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42288/0 (socket says 172.21.15.114:42288) 2023-10-18T14:07:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a36bb3700 1 -- 172.21.15.114:0/313918089 learned_addr learned my addr 172.21.15.114:0/313918089 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a35bb1700 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1630 0x556f7d5b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a363b2700 1 -- 172.21.15.114:0/313918089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5b1f50 msgr2=0x556f7d5b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a363b2700 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5b1f50 0x556f7d5b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a363b2700 1 -- 172.21.15.114:0/313918089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1630 msgr2=0x556f7d5b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a363b2700 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1630 0x556f7d5b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a363b2700 1 -- 172.21.15.114:0/313918089 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a301a3910 con 0x556f7d5ac410 2023-10-18T14:07:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a35bb1700 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1630 0x556f7d5b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.505+0000 7f4a36bb3700 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5b1f50 0x556f7d5b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.506+0000 7f4a363b2700 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5ac410 0x556f7d5b5420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c010b20 tx=0x7f4a2c00c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9b688c8f6c52060 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.506+0000 7f4a19ffb700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-10-18T14:07:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.506+0000 7f4a19ffb700 1 -- 172.21.15.114:0/313918089 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0b2050 con 0x556f7d5ac410 2023-10-18T14:07:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.506+0000 7f4a447ffb80 1 -- 172.21.15.114:0/313918089 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f7d503e90 con 0x556f7d5ac410 2023-10-18T14:07:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.506+0000 7f4a19ffb700 1 -- 172.21.15.114:0/313918089 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f4a2c0a2630 con 0x556f7d5ac410 2023-10-18T14:07:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.506+0000 7f4a19ffb700 1 -- 172.21.15.114:0/313918089 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a2c0b8300 con 0x556f7d5ac410 2023-10-18T14:07:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.506+0000 7f4a447ffb80 10 client.25837 fetch_fsmap learned FSMap version 34 2023-10-18T14:07:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.506+0000 7f4a447ffb80 1 -- 172.21.15.114:0/313918089 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x556f7d329d80 con 0x556f7d5ac410 2023-10-18T14:07:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.506+0000 7f4a19ffb700 1 -- 172.21.15.114:0/313918089 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556f7d503e90 con 0x556f7d5ac410 2023-10-18T14:07:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.507+0000 7f4a19ffb700 1 -- 172.21.15.114:0/313918089 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f4a2c0a21a0 con 0x556f7d5ac410 2023-10-18T14:07:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.507+0000 7f4a447ffb80 10 client.25837 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:07:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.507+0000 7f4a447ffb80 10 client.25837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.507+0000 7f4a447ffb80 20 client.25837 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.507+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556f7d5c99a0 0x556f7d5cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.507+0000 7f4a447ffb80 4 client.25837 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:07:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.507+0000 7f4a447ffb80 1 -- 172.21.15.114:0/313918089 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f7d57b850 con 0x556f7d5c99a0 2023-10-18T14:07:27.526 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.507+0000 7f4a35bb1700 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556f7d5c99a0 0x556f7d5cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.526 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.507+0000 7f4a35bb1700 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556f7d5c99a0 0x556f7d5cbdc0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=792a323f9deb0b08 server_cookie=cb03d920a73bc5a0 in_seq=0 out_seq=0 2023-10-18T14:07:27.526 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.507+0000 7f4a19ffb700 10 client.25837 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.508+0000 7f4a19ffb700 1 -- 172.21.15.114:0/313918089 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556f7d57b850 con 0x556f7d5c99a0 2023-10-18T14:07:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.508+0000 7f4a19ffb700 10 client.25837 handle_command_reply: tid=0 2023-10-18T14:07:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.508+0000 7f4a447ffb80 1 client.25837 shutdown 2023-10-18T14:07:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.508+0000 7f4a447ffb80 1 -- 172.21.15.114:0/313918089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5ac410 msgr2=0x556f7d5b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.508+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5ac410 0x556f7d5b5420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c010b20 tx=0x7f4a2c00c480 comp rx=0 tx=0).stop 2023-10-18T14:07:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.508+0000 7f4a447ffb80 1 -- 172.21.15.114:0/313918089 shutdown_connections 2023-10-18T14:07:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.508+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556f7d5c99a0 0x556f7d5cbdc0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.508+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5b1f50 0x556f7d5b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.508+0000 7f4a19ffb700 0 client.25837 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.508+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5ac410 0x556f7d5b5420 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.508+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/313918089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1630 0x556f7d5b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.530 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.508+0000 7f4a447ffb80 1 -- 172.21.15.114:0/313918089 >> 172.21.15.114:0/313918089 conn(0x556f7d5206c0 msgr2=0x556f7d5a5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:27.530 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.509+0000 7f4a447ffb80 1 -- 172.21.15.114:0/313918089 shutdown_connections 2023-10-18T14:07:27.530 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.509+0000 7f4a447ffb80 1 -- 172.21.15.114:0/313918089 wait complete. 2023-10-18T14:07:27.530 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.509+0000 7f4a447ffb80 20 client.25837 trim_cache size 0 max 16384 2023-10-18T14:07:27.535 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a447ffb80 1 Processor -- start 2023-10-18T14:07:27.535 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a447ffb80 1 -- start start 2023-10-18T14:07:27.535 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a447ffb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5ac410 0x556f7d5abed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.535 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a447ffb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a447ffb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5b1f50 0x556f7d5b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a447ffb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7d37f8c0 con 0x556f7d5ac410 2023-10-18T14:07:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a447ffb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7d59f0f0 con 0x556f7d5b1f50 2023-10-18T14:07:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a447ffb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7d5a7120 con 0x556f7d5b1630 2023-10-18T14:07:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a363b2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5ac410 0x556f7d5abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a363b2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5ac410 0x556f7d5abed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46148/0 (socket says 172.21.15.114:46148) 2023-10-18T14:07:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a363b2700 1 -- 172.21.15.114:0/2414337239 learned_addr learned my addr 172.21.15.114:0/2414337239 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a36bb3700 1 --2- 172.21.15.114:0/2414337239 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5b1f50 0x556f7d5b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a35bb1700 1 --2- 172.21.15.114:0/2414337239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a363b2700 1 -- 172.21.15.114:0/2414337239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 msgr2=0x556f7d5c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a363b2700 1 --2- 172.21.15.114:0/2414337239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a363b2700 1 -- 172.21.15.114:0/2414337239 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5b1f50 msgr2=0x556f7d5b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a363b2700 1 --2- 172.21.15.114:0/2414337239 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5b1f50 0x556f7d5b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.525+0000 7f4a363b2700 1 -- 172.21.15.114:0/2414337239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f7d312c00 con 0x556f7d5ac410 2023-10-18T14:07:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.526+0000 7f4a363b2700 1 --2- 172.21.15.114:0/2414337239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5ac410 0x556f7d5abed0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c099fa0 tx=0x7f4a2c099410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1076b1338244ff server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.526+0000 7f4a257fa700 1 -- 172.21.15.114:0/2414337239 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0995d0 con 0x556f7d5ac410 2023-10-18T14:07:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.526+0000 7f4a257fa700 1 -- 172.21.15.114:0/2414337239 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a2c0965e0 con 0x556f7d5ac410 2023-10-18T14:07:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.526+0000 7f4a257fa700 1 -- 172.21.15.114:0/2414337239 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c09a500 con 0x556f7d5ac410 2023-10-18T14:07:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.526+0000 7f4a447ffb80 1 -- 172.21.15.114:0/2414337239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5ac410 msgr2=0x556f7d5abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.526+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/2414337239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5ac410 0x556f7d5abed0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c099fa0 tx=0x7f4a2c099410 comp rx=0 tx=0).stop 2023-10-18T14:07:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.526+0000 7f4a447ffb80 1 -- 172.21.15.114:0/2414337239 shutdown_connections 2023-10-18T14:07:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.526+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/2414337239 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5b1f50 0x556f7d5b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/2414337239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5ac410 0x556f7d5abed0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/2414337239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 1 -- 172.21.15.114:0/2414337239 >> 172.21.15.114:0/2414337239 conn(0x556f7d5206c0 msgr2=0x556f7d5b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 1 -- 172.21.15.114:0/2414337239 shutdown_connections 2023-10-18T14:07:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 1 -- 172.21.15.114:0/2414337239 wait complete. 2023-10-18T14:07:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 1 -- start start 2023-10-18T14:07:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 1 Processor -- start 2023-10-18T14:07:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5ac410 0x556f7d5bed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5bf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1f50 0x556f7d5bf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7d61c7d0 con 0x556f7d5b1f50 2023-10-18T14:07:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7d61c910 con 0x556f7d5ac410 2023-10-18T14:07:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7d61caa0 con 0x556f7d5b1630 2023-10-18T14:07:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a447ffb80 10 client.0 _ll_register_callbacks cb 0x556f7d3e5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a36bb3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1f50 0x556f7d5bf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a36bb3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1f50 0x556f7d5bf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46158/0 (socket says 172.21.15.114:46158) 2023-10-18T14:07:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.527+0000 7f4a363b2700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5ac410 0x556f7d5bed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a36bb3700 1 -- 172.21.15.114:0/1682741203 learned_addr learned my addr 172.21.15.114:0/1682741203 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:27.544 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a35bb1700 1 --2- 172.21.15.114:0/1682741203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5bf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.544 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a36bb3700 1 -- 172.21.15.114:0/1682741203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 msgr2=0x556f7d5bf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:27.544 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a36bb3700 1 --2- 172.21.15.114:0/1682741203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5bf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.544 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a36bb3700 1 -- 172.21.15.114:0/1682741203 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5ac410 msgr2=0x556f7d5bed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:27.544 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a36bb3700 1 --2- 172.21.15.114:0/1682741203 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5ac410 0x556f7d5bed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a36bb3700 1 -- 172.21.15.114:0/1682741203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2c07a050 con 0x556f7d5b1f50 2023-10-18T14:07:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a363b2700 1 --2- 172.21.15.114:0/1682741203 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5ac410 0x556f7d5bed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a36bb3700 1 --2- 172.21.15.114:0/1682741203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1f50 0x556f7d5bf780 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4a28007760 tx=0x7f4a280099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0cc0f3766e2a6d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a19ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:07:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a19ffb700 1 -- 172.21.15.114:0/1682741203 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800e040 con 0x556f7d5b1f50 2023-10-18T14:07:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a19ffb700 1 -- 172.21.15.114:0/1682741203 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f4a28022040 con 0x556f7d5b1f50 2023-10-18T14:07:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a447ffb80 1 -- 172.21.15.114:0/1682741203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a2c098640 con 0x556f7d5b1f50 2023-10-18T14:07:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a19ffb700 1 -- 172.21.15.114:0/1682741203 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a28005990 con 0x556f7d5b1f50 2023-10-18T14:07:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a447ffb80 10 client.16467 fetch_fsmap learned FSMap version 34 2023-10-18T14:07:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.528+0000 7f4a447ffb80 1 -- 172.21.15.114:0/1682741203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x556f7d3501f0 con 0x556f7d5b1f50 2023-10-18T14:07:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.529+0000 7f4a19ffb700 1 -- 172.21.15.114:0/1682741203 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a2c098640 con 0x556f7d5b1f50 2023-10-18T14:07:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.529+0000 7f4a19ffb700 1 -- 172.21.15.114:0/1682741203 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f4a2803c400 con 0x556f7d5b1f50 2023-10-18T14:07:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.529+0000 7f4a447ffb80 10 client.16467 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:07:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.529+0000 7f4a447ffb80 10 client.16467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.529+0000 7f4a447ffb80 20 client.16467 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.529+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/1682741203 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556f7d61e350 0x556f7d620770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.529+0000 7f4a447ffb80 4 client.16467 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:07:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.529+0000 7f4a447ffb80 1 -- 172.21.15.114:0/1682741203 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556f7d4f7df0 con 0x556f7d61e350 2023-10-18T14:07:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.529+0000 7f4a363b2700 1 --2- 172.21.15.114:0/1682741203 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556f7d61e350 0x556f7d620770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.529+0000 7f4a19ffb700 10 client.16467 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.529+0000 7f4a363b2700 1 --2- 172.21.15.114:0/1682741203 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556f7d61e350 0x556f7d620770 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a862dcc74399188 server_cookie=8a84796a546eb044 in_seq=0 out_seq=0 2023-10-18T14:07:27.563 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.558+0000 7f4a19ffb700 1 -- 172.21.15.114:0/1682741203 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556f7d4f7df0 con 0x556f7d61e350 2023-10-18T14:07:27.563 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.558+0000 7f4a19ffb700 10 client.16467 handle_command_reply: tid=0 2023-10-18T14:07:27.563 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a447ffb80 1 client.16467 shutdown 2023-10-18T14:07:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a447ffb80 1 -- 172.21.15.114:0/1682741203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1f50 msgr2=0x556f7d5bf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/1682741203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1f50 0x556f7d5bf780 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4a28007760 tx=0x7f4a280099e0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a447ffb80 1 -- 172.21.15.114:0/1682741203 shutdown_connections 2023-10-18T14:07:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/1682741203 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x556f7d61e350 0x556f7d620770 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/1682741203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556f7d5b1f50 0x556f7d5bf780 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a19ffb700 0 client.16467 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/1682741203 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x556f7d5ac410 0x556f7d5bed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a447ffb80 1 --2- 172.21.15.114:0/1682741203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7d5b1630 0x556f7d5bf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a447ffb80 1 -- 172.21.15.114:0/1682741203 >> 172.21.15.114:0/1682741203 conn(0x556f7d5206c0 msgr2=0x556f7d5b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a447ffb80 1 -- 172.21.15.114:0/1682741203 shutdown_connections 2023-10-18T14:07:27.566 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a447ffb80 1 -- 172.21.15.114:0/1682741203 wait complete. 2023-10-18T14:07:27.566 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a447ffb80 20 client.16467 trim_cache size 0 max 16384 2023-10-18T14:07:27.566 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:07:27.566 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:07:27.567 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:07:27.567 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:07:27.568 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a38616700 1 -- 172.21.15.114:0/2068605294 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4a1c0a15f0 msgr2=0x7f4a1c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:27.568 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a38616700 1 --2- 172.21.15.114:0/2068605294 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4a1c0a15f0 0x7f4a1c0a3ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009fd0 tx=0x7f4a2800b740 comp rx=0 tx=0).stop 2023-10-18T14:07:27.568 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a38616700 1 -- 172.21.15.114:0/2068605294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a300fec60 msgr2=0x7f4a3019c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:27.568 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a38616700 1 --2- 172.21.15.114:0/2068605294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a300fec60 0x7f4a3019c920 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00e9a0 tx=0x7f4a2c00ecb0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a38616700 1 -- 172.21.15.114:0/2068605294 shutdown_connections 2023-10-18T14:07:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.559+0000 7f4a38616700 1 --2- 172.21.15.114:0/2068605294 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f4a1c0a15f0 0x7f4a1c0a3ab0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.560+0000 7f4a38616700 1 --2- 172.21.15.114:0/2068605294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4a30106760 0x7f4a30196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.560+0000 7f4a38616700 1 --2- 172.21.15.114:0/2068605294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a300fec60 0x7f4a3019c920 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.560+0000 7f4a38616700 1 --2- 172.21.15.114:0/2068605294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a300ff620 0x7f4a3019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.560+0000 7f4a38616700 1 -- 172.21.15.114:0/2068605294 >> 172.21.15.114:0/2068605294 conn(0x7f4a30075bf0 msgr2=0x7f4a300fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.560+0000 7f4a38616700 1 -- 172.21.15.114:0/2068605294 shutdown_connections 2023-10-18T14:07:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:27.560+0000 7f4a38616700 1 -- 172.21.15.114:0/2068605294 wait complete. 2023-10-18T14:07:29.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:28 smithi158 ceph-mon[103317]: pgmap v384: 97 pgs: 97 active+clean; 59 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 2.7 MiB/s wr, 525 op/s 2023-10-18T14:07:29.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:28 smithi172 ceph-mon[103574]: pgmap v384: 97 pgs: 97 active+clean; 59 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 2.7 MiB/s wr, 525 op/s 2023-10-18T14:07:29.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:28 smithi114 ceph-mon[99494]: pgmap v384: 97 pgs: 97 active+clean; 59 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 2.7 MiB/s wr, 525 op/s 2023-10-18T14:07:29.139 INFO:tasks.workunit.client.0.smithi114.stdout:50000 trunc from 0x3a0a6d to 0x51d279 2023-10-18T14:07:29.140 INFO:tasks.workunit.client.0.smithi114.stdout:All 50000 operations completed A-OK! 2023-10-18T14:07:29.140 INFO:tasks.workunit.client.0.smithi114.stderr:+ ./fsx -z 100MB -N 50000 -p 10000 -l 104857600 2023-10-18T14:07:29.141 INFO:tasks.workunit.client.0.smithi114.stdout:Seed set to 1 2023-10-18T14:07:30.316 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support fallocate mode 0, disabling! 2023-10-18T14:07:30.316 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2023-10-18T14:07:30.318 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2023-10-18T14:07:30.319 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2023-10-18T14:07:30.319 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support clone range, disabling! 2023-10-18T14:07:30.322 INFO:tasks.workunit.client.0.smithi114.stderr:main: filesystem does not support dedupe range, disabling! 2023-10-18T14:07:30.326 INFO:tasks.workunit.client.0.smithi114.stdout:skipping zero size read 2023-10-18T14:07:30.326 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x7e0023 2023-10-18T14:07:30.335 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0xe91bf1 2023-10-18T14:07:30.336 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0x5a6de73 2023-10-18T14:07:30.351 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x5bdf572 2023-10-18T14:07:30.356 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x602fcad 2023-10-18T14:07:30.501 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0x623914d 2023-10-18T14:07:30.554 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0x628f369 2023-10-18T14:07:30.596 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0x6328dee 2023-10-18T14:07:30.792 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x635b95a 2023-10-18T14:07:31.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:30 smithi158 ceph-mon[103317]: pgmap v385: 97 pgs: 97 active+clean; 52 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.9 MiB/s wr, 755 op/s 2023-10-18T14:07:31.054 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0x637b84e 2023-10-18T14:07:31.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:30 smithi172 ceph-mon[103574]: pgmap v385: 97 pgs: 97 active+clean; 52 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.9 MiB/s wr, 755 op/s 2023-10-18T14:07:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:30 smithi114 ceph-mon[99494]: pgmap v385: 97 pgs: 97 active+clean; 52 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.9 MiB/s wr, 755 op/s 2023-10-18T14:07:31.143 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x63b535e 2023-10-18T14:07:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:32 smithi158 ceph-mon[103317]: pgmap v386: 97 pgs: 97 active+clean; 52 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.6 MiB/s wr, 506 op/s 2023-10-18T14:07:33.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:32 smithi172 ceph-mon[103574]: pgmap v386: 97 pgs: 97 active+clean; 52 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.6 MiB/s wr, 506 op/s 2023-10-18T14:07:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:32 smithi114 ceph-mon[99494]: pgmap v386: 97 pgs: 97 active+clean; 52 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.6 MiB/s wr, 506 op/s 2023-10-18T14:07:34.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:34 smithi114 ceph-mon[99494]: pgmap v387: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.9 MiB/s wr, 627 op/s 2023-10-18T14:07:34.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:34 smithi158 ceph-mon[103317]: pgmap v387: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.9 MiB/s wr, 627 op/s 2023-10-18T14:07:34.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:34 smithi172 ceph-mon[103574]: pgmap v387: 97 pgs: 97 active+clean; 51 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.9 MiB/s wr, 627 op/s 2023-10-18T14:07:36.898 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0x63d8bf1 2023-10-18T14:07:37.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:36 smithi158 ceph-mon[103317]: pgmap v388: 97 pgs: 97 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.8 MiB/s wr, 673 op/s 2023-10-18T14:07:37.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:36 smithi172 ceph-mon[103574]: pgmap v388: 97 pgs: 97 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.8 MiB/s wr, 673 op/s 2023-10-18T14:07:37.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:36 smithi114 ceph-mon[99494]: pgmap v388: 97 pgs: 97 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.8 MiB/s wr, 673 op/s 2023-10-18T14:07:38.800 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x63e65d6 2023-10-18T14:07:39.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:38 smithi158 ceph-mon[103317]: pgmap v389: 97 pgs: 97 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 2.2 MiB/s wr, 616 op/s 2023-10-18T14:07:39.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:38 smithi172 ceph-mon[103574]: pgmap v389: 97 pgs: 97 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 2.2 MiB/s wr, 616 op/s 2023-10-18T14:07:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:38 smithi114 ceph-mon[99494]: pgmap v389: 97 pgs: 97 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 2.2 MiB/s wr, 616 op/s 2023-10-18T14:07:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.698+0000 7f3930a23700 1 -- 172.21.15.114:0/789729360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c1077f0 msgr2=0x7f392c107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.698+0000 7f3930a23700 1 --2- 172.21.15.114:0/789729360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c1077f0 0x7f392c107c70 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f3920009990 tx=0x7f3920009ca0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.699+0000 7f3930a23700 1 -- 172.21.15.114:0/789729360 shutdown_connections 2023-10-18T14:07:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.699+0000 7f3930a23700 1 --2- 172.21.15.114:0/789729360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f392c1081b0 0x7f392c114320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.699+0000 7f3930a23700 1 --2- 172.21.15.114:0/789729360 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f392c10d4f0 0x7f392c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.699+0000 7f3930a23700 1 --2- 172.21.15.114:0/789729360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c1077f0 0x7f392c107c70 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.699+0000 7f3930a23700 1 -- 172.21.15.114:0/789729360 >> 172.21.15.114:0/789729360 conn(0x7f392c06b710 msgr2=0x7f392c06bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.699+0000 7f3930a23700 1 -- 172.21.15.114:0/789729360 shutdown_connections 2023-10-18T14:07:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.699+0000 7f3930a23700 1 -- 172.21.15.114:0/789729360 wait complete. 2023-10-18T14:07:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.700+0000 7f3930a23700 1 Processor -- start 2023-10-18T14:07:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.700+0000 7f3930a23700 1 -- start start 2023-10-18T14:07:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.700+0000 7f3930a23700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c1077f0 0x7f392c06f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.700+0000 7f3930a23700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f392c1081b0 0x7f392c06f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.700+0000 7f3930a23700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f392c10d4f0 0x7f392c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.700+0000 7f3930a23700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c1ad5c0 con 0x7f392c1077f0 2023-10-18T14:07:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.700+0000 7f3930a23700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c1ad730 con 0x7f392c1081b0 2023-10-18T14:07:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.700+0000 7f3930a23700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c1ad8f0 con 0x7f392c10d4f0 2023-10-18T14:07:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.700+0000 7f392a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c1077f0 0x7f392c06f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.700+0000 7f392a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c1077f0 0x7f392c06f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46168/0 (socket says 172.21.15.114:46168) 2023-10-18T14:07:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.700+0000 7f392a59c700 1 -- 172.21.15.114:0/3766841080 learned_addr learned my addr 172.21.15.114:0/3766841080 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.700+0000 7f392ad9d700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f392c10d4f0 0x7f392c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.709 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f392a59c700 1 -- 172.21.15.114:0/3766841080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f392c10d4f0 msgr2=0x7f392c06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:40.709 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f392a59c700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f392c10d4f0 0x7f392c06fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.709 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f3929d9b700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f392c1081b0 0x7f392c06f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.709 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f392a59c700 1 -- 172.21.15.114:0/3766841080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f392c1081b0 msgr2=0x7f392c06f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:40.709 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f392a59c700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f392c1081b0 0x7f392c06f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f392a59c700 1 -- 172.21.15.114:0/3766841080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39200095f0 con 0x7f392c1077f0 2023-10-18T14:07:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f392ad9d700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f392c10d4f0 0x7f392c06fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f3929d9b700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f392c1081b0 0x7f392c06f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:07:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f392a59c700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c1077f0 0x7f392c06f240 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f391c00e9a0 tx=0x7f391c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f391b7fe700 1 -- 172.21.15.114:0/3766841080 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c009790 con 0x7f392c1077f0 2023-10-18T14:07:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f3930a23700 1 -- 172.21.15.114:0/3766841080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c1adbd0 con 0x7f392c1077f0 2023-10-18T14:07:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f391b7fe700 1 -- 172.21.15.114:0/3766841080 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f391c00cbd0 con 0x7f392c1077f0 2023-10-18T14:07:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f391b7fe700 1 -- 172.21.15.114:0/3766841080 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c018680 con 0x7f392c1077f0 2023-10-18T14:07:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.701+0000 7f3930a23700 1 -- 172.21.15.114:0/3766841080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c1ae130 con 0x7f392c1077f0 2023-10-18T14:07:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.704+0000 7f391b7fe700 1 -- 172.21.15.114:0/3766841080 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f391c0187e0 con 0x7f392c1077f0 2023-10-18T14:07:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.704+0000 7f391b7fe700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f39140a15e0 0x7f39140a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.705+0000 7f3929d9b700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f39140a15e0 0x7f39140a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.705+0000 7f391b7fe700 1 -- 172.21.15.114:0/3766841080 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f391c014070 con 0x7f392c1077f0 2023-10-18T14:07:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.705+0000 7f393cc0cb80 1 Processor -- start 2023-10-18T14:07:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.705+0000 7f3929d9b700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f39140a15e0 0x7f39140a3aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f392000b2e0 tx=0x7f3920005e80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.705+0000 7f393cc0cb80 1 -- start start 2023-10-18T14:07:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.705+0000 7f393cc0cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2630 0x564128bb2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.705+0000 7f393cc0cb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bb2f50 0x564128baced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.705+0000 7f393cc0cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bad410 0x564128bad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.705+0000 7f393cc0cb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564128b20680 con 0x564128bb2f50 2023-10-18T14:07:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.705+0000 7f393cc0cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x564128b06c00 con 0x564128bad410 2023-10-18T14:07:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.705+0000 7f393cc0cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564128b04520 con 0x564128bb2630 2023-10-18T14:07:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f3929d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bb2f50 0x564128baced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f392a59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2630 0x564128bb2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f392ad9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bad410 0x564128bad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f392a59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2630 0x564128bb2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:50112/0 (socket says 172.21.15.114:50112) 2023-10-18T14:07:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f3929d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bb2f50 0x564128baced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46178/0 (socket says 172.21.15.114:46178) 2023-10-18T14:07:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f392a59c700 1 -- 172.21.15.114:0/30059884 learned_addr learned my addr 172.21.15.114:0/30059884 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f392a59c700 1 -- 172.21.15.114:0/30059884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bad410 msgr2=0x564128bad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f392a59c700 1 --2- 172.21.15.114:0/30059884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bad410 0x564128bad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f392a59c700 1 -- 172.21.15.114:0/30059884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bb2f50 msgr2=0x564128baced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f392a59c700 1 --2- 172.21.15.114:0/30059884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bb2f50 0x564128baced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f392a59c700 1 -- 172.21.15.114:0/30059884 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564128abd390 con 0x564128bb2630 2023-10-18T14:07:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f392a59c700 1 --2- 172.21.15.114:0/30059884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2630 0x564128bb2a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f391c009230 tx=0x7f391c099df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d49bba2d2565e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f3918ff9700 1 -- 172.21.15.114:0/30059884 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c098610 con 0x564128bb2630 2023-10-18T14:07:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f3918ff9700 1 -- 172.21.15.114:0/30059884 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f391c09e120 con 0x564128bb2630 2023-10-18T14:07:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.706+0000 7f3918ff9700 1 -- 172.21.15.114:0/30059884 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0a2490 con 0x564128bb2630 2023-10-18T14:07:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.707+0000 7f393cc0cb80 1 -- 172.21.15.114:0/30059884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2630 msgr2=0x564128bb2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:40.722 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.707+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/30059884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2630 0x564128bb2a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f391c009230 tx=0x7f391c099df0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.722 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.707+0000 7f393cc0cb80 1 -- 172.21.15.114:0/30059884 shutdown_connections 2023-10-18T14:07:40.722 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.707+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/30059884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bad410 0x564128bad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.722 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.707+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/30059884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2630 0x564128bb2a10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.722 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.707+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/30059884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bb2f50 0x564128baced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.722 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.707+0000 7f393cc0cb80 1 -- 172.21.15.114:0/30059884 >> 172.21.15.114:0/30059884 conn(0x564128b216c0 msgr2=0x564128ba75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.707+0000 7f393cc0cb80 1 -- 172.21.15.114:0/30059884 shutdown_connections 2023-10-18T14:07:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.707+0000 7f393cc0cb80 1 -- 172.21.15.114:0/30059884 wait complete. 2023-10-18T14:07:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f393cc0cb80 1 -- start start 2023-10-18T14:07:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f393cc0cb80 1 Processor -- start 2023-10-18T14:07:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f393cc0cb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 0x564128bb6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.724 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f393cc0cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2630 0x564128bb6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.724 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f393cc0cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2f50 0x564128bb6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.724 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f393cc0cb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564128affe10 con 0x564128bad410 2023-10-18T14:07:40.724 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f393cc0cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x564128a9c6b0 con 0x564128bb2630 2023-10-18T14:07:40.724 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f393cc0cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564128a9c350 con 0x564128bb2f50 2023-10-18T14:07:40.725 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f393cc0cb80 10 client.0 _ll_register_callbacks cb 0x5641289e6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:40.725 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f392a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 0x564128bb6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.725 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f392a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 0x564128bb6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46182/0 (socket says 172.21.15.114:46182) 2023-10-18T14:07:40.725 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f392a59c700 1 -- 172.21.15.114:0/3247201726 learned_addr learned my addr 172.21.15.114:0/3247201726 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:40.725 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f3929d9b700 1 --2- 172.21.15.114:0/3247201726 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2630 0x564128bb6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.726 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f392a59c700 1 -- 172.21.15.114:0/3247201726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2f50 msgr2=0x564128bb6d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-18T14:07:40.726 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f392a59c700 1 --2- 172.21.15.114:0/3247201726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2f50 0x564128bb6d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.726 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f392a59c700 1 -- 172.21.15.114:0/3247201726 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2630 msgr2=0x564128bb6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:40.726 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f392a59c700 1 --2- 172.21.15.114:0/3247201726 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2630 0x564128bb6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.726 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.708+0000 7f392a59c700 1 -- 172.21.15.114:0/3247201726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c1ae130 con 0x564128bad410 2023-10-18T14:07:40.727 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.709+0000 7f392a59c700 1 --2- 172.21.15.114:0/3247201726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 0x564128bb6300 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f391c0caae0 tx=0x7f391c00efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433483974c859a2e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:40.727 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.709+0000 7f3911ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:07:40.727 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.710+0000 7f3911ffb700 1 -- 172.21.15.114:0/3247201726 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0b6070 con 0x564128bad410 2023-10-18T14:07:40.727 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.710+0000 7f3911ffb700 1 -- 172.21.15.114:0/3247201726 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f391c099900 con 0x564128bad410 2023-10-18T14:07:40.727 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.711+0000 7f393cc0cb80 1 -- 172.21.15.114:0/3247201726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564128b04e90 con 0x564128bad410 2023-10-18T14:07:40.728 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.711+0000 7f3911ffb700 1 -- 172.21.15.114:0/3247201726 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f391c099ac0 con 0x564128bad410 2023-10-18T14:07:40.728 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.711+0000 7f393cc0cb80 10 client.16479 fetch_fsmap learned FSMap version 34 2023-10-18T14:07:40.728 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.711+0000 7f393cc0cb80 1 -- 172.21.15.114:0/3247201726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56412892ad80 con 0x564128bad410 2023-10-18T14:07:40.728 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.712+0000 7f3911ffb700 1 -- 172.21.15.114:0/3247201726 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564128b04e90 con 0x564128bad410 2023-10-18T14:07:40.728 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.712+0000 7f3911ffb700 1 -- 172.21.15.114:0/3247201726 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f391c083bf0 con 0x564128bad410 2023-10-18T14:07:40.729 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.712+0000 7f393cc0cb80 10 client.16479 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:07:40.729 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.712+0000 7f393cc0cb80 10 client.16479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:40.729 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.712+0000 7f393cc0cb80 20 client.16479 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:40.729 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.712+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/3247201726 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564128bc65f0 0x564128bc8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.730 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.712+0000 7f393cc0cb80 4 client.16479 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:07:40.730 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.712+0000 7f393cc0cb80 1 -- 172.21.15.114:0/3247201726 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564128b7c850 con 0x564128bc65f0 2023-10-18T14:07:40.730 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.712+0000 7f3929d9b700 1 --2- 172.21.15.114:0/3247201726 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564128bc65f0 0x564128bc8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.730 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.713+0000 7f3911ffb700 10 client.16479 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:40.731 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.713+0000 7f3929d9b700 1 --2- 172.21.15.114:0/3247201726 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564128bc65f0 0x564128bc8a10 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e331d8ee2e718f7 server_cookie=71d11f53697c85a1 in_seq=0 out_seq=0 2023-10-18T14:07:40.732 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f3911ffb700 1 -- 172.21.15.114:0/3247201726 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564128b7c850 con 0x564128bc65f0 2023-10-18T14:07:40.732 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f3911ffb700 10 client.16479 handle_command_reply: tid=0 2023-10-18T14:07:40.732 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f393cc0cb80 1 client.16479 shutdown 2023-10-18T14:07:40.732 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f393cc0cb80 1 -- 172.21.15.114:0/3247201726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 msgr2=0x564128bb6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:40.733 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/3247201726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 0x564128bb6300 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f391c0caae0 tx=0x7f391c00efb0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.733 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f393cc0cb80 1 -- 172.21.15.114:0/3247201726 shutdown_connections 2023-10-18T14:07:40.733 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/3247201726 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564128bc65f0 0x564128bc8a10 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.733 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/3247201726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2f50 0x564128bb6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.733 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/3247201726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 0x564128bb6300 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.734 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f3911ffb700 0 client.16479 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:40.734 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/3247201726 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2630 0x564128bb6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.734 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f393cc0cb80 1 -- 172.21.15.114:0/3247201726 >> 172.21.15.114:0/3247201726 conn(0x564128b216c0 msgr2=0x564128ba6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:40.734 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f393cc0cb80 1 -- 172.21.15.114:0/3247201726 shutdown_connections 2023-10-18T14:07:40.734 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.714+0000 7f393cc0cb80 1 -- 172.21.15.114:0/3247201726 wait complete. 2023-10-18T14:07:40.735 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.715+0000 7f393cc0cb80 20 client.16479 trim_cache size 0 max 16384 2023-10-18T14:07:40.735 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x63ea964 2023-10-18T14:07:40.738 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.732+0000 7f393cc0cb80 1 Processor -- start 2023-10-18T14:07:40.738 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.732+0000 7f393cc0cb80 1 -- start start 2023-10-18T14:07:40.738 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f393cc0cb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 0x564128baced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.739 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f393cc0cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2630 0x564128ba74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.739 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f393cc0cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2f50 0x564128bb1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.739 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f393cc0cb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641289808c0 con 0x564128bad410 2023-10-18T14:07:40.739 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f393cc0cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x564128bb4340 con 0x564128bb2630 2023-10-18T14:07:40.739 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f393cc0cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564128ba2ce0 con 0x564128bb2f50 2023-10-18T14:07:40.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f392a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 0x564128baced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f392a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 0x564128baced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46190/0 (socket says 172.21.15.114:46190) 2023-10-18T14:07:40.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f392a59c700 1 -- 172.21.15.114:0/1751301257 learned_addr learned my addr 172.21.15.114:0/1751301257 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:40.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f3929d9b700 1 --2- 172.21.15.114:0/1751301257 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2630 0x564128ba74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.740 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f392ad9d700 1 --2- 172.21.15.114:0/1751301257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2f50 0x564128bb1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f392a59c700 1 -- 172.21.15.114:0/1751301257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2f50 msgr2=0x564128bb1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:40.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f392a59c700 1 --2- 172.21.15.114:0/1751301257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2f50 0x564128bb1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f392a59c700 1 -- 172.21.15.114:0/1751301257 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2630 msgr2=0x564128ba74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:40.741 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f392a59c700 1 --2- 172.21.15.114:0/1751301257 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2630 0x564128ba74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.742 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f392a59c700 1 -- 172.21.15.114:0/1751301257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564128913c00 con 0x564128bad410 2023-10-18T14:07:40.742 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f392a59c700 1 --2- 172.21.15.114:0/1751301257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 0x564128baced0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f391c00e970 tx=0x7f391c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99642fa11b57d212 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:40.742 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f39197fa700 1 -- 172.21.15.114:0/1751301257 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0b6020 con 0x564128bad410 2023-10-18T14:07:40.742 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f39197fa700 1 -- 172.21.15.114:0/1751301257 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f391c0b0070 con 0x564128bad410 2023-10-18T14:07:40.743 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.733+0000 7f39197fa700 1 -- 172.21.15.114:0/1751301257 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c099b60 con 0x564128bad410 2023-10-18T14:07:40.743 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.734+0000 7f393cc0cb80 1 -- 172.21.15.114:0/1751301257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 msgr2=0x564128baced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:40.743 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.734+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/1751301257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 0x564128baced0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f391c00e970 tx=0x7f391c00cf50 comp rx=0 tx=0).stop 2023-10-18T14:07:40.743 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.734+0000 7f393cc0cb80 1 -- 172.21.15.114:0/1751301257 shutdown_connections 2023-10-18T14:07:40.744 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.734+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/1751301257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bb2f50 0x564128bb1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.744 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.734+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/1751301257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bad410 0x564128baced0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.744 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.734+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/1751301257 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2630 0x564128ba74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.744 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.734+0000 7f393cc0cb80 1 -- 172.21.15.114:0/1751301257 >> 172.21.15.114:0/1751301257 conn(0x564128b216c0 msgr2=0x564128bb4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:40.745 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.734+0000 7f393cc0cb80 1 -- 172.21.15.114:0/1751301257 shutdown_connections 2023-10-18T14:07:40.745 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.734+0000 7f393cc0cb80 1 -- 172.21.15.114:0/1751301257 wait complete. 2023-10-18T14:07:40.745 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.735+0000 7f393cc0cb80 1 -- start start 2023-10-18T14:07:40.745 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.735+0000 7f393cc0cb80 1 Processor -- start 2023-10-18T14:07:40.745 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.735+0000 7f393cc0cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bad410 0x564128bbbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.746 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.735+0000 7f393cc0cb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bb2630 0x564128bbbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.746 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.735+0000 7f393cc0cb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2f50 0x564128c193e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.746 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.735+0000 7f393cc0cb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564128bbc700 con 0x564128bb2630 2023-10-18T14:07:40.746 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.735+0000 7f393cc0cb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x564128c19920 con 0x564128bb2f50 2023-10-18T14:07:40.746 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.735+0000 7f393cc0cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564128c19a90 con 0x564128bad410 2023-10-18T14:07:40.748 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.735+0000 7f393cc0cb80 10 client.0 _ll_register_callbacks cb 0x5641289e6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.735+0000 7f392ad9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2f50 0x564128c193e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.735+0000 7f392ad9d700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2f50 0x564128c193e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42344/0 (socket says 172.21.15.114:42344) 2023-10-18T14:07:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.735+0000 7f392ad9d700 1 -- 172.21.15.114:0/2099331017 learned_addr learned my addr 172.21.15.114:0/2099331017 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.735+0000 7f3929d9b700 1 --2- 172.21.15.114:0/2099331017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bb2630 0x564128bbbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.736+0000 7f392a59c700 1 --2- 172.21.15.114:0/2099331017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bad410 0x564128bbbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.736+0000 7f392a59c700 1 -- 172.21.15.114:0/2099331017 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2f50 msgr2=0x564128c193e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.736+0000 7f392a59c700 1 --2- 172.21.15.114:0/2099331017 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2f50 0x564128c193e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.736+0000 7f392a59c700 1 -- 172.21.15.114:0/2099331017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bb2630 msgr2=0x564128bbbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.736+0000 7f392a59c700 1 --2- 172.21.15.114:0/2099331017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bb2630 0x564128bbbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.736+0000 7f392a59c700 1 -- 172.21.15.114:0/2099331017 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56412892ad80 con 0x564128bad410 2023-10-18T14:07:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.737+0000 7f392a59c700 1 --2- 172.21.15.114:0/2099331017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bad410 0x564128bbbaa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f391c098760 tx=0x7f391c00efb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=324bdc335b9cb847 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.737+0000 7f3911ffb700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-10-18T14:07:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.737+0000 7f3911ffb700 1 -- 172.21.15.114:0/2099331017 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0b6070 con 0x564128bad410 2023-10-18T14:07:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.738+0000 7f3911ffb700 1 -- 172.21.15.114:0/2099331017 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f391c083ad0 con 0x564128bad410 2023-10-18T14:07:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.738+0000 7f393cc0cb80 1 -- 172.21.15.114:0/2099331017 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f391c09e120 con 0x564128bad410 2023-10-18T14:07:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.738+0000 7f3911ffb700 1 -- 172.21.15.114:0/2099331017 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f391c099370 con 0x564128bad410 2023-10-18T14:07:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.738+0000 7f393cc0cb80 10 client.25858 fetch_fsmap learned FSMap version 34 2023-10-18T14:07:40.753 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.738+0000 7f393cc0cb80 1 -- 172.21.15.114:0/2099331017 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5641289511f0 con 0x564128bad410 2023-10-18T14:07:40.753 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.739+0000 7f3911ffb700 1 -- 172.21.15.114:0/2099331017 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f391c09e120 con 0x564128bad410 2023-10-18T14:07:40.753 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.739+0000 7f3911ffb700 1 -- 172.21.15.114:0/2099331017 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f391c018a90 con 0x564128bad410 2023-10-18T14:07:40.753 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.739+0000 7f393cc0cb80 10 client.25858 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:07:40.753 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.739+0000 7f393cc0cb80 10 client.25858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:40.754 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.739+0000 7f393cc0cb80 20 client.25858 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:40.754 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.739+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/2099331017 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564128c1ad30 0x564128c1d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:40.754 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.739+0000 7f393cc0cb80 4 client.25858 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:07:40.754 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.739+0000 7f393cc0cb80 1 -- 172.21.15.114:0/2099331017 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564128af8df0 con 0x564128c1ad30 2023-10-18T14:07:40.754 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.739+0000 7f3929d9b700 1 --2- 172.21.15.114:0/2099331017 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564128c1ad30 0x564128c1d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.739+0000 7f3911ffb700 10 client.25858 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.740+0000 7f3929d9b700 1 --2- 172.21.15.114:0/2099331017 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564128c1ad30 0x564128c1d120 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d9f418a4e93940b server_cookie=f7cb820c4463cd6d in_seq=0 out_seq=0 2023-10-18T14:07:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.761+0000 7f3911ffb700 1 -- 172.21.15.114:0/2099331017 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564128af8df0 con 0x564128c1ad30 2023-10-18T14:07:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.761+0000 7f3911ffb700 10 client.25858 handle_command_reply: tid=0 2023-10-18T14:07:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.761+0000 7f393cc0cb80 1 client.25858 shutdown 2023-10-18T14:07:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.764+0000 7f393cc0cb80 1 -- 172.21.15.114:0/2099331017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bad410 msgr2=0x564128bbbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.764+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/2099331017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bad410 0x564128bbbaa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f391c098760 tx=0x7f391c00efb0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.764+0000 7f393cc0cb80 1 -- 172.21.15.114:0/2099331017 shutdown_connections 2023-10-18T14:07:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.764+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/2099331017 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x564128c1ad30 0x564128c1d120 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.764+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/2099331017 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x564128bb2f50 0x564128c193e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.764+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/2099331017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564128bad410 0x564128bbbaa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.764+0000 7f393cc0cb80 1 --2- 172.21.15.114:0/2099331017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564128bb2630 0x564128bbbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.764+0000 7f393cc0cb80 1 -- 172.21.15.114:0/2099331017 >> 172.21.15.114:0/2099331017 conn(0x564128b216c0 msgr2=0x564128bb48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.764+0000 7f3911ffb700 0 client.25858 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.764+0000 7f393cc0cb80 1 -- 172.21.15.114:0/2099331017 shutdown_connections 2023-10-18T14:07:40.770 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.764+0000 7f393cc0cb80 1 -- 172.21.15.114:0/2099331017 wait complete. 2023-10-18T14:07:40.770 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.765+0000 7f393cc0cb80 20 client.25858 trim_cache size 0 max 16384 2023-10-18T14:07:40.770 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:07:40.770 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:07:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:07:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:07:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.765+0000 7f3930a23700 1 -- 172.21.15.114:0/3766841080 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f39140a15e0 msgr2=0x7f39140a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.765+0000 7f3930a23700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f39140a15e0 0x7f39140a3aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f392000b2e0 tx=0x7f3920005e80 comp rx=0 tx=0).stop 2023-10-18T14:07:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.765+0000 7f3930a23700 1 -- 172.21.15.114:0/3766841080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c1077f0 msgr2=0x7f392c06f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.765+0000 7f3930a23700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c1077f0 0x7f392c06f240 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f391c00e9a0 tx=0x7f391c00ecb0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.765+0000 7f3930a23700 1 -- 172.21.15.114:0/3766841080 shutdown_connections 2023-10-18T14:07:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.765+0000 7f3930a23700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f39140a15e0 0x7f39140a3aa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.765+0000 7f3930a23700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f392c10d4f0 0x7f392c06fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.765+0000 7f3930a23700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c1077f0 0x7f392c06f240 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.765+0000 7f3930a23700 1 --2- 172.21.15.114:0/3766841080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f392c1081b0 0x7f392c06f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.765+0000 7f3930a23700 1 -- 172.21.15.114:0/3766841080 >> 172.21.15.114:0/3766841080 conn(0x7f392c06b710 msgr2=0x7f392c0716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.765+0000 7f3930a23700 1 -- 172.21.15.114:0/3766841080 shutdown_connections 2023-10-18T14:07:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:40.765+0000 7f3930a23700 1 -- 172.21.15.114:0/3766841080 wait complete. 2023-10-18T14:07:41.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:40 smithi158 ceph-mon[103317]: pgmap v390: 97 pgs: 97 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.9 MiB/s wr, 957 op/s 2023-10-18T14:07:41.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:40 smithi172 ceph-mon[103574]: pgmap v390: 97 pgs: 97 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.9 MiB/s wr, 957 op/s 2023-10-18T14:07:41.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:40 smithi114 ceph-mon[99494]: pgmap v390: 97 pgs: 97 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.9 MiB/s wr, 957 op/s 2023-10-18T14:07:43.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:42 smithi158 ceph-mon[103317]: pgmap v391: 97 pgs: 97 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.0 MiB/s wr, 824 op/s 2023-10-18T14:07:43.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:42 smithi172 ceph-mon[103574]: pgmap v391: 97 pgs: 97 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.0 MiB/s wr, 824 op/s 2023-10-18T14:07:43.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:42 smithi114 ceph-mon[99494]: pgmap v391: 97 pgs: 97 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.0 MiB/s wr, 824 op/s 2023-10-18T14:07:43.262 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.408+0000 7fa3e681e700 1 -- 172.21.15.114:0/239793028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e01056e0 msgr2=0x7fa3e0105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.408+0000 7fa3e681e700 1 --2- 172.21.15.114:0/239793028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e01056e0 0x7fa3e0105ac0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00098f0 tx=0x7fa3d0009c00 comp rx=0 tx=0).stop 2023-10-18T14:07:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.408+0000 7fa3e681e700 1 -- 172.21.15.114:0/239793028 shutdown_connections 2023-10-18T14:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.408+0000 7fa3e681e700 1 --2- 172.21.15.114:0/239793028 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3e0100000 0x7fa3e010c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.408+0000 7fa3e681e700 1 --2- 172.21.15.114:0/239793028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e01056e0 0x7fa3e0105ac0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.408+0000 7fa3e681e700 1 --2- 172.21.15.114:0/239793028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e00ff640 0x7fa3e00ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.408+0000 7fa3e681e700 1 -- 172.21.15.114:0/239793028 >> 172.21.15.114:0/239793028 conn(0x7fa3e00767f0 msgr2=0x7fa3e0076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.408+0000 7fa3e681e700 1 -- 172.21.15.114:0/239793028 shutdown_connections 2023-10-18T14:07:43.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.409+0000 7fa3e681e700 1 -- 172.21.15.114:0/239793028 wait complete. 2023-10-18T14:07:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.409+0000 7fa3e681e700 1 Processor -- start 2023-10-18T14:07:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.409+0000 7fa3e681e700 1 -- start start 2023-10-18T14:07:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e681e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e00ff640 0x7fa3e0101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e681e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e0100000 0x7fa3e01017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e681e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3e01056e0 0x7fa3e0101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e681e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e01a50a0 con 0x7fa3e00ff640 2023-10-18T14:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e681e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e01a5210 con 0x7fa3e01056e0 2023-10-18T14:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e681e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e01a53d0 con 0x7fa3e0100000 2023-10-18T14:07:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3dffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e00ff640 0x7fa3e0101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e4dbb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3e01056e0 0x7fa3e0101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3dffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e00ff640 0x7fa3e0101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46210/0 (socket says 172.21.15.114:46210) 2023-10-18T14:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e4dbb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3e01056e0 0x7fa3e0101d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42358/0 (socket says 172.21.15.114:42358) 2023-10-18T14:07:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3dffff700 1 -- 172.21.15.114:0/1483700379 learned_addr learned my addr 172.21.15.114:0/1483700379 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3df7fe700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e0100000 0x7fa3e01017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e4dbb700 1 -- 172.21.15.114:0/1483700379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e0100000 msgr2=0x7fa3e01017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e4dbb700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e0100000 0x7fa3e01017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e4dbb700 1 -- 172.21.15.114:0/1483700379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e00ff640 msgr2=0x7fa3e0101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e4dbb700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e00ff640 0x7fa3e0101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e4dbb700 1 -- 172.21.15.114:0/1483700379 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d0009520 con 0x7fa3e01056e0 2023-10-18T14:07:43.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3dffff700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e00ff640 0x7fa3e0101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:43.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.410+0000 7fa3e4dbb700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3e01056e0 0x7fa3e0101d30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800efc0 tx=0x7fa3d800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:43.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.411+0000 7fa3dd7fa700 1 -- 172.21.15.114:0/1483700379 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8018070 con 0x7fa3e01056e0 2023-10-18T14:07:43.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.411+0000 7fa3dd7fa700 1 -- 172.21.15.114:0/1483700379 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3d800f040 con 0x7fa3e01056e0 2023-10-18T14:07:43.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.411+0000 7fa3e681e700 1 -- 172.21.15.114:0/1483700379 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e01a5650 con 0x7fa3e01056e0 2023-10-18T14:07:43.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.411+0000 7fa3dd7fa700 1 -- 172.21.15.114:0/1483700379 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800cbb0 con 0x7fa3e01056e0 2023-10-18T14:07:43.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.411+0000 7fa3e681e700 1 -- 172.21.15.114:0/1483700379 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e01a5b60 con 0x7fa3e01056e0 2023-10-18T14:07:43.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.413+0000 7fa3dd7fa700 1 -- 172.21.15.114:0/1483700379 <== mon.2 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fa3d8004000 con 0x7fa3e01056e0 2023-10-18T14:07:43.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.414+0000 7fa3dd7fa700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa3c80a1670 0x7fa3c80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.414+0000 7fa3dffff700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa3c80a1670 0x7fa3c80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.414+0000 7fa3dd7fa700 1 -- 172.21.15.114:0/1483700379 <== mon.2 v2:172.21.15.158:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa3d80ccb30 con 0x7fa3e01056e0 2023-10-18T14:07:43.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.415+0000 7fa3dffff700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa3c80a1670 0x7fa3c80a3b30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009fd0 tx=0x7fa3d0019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:43.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.415+0000 7fa3f2a07b80 1 Processor -- start 2023-10-18T14:07:43.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.415+0000 7fa3f2a07b80 1 -- start start 2023-10-18T14:07:43.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3f2a07b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44cbe0 0x55623b44cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3f2a07b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b44d500 0x55623b447090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3f2a07b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 0x55623b447a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3f2a07b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623b3ba6e0 con 0x55623b4475d0 2023-10-18T14:07:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3f2a07b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623b3a0c60 con 0x55623b44cbe0 2023-10-18T14:07:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3f2a07b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623b39e580 con 0x55623b44d500 2023-10-18T14:07:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3df7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b44d500 0x55623b447090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3dffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44cbe0 0x55623b44cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3dffff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44cbe0 0x55623b44cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42366/0 (socket says 172.21.15.114:42366) 2023-10-18T14:07:43.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3df7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b44d500 0x55623b447090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:50154/0 (socket says 172.21.15.114:50154) 2023-10-18T14:07:43.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3dffff700 1 -- 172.21.15.114:0/1688809431 learned_addr learned my addr 172.21.15.114:0/1688809431 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:43.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3e4dbb700 1 --2- 172.21.15.114:0/1688809431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 0x55623b447a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3dffff700 1 -- 172.21.15.114:0/1688809431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b44d500 msgr2=0x55623b447090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3dffff700 1 --2- 172.21.15.114:0/1688809431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b44d500 0x55623b447090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3dffff700 1 -- 172.21.15.114:0/1688809431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 msgr2=0x55623b447a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3dffff700 1 --2- 172.21.15.114:0/1688809431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 0x55623b447a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.416+0000 7fa3dffff700 1 -- 172.21.15.114:0/1688809431 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55623b3573f0 con 0x55623b44cbe0 2023-10-18T14:07:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.417+0000 7fa3dffff700 1 --2- 172.21.15.114:0/1688809431 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44cbe0 0x55623b44cfc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009230 tx=0x7fa3d001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f62509641a96562 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:43.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.417+0000 7fa3c67fc700 1 -- 172.21.15.114:0/1688809431 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d000b860 con 0x55623b44cbe0 2023-10-18T14:07:43.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.417+0000 7fa3c67fc700 1 -- 172.21.15.114:0/1688809431 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3d001d040 con 0x55623b44cbe0 2023-10-18T14:07:43.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.417+0000 7fa3c67fc700 1 -- 172.21.15.114:0/1688809431 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0004a10 con 0x55623b44cbe0 2023-10-18T14:07:43.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.417+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/1688809431 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44cbe0 msgr2=0x55623b44cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:43.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.417+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/1688809431 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44cbe0 0x55623b44cfc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009230 tx=0x7fa3d001f000 comp rx=0 tx=0).stop 2023-10-18T14:07:43.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.418+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/1688809431 shutdown_connections 2023-10-18T14:07:43.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.418+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/1688809431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 0x55623b447a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.418+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/1688809431 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44cbe0 0x55623b44cfc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.418+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/1688809431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b44d500 0x55623b447090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.418+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/1688809431 >> 172.21.15.114:0/1688809431 conn(0x55623b3bb720 msgr2=0x55623b441b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.418+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/1688809431 shutdown_connections 2023-10-18T14:07:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.418+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/1688809431 wait complete. 2023-10-18T14:07:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.418+0000 7fa3f2a07b80 1 -- start start 2023-10-18T14:07:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.419+0000 7fa3f2a07b80 1 Processor -- start 2023-10-18T14:07:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.419+0000 7fa3f2a07b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b4475d0 0x55623b450a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.419+0000 7fa3f2a07b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 0x55623b450f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.419+0000 7fa3f2a07b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4514c0 0x55623b45cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.419+0000 7fa3f2a07b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623b399e70 con 0x55623b4514c0 2023-10-18T14:07:43.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.419+0000 7fa3f2a07b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623b336710 con 0x55623b44d500 2023-10-18T14:07:43.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.419+0000 7fa3f2a07b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623b3363b0 con 0x55623b4475d0 2023-10-18T14:07:43.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.419+0000 7fa3f2a07b80 10 client.0 _ll_register_callbacks cb 0x55623b280a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:43.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.419+0000 7fa3df7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 0x55623b450f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.419+0000 7fa3e4dbb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4514c0 0x55623b45cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.419+0000 7fa3dffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b4475d0 0x55623b450a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.419+0000 7fa3df7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 0x55623b450f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42370/0 (socket says 172.21.15.114:42370) 2023-10-18T14:07:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.419+0000 7fa3df7fe700 1 -- 172.21.15.114:0/2034801931 learned_addr learned my addr 172.21.15.114:0/2034801931 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3df7fe700 1 -- 172.21.15.114:0/2034801931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b4475d0 msgr2=0x55623b450a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3df7fe700 1 --2- 172.21.15.114:0/2034801931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b4475d0 0x55623b450a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3df7fe700 1 -- 172.21.15.114:0/2034801931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4514c0 msgr2=0x55623b45cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3df7fe700 1 --2- 172.21.15.114:0/2034801931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4514c0 0x55623b45cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3df7fe700 1 -- 172.21.15.114:0/2034801931 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e010cd90 con 0x55623b44d500 2023-10-18T14:07:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3df7fe700 1 --2- 172.21.15.114:0/2034801931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 0x55623b450f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40126d0 tx=0x7fa3d40129e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da882eb1db46061a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:07:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3bf7fe700 1 -- 172.21.15.114:0/2034801931 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4017070 con 0x55623b44d500 2023-10-18T14:07:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3bf7fe700 1 -- 172.21.15.114:0/2034801931 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa3d4010430 con 0x55623b44d500 2023-10-18T14:07:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/2034801931 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55623b39eef0 con 0x55623b44d500 2023-10-18T14:07:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3bf7fe700 1 -- 172.21.15.114:0/2034801931 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3d4010630 con 0x55623b44d500 2023-10-18T14:07:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3f2a07b80 10 client.25646 fetch_fsmap learned FSMap version 34 2023-10-18T14:07:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/2034801931 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55623b1c4de0 con 0x55623b44d500 2023-10-18T14:07:43.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.420+0000 7fa3bf7fe700 1 -- 172.21.15.114:0/2034801931 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55623b39eef0 con 0x55623b44d500 2023-10-18T14:07:43.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.421+0000 7fa3bf7fe700 1 -- 172.21.15.114:0/2034801931 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fa3d401c7f0 con 0x55623b44d500 2023-10-18T14:07:43.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.421+0000 7fa3f2a07b80 10 client.25646 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:07:43.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.421+0000 7fa3f2a07b80 10 client.25646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:43.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.421+0000 7fa3f2a07b80 20 client.25646 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:43.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.421+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/2034801931 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55623b461620 0x55623b463a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.421+0000 7fa3f2a07b80 4 client.25646 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:07:43.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.421+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/2034801931 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55623b4168b0 con 0x55623b461620 2023-10-18T14:07:43.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.421+0000 7fa3dffff700 1 --2- 172.21.15.114:0/2034801931 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55623b461620 0x55623b463a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.421+0000 7fa3bf7fe700 10 client.25646 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:43.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.421+0000 7fa3dffff700 1 --2- 172.21.15.114:0/2034801931 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55623b461620 0x55623b463a40 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=526228aa0b301a3e server_cookie=bcff8e5ce7bb8cf0 in_seq=0 out_seq=0 2023-10-18T14:07:43.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3bf7fe700 1 -- 172.21.15.114:0/2034801931 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55623b4168b0 con 0x55623b461620 2023-10-18T14:07:43.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3bf7fe700 10 client.25646 handle_command_reply: tid=0 2023-10-18T14:07:43.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3f2a07b80 1 client.25646 shutdown 2023-10-18T14:07:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/2034801931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 msgr2=0x55623b450f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/2034801931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 0x55623b450f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40126d0 tx=0x7fa3d40129e0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/2034801931 shutdown_connections 2023-10-18T14:07:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/2034801931 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55623b461620 0x55623b463a40 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/2034801931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4514c0 0x55623b45cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3bf7fe700 0 client.25646 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:43.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/2034801931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b4475d0 0x55623b450a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/2034801931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 0x55623b450f80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/2034801931 >> 172.21.15.114:0/2034801931 conn(0x55623b3bb720 msgr2=0x55623b446080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:43.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/2034801931 shutdown_connections 2023-10-18T14:07:43.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.422+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/2034801931 wait complete. 2023-10-18T14:07:43.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.423+0000 7fa3f2a07b80 20 client.25646 trim_cache size 0 max 16384 2023-10-18T14:07:43.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.443+0000 7fa3f2a07b80 1 Processor -- start 2023-10-18T14:07:43.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.443+0000 7fa3f2a07b80 1 -- start start 2023-10-18T14:07:43.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.443+0000 7fa3f2a07b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 0x55623b447090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.443+0000 7fa3f2a07b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 0x55623b44c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.443+0000 7fa3f2a07b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b4514c0 0x55623b457e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.443+0000 7fa3f2a07b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623b21a920 con 0x55623b4475d0 2023-10-18T14:07:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.443+0000 7fa3f2a07b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623b4535d0 con 0x55623b44d500 2023-10-18T14:07:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.443+0000 7fa3f2a07b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623b45df70 con 0x55623b4514c0 2023-10-18T14:07:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.444+0000 7fa3df7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 0x55623b44c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.444+0000 7fa3df7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 0x55623b44c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42378/0 (socket says 172.21.15.114:42378) 2023-10-18T14:07:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.444+0000 7fa3df7fe700 1 -- 172.21.15.114:0/2882461942 learned_addr learned my addr 172.21.15.114:0/2882461942 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.444+0000 7fa3e4dbb700 1 --2- 172.21.15.114:0/2882461942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b4514c0 0x55623b457e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.444+0000 7fa3df7fe700 1 -- 172.21.15.114:0/2882461942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b4514c0 msgr2=0x55623b457e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:43.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.444+0000 7fa3df7fe700 1 --2- 172.21.15.114:0/2882461942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b4514c0 0x55623b457e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.444+0000 7fa3df7fe700 1 -- 172.21.15.114:0/2882461942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 msgr2=0x55623b447090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:43.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.444+0000 7fa3df7fe700 1 --2- 172.21.15.114:0/2882461942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 0x55623b447090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.444+0000 7fa3df7fe700 1 -- 172.21.15.114:0/2882461942 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55623b1adc60 con 0x55623b44d500 2023-10-18T14:07:43.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.444+0000 7fa3df7fe700 1 --2- 172.21.15.114:0/2882461942 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 0x55623b44c240 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa3d401cc20 tx=0x7fa3d4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e4fd3145c184b3c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:43.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.444+0000 7fa3c6ffd700 1 -- 172.21.15.114:0/2882461942 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4017040 con 0x55623b44d500 2023-10-18T14:07:43.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.444+0000 7fa3c6ffd700 1 -- 172.21.15.114:0/2882461942 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3d401ce90 con 0x55623b44d500 2023-10-18T14:07:43.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.444+0000 7fa3c6ffd700 1 -- 172.21.15.114:0/2882461942 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4003680 con 0x55623b44d500 2023-10-18T14:07:43.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.445+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/2882461942 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 msgr2=0x55623b44c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:43.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.445+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/2882461942 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 0x55623b44c240 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa3d401cc20 tx=0x7fa3d4005880 comp rx=0 tx=0).stop 2023-10-18T14:07:43.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.445+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/2882461942 shutdown_connections 2023-10-18T14:07:43.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.445+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/2882461942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b4514c0 0x55623b457e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.445+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/2882461942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 0x55623b447090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.445+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/2882461942 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b44d500 0x55623b44c240 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.445+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/2882461942 >> 172.21.15.114:0/2882461942 conn(0x55623b3bb720 msgr2=0x55623b44bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:43.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.445+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/2882461942 shutdown_connections 2023-10-18T14:07:43.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.445+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/2882461942 wait complete. 2023-10-18T14:07:43.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3f2a07b80 1 -- start start 2023-10-18T14:07:43.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3f2a07b80 1 Processor -- start 2023-10-18T14:07:43.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3f2a07b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 0x55623b456580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3f2a07b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b44d500 0x55623b456ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3f2a07b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b4514c0 0x55623b457000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3f2a07b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623b4b5420 con 0x55623b4475d0 2023-10-18T14:07:43.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3f2a07b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623b4b5560 con 0x55623b4514c0 2023-10-18T14:07:43.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3f2a07b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623b4b56a0 con 0x55623b44d500 2023-10-18T14:07:43.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3f2a07b80 10 client.0 _ll_register_callbacks cb 0x55623b280a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:43.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3e4dbb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b4514c0 0x55623b457000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3dffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 0x55623b456580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3df7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b44d500 0x55623b456ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3e4dbb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b4514c0 0x55623b457000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42386/0 (socket says 172.21.15.114:42386) 2023-10-18T14:07:43.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.446+0000 7fa3e4dbb700 1 -- 172.21.15.114:0/4007632365 learned_addr learned my addr 172.21.15.114:0/4007632365 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:43.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3e4dbb700 1 -- 172.21.15.114:0/4007632365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b44d500 msgr2=0x55623b456ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:43.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3e4dbb700 1 --2- 172.21.15.114:0/4007632365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b44d500 0x55623b456ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3e4dbb700 1 -- 172.21.15.114:0/4007632365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 msgr2=0x55623b456580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:43.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3e4dbb700 1 --2- 172.21.15.114:0/4007632365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 0x55623b456580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3e4dbb700 1 -- 172.21.15.114:0/4007632365 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55623b1c4de0 con 0x55623b4514c0 2023-10-18T14:07:43.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3df7fe700 1 --2- 172.21.15.114:0/4007632365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b44d500 0x55623b456ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:07:43.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3e4dbb700 1 --2- 172.21.15.114:0/4007632365 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b4514c0 0x55623b457000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80965f0 tx=0x7fa3d80994e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d57784e75d924cdf server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:43.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:07:43.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3bf7fe700 1 -- 172.21.15.114:0/4007632365 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8099b80 con 0x55623b4514c0 2023-10-18T14:07:43.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3bf7fe700 1 -- 172.21.15.114:0/4007632365 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fa3d809dcd0 con 0x55623b4514c0 2023-10-18T14:07:43.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/4007632365 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa3d001d040 con 0x55623b4514c0 2023-10-18T14:07:43.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3bf7fe700 1 -- 172.21.15.114:0/4007632365 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3d80a1e80 con 0x55623b4514c0 2023-10-18T14:07:43.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3f2a07b80 10 client.25652 fetch_fsmap learned FSMap version 34 2023-10-18T14:07:43.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/4007632365 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55623b1eb250 con 0x55623b4514c0 2023-10-18T14:07:43.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.447+0000 7fa3bf7fe700 1 -- 172.21.15.114:0/4007632365 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3d001d040 con 0x55623b4514c0 2023-10-18T14:07:43.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.448+0000 7fa3bf7fe700 1 -- 172.21.15.114:0/4007632365 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 34) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fa3d80a19f0 con 0x55623b4514c0 2023-10-18T14:07:43.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.448+0000 7fa3f2a07b80 10 client.25652 fetch_fsmap finished waiting for FSMap version 34 2023-10-18T14:07:43.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.448+0000 7fa3f2a07b80 10 client.25652 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:43.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.448+0000 7fa3f2a07b80 20 client.25652 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:43.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.448+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/4007632365 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55623b4b6fb0 0x55623b4b93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:43.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.448+0000 7fa3f2a07b80 4 client.25652 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:07:43.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.448+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/4007632365 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55623b392e50 con 0x55623b4b6fb0 2023-10-18T14:07:43.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.448+0000 7fa3dffff700 1 --2- 172.21.15.114:0/4007632365 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55623b4b6fb0 0x55623b4b93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:43.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.448+0000 7fa3bf7fe700 10 client.25652 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:43.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.448+0000 7fa3dffff700 1 --2- 172.21.15.114:0/4007632365 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55623b4b6fb0 0x55623b4b93d0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=896420aaf3ab4ae7 server_cookie=1e6ebb9776012129 in_seq=0 out_seq=0 2023-10-18T14:07:43.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3bf7fe700 1 -- 172.21.15.114:0/4007632365 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55623b392e50 con 0x55623b4b6fb0 2023-10-18T14:07:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3bf7fe700 10 client.25652 handle_command_reply: tid=0 2023-10-18T14:07:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3f2a07b80 1 client.25652 shutdown 2023-10-18T14:07:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/4007632365 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b4514c0 msgr2=0x55623b457000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/4007632365 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b4514c0 0x55623b457000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80965f0 tx=0x7fa3d80994e0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/4007632365 shutdown_connections 2023-10-18T14:07:43.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/4007632365 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55623b4b6fb0 0x55623b4b93d0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/4007632365 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55623b4514c0 0x55623b457000 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/4007632365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55623b4475d0 0x55623b456580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3bf7fe700 0 client.25652 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:43.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3f2a07b80 1 --2- 172.21.15.114:0/4007632365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55623b44d500 0x55623b456ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/4007632365 >> 172.21.15.114:0/4007632365 conn(0x55623b3bb720 msgr2=0x55623b44bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:43.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/4007632365 shutdown_connections 2023-10-18T14:07:43.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3f2a07b80 1 -- 172.21.15.114:0/4007632365 wait complete. 2023-10-18T14:07:43.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.449+0000 7fa3f2a07b80 20 client.25652 trim_cache size 0 max 16384 2023-10-18T14:07:43.469 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:07:43.469 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-18T14:07:43.469 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": { 2023-10-18T14:07:43.469 INFO:teuthology.orchestra.run.smithi114.stdout: "94d18228-30fd-45a0-94d1-b2bec5a6db1a": { 2023-10-18T14:07:43.469 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/", 2023-10-18T14:07:43.470 INFO:teuthology.orchestra.run.smithi114.stdout: "tag": "94d18228-30fd-45a0-94d1-b2bec5a6db1a", 2023-10-18T14:07:43.470 INFO:teuthology.orchestra.run.smithi114.stdout: "options": "recursive,force" 2023-10-18T14:07:43.470 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:07:43.470 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:07:43.470 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:07:43.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.450+0000 7fa3e681e700 1 -- 172.21.15.114:0/1483700379 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa3c80a1670 msgr2=0x7fa3c80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:43.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.450+0000 7fa3e681e700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa3c80a1670 0x7fa3c80a3b30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009fd0 tx=0x7fa3d0019040 comp rx=0 tx=0).stop 2023-10-18T14:07:43.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.450+0000 7fa3e681e700 1 -- 172.21.15.114:0/1483700379 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3e01056e0 msgr2=0x7fa3e0101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:43.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.450+0000 7fa3e681e700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3e01056e0 0x7fa3e0101d30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800efc0 tx=0x7fa3d800c3a0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.450+0000 7fa3e681e700 1 -- 172.21.15.114:0/1483700379 shutdown_connections 2023-10-18T14:07:43.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.450+0000 7fa3e681e700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fa3c80a1670 0x7fa3c80a3b30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.450+0000 7fa3e681e700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa3e01056e0 0x7fa3e0101d30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.450+0000 7fa3e681e700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e00ff640 0x7fa3e0101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.450+0000 7fa3e681e700 1 --2- 172.21.15.114:0/1483700379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e0100000 0x7fa3e01017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:43.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.450+0000 7fa3e681e700 1 -- 172.21.15.114:0/1483700379 >> 172.21.15.114:0/1483700379 conn(0x7fa3e00767f0 msgr2=0x7fa3e0067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:43.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.450+0000 7fa3e681e700 1 -- 172.21.15.114:0/1483700379 shutdown_connections 2023-10-18T14:07:43.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:07:43.450+0000 7fa3e681e700 1 -- 172.21.15.114:0/1483700379 wait complete. 2023-10-18T14:07:43.474 INFO:tasks.cephfs.filesystem:scrub status for tag:94d18228-30fd-45a0-94d1-b2bec5a6db1a - {'path': '/', 'tag': '94d18228-30fd-45a0-94d1-b2bec5a6db1a', 'options': 'recursive,force'} 2023-10-18T14:07:44.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:44 smithi114 ceph-mon[99494]: pgmap v392: 97 pgs: 97 active+clean; 76 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.8 MiB/s wr, 1.12k op/s 2023-10-18T14:07:44.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:44 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:07:44.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:44 smithi158 ceph-mon[103317]: pgmap v392: 97 pgs: 97 active+clean; 76 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.8 MiB/s wr, 1.12k op/s 2023-10-18T14:07:44.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:44 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:07:44.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:44 smithi172 ceph-mon[103574]: pgmap v392: 97 pgs: 97 active+clean; 76 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.8 MiB/s wr, 1.12k op/s 2023-10-18T14:07:44.812 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:44 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:07:45.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:07:45.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:07:45.589 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:07:45.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:07:45.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:07:45.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:07:45.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:07:45.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:07:45.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:07:46.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:46 smithi158 ceph-mon[103317]: pgmap v393: 97 pgs: 97 active+clean; 70 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.7 MiB/s wr, 1.14k op/s 2023-10-18T14:07:46.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:46 smithi172 ceph-mon[103574]: pgmap v393: 97 pgs: 97 active+clean; 70 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.7 MiB/s wr, 1.14k op/s 2023-10-18T14:07:46.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:46 smithi114 ceph-mon[99494]: pgmap v393: 97 pgs: 97 active+clean; 70 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.7 MiB/s wr, 1.14k op/s 2023-10-18T14:07:47.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:47 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:07:47.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:47 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:07:47.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:47 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:07:48.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:48 smithi158 ceph-mon[103317]: pgmap v394: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 1.09k op/s 2023-10-18T14:07:48.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:48 smithi172 ceph-mon[103574]: pgmap v394: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 1.09k op/s 2023-10-18T14:07:48.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:48 smithi114 ceph-mon[99494]: pgmap v394: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 1.09k op/s 2023-10-18T14:07:51.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:50 smithi158 ceph-mon[103317]: pgmap v395: 97 pgs: 97 active+clean; 64 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.3 MiB/s wr, 1.36k op/s 2023-10-18T14:07:51.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:50 smithi172 ceph-mon[103574]: pgmap v395: 97 pgs: 97 active+clean; 64 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.3 MiB/s wr, 1.36k op/s 2023-10-18T14:07:51.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:50 smithi114 ceph-mon[99494]: pgmap v395: 97 pgs: 97 active+clean; 64 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.3 MiB/s wr, 1.36k op/s 2023-10-18T14:07:52.907 INFO:tasks.workunit.client.0.smithi114.stdout:copying to largest ever: 0x63fd4d5 2023-10-18T14:07:53.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:52 smithi158 ceph-mon[103317]: pgmap v396: 97 pgs: 97 active+clean; 64 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.07k op/s 2023-10-18T14:07:53.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:52 smithi172 ceph-mon[103574]: pgmap v396: 97 pgs: 97 active+clean; 64 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.07k op/s 2023-10-18T14:07:53.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:52 smithi114 ceph-mon[99494]: pgmap v396: 97 pgs: 97 active+clean; 64 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.07k op/s 2023-10-18T14:07:53.900 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.895+0000 7f6782704700 1 -- 172.21.15.114:0/3517501134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677c10c090 msgr2=0x7f677c113c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:53.900 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.895+0000 7f6782704700 1 --2- 172.21.15.114:0/3517501134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677c10c090 0x7f677c113c10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f677400b0a0 tx=0x7f677400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.900 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.895+0000 7f6782704700 1 -- 172.21.15.114:0/3517501134 shutdown_connections 2023-10-18T14:07:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.895+0000 7f6782704700 1 --2- 172.21.15.114:0/3517501134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677c10c090 0x7f677c113c10 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.895+0000 7f6782704700 1 --2- 172.21.15.114:0/3517501134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c106f70 0x7f677c107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.895+0000 7f6782704700 1 --2- 172.21.15.114:0/3517501134 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f677c107920 0x7f677c10b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.895+0000 7f6782704700 1 -- 172.21.15.114:0/3517501134 >> 172.21.15.114:0/3517501134 conn(0x7f677c0764f0 msgr2=0x7f677c078910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.895+0000 7f6782704700 1 -- 172.21.15.114:0/3517501134 shutdown_connections 2023-10-18T14:07:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.895+0000 7f6782704700 1 -- 172.21.15.114:0/3517501134 wait complete. 2023-10-18T14:07:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.896+0000 7f6782704700 1 Processor -- start 2023-10-18T14:07:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.896+0000 7f6782704700 1 -- start start 2023-10-18T14:07:53.904 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6782704700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c106f70 0x7f677c19d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.905 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6782704700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f677c10c090 0x7f677c19d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.905 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6782704700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677c1a1b50 0x7f677c1a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.905 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6782704700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c1a25d0 con 0x7f677c1a1b50 2023-10-18T14:07:53.905 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6782704700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c1a2740 con 0x7f677c10c090 2023-10-18T14:07:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6782704700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c1a2900 con 0x7f677c106f70 2023-10-18T14:07:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6780ca1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677c1a1b50 0x7f677c1a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f677b7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f677c10c090 0x7f677c19d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6780ca1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677c1a1b50 0x7f677c1a1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46256/0 (socket says 172.21.15.114:46256) 2023-10-18T14:07:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f677b7fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f677c10c090 0x7f677c19d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42398/0 (socket says 172.21.15.114:42398) 2023-10-18T14:07:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6780ca1700 1 -- 172.21.15.114:0/737413498 learned_addr learned my addr 172.21.15.114:0/737413498 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f677bfff700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c106f70 0x7f677c19d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6780ca1700 1 -- 172.21.15.114:0/737413498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c106f70 msgr2=0x7f677c19d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6780ca1700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c106f70 0x7f677c19d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6780ca1700 1 -- 172.21.15.114:0/737413498 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f677c10c090 msgr2=0x7f677c19d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6780ca1700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f677c10c090 0x7f677c19d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6780ca1700 1 -- 172.21.15.114:0/737413498 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774009d00 con 0x7f677c1a1b50 2023-10-18T14:07:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f677b7fe700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f677c10c090 0x7f677c19d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6780ca1700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677c1a1b50 0x7f677c1a1fd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6774006130 tx=0x7f677400bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f67797fa700 1 -- 172.21.15.114:0/737413498 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400e040 con 0x7f677c1a1b50 2023-10-18T14:07:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6782704700 1 -- 172.21.15.114:0/737413498 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677c1a9e00 con 0x7f677c1a1b50 2023-10-18T14:07:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f67797fa700 1 -- 172.21.15.114:0/737413498 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f677401d480 con 0x7f677c1a1b50 2023-10-18T14:07:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f67797fa700 1 -- 172.21.15.114:0/737413498 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677401b6b0 con 0x7f677c1a1b50 2023-10-18T14:07:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.897+0000 7f6782704700 1 -- 172.21.15.114:0/737413498 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c1aa280 con 0x7f677c1a1b50 2023-10-18T14:07:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.900+0000 7f67797fa700 1 -- 172.21.15.114:0/737413498 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f677401b810 con 0x7f677c1a1b50 2023-10-18T14:07:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.901+0000 7f67797fa700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f67640a15f0 0x7f67640a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.901+0000 7f67797fa700 1 -- 172.21.15.114:0/737413498 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f67740ce5d0 con 0x7f677c1a1b50 2023-10-18T14:07:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.901+0000 7f677bfff700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f67640a15f0 0x7f67640a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.901+0000 7f677bfff700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f67640a15f0 0x7f67640a3ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f676c009c60 tx=0x7f676c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.902+0000 7f678e8edb80 1 Processor -- start 2023-10-18T14:07:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.902+0000 7f678e8edb80 1 -- start start 2023-10-18T14:07:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.902+0000 7f678e8edb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551d630 0x55dfe551da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.902+0000 7f678e8edb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551df50 0x55dfe5517ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.902+0000 7f678e8edb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe5518870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.902+0000 7f678e8edb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe548b680 con 0x55dfe551df50 2023-10-18T14:07:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.902+0000 7f678e8edb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe5471c00 con 0x55dfe5518410 2023-10-18T14:07:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.902+0000 7f678e8edb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe546f520 con 0x55dfe551d630 2023-10-18T14:07:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.902+0000 7f677b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551df50 0x55dfe5517ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.902+0000 7f677b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551df50 0x55dfe5517ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46262/0 (socket says 172.21.15.114:46262) 2023-10-18T14:07:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.903+0000 7f677b7fe700 1 -- 172.21.15.114:0/1371972957 learned_addr learned my addr 172.21.15.114:0/1371972957 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.903+0000 7f6780ca1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe5518870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.903+0000 7f677b7fe700 1 -- 172.21.15.114:0/1371972957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551d630 msgr2=0x55dfe551da10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-18T14:07:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.903+0000 7f677b7fe700 1 --2- 172.21.15.114:0/1371972957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551d630 0x55dfe551da10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.903+0000 7f677b7fe700 1 -- 172.21.15.114:0/1371972957 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 msgr2=0x55dfe5518870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.903+0000 7f677b7fe700 1 --2- 172.21.15.114:0/1371972957 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe5518870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.903+0000 7f677b7fe700 1 -- 172.21.15.114:0/1371972957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfe5428390 con 0x55dfe551df50 2023-10-18T14:07:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.903+0000 7f6780ca1700 1 --2- 172.21.15.114:0/1371972957 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe5518870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.903+0000 7f677b7fe700 1 --2- 172.21.15.114:0/1371972957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551df50 0x55dfe5517ed0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f67700114f0 tx=0x7f6770011800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5943e3ab0b21b297 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.903+0000 7f67627fc700 1 -- 172.21.15.114:0/1371972957 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770004a30 con 0x55dfe551df50 2023-10-18T14:07:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.903+0000 7f67627fc700 1 -- 172.21.15.114:0/1371972957 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67700054e0 con 0x55dfe551df50 2023-10-18T14:07:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.903+0000 7f67627fc700 1 -- 172.21.15.114:0/1371972957 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677000e9d0 con 0x55dfe551df50 2023-10-18T14:07:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.904+0000 7f678e8edb80 1 -- 172.21.15.114:0/1371972957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551df50 msgr2=0x55dfe5517ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.904+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1371972957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551df50 0x55dfe5517ed0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f67700114f0 tx=0x7f6770011800 comp rx=0 tx=0).stop 2023-10-18T14:07:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.904+0000 7f678e8edb80 1 -- 172.21.15.114:0/1371972957 shutdown_connections 2023-10-18T14:07:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.904+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1371972957 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe5518870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.904+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1371972957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551d630 0x55dfe551da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.904+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1371972957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551df50 0x55dfe5517ed0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.904+0000 7f678e8edb80 1 -- 172.21.15.114:0/1371972957 >> 172.21.15.114:0/1371972957 conn(0x55dfe548c6c0 msgr2=0x55dfe55125a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.904+0000 7f678e8edb80 1 -- 172.21.15.114:0/1371972957 shutdown_connections 2023-10-18T14:07:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.904+0000 7f678e8edb80 1 -- 172.21.15.114:0/1371972957 wait complete. 2023-10-18T14:07:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.905+0000 7f678e8edb80 1 -- start start 2023-10-18T14:07:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.905+0000 7f678e8edb80 1 Processor -- start 2023-10-18T14:07:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f678e8edb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe5518410 0x55dfe5523f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f678e8edb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551d630 0x55dfe5521240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f678e8edb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe551df50 0x55dfe5521980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f678e8edb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe546ae10 con 0x55dfe5518410 2023-10-18T14:07:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f678e8edb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe54076b0 con 0x55dfe551df50 2023-10-18T14:07:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f678e8edb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe5407350 con 0x55dfe551d630 2023-10-18T14:07:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f678e8edb80 10 client.0 _ll_register_callbacks cb 0x55dfe5351a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f677bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe5518410 0x55dfe5523f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f6780ca1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe551df50 0x55dfe5521980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f6780ca1700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe551df50 0x55dfe5521980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42412/0 (socket says 172.21.15.114:42412) 2023-10-18T14:07:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f677bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe5518410 0x55dfe5523f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46266/0 (socket says 172.21.15.114:46266) 2023-10-18T14:07:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f6780ca1700 1 -- 172.21.15.114:0/1895750536 learned_addr learned my addr 172.21.15.114:0/1895750536 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f677b7fe700 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551d630 0x55dfe5521240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f6780ca1700 1 -- 172.21.15.114:0/1895750536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551d630 msgr2=0x55dfe5521240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f6780ca1700 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551d630 0x55dfe5521240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f6780ca1700 1 -- 172.21.15.114:0/1895750536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe5518410 msgr2=0x55dfe5523f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f6780ca1700 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe5518410 0x55dfe5523f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f6780ca1700 1 -- 172.21.15.114:0/1895750536 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c1aa280 con 0x55dfe551df50 2023-10-18T14:07:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f677b7fe700 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551d630 0x55dfe5521240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:07:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f677bfff700 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe5518410 0x55dfe5523f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:07:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.906+0000 7f6780ca1700 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe551df50 0x55dfe5521980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f677409b650 tx=0x7f677400b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71b041650e6b530e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f675b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:07:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f675b7fe700 1 -- 172.21.15.114:0/1895750536 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677401dad0 con 0x55dfe551df50 2023-10-18T14:07:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f675b7fe700 1 -- 172.21.15.114:0/1895750536 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f677409bdc0 con 0x55dfe551df50 2023-10-18T14:07:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f678e8edb80 1 -- 172.21.15.114:0/1895750536 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dfe546fe90 con 0x55dfe551df50 2023-10-18T14:07:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f675b7fe700 1 -- 172.21.15.114:0/1895750536 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f677409b6c0 con 0x55dfe551df50 2023-10-18T14:07:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f678e8edb80 10 client.25664 fetch_fsmap learned FSMap version 35 2023-10-18T14:07:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f678e8edb80 1 -- 172.21.15.114:0/1895750536 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f6770009c90 con 0x55dfe551df50 2023-10-18T14:07:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f675b7fe700 1 -- 172.21.15.114:0/1895750536 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6774066020 con 0x55dfe551df50 2023-10-18T14:07:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f675b7fe700 1 -- 172.21.15.114:0/1895750536 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 35) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f67740b9030 con 0x55dfe551df50 2023-10-18T14:07:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f678e8edb80 10 client.25664 fetch_fsmap finished waiting for FSMap version 35 2023-10-18T14:07:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f678e8edb80 10 client.25664 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:53.929 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f678e8edb80 20 client.25664 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:53.929 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dfe5542790 0x55dfe5544bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.929 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f678e8edb80 4 client.25664 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:07:53.929 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.907+0000 7f678e8edb80 1 -- 172.21.15.114:0/1895750536 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dfe54e7850 con 0x55dfe5542790 2023-10-18T14:07:53.929 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.908+0000 7f677bfff700 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dfe5542790 0x55dfe5544bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.908+0000 7f675b7fe700 10 client.25664 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.908+0000 7f677bfff700 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dfe5542790 0x55dfe5544bb0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44a308bc449a0758 server_cookie=628ddbef948ecf11 in_seq=0 out_seq=0 2023-10-18T14:07:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f675b7fe700 1 -- 172.21.15.114:0/1895750536 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dfe54e7850 con 0x55dfe5542790 2023-10-18T14:07:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f675b7fe700 10 client.25664 handle_command_reply: tid=0 2023-10-18T14:07:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f678e8edb80 1 client.25664 shutdown 2023-10-18T14:07:53.931 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f678e8edb80 1 -- 172.21.15.114:0/1895750536 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe551df50 msgr2=0x55dfe5521980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:53.931 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe551df50 0x55dfe5521980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f677409b650 tx=0x7f677400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.931 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f678e8edb80 1 -- 172.21.15.114:0/1895750536 shutdown_connections 2023-10-18T14:07:53.931 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dfe5542790 0x55dfe5544bb0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.931 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe551df50 0x55dfe5521980 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.932 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f675b7fe700 0 client.25664 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:53.932 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe5518410 0x55dfe5523f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.932 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1895750536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551d630 0x55dfe5521240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.932 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f678e8edb80 1 -- 172.21.15.114:0/1895750536 >> 172.21.15.114:0/1895750536 conn(0x55dfe548c6c0 msgr2=0x55dfe5511d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:53.932 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f678e8edb80 1 -- 172.21.15.114:0/1895750536 shutdown_connections 2023-10-18T14:07:53.933 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f678e8edb80 1 -- 172.21.15.114:0/1895750536 wait complete. 2023-10-18T14:07:53.933 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.910+0000 7f678e8edb80 20 client.25664 trim_cache size 0 max 16384 2023-10-18T14:07:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.932+0000 7f678e8edb80 1 Processor -- start 2023-10-18T14:07:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.932+0000 7f678e8edb80 1 -- start start 2023-10-18T14:07:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f678e8edb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe5521900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f678e8edb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551d630 0x55dfe553e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f678e8edb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551df50 0x55dfe5520b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f678e8edb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe52eb8c0 con 0x55dfe551d630 2023-10-18T14:07:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f678e8edb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe54e7850 con 0x55dfe5518410 2023-10-18T14:07:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f678e8edb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe5522840 con 0x55dfe551df50 2023-10-18T14:07:53.941 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f677bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe5521900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.941 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f677b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551d630 0x55dfe553e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.941 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f677bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe5521900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42418/0 (socket says 172.21.15.114:42418) 2023-10-18T14:07:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f677b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551d630 0x55dfe553e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46276/0 (socket says 172.21.15.114:46276) 2023-10-18T14:07:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f677bfff700 1 -- 172.21.15.114:0/3912338500 learned_addr learned my addr 172.21.15.114:0/3912338500 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f677bfff700 1 -- 172.21.15.114:0/3912338500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551df50 msgr2=0x55dfe5520b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f677bfff700 1 --2- 172.21.15.114:0/3912338500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551df50 0x55dfe5520b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f677bfff700 1 -- 172.21.15.114:0/3912338500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551d630 msgr2=0x55dfe553e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f677bfff700 1 --2- 172.21.15.114:0/3912338500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551d630 0x55dfe553e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.933+0000 7f677bfff700 1 -- 172.21.15.114:0/3912338500 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfe5295d80 con 0x55dfe5518410 2023-10-18T14:07:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.934+0000 7f677bfff700 1 --2- 172.21.15.114:0/3912338500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe5521900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f676c0097c0 tx=0x7f676c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c04bf748f582ea31 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.934+0000 7f6762ffd700 1 -- 172.21.15.114:0/3912338500 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c022040 con 0x55dfe5518410 2023-10-18T14:07:53.947 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.934+0000 7f6762ffd700 1 -- 172.21.15.114:0/3912338500 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f676c00edc0 con 0x55dfe5518410 2023-10-18T14:07:53.947 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.934+0000 7f6762ffd700 1 -- 172.21.15.114:0/3912338500 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c01dae0 con 0x55dfe5518410 2023-10-18T14:07:53.947 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.934+0000 7f678e8edb80 1 -- 172.21.15.114:0/3912338500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 msgr2=0x55dfe5521900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:53.947 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.934+0000 7f678e8edb80 1 --2- 172.21.15.114:0/3912338500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe5521900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f676c0097c0 tx=0x7f676c014000 comp rx=0 tx=0).stop 2023-10-18T14:07:53.947 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.935+0000 7f678e8edb80 1 -- 172.21.15.114:0/3912338500 shutdown_connections 2023-10-18T14:07:53.948 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.935+0000 7f678e8edb80 1 --2- 172.21.15.114:0/3912338500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551df50 0x55dfe5520b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.948 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.935+0000 7f678e8edb80 1 --2- 172.21.15.114:0/3912338500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe5521900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.948 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.935+0000 7f678e8edb80 1 --2- 172.21.15.114:0/3912338500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551d630 0x55dfe553e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.948 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.935+0000 7f678e8edb80 1 -- 172.21.15.114:0/3912338500 >> 172.21.15.114:0/3912338500 conn(0x55dfe548c6c0 msgr2=0x55dfe551c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:53.948 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.935+0000 7f678e8edb80 1 -- 172.21.15.114:0/3912338500 shutdown_connections 2023-10-18T14:07:53.949 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.935+0000 7f678e8edb80 1 -- 172.21.15.114:0/3912338500 wait complete. 2023-10-18T14:07:53.949 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.935+0000 7f678e8edb80 1 -- start start 2023-10-18T14:07:53.949 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.935+0000 7f678e8edb80 1 Processor -- start 2023-10-18T14:07:53.949 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f678e8edb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe558f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.949 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f678e8edb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551d630 0x55dfe558fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.950 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f678e8edb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551df50 0x55dfe5537920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.950 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f678e8edb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe5537ef0 con 0x55dfe551d630 2023-10-18T14:07:53.950 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f678e8edb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe5538060 con 0x55dfe5518410 2023-10-18T14:07:53.950 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f678e8edb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfe5538220 con 0x55dfe551df50 2023-10-18T14:07:53.950 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f678e8edb80 10 client.0 _ll_register_callbacks cb 0x55dfe5351a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:07:53.951 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f677bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe558f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.951 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f6780ca1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551df50 0x55dfe5537920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.951 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f677bfff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe558f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42424/0 (socket says 172.21.15.114:42424) 2023-10-18T14:07:53.951 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f677bfff700 1 -- 172.21.15.114:0/1301010876 learned_addr learned my addr 172.21.15.114:0/1301010876 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:07:53.951 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f677b7fe700 1 --2- 172.21.15.114:0/1301010876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551d630 0x55dfe558fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.951 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f677bfff700 1 -- 172.21.15.114:0/1301010876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551df50 msgr2=0x55dfe5537920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f677bfff700 1 --2- 172.21.15.114:0/1301010876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551df50 0x55dfe5537920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f677bfff700 1 -- 172.21.15.114:0/1301010876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551d630 msgr2=0x55dfe558fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:07:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f677bfff700 1 --2- 172.21.15.114:0/1301010876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551d630 0x55dfe558fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f677bfff700 1 -- 172.21.15.114:0/1301010876 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676c017070 con 0x55dfe5518410 2023-10-18T14:07:53.952 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f677bfff700 1 --2- 172.21.15.114:0/1301010876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe558f880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f676c005950 tx=0x7f676c01d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bdd1de1b435a790 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:07:53.953 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.936+0000 7f675b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:07:53.953 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f675b7fe700 1 -- 172.21.15.114:0/1301010876 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c022070 con 0x55dfe5518410 2023-10-18T14:07:53.953 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f675b7fe700 1 -- 172.21.15.114:0/1301010876 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f676c00e900 con 0x55dfe5518410 2023-10-18T14:07:53.953 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f678e8edb80 1 -- 172.21.15.114:0/1301010876 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67700054e0 con 0x55dfe5518410 2023-10-18T14:07:53.953 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f675b7fe700 1 -- 172.21.15.114:0/1301010876 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f676c00eac0 con 0x55dfe5518410 2023-10-18T14:07:53.954 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f678e8edb80 10 client.25670 fetch_fsmap learned FSMap version 35 2023-10-18T14:07:53.954 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f678e8edb80 1 -- 172.21.15.114:0/1301010876 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55dfe527ec00 con 0x55dfe5518410 2023-10-18T14:07:53.954 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f675b7fe700 1 -- 172.21.15.114:0/1301010876 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67700054e0 con 0x55dfe5518410 2023-10-18T14:07:53.954 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f675b7fe700 1 -- 172.21.15.114:0/1301010876 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 35) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f676c01d6c0 con 0x55dfe5518410 2023-10-18T14:07:53.954 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f678e8edb80 10 client.25670 fetch_fsmap finished waiting for FSMap version 35 2023-10-18T14:07:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f678e8edb80 10 client.25670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:07:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f678e8edb80 20 client.25670 populate_metadata read hostname 'smithi114' 2023-10-18T14:07:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1301010876 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dfe5597750 0x55dfe5599b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:07:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f678e8edb80 4 client.25670 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:07:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.937+0000 7f678e8edb80 1 -- 172.21.15.114:0/1301010876 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dfe5463df0 con 0x55dfe5597750 2023-10-18T14:07:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.938+0000 7f677b7fe700 1 --2- 172.21.15.114:0/1301010876 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dfe5597750 0x55dfe5599b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:07:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.938+0000 7f675b7fe700 10 client.25670 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.938+0000 7f677b7fe700 1 --2- 172.21.15.114:0/1301010876 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dfe5597750 0x55dfe5599b70 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f97a5f53bc2fb86 server_cookie=4a1753535a63233c in_seq=0 out_seq=0 2023-10-18T14:07:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f675b7fe700 1 -- 172.21.15.114:0/1301010876 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dfe5463df0 con 0x55dfe5597750 2023-10-18T14:07:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f675b7fe700 10 client.25670 handle_command_reply: tid=0 2023-10-18T14:07:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f678e8edb80 1 client.25670 shutdown 2023-10-18T14:07:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f678e8edb80 1 -- 172.21.15.114:0/1301010876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 msgr2=0x55dfe558f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1301010876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe558f880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f676c005950 tx=0x7f676c01d4a0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f678e8edb80 1 -- 172.21.15.114:0/1301010876 shutdown_connections 2023-10-18T14:07:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1301010876 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55dfe5597750 0x55dfe5599b70 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1301010876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfe551df50 0x55dfe5537920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1301010876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dfe5518410 0x55dfe558f880 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f678e8edb80 1 --2- 172.21.15.114:0/1301010876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dfe551d630 0x55dfe558fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f678e8edb80 1 -- 172.21.15.114:0/1301010876 >> 172.21.15.114:0/1301010876 conn(0x55dfe548c6c0 msgr2=0x55dfe551e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f675b7fe700 0 client.25670 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:07:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f678e8edb80 1 -- 172.21.15.114:0/1301010876 shutdown_connections 2023-10-18T14:07:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.962+0000 7f678e8edb80 1 -- 172.21.15.114:0/1301010876 wait complete. 2023-10-18T14:07:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.963+0000 7f678e8edb80 20 client.25670 trim_cache size 0 max 16384 2023-10-18T14:07:53.970 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:07:53.970 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:07:53.970 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:07:53.970 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:07:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.963+0000 7f6782704700 1 -- 172.21.15.114:0/737413498 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f67640a15f0 msgr2=0x7f67640a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.963+0000 7f6782704700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f67640a15f0 0x7f67640a3ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f676c009c60 tx=0x7f676c009260 comp rx=0 tx=0).stop 2023-10-18T14:07:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.963+0000 7f6782704700 1 -- 172.21.15.114:0/737413498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677c1a1b50 msgr2=0x7f677c1a1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:07:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.963+0000 7f6782704700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677c1a1b50 0x7f677c1a1fd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6774006130 tx=0x7f677400bcd0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.963+0000 7f6782704700 1 -- 172.21.15.114:0/737413498 shutdown_connections 2023-10-18T14:07:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.963+0000 7f6782704700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f67640a15f0 0x7f67640a3ab0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.963+0000 7f6782704700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677c1a1b50 0x7f677c1a1fd0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.963+0000 7f6782704700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c106f70 0x7f677c19d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.963+0000 7f6782704700 1 --2- 172.21.15.114:0/737413498 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f677c10c090 0x7f677c19d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:07:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.963+0000 7f6782704700 1 -- 172.21.15.114:0/737413498 >> 172.21.15.114:0/737413498 conn(0x7f677c0764f0 msgr2=0x7f677c078830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:07:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.963+0000 7f6782704700 1 -- 172.21.15.114:0/737413498 shutdown_connections 2023-10-18T14:07:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:07:53.963+0000 7f6782704700 1 -- 172.21.15.114:0/737413498 wait complete. 2023-10-18T14:07:54.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:54 smithi158 ceph-mon[103317]: pgmap v397: 97 pgs: 97 active+clean; 61 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.9 MiB/s wr, 1.22k op/s 2023-10-18T14:07:54.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:54 smithi172 ceph-mon[103574]: pgmap v397: 97 pgs: 97 active+clean; 61 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.9 MiB/s wr, 1.22k op/s 2023-10-18T14:07:54.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:54 smithi114 ceph-mon[99494]: pgmap v397: 97 pgs: 97 active+clean; 61 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.9 MiB/s wr, 1.22k op/s 2023-10-18T14:07:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:56 smithi158 ceph-mon[103317]: pgmap v398: 97 pgs: 97 active+clean; 61 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.7 MiB/s wr, 1.11k op/s 2023-10-18T14:07:57.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:56 smithi172 ceph-mon[103574]: pgmap v398: 97 pgs: 97 active+clean; 61 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.7 MiB/s wr, 1.11k op/s 2023-10-18T14:07:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:56 smithi114 ceph-mon[99494]: pgmap v398: 97 pgs: 97 active+clean; 61 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.7 MiB/s wr, 1.11k op/s 2023-10-18T14:07:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:07:58 smithi158 ceph-mon[103317]: pgmap v399: 97 pgs: 97 active+clean; 65 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.6 MiB/s wr, 1.07k op/s 2023-10-18T14:07:59.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:07:58 smithi172 ceph-mon[103574]: pgmap v399: 97 pgs: 97 active+clean; 65 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.6 MiB/s wr, 1.07k op/s 2023-10-18T14:07:59.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:07:58 smithi114 ceph-mon[99494]: pgmap v399: 97 pgs: 97 active+clean; 65 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.6 MiB/s wr, 1.07k op/s 2023-10-18T14:08:01.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:00 smithi158 ceph-mon[103317]: pgmap v400: 97 pgs: 97 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.1 MiB/s wr, 1.28k op/s 2023-10-18T14:08:01.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:00 smithi172 ceph-mon[103574]: pgmap v400: 97 pgs: 97 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.1 MiB/s wr, 1.28k op/s 2023-10-18T14:08:01.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:00 smithi114 ceph-mon[99494]: pgmap v400: 97 pgs: 97 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.1 MiB/s wr, 1.28k op/s 2023-10-18T14:08:03.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:02 smithi158 ceph-mon[103317]: pgmap v401: 97 pgs: 97 active+clean; 68 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.3 MiB/s wr, 999 op/s 2023-10-18T14:08:03.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:02 smithi172 ceph-mon[103574]: pgmap v401: 97 pgs: 97 active+clean; 68 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.3 MiB/s wr, 999 op/s 2023-10-18T14:08:03.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:02 smithi114 ceph-mon[99494]: pgmap v401: 97 pgs: 97 active+clean; 68 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.3 MiB/s wr, 999 op/s 2023-10-18T14:08:04.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:04 smithi158 ceph-mon[103317]: pgmap v402: 97 pgs: 97 active+clean; 77 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 3.0 MiB/s wr, 1.23k op/s 2023-10-18T14:08:04.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:04 smithi172 ceph-mon[103574]: pgmap v402: 97 pgs: 97 active+clean; 77 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 3.0 MiB/s wr, 1.23k op/s 2023-10-18T14:08:04.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:04 smithi114 ceph-mon[99494]: pgmap v402: 97 pgs: 97 active+clean; 77 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 3.0 MiB/s wr, 1.23k op/s 2023-10-18T14:08:07.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:06 smithi158 ceph-mon[103317]: pgmap v403: 97 pgs: 97 active+clean; 87 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.7 MiB/s wr, 1.12k op/s 2023-10-18T14:08:07.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:06 smithi172 ceph-mon[103574]: pgmap v403: 97 pgs: 97 active+clean; 87 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.7 MiB/s wr, 1.12k op/s 2023-10-18T14:08:07.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:06 smithi114 ceph-mon[99494]: pgmap v403: 97 pgs: 97 active+clean; 87 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.7 MiB/s wr, 1.12k op/s 2023-10-18T14:08:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.105+0000 7fe00adac700 1 -- 172.21.15.114:0/4008795214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0040fffb0 msgr2=0x7fe00410c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.105+0000 7fe00adac700 1 --2- 172.21.15.114:0/4008795214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0040fffb0 0x7fe00410c4c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00b0a0 tx=0x7fdffc00b3b0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.105+0000 7fe00adac700 1 -- 172.21.15.114:0/4008795214 shutdown_connections 2023-10-18T14:08:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.105+0000 7fe00adac700 1 --2- 172.21.15.114:0/4008795214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0040fffb0 0x7fe00410c4c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.105+0000 7fe00adac700 1 --2- 172.21.15.114:0/4008795214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe004105690 0x7fe004105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.105+0000 7fe00adac700 1 --2- 172.21.15.114:0/4008795214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040ff5f0 0x7fe0040ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.105+0000 7fe00adac700 1 -- 172.21.15.114:0/4008795214 >> 172.21.15.114:0/4008795214 conn(0x7fe0040fb0c0 msgr2=0x7fe0040fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:07.111 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.105+0000 7fe00adac700 1 -- 172.21.15.114:0/4008795214 shutdown_connections 2023-10-18T14:08:07.111 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.105+0000 7fe00adac700 1 -- 172.21.15.114:0/4008795214 wait complete. 2023-10-18T14:08:07.112 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.106+0000 7fe00adac700 1 Processor -- start 2023-10-18T14:08:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.106+0000 7fe00adac700 1 -- start start 2023-10-18T14:08:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.106+0000 7fe00adac700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0040ff5f0 0x7fe00419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.106+0000 7fe00adac700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040fffb0 0x7fe00419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.106+0000 7fe00adac700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe004105690 0x7fe0041946d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.106+0000 7fe00adac700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe004194d30 con 0x7fe004105690 2023-10-18T14:08:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.106+0000 7fe00adac700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe004194ea0 con 0x7fe0040fffb0 2023-10-18T14:08:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.106+0000 7fe00adac700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe004195060 con 0x7fe0040ff5f0 2023-10-18T14:08:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.106+0000 7fe009349700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe004105690 0x7fe0041946d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.106+0000 7fe003fff700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040fffb0 0x7fe00419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.106+0000 7fe009349700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe004105690 0x7fe0041946d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46298/0 (socket says 172.21.15.114:46298) 2023-10-18T14:08:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.106+0000 7fe009349700 1 -- 172.21.15.114:0/4196821589 learned_addr learned my addr 172.21.15.114:0/4196821589 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.106+0000 7fe008b48700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0040ff5f0 0x7fe00419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.107+0000 7fe003fff700 1 -- 172.21.15.114:0/4196821589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0040ff5f0 msgr2=0x7fe00419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.107+0000 7fe003fff700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0040ff5f0 0x7fe00419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.107+0000 7fe003fff700 1 -- 172.21.15.114:0/4196821589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe004105690 msgr2=0x7fe0041946d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.107+0000 7fe003fff700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe004105690 0x7fe0041946d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.107+0000 7fe003fff700 1 -- 172.21.15.114:0/4196821589 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc009d00 con 0x7fe0040fffb0 2023-10-18T14:08:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.107+0000 7fe009349700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe004105690 0x7fe0041946d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:08:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.107+0000 7fe008b48700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0040ff5f0 0x7fe00419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:08:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.107+0000 7fe003fff700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040fffb0 0x7fe00419aa90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdff0010ad0 tx=0x7fdff0010de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.107+0000 7fe001ffb700 1 -- 172.21.15.114:0/4196821589 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff000b8e0 con 0x7fe0040fffb0 2023-10-18T14:08:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.107+0000 7fe001ffb700 1 -- 172.21.15.114:0/4196821589 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdff0011040 con 0x7fe0040fffb0 2023-10-18T14:08:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.107+0000 7fe00adac700 1 -- 172.21.15.114:0/4196821589 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe004195340 con 0x7fe0040fffb0 2023-10-18T14:08:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.107+0000 7fe001ffb700 1 -- 172.21.15.114:0/4196821589 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff00153e0 con 0x7fe0040fffb0 2023-10-18T14:08:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.107+0000 7fe00adac700 1 -- 172.21.15.114:0/4196821589 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0041a1540 con 0x7fe0040fffb0 2023-10-18T14:08:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.110+0000 7fe001ffb700 1 -- 172.21.15.114:0/4196821589 <== mon.2 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fdff0015540 con 0x7fe0040fffb0 2023-10-18T14:08:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.110+0000 7fe001ffb700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdff40a1670 0x7fdff40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.111+0000 7fe008b48700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdff40a1670 0x7fdff40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.111+0000 7fe001ffb700 1 -- 172.21.15.114:0/4196821589 <== mon.2 v2:172.21.15.158:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fdff00cf4d0 con 0x7fe0040fffb0 2023-10-18T14:08:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.111+0000 7fe016f95b80 1 Processor -- start 2023-10-18T14:08:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.111+0000 7fe016f95b80 1 -- start start 2023-10-18T14:08:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.111+0000 7fe008b48700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdff40a1670 0x7fdff40a3b30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe004100730 tx=0x7fdff8009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.111+0000 7fe016f95b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82fa40 0x55683f82fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.111+0000 7fe016f95b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f830360 0x55683f82a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.111+0000 7fe016f95b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82a820 0x55683f82ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.111+0000 7fe016f95b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55683f799680 con 0x55683f82a820 2023-10-18T14:08:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.111+0000 7fe016f95b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55683f77fc00 con 0x55683f82fa40 2023-10-18T14:08:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.111+0000 7fe016f95b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55683f77d520 con 0x55683f830360 2023-10-18T14:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fe008b48700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82fa40 0x55683f82fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fe008b48700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82fa40 0x55683f82fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42446/0 (socket says 172.21.15.114:42446) 2023-10-18T14:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fe008b48700 1 -- 172.21.15.114:0/2480872489 learned_addr learned my addr 172.21.15.114:0/2480872489 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fe003fff700 1 --2- 172.21.15.114:0/2480872489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f830360 0x55683f82a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fe009349700 1 --2- 172.21.15.114:0/2480872489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82a820 0x55683f82ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fe008b48700 1 -- 172.21.15.114:0/2480872489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f830360 msgr2=0x55683f82a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fe008b48700 1 --2- 172.21.15.114:0/2480872489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f830360 0x55683f82a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fe008b48700 1 -- 172.21.15.114:0/2480872489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82a820 msgr2=0x55683f82ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fe008b48700 1 --2- 172.21.15.114:0/2480872489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82a820 0x55683f82ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fe008b48700 1 -- 172.21.15.114:0/2480872489 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55683f736390 con 0x55683f82fa40 2023-10-18T14:08:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fe008b48700 1 --2- 172.21.15.114:0/2480872489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82fa40 0x55683f82fe20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdff80043d0 tx=0x7fdff8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f200843437e0420 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fdfeeffd700 1 -- 172.21.15.114:0/2480872489 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8003ce0 con 0x55683f82fa40 2023-10-18T14:08:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fdfeeffd700 1 -- 172.21.15.114:0/2480872489 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdff8003e40 con 0x55683f82fa40 2023-10-18T14:08:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.112+0000 7fdfeeffd700 1 -- 172.21.15.114:0/2480872489 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8026900 con 0x55683f82fa40 2023-10-18T14:08:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.113+0000 7fe016f95b80 1 -- 172.21.15.114:0/2480872489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82fa40 msgr2=0x55683f82fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.113+0000 7fe016f95b80 1 --2- 172.21.15.114:0/2480872489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82fa40 0x55683f82fe20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdff80043d0 tx=0x7fdff8014000 comp rx=0 tx=0).stop 2023-10-18T14:08:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.113+0000 7fe016f95b80 1 -- 172.21.15.114:0/2480872489 shutdown_connections 2023-10-18T14:08:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.113+0000 7fe016f95b80 1 --2- 172.21.15.114:0/2480872489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82a820 0x55683f82ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.113+0000 7fe016f95b80 1 --2- 172.21.15.114:0/2480872489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82fa40 0x55683f82fe20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.113+0000 7fe016f95b80 1 --2- 172.21.15.114:0/2480872489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f830360 0x55683f82a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.113+0000 7fe016f95b80 1 -- 172.21.15.114:0/2480872489 >> 172.21.15.114:0/2480872489 conn(0x55683f79a6c0 msgr2=0x55683f8205a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.113+0000 7fe016f95b80 1 -- 172.21.15.114:0/2480872489 shutdown_connections 2023-10-18T14:08:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.113+0000 7fe016f95b80 1 -- 172.21.15.114:0/2480872489 wait complete. 2023-10-18T14:08:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.114+0000 7fe016f95b80 1 -- start start 2023-10-18T14:08:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.114+0000 7fe016f95b80 1 Processor -- start 2023-10-18T14:08:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.114+0000 7fe016f95b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82a820 0x55683f836370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.114+0000 7fe016f95b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82fa40 0x55683f833660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.114+0000 7fe016f95b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f830360 0x55683f833ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.131 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.114+0000 7fe016f95b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55683f778e10 con 0x55683f830360 2023-10-18T14:08:07.131 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.114+0000 7fe016f95b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55683f7156b0 con 0x55683f82a820 2023-10-18T14:08:07.131 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.114+0000 7fe016f95b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55683f715350 con 0x55683f82fa40 2023-10-18T14:08:07.131 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.114+0000 7fe016f95b80 10 client.0 _ll_register_callbacks cb 0x55683f65fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:08:07.131 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fe008b48700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82a820 0x55683f836370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fe008b48700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82a820 0x55683f836370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42452/0 (socket says 172.21.15.114:42452) 2023-10-18T14:08:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fe003fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82fa40 0x55683f833660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fe008b48700 1 -- 172.21.15.114:0/2761564919 learned_addr learned my addr 172.21.15.114:0/2761564919 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fe009349700 1 --2- 172.21.15.114:0/2761564919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f830360 0x55683f833ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fe008b48700 1 -- 172.21.15.114:0/2761564919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82fa40 msgr2=0x55683f833660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fe008b48700 1 --2- 172.21.15.114:0/2761564919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82fa40 0x55683f833660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fe008b48700 1 -- 172.21.15.114:0/2761564919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f830360 msgr2=0x55683f833ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fe008b48700 1 --2- 172.21.15.114:0/2761564919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f830360 0x55683f833ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fe008b48700 1 -- 172.21.15.114:0/2761564919 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff8017070 con 0x55683f82a820 2023-10-18T14:08:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fe003fff700 1 --2- 172.21.15.114:0/2761564919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82fa40 0x55683f833660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fe008b48700 1 --2- 172.21.15.114:0/2761564919 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82a820 0x55683f836370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdff80041e0 tx=0x7fdff80052f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e702766e89548689 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fdfe3fff700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fdfe3fff700 1 -- 172.21.15.114:0/2761564919 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff802a070 con 0x55683f82a820 2023-10-18T14:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fdfe3fff700 1 -- 172.21.15.114:0/2761564919 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fdff80048e0 con 0x55683f82a820 2023-10-18T14:08:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.115+0000 7fe016f95b80 1 -- 172.21.15.114:0/2761564919 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55683f77de90 con 0x55683f82a820 2023-10-18T14:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.116+0000 7fdfe3fff700 1 -- 172.21.15.114:0/2761564919 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdff801ee00 con 0x55683f82a820 2023-10-18T14:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.116+0000 7fe016f95b80 10 client.25682 fetch_fsmap learned FSMap version 35 2023-10-18T14:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.116+0000 7fe016f95b80 1 -- 172.21.15.114:0/2761564919 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55683f5a3d80 con 0x55683f82a820 2023-10-18T14:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.116+0000 7fdfe3fff700 1 -- 172.21.15.114:0/2761564919 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55683f77de90 con 0x55683f82a820 2023-10-18T14:08:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.116+0000 7fdfe3fff700 1 -- 172.21.15.114:0/2761564919 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 35) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fdff8024020 con 0x55683f82a820 2023-10-18T14:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.116+0000 7fe016f95b80 10 client.25682 fetch_fsmap finished waiting for FSMap version 35 2023-10-18T14:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.116+0000 7fe016f95b80 10 client.25682 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.116+0000 7fe016f95b80 20 client.25682 populate_metadata read hostname 'smithi114' 2023-10-18T14:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.116+0000 7fe016f95b80 1 --2- 172.21.15.114:0/2761564919 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55683f8256d0 0x55683f825ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.116+0000 7fe016f95b80 4 client.25682 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.116+0000 7fe016f95b80 1 -- 172.21.15.114:0/2761564919 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55683f7f5850 con 0x55683f8256d0 2023-10-18T14:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.116+0000 7fe003fff700 1 --2- 172.21.15.114:0/2761564919 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55683f8256d0 0x55683f825ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.117+0000 7fe003fff700 1 --2- 172.21.15.114:0/2761564919 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55683f8256d0 0x55683f825ae0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32421a9adab9b8a8 server_cookie=53dd655d88df8226 in_seq=0 out_seq=0 2023-10-18T14:08:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.117+0000 7fdfe3fff700 10 client.25682 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:07.138 INFO:tasks.workunit.client.0.smithi114.stdout:30000 mapread 0x11b12cb thru 0x11b885f (0x7595 bytes) 2023-10-18T14:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fdfe3fff700 1 -- 172.21.15.114:0/2761564919 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55683f7f5850 con 0x55683f8256d0 2023-10-18T14:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fdfe3fff700 10 client.25682 handle_command_reply: tid=0 2023-10-18T14:08:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fe016f95b80 1 client.25682 shutdown 2023-10-18T14:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fe016f95b80 1 -- 172.21.15.114:0/2761564919 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82a820 msgr2=0x55683f836370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fe016f95b80 1 --2- 172.21.15.114:0/2761564919 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82a820 0x55683f836370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdff80041e0 tx=0x7fdff80052f0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fe016f95b80 1 -- 172.21.15.114:0/2761564919 shutdown_connections 2023-10-18T14:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fe016f95b80 1 --2- 172.21.15.114:0/2761564919 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55683f8256d0 0x55683f825ae0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fe016f95b80 1 --2- 172.21.15.114:0/2761564919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f830360 0x55683f833ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fe016f95b80 1 --2- 172.21.15.114:0/2761564919 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f82a820 0x55683f836370 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fdfe3fff700 0 client.25682 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fe016f95b80 1 --2- 172.21.15.114:0/2761564919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82fa40 0x55683f833660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fe016f95b80 1 -- 172.21.15.114:0/2761564919 >> 172.21.15.114:0/2761564919 conn(0x55683f79a6c0 msgr2=0x55683f81fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fe016f95b80 1 -- 172.21.15.114:0/2761564919 shutdown_connections 2023-10-18T14:08:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fe016f95b80 1 -- 172.21.15.114:0/2761564919 wait complete. 2023-10-18T14:08:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.118+0000 7fe016f95b80 20 client.25682 trim_cache size 0 max 16384 2023-10-18T14:08:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe016f95b80 1 Processor -- start 2023-10-18T14:08:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe016f95b80 1 -- start start 2023-10-18T14:08:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe016f95b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f8256d0 0x55683f83fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe016f95b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82a820 0x55683f8204e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe016f95b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82fa40 0x55683f82e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe016f95b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55683f5f98c0 con 0x55683f82a820 2023-10-18T14:08:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe016f95b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55683f8254e0 con 0x55683f8256d0 2023-10-18T14:08:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe016f95b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55683f831bd0 con 0x55683f82fa40 2023-10-18T14:08:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe003fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82a820 0x55683f8204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe003fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82a820 0x55683f8204e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46318/0 (socket says 172.21.15.114:46318) 2023-10-18T14:08:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe003fff700 1 -- 172.21.15.114:0/154269423 learned_addr learned my addr 172.21.15.114:0/154269423 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe008b48700 1 --2- 172.21.15.114:0/154269423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f8256d0 0x55683f83fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe009349700 1 --2- 172.21.15.114:0/154269423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82fa40 0x55683f82e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe003fff700 1 -- 172.21.15.114:0/154269423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82fa40 msgr2=0x55683f82e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe003fff700 1 --2- 172.21.15.114:0/154269423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82fa40 0x55683f82e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe003fff700 1 -- 172.21.15.114:0/154269423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f8256d0 msgr2=0x55683f83fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe003fff700 1 --2- 172.21.15.114:0/154269423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f8256d0 0x55683f83fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe003fff700 1 -- 172.21.15.114:0/154269423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55683f58cc00 con 0x55683f82a820 2023-10-18T14:08:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.138+0000 7fe009349700 1 --2- 172.21.15.114:0/154269423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82fa40 0x55683f82e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:08:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.139+0000 7fe003fff700 1 --2- 172.21.15.114:0/154269423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82a820 0x55683f8204e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdff000bfd0 tx=0x7fdff00cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f6c8abe0096459 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.139+0000 7fdfef7fe700 1 -- 172.21.15.114:0/154269423 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff009c530 con 0x55683f82a820 2023-10-18T14:08:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.139+0000 7fdfef7fe700 1 -- 172.21.15.114:0/154269423 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdff0098040 con 0x55683f82a820 2023-10-18T14:08:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.139+0000 7fdfef7fe700 1 -- 172.21.15.114:0/154269423 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff00cf0b0 con 0x55683f82a820 2023-10-18T14:08:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.140+0000 7fe016f95b80 1 -- 172.21.15.114:0/154269423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82a820 msgr2=0x55683f8204e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.140+0000 7fe016f95b80 1 --2- 172.21.15.114:0/154269423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82a820 0x55683f8204e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdff000bfd0 tx=0x7fdff00cf040 comp rx=0 tx=0).stop 2023-10-18T14:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.140+0000 7fe016f95b80 1 -- 172.21.15.114:0/154269423 shutdown_connections 2023-10-18T14:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.140+0000 7fe016f95b80 1 --2- 172.21.15.114:0/154269423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82fa40 0x55683f82e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.140+0000 7fe016f95b80 1 --2- 172.21.15.114:0/154269423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f8256d0 0x55683f83fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.140+0000 7fe016f95b80 1 --2- 172.21.15.114:0/154269423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82a820 0x55683f8204e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.140+0000 7fe016f95b80 1 -- 172.21.15.114:0/154269423 >> 172.21.15.114:0/154269423 conn(0x55683f79a6c0 msgr2=0x55683f831f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.140+0000 7fe016f95b80 1 -- 172.21.15.114:0/154269423 shutdown_connections 2023-10-18T14:08:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.140+0000 7fe016f95b80 1 -- 172.21.15.114:0/154269423 wait complete. 2023-10-18T14:08:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.140+0000 7fe016f95b80 1 -- start start 2023-10-18T14:08:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.140+0000 7fe016f95b80 1 Processor -- start 2023-10-18T14:08:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe016f95b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f8256d0 0x55683f84c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe016f95b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82a820 0x55683f84cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe016f95b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82fa40 0x55683f89ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe016f95b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55683f84d650 con 0x55683f82fa40 2023-10-18T14:08:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe016f95b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55683f89b200 con 0x55683f8256d0 2023-10-18T14:08:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe016f95b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55683f89b3c0 con 0x55683f82a820 2023-10-18T14:08:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe016f95b80 10 client.0 _ll_register_callbacks cb 0x55683f65fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:08:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe008b48700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f8256d0 0x55683f84c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe008b48700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f8256d0 0x55683f84c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42466/0 (socket says 172.21.15.114:42466) 2023-10-18T14:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe008b48700 1 -- 172.21.15.114:0/532334742 learned_addr learned my addr 172.21.15.114:0/532334742 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe003fff700 1 --2- 172.21.15.114:0/532334742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82a820 0x55683f84cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe009349700 1 --2- 172.21.15.114:0/532334742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82fa40 0x55683f89ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe008b48700 1 -- 172.21.15.114:0/532334742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82a820 msgr2=0x55683f84cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe008b48700 1 --2- 172.21.15.114:0/532334742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82a820 0x55683f84cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe008b48700 1 -- 172.21.15.114:0/532334742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82fa40 msgr2=0x55683f89ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe008b48700 1 --2- 172.21.15.114:0/532334742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82fa40 0x55683f89ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe008b48700 1 -- 172.21.15.114:0/532334742 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0041a1540 con 0x55683f8256d0 2023-10-18T14:08:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fe008b48700 1 --2- 172.21.15.114:0/532334742 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f8256d0 0x55683f84c980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdff801ec70 tx=0x7fdff8005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e6cd7e89df41c38 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fdfe3fff700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.141+0000 7fdfe3fff700 1 -- 172.21.15.114:0/532334742 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff802a040 con 0x55683f8256d0 2023-10-18T14:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fdfe3fff700 1 -- 172.21.15.114:0/532334742 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fdff8026dd0 con 0x55683f8256d0 2023-10-18T14:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fe016f95b80 1 -- 172.21.15.114:0/532334742 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdff8003e40 con 0x55683f8256d0 2023-10-18T14:08:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fdfe3fff700 1 -- 172.21.15.114:0/532334742 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdff801e420 con 0x55683f8256d0 2023-10-18T14:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fe016f95b80 10 client.25688 fetch_fsmap learned FSMap version 35 2023-10-18T14:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fe016f95b80 1 -- 172.21.15.114:0/532334742 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55683f5ca1f0 con 0x55683f8256d0 2023-10-18T14:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fdfe3fff700 1 -- 172.21.15.114:0/532334742 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdff8003e40 con 0x55683f8256d0 2023-10-18T14:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fdfe3fff700 1 -- 172.21.15.114:0/532334742 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 35) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fdff8024070 con 0x55683f8256d0 2023-10-18T14:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fe016f95b80 10 client.25688 fetch_fsmap finished waiting for FSMap version 35 2023-10-18T14:08:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fe016f95b80 10 client.25688 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:08:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fe016f95b80 20 client.25688 populate_metadata read hostname 'smithi114' 2023-10-18T14:08:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fe016f95b80 1 --2- 172.21.15.114:0/532334742 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55683f830360 0x55683f89e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fe016f95b80 4 client.25688 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:08:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fe016f95b80 1 -- 172.21.15.114:0/532334742 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55683f771df0 con 0x55683f830360 2023-10-18T14:08:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.142+0000 7fe003fff700 1 --2- 172.21.15.114:0/532334742 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55683f830360 0x55683f89e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.143+0000 7fdfe3fff700 10 client.25688 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.143+0000 7fe003fff700 1 --2- 172.21.15.114:0/532334742 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55683f830360 0x55683f89e8b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63da433b8d80905e server_cookie=9d69fbbd3c772a4a in_seq=0 out_seq=0 2023-10-18T14:08:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fdfe3fff700 1 -- 172.21.15.114:0/532334742 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55683f771df0 con 0x55683f830360 2023-10-18T14:08:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fdfe3fff700 10 client.25688 handle_command_reply: tid=0 2023-10-18T14:08:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fe016f95b80 1 client.25688 shutdown 2023-10-18T14:08:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fe016f95b80 1 -- 172.21.15.114:0/532334742 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f8256d0 msgr2=0x55683f84c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fe016f95b80 1 --2- 172.21.15.114:0/532334742 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f8256d0 0x55683f84c980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdff801ec70 tx=0x7fdff8005770 comp rx=0 tx=0).stop 2023-10-18T14:08:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fe016f95b80 1 -- 172.21.15.114:0/532334742 shutdown_connections 2023-10-18T14:08:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fe016f95b80 1 --2- 172.21.15.114:0/532334742 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55683f830360 0x55683f89e8b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fe016f95b80 1 --2- 172.21.15.114:0/532334742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55683f82fa40 0x55683f89ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fe016f95b80 1 --2- 172.21.15.114:0/532334742 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55683f8256d0 0x55683f84c980 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fe016f95b80 1 --2- 172.21.15.114:0/532334742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55683f82a820 0x55683f84cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fe016f95b80 1 -- 172.21.15.114:0/532334742 >> 172.21.15.114:0/532334742 conn(0x55683f79a6c0 msgr2=0x55683f82e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fdfe3fff700 0 client.25688 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fe016f95b80 1 -- 172.21.15.114:0/532334742 shutdown_connections 2023-10-18T14:08:07.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fe016f95b80 1 -- 172.21.15.114:0/532334742 wait complete. 2023-10-18T14:08:07.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.164+0000 7fe016f95b80 20 client.25688 trim_cache size 0 max 16384 2023-10-18T14:08:07.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:08:07.171 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:08:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:08:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:08:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.165+0000 7fe00adac700 1 -- 172.21.15.114:0/4196821589 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdff40a1670 msgr2=0x7fdff40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.165+0000 7fe00adac700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdff40a1670 0x7fdff40a3b30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe004100730 tx=0x7fdff8009260 comp rx=0 tx=0).stop 2023-10-18T14:08:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.165+0000 7fe00adac700 1 -- 172.21.15.114:0/4196821589 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040fffb0 msgr2=0x7fe00419aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.165+0000 7fe00adac700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040fffb0 0x7fe00419aa90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdff0010ad0 tx=0x7fdff0010de0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.165+0000 7fe00adac700 1 -- 172.21.15.114:0/4196821589 shutdown_connections 2023-10-18T14:08:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.165+0000 7fe00adac700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdff40a1670 0x7fdff40a3b30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.165+0000 7fe00adac700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe004105690 0x7fe0041946d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.165+0000 7fe00adac700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0040ff5f0 0x7fe00419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.165+0000 7fe00adac700 1 --2- 172.21.15.114:0/4196821589 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040fffb0 0x7fe00419aa90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.165+0000 7fe00adac700 1 -- 172.21.15.114:0/4196821589 >> 172.21.15.114:0/4196821589 conn(0x7fe0040fb0c0 msgr2=0x7fe0040fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.165+0000 7fe00adac700 1 -- 172.21.15.114:0/4196821589 shutdown_connections 2023-10-18T14:08:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:07.165+0000 7fe00adac700 1 -- 172.21.15.114:0/4196821589 wait complete. 2023-10-18T14:08:09.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:08 smithi158 ceph-mon[103317]: pgmap v404: 97 pgs: 97 active+clean; 80 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.4 MiB/s wr, 1.02k op/s 2023-10-18T14:08:09.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:08 smithi172 ceph-mon[103574]: pgmap v404: 97 pgs: 97 active+clean; 80 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.4 MiB/s wr, 1.02k op/s 2023-10-18T14:08:09.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:08 smithi114 ceph-mon[99494]: pgmap v404: 97 pgs: 97 active+clean; 80 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.4 MiB/s wr, 1.02k op/s 2023-10-18T14:08:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:10 smithi158 ceph-mon[103317]: pgmap v405: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.2 MiB/s wr, 1.28k op/s 2023-10-18T14:08:11.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:10 smithi172 ceph-mon[103574]: pgmap v405: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.2 MiB/s wr, 1.28k op/s 2023-10-18T14:08:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:10 smithi114 ceph-mon[99494]: pgmap v405: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.2 MiB/s wr, 1.28k op/s 2023-10-18T14:08:13.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:12 smithi158 ceph-mon[103317]: pgmap v406: 97 pgs: 97 active+clean; 83 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.01k op/s 2023-10-18T14:08:13.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:12 smithi172 ceph-mon[103574]: pgmap v406: 97 pgs: 97 active+clean; 83 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.01k op/s 2023-10-18T14:08:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:12 smithi114 ceph-mon[99494]: pgmap v406: 97 pgs: 97 active+clean; 83 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.01k op/s 2023-10-18T14:08:13.476 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:08:13.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.628+0000 7f86206b4700 1 -- 172.21.15.114:0/4177888431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86181032f0 msgr2=0x7f861810f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:13.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.628+0000 7f86206b4700 1 --2- 172.21.15.114:0/4177888431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86181032f0 0x7f861810f800 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f861000b0a0 tx=0x7f861000b3b0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.629+0000 7f86206b4700 1 -- 172.21.15.114:0/4177888431 shutdown_connections 2023-10-18T14:08:13.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.629+0000 7f86206b4700 1 --2- 172.21.15.114:0/4177888431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86181032f0 0x7f861810f800 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.629+0000 7f86206b4700 1 --2- 172.21.15.114:0/4177888431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8618108940 0x7f8618108d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.629+0000 7f86206b4700 1 --2- 172.21.15.114:0/4177888431 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8618102930 0x7f8618102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.629+0000 7f86206b4700 1 -- 172.21.15.114:0/4177888431 >> 172.21.15.114:0/4177888431 conn(0x7f86180fe400 msgr2=0x7f8618100820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.629+0000 7f86206b4700 1 -- 172.21.15.114:0/4177888431 shutdown_connections 2023-10-18T14:08:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.629+0000 7f86206b4700 1 -- 172.21.15.114:0/4177888431 wait complete. 2023-10-18T14:08:13.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f86206b4700 1 Processor -- start 2023-10-18T14:08:13.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f86206b4700 1 -- start start 2023-10-18T14:08:13.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f86206b4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8618102930 0x7f861819ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f86206b4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86181032f0 0x7f861819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f86206b4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8618108940 0x7f8618198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f86206b4700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86181992a0 con 0x7f86181032f0 2023-10-18T14:08:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f86206b4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8618199410 con 0x7f8618102930 2023-10-18T14:08:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f86206b4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86181995d0 con 0x7f8618108940 2023-10-18T14:08:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f861dc4f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86181032f0 0x7f861819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f861dc4f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86181032f0 0x7f861819ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46338/0 (socket says 172.21.15.114:46338) 2023-10-18T14:08:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f861dc4f700 1 -- 172.21.15.114:0/3154789240 learned_addr learned my addr 172.21.15.114:0/3154789240 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f861e450700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8618102930 0x7f861819ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f861ec51700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8618108940 0x7f8618198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f861dc4f700 1 -- 172.21.15.114:0/3154789240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8618108940 msgr2=0x7f8618198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f861dc4f700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8618108940 0x7f8618198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f861dc4f700 1 -- 172.21.15.114:0/3154789240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8618102930 msgr2=0x7f861819ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:13.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f861dc4f700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8618102930 0x7f861819ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f861dc4f700 1 -- 172.21.15.114:0/3154789240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8610009d00 con 0x7f86181032f0 2023-10-18T14:08:13.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.630+0000 7f861e450700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8618102930 0x7f861819ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:08:13.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.631+0000 7f861dc4f700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86181032f0 0x7f861819ef70 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f860800e9a0 tx=0x7f860800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:13.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.631+0000 7f860f7fe700 1 -- 172.21.15.114:0/3154789240 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608009790 con 0x7f86181032f0 2023-10-18T14:08:13.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.631+0000 7f860f7fe700 1 -- 172.21.15.114:0/3154789240 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8608010430 con 0x7f86181032f0 2023-10-18T14:08:13.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.631+0000 7f86206b4700 1 -- 172.21.15.114:0/3154789240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86181998b0 con 0x7f86181032f0 2023-10-18T14:08:13.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.631+0000 7f860f7fe700 1 -- 172.21.15.114:0/3154789240 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608018680 con 0x7f86181032f0 2023-10-18T14:08:13.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.631+0000 7f86206b4700 1 -- 172.21.15.114:0/3154789240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86181a59b0 con 0x7f86181032f0 2023-10-18T14:08:13.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.633+0000 7f860f7fe700 1 -- 172.21.15.114:0/3154789240 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f86080105a0 con 0x7f86181032f0 2023-10-18T14:08:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.634+0000 7f860f7fe700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f86040a15f0 0x7f86040a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.634+0000 7f861e450700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f86040a15f0 0x7f86040a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.634+0000 7f860f7fe700 1 -- 172.21.15.114:0/3154789240 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f8608014070 con 0x7f86181032f0 2023-10-18T14:08:13.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.634+0000 7f861e450700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f86040a15f0 0x7f86040a3ab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8614009fd0 tx=0x7f8614009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:13.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.635+0000 7f862c89db80 1 Processor -- start 2023-10-18T14:08:13.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.635+0000 7f862c89db80 1 -- start start 2023-10-18T14:08:13.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.635+0000 7f862c89db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96ebe0 0x558a2d96efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.635+0000 7f862c89db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 0x558a2d969090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.635+0000 7f862c89db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d969a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.635+0000 7f862c89db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2d8dc6e0 con 0x558a2d96f500 2023-10-18T14:08:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.635+0000 7f862c89db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2d8c2c60 con 0x558a2d9695d0 2023-10-18T14:08:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.635+0000 7f862c89db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2d8c0580 con 0x558a2d96ebe0 2023-10-18T14:08:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.635+0000 7f861e450700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96ebe0 0x558a2d96efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.635+0000 7f861dc4f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 0x558a2d969090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f861e450700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96ebe0 0x558a2d96efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:50280/0 (socket says 172.21.15.114:50280) 2023-10-18T14:08:13.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f861dc4f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 0x558a2d969090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46348/0 (socket says 172.21.15.114:46348) 2023-10-18T14:08:13.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f861e450700 1 -- 172.21.15.114:0/538414667 learned_addr learned my addr 172.21.15.114:0/538414667 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:13.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f861ec51700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d969a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f861ec51700 1 -- 172.21.15.114:0/538414667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96ebe0 msgr2=0x558a2d96efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:13.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f861ec51700 1 --2- 172.21.15.114:0/538414667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96ebe0 0x558a2d96efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f861ec51700 1 -- 172.21.15.114:0/538414667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 msgr2=0x558a2d969090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:13.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f861ec51700 1 --2- 172.21.15.114:0/538414667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 0x558a2d969090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f861ec51700 1 -- 172.21.15.114:0/538414667 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a2d8793f0 con 0x558a2d9695d0 2023-10-18T14:08:13.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f861dc4f700 1 --2- 172.21.15.114:0/538414667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 0x558a2d969090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:08:13.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f861ec51700 1 --2- 172.21.15.114:0/538414667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d969a50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8610009fd0 tx=0x7f8610009450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dda9bcfbeed3cdf server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:13.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f860cff9700 1 -- 172.21.15.114:0/538414667 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861000e040 con 0x558a2d9695d0 2023-10-18T14:08:13.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f860cff9700 1 -- 172.21.15.114:0/538414667 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8610007e80 con 0x558a2d9695d0 2023-10-18T14:08:13.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.636+0000 7f860cff9700 1 -- 172.21.15.114:0/538414667 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8610007720 con 0x558a2d9695d0 2023-10-18T14:08:13.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.637+0000 7f862c89db80 1 -- 172.21.15.114:0/538414667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 msgr2=0x558a2d969a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:13.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.637+0000 7f862c89db80 1 --2- 172.21.15.114:0/538414667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d969a50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8610009fd0 tx=0x7f8610009450 comp rx=0 tx=0).stop 2023-10-18T14:08:13.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.637+0000 7f862c89db80 1 -- 172.21.15.114:0/538414667 shutdown_connections 2023-10-18T14:08:13.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.637+0000 7f862c89db80 1 --2- 172.21.15.114:0/538414667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d969a50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.637+0000 7f862c89db80 1 --2- 172.21.15.114:0/538414667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96ebe0 0x558a2d96efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.637+0000 7f862c89db80 1 --2- 172.21.15.114:0/538414667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 0x558a2d969090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.637+0000 7f862c89db80 1 -- 172.21.15.114:0/538414667 >> 172.21.15.114:0/538414667 conn(0x558a2d8dd720 msgr2=0x558a2d963b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.637+0000 7f862c89db80 1 -- 172.21.15.114:0/538414667 shutdown_connections 2023-10-18T14:08:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.637+0000 7f862c89db80 1 -- 172.21.15.114:0/538414667 wait complete. 2023-10-18T14:08:13.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.638+0000 7f862c89db80 1 -- start start 2023-10-18T14:08:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.638+0000 7f862c89db80 1 Processor -- start 2023-10-18T14:08:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.638+0000 7f862c89db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d975490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.638+0000 7f862c89db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96ebe0 0x558a2d972780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.638+0000 7f862c89db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96f500 0x558a2d972ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.638+0000 7f862c89db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2d8bbe70 con 0x558a2d96ebe0 2023-10-18T14:08:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.638+0000 7f862c89db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2d858710 con 0x558a2d9695d0 2023-10-18T14:08:13.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.638+0000 7f862c89db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2d8583b0 con 0x558a2d96f500 2023-10-18T14:08:13.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.638+0000 7f862c89db80 10 client.0 _ll_register_callbacks cb 0x558a2d7a2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:08:13.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.638+0000 7f861dc4f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96ebe0 0x558a2d972780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f861e450700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d975490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f861dc4f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96ebe0 0x558a2d972780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46352/0 (socket says 172.21.15.114:46352) 2023-10-18T14:08:13.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f861dc4f700 1 -- 172.21.15.114:0/236646991 learned_addr learned my addr 172.21.15.114:0/236646991 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:13.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f861ec51700 1 --2- 172.21.15.114:0/236646991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96f500 0x558a2d972ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f861e450700 1 -- 172.21.15.114:0/236646991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96f500 msgr2=0x558a2d972ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:13.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f861e450700 1 --2- 172.21.15.114:0/236646991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96f500 0x558a2d972ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f861e450700 1 -- 172.21.15.114:0/236646991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96ebe0 msgr2=0x558a2d972780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:13.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f861e450700 1 --2- 172.21.15.114:0/236646991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96ebe0 0x558a2d972780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f861e450700 1 -- 172.21.15.114:0/236646991 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86181a59b0 con 0x558a2d9695d0 2023-10-18T14:08:13.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f861e450700 1 --2- 172.21.15.114:0/236646991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d975490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f861400ea40 tx=0x7f86140047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=371bed76b897453a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:13.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f8601ffb700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:08:13.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f8601ffb700 1 -- 172.21.15.114:0/236646991 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861401ea20 con 0x558a2d9695d0 2023-10-18T14:08:13.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f8601ffb700 1 -- 172.21.15.114:0/236646991 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f861400ee10 con 0x558a2d9695d0 2023-10-18T14:08:13.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.639+0000 7f862c89db80 1 -- 172.21.15.114:0/236646991 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a2d9388b0 con 0x558a2d9695d0 2023-10-18T14:08:13.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.640+0000 7f8601ffb700 1 -- 172.21.15.114:0/236646991 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f861401eb80 con 0x558a2d9695d0 2023-10-18T14:08:13.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.640+0000 7f862c89db80 10 client.25700 fetch_fsmap learned FSMap version 35 2023-10-18T14:08:13.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.640+0000 7f862c89db80 1 -- 172.21.15.114:0/236646991 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f8618110100 con 0x558a2d9695d0 2023-10-18T14:08:13.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.640+0000 7f8601ffb700 1 -- 172.21.15.114:0/236646991 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558a2d9388b0 con 0x558a2d9695d0 2023-10-18T14:08:13.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.640+0000 7f8601ffb700 1 -- 172.21.15.114:0/236646991 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 35) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f861401f400 con 0x558a2d9695d0 2023-10-18T14:08:13.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.640+0000 7f862c89db80 10 client.25700 fetch_fsmap finished waiting for FSMap version 35 2023-10-18T14:08:13.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.640+0000 7f862c89db80 10 client.25700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:08:13.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.640+0000 7f862c89db80 20 client.25700 populate_metadata read hostname 'smithi114' 2023-10-18T14:08:13.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.640+0000 7f862c89db80 1 --2- 172.21.15.114:0/236646991 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2d979f30 0x558a2d97c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.640+0000 7f862c89db80 4 client.25700 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:08:13.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.640+0000 7f862c89db80 1 -- 172.21.15.114:0/236646991 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a2d8b4e50 con 0x558a2d979f30 2023-10-18T14:08:13.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.640+0000 7f861dc4f700 1 --2- 172.21.15.114:0/236646991 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2d979f30 0x558a2d97c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.641+0000 7f8601ffb700 10 client.25700 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:13.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.641+0000 7f861dc4f700 1 --2- 172.21.15.114:0/236646991 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2d979f30 0x558a2d97c350 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c7cdcbc010d5766 server_cookie=31e47180521e471f in_seq=0 out_seq=0 2023-10-18T14:08:13.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f8601ffb700 1 -- 172.21.15.114:0/236646991 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558a2d8b4e50 con 0x558a2d979f30 2023-10-18T14:08:13.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f8601ffb700 10 client.25700 handle_command_reply: tid=0 2023-10-18T14:08:13.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f862c89db80 1 client.25700 shutdown 2023-10-18T14:08:13.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f862c89db80 1 -- 172.21.15.114:0/236646991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 msgr2=0x558a2d975490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:13.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f862c89db80 1 --2- 172.21.15.114:0/236646991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d975490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f861400ea40 tx=0x7f86140047c0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f862c89db80 1 -- 172.21.15.114:0/236646991 shutdown_connections 2023-10-18T14:08:13.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f862c89db80 1 --2- 172.21.15.114:0/236646991 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2d979f30 0x558a2d97c350 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f862c89db80 1 --2- 172.21.15.114:0/236646991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96f500 0x558a2d972ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f862c89db80 1 --2- 172.21.15.114:0/236646991 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d975490 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f8601ffb700 0 client.25700 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:13.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f862c89db80 1 --2- 172.21.15.114:0/236646991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96ebe0 0x558a2d972780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f862c89db80 1 -- 172.21.15.114:0/236646991 >> 172.21.15.114:0/236646991 conn(0x558a2d8dd720 msgr2=0x558a2d968080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:13.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f862c89db80 1 -- 172.21.15.114:0/236646991 shutdown_connections 2023-10-18T14:08:13.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f862c89db80 1 -- 172.21.15.114:0/236646991 wait complete. 2023-10-18T14:08:13.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.642+0000 7f862c89db80 20 client.25700 trim_cache size 0 max 16384 2023-10-18T14:08:13.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f862c89db80 1 Processor -- start 2023-10-18T14:08:13.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f862c89db80 1 -- start start 2023-10-18T14:08:13.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f862c89db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d980ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f862c89db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96ebe0 0x558a2d968930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f862c89db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 0x558a2d96c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f862c89db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2d73c920 con 0x558a2d96f500 2023-10-18T14:08:13.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f862c89db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2d973d80 con 0x558a2d9695d0 2023-10-18T14:08:13.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f862c89db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2d977440 con 0x558a2d96ebe0 2023-10-18T14:08:13.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f861ec51700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 0x558a2d96c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f861e450700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d980ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f861e450700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d980ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42502/0 (socket says 172.21.15.114:42502) 2023-10-18T14:08:13.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f861ec51700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 0x558a2d96c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46362/0 (socket says 172.21.15.114:46362) 2023-10-18T14:08:13.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f861e450700 1 -- 172.21.15.114:0/3322071939 learned_addr learned my addr 172.21.15.114:0/3322071939 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:13.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f861dc4f700 1 --2- 172.21.15.114:0/3322071939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96ebe0 0x558a2d968930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f861e450700 1 -- 172.21.15.114:0/3322071939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96ebe0 msgr2=0x558a2d968930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:13.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f861e450700 1 --2- 172.21.15.114:0/3322071939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96ebe0 0x558a2d968930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f861e450700 1 -- 172.21.15.114:0/3322071939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 msgr2=0x558a2d96c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:13.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f861e450700 1 --2- 172.21.15.114:0/3322071939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 0x558a2d96c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f861e450700 1 -- 172.21.15.114:0/3322071939 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a2d6e6de0 con 0x558a2d9695d0 2023-10-18T14:08:13.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.662+0000 7f861ec51700 1 --2- 172.21.15.114:0/3322071939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 0x558a2d96c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:08:13.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.663+0000 7f861e450700 1 --2- 172.21.15.114:0/3322071939 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d980ca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8614009e90 tx=0x7f861400e3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df7ee1790811cf5d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:13.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.663+0000 7f860d7fa700 1 -- 172.21.15.114:0/3322071939 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861401f400 con 0x558a2d9695d0 2023-10-18T14:08:13.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.663+0000 7f860d7fa700 1 -- 172.21.15.114:0/3322071939 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8614023070 con 0x558a2d9695d0 2023-10-18T14:08:13.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.663+0000 7f860d7fa700 1 -- 172.21.15.114:0/3322071939 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140039b0 con 0x558a2d9695d0 2023-10-18T14:08:13.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.663+0000 7f862c89db80 1 -- 172.21.15.114:0/3322071939 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 msgr2=0x558a2d980ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:13.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.663+0000 7f862c89db80 1 --2- 172.21.15.114:0/3322071939 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d980ca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8614009e90 tx=0x7f861400e3b0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.663+0000 7f862c89db80 1 -- 172.21.15.114:0/3322071939 shutdown_connections 2023-10-18T14:08:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.663+0000 7f862c89db80 1 --2- 172.21.15.114:0/3322071939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d96f500 0x558a2d96c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.663+0000 7f862c89db80 1 --2- 172.21.15.114:0/3322071939 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d9695d0 0x558a2d980ca0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.663+0000 7f862c89db80 1 --2- 172.21.15.114:0/3322071939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96ebe0 0x558a2d968930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.663+0000 7f862c89db80 1 -- 172.21.15.114:0/3322071939 >> 172.21.15.114:0/3322071939 conn(0x558a2d8dd720 msgr2=0x558a2d968080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f862c89db80 1 -- 172.21.15.114:0/3322071939 shutdown_connections 2023-10-18T14:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f862c89db80 1 -- 172.21.15.114:0/3322071939 wait complete. 2023-10-18T14:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f862c89db80 1 -- start start 2023-10-18T14:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f862c89db80 1 Processor -- start 2023-10-18T14:08:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f862c89db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d9695d0 0x558a2d97fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f862c89db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d96ebe0 0x558a2d9801e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f862c89db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96f500 0x558a2d9e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f862c89db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2d9e7d30 con 0x558a2d9695d0 2023-10-18T14:08:13.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f862c89db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2d9e7e70 con 0x558a2d96ebe0 2023-10-18T14:08:13.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f862c89db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2d9e7fb0 con 0x558a2d96f500 2023-10-18T14:08:13.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f862c89db80 10 client.0 _ll_register_callbacks cb 0x558a2d7a2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:08:13.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f861e450700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d9695d0 0x558a2d97fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f861e450700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d9695d0 0x558a2d97fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46364/0 (socket says 172.21.15.114:46364) 2023-10-18T14:08:13.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f861e450700 1 -- 172.21.15.114:0/2817419362 learned_addr learned my addr 172.21.15.114:0/2817419362 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:13.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.664+0000 7f861dc4f700 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d96ebe0 0x558a2d9801e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f861ec51700 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96f500 0x558a2d9e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f861e450700 1 -- 172.21.15.114:0/2817419362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96f500 msgr2=0x558a2d9e77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f861e450700 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96f500 0x558a2d9e77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f861e450700 1 -- 172.21.15.114:0/2817419362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d96ebe0 msgr2=0x558a2d9801e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f861e450700 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d96ebe0 0x558a2d9801e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f861e450700 1 -- 172.21.15.114:0/2817419362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a2d8793f0 con 0x558a2d9695d0 2023-10-18T14:08:13.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f861dc4f700 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d96ebe0 0x558a2d9801e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:08:13.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f861ec51700 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96f500 0x558a2d9e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:08:13.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f861e450700 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d9695d0 0x558a2d97fca0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f861401f730 tx=0x7f86140042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70c9d145e0ab4f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:13.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f8601ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:08:13.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f8601ffb700 1 -- 172.21.15.114:0/2817419362 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861401f9d0 con 0x558a2d9695d0 2023-10-18T14:08:13.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f8601ffb700 1 -- 172.21.15.114:0/2817419362 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f861401f400 con 0x558a2d9695d0 2023-10-18T14:08:13.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f862c89db80 1 -- 172.21.15.114:0/2817419362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a2d8c0ef0 con 0x558a2d9695d0 2023-10-18T14:08:13.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f8601ffb700 1 -- 172.21.15.114:0/2817419362 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f861401fc10 con 0x558a2d9695d0 2023-10-18T14:08:13.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f862c89db80 10 client.16554 fetch_fsmap learned FSMap version 35 2023-10-18T14:08:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.665+0000 7f862c89db80 1 -- 172.21.15.114:0/2817419362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f8618110100 con 0x558a2d9695d0 2023-10-18T14:08:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.666+0000 7f8601ffb700 1 -- 172.21.15.114:0/2817419362 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8614051080 con 0x558a2d9695d0 2023-10-18T14:08:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.666+0000 7f8601ffb700 1 -- 172.21.15.114:0/2817419362 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 35) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8614003680 con 0x558a2d9695d0 2023-10-18T14:08:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.666+0000 7f862c89db80 10 client.16554 fetch_fsmap finished waiting for FSMap version 35 2023-10-18T14:08:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.666+0000 7f862c89db80 10 client.16554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.666+0000 7f862c89db80 20 client.16554 populate_metadata read hostname 'smithi114' 2023-10-18T14:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.666+0000 7f862c89db80 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2d9e94a0 0x558a2d9eb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.666+0000 7f862c89db80 4 client.16554 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.666+0000 7f862c89db80 1 -- 172.21.15.114:0/2817419362 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558a2d8b4b70 con 0x558a2d9e94a0 2023-10-18T14:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.666+0000 7f861dc4f700 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2d9e94a0 0x558a2d9eb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.667+0000 7f8601ffb700 10 client.16554 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.667+0000 7f861dc4f700 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2d9e94a0 0x558a2d9eb8c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdc483ffea5dfe70 server_cookie=5d837387cc1f63d5 in_seq=0 out_seq=0 2023-10-18T14:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.667+0000 7f8601ffb700 1 -- 172.21.15.114:0/2817419362 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558a2d8b4b70 con 0x558a2d9e94a0 2023-10-18T14:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.667+0000 7f8601ffb700 10 client.16554 handle_command_reply: tid=0 2023-10-18T14:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.667+0000 7f862c89db80 1 client.16554 shutdown 2023-10-18T14:08:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.667+0000 7f862c89db80 1 -- 172.21.15.114:0/2817419362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d9695d0 msgr2=0x558a2d97fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.667+0000 7f862c89db80 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d9695d0 0x558a2d97fca0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f861401f730 tx=0x7f86140042d0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.667+0000 7f862c89db80 1 -- 172.21.15.114:0/2817419362 shutdown_connections 2023-10-18T14:08:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.668+0000 7f862c89db80 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x558a2d9e94a0 0x558a2d9eb8c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.668+0000 7f862c89db80 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a2d96f500 0x558a2d9e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.668+0000 7f8601ffb700 0 client.16554 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.668+0000 7f862c89db80 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558a2d9695d0 0x558a2d97fca0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.668+0000 7f862c89db80 1 --2- 172.21.15.114:0/2817419362 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x558a2d96ebe0 0x558a2d9801e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.668+0000 7f862c89db80 1 -- 172.21.15.114:0/2817419362 >> 172.21.15.114:0/2817419362 conn(0x558a2d8dd720 msgr2=0x558a2d972010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.668+0000 7f862c89db80 1 -- 172.21.15.114:0/2817419362 shutdown_connections 2023-10-18T14:08:13.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.668+0000 7f862c89db80 1 -- 172.21.15.114:0/2817419362 wait complete. 2023-10-18T14:08:13.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.668+0000 7f862c89db80 20 client.16554 trim_cache size 0 max 16384 2023-10-18T14:08:13.688 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:08:13.688 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-18T14:08:13.689 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": { 2023-10-18T14:08:13.689 INFO:teuthology.orchestra.run.smithi114.stdout: "94d18228-30fd-45a0-94d1-b2bec5a6db1a": { 2023-10-18T14:08:13.689 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/", 2023-10-18T14:08:13.689 INFO:teuthology.orchestra.run.smithi114.stdout: "tag": "94d18228-30fd-45a0-94d1-b2bec5a6db1a", 2023-10-18T14:08:13.689 INFO:teuthology.orchestra.run.smithi114.stdout: "options": "recursive,force" 2023-10-18T14:08:13.690 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:08:13.690 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:08:13.690 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:08:13.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.668+0000 7f86206b4700 1 -- 172.21.15.114:0/3154789240 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f86040a15f0 msgr2=0x7f86040a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.668+0000 7f86206b4700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f86040a15f0 0x7f86040a3ab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8614009fd0 tx=0x7f8614009260 comp rx=0 tx=0).stop 2023-10-18T14:08:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.668+0000 7f86206b4700 1 -- 172.21.15.114:0/3154789240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86181032f0 msgr2=0x7f861819ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.668+0000 7f86206b4700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86181032f0 0x7f861819ef70 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f860800e9a0 tx=0x7f860800ecb0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.669+0000 7f86206b4700 1 -- 172.21.15.114:0/3154789240 shutdown_connections 2023-10-18T14:08:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.669+0000 7f86206b4700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f86040a15f0 0x7f86040a3ab0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.669+0000 7f86206b4700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8618108940 0x7f8618198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.669+0000 7f86206b4700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8618102930 0x7f861819ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.669+0000 7f86206b4700 1 --2- 172.21.15.114:0/3154789240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86181032f0 0x7f861819ef70 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.669+0000 7f86206b4700 1 -- 172.21.15.114:0/3154789240 >> 172.21.15.114:0/3154789240 conn(0x7f86180fe400 msgr2=0x7f86180fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.669+0000 7f86206b4700 1 -- 172.21.15.114:0/3154789240 shutdown_connections 2023-10-18T14:08:13.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:13.669+0000 7f86206b4700 1 -- 172.21.15.114:0/3154789240 wait complete. 2023-10-18T14:08:13.694 INFO:tasks.cephfs.filesystem:scrub status for tag:94d18228-30fd-45a0-94d1-b2bec5a6db1a - {'path': '/', 'tag': '94d18228-30fd-45a0-94d1-b2bec5a6db1a', 'options': 'recursive,force'} 2023-10-18T14:08:14.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:14 smithi158 ceph-mon[103317]: pgmap v407: 97 pgs: 97 active+clean; 87 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 3.1 MiB/s wr, 1.21k op/s 2023-10-18T14:08:14.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:14 smithi172 ceph-mon[103574]: pgmap v407: 97 pgs: 97 active+clean; 87 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 3.1 MiB/s wr, 1.21k op/s 2023-10-18T14:08:14.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:14 smithi114 ceph-mon[99494]: pgmap v407: 97 pgs: 97 active+clean; 87 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 3.1 MiB/s wr, 1.21k op/s 2023-10-18T14:08:17.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:16 smithi158 ceph-mon[103317]: pgmap v408: 97 pgs: 97 active+clean; 86 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.05k op/s 2023-10-18T14:08:17.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:16 smithi172 ceph-mon[103574]: pgmap v408: 97 pgs: 97 active+clean; 86 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.05k op/s 2023-10-18T14:08:17.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:16 smithi114 ceph-mon[99494]: pgmap v408: 97 pgs: 97 active+clean; 86 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.6 MiB/s wr, 1.05k op/s 2023-10-18T14:08:19.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:18 smithi158 ceph-mon[103317]: pgmap v409: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 1.02k op/s 2023-10-18T14:08:19.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:18 smithi172 ceph-mon[103574]: pgmap v409: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 1.02k op/s 2023-10-18T14:08:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:18 smithi114 ceph-mon[99494]: pgmap v409: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 1.02k op/s 2023-10-18T14:08:20.306 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.302+0000 7f7409ea4700 1 -- 172.21.15.114:0/455829584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7404108a40 msgr2=0x7f7404114410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:20.307 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.302+0000 7f7409ea4700 1 --2- 172.21.15.114:0/455829584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7404108a40 0x7f7404114410 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00b0d0 tx=0x7f73fc00b3e0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.307 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.302+0000 7f7409ea4700 1 -- 172.21.15.114:0/455829584 shutdown_connections 2023-10-18T14:08:20.307 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.302+0000 7f7409ea4700 1 --2- 172.21.15.114:0/455829584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7404108a40 0x7f7404114410 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.307 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.302+0000 7f7409ea4700 1 --2- 172.21.15.114:0/455829584 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f740410c580 0x7f740410c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.302+0000 7f7409ea4700 1 --2- 172.21.15.114:0/455829584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7404108080 0x7f7404108500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.302+0000 7f7409ea4700 1 -- 172.21.15.114:0/455829584 >> 172.21.15.114:0/455829584 conn(0x7f740406b7c0 msgr2=0x7f740406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.302+0000 7f7409ea4700 1 -- 172.21.15.114:0/455829584 shutdown_connections 2023-10-18T14:08:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.302+0000 7f7409ea4700 1 -- 172.21.15.114:0/455829584 wait complete. 2023-10-18T14:08:20.309 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.303+0000 7f7409ea4700 1 Processor -- start 2023-10-18T14:08:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.303+0000 7f7409ea4700 1 -- start start 2023-10-18T14:08:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.303+0000 7f7409ea4700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7404108080 0x7f740419d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.303+0000 7f7409ea4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7404108a40 0x7f740419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.303+0000 7f7409ea4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740410c580 0x7f74041a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.303+0000 7f7409ea4700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74041a2110 con 0x7f740410c580 2023-10-18T14:08:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.303+0000 7f7409ea4700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74041a2280 con 0x7f7404108080 2023-10-18T14:08:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.303+0000 7f7409ea4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74041a2440 con 0x7f7404108a40 2023-10-18T14:08:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.303+0000 7f7403fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740410c580 0x7f74041a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.313 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.303+0000 7f74037fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7404108080 0x7f740419d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.313 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.303+0000 7f7403fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740410c580 0x7f74041a1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46382/0 (socket says 172.21.15.114:46382) 2023-10-18T14:08:20.313 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.304+0000 7f7403fff700 1 -- 172.21.15.114:0/323660214 learned_addr learned my addr 172.21.15.114:0/323660214 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:20.313 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.303+0000 7f74037fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7404108080 0x7f740419d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42522/0 (socket says 172.21.15.114:42522) 2023-10-18T14:08:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.304+0000 7f7402ffd700 1 --2- 172.21.15.114:0/323660214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7404108a40 0x7f740419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.304+0000 7f7403fff700 1 -- 172.21.15.114:0/323660214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7404108a40 msgr2=0x7f740419d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.304+0000 7f7403fff700 1 --2- 172.21.15.114:0/323660214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7404108a40 0x7f740419d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.304+0000 7f7403fff700 1 -- 172.21.15.114:0/323660214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7404108080 msgr2=0x7f740419d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.304+0000 7f7403fff700 1 --2- 172.21.15.114:0/323660214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7404108080 0x7f740419d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.304+0000 7f7403fff700 1 -- 172.21.15.114:0/323660214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc009d00 con 0x7f740410c580 2023-10-18T14:08:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.304+0000 7f7403fff700 1 --2- 172.21.15.114:0/323660214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740410c580 0x7f74041a1ad0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00bd50 tx=0x7f73fc00bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.304+0000 7f7400ff9700 1 -- 172.21.15.114:0/323660214 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00e040 con 0x7f740410c580 2023-10-18T14:08:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.304+0000 7f7400ff9700 1 -- 172.21.15.114:0/323660214 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73fc01e070 con 0x7f740410c580 2023-10-18T14:08:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.304+0000 7f7409ea4700 1 -- 172.21.15.114:0/323660214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74041a26c0 con 0x7f740410c580 2023-10-18T14:08:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.304+0000 7f7400ff9700 1 -- 172.21.15.114:0/323660214 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc012650 con 0x7f740410c580 2023-10-18T14:08:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.304+0000 7f7409ea4700 1 -- 172.21.15.114:0/323660214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74041a9f60 con 0x7f740410c580 2023-10-18T14:08:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.307+0000 7f7400ff9700 1 -- 172.21.15.114:0/323660214 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f73fc020030 con 0x7f740410c580 2023-10-18T14:08:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.308+0000 7f7400ff9700 1 --2- 172.21.15.114:0/323660214 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f73ec0a1670 0x7f73ec0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.308+0000 7f74037fe700 1 --2- 172.21.15.114:0/323660214 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f73ec0a1670 0x7f73ec0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.308+0000 7f7400ff9700 1 -- 172.21.15.114:0/323660214 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f73fc0cf680 con 0x7f740410c580 2023-10-18T14:08:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.309+0000 7f741608db80 1 Processor -- start 2023-10-18T14:08:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.309+0000 7f74037fe700 1 --2- 172.21.15.114:0/323660214 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f73ec0a1670 0x7f73ec0a3b30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f73f800acd0 tx=0x7f73f8010040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.309+0000 7f741608db80 1 -- start start 2023-10-18T14:08:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.309+0000 7f741608db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 0x56538787ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.309+0000 7f741608db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56538787bf50 0x565387875ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.309+0000 7f741608db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x565387876410 0x565387876870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.309+0000 7f741608db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653877e9680 con 0x56538787b630 2023-10-18T14:08:20.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.309+0000 7f741608db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653877cfc00 con 0x565387876410 2023-10-18T14:08:20.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.309+0000 7f741608db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653877cd520 con 0x56538787bf50 2023-10-18T14:08:20.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.309+0000 7f74037fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 0x56538787ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.324 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.309+0000 7f74037fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 0x56538787ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46386/0 (socket says 172.21.15.114:46386) 2023-10-18T14:08:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.309+0000 7f74037fe700 1 -- 172.21.15.114:0/849479242 learned_addr learned my addr 172.21.15.114:0/849479242 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.310+0000 7f7403fff700 1 --2- 172.21.15.114:0/849479242 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x565387876410 0x565387876870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.310+0000 7f7402ffd700 1 --2- 172.21.15.114:0/849479242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56538787bf50 0x565387875ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.310+0000 7f74037fe700 1 -- 172.21.15.114:0/849479242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56538787bf50 msgr2=0x565387875ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.310+0000 7f74037fe700 1 --2- 172.21.15.114:0/849479242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56538787bf50 0x565387875ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.310+0000 7f74037fe700 1 -- 172.21.15.114:0/849479242 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x565387876410 msgr2=0x565387876870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.310+0000 7f74037fe700 1 --2- 172.21.15.114:0/849479242 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x565387876410 0x565387876870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.310+0000 7f74037fe700 1 -- 172.21.15.114:0/849479242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565387786390 con 0x56538787b630 2023-10-18T14:08:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.310+0000 7f7402ffd700 1 --2- 172.21.15.114:0/849479242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56538787bf50 0x565387875ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:08:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.310+0000 7f7403fff700 1 --2- 172.21.15.114:0/849479242 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x565387876410 0x565387876870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:08:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.310+0000 7f74037fe700 1 --2- 172.21.15.114:0/849479242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 0x56538787ba10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f73f800efa0 tx=0x7f73f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48f70d0d834f9f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.310+0000 7f73e9ffb700 1 -- 172.21.15.114:0/849479242 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8028070 con 0x56538787b630 2023-10-18T14:08:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.310+0000 7f73e9ffb700 1 -- 172.21.15.114:0/849479242 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73f8004020 con 0x56538787b630 2023-10-18T14:08:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.310+0000 7f73e9ffb700 1 -- 172.21.15.114:0/849479242 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8013040 con 0x56538787b630 2023-10-18T14:08:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.311+0000 7f741608db80 1 -- 172.21.15.114:0/849479242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 msgr2=0x56538787ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.311+0000 7f741608db80 1 --2- 172.21.15.114:0/849479242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 0x56538787ba10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f73f800efa0 tx=0x7f73f8014000 comp rx=0 tx=0).stop 2023-10-18T14:08:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.311+0000 7f741608db80 1 -- 172.21.15.114:0/849479242 shutdown_connections 2023-10-18T14:08:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.311+0000 7f741608db80 1 --2- 172.21.15.114:0/849479242 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x565387876410 0x565387876870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.311+0000 7f741608db80 1 --2- 172.21.15.114:0/849479242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 0x56538787ba10 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.311+0000 7f741608db80 1 --2- 172.21.15.114:0/849479242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56538787bf50 0x565387875ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.311+0000 7f741608db80 1 -- 172.21.15.114:0/849479242 >> 172.21.15.114:0/849479242 conn(0x5653877ea6c0 msgr2=0x5653878705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.312+0000 7f741608db80 1 -- 172.21.15.114:0/849479242 shutdown_connections 2023-10-18T14:08:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.312+0000 7f741608db80 1 -- 172.21.15.114:0/849479242 wait complete. 2023-10-18T14:08:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.312+0000 7f741608db80 1 -- start start 2023-10-18T14:08:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.312+0000 7f741608db80 1 Processor -- start 2023-10-18T14:08:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.313+0000 7f741608db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 0x565387881db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.313+0000 7f741608db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 0x5653878856b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.313+0000 7f741608db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56538787bf50 0x565387885c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.313+0000 7f741608db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653877c8e10 con 0x56538787b630 2023-10-18T14:08:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.313+0000 7f741608db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653877656b0 con 0x56538787bf50 2023-10-18T14:08:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.313+0000 7f741608db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x565387765350 con 0x565387876410 2023-10-18T14:08:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.313+0000 7f741608db80 10 client.0 _ll_register_callbacks cb 0x5653876afa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:08:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.313+0000 7f74037fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 0x565387881db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.313+0000 7f74037fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 0x565387881db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:50328/0 (socket says 172.21.15.114:50328) 2023-10-18T14:08:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.313+0000 7f74037fe700 1 -- 172.21.15.114:0/157516778 learned_addr learned my addr 172.21.15.114:0/157516778 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.313+0000 7f7402ffd700 1 --2- 172.21.15.114:0/157516778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 0x5653878856b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.314+0000 7f74037fe700 1 -- 172.21.15.114:0/157516778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56538787bf50 msgr2=0x565387885c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.314+0000 7f74037fe700 1 --2- 172.21.15.114:0/157516778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56538787bf50 0x565387885c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.314+0000 7f74037fe700 1 -- 172.21.15.114:0/157516778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 msgr2=0x5653878856b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.314+0000 7f74037fe700 1 --2- 172.21.15.114:0/157516778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 0x5653878856b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.314+0000 7f74037fe700 1 -- 172.21.15.114:0/157516778 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74041a9f60 con 0x565387876410 2023-10-18T14:08:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.317+0000 7f74037fe700 1 --2- 172.21.15.114:0/157516778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 0x565387881db0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73f8005c50 tx=0x7f73f800cd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1b525e390c321bc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.317+0000 7f73e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-10-18T14:08:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.318+0000 7f73e2ffd700 1 -- 172.21.15.114:0/157516778 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8038070 con 0x565387876410 2023-10-18T14:08:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.318+0000 7f73e2ffd700 1 -- 172.21.15.114:0/157516778 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f73f8003b30 con 0x565387876410 2023-10-18T14:08:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.318+0000 7f741608db80 1 -- 172.21.15.114:0/157516778 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653877cde90 con 0x565387876410 2023-10-18T14:08:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.319+0000 7f73e2ffd700 1 -- 172.21.15.114:0/157516778 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73f8028030 con 0x565387876410 2023-10-18T14:08:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.319+0000 7f741608db80 10 client.25933 fetch_fsmap learned FSMap version 35 2023-10-18T14:08:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.319+0000 7f741608db80 1 -- 172.21.15.114:0/157516778 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f73f800ecd0 con 0x565387876410 2023-10-18T14:08:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.319+0000 7f73e2ffd700 1 -- 172.21.15.114:0/157516778 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73f8041020 con 0x565387876410 2023-10-18T14:08:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.319+0000 7f73e2ffd700 1 -- 172.21.15.114:0/157516778 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 35) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f73f803b030 con 0x565387876410 2023-10-18T14:08:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.319+0000 7f741608db80 10 client.25933 fetch_fsmap finished waiting for FSMap version 35 2023-10-18T14:08:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.319+0000 7f741608db80 10 client.25933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:08:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.319+0000 7f741608db80 20 client.25933 populate_metadata read hostname 'smithi114' 2023-10-18T14:08:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.319+0000 7f741608db80 1 --2- 172.21.15.114:0/157516778 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56538788f910 0x565387891d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.319+0000 7f741608db80 4 client.25933 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:08:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.319+0000 7f741608db80 1 -- 172.21.15.114:0/157516778 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565387845850 con 0x56538788f910 2023-10-18T14:08:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.321+0000 7f7402ffd700 1 --2- 172.21.15.114:0/157516778 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56538788f910 0x565387891d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.322+0000 7f73e2ffd700 10 client.25933 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.322+0000 7f7402ffd700 1 --2- 172.21.15.114:0/157516778 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56538788f910 0x565387891d30 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb6072c3849e0467 server_cookie=745c6ed4ef70c82c in_seq=0 out_seq=0 2023-10-18T14:08:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f73e2ffd700 1 -- 172.21.15.114:0/157516778 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x565387845850 con 0x56538788f910 2023-10-18T14:08:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f73e2ffd700 10 client.25933 handle_command_reply: tid=0 2023-10-18T14:08:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f741608db80 1 client.25933 shutdown 2023-10-18T14:08:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f741608db80 1 -- 172.21.15.114:0/157516778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 msgr2=0x565387881db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f741608db80 1 --2- 172.21.15.114:0/157516778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 0x565387881db0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73f8005c50 tx=0x7f73f800cd70 comp rx=0 tx=0).stop 2023-10-18T14:08:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f741608db80 1 -- 172.21.15.114:0/157516778 shutdown_connections 2023-10-18T14:08:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f741608db80 1 --2- 172.21.15.114:0/157516778 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56538788f910 0x565387891d30 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f741608db80 1 --2- 172.21.15.114:0/157516778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56538787bf50 0x565387885c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f73e2ffd700 0 client.25933 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f741608db80 1 --2- 172.21.15.114:0/157516778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 0x565387881db0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f741608db80 1 --2- 172.21.15.114:0/157516778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 0x5653878856b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f741608db80 1 -- 172.21.15.114:0/157516778 >> 172.21.15.114:0/157516778 conn(0x5653877ea6c0 msgr2=0x56538786fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f741608db80 1 -- 172.21.15.114:0/157516778 shutdown_connections 2023-10-18T14:08:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f741608db80 1 -- 172.21.15.114:0/157516778 wait complete. 2023-10-18T14:08:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.323+0000 7f741608db80 20 client.25933 trim_cache size 0 max 16384 2023-10-18T14:08:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.342+0000 7f741608db80 1 Processor -- start 2023-10-18T14:08:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.342+0000 7f741608db80 1 -- start start 2023-10-18T14:08:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.342+0000 7f741608db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x565387876410 0x56538787ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.342+0000 7f741608db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56538787b630 0x565387885c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.342+0000 7f741608db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787bf50 0x565387884600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.342+0000 7f741608db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653876498c0 con 0x56538787bf50 2023-10-18T14:08:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.342+0000 7f741608db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x56538787c660 con 0x565387876410 2023-10-18T14:08:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.342+0000 7f741608db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x565387869080 con 0x56538787b630 2023-10-18T14:08:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.342+0000 7f74037fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x565387876410 0x56538787ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.343+0000 7f74037fe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x565387876410 0x56538787ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42544/0 (socket says 172.21.15.114:42544) 2023-10-18T14:08:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.343+0000 7f74037fe700 1 -- 172.21.15.114:0/602590092 learned_addr learned my addr 172.21.15.114:0/602590092 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.343+0000 7f7402ffd700 1 --2- 172.21.15.114:0/602590092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56538787b630 0x565387885c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.343+0000 7f74037fe700 1 -- 172.21.15.114:0/602590092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56538787b630 msgr2=0x565387885c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.343+0000 7f74037fe700 1 --2- 172.21.15.114:0/602590092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56538787b630 0x565387885c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.343+0000 7f74037fe700 1 -- 172.21.15.114:0/602590092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787bf50 msgr2=0x565387884600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T14:08:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.343+0000 7f74037fe700 1 --2- 172.21.15.114:0/602590092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787bf50 0x565387884600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.343+0000 7f74037fe700 1 -- 172.21.15.114:0/602590092 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653875f3d80 con 0x565387876410 2023-10-18T14:08:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.343+0000 7f74037fe700 1 --2- 172.21.15.114:0/602590092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x565387876410 0x56538787ba10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f73f800ab30 tx=0x7f73f8005d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b422e45d6cf4a17e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.343+0000 7f73ea7fc700 1 -- 172.21.15.114:0/602590092 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8028070 con 0x565387876410 2023-10-18T14:08:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.343+0000 7f73ea7fc700 1 -- 172.21.15.114:0/602590092 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73f8041030 con 0x565387876410 2023-10-18T14:08:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.343+0000 7f73ea7fc700 1 -- 172.21.15.114:0/602590092 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8038040 con 0x565387876410 2023-10-18T14:08:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.344+0000 7f741608db80 1 -- 172.21.15.114:0/602590092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x565387876410 msgr2=0x56538787ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.344+0000 7f741608db80 1 --2- 172.21.15.114:0/602590092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x565387876410 0x56538787ba10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f73f800ab30 tx=0x7f73f8005d00 comp rx=0 tx=0).stop 2023-10-18T14:08:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.344+0000 7f741608db80 1 -- 172.21.15.114:0/602590092 shutdown_connections 2023-10-18T14:08:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.344+0000 7f741608db80 1 --2- 172.21.15.114:0/602590092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787bf50 0x565387884600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.344+0000 7f741608db80 1 --2- 172.21.15.114:0/602590092 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x565387876410 0x56538787ba10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.344+0000 7f741608db80 1 --2- 172.21.15.114:0/602590092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56538787b630 0x565387885c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.344+0000 7f741608db80 1 -- 172.21.15.114:0/602590092 >> 172.21.15.114:0/602590092 conn(0x5653877ea6c0 msgr2=0x565387882840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.344+0000 7f741608db80 1 -- 172.21.15.114:0/602590092 shutdown_connections 2023-10-18T14:08:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.344+0000 7f741608db80 1 -- 172.21.15.114:0/602590092 wait complete. 2023-10-18T14:08:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.345+0000 7f741608db80 1 -- start start 2023-10-18T14:08:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.345+0000 7f741608db80 1 Processor -- start 2023-10-18T14:08:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.345+0000 7f741608db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 0x56538788c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.345+0000 7f741608db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 0x565387888770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.345+0000 7f741608db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56538787bf50 0x565387888cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.345+0000 7f741608db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x565387889280 con 0x56538787b630 2023-10-18T14:08:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.345+0000 7f741608db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653878893f0 con 0x56538787bf50 2023-10-18T14:08:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.345+0000 7f741608db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653878895b0 con 0x565387876410 2023-10-18T14:08:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.345+0000 7f741608db80 10 client.0 _ll_register_callbacks cb 0x5653876afa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:08:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.345+0000 7f74037fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 0x56538788c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.345+0000 7f74037fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 0x56538788c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:50340/0 (socket says 172.21.15.114:50340) 2023-10-18T14:08:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.345+0000 7f74037fe700 1 -- 172.21.15.114:0/227599070 learned_addr learned my addr 172.21.15.114:0/227599070 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.345+0000 7f7403fff700 1 --2- 172.21.15.114:0/227599070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56538787bf50 0x565387888cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.346+0000 7f74037fe700 1 -- 172.21.15.114:0/227599070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56538787bf50 msgr2=0x565387888cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.346+0000 7f74037fe700 1 --2- 172.21.15.114:0/227599070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56538787bf50 0x565387888cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.346+0000 7f74037fe700 1 -- 172.21.15.114:0/227599070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 msgr2=0x565387888770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.346+0000 7f74037fe700 1 --2- 172.21.15.114:0/227599070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 0x565387888770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.346+0000 7f74037fe700 1 -- 172.21.15.114:0/227599070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f800ecd0 con 0x565387876410 2023-10-18T14:08:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.346+0000 7f74037fe700 1 --2- 172.21.15.114:0/227599070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 0x56538788c280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f73f80044e0 tx=0x7f73f8004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd77baa249208e22 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.346+0000 7f73e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-10-18T14:08:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.346+0000 7f73e2ffd700 1 -- 172.21.15.114:0/227599070 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8038030 con 0x565387876410 2023-10-18T14:08:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.346+0000 7f73e2ffd700 1 -- 172.21.15.114:0/227599070 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f73f8042080 con 0x565387876410 2023-10-18T14:08:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.346+0000 7f741608db80 1 -- 172.21.15.114:0/227599070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f73f8004020 con 0x565387876410 2023-10-18T14:08:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.347+0000 7f73e2ffd700 1 -- 172.21.15.114:0/227599070 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73f8028040 con 0x565387876410 2023-10-18T14:08:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.347+0000 7f741608db80 10 client.25939 fetch_fsmap learned FSMap version 35 2023-10-18T14:08:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.347+0000 7f741608db80 1 -- 172.21.15.114:0/227599070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5653875dcc00 con 0x565387876410 2023-10-18T14:08:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.347+0000 7f73e2ffd700 1 -- 172.21.15.114:0/227599070 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73f8054020 con 0x565387876410 2023-10-18T14:08:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.347+0000 7f73e2ffd700 1 -- 172.21.15.114:0/227599070 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 35) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f73f800c6b0 con 0x565387876410 2023-10-18T14:08:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.347+0000 7f741608db80 10 client.25939 fetch_fsmap finished waiting for FSMap version 35 2023-10-18T14:08:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.347+0000 7f741608db80 10 client.25939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:08:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.347+0000 7f741608db80 20 client.25939 populate_metadata read hostname 'smithi114' 2023-10-18T14:08:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.347+0000 7f741608db80 1 --2- 172.21.15.114:0/227599070 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56538788f910 0x5653878e6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.347+0000 7f741608db80 4 client.25939 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:08:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.347+0000 7f741608db80 1 -- 172.21.15.114:0/227599070 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5653877c1df0 con 0x56538788f910 2023-10-18T14:08:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.347+0000 7f7402ffd700 1 --2- 172.21.15.114:0/227599070 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56538788f910 0x5653878e6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.348+0000 7f73e2ffd700 10 client.25939 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.348+0000 7f7402ffd700 1 --2- 172.21.15.114:0/227599070 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56538788f910 0x5653878e6950 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0cbb0bad6549030 server_cookie=e0cb8b0ea3025669 in_seq=0 out_seq=0 2023-10-18T14:08:20.374 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f73e2ffd700 1 -- 172.21.15.114:0/227599070 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5653877c1df0 con 0x56538788f910 2023-10-18T14:08:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f73e2ffd700 10 client.25939 handle_command_reply: tid=0 2023-10-18T14:08:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f741608db80 1 client.25939 shutdown 2023-10-18T14:08:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f741608db80 1 -- 172.21.15.114:0/227599070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 msgr2=0x56538788c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f741608db80 1 --2- 172.21.15.114:0/227599070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 0x56538788c280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f73f80044e0 tx=0x7f73f8004830 comp rx=0 tx=0).stop 2023-10-18T14:08:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f741608db80 1 -- 172.21.15.114:0/227599070 shutdown_connections 2023-10-18T14:08:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f741608db80 1 --2- 172.21.15.114:0/227599070 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x56538788f910 0x5653878e6950 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f741608db80 1 --2- 172.21.15.114:0/227599070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x56538787bf50 0x565387888cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f73e2ffd700 0 client.25939 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f741608db80 1 --2- 172.21.15.114:0/227599070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565387876410 0x56538788c280 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f741608db80 1 --2- 172.21.15.114:0/227599070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56538787b630 0x565387888770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f741608db80 1 -- 172.21.15.114:0/227599070 >> 172.21.15.114:0/227599070 conn(0x5653877ea6c0 msgr2=0x565387882840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f741608db80 1 -- 172.21.15.114:0/227599070 shutdown_connections 2023-10-18T14:08:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.369+0000 7f741608db80 1 -- 172.21.15.114:0/227599070 wait complete. 2023-10-18T14:08:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.370+0000 7f741608db80 20 client.25939 trim_cache size 0 max 16384 2023-10-18T14:08:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:08:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:08:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:08:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:08:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.370+0000 7f7409ea4700 1 -- 172.21.15.114:0/323660214 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f73ec0a1670 msgr2=0x7f73ec0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.370+0000 7f7409ea4700 1 --2- 172.21.15.114:0/323660214 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f73ec0a1670 0x7f73ec0a3b30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f73f800acd0 tx=0x7f73f8010040 comp rx=0 tx=0).stop 2023-10-18T14:08:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.370+0000 7f7409ea4700 1 -- 172.21.15.114:0/323660214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740410c580 msgr2=0x7f74041a1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.370+0000 7f7409ea4700 1 --2- 172.21.15.114:0/323660214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740410c580 0x7f74041a1ad0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00bd50 tx=0x7f73fc00bd80 comp rx=0 tx=0).stop 2023-10-18T14:08:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.370+0000 7f7409ea4700 1 -- 172.21.15.114:0/323660214 shutdown_connections 2023-10-18T14:08:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.370+0000 7f7409ea4700 1 --2- 172.21.15.114:0/323660214 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f73ec0a1670 0x7f73ec0a3b30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.370+0000 7f7409ea4700 1 --2- 172.21.15.114:0/323660214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f740410c580 0x7f74041a1ad0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.370+0000 7f7409ea4700 1 --2- 172.21.15.114:0/323660214 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7404108080 0x7f740419d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.370+0000 7f7409ea4700 1 --2- 172.21.15.114:0/323660214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7404108a40 0x7f740419d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.370+0000 7f7409ea4700 1 -- 172.21.15.114:0/323660214 >> 172.21.15.114:0/323660214 conn(0x7f740406b7c0 msgr2=0x7f740406ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.370+0000 7f7409ea4700 1 -- 172.21.15.114:0/323660214 shutdown_connections 2023-10-18T14:08:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:20.370+0000 7f7409ea4700 1 -- 172.21.15.114:0/323660214 wait complete. 2023-10-18T14:08:20.503 INFO:tasks.workunit.client.0.smithi114.stdout:40000 copy from 0x98ca82 to 0x993e9d, (0x741b bytes) at 0xfd3925 2023-10-18T14:08:21.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:20 smithi158 ceph-mon[103317]: pgmap v410: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 3.1 MiB/s wr, 1.25k op/s 2023-10-18T14:08:21.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:20 smithi172 ceph-mon[103574]: pgmap v410: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 3.1 MiB/s wr, 1.25k op/s 2023-10-18T14:08:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:20 smithi114 ceph-mon[99494]: pgmap v410: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 3.1 MiB/s wr, 1.25k op/s 2023-10-18T14:08:23.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:22 smithi158 ceph-mon[103317]: pgmap v411: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.2 MiB/s wr, 936 op/s 2023-10-18T14:08:23.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:22 smithi172 ceph-mon[103574]: pgmap v411: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.2 MiB/s wr, 936 op/s 2023-10-18T14:08:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:22 smithi114 ceph-mon[99494]: pgmap v411: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.2 MiB/s wr, 936 op/s 2023-10-18T14:08:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:24 smithi158 ceph-mon[103317]: pgmap v412: 97 pgs: 97 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.8 MiB/s wr, 1.17k op/s 2023-10-18T14:08:24.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:24 smithi172 ceph-mon[103574]: pgmap v412: 97 pgs: 97 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.8 MiB/s wr, 1.17k op/s 2023-10-18T14:08:24.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:24 smithi114 ceph-mon[99494]: pgmap v412: 97 pgs: 97 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.8 MiB/s wr, 1.17k op/s 2023-10-18T14:08:25.556 INFO:tasks.workunit.client.0.smithi114.stdout:truncating to largest ever: 0x63ff6b1 2023-10-18T14:08:27.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:26 smithi158 ceph-mon[103317]: pgmap v413: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 990 op/s 2023-10-18T14:08:27.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:26 smithi172 ceph-mon[103574]: pgmap v413: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 990 op/s 2023-10-18T14:08:27.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:26 smithi114 ceph-mon[99494]: pgmap v413: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 990 op/s 2023-10-18T14:08:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:28 smithi158 ceph-mon[103317]: pgmap v414: 97 pgs: 97 active+clean; 89 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 973 op/s 2023-10-18T14:08:29.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:28 smithi172 ceph-mon[103574]: pgmap v414: 97 pgs: 97 active+clean; 89 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 973 op/s 2023-10-18T14:08:29.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:28 smithi114 ceph-mon[99494]: pgmap v414: 97 pgs: 97 active+clean; 89 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 973 op/s 2023-10-18T14:08:31.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:30 smithi158 ceph-mon[103317]: pgmap v415: 97 pgs: 97 active+clean; 83 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.7 MiB/s wr, 1.16k op/s 2023-10-18T14:08:31.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:30 smithi172 ceph-mon[103574]: pgmap v415: 97 pgs: 97 active+clean; 83 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.7 MiB/s wr, 1.16k op/s 2023-10-18T14:08:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:30 smithi114 ceph-mon[99494]: pgmap v415: 97 pgs: 97 active+clean; 83 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.7 MiB/s wr, 1.16k op/s 2023-10-18T14:08:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:32 smithi158 ceph-mon[103317]: pgmap v416: 97 pgs: 97 active+clean; 85 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.2 MiB/s wr, 917 op/s 2023-10-18T14:08:33.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:32 smithi172 ceph-mon[103574]: pgmap v416: 97 pgs: 97 active+clean; 85 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.2 MiB/s wr, 917 op/s 2023-10-18T14:08:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:32 smithi114 ceph-mon[99494]: pgmap v416: 97 pgs: 97 active+clean; 85 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.2 MiB/s wr, 917 op/s 2023-10-18T14:08:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.510+0000 7f242c10e700 1 -- 172.21.15.114:0/470173371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24240ffa10 msgr2=0x7f2424103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.510+0000 7f242c10e700 1 --2- 172.21.15.114:0/470173371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24240ffa10 0x7f2424103a50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2414009990 tx=0x7f2414009ca0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.510+0000 7f242c10e700 1 -- 172.21.15.114:0/470173371 shutdown_connections 2023-10-18T14:08:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.510+0000 7f242c10e700 1 --2- 172.21.15.114:0/470173371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2424104180 0x7f242410bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.510+0000 7f242c10e700 1 --2- 172.21.15.114:0/470173371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24240ff060 0x7f24240ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.510+0000 7f242c10e700 1 --2- 172.21.15.114:0/470173371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24240ffa10 0x7f2424103a50 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.510+0000 7f242c10e700 1 -- 172.21.15.114:0/470173371 >> 172.21.15.114:0/470173371 conn(0x7f2424075c40 msgr2=0x7f24240fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.510+0000 7f242c10e700 1 -- 172.21.15.114:0/470173371 shutdown_connections 2023-10-18T14:08:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.510+0000 7f242c10e700 1 -- 172.21.15.114:0/470173371 wait complete. 2023-10-18T14:08:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f242c10e700 1 Processor -- start 2023-10-18T14:08:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f242c10e700 1 -- start start 2023-10-18T14:08:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f242c10e700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24240ff060 0x7f2424194a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f242c10e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2424104180 0x7f2424194f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f242c10e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2424199340 0x7f24241997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f242c10e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2424199d30 con 0x7f2424104180 2023-10-18T14:08:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f242c10e700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2424199ea0 con 0x7f24240ff060 2023-10-18T14:08:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f242c10e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242419a060 con 0x7f2424199340 2023-10-18T14:08:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f24296a9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2424104180 0x7f2424194f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f24296a9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2424104180 0x7f2424194f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46420/0 (socket says 172.21.15.114:46420) 2023-10-18T14:08:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f24296a9700 1 -- 172.21.15.114:0/4135896032 learned_addr learned my addr 172.21.15.114:0/4135896032 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f2429eaa700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24240ff060 0x7f2424194a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f242a6ab700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2424199340 0x7f24241997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f24296a9700 1 -- 172.21.15.114:0/4135896032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2424199340 msgr2=0x7f24241997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f24296a9700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2424199340 0x7f24241997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f24296a9700 1 -- 172.21.15.114:0/4135896032 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24240ff060 msgr2=0x7f2424194a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f24296a9700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24240ff060 0x7f2424194a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.511+0000 7f24296a9700 1 -- 172.21.15.114:0/4135896032 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24140095f0 con 0x7f2424104180 2023-10-18T14:08:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.512+0000 7f24296a9700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2424104180 0x7f2424194f70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f24140059d0 tx=0x7f2414004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.512+0000 7f241affd700 1 -- 172.21.15.114:0/4135896032 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241401d070 con 0x7f2424104180 2023-10-18T14:08:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.512+0000 7f241affd700 1 -- 172.21.15.114:0/4135896032 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2414022470 con 0x7f2424104180 2023-10-18T14:08:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.512+0000 7f242c10e700 1 -- 172.21.15.114:0/4135896032 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24241a15f0 con 0x7f2424104180 2023-10-18T14:08:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.512+0000 7f241affd700 1 -- 172.21.15.114:0/4135896032 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414017650 con 0x7f2424104180 2023-10-18T14:08:33.522 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.512+0000 7f242c10e700 1 -- 172.21.15.114:0/4135896032 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24241a1a10 con 0x7f2424104180 2023-10-18T14:08:33.527 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.514+0000 7f241affd700 1 -- 172.21.15.114:0/4135896032 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f24140225e0 con 0x7f2424104180 2023-10-18T14:08:33.528 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.515+0000 7f241affd700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f24100a1670 0x7f24100a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.528 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.515+0000 7f2429eaa700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f24100a1670 0x7f24100a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.528 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.515+0000 7f241affd700 1 -- 172.21.15.114:0/4135896032 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f24140ce300 con 0x7f2424104180 2023-10-18T14:08:33.528 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.515+0000 7f2429eaa700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f24100a1670 0x7f24100a3b30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2420005950 tx=0x7f242000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.515+0000 7f24382f7b80 1 Processor -- start 2023-10-18T14:08:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24382f7b80 1 -- start start 2023-10-18T14:08:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24382f7b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 0x561e34578cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24382f7b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34579230 0x561e345730e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24382f7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34573620 0x561e34573aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.530 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24382f7b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e344e4680 con 0x561e34579230 2023-10-18T14:08:33.530 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24382f7b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e344cac00 con 0x561e34578910 2023-10-18T14:08:33.530 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24382f7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e344c8520 con 0x561e34573620 2023-10-18T14:08:33.530 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f2429eaa700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 0x561e34578cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.530 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24296a9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34579230 0x561e345730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.531 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24296a9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34579230 0x561e345730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46428/0 (socket says 172.21.15.114:46428) 2023-10-18T14:08:33.531 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f2429eaa700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 0x561e34578cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42570/0 (socket says 172.21.15.114:42570) 2023-10-18T14:08:33.531 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24296a9700 1 -- 172.21.15.114:0/379836354 learned_addr learned my addr 172.21.15.114:0/379836354 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:33.531 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f242a6ab700 1 --2- 172.21.15.114:0/379836354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34573620 0x561e34573aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.531 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24296a9700 1 -- 172.21.15.114:0/379836354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34573620 msgr2=0x561e34573aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24296a9700 1 --2- 172.21.15.114:0/379836354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34573620 0x561e34573aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24296a9700 1 -- 172.21.15.114:0/379836354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 msgr2=0x561e34578cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24296a9700 1 --2- 172.21.15.114:0/379836354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 0x561e34578cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f24296a9700 1 -- 172.21.15.114:0/379836354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e34481390 con 0x561e34579230 2023-10-18T14:08:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.516+0000 7f2429eaa700 1 --2- 172.21.15.114:0/379836354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 0x561e34578cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:08:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.517+0000 7f24296a9700 1 --2- 172.21.15.114:0/379836354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34579230 0x561e345730e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2414097e60 tx=0x7f2414097850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bb74be62f2bed server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:33.533 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.517+0000 7f240ffff700 1 -- 172.21.15.114:0/379836354 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241409baf0 con 0x561e34579230 2023-10-18T14:08:33.533 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.517+0000 7f240ffff700 1 -- 172.21.15.114:0/379836354 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24140b0020 con 0x561e34579230 2023-10-18T14:08:33.533 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.517+0000 7f240ffff700 1 -- 172.21.15.114:0/379836354 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241409f120 con 0x561e34579230 2023-10-18T14:08:33.533 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.518+0000 7f24382f7b80 1 -- 172.21.15.114:0/379836354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34579230 msgr2=0x561e345730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:33.533 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.518+0000 7f24382f7b80 1 --2- 172.21.15.114:0/379836354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34579230 0x561e345730e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2414097e60 tx=0x7f2414097850 comp rx=0 tx=0).stop 2023-10-18T14:08:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.518+0000 7f24382f7b80 1 -- 172.21.15.114:0/379836354 shutdown_connections 2023-10-18T14:08:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.518+0000 7f24382f7b80 1 --2- 172.21.15.114:0/379836354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34573620 0x561e34573aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.518+0000 7f24382f7b80 1 --2- 172.21.15.114:0/379836354 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 0x561e34578cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.518+0000 7f24382f7b80 1 --2- 172.21.15.114:0/379836354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34579230 0x561e345730e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.518+0000 7f24382f7b80 1 -- 172.21.15.114:0/379836354 >> 172.21.15.114:0/379836354 conn(0x561e344e56c0 msgr2=0x561e3456b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.518+0000 7f24382f7b80 1 -- 172.21.15.114:0/379836354 shutdown_connections 2023-10-18T14:08:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.518+0000 7f24382f7b80 1 -- 172.21.15.114:0/379836354 wait complete. 2023-10-18T14:08:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.518+0000 7f24382f7b80 1 -- start start 2023-10-18T14:08:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.518+0000 7f24382f7b80 1 Processor -- start 2023-10-18T14:08:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f24382f7b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e3457c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f24382f7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34578910 0x561e3457cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f24382f7b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34579230 0x561e3457d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f24382f7b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e344c3e10 con 0x561e34573620 2023-10-18T14:08:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f24382f7b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e344606b0 con 0x561e34579230 2023-10-18T14:08:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f24382f7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e34460350 con 0x561e34578910 2023-10-18T14:08:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f24382f7b80 10 client.0 _ll_register_callbacks cb 0x561e343aaa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:08:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f2429eaa700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e3457c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f2429eaa700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e3457c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46432/0 (socket says 172.21.15.114:46432) 2023-10-18T14:08:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f2429eaa700 1 -- 172.21.15.114:0/1863006677 learned_addr learned my addr 172.21.15.114:0/1863006677 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f242a6ab700 1 --2- 172.21.15.114:0/1863006677 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34579230 0x561e3457d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f24296a9700 1 --2- 172.21.15.114:0/1863006677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34578910 0x561e3457cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f2429eaa700 1 -- 172.21.15.114:0/1863006677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34578910 msgr2=0x561e3457cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f2429eaa700 1 --2- 172.21.15.114:0/1863006677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34578910 0x561e3457cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f2429eaa700 1 -- 172.21.15.114:0/1863006677 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34579230 msgr2=0x561e3457d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f2429eaa700 1 --2- 172.21.15.114:0/1863006677 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34579230 0x561e3457d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f2429eaa700 1 -- 172.21.15.114:0/1863006677 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2420010c50 con 0x561e34573620 2023-10-18T14:08:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f2429eaa700 1 --2- 172.21.15.114:0/1863006677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e3457c590 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f24200116c0 tx=0x7f24200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5116c0ab152c8c34 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f240d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:08:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f240d7fa700 1 -- 172.21.15.114:0/1863006677 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420028470 con 0x561e34573620 2023-10-18T14:08:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.519+0000 7f240d7fa700 1 -- 172.21.15.114:0/1863006677 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f2420017070 con 0x561e34573620 2023-10-18T14:08:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.520+0000 7f24382f7b80 1 -- 172.21.15.114:0/1863006677 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e344c8e90 con 0x561e34573620 2023-10-18T14:08:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.520+0000 7f240d7fa700 1 -- 172.21.15.114:0/1863006677 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24200285d0 con 0x561e34573620 2023-10-18T14:08:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.520+0000 7f24382f7b80 10 client.16578 fetch_fsmap learned FSMap version 35 2023-10-18T14:08:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.520+0000 7f24382f7b80 1 -- 172.21.15.114:0/1863006677 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f24241a1a10 con 0x561e34573620 2023-10-18T14:08:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.520+0000 7f240d7fa700 1 -- 172.21.15.114:0/1863006677 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561e344c8e90 con 0x561e34573620 2023-10-18T14:08:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.520+0000 7f240d7fa700 1 -- 172.21.15.114:0/1863006677 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 35) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f2420032800 con 0x561e34573620 2023-10-18T14:08:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.520+0000 7f24382f7b80 10 client.16578 fetch_fsmap finished waiting for FSMap version 35 2023-10-18T14:08:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.520+0000 7f24382f7b80 10 client.16578 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:08:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.520+0000 7f24382f7b80 20 client.16578 populate_metadata read hostname 'smithi114' 2023-10-18T14:08:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.520+0000 7f24382f7b80 1 --2- 172.21.15.114:0/1863006677 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561e3458c9c0 0x561e3458ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.520+0000 7f24382f7b80 4 client.16578 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:08:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.520+0000 7f24382f7b80 1 -- 172.21.15.114:0/1863006677 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e34540850 con 0x561e3458c9c0 2023-10-18T14:08:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.521+0000 7f24296a9700 1 --2- 172.21.15.114:0/1863006677 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561e3458c9c0 0x561e3458ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.521+0000 7f24296a9700 1 --2- 172.21.15.114:0/1863006677 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561e3458c9c0 0x561e3458ede0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff3c728d361b5d59 server_cookie=a3218eced3c9a7b6 in_seq=0 out_seq=0 2023-10-18T14:08:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.521+0000 7f240d7fa700 10 client.16578 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f240d7fa700 1 -- 172.21.15.114:0/1863006677 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561e34540850 con 0x561e3458c9c0 2023-10-18T14:08:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f240d7fa700 10 client.16578 handle_command_reply: tid=0 2023-10-18T14:08:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f24382f7b80 1 client.16578 shutdown 2023-10-18T14:08:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f24382f7b80 1 -- 172.21.15.114:0/1863006677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 msgr2=0x561e3457c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f24382f7b80 1 --2- 172.21.15.114:0/1863006677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e3457c590 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f24200116c0 tx=0x7f24200047c0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f24382f7b80 1 -- 172.21.15.114:0/1863006677 shutdown_connections 2023-10-18T14:08:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f24382f7b80 1 --2- 172.21.15.114:0/1863006677 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561e3458c9c0 0x561e3458ede0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f24382f7b80 1 --2- 172.21.15.114:0/1863006677 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34579230 0x561e3457d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f24382f7b80 1 --2- 172.21.15.114:0/1863006677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e3457c590 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f24382f7b80 1 --2- 172.21.15.114:0/1863006677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34578910 0x561e3457cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f24382f7b80 1 -- 172.21.15.114:0/1863006677 >> 172.21.15.114:0/1863006677 conn(0x561e344e56c0 msgr2=0x561e3456ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f240d7fa700 0 client.16578 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f24382f7b80 1 -- 172.21.15.114:0/1863006677 shutdown_connections 2023-10-18T14:08:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.522+0000 7f24382f7b80 1 -- 172.21.15.114:0/1863006677 wait complete. 2023-10-18T14:08:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.523+0000 7f24382f7b80 20 client.16578 trim_cache size 0 max 16384 2023-10-18T14:08:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f24382f7b80 1 Processor -- start 2023-10-18T14:08:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f24382f7b80 1 -- start start 2023-10-18T14:08:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f24382f7b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e3456b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f24382f7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34578910 0x561e34588030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f24382f7b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34579230 0x561e34588570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f24382f7b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e343448c0 con 0x561e34573620 2023-10-18T14:08:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f24382f7b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3457efa0 con 0x561e34579230 2023-10-18T14:08:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f24382f7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3457aac0 con 0x561e34578910 2023-10-18T14:08:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f2429eaa700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e3456b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f242a6ab700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34579230 0x561e34588570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f2429eaa700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e3456b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46440/0 (socket says 172.21.15.114:46440) 2023-10-18T14:08:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f242a6ab700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34579230 0x561e34588570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42588/0 (socket says 172.21.15.114:42588) 2023-10-18T14:08:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f2429eaa700 1 -- 172.21.15.114:0/4112157500 learned_addr learned my addr 172.21.15.114:0/4112157500 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.541+0000 7f24296a9700 1 --2- 172.21.15.114:0/4112157500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34578910 0x561e34588030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.542+0000 7f2429eaa700 1 -- 172.21.15.114:0/4112157500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34578910 msgr2=0x561e34588030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.542+0000 7f2429eaa700 1 --2- 172.21.15.114:0/4112157500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34578910 0x561e34588030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.542+0000 7f2429eaa700 1 -- 172.21.15.114:0/4112157500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34579230 msgr2=0x561e34588570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.542+0000 7f2429eaa700 1 --2- 172.21.15.114:0/4112157500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34579230 0x561e34588570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.542+0000 7f2429eaa700 1 -- 172.21.15.114:0/4112157500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e342eed80 con 0x561e34573620 2023-10-18T14:08:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.542+0000 7f242a6ab700 1 --2- 172.21.15.114:0/4112157500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34579230 0x561e34588570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:08:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.542+0000 7f2429eaa700 1 --2- 172.21.15.114:0/4112157500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e3456b4e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2420000c00 tx=0x7f242001f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba92af0cfe390f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.542+0000 7f2418ff9700 1 -- 172.21.15.114:0/4112157500 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420032650 con 0x561e34573620 2023-10-18T14:08:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.543+0000 7f2418ff9700 1 -- 172.21.15.114:0/4112157500 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2420015070 con 0x561e34573620 2023-10-18T14:08:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.543+0000 7f2418ff9700 1 -- 172.21.15.114:0/4112157500 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420028470 con 0x561e34573620 2023-10-18T14:08:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.543+0000 7f24382f7b80 1 -- 172.21.15.114:0/4112157500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 msgr2=0x561e3456b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.543+0000 7f24382f7b80 1 --2- 172.21.15.114:0/4112157500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e3456b4e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2420000c00 tx=0x7f242001f430 comp rx=0 tx=0).stop 2023-10-18T14:08:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.543+0000 7f24382f7b80 1 -- 172.21.15.114:0/4112157500 shutdown_connections 2023-10-18T14:08:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.543+0000 7f24382f7b80 1 --2- 172.21.15.114:0/4112157500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34579230 0x561e34588570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.543+0000 7f24382f7b80 1 --2- 172.21.15.114:0/4112157500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e3456b4e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.543+0000 7f24382f7b80 1 --2- 172.21.15.114:0/4112157500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34578910 0x561e34588030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.543+0000 7f24382f7b80 1 -- 172.21.15.114:0/4112157500 >> 172.21.15.114:0/4112157500 conn(0x561e344e56c0 msgr2=0x561e34576740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.543+0000 7f24382f7b80 1 -- 172.21.15.114:0/4112157500 shutdown_connections 2023-10-18T14:08:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.543+0000 7f24382f7b80 1 -- 172.21.15.114:0/4112157500 wait complete. 2023-10-18T14:08:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.544+0000 7f24382f7b80 1 -- start start 2023-10-18T14:08:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.544+0000 7f24382f7b80 1 Processor -- start 2023-10-18T14:08:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.544+0000 7f24382f7b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e345d9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.544+0000 7f24382f7b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 0x561e345d9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.544+0000 7f24382f7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34579230 0x561e345d4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.544+0000 7f24382f7b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e345da440 con 0x561e34573620 2023-10-18T14:08:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.544+0000 7f24382f7b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e345da5b0 con 0x561e34578910 2023-10-18T14:08:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.544+0000 7f24382f7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e345d4c80 con 0x561e34579230 2023-10-18T14:08:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.544+0000 7f24382f7b80 10 client.0 _ll_register_callbacks cb 0x561e343aaa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:08:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f24296a9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 0x561e345d9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f24296a9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 0x561e345d9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42592/0 (socket says 172.21.15.114:42592) 2023-10-18T14:08:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f24296a9700 1 -- 172.21.15.114:0/2035091446 learned_addr learned my addr 172.21.15.114:0/2035091446 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f242a6ab700 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34579230 0x561e345d4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f2429eaa700 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e345d9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f24296a9700 1 -- 172.21.15.114:0/2035091446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34579230 msgr2=0x561e345d4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f24296a9700 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34579230 0x561e345d4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f24296a9700 1 -- 172.21.15.114:0/2035091446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 msgr2=0x561e345d9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f24296a9700 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e345d9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f24296a9700 1 -- 172.21.15.114:0/2035091446 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241c003e00 con 0x561e34578910 2023-10-18T14:08:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f2429eaa700 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e345d9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:08:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f242a6ab700 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34579230 0x561e345d4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:08:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f24296a9700 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 0x561e345d9cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f241409b380 tx=0x7f241400f8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6c5816ce655ffc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f240d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.158:3300/0 2023-10-18T14:08:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f240d7fa700 1 -- 172.21.15.114:0/2035091446 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241409baf0 con 0x561e34578910 2023-10-18T14:08:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f24382f7b80 1 -- 172.21.15.114:0/2035091446 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24140b0020 con 0x561e34578910 2023-10-18T14:08:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f240d7fa700 1 -- 172.21.15.114:0/2035091446 <== mon.2 v2:172.21.15.158:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f24140b1070 con 0x561e34578910 2023-10-18T14:08:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f240d7fa700 1 -- 172.21.15.114:0/2035091446 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f241409f540 con 0x561e34578910 2023-10-18T14:08:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f24382f7b80 10 client.25739 fetch_fsmap learned FSMap version 35 2023-10-18T14:08:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.545+0000 7f24382f7b80 1 -- 172.21.15.114:0/2035091446 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f24241a1a10 con 0x561e34578910 2023-10-18T14:08:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.546+0000 7f240d7fa700 1 -- 172.21.15.114:0/2035091446 <== mon.2 v2:172.21.15.158:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2414083080 con 0x561e34578910 2023-10-18T14:08:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.546+0000 7f240d7fa700 1 -- 172.21.15.114:0/2035091446 <== mon.2 v2:172.21.15.158:3300/0 5 ==== fsmap(e 35) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f241407b070 con 0x561e34578910 2023-10-18T14:08:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.546+0000 7f24382f7b80 10 client.25739 fetch_fsmap finished waiting for FSMap version 35 2023-10-18T14:08:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.546+0000 7f24382f7b80 10 client.25739 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-18T14:08:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.546+0000 7f24382f7b80 20 client.25739 populate_metadata read hostname 'smithi114' 2023-10-18T14:08:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.546+0000 7f24382f7b80 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561e34571990 0x561e34571da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.546+0000 7f24382f7b80 4 client.25739 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-18T14:08:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.546+0000 7f24382f7b80 1 -- 172.21.15.114:0/2035091446 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561e344bcdf0 con 0x561e34571990 2023-10-18T14:08:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.546+0000 7f2429eaa700 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561e34571990 0x561e34571da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.546+0000 7f240d7fa700 10 client.25739 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.546+0000 7f2429eaa700 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561e34571990 0x561e34571da0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfa088d74a714aab server_cookie=57243fce3d227d2d in_seq=0 out_seq=0 2023-10-18T14:08:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f240d7fa700 1 -- 172.21.15.114:0/2035091446 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561e344bcdf0 con 0x561e34571990 2023-10-18T14:08:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f240d7fa700 10 client.25739 handle_command_reply: tid=0 2023-10-18T14:08:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f24382f7b80 1 client.25739 shutdown 2023-10-18T14:08:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f24382f7b80 1 -- 172.21.15.114:0/2035091446 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 msgr2=0x561e345d9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f24382f7b80 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 0x561e345d9cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f241409b380 tx=0x7f241400f8b0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f24382f7b80 1 -- 172.21.15.114:0/2035091446 shutdown_connections 2023-10-18T14:08:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f24382f7b80 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561e34571990 0x561e34571da0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f24382f7b80 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e34579230 0x561e345d4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f24382f7b80 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561e34573620 0x561e345d9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f24382f7b80 1 --2- 172.21.15.114:0/2035091446 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561e34578910 0x561e345d9cd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f24382f7b80 1 -- 172.21.15.114:0/2035091446 >> 172.21.15.114:0/2035091446 conn(0x561e344e56c0 msgr2=0x561e34588030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f240d7fa700 0 client.25739 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f24382f7b80 1 -- 172.21.15.114:0/2035091446 shutdown_connections 2023-10-18T14:08:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.574+0000 7f24382f7b80 1 -- 172.21.15.114:0/2035091446 wait complete. 2023-10-18T14:08:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.575+0000 7f24382f7b80 20 client.25739 trim_cache size 0 max 16384 2023-10-18T14:08:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:{ 2023-10-18T14:08:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "message": "", 2023-10-18T14:08:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout: "return_code": 0 2023-10-18T14:08:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stdout:} 2023-10-18T14:08:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.577+0000 7f242c10e700 1 -- 172.21.15.114:0/4135896032 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f24100a1670 msgr2=0x7f24100a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.577+0000 7f242c10e700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f24100a1670 0x7f24100a3b30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2420005950 tx=0x7f242000b410 comp rx=0 tx=0).stop 2023-10-18T14:08:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.577+0000 7f242c10e700 1 -- 172.21.15.114:0/4135896032 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2424104180 msgr2=0x7f2424194f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.577+0000 7f242c10e700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2424104180 0x7f2424194f70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f24140059d0 tx=0x7f2414004730 comp rx=0 tx=0).stop 2023-10-18T14:08:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.577+0000 7f242c10e700 1 -- 172.21.15.114:0/4135896032 shutdown_connections 2023-10-18T14:08:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.577+0000 7f242c10e700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f24100a1670 0x7f24100a3b30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.577+0000 7f242c10e700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2424199340 0x7f24241997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.577+0000 7f242c10e700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f24240ff060 0x7f2424194a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.577+0000 7f242c10e700 1 --2- 172.21.15.114:0/4135896032 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2424104180 0x7f2424194f70 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.577+0000 7f242c10e700 1 -- 172.21.15.114:0/4135896032 >> 172.21.15.114:0/4135896032 conn(0x7f2424075c40 msgr2=0x7f24240fb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.578+0000 7f242c10e700 1 -- 172.21.15.114:0/4135896032 shutdown_connections 2023-10-18T14:08:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi114.front.sepia.ceph.com.smithi114.stderr:2023-10-18T14:08:33.578+0000 7f242c10e700 1 -- 172.21.15.114:0/4135896032 wait complete. 2023-10-18T14:08:34.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:34 smithi158 ceph-mon[103317]: pgmap v417: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 1.07k op/s 2023-10-18T14:08:34.794 INFO:tasks.workunit.client.0.smithi114.stdout:All 50000 operations completed A-OK! 2023-10-18T14:08:34.799 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-18T14:08:34.799 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-18T14:08:34.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:34 smithi172 ceph-mon[103574]: pgmap v417: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 1.07k op/s 2023-10-18T14:08:34.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:34 smithi114 ceph-mon[99494]: pgmap v417: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 1.07k op/s 2023-10-18T14:08:37.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:36 smithi158 ceph-mon[103317]: pgmap v418: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.3 MiB/s wr, 960 op/s 2023-10-18T14:08:37.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:36 smithi172 ceph-mon[103574]: pgmap v418: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.3 MiB/s wr, 960 op/s 2023-10-18T14:08:37.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:36 smithi114 ceph-mon[99494]: pgmap v418: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.3 MiB/s wr, 960 op/s 2023-10-18T14:08:38.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:37 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:38.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:37 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:08:38.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:37 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:38.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:37 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:08:38.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:37 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:38.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:37 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:08:39.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:38 smithi158 ceph-mon[103317]: pgmap v419: 97 pgs: 97 active+clean; 88 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.1 MiB/s wr, 896 op/s 2023-10-18T14:08:39.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:38 smithi172 ceph-mon[103574]: pgmap v419: 97 pgs: 97 active+clean; 88 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.1 MiB/s wr, 896 op/s 2023-10-18T14:08:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:38 smithi114 ceph-mon[99494]: pgmap v419: 97 pgs: 97 active+clean; 88 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.1 MiB/s wr, 896 op/s 2023-10-18T14:08:40.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:39 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:40.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:39 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:40.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:39 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:41.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:40 smithi158 ceph-mon[103317]: pgmap v420: 97 pgs: 97 active+clean; 86 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 905 op/s 2023-10-18T14:08:41.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:40 smithi172 ceph-mon[103574]: pgmap v420: 97 pgs: 97 active+clean; 86 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 905 op/s 2023-10-18T14:08:41.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:40 smithi114 ceph-mon[99494]: pgmap v420: 97 pgs: 97 active+clean; 86 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 905 op/s 2023-10-18T14:08:42.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:41 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:42.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:41 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:42.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:41 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:43.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:42 smithi158 ceph-mon[103317]: pgmap v421: 97 pgs: 97 active+clean; 87 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 1.9 MiB/s wr, 637 op/s 2023-10-18T14:08:43.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:42 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:43.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:42 smithi172 ceph-mon[103574]: pgmap v421: 97 pgs: 97 active+clean; 87 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 1.9 MiB/s wr, 637 op/s 2023-10-18T14:08:43.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:42 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:42 smithi114 ceph-mon[99494]: pgmap v421: 97 pgs: 97 active+clean; 87 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 1.9 MiB/s wr, 637 op/s 2023-10-18T14:08:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:42 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:43.695 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:08:43.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.820+0000 7f0503941700 1 -- 172.21.15.114:0/1852833037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc1056e0 msgr2=0x7f04fc105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:43.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.820+0000 7f0503941700 1 --2- 172.21.15.114:0/1852833037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc1056e0 0x7f04fc105ac0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009990 tx=0x7f04f8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 -- 172.21.15.114:0/1852833037 shutdown_connections 2023-10-18T14:08:43.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 --2- 172.21.15.114:0/1852833037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc100000 0x7f04fc10c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 --2- 172.21.15.114:0/1852833037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc1056e0 0x7f04fc105ac0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 --2- 172.21.15.114:0/1852833037 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04fc0ff640 0x7f04fc0ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 -- 172.21.15.114:0/1852833037 >> 172.21.15.114:0/1852833037 conn(0x7f04fc0767f0 msgr2=0x7f04fc076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:43.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 -- 172.21.15.114:0/1852833037 shutdown_connections 2023-10-18T14:08:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 -- 172.21.15.114:0/1852833037 wait complete. 2023-10-18T14:08:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 Processor -- start 2023-10-18T14:08:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 -- start start 2023-10-18T14:08:43.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc0ff640 0x7f04fc197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc100000 0x7f04fc197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04fc1056e0 0x7f04fc1a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc198790 con 0x7f04fc100000 2023-10-18T14:08:43.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc1a2f50 con 0x7f04fc1056e0 2023-10-18T14:08:43.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.821+0000 7f0503941700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc1a3090 con 0x7f04fc0ff640 2023-10-18T14:08:43.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f0500edc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc100000 0x7f04fc197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f0500edc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc100000 0x7f04fc197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46462/0 (socket says 172.21.15.114:46462) 2023-10-18T14:08:43.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f0500edc700 1 -- 172.21.15.114:0/778151420 learned_addr learned my addr 172.21.15.114:0/778151420 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:43.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f0501ede700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04fc1056e0 0x7f04fc1a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f05016dd700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc0ff640 0x7f04fc197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f0500edc700 1 -- 172.21.15.114:0/778151420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc0ff640 msgr2=0x7f04fc197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:43.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f0500edc700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc0ff640 0x7f04fc197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f0500edc700 1 -- 172.21.15.114:0/778151420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04fc1056e0 msgr2=0x7f04fc1a2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:43.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f0500edc700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04fc1056e0 0x7f04fc1a2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f0500edc700 1 -- 172.21.15.114:0/778151420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f80095f0 con 0x7f04fc100000 2023-10-18T14:08:43.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f0500edc700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc100000 0x7f04fc197ed0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00e9a0 tx=0x7f04ec00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:43.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f04f27fc700 1 -- 172.21.15.114:0/778151420 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec009790 con 0x7f04fc100000 2023-10-18T14:08:43.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f04f27fc700 1 -- 172.21.15.114:0/778151420 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04ec010430 con 0x7f04fc100000 2023-10-18T14:08:43.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f0503941700 1 -- 172.21.15.114:0/778151420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc1a3370 con 0x7f04fc100000 2023-10-18T14:08:43.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f04f27fc700 1 -- 172.21.15.114:0/778151420 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec018680 con 0x7f04fc100000 2023-10-18T14:08:43.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.822+0000 7f0503941700 1 -- 172.21.15.114:0/778151420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc1a38d0 con 0x7f04fc100000 2023-10-18T14:08:43.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.824+0000 7f04f27fc700 1 -- 172.21.15.114:0/778151420 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f04ec0105a0 con 0x7f04fc100000 2023-10-18T14:08:43.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.825+0000 7f04f27fc700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f04e80a1670 0x7f04e80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.825+0000 7f04f27fc700 1 -- 172.21.15.114:0/778151420 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f04ec014070 con 0x7f04fc100000 2023-10-18T14:08:43.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.825+0000 7f05016dd700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f04e80a1670 0x7f04e80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.825+0000 7f05016dd700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f04e80a1670 0x7f04e80a3b30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f04f80098e0 tx=0x7f04f8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:43.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.826+0000 7f050fb2ab80 1 Processor -- start 2023-10-18T14:08:43.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.826+0000 7f050fb2ab80 1 -- start start 2023-10-18T14:08:43.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.826+0000 7f050fb2ab80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72c690 0x55e22a72ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.826+0000 7f050fb2ab80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72cfb0 0x55e22a730bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.826+0000 7f050fb2ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a731100 0x55e22a731560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.826+0000 7f050fb2ab80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22a69b6e0 con 0x55e22a72c690 2023-10-18T14:08:43.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.826+0000 7f050fb2ab80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22a681c60 con 0x55e22a72cfb0 2023-10-18T14:08:43.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.826+0000 7f050fb2ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22a67f580 con 0x55e22a731100 2023-10-18T14:08:43.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.826+0000 7f05016dd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72c690 0x55e22a72ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.826+0000 7f0500edc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72cfb0 0x55e22a730bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.826+0000 7f05016dd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72c690 0x55e22a72ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46468/0 (socket says 172.21.15.114:46468) 2023-10-18T14:08:43.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.826+0000 7f05016dd700 1 -- 172.21.15.114:0/890572812 learned_addr learned my addr 172.21.15.114:0/890572812 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:43.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.826+0000 7f0501ede700 1 --2- 172.21.15.114:0/890572812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a731100 0x55e22a731560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.827+0000 7f0500edc700 1 -- 172.21.15.114:0/890572812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a731100 msgr2=0x55e22a731560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:43.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.827+0000 7f0500edc700 1 --2- 172.21.15.114:0/890572812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a731100 0x55e22a731560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.827+0000 7f0500edc700 1 -- 172.21.15.114:0/890572812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72c690 msgr2=0x55e22a72ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:43.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.827+0000 7f0500edc700 1 --2- 172.21.15.114:0/890572812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72c690 0x55e22a72ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.827+0000 7f0500edc700 1 -- 172.21.15.114:0/890572812 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e22a6383f0 con 0x55e22a72cfb0 2023-10-18T14:08:43.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.827+0000 7f0500edc700 1 --2- 172.21.15.114:0/890572812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72cfb0 0x55e22a730bc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0ca9b0 tx=0x7f04ec099c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=def1c13127c1a1fc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:43.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.827+0000 7f04e77fe700 1 -- 172.21.15.114:0/890572812 <== mon.2 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec09e390 con 0x55e22a72cfb0 2023-10-18T14:08:43.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.827+0000 7f04e77fe700 1 -- 172.21.15.114:0/890572812 <== mon.2 v2:172.21.15.158:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04ec0a25d0 con 0x55e22a72cfb0 2023-10-18T14:08:43.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.827+0000 7f04e77fe700 1 -- 172.21.15.114:0/890572812 <== mon.2 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec099730 con 0x55e22a72cfb0 2023-10-18T14:08:43.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 -- 172.21.15.114:0/890572812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72cfb0 msgr2=0x55e22a730bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:43.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/890572812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72cfb0 0x55e22a730bc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0ca9b0 tx=0x7f04ec099c90 comp rx=0 tx=0).stop 2023-10-18T14:08:43.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 -- 172.21.15.114:0/890572812 shutdown_connections 2023-10-18T14:08:43.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/890572812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a731100 0x55e22a731560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/890572812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72c690 0x55e22a72ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/890572812 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72cfb0 0x55e22a730bc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 -- 172.21.15.114:0/890572812 >> 172.21.15.114:0/890572812 conn(0x55e22a69c720 msgr2=0x55e22a722b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:43.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 -- 172.21.15.114:0/890572812 shutdown_connections 2023-10-18T14:08:43.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 -- 172.21.15.114:0/890572812 wait complete. 2023-10-18T14:08:43.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 -- start start 2023-10-18T14:08:43.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 Processor -- start 2023-10-18T14:08:43.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72c690 0x55e22a735d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72cfb0 0x55e22a736240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a731100 0x55e22a736780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22a67ae70 con 0x55e22a72cfb0 2023-10-18T14:08:43.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22a617710 con 0x55e22a72c690 2023-10-18T14:08:43.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.828+0000 7f050fb2ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22a6173b0 con 0x55e22a731100 2023-10-18T14:08:43.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f050fb2ab80 10 client.0 _ll_register_callbacks cb 0x55e22a561a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:08:43.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f05016dd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72c690 0x55e22a735d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f0500edc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72cfb0 0x55e22a736240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f05016dd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72c690 0x55e22a735d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.114:42618/0 (socket says 172.21.15.114:42618) 2023-10-18T14:08:43.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f05016dd700 1 -- 172.21.15.114:0/2361783102 learned_addr learned my addr 172.21.15.114:0/2361783102 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:43.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f0501ede700 1 --2- 172.21.15.114:0/2361783102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a731100 0x55e22a736780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f0500edc700 1 -- 172.21.15.114:0/2361783102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a731100 msgr2=0x55e22a736780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:43.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f0500edc700 1 --2- 172.21.15.114:0/2361783102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a731100 0x55e22a736780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f0500edc700 1 -- 172.21.15.114:0/2361783102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72c690 msgr2=0x55e22a735d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:43.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f0500edc700 1 --2- 172.21.15.114:0/2361783102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72c690 0x55e22a735d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f0500edc700 1 -- 172.21.15.114:0/2361783102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc1a38d0 con 0x55e22a72cfb0 2023-10-18T14:08:43.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f05016dd700 1 --2- 172.21.15.114:0/2361783102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72c690 0x55e22a735d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:08:43.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f0500edc700 1 --2- 172.21.15.114:0/2361783102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72cfb0 0x55e22a736240 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0ca9e0 tx=0x7f04ec010ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc27a4e52ce3a7b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:43.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f04e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:08:43.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f04e4ff9700 1 -- 172.21.15.114:0/2361783102 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec099730 con 0x55e22a72cfb0 2023-10-18T14:08:43.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f04e4ff9700 1 -- 172.21.15.114:0/2361783102 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f04ec099890 con 0x55e22a72cfb0 2023-10-18T14:08:43.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f050fb2ab80 1 -- 172.21.15.114:0/2361783102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e22a67fef0 con 0x55e22a72cfb0 2023-10-18T14:08:43.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f04e4ff9700 1 -- 172.21.15.114:0/2361783102 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04ec0a2140 con 0x55e22a72cfb0 2023-10-18T14:08:43.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f050fb2ab80 10 client.16596 fetch_fsmap learned FSMap version 40 2023-10-18T14:08:43.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f050fb2ab80 1 -- 172.21.15.114:0/2361783102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55e22a4a5de0 con 0x55e22a72cfb0 2023-10-18T14:08:43.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.829+0000 7f04e4ff9700 1 -- 172.21.15.114:0/2361783102 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e22a67fef0 con 0x55e22a72cfb0 2023-10-18T14:08:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.830+0000 7f04e4ff9700 1 -- 172.21.15.114:0/2361783102 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 40) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f04ec0991a0 con 0x55e22a72cfb0 2023-10-18T14:08:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.830+0000 7f050fb2ab80 10 client.16596 fetch_fsmap finished waiting for FSMap version 40 2023-10-18T14:08:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.830+0000 7f050fb2ab80 10 client.16596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:08:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.830+0000 7f050fb2ab80 20 client.16596 populate_metadata read hostname 'smithi114' 2023-10-18T14:08:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.830+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/2361783102 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e22a745ed0 0x55e22a7482f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.830+0000 7f050fb2ab80 4 client.16596 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:08:43.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.830+0000 7f050fb2ab80 1 -- 172.21.15.114:0/2361783102 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e22a6f78b0 con 0x55e22a745ed0 2023-10-18T14:08:43.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.830+0000 7f05016dd700 1 --2- 172.21.15.114:0/2361783102 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e22a745ed0 0x55e22a7482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.830+0000 7f04e4ff9700 10 client.16596 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:43.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.830+0000 7f05016dd700 1 --2- 172.21.15.114:0/2361783102 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e22a745ed0 0x55e22a7482f0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87b5f3ded665b090 server_cookie=c87de91262ad34fe in_seq=0 out_seq=0 2023-10-18T14:08:43.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f04e4ff9700 1 -- 172.21.15.114:0/2361783102 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e22a6f78b0 con 0x55e22a745ed0 2023-10-18T14:08:43.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f04e4ff9700 10 client.16596 handle_command_reply: tid=0 2023-10-18T14:08:43.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f050fb2ab80 1 client.16596 shutdown 2023-10-18T14:08:43.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f050fb2ab80 1 -- 172.21.15.114:0/2361783102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72cfb0 msgr2=0x55e22a736240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:43.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/2361783102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72cfb0 0x55e22a736240 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0ca9e0 tx=0x7f04ec010ba0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f050fb2ab80 1 -- 172.21.15.114:0/2361783102 shutdown_connections 2023-10-18T14:08:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/2361783102 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e22a745ed0 0x55e22a7482f0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/2361783102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a731100 0x55e22a736780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f04e4ff9700 0 client.16596 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/2361783102 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72c690 0x55e22a735d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/2361783102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72cfb0 0x55e22a736240 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f050fb2ab80 1 -- 172.21.15.114:0/2361783102 >> 172.21.15.114:0/2361783102 conn(0x55e22a69c720 msgr2=0x55e22a727080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:43.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f050fb2ab80 1 -- 172.21.15.114:0/2361783102 shutdown_connections 2023-10-18T14:08:43.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f050fb2ab80 1 -- 172.21.15.114:0/2361783102 wait complete. 2023-10-18T14:08:43.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.831+0000 7f050fb2ab80 20 client.16596 trim_cache size 0 max 16384 2023-10-18T14:08:43.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.848+0000 7f050fb2ab80 1 Processor -- start 2023-10-18T14:08:43.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f050fb2ab80 1 -- start start 2023-10-18T14:08:43.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f050fb2ab80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72c690 0x55e22a72eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f050fb2ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a72cfb0 0x55e22a7324f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f050fb2ab80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a731100 0x55e22a72f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f050fb2ab80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22a71daf0 con 0x55e22a72c690 2023-10-18T14:08:43.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f050fb2ab80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22a4fb920 con 0x55e22a731100 2023-10-18T14:08:43.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f050fb2ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22a739070 con 0x55e22a72cfb0 2023-10-18T14:08:43.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f05016dd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72c690 0x55e22a72eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f05016dd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72c690 0x55e22a72eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46482/0 (socket says 172.21.15.114:46482) 2023-10-18T14:08:43.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f05016dd700 1 -- 172.21.15.114:0/3166849173 learned_addr learned my addr 172.21.15.114:0/3166849173 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:43.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f0500edc700 1 --2- 172.21.15.114:0/3166849173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a72cfb0 0x55e22a7324f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f0501ede700 1 --2- 172.21.15.114:0/3166849173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a731100 0x55e22a72f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f05016dd700 1 -- 172.21.15.114:0/3166849173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a72cfb0 msgr2=0x55e22a7324f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:43.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f05016dd700 1 --2- 172.21.15.114:0/3166849173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a72cfb0 0x55e22a7324f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f05016dd700 1 -- 172.21.15.114:0/3166849173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a731100 msgr2=0x55e22a72f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f05016dd700 1 --2- 172.21.15.114:0/3166849173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a731100 0x55e22a72f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f05016dd700 1 -- 172.21.15.114:0/3166849173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e22a48ec60 con 0x55e22a72c690 2023-10-18T14:08:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f0501ede700 1 --2- 172.21.15.114:0/3166849173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a731100 0x55e22a72f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:08:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f0500edc700 1 --2- 172.21.15.114:0/3166849173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a72cfb0 0x55e22a7324f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:08:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f05016dd700 1 --2- 172.21.15.114:0/3166849173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72c690 0x55e22a72eb30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b6c0 tx=0x7f04f8023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d660235729ec63e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f04e7fff700 1 -- 172.21.15.114:0/3166849173 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8036e90 con 0x55e22a72c690 2023-10-18T14:08:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f04e7fff700 1 -- 172.21.15.114:0/3166849173 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04f801e040 con 0x55e22a72c690 2023-10-18T14:08:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.849+0000 7f04e7fff700 1 -- 172.21.15.114:0/3166849173 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800f460 con 0x55e22a72c690 2023-10-18T14:08:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.850+0000 7f050fb2ab80 1 -- 172.21.15.114:0/3166849173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72c690 msgr2=0x55e22a72eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:43.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.850+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/3166849173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72c690 0x55e22a72eb30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b6c0 tx=0x7f04f8023000 comp rx=0 tx=0).stop 2023-10-18T14:08:43.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.850+0000 7f050fb2ab80 1 -- 172.21.15.114:0/3166849173 shutdown_connections 2023-10-18T14:08:43.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.850+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/3166849173 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a731100 0x55e22a72f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.850+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/3166849173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a72c690 0x55e22a72eb30 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.850+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/3166849173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a72cfb0 0x55e22a7324f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.850+0000 7f050fb2ab80 1 -- 172.21.15.114:0/3166849173 >> 172.21.15.114:0/3166849173 conn(0x55e22a69c720 msgr2=0x55e22a722810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:43.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.850+0000 7f050fb2ab80 1 -- 172.21.15.114:0/3166849173 shutdown_connections 2023-10-18T14:08:43.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.850+0000 7f050fb2ab80 1 -- 172.21.15.114:0/3166849173 wait complete. 2023-10-18T14:08:43.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.850+0000 7f050fb2ab80 1 -- start start 2023-10-18T14:08:43.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.850+0000 7f050fb2ab80 1 Processor -- start 2023-10-18T14:08:43.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f050fb2ab80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72c690 0x55e22a72e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f050fb2ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a72cfb0 0x55e22a7314e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f050fb2ab80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a731100 0x55e22a731a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f050fb2ab80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22a73d510 con 0x55e22a731100 2023-10-18T14:08:43.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f050fb2ab80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22a73d680 con 0x55e22a72c690 2023-10-18T14:08:43.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f050fb2ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22a73d840 con 0x55e22a72cfb0 2023-10-18T14:08:43.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f050fb2ab80 10 client.0 _ll_register_callbacks cb 0x55e22a561a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:08:43.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f0501ede700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a731100 0x55e22a731a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f0500edc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a72cfb0 0x55e22a7314e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f0501ede700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a731100 0x55e22a731a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46492/0 (socket says 172.21.15.114:46492) 2023-10-18T14:08:43.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f05016dd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72c690 0x55e22a72e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f0501ede700 1 -- 172.21.15.114:0/834109253 learned_addr learned my addr 172.21.15.114:0/834109253 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:08:43.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f0501ede700 1 -- 172.21.15.114:0/834109253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a72cfb0 msgr2=0x55e22a7314e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:43.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f0501ede700 1 --2- 172.21.15.114:0/834109253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a72cfb0 0x55e22a7314e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f0501ede700 1 -- 172.21.15.114:0/834109253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72c690 msgr2=0x55e22a72e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:08:43.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f0501ede700 1 --2- 172.21.15.114:0/834109253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72c690 0x55e22a72e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f0501ede700 1 -- 172.21.15.114:0/834109253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc10cd90 con 0x55e22a731100 2023-10-18T14:08:43.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f05016dd700 1 --2- 172.21.15.114:0/834109253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72c690 0x55e22a72e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T14:08:43.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f0501ede700 1 --2- 172.21.15.114:0/834109253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a731100 0x55e22a731a20 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f04f4018b70 tx=0x7f04f4018ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348cfc6655ea2255 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:08:43.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.851+0000 7f04e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:08:43.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f04e4ff9700 1 -- 172.21.15.114:0/834109253 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4009b50 con 0x55e22a731100 2023-10-18T14:08:43.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f04e4ff9700 1 -- 172.21.15.114:0/834109253 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f04f4007990 con 0x55e22a731100 2023-10-18T14:08:43.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f050fb2ab80 1 -- 172.21.15.114:0/834109253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04ec0a25d0 con 0x55e22a731100 2023-10-18T14:08:43.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f04e4ff9700 1 -- 172.21.15.114:0/834109253 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04f4007b90 con 0x55e22a731100 2023-10-18T14:08:43.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f050fb2ab80 10 client.16602 fetch_fsmap learned FSMap version 40 2023-10-18T14:08:43.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f050fb2ab80 1 -- 172.21.15.114:0/834109253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55e22a4cc250 con 0x55e22a731100 2023-10-18T14:08:43.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f04e4ff9700 1 -- 172.21.15.114:0/834109253 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04f402e020 con 0x55e22a731100 2023-10-18T14:08:43.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f04e4ff9700 1 -- 172.21.15.114:0/834109253 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 40) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f04f40203f0 con 0x55e22a731100 2023-10-18T14:08:43.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f050fb2ab80 10 client.16602 fetch_fsmap finished waiting for FSMap version 40 2023-10-18T14:08:43.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f050fb2ab80 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:08:43.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f050fb2ab80 20 client.16602 populate_metadata read hostname 'smithi114' 2023-10-18T14:08:43.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/834109253 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e22a79af50 0x55e22a79d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:08:43.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f050fb2ab80 4 client.16602 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:08:43.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f050fb2ab80 1 -- 172.21.15.114:0/834109253 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e22a673e50 con 0x55e22a79af50 2023-10-18T14:08:43.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.852+0000 7f05016dd700 1 --2- 172.21.15.114:0/834109253 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e22a79af50 0x55e22a79d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:08:43.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f04e4ff9700 10 client.16602 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:43.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f05016dd700 1 --2- 172.21.15.114:0/834109253 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e22a79af50 0x55e22a79d370 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a64cbdc4d74d2012 server_cookie=d2a10077c5caf33b in_seq=0 out_seq=0 2023-10-18T14:08:43.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f04e4ff9700 1 -- 172.21.15.114:0/834109253 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e22a673e50 con 0x55e22a79af50 2023-10-18T14:08:43.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f04e4ff9700 10 client.16602 handle_command_reply: tid=0 2023-10-18T14:08:43.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f050fb2ab80 1 client.16602 shutdown 2023-10-18T14:08:43.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f050fb2ab80 1 -- 172.21.15.114:0/834109253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a731100 msgr2=0x55e22a731a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:43.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/834109253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a731100 0x55e22a731a20 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f04f4018b70 tx=0x7f04f4018ba0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f050fb2ab80 1 -- 172.21.15.114:0/834109253 shutdown_connections 2023-10-18T14:08:43.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/834109253 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55e22a79af50 0x55e22a79d370 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/834109253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e22a731100 0x55e22a731a20 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/834109253 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55e22a72c690 0x55e22a72e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f050fb2ab80 1 --2- 172.21.15.114:0/834109253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e22a72cfb0 0x55e22a7314e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f04e4ff9700 0 client.16602 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:08:43.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f050fb2ab80 1 -- 172.21.15.114:0/834109253 >> 172.21.15.114:0/834109253 conn(0x55e22a69c720 msgr2=0x55e22a72f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:43.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f050fb2ab80 1 -- 172.21.15.114:0/834109253 shutdown_connections 2023-10-18T14:08:43.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f050fb2ab80 1 -- 172.21.15.114:0/834109253 wait complete. 2023-10-18T14:08:43.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.853+0000 7f050fb2ab80 20 client.16602 trim_cache size 0 max 16384 2023-10-18T14:08:43.880 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:08:43.880 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-18T14:08:43.880 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": { 2023-10-18T14:08:43.880 INFO:teuthology.orchestra.run.smithi114.stdout: "94d18228-30fd-45a0-94d1-b2bec5a6db1a": { 2023-10-18T14:08:43.881 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/", 2023-10-18T14:08:43.881 INFO:teuthology.orchestra.run.smithi114.stdout: "tag": "94d18228-30fd-45a0-94d1-b2bec5a6db1a", 2023-10-18T14:08:43.881 INFO:teuthology.orchestra.run.smithi114.stdout: "options": "recursive,force" 2023-10-18T14:08:43.881 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:08:43.881 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:08:43.882 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:08:43.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.854+0000 7f0503941700 1 -- 172.21.15.114:0/778151420 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f04e80a1670 msgr2=0x7f04e80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:43.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.854+0000 7f0503941700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f04e80a1670 0x7f04e80a3b30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f04f80098e0 tx=0x7f04f8005960 comp rx=0 tx=0).stop 2023-10-18T14:08:43.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.854+0000 7f0503941700 1 -- 172.21.15.114:0/778151420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc100000 msgr2=0x7f04fc197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:08:43.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.854+0000 7f0503941700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc100000 0x7f04fc197ed0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00e9a0 tx=0x7f04ec00ecb0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.854+0000 7f0503941700 1 -- 172.21.15.114:0/778151420 shutdown_connections 2023-10-18T14:08:43.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.854+0000 7f0503941700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f04e80a1670 0x7f04e80a3b30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.854+0000 7f0503941700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f04fc1056e0 0x7f04fc1a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.854+0000 7f0503941700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc0ff640 0x7f04fc197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.854+0000 7f0503941700 1 --2- 172.21.15.114:0/778151420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc100000 0x7f04fc197ed0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:08:43.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.854+0000 7f0503941700 1 -- 172.21.15.114:0/778151420 >> 172.21.15.114:0/778151420 conn(0x7f04fc0767f0 msgr2=0x7f04fc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:08:43.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.854+0000 7f0503941700 1 -- 172.21.15.114:0/778151420 shutdown_connections 2023-10-18T14:08:43.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:08:43.854+0000 7f0503941700 1 -- 172.21.15.114:0/778151420 wait complete. 2023-10-18T14:08:43.885 INFO:tasks.cephfs.filesystem:scrub status for tag:94d18228-30fd-45a0-94d1-b2bec5a6db1a - {'path': '/', 'tag': '94d18228-30fd-45a0-94d1-b2bec5a6db1a', 'options': 'recursive,force'} 2023-10-18T14:08:44.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:43 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:08:44.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:43 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:08:44.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:43 smithi158 ceph-mon[103317]: scrub summary: active paths [/] 2023-10-18T14:08:44.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:43 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:08:44.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:43 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:08:44.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:43 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:08:44.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:43 smithi172 ceph-mon[103574]: scrub summary: active paths [/] 2023-10-18T14:08:44.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:43 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:08:44.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:43 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:08:44.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:43 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:08:44.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:43 smithi114 ceph-mon[99494]: scrub summary: active paths [/] 2023-10-18T14:08:44.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:43 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:08:45.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:44 smithi158 ceph-mon[103317]: pgmap v422: 97 pgs: 97 active+clean; 94 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.3 MiB/s wr, 711 op/s 2023-10-18T14:08:45.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:44 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:45.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:44 smithi172 ceph-mon[103574]: pgmap v422: 97 pgs: 97 active+clean; 94 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.3 MiB/s wr, 711 op/s 2023-10-18T14:08:45.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:44 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:45.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:44 smithi114 ceph-mon[99494]: pgmap v422: 97 pgs: 97 active+clean; 94 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.3 MiB/s wr, 711 op/s 2023-10-18T14:08:45.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:44 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:45.986 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2023-10-18T14:08:45.986 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-18T14:08:46.010 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:45 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:46.010 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:45 smithi114 ceph-mon[99494]: scrub summary: idle+waiting paths [/] 2023-10-18T14:08:46.010 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:45 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:08:46.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:45 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:46.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:45 smithi158 ceph-mon[103317]: scrub summary: idle+waiting paths [/] 2023-10-18T14:08:46.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:45 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:08:46.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:45 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:46.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:45 smithi172 ceph-mon[103574]: scrub summary: idle+waiting paths [/] 2023-10-18T14:08:46.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:45 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:08:46.241 DEBUG:teuthology.parallel:result is None 2023-10-18T14:08:46.242 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-18T14:08:46.323 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-18T14:08:46.324 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-10-18T14:08:46.344 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T14:08:46.374 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-10-18T14:08:46.403 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-10-18T14:08:46.403 INFO:teuthology.task.exec:Executing custom commands... 2023-10-18T14:08:46.404 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T14:08:46.404 DEBUG:teuthology.orchestra.run.smithi114:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-10-18T14:08:46.443 DEBUG:teuthology.orchestra.run.smithi114:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-10-18T14:08:47.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:46 smithi158 ceph-mon[103317]: pgmap v423: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.9 MiB/s wr, 555 op/s 2023-10-18T14:08:47.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:46 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:47.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:46 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:08:47.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:46 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:08:47.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:46 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:08:47.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:46 smithi172 ceph-mon[103574]: pgmap v423: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.9 MiB/s wr, 555 op/s 2023-10-18T14:08:47.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:46 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:47.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:46 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:08:47.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:46 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:08:47.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:46 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:08:47.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:46 smithi114 ceph-mon[99494]: pgmap v423: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.9 MiB/s wr, 555 op/s 2023-10-18T14:08:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:46 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:46 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:08:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:46 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:08:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:46 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:08:48.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:47 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:48.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:47 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:48.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:47 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:49.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:48 smithi158 ceph-mon[103317]: pgmap v424: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 420 op/s 2023-10-18T14:08:49.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:48 smithi172 ceph-mon[103574]: pgmap v424: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 420 op/s 2023-10-18T14:08:49.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:48 smithi114 ceph-mon[99494]: pgmap v424: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 420 op/s 2023-10-18T14:08:51.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:50 smithi158 ceph-mon[103317]: pgmap v425: 97 pgs: 97 active+clean; 101 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.9 MiB/s wr, 455 op/s 2023-10-18T14:08:51.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:50 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:51.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:50 smithi172 ceph-mon[103574]: pgmap v425: 97 pgs: 97 active+clean; 101 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.9 MiB/s wr, 455 op/s 2023-10-18T14:08:51.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:50 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:51.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:50 smithi114 ceph-mon[99494]: pgmap v425: 97 pgs: 97 active+clean; 101 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.9 MiB/s wr, 455 op/s 2023-10-18T14:08:51.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:50 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:08:53.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:52 smithi158 ceph-mon[103317]: pgmap v426: 97 pgs: 97 active+clean; 101 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 341 op/s 2023-10-18T14:08:53.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:52 smithi172 ceph-mon[103574]: pgmap v426: 97 pgs: 97 active+clean; 101 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 341 op/s 2023-10-18T14:08:53.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:52 smithi114 ceph-mon[99494]: pgmap v426: 97 pgs: 97 active+clean; 101 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 341 op/s 2023-10-18T14:08:54.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:54 smithi158 ceph-mon[103317]: pgmap v427: 97 pgs: 97 active+clean; 101 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 324 op/s 2023-10-18T14:08:54.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:54 smithi172 ceph-mon[103574]: pgmap v427: 97 pgs: 97 active+clean; 101 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 324 op/s 2023-10-18T14:08:54.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:54 smithi114 ceph-mon[99494]: pgmap v427: 97 pgs: 97 active+clean; 101 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 324 op/s 2023-10-18T14:08:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:56 smithi158 ceph-mon[103317]: pgmap v428: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 644 KiB/s wr, 167 op/s 2023-10-18T14:08:57.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:56 smithi158 ceph-mon[103317]: scrub summary: idle 2023-10-18T14:08:57.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:56 smithi158 ceph-mon[103317]: scrub summary: idle 2023-10-18T14:08:57.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:56 smithi158 ceph-mon[103317]: scrub summary: idle 2023-10-18T14:08:57.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:56 smithi158 ceph-mon[103317]: scrub summary: idle 2023-10-18T14:08:57.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:56 smithi172 ceph-mon[103574]: pgmap v428: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 644 KiB/s wr, 167 op/s 2023-10-18T14:08:57.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:56 smithi172 ceph-mon[103574]: scrub summary: idle 2023-10-18T14:08:57.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:56 smithi172 ceph-mon[103574]: scrub summary: idle 2023-10-18T14:08:57.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:56 smithi172 ceph-mon[103574]: scrub summary: idle 2023-10-18T14:08:57.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:56 smithi172 ceph-mon[103574]: scrub summary: idle 2023-10-18T14:08:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:56 smithi114 ceph-mon[99494]: pgmap v428: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 644 KiB/s wr, 167 op/s 2023-10-18T14:08:57.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:56 smithi114 ceph-mon[99494]: scrub summary: idle 2023-10-18T14:08:57.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:56 smithi114 ceph-mon[99494]: scrub summary: idle 2023-10-18T14:08:57.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:56 smithi114 ceph-mon[99494]: scrub summary: idle 2023-10-18T14:08:57.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:56 smithi114 ceph-mon[99494]: scrub summary: idle 2023-10-18T14:08:58.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:57 smithi158 ceph-mon[103317]: scrub summary: idle 2023-10-18T14:08:58.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:57 smithi172 ceph-mon[103574]: scrub summary: idle 2023-10-18T14:08:58.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:57 smithi114 ceph-mon[99494]: scrub summary: idle 2023-10-18T14:08:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:08:58 smithi158 ceph-mon[103317]: pgmap v429: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 551 KiB/s wr, 126 op/s 2023-10-18T14:08:59.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:08:58 smithi172 ceph-mon[103574]: pgmap v429: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 551 KiB/s wr, 126 op/s 2023-10-18T14:08:59.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:08:58 smithi114 ceph-mon[99494]: pgmap v429: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 551 KiB/s wr, 126 op/s 2023-10-18T14:09:01.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:00 smithi158 ceph-mon[103317]: pgmap v430: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 427 KiB/s wr, 107 op/s 2023-10-18T14:09:01.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:00 smithi172 ceph-mon[103574]: pgmap v430: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 427 KiB/s wr, 107 op/s 2023-10-18T14:09:01.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:00 smithi114 ceph-mon[99494]: pgmap v430: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 427 KiB/s wr, 107 op/s 2023-10-18T14:09:03.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:02 smithi158 ceph-mon[103317]: pgmap v431: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 54 KiB/s wr, 37 op/s 2023-10-18T14:09:03.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:02 smithi172 ceph-mon[103574]: pgmap v431: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 54 KiB/s wr, 37 op/s 2023-10-18T14:09:03.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:02 smithi114 ceph-mon[99494]: pgmap v431: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 54 KiB/s wr, 37 op/s 2023-10-18T14:09:04.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:04 smithi158 ceph-mon[103317]: pgmap v432: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 55 KiB/s wr, 33 op/s 2023-10-18T14:09:04.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:04 smithi172 ceph-mon[103574]: pgmap v432: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 55 KiB/s wr, 33 op/s 2023-10-18T14:09:04.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:04 smithi114 ceph-mon[99494]: pgmap v432: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 55 KiB/s wr, 33 op/s 2023-10-18T14:09:07.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:06 smithi158 ceph-mon[103317]: pgmap v433: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 30 KiB/s wr, 29 op/s 2023-10-18T14:09:07.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:06 smithi172 ceph-mon[103574]: pgmap v433: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 30 KiB/s wr, 29 op/s 2023-10-18T14:09:07.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:06 smithi114 ceph-mon[99494]: pgmap v433: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 30 KiB/s wr, 29 op/s 2023-10-18T14:09:09.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:08 smithi158 ceph-mon[103317]: pgmap v434: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 26 op/s 2023-10-18T14:09:09.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:08 smithi172 ceph-mon[103574]: pgmap v434: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 26 op/s 2023-10-18T14:09:09.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:08 smithi114 ceph-mon[99494]: pgmap v434: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 26 op/s 2023-10-18T14:09:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:10 smithi158 ceph-mon[103317]: pgmap v435: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 27 op/s 2023-10-18T14:09:11.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:10 smithi172 ceph-mon[103574]: pgmap v435: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 27 op/s 2023-10-18T14:09:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:10 smithi114 ceph-mon[99494]: pgmap v435: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 27 op/s 2023-10-18T14:09:13.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:12 smithi158 ceph-mon[103317]: pgmap v436: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-10-18T14:09:13.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:12 smithi172 ceph-mon[103574]: pgmap v436: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-10-18T14:09:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:12 smithi114 ceph-mon[99494]: pgmap v436: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-10-18T14:09:13.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-18T14:09:14.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 -- 172.21.15.114:0/1047822753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc0ffd40 msgr2=0x7f06cc1039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 --2- 172.21.15.114:0/1047822753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc0ffd40 0x7f06cc1039e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009990 tx=0x7f06bc009ca0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 -- 172.21.15.114:0/1047822753 shutdown_connections 2023-10-18T14:09:14.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 --2- 172.21.15.114:0/1047822753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06cc104110 0x7f06cc10bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 --2- 172.21.15.114:0/1047822753 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06cc0ff390 0x7f06cc0ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 --2- 172.21.15.114:0/1047822753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc0ffd40 0x7f06cc1039e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 -- 172.21.15.114:0/1047822753 >> 172.21.15.114:0/1047822753 conn(0x7f06cc074890 msgr2=0x7f06cc074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:14.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 -- 172.21.15.114:0/1047822753 shutdown_connections 2023-10-18T14:09:14.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 -- 172.21.15.114:0/1047822753 wait complete. 2023-10-18T14:09:14.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 Processor -- start 2023-10-18T14:09:14.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 -- start start 2023-10-18T14:09:14.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06cc0ff390 0x7f06cc197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06cc104110 0x7f06cc197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc1984e0 0x7f06cc1a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc1a31c0 con 0x7f06cc1984e0 2023-10-18T14:09:14.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc1a3330 con 0x7f06cc104110 2023-10-18T14:09:14.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.021+0000 7f06d3f18700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc1a34f0 con 0x7f06cc0ff390 2023-10-18T14:09:14.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06d24b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc1984e0 0x7f06cc1a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06d24b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc1984e0 0x7f06cc1a2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46506/0 (socket says 172.21.15.114:46506) 2023-10-18T14:09:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06d24b5700 1 -- 172.21.15.114:0/275407054 learned_addr learned my addr 172.21.15.114:0/275407054 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06d14b3700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06cc104110 0x7f06cc197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06d1cb4700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06cc0ff390 0x7f06cc197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06d24b5700 1 -- 172.21.15.114:0/275407054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06cc0ff390 msgr2=0x7f06cc197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06d24b5700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06cc0ff390 0x7f06cc197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06d24b5700 1 -- 172.21.15.114:0/275407054 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06cc104110 msgr2=0x7f06cc197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06d24b5700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06cc104110 0x7f06cc197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06d24b5700 1 -- 172.21.15.114:0/275407054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc0095f0 con 0x7f06cc1984e0 2023-10-18T14:09:14.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06d24b5700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc1984e0 0x7f06cc1a2ae0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f06c400ef30 tx=0x7f06c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06c2ffd700 1 -- 172.21.15.114:0/275407054 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4018070 con 0x7f06cc1984e0 2023-10-18T14:09:14.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06c2ffd700 1 -- 172.21.15.114:0/275407054 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06c400f040 con 0x7f06cc1984e0 2023-10-18T14:09:14.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06c2ffd700 1 -- 172.21.15.114:0/275407054 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c400cd00 con 0x7f06cc1984e0 2023-10-18T14:09:14.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06d3f18700 1 -- 172.21.15.114:0/275407054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc1a3770 con 0x7f06cc1984e0 2023-10-18T14:09:14.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.022+0000 7f06d3f18700 1 -- 172.21.15.114:0/275407054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06cc1a3c30 con 0x7f06cc1984e0 2023-10-18T14:09:14.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.024+0000 7f06c2ffd700 1 -- 172.21.15.114:0/275407054 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f06c4003a00 con 0x7f06cc1984e0 2023-10-18T14:09:14.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.025+0000 7f06c2ffd700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f06b80a1670 0x7f06b80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.025+0000 7f06d1cb4700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f06b80a1670 0x7f06b80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.025+0000 7f06c2ffd700 1 -- 172.21.15.114:0/275407054 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f06c40ccb10 con 0x7f06cc1984e0 2023-10-18T14:09:14.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.025+0000 7f06d1cb4700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f06b80a1670 0x7f06b80a3b30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f06c8005950 tx=0x7f06c800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.026+0000 7f06e0101b80 1 Processor -- start 2023-10-18T14:09:14.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.026+0000 7f06e0101b80 1 -- start start 2023-10-18T14:09:14.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06e0101b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a1be0 0x55d3403a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06e0101b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a2500 0x55d34039c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06e0101b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 0x55d34039ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06e0101b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d34030f6e0 con 0x55d34039c5d0 2023-10-18T14:09:14.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06e0101b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3402f5c60 con 0x55d3403a2500 2023-10-18T14:09:14.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06e0101b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3402f3580 con 0x55d3403a1be0 2023-10-18T14:09:14.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06d24b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 0x55d34039ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06d24b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 0x55d34039ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46514/0 (socket says 172.21.15.114:46514) 2023-10-18T14:09:14.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06d24b5700 1 -- 172.21.15.114:0/1694315760 learned_addr learned my addr 172.21.15.114:0/1694315760 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:14.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06d1cb4700 1 --2- 172.21.15.114:0/1694315760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a1be0 0x55d3403a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06d14b3700 1 --2- 172.21.15.114:0/1694315760 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a2500 0x55d34039c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06d24b5700 1 -- 172.21.15.114:0/1694315760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a1be0 msgr2=0x55d3403a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06d24b5700 1 --2- 172.21.15.114:0/1694315760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a1be0 0x55d3403a1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06d24b5700 1 -- 172.21.15.114:0/1694315760 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a2500 msgr2=0x55d34039c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06d24b5700 1 --2- 172.21.15.114:0/1694315760 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a2500 0x55d34039c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06d24b5700 1 -- 172.21.15.114:0/1694315760 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3402ac3f0 con 0x55d34039c5d0 2023-10-18T14:09:14.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06d14b3700 1 --2- 172.21.15.114:0/1694315760 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a2500 0x55d34039c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06d24b5700 1 --2- 172.21.15.114:0/1694315760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 0x55d34039ca50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f06c40090a0 tx=0x7f06c40997c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5e0dc22a3cfd0c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06b7fff700 1 -- 172.21.15.114:0/1694315760 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c401b320 con 0x55d34039c5d0 2023-10-18T14:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06b7fff700 1 -- 172.21.15.114:0/1694315760 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06c409a300 con 0x55d34039c5d0 2023-10-18T14:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.027+0000 7f06b7fff700 1 -- 172.21.15.114:0/1694315760 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4096310 con 0x55d34039c5d0 2023-10-18T14:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.028+0000 7f06e0101b80 1 -- 172.21.15.114:0/1694315760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 msgr2=0x55d34039ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.028+0000 7f06e0101b80 1 --2- 172.21.15.114:0/1694315760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 0x55d34039ca50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f06c40090a0 tx=0x7f06c40997c0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.028+0000 7f06e0101b80 1 -- 172.21.15.114:0/1694315760 shutdown_connections 2023-10-18T14:09:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.028+0000 7f06e0101b80 1 --2- 172.21.15.114:0/1694315760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 0x55d34039ca50 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.028+0000 7f06e0101b80 1 --2- 172.21.15.114:0/1694315760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a1be0 0x55d3403a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.028+0000 7f06e0101b80 1 --2- 172.21.15.114:0/1694315760 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a2500 0x55d34039c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.028+0000 7f06e0101b80 1 -- 172.21.15.114:0/1694315760 >> 172.21.15.114:0/1694315760 conn(0x55d340310720 msgr2=0x55d340396b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.028+0000 7f06e0101b80 1 -- 172.21.15.114:0/1694315760 shutdown_connections 2023-10-18T14:09:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.028+0000 7f06e0101b80 1 -- 172.21.15.114:0/1694315760 wait complete. 2023-10-18T14:09:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06e0101b80 1 -- start start 2023-10-18T14:09:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06e0101b80 1 Processor -- start 2023-10-18T14:09:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06e0101b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d34039c5d0 0x55d3403a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06e0101b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a1be0 0x55d3403a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06e0101b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 0x55d3403a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06e0101b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3402eee70 con 0x55d3403a2500 2023-10-18T14:09:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06e0101b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d34028b710 con 0x55d34039c5d0 2023-10-18T14:09:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06e0101b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d34028b3b0 con 0x55d3403a1be0 2023-10-18T14:09:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06e0101b80 10 client.0 _ll_register_callbacks cb 0x55d3401d5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:09:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06d24b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 0x55d3403a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06d24b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 0x55d3403a62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46520/0 (socket says 172.21.15.114:46520) 2023-10-18T14:09:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06d24b5700 1 -- 172.21.15.114:0/3056436268 learned_addr learned my addr 172.21.15.114:0/3056436268 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:14.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06d14b3700 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a1be0 0x55d3403a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.029+0000 7f06d1cb4700 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d34039c5d0 0x55d3403a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06d24b5700 1 -- 172.21.15.114:0/3056436268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a1be0 msgr2=0x55d3403a5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06d24b5700 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a1be0 0x55d3403a5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06d24b5700 1 -- 172.21.15.114:0/3056436268 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d34039c5d0 msgr2=0x55d3403a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06d24b5700 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d34039c5d0 0x55d3403a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06d24b5700 1 -- 172.21.15.114:0/3056436268 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06cc1a3c30 con 0x55d3403a2500 2023-10-18T14:09:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06d14b3700 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a1be0 0x55d3403a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:09:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06d24b5700 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 0x55d3403a62f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f06c40ca390 tx=0x7f06c4004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595f1f01825e1d34 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:09:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06b57fa700 1 -- 172.21.15.114:0/3056436268 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c40b2410 con 0x55d3403a2500 2023-10-18T14:09:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06b57fa700 1 -- 172.21.15.114:0/3056436268 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f06c4099c00 con 0x55d3403a2500 2023-10-18T14:09:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06e0101b80 1 -- 172.21.15.114:0/3056436268 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d3402f3ef0 con 0x55d3403a2500 2023-10-18T14:09:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06b57fa700 1 -- 172.21.15.114:0/3056436268 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06c4099e60 con 0x55d3403a2500 2023-10-18T14:09:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06e0101b80 10 client.16614 fetch_fsmap learned FSMap version 44 2023-10-18T14:09:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06e0101b80 1 -- 172.21.15.114:0/3056436268 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55d340119de0 con 0x55d3403a2500 2023-10-18T14:09:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06b57fa700 1 -- 172.21.15.114:0/3056436268 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d3402f3ef0 con 0x55d3403a2500 2023-10-18T14:09:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06b57fa700 1 -- 172.21.15.114:0/3056436268 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 44) v1 ==== 7958+0+0 (secure 0 0 0) 0x7f06c40a1a70 con 0x55d3403a2500 2023-10-18T14:09:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06e0101b80 10 client.16614 fetch_fsmap finished waiting for FSMap version 44 2023-10-18T14:09:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06e0101b80 10 client.16614 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:09:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06e0101b80 20 client.16614 populate_metadata read hostname 'smithi114' 2023-10-18T14:09:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06e0101b80 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d3403b5bb0 0x55d3403b7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06e0101b80 4 client.16614 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:09:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.030+0000 7f06e0101b80 1 -- 172.21.15.114:0/3056436268 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d34036b8b0 con 0x55d3403b5bb0 2023-10-18T14:09:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.031+0000 7f06d1cb4700 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d3403b5bb0 0x55d3403b7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.031+0000 7f06b57fa700 10 client.16614 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:09:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.031+0000 7f06d1cb4700 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d3403b5bb0 0x55d3403b7fd0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5be3d29624db8b4 server_cookie=4f4f64ed8d9a0d1a in_seq=0 out_seq=0 2023-10-18T14:09:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06b57fa700 1 -- 172.21.15.114:0/3056436268 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d34036b8b0 con 0x55d3403b5bb0 2023-10-18T14:09:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06b57fa700 10 client.16614 handle_command_reply: tid=0 2023-10-18T14:09:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06e0101b80 1 client.16614 shutdown 2023-10-18T14:09:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06e0101b80 1 -- 172.21.15.114:0/3056436268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 msgr2=0x55d3403a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06e0101b80 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 0x55d3403a62f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f06c40ca390 tx=0x7f06c4004d30 comp rx=0 tx=0).stop 2023-10-18T14:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06e0101b80 1 -- 172.21.15.114:0/3056436268 shutdown_connections 2023-10-18T14:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06e0101b80 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d3403b5bb0 0x55d3403b7fd0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06e0101b80 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 0x55d3403a62f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06b57fa700 0 client.16614 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:09:14.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06e0101b80 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d34039c5d0 0x55d3403a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06e0101b80 1 --2- 172.21.15.114:0/3056436268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a1be0 0x55d3403a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06e0101b80 1 -- 172.21.15.114:0/3056436268 >> 172.21.15.114:0/3056436268 conn(0x55d340310720 msgr2=0x55d34039b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:14.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06e0101b80 1 -- 172.21.15.114:0/3056436268 shutdown_connections 2023-10-18T14:09:14.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06e0101b80 1 -- 172.21.15.114:0/3056436268 wait complete. 2023-10-18T14:09:14.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.032+0000 7f06e0101b80 20 client.16614 trim_cache size 0 max 16384 2023-10-18T14:09:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06e0101b80 1 Processor -- start 2023-10-18T14:09:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06e0101b80 1 -- start start 2023-10-18T14:09:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06e0101b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d34039c5d0 0x55d3403aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06e0101b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a1be0 0x55d3403a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06e0101b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 0x55d3403a6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06e0101b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d34016f920 con 0x55d3403a2500 2023-10-18T14:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06e0101b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3402f3ef0 con 0x55d3403a1be0 2023-10-18T14:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06e0101b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3403a8a30 con 0x55d34039c5d0 2023-10-18T14:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06d24b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 0x55d3403a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06d24b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 0x55d3403a6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46526/0 (socket says 172.21.15.114:46526) 2023-10-18T14:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06d24b5700 1 -- 172.21.15.114:0/494820521 learned_addr learned my addr 172.21.15.114:0/494820521 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06d1cb4700 1 --2- 172.21.15.114:0/494820521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d34039c5d0 0x55d3403aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06d14b3700 1 --2- 172.21.15.114:0/494820521 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a1be0 0x55d3403a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06d24b5700 1 -- 172.21.15.114:0/494820521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d34039c5d0 msgr2=0x55d3403aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06d24b5700 1 --2- 172.21.15.114:0/494820521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d34039c5d0 0x55d3403aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06d24b5700 1 -- 172.21.15.114:0/494820521 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a1be0 msgr2=0x55d3403a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06d24b5700 1 --2- 172.21.15.114:0/494820521 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a1be0 0x55d3403a5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06d24b5700 1 -- 172.21.15.114:0/494820521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d340102c60 con 0x55d3403a2500 2023-10-18T14:09:14.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06d24b5700 1 --2- 172.21.15.114:0/494820521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 0x55d3403a6300 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f06c4099900 tx=0x7f06c4004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25fcdb5b5f8aed5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06c0ff9700 1 -- 172.21.15.114:0/494820521 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c40a1f00 con 0x55d3403a2500 2023-10-18T14:09:14.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06c0ff9700 1 -- 172.21.15.114:0/494820521 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06c4099560 con 0x55d3403a2500 2023-10-18T14:09:14.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.049+0000 7f06c0ff9700 1 -- 172.21.15.114:0/494820521 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c40b2210 con 0x55d3403a2500 2023-10-18T14:09:14.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.050+0000 7f06e0101b80 1 -- 172.21.15.114:0/494820521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 msgr2=0x55d3403a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.050+0000 7f06e0101b80 1 --2- 172.21.15.114:0/494820521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 0x55d3403a6300 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f06c4099900 tx=0x7f06c4004dc0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.050+0000 7f06e0101b80 1 -- 172.21.15.114:0/494820521 shutdown_connections 2023-10-18T14:09:14.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.050+0000 7f06e0101b80 1 --2- 172.21.15.114:0/494820521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3403a2500 0x55d3403a6300 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.050+0000 7f06e0101b80 1 --2- 172.21.15.114:0/494820521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d34039c5d0 0x55d3403aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.050+0000 7f06e0101b80 1 --2- 172.21.15.114:0/494820521 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a1be0 0x55d3403a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.050+0000 7f06e0101b80 1 -- 172.21.15.114:0/494820521 >> 172.21.15.114:0/494820521 conn(0x55d340310720 msgr2=0x55d340396810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:14.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.050+0000 7f06e0101b80 1 -- 172.21.15.114:0/494820521 shutdown_connections 2023-10-18T14:09:14.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.050+0000 7f06e0101b80 1 -- 172.21.15.114:0/494820521 wait complete. 2023-10-18T14:09:14.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.050+0000 7f06e0101b80 1 -- start start 2023-10-18T14:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.050+0000 7f06e0101b80 1 Processor -- start 2023-10-18T14:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.050+0000 7f06e0101b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 0x55d3403acd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06e0101b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a1be0 0x55d3403ab280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06e0101b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a2500 0x55d3403ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06e0101b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3403abd00 con 0x55d34039c5d0 2023-10-18T14:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06e0101b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3403abe40 con 0x55d3403a1be0 2023-10-18T14:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06e0101b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3403abfd0 con 0x55d3403a2500 2023-10-18T14:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06e0101b80 10 client.0 _ll_register_callbacks cb 0x55d3401d5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06d1cb4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 0x55d3403acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06d1cb4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 0x55d3403acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46530/0 (socket says 172.21.15.114:46530) 2023-10-18T14:09:14.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06d1cb4700 1 -- 172.21.15.114:0/3576177191 learned_addr learned my addr 172.21.15.114:0/3576177191 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:14.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06d14b3700 1 --2- 172.21.15.114:0/3576177191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a1be0 0x55d3403ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06d24b5700 1 --2- 172.21.15.114:0/3576177191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a2500 0x55d3403ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06d1cb4700 1 -- 172.21.15.114:0/3576177191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a2500 msgr2=0x55d3403ab7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06d1cb4700 1 --2- 172.21.15.114:0/3576177191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a2500 0x55d3403ab7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06d1cb4700 1 -- 172.21.15.114:0/3576177191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a1be0 msgr2=0x55d3403ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06d1cb4700 1 --2- 172.21.15.114:0/3576177191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a1be0 0x55d3403ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06d1cb4700 1 -- 172.21.15.114:0/3576177191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d340119de0 con 0x55d34039c5d0 2023-10-18T14:09:14.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06d1cb4700 1 --2- 172.21.15.114:0/3576177191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 0x55d3403acd10 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55d3403b88a0 tx=0x7f06c80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13fae406293551e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06b57fa700 1 -- 172.21.15.114:0/3576177191 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8026450 con 0x55d34039c5d0 2023-10-18T14:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06b57fa700 1 -- 172.21.15.114:0/3576177191 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f06c8017070 con 0x55d34039c5d0 2023-10-18T14:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06e0101b80 1 -- 172.21.15.114:0/3576177191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06c409a300 con 0x55d34039c5d0 2023-10-18T14:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06b57fa700 1 -- 172.21.15.114:0/3576177191 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06c80265b0 con 0x55d34039c5d0 2023-10-18T14:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06e0101b80 10 client.16620 fetch_fsmap learned FSMap version 44 2023-10-18T14:09:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.051+0000 7f06e0101b80 1 -- 172.21.15.114:0/3576177191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55d340140250 con 0x55d34039c5d0 2023-10-18T14:09:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.052+0000 7f06b57fa700 1 -- 172.21.15.114:0/3576177191 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06c409a300 con 0x55d34039c5d0 2023-10-18T14:09:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.052+0000 7f06b57fa700 1 -- 172.21.15.114:0/3576177191 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 44) v1 ==== 7958+0+0 (secure 0 0 0) 0x7f06c8005020 con 0x55d34039c5d0 2023-10-18T14:09:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.052+0000 7f06e0101b80 10 client.16620 fetch_fsmap finished waiting for FSMap version 44 2023-10-18T14:09:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.052+0000 7f06e0101b80 10 client.16620 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:09:14.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.052+0000 7f06e0101b80 20 client.16620 populate_metadata read hostname 'smithi114' 2023-10-18T14:09:14.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.052+0000 7f06e0101b80 1 --2- 172.21.15.114:0/3576177191 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d34040f470 0x55d340411890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.052+0000 7f06e0101b80 4 client.16620 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-18T14:09:14.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.052+0000 7f06e0101b80 1 -- 172.21.15.114:0/3576177191 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d3402e7e50 con 0x55d34040f470 2023-10-18T14:09:14.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.052+0000 7f06d14b3700 1 --2- 172.21.15.114:0/3576177191 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d34040f470 0x55d340411890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.052+0000 7f06b57fa700 10 client.16620 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:09:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.052+0000 7f06d14b3700 1 --2- 172.21.15.114:0/3576177191 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d34040f470 0x55d340411890 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60862b6c8f02be1e server_cookie=53f53526bf19462 in_seq=0 out_seq=0 2023-10-18T14:09:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06b57fa700 1 -- 172.21.15.114:0/3576177191 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d3402e7e50 con 0x55d34040f470 2023-10-18T14:09:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06b57fa700 10 client.16620 handle_command_reply: tid=0 2023-10-18T14:09:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06e0101b80 1 client.16620 shutdown 2023-10-18T14:09:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06e0101b80 1 -- 172.21.15.114:0/3576177191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 msgr2=0x55d3403acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06e0101b80 1 --2- 172.21.15.114:0/3576177191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 0x55d3403acd10 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55d3403b88a0 tx=0x7f06c80047c0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06e0101b80 1 -- 172.21.15.114:0/3576177191 shutdown_connections 2023-10-18T14:09:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06e0101b80 1 --2- 172.21.15.114:0/3576177191 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x55d34040f470 0x55d340411890 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06e0101b80 1 --2- 172.21.15.114:0/3576177191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d3403a2500 0x55d3403ab7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06b57fa700 0 client.16620 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:09:14.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06e0101b80 1 --2- 172.21.15.114:0/3576177191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d34039c5d0 0x55d3403acd10 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06e0101b80 1 --2- 172.21.15.114:0/3576177191 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d3403a1be0 0x55d3403ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06e0101b80 1 -- 172.21.15.114:0/3576177191 >> 172.21.15.114:0/3576177191 conn(0x55d340310720 msgr2=0x55d3403a40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:14.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06e0101b80 1 -- 172.21.15.114:0/3576177191 shutdown_connections 2023-10-18T14:09:14.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06e0101b80 1 -- 172.21.15.114:0/3576177191 wait complete. 2023-10-18T14:09:14.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06e0101b80 20 client.16620 trim_cache size 0 max 16384 2023-10-18T14:09:14.080 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:09:14.080 INFO:teuthology.orchestra.run.smithi114.stdout: "status": "no active scrubs running", 2023-10-18T14:09:14.081 INFO:teuthology.orchestra.run.smithi114.stdout: "scrubs": {} 2023-10-18T14:09:14.081 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:09:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06d3f18700 1 -- 172.21.15.114:0/275407054 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f06b80a1670 msgr2=0x7f06b80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06d3f18700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f06b80a1670 0x7f06b80a3b30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f06c8005950 tx=0x7f06c800b410 comp rx=0 tx=0).stop 2023-10-18T14:09:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06d3f18700 1 -- 172.21.15.114:0/275407054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc1984e0 msgr2=0x7f06cc1a2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06d3f18700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc1984e0 0x7f06cc1a2ae0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f06c400ef30 tx=0x7f06c400c3a0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06d3f18700 1 -- 172.21.15.114:0/275407054 shutdown_connections 2023-10-18T14:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06d3f18700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f06b80a1670 0x7f06b80a3b30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06d3f18700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06cc1984e0 0x7f06cc1a2ae0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06d3f18700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06cc0ff390 0x7f06cc197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06d3f18700 1 --2- 172.21.15.114:0/275407054 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f06cc104110 0x7f06cc197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.053+0000 7f06d3f18700 1 -- 172.21.15.114:0/275407054 >> 172.21.15.114:0/275407054 conn(0x7f06cc074890 msgr2=0x7f06cc1029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.054+0000 7f06d3f18700 1 -- 172.21.15.114:0/275407054 shutdown_connections 2023-10-18T14:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.054+0000 7f06d3f18700 1 -- 172.21.15.114:0/275407054 wait complete. 2023-10-18T14:09:14.085 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-18T14:09:14.085 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:09:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.203+0000 7fbefe9fa700 1 -- 172.21.15.114:0/3830233826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbef81066c0 msgr2=0x7fbef8106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.203+0000 7fbefe9fa700 1 --2- 172.21.15.114:0/3830233826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbef81066c0 0x7fbef8106aa0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009990 tx=0x7fbee8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.203+0000 7fbefe9fa700 1 -- 172.21.15.114:0/3830233826 shutdown_connections 2023-10-18T14:09:14.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.203+0000 7fbefe9fa700 1 --2- 172.21.15.114:0/3830233826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef8067fa0 0x7fbef810d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.203+0000 7fbefe9fa700 1 --2- 172.21.15.114:0/3830233826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbef81066c0 0x7fbef8106aa0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.203+0000 7fbefe9fa700 1 --2- 172.21.15.114:0/3830233826 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbef8106fe0 0x7fbef8067870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.203+0000 7fbefe9fa700 1 -- 172.21.15.114:0/3830233826 >> 172.21.15.114:0/3830233826 conn(0x7fbef8076400 msgr2=0x7fbef8076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:14.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.203+0000 7fbefe9fa700 1 -- 172.21.15.114:0/3830233826 shutdown_connections 2023-10-18T14:09:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.203+0000 7fbefe9fa700 1 -- 172.21.15.114:0/3830233826 wait complete. 2023-10-18T14:09:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.204+0000 7fbefe9fa700 1 Processor -- start 2023-10-18T14:09:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.204+0000 7fbefe9fa700 1 -- start start 2023-10-18T14:09:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.204+0000 7fbefe9fa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef8067fa0 0x7fbef80ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.204+0000 7fbefe9fa700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbef81066c0 0x7fbef80ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.204+0000 7fbefe9fa700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbef8106fe0 0x7fbef8100420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.204+0000 7fbefe9fa700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef81a4ee0 con 0x7fbef81066c0 2023-10-18T14:09:14.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.204+0000 7fbefe9fa700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef81a5050 con 0x7fbef8106fe0 2023-10-18T14:09:14.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.204+0000 7fbefe9fa700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef81a5210 con 0x7fbef8067fa0 2023-10-18T14:09:14.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.204+0000 7fbef77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbef81066c0 0x7fbef80ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.204+0000 7fbef77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbef81066c0 0x7fbef80ffee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46546/0 (socket says 172.21.15.114:46546) 2023-10-18T14:09:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.204+0000 7fbef77fe700 1 -- 172.21.15.114:0/283902190 learned_addr learned my addr 172.21.15.114:0/283902190 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.204+0000 7fbefcf97700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbef8106fe0 0x7fbef8100420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.204+0000 7fbef7fff700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef8067fa0 0x7fbef80ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.205+0000 7fbef77fe700 1 -- 172.21.15.114:0/283902190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef8067fa0 msgr2=0x7fbef80ff9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.205+0000 7fbef77fe700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef8067fa0 0x7fbef80ff9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.205+0000 7fbef77fe700 1 -- 172.21.15.114:0/283902190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbef8106fe0 msgr2=0x7fbef8100420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.205+0000 7fbef77fe700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbef8106fe0 0x7fbef8100420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.205+0000 7fbef77fe700 1 -- 172.21.15.114:0/283902190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee80095f0 con 0x7fbef81066c0 2023-10-18T14:09:14.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.205+0000 7fbef7fff700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef8067fa0 0x7fbef80ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:09:14.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.205+0000 7fbef77fe700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbef81066c0 0x7fbef80ffee0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbee000d980 tx=0x7fbee000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.205+0000 7fbef57fa700 1 -- 172.21.15.114:0/283902190 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0009930 con 0x7fbef81066c0 2023-10-18T14:09:14.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.205+0000 7fbef57fa700 1 -- 172.21.15.114:0/283902190 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbee0010460 con 0x7fbef81066c0 2023-10-18T14:09:14.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.205+0000 7fbefe9fa700 1 -- 172.21.15.114:0/283902190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef81a54f0 con 0x7fbef81066c0 2023-10-18T14:09:14.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.205+0000 7fbef57fa700 1 -- 172.21.15.114:0/283902190 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee000f620 con 0x7fbef81066c0 2023-10-18T14:09:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.205+0000 7fbefe9fa700 1 -- 172.21.15.114:0/283902190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef81a5a00 con 0x7fbef81066c0 2023-10-18T14:09:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.206+0000 7fbefe9fa700 1 -- 172.21.15.114:0/283902190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef8108c10 con 0x7fbef81066c0 2023-10-18T14:09:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.207+0000 7fbef57fa700 1 -- 172.21.15.114:0/283902190 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fbee00108d0 con 0x7fbef81066c0 2023-10-18T14:09:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.208+0000 7fbef57fa700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbee40a15f0 0x7fbee40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.208+0000 7fbef7fff700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbee40a15f0 0x7fbee40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.208+0000 7fbef57fa700 1 -- 172.21.15.114:0/283902190 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fbee00ccaa0 con 0x7fbef81066c0 2023-10-18T14:09:14.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.208+0000 7fbef7fff700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbee40a15f0 0x7fbee40a3ab0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbee8006010 tx=0x7fbee801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.213+0000 7fbef57fa700 1 -- 172.21.15.114:0/283902190 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbee0095e40 con 0x7fbef81066c0 2023-10-18T14:09:14.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.453+0000 7fbefe9fa700 1 -- 172.21.15.114:0/283902190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbef8101de0 con 0x7fbef81066c0 2023-10-18T14:09:14.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.454+0000 7fbef57fa700 1 -- 172.21.15.114:0/283902190 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+11427 (secure 0 0 0) 0x7fbee0020090 con 0x7fbef81066c0 2023-10-18T14:09:14.458 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:09:14.458 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":44,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:08:48.949224+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":52,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_16344":{"gid":16344,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1399361838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1399361838},{"type":"v1","addr":"172.21.15.172:6833","nonce":1399361838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":51,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":54,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":54,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:09:14.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.456+0000 7fbefe9fa700 1 -- 172.21.15.114:0/283902190 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbee40a15f0 msgr2=0x7fbee40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.456+0000 7fbefe9fa700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbee40a15f0 0x7fbee40a3ab0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbee8006010 tx=0x7fbee801a040 comp rx=0 tx=0).stop 2023-10-18T14:09:14.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.456+0000 7fbefe9fa700 1 -- 172.21.15.114:0/283902190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbef81066c0 msgr2=0x7fbef80ffee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.456+0000 7fbefe9fa700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbef81066c0 0x7fbef80ffee0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbee000d980 tx=0x7fbee000dc90 comp rx=0 tx=0).stop 2023-10-18T14:09:14.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.456+0000 7fbefe9fa700 1 -- 172.21.15.114:0/283902190 shutdown_connections 2023-10-18T14:09:14.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.456+0000 7fbefe9fa700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fbee40a15f0 0x7fbee40a3ab0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.456+0000 7fbefe9fa700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbef8106fe0 0x7fbef8100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.456+0000 7fbefe9fa700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef8067fa0 0x7fbef80ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.456+0000 7fbefe9fa700 1 --2- 172.21.15.114:0/283902190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbef81066c0 0x7fbef80ffee0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.456+0000 7fbefe9fa700 1 -- 172.21.15.114:0/283902190 >> 172.21.15.114:0/283902190 conn(0x7fbef8076400 msgr2=0x7fbef80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:14.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.456+0000 7fbefe9fa700 1 -- 172.21.15.114:0/283902190 shutdown_connections 2023-10-18T14:09:14.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.456+0000 7fbefe9fa700 1 -- 172.21.15.114:0/283902190 wait complete. 2023-10-18T14:09:14.463 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 44 2023-10-18T14:09:14.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-18T14:09:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.592+0000 7f70a5f17700 1 -- 172.21.15.114:0/1814093560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70a0106860 msgr2=0x7f70a0106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.592+0000 7f70a5f17700 1 --2- 172.21.15.114:0/1814093560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70a0106860 0x7f70a0106c40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7094009990 tx=0x7f7094009ca0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.592+0000 7f70a5f17700 1 -- 172.21.15.114:0/1814093560 shutdown_connections 2023-10-18T14:09:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.592+0000 7f70a5f17700 1 --2- 172.21.15.114:0/1814093560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70a00ffae0 0x7f70a010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.592+0000 7f70a5f17700 1 --2- 172.21.15.114:0/1814093560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70a0106860 0x7f70a0106c40 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.592+0000 7f70a5f17700 1 --2- 172.21.15.114:0/1814093560 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70a00ff120 0x7f70a00ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.592+0000 7f70a5f17700 1 -- 172.21.15.114:0/1814093560 >> 172.21.15.114:0/1814093560 conn(0x7f70a0074890 msgr2=0x7f70a0074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.592+0000 7f70a5f17700 1 -- 172.21.15.114:0/1814093560 shutdown_connections 2023-10-18T14:09:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.592+0000 7f70a5f17700 1 -- 172.21.15.114:0/1814093560 wait complete. 2023-10-18T14:09:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.592+0000 7f70a5f17700 1 Processor -- start 2023-10-18T14:09:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.592+0000 7f70a5f17700 1 -- start start 2023-10-18T14:09:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f70a5f17700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70a00ff120 0x7f70a0100300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f70a5f17700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70a00ffae0 0x7f70a0100840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f70a5f17700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70a0106860 0x7f70a0100d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f70a5f17700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a01a4f70 con 0x7f70a00ff120 2023-10-18T14:09:14.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f70a5f17700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a01a50e0 con 0x7f70a00ffae0 2023-10-18T14:09:14.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f70a5f17700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a01a52a0 con 0x7f70a0106860 2023-10-18T14:09:14.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70a00ff120 0x7f70a0100300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70a00ff120 0x7f70a0100300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46558/0 (socket says 172.21.15.114:46558) 2023-10-18T14:09:14.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709f7fe700 1 -- 172.21.15.114:0/3498076653 learned_addr learned my addr 172.21.15.114:0/3498076653 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:14.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709ffff700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70a0106860 0x7f70a0100d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709effd700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70a00ffae0 0x7f70a0100840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709f7fe700 1 -- 172.21.15.114:0/3498076653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70a0106860 msgr2=0x7f70a0100d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709f7fe700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70a0106860 0x7f70a0100d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709f7fe700 1 -- 172.21.15.114:0/3498076653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70a00ffae0 msgr2=0x7f70a0100840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709f7fe700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70a00ffae0 0x7f70a0100840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709f7fe700 1 -- 172.21.15.114:0/3498076653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70940095f0 con 0x7f70a00ff120 2023-10-18T14:09:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709effd700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70a00ffae0 0x7f70a0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:09:14.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709f7fe700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70a00ff120 0x7f70a0100300 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7094004760 tx=0x7f7094004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709cff9700 1 -- 172.21.15.114:0/3498076653 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709401d070 con 0x7f70a00ff120 2023-10-18T14:09:14.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709cff9700 1 -- 172.21.15.114:0/3498076653 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f709400fc70 con 0x7f70a00ff120 2023-10-18T14:09:14.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f70a5f17700 1 -- 172.21.15.114:0/3498076653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a01a5520 con 0x7f70a00ff120 2023-10-18T14:09:14.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f709cff9700 1 -- 172.21.15.114:0/3498076653 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094022e40 con 0x7f70a00ff120 2023-10-18T14:09:14.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.593+0000 7f70a5f17700 1 -- 172.21.15.114:0/3498076653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a01a5940 con 0x7f70a00ff120 2023-10-18T14:09:14.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.595+0000 7f709cff9700 1 -- 172.21.15.114:0/3498076653 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f7094022500 con 0x7f70a00ff120 2023-10-18T14:09:14.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.596+0000 7f709cff9700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f70880a15f0 0x7f70880a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.596+0000 7f709cff9700 1 -- 172.21.15.114:0/3498076653 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f70940ce2f0 con 0x7f70a00ff120 2023-10-18T14:09:14.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.596+0000 7f709effd700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f70880a15f0 0x7f70880a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.596+0000 7f709effd700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f70880a15f0 0x7f70880a3ab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7090005fd0 tx=0x7f7090005dc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.597+0000 7f70b2100b80 1 Processor -- start 2023-10-18T14:09:14.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.597+0000 7f70b2100b80 1 -- start start 2023-10-18T14:09:14.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.597+0000 7f70b2100b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.597+0000 7f70b2100b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8c500 0x55dc3cd86090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.597+0000 7f70b2100b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd865d0 0x55dc3cd86a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.597+0000 7f70b2100b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3ccf96e0 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.597+0000 7f70b2100b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3ccdfc60 con 0x55dc3cd8c500 2023-10-18T14:09:14.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.597+0000 7f70b2100b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3ccdd580 con 0x55dc3cd865d0 2023-10-18T14:09:14.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.597+0000 7f709f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.597+0000 7f709f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46566/0 (socket says 172.21.15.114:46566) 2023-10-18T14:09:14.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.597+0000 7f709f7fe700 1 -- 172.21.15.114:0/3344643580 learned_addr learned my addr 172.21.15.114:0/3344643580 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:14.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.597+0000 7f709ffff700 1 --2- 172.21.15.114:0/3344643580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd865d0 0x55dc3cd86a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.598+0000 7f709f7fe700 1 -- 172.21.15.114:0/3344643580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd865d0 msgr2=0x55dc3cd86a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.598+0000 7f709f7fe700 1 --2- 172.21.15.114:0/3344643580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd865d0 0x55dc3cd86a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.598+0000 7f709f7fe700 1 -- 172.21.15.114:0/3344643580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8c500 msgr2=0x55dc3cd86090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.598+0000 7f709f7fe700 1 --2- 172.21.15.114:0/3344643580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8c500 0x55dc3cd86090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.598+0000 7f709f7fe700 1 -- 172.21.15.114:0/3344643580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc3cc963f0 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.598+0000 7f709f7fe700 1 --2- 172.21.15.114:0/3344643580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8bfc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f70940978e0 tx=0x7f7094009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf97ac199eec314c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.598+0000 7f7085ffb700 1 -- 172.21.15.114:0/3344643580 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70940b0020 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.598+0000 7f7085ffb700 1 -- 172.21.15.114:0/3344643580 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f709409bae0 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.598+0000 7f7085ffb700 1 -- 172.21.15.114:0/3344643580 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709409b640 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.598+0000 7f70b2100b80 1 -- 172.21.15.114:0/3344643580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 msgr2=0x55dc3cd8bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.598+0000 7f70b2100b80 1 --2- 172.21.15.114:0/3344643580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8bfc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f70940978e0 tx=0x7f7094009310 comp rx=0 tx=0).stop 2023-10-18T14:09:14.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 -- 172.21.15.114:0/3344643580 shutdown_connections 2023-10-18T14:09:14.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 --2- 172.21.15.114:0/3344643580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd865d0 0x55dc3cd86a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 --2- 172.21.15.114:0/3344643580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8bfc0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 --2- 172.21.15.114:0/3344643580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8c500 0x55dc3cd86090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 -- 172.21.15.114:0/3344643580 >> 172.21.15.114:0/3344643580 conn(0x55dc3ccfa720 msgr2=0x55dc3cd80b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:14.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 -- 172.21.15.114:0/3344643580 shutdown_connections 2023-10-18T14:09:14.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 -- 172.21.15.114:0/3344643580 wait complete. 2023-10-18T14:09:14.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 -- start start 2023-10-18T14:09:14.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 Processor -- start 2023-10-18T14:09:14.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 0x55dc3cd92440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd8c500 0x55dc3cd8fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3ccd8e70 con 0x55dc3cd865d0 2023-10-18T14:09:14.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cc75710 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cc753b0 con 0x55dc3cd8c500 2023-10-18T14:09:14.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.599+0000 7f70b2100b80 10 client.0 _ll_register_callbacks cb 0x55dc3cbbfa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:09:14.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f709f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 0x55dc3cd92440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f709f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 0x55dc3cd92440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46572/0 (socket says 172.21.15.114:46572) 2023-10-18T14:09:14.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f709f7fe700 1 -- 172.21.15.114:0/4018002264 learned_addr learned my addr 172.21.15.114:0/4018002264 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:14.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f709effd700 1 --2- 172.21.15.114:0/4018002264 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f709ffff700 1 --2- 172.21.15.114:0/4018002264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd8c500 0x55dc3cd8fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f709f7fe700 1 -- 172.21.15.114:0/4018002264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd8c500 msgr2=0x55dc3cd8fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f709f7fe700 1 --2- 172.21.15.114:0/4018002264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd8c500 0x55dc3cd8fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f709f7fe700 1 -- 172.21.15.114:0/4018002264 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8bbe0 msgr2=0x55dc3cd8f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f709f7fe700 1 --2- 172.21.15.114:0/4018002264 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f709f7fe700 1 -- 172.21.15.114:0/4018002264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a01a5940 con 0x55dc3cd865d0 2023-10-18T14:09:14.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f709f7fe700 1 --2- 172.21.15.114:0/4018002264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 0x55dc3cd92440 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f70940cc040 tx=0x7f709409ab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633bbc66c0ae9729 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f707effd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:09:14.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f707effd700 1 -- 172.21.15.114:0/4018002264 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70940b0040 con 0x55dc3cd865d0 2023-10-18T14:09:14.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f707effd700 1 -- 172.21.15.114:0/4018002264 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f709409b3e0 con 0x55dc3cd865d0 2023-10-18T14:09:14.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f70b2100b80 1 -- 172.21.15.114:0/4018002264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc3ccddef0 con 0x55dc3cd865d0 2023-10-18T14:09:14.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f707effd700 1 -- 172.21.15.114:0/4018002264 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70940a36e0 con 0x55dc3cd865d0 2023-10-18T14:09:14.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f70b2100b80 10 client.16638 fetch_fsmap learned FSMap version 44 2023-10-18T14:09:14.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f70b2100b80 1 -- 172.21.15.114:0/4018002264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55dc3cb03de0 con 0x55dc3cd865d0 2023-10-18T14:09:14.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.600+0000 7f707effd700 1 -- 172.21.15.114:0/4018002264 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7094081080 con 0x55dc3cd865d0 2023-10-18T14:09:14.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.601+0000 7f707effd700 1 -- 172.21.15.114:0/4018002264 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 44) v1 ==== 7958+0+0 (secure 0 0 0) 0x7f7094064020 con 0x55dc3cd865d0 2023-10-18T14:09:14.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.601+0000 7f70b2100b80 10 client.16638 fetch_fsmap finished waiting for FSMap version 44 2023-10-18T14:09:14.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.601+0000 7f70b2100b80 10 client.16638 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-18T14:09:14.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.601+0000 7f70b2100b80 20 client.16638 populate_metadata read hostname 'smithi114' 2023-10-18T14:09:14.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.601+0000 7f70b2100b80 1 --2- 172.21.15.114:0/4018002264 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55dc3cd9f860 0x55dc3cda1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.601+0000 7f70b2100b80 4 client.16638 mds_command: new command op to 14820 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:09:14.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.601+0000 7f70b2100b80 1 -- 172.21.15.114:0/4018002264 --> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc3cd558b0 con 0x55dc3cd9f860 2023-10-18T14:09:14.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.601+0000 7f709effd700 1 --2- 172.21.15.114:0/4018002264 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55dc3cd9f860 0x55dc3cda1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.601+0000 7f707effd700 10 client.16638 ms_handle_connect on v2:172.21.15.114:6840/2423071224 2023-10-18T14:09:14.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.601+0000 7f709effd700 1 --2- 172.21.15.114:0/4018002264 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55dc3cd9f860 0x55dc3cda1c80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e99c3062f3ec6761 server_cookie=718c271c0a885ecf in_seq=0 out_seq=0 2023-10-18T14:09:14.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.601+0000 7f707effd700 1 -- 172.21.15.114:0/4018002264 <== mds.4 v2:172.21.15.114:6840/2423071224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dc3cd558b0 con 0x55dc3cd9f860 2023-10-18T14:09:14.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.601+0000 7f707effd700 10 client.16638 handle_command_reply: tid=0 2023-10-18T14:09:14.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.602+0000 7f70b2100b80 1 client.16638 shutdown 2023-10-18T14:09:14.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.602+0000 7f70b2100b80 1 -- 172.21.15.114:0/4018002264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 msgr2=0x55dc3cd92440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.602+0000 7f70b2100b80 1 --2- 172.21.15.114:0/4018002264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 0x55dc3cd92440 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f70940cc040 tx=0x7f709409ab00 comp rx=0 tx=0).stop 2023-10-18T14:09:14.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.602+0000 7f70b2100b80 1 -- 172.21.15.114:0/4018002264 shutdown_connections 2023-10-18T14:09:14.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.602+0000 7f70b2100b80 1 --2- 172.21.15.114:0/4018002264 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55dc3cd9f860 0x55dc3cda1c80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.602+0000 7f70b2100b80 1 --2- 172.21.15.114:0/4018002264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd8c500 0x55dc3cd8fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.602+0000 7f707effd700 0 client.16638 ms_handle_reset on v2:172.21.15.114:6840/2423071224 2023-10-18T14:09:14.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.602+0000 7f70b2100b80 1 --2- 172.21.15.114:0/4018002264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 0x55dc3cd92440 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.602+0000 7f70b2100b80 1 --2- 172.21.15.114:0/4018002264 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.602+0000 7f70b2100b80 1 -- 172.21.15.114:0/4018002264 >> 172.21.15.114:0/4018002264 conn(0x55dc3ccfa720 msgr2=0x55dc3cd85080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:14.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.602+0000 7f70b2100b80 1 -- 172.21.15.114:0/4018002264 shutdown_connections 2023-10-18T14:09:14.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.602+0000 7f70b2100b80 1 -- 172.21.15.114:0/4018002264 wait complete. 2023-10-18T14:09:14.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.602+0000 7f70b2100b80 20 client.16638 trim_cache size 0 max 16384 2023-10-18T14:09:14.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f70b2100b80 1 Processor -- start 2023-10-18T14:09:14.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f70b2100b80 1 -- start start 2023-10-18T14:09:14.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f70b2100b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 0x55dc3cd96c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f70b2100b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd85930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f70b2100b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd8c500 0x55dc3cd896b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f70b2100b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cd81130 con 0x55dc3cd865d0 2023-10-18T14:09:14.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f70b2100b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cb59920 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f70b2100b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cd9c690 con 0x55dc3cd8c500 2023-10-18T14:09:14.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f709f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 0x55dc3cd96c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f709f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 0x55dc3cd96c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46580/0 (socket says 172.21.15.114:46580) 2023-10-18T14:09:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f709f7fe700 1 -- 172.21.15.114:0/4205705882 learned_addr learned my addr 172.21.15.114:0/4205705882 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f709effd700 1 --2- 172.21.15.114:0/4205705882 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd85930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f709f7fe700 1 -- 172.21.15.114:0/4205705882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd8c500 msgr2=0x55dc3cd896b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f709f7fe700 1 --2- 172.21.15.114:0/4205705882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd8c500 0x55dc3cd896b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f709f7fe700 1 -- 172.21.15.114:0/4205705882 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8bbe0 msgr2=0x55dc3cd85930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f709f7fe700 1 --2- 172.21.15.114:0/4205705882 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd85930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.615+0000 7f709f7fe700 1 -- 172.21.15.114:0/4205705882 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc3caecc60 con 0x55dc3cd865d0 2023-10-18T14:09:14.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.616+0000 7f709f7fe700 1 --2- 172.21.15.114:0/4205705882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 0x55dc3cd96c30 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f70940978e0 tx=0x7f7094009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214cfda7860eae60 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.616+0000 7f70867fc700 1 -- 172.21.15.114:0/4205705882 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70940b0070 con 0x55dc3cd865d0 2023-10-18T14:09:14.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.616+0000 7f70867fc700 1 -- 172.21.15.114:0/4205705882 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dc3ccddef0 con 0x55dc3cd865d0 2023-10-18T14:09:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.616+0000 7f70867fc700 1 -- 172.21.15.114:0/4205705882 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709409b8e0 con 0x55dc3cd865d0 2023-10-18T14:09:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.616+0000 7f70b2100b80 1 -- 172.21.15.114:0/4205705882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 msgr2=0x55dc3cd96c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.616+0000 7f70b2100b80 1 --2- 172.21.15.114:0/4205705882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 0x55dc3cd96c30 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f70940978e0 tx=0x7f7094009310 comp rx=0 tx=0).stop 2023-10-18T14:09:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.616+0000 7f70b2100b80 1 -- 172.21.15.114:0/4205705882 shutdown_connections 2023-10-18T14:09:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.616+0000 7f70b2100b80 1 --2- 172.21.15.114:0/4205705882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd8c500 0x55dc3cd896b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.616+0000 7f70b2100b80 1 --2- 172.21.15.114:0/4205705882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd865d0 0x55dc3cd96c30 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.616+0000 7f70b2100b80 1 --2- 172.21.15.114:0/4205705882 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd85930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.616+0000 7f70b2100b80 1 -- 172.21.15.114:0/4205705882 >> 172.21.15.114:0/4205705882 conn(0x55dc3ccfa720 msgr2=0x55dc3cd85080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.616+0000 7f70b2100b80 1 -- 172.21.15.114:0/4205705882 shutdown_connections 2023-10-18T14:09:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.616+0000 7f70b2100b80 1 -- 172.21.15.114:0/4205705882 wait complete. 2023-10-18T14:09:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f70b2100b80 1 -- start start 2023-10-18T14:09:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f70b2100b80 1 Processor -- start 2023-10-18T14:09:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f70b2100b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd865d0 0x55dc3cd969b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f70b2100b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f70b2100b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd8c500 0x55dc3cd8f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f70b2100b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cd8f7f0 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f70b2100b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cd8f960 con 0x55dc3cd865d0 2023-10-18T14:09:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f70b2100b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3cd8fb20 con 0x55dc3cd8c500 2023-10-18T14:09:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f70b2100b80 10 client.0 _ll_register_callbacks cb 0x55dc3cbbfa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:09:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f709effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f709effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46588/0 (socket says 172.21.15.114:46588) 2023-10-18T14:09:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f709effd700 1 -- 172.21.15.114:0/1844930369 learned_addr learned my addr 172.21.15.114:0/1844930369 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f709f7fe700 1 --2- 172.21.15.114:0/1844930369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd865d0 0x55dc3cd969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f709effd700 1 -- 172.21.15.114:0/1844930369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd8c500 msgr2=0x55dc3cd8f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f709effd700 1 --2- 172.21.15.114:0/1844930369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd8c500 0x55dc3cd8f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f709effd700 1 -- 172.21.15.114:0/1844930369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd865d0 msgr2=0x55dc3cd969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f709effd700 1 --2- 172.21.15.114:0/1844930369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd865d0 0x55dc3cd969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.617+0000 7f709effd700 1 -- 172.21.15.114:0/1844930369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc3cb03de0 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f709effd700 1 --2- 172.21.15.114:0/1844930369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8ed70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f70a0101a30 tx=0x7f7090004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d87bd841f39d1c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f707effd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:09:14.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f707effd700 1 -- 172.21.15.114:0/1844930369 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090025c90 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f707effd700 1 -- 172.21.15.114:0/1844930369 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7090022070 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f70b2100b80 1 -- 172.21.15.114:0/1844930369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f709409bae0 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f707effd700 1 -- 172.21.15.114:0/1844930369 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7090025df0 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f70b2100b80 10 client.16644 fetch_fsmap learned FSMap version 44 2023-10-18T14:09:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f70b2100b80 1 -- 172.21.15.114:0/1844930369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55dc3cb2a250 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f707effd700 1 -- 172.21.15.114:0/1844930369 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f709409bae0 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f707effd700 1 -- 172.21.15.114:0/1844930369 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 44) v1 ==== 7958+0+0 (secure 0 0 0) 0x7f709000f420 con 0x55dc3cd8bbe0 2023-10-18T14:09:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f70b2100b80 10 client.16644 fetch_fsmap finished waiting for FSMap version 44 2023-10-18T14:09:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f70b2100b80 10 client.16644 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-18T14:09:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f70b2100b80 20 client.16644 populate_metadata read hostname 'smithi114' 2023-10-18T14:09:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f70b2100b80 1 --2- 172.21.15.114:0/1844930369 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55dc3cdf4c50 0x55dc3cdf7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f70b2100b80 4 client.16644 mds_command: new command op to 14820 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:09:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f70b2100b80 1 -- 172.21.15.114:0/1844930369 --> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55dc3ccd1e50 con 0x55dc3cdf4c50 2023-10-18T14:09:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.618+0000 7f709f7fe700 1 --2- 172.21.15.114:0/1844930369 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55dc3cdf4c50 0x55dc3cdf7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.619+0000 7f707effd700 10 client.16644 ms_handle_connect on v2:172.21.15.114:6840/2423071224 2023-10-18T14:09:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.619+0000 7f709f7fe700 1 --2- 172.21.15.114:0/1844930369 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55dc3cdf4c50 0x55dc3cdf7070 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=914d411908a6fcd0 server_cookie=66af33e3d6341bd5 in_seq=0 out_seq=0 2023-10-18T14:09:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.620+0000 7f707effd700 1 -- 172.21.15.114:0/1844930369 <== mds.4 v2:172.21.15.114:6840/2423071224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+66998 (crc 0 0 0) 0x55dc3ccd1e50 con 0x55dc3cdf4c50 2023-10-18T14:09:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.620+0000 7f707effd700 10 client.16644 handle_command_reply: tid=0 2023-10-18T14:09:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.620+0000 7f70b2100b80 1 client.16644 shutdown 2023-10-18T14:09:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.620+0000 7f70b2100b80 1 -- 172.21.15.114:0/1844930369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 msgr2=0x55dc3cd8ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.620+0000 7f70b2100b80 1 --2- 172.21.15.114:0/1844930369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8ed70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f70a0101a30 tx=0x7f7090004750 comp rx=0 tx=0).stop 2023-10-18T14:09:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.620+0000 7f70b2100b80 1 -- 172.21.15.114:0/1844930369 shutdown_connections 2023-10-18T14:09:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.620+0000 7f70b2100b80 1 --2- 172.21.15.114:0/1844930369 >> [v2:172.21.15.114:6840/2423071224,v1:172.21.15.114:6841/2423071224] conn(0x55dc3cdf4c50 0x55dc3cdf7070 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.620+0000 7f70b2100b80 1 --2- 172.21.15.114:0/1844930369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc3cd8c500 0x55dc3cd8f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.620+0000 7f707effd700 0 client.16644 ms_handle_reset on v2:172.21.15.114:6840/2423071224 2023-10-18T14:09:14.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.620+0000 7f70b2100b80 1 --2- 172.21.15.114:0/1844930369 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55dc3cd865d0 0x55dc3cd969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.620+0000 7f70b2100b80 1 --2- 172.21.15.114:0/1844930369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc3cd8bbe0 0x55dc3cd8ed70 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:14.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.620+0000 7f70b2100b80 1 -- 172.21.15.114:0/1844930369 >> 172.21.15.114:0/1844930369 conn(0x55dc3ccfa720 msgr2=0x55dc3cd896b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:14.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70b2100b80 1 -- 172.21.15.114:0/1844930369 shutdown_connections 2023-10-18T14:09:14.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70b2100b80 1 -- 172.21.15.114:0/1844930369 wait complete. 2023-10-18T14:09:14.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70b2100b80 20 client.16644 trim_cache size 0 max 16384 2023-10-18T14:09:14.651 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2023-10-18T14:09:14.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.652 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.652 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 5194099, 2023-10-18T14:09:14.652 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631706, 2023-10-18T14:09:14.652 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/511.out" 2023-10-18T14:09:14.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.653 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.653 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.653 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 15379541, 2023-10-18T14:09:14.653 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631573, 2023-10-18T14:09:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/444.out" 2023-10-18T14:09:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 24745406, 2023-10-18T14:09:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630023, 2023-10-18T14:09:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/314.out" 2023-10-18T14:09:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.656 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 35548548, 2023-10-18T14:09:14.656 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631401, 2023-10-18T14:09:14.656 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/358.out" 2023-10-18T14:09:14.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.657 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.657 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 41703135, 2023-10-18T14:09:14.657 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631238, 2023-10-18T14:09:14.657 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/277.out" 2023-10-18T14:09:14.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.658 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.658 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 58194184, 2023-10-18T14:09:14.658 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632650, 2023-10-18T14:09:14.658 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/286" 2023-10-18T14:09:14.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.659 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.659 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 66190420, 2023-10-18T14:09:14.660 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632602, 2023-10-18T14:09:14.660 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/238" 2023-10-18T14:09:14.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.660 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.660 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 97672317, 2023-10-18T14:09:14.661 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632486, 2023-10-18T14:09:14.661 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/127" 2023-10-18T14:09:14.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.661 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.662 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 106682814, 2023-10-18T14:09:14.662 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628433, 2023-10-18T14:09:14.662 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/305.out" 2023-10-18T14:09:14.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.663 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.663 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 116184688, 2023-10-18T14:09:14.663 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631475, 2023-10-18T14:09:14.663 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/395.out" 2023-10-18T14:09:14.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.664 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.664 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 117604627, 2023-10-18T14:09:14.664 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631236, 2023-10-18T14:09:14.664 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/276.out" 2023-10-18T14:09:14.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.665 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.665 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 122675859, 2023-10-18T14:09:14.665 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631034, 2023-10-18T14:09:14.666 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/181.out" 2023-10-18T14:09:14.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.666 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.666 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 130767515, 2023-10-18T14:09:14.667 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631374, 2023-10-18T14:09:14.667 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/345.out" 2023-10-18T14:09:14.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.667 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.667 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.667 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 131817381, 2023-10-18T14:09:14.668 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628706, 2023-10-18T14:09:14.668 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/126.out" 2023-10-18T14:09:14.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.668 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.669 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 133472476, 2023-10-18T14:09:14.669 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631591, 2023-10-18T14:09:14.669 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/453.out" 2023-10-18T14:09:14.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.670 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.670 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 135115736, 2023-10-18T14:09:14.670 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628449, 2023-10-18T14:09:14.670 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/003.out" 2023-10-18T14:09:14.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.671 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.671 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.671 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 143032561, 2023-10-18T14:09:14.671 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631352, 2023-10-18T14:09:14.671 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/334.out" 2023-10-18T14:09:14.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.672 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.672 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 151010142, 2023-10-18T14:09:14.672 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631637, 2023-10-18T14:09:14.673 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/476.out" 2023-10-18T14:09:14.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.673 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.673 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 153675479, 2023-10-18T14:09:14.673 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628351, 2023-10-18T14:09:14.674 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/024.out" 2023-10-18T14:09:14.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.674 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.675 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 164431962, 2023-10-18T14:09:14.675 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630047, 2023-10-18T14:09:14.675 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/326.out" 2023-10-18T14:09:14.675 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.676 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.676 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 229347142, 2023-10-18T14:09:14.676 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632391, 2023-10-18T14:09:14.676 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/049" 2023-10-18T14:09:14.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.677 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.677 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.677 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 260419294, 2023-10-18T14:09:14.677 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631553, 2023-10-18T14:09:14.678 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/434.out" 2023-10-18T14:09:14.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.678 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.678 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 265297887, 2023-10-18T14:09:14.679 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632415, 2023-10-18T14:09:14.679 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/058" 2023-10-18T14:09:14.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.679 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.679 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 269017621, 2023-10-18T14:09:14.680 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629993, 2023-10-18T14:09:14.680 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/299.out" 2023-10-18T14:09:14.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.680 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.681 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 271337472, 2023-10-18T14:09:14.681 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632943, 2023-10-18T14:09:14.681 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/336" 2023-10-18T14:09:14.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.682 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.682 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 277554283, 2023-10-18T14:09:14.682 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633164, 2023-10-18T14:09:14.682 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/542" 2023-10-18T14:09:14.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.683 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.683 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 279311230, 2023-10-18T14:09:14.683 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630079, 2023-10-18T14:09:14.683 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/554.out" 2023-10-18T14:09:14.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.684 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.684 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 283802522, 2023-10-18T14:09:14.684 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633131, 2023-10-18T14:09:14.684 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/510" 2023-10-18T14:09:14.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.685 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.685 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 303903949, 2023-10-18T14:09:14.685 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630922, 2023-10-18T14:09:14.686 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/125.out" 2023-10-18T14:09:14.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.686 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.686 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.686 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 309721522, 2023-10-18T14:09:14.687 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631316, 2023-10-18T14:09:14.687 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/316.out" 2023-10-18T14:09:14.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.687 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.687 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 311106094, 2023-10-18T14:09:14.688 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628487, 2023-10-18T14:09:14.688 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/022.out" 2023-10-18T14:09:14.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.688 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.689 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 319973604, 2023-10-18T14:09:14.689 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631172, 2023-10-18T14:09:14.689 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/244.out" 2023-10-18T14:09:14.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.690 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.690 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 356742260, 2023-10-18T14:09:14.690 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631684, 2023-10-18T14:09:14.690 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/500.out" 2023-10-18T14:09:14.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.691 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.691 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 366627470, 2023-10-18T14:09:14.691 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632558, 2023-10-18T14:09:14.691 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/195" 2023-10-18T14:09:14.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.692 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.692 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 367442426, 2023-10-18T14:09:14.692 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632968, 2023-10-18T14:09:14.693 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/359" 2023-10-18T14:09:14.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.693 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.693 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 391008305, 2023-10-18T14:09:14.694 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629158, 2023-10-18T14:09:14.694 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/477.out" 2023-10-18T14:09:14.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.694 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.695 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 395472320, 2023-10-18T14:09:14.695 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632988, 2023-10-18T14:09:14.695 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/377" 2023-10-18T14:09:14.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.695 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.696 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 397390657, 2023-10-18T14:09:14.696 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633072, 2023-10-18T14:09:14.696 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/455" 2023-10-18T14:09:14.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.697 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.697 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 399973646, 2023-10-18T14:09:14.697 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632554, 2023-10-18T14:09:14.697 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/191" 2023-10-18T14:09:14.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.698 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.698 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 400539427, 2023-10-18T14:09:14.698 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629144, 2023-10-18T14:09:14.698 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/470.out" 2023-10-18T14:09:14.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.699 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.699 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 415674261, 2023-10-18T14:09:14.699 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629112, 2023-10-18T14:09:14.700 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/454.out" 2023-10-18T14:09:14.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.700 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.700 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 433663705, 2023-10-18T14:09:14.700 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629965, 2023-10-18T14:09:14.701 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/285.out" 2023-10-18T14:09:14.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.701 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.701 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 443690343, 2023-10-18T14:09:14.702 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628902, 2023-10-18T14:09:14.702 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/349.out" 2023-10-18T14:09:14.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.702 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.702 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.703 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 457041475, 2023-10-18T14:09:14.703 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631346, 2023-10-18T14:09:14.703 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/331.out" 2023-10-18T14:09:14.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.704 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.704 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 459908076, 2023-10-18T14:09:14.704 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631378, 2023-10-18T14:09:14.704 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/347.out" 2023-10-18T14:09:14.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.704 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.705 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.705 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 468893487, 2023-10-18T14:09:14.705 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633016, 2023-10-18T14:09:14.705 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/404" 2023-10-18T14:09:14.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.706 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.706 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 480945935, 2023-10-18T14:09:14.706 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631599, 2023-10-18T14:09:14.707 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/457.out" 2023-10-18T14:09:14.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.707 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.707 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 487947058, 2023-10-18T14:09:14.708 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631649, 2023-10-18T14:09:14.708 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/482.out" 2023-10-18T14:09:14.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.708 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.708 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 490207651, 2023-10-18T14:09:14.709 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629090, 2023-10-18T14:09:14.709 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/443.out" 2023-10-18T14:09:14.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.709 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.710 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 520292411, 2023-10-18T14:09:14.710 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631615, 2023-10-18T14:09:14.710 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/465.out" 2023-10-18T14:09:14.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.711 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.711 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 521662858, 2023-10-18T14:09:14.711 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631603, 2023-10-18T14:09:14.711 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/459.out" 2023-10-18T14:09:14.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.712 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.712 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 571005504, 2023-10-18T14:09:14.712 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630798, 2023-10-18T14:09:14.712 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/067.out" 2023-10-18T14:09:14.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.713 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.713 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 581284538, 2023-10-18T14:09:14.713 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628874, 2023-10-18T14:09:14.713 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/335.out" 2023-10-18T14:09:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 592831098, 2023-10-18T14:09:14.714 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629210, 2023-10-18T14:09:14.715 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/503.out" 2023-10-18T14:09:14.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.715 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.715 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 607653522, 2023-10-18T14:09:14.715 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630792, 2023-10-18T14:09:14.716 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/064.out" 2023-10-18T14:09:14.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.716 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.716 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 618545236, 2023-10-18T14:09:14.717 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629236, 2023-10-18T14:09:14.717 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/516.out" 2023-10-18T14:09:14.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.717 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.717 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 638345652, 2023-10-18T14:09:14.718 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632369, 2023-10-18T14:09:14.718 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/030.out" 2023-10-18T14:09:14.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.718 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.719 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 690123381, 2023-10-18T14:09:14.719 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630938, 2023-10-18T14:09:14.719 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/133.out" 2023-10-18T14:09:14.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.719 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.720 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 696257643, 2023-10-18T14:09:14.720 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631214, 2023-10-18T14:09:14.720 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/265.out" 2023-10-18T14:09:14.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.721 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.721 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 701130355, 2023-10-18T14:09:14.721 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629889, 2023-10-18T14:09:14.721 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/247.out" 2023-10-18T14:09:14.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.722 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.722 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 709125886, 2023-10-18T14:09:14.722 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632983, 2023-10-18T14:09:14.722 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/373.out" 2023-10-18T14:09:14.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.723 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.723 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 709747368, 2023-10-18T14:09:14.724 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632579, 2023-10-18T14:09:14.724 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/215" 2023-10-18T14:09:14.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.724 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.724 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 725756796, 2023-10-18T14:09:14.725 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632383, 2023-10-18T14:09:14.725 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/041" 2023-10-18T14:09:14.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.725 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.726 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 782079720, 2023-10-18T14:09:14.726 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631561, 2023-10-18T14:09:14.726 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/438.out" 2023-10-18T14:09:14.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.727 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.727 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 784086821, 2023-10-18T14:09:14.727 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631601, 2023-10-18T14:09:14.727 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/458.out" 2023-10-18T14:09:14.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.728 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.728 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 789110480, 2023-10-18T14:09:14.728 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631405, 2023-10-18T14:09:14.728 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/360.out" 2023-10-18T14:09:14.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.729 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.729 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 799266497, 2023-10-18T14:09:14.729 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628768, 2023-10-18T14:09:14.729 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/157.out" 2023-10-18T14:09:14.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.730 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.730 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 807849490, 2023-10-18T14:09:14.730 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628982, 2023-10-18T14:09:14.731 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/389.out" 2023-10-18T14:09:14.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.731 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.731 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 823520534, 2023-10-18T14:09:14.732 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631326, 2023-10-18T14:09:14.732 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/321.out" 2023-10-18T14:09:14.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.732 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.732 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 830160152, 2023-10-18T14:09:14.733 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632473, 2023-10-18T14:09:14.733 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/114" 2023-10-18T14:09:14.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.733 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.734 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 834223673, 2023-10-18T14:09:14.734 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631166, 2023-10-18T14:09:14.734 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/241.out" 2023-10-18T14:09:14.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.735 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.735 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 851748622, 2023-10-18T14:09:14.735 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628553, 2023-10-18T14:09:14.735 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.nojournal" 2023-10-18T14:09:14.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.736 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.736 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.736 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 884970421, 2023-10-18T14:09:14.736 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631519, 2023-10-18T14:09:14.737 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/417.out" 2023-10-18T14:09:14.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.737 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.737 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 890653585, 2023-10-18T14:09:14.738 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628868, 2023-10-18T14:09:14.738 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/332.out" 2023-10-18T14:09:14.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.738 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.739 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 892571780, 2023-10-18T14:09:14.739 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632952, 2023-10-18T14:09:14.739 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/345" 2023-10-18T14:09:14.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.740 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.740 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 893227871, 2023-10-18T14:09:14.740 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628551, 2023-10-18T14:09:14.740 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.cfg" 2023-10-18T14:09:14.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.741 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.741 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 910331455, 2023-10-18T14:09:14.741 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631645, 2023-10-18T14:09:14.741 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/480.out" 2023-10-18T14:09:14.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.742 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.742 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 924811554, 2023-10-18T14:09:14.742 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628323, 2023-10-18T14:09:14.742 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/010.out" 2023-10-18T14:09:14.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.743 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.743 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 936940106, 2023-10-18T14:09:14.743 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632331, 2023-10-18T14:09:14.744 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/307" 2023-10-18T14:09:14.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.744 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.744 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.744 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 944101427, 2023-10-18T14:09:14.744 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630071, 2023-10-18T14:09:14.745 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/550.out" 2023-10-18T14:09:14.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.745 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.745 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.745 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 950716093, 2023-10-18T14:09:14.746 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632590, 2023-10-18T14:09:14.746 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/226" 2023-10-18T14:09:14.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.746 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.747 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 997939441, 2023-10-18T14:09:14.747 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631511, 2023-10-18T14:09:14.747 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/413.out" 2023-10-18T14:09:14.747 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.747 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.748 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.748 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1008312425, 2023-10-18T14:09:14.748 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630668, 2023-10-18T14:09:14.748 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/003.out" 2023-10-18T14:09:14.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.749 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.749 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1047205289, 2023-10-18T14:09:14.749 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628884, 2023-10-18T14:09:14.749 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/340.out" 2023-10-18T14:09:14.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.750 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.750 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1047325037, 2023-10-18T14:09:14.750 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631698, 2023-10-18T14:09:14.750 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/507.out" 2023-10-18T14:09:14.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.751 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.751 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1078574817, 2023-10-18T14:09:14.751 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633173, 2023-10-18T14:09:14.751 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/551" 2023-10-18T14:09:14.752 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.752 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.752 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.752 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1087736557, 2023-10-18T14:09:14.752 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631240, 2023-10-18T14:09:14.752 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/278.out" 2023-10-18T14:09:14.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.753 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.753 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1089115581, 2023-10-18T14:09:14.753 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631609, 2023-10-18T14:09:14.754 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/462.out" 2023-10-18T14:09:14.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.754 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.754 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1103675912, 2023-10-18T14:09:14.754 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632957, 2023-10-18T14:09:14.755 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/350" 2023-10-18T14:09:14.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.755 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.755 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1150984856, 2023-10-18T14:09:14.756 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629834, 2023-10-18T14:09:14.756 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/193.out" 2023-10-18T14:09:14.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.756 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.757 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1164301765, 2023-10-18T14:09:14.757 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632341, 2023-10-18T14:09:14.757 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/005" 2023-10-18T14:09:14.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.758 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.758 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1166616487, 2023-10-18T14:09:14.758 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628517, 2023-10-18T14:09:14.761 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/036.out" 2023-10-18T14:09:14.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.762 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.762 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1182557407, 2023-10-18T14:09:14.762 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629885, 2023-10-18T14:09:14.763 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/245.out" 2023-10-18T14:09:14.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.763 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.763 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1193352819, 2023-10-18T14:09:14.764 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631290, 2023-10-18T14:09:14.764 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/303.out" 2023-10-18T14:09:14.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.764 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.765 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1195441342, 2023-10-18T14:09:14.765 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632626, 2023-10-18T14:09:14.765 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/262" 2023-10-18T14:09:14.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.766 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.766 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1223164286, 2023-10-18T14:09:14.766 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632385, 2023-10-18T14:09:14.766 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/043" 2023-10-18T14:09:14.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.767 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.767 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.767 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1233954801, 2023-10-18T14:09:14.767 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633003, 2023-10-18T14:09:14.768 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/392" 2023-10-18T14:09:14.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.768 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.769 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1241585199, 2023-10-18T14:09:14.769 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630738, 2023-10-18T14:09:14.769 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/037.out" 2023-10-18T14:09:14.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.770 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.770 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1266190664, 2023-10-18T14:09:14.770 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628353, 2023-10-18T14:09:14.770 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/025.out" 2023-10-18T14:09:14.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.771 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.771 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1269802364, 2023-10-18T14:09:14.771 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630924, 2023-10-18T14:09:14.771 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/126.out" 2023-10-18T14:09:14.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.772 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.772 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1281192578, 2023-10-18T14:09:14.772 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633091, 2023-10-18T14:09:14.772 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/473" 2023-10-18T14:09:14.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.773 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.773 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1289460414, 2023-10-18T14:09:14.773 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629857, 2023-10-18T14:09:14.774 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/231.out" 2023-10-18T14:09:14.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.774 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.774 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1299177162, 2023-10-18T14:09:14.775 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631583, 2023-10-18T14:09:14.775 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/449.out" 2023-10-18T14:09:14.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.775 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.776 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1303565943, 2023-10-18T14:09:14.776 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633048, 2023-10-18T14:09:14.776 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/433" 2023-10-18T14:09:14.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.777 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.777 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1315839230, 2023-10-18T14:09:14.777 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633105, 2023-10-18T14:09:14.777 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/486" 2023-10-18T14:09:14.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.778 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.778 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1316753218, 2023-10-18T14:09:14.778 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631122, 2023-10-18T14:09:14.778 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/224.out" 2023-10-18T14:09:14.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.779 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.779 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1329764628, 2023-10-18T14:09:14.779 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628387, 2023-10-18T14:09:14.779 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/042.out" 2023-10-18T14:09:14.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.780 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.780 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1333668470, 2023-10-18T14:09:14.780 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633199, 2023-10-18T14:09:14.780 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/574" 2023-10-18T14:09:14.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.781 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.781 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1337631038, 2023-10-18T14:09:14.782 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628495, 2023-10-18T14:09:14.782 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/026.out" 2023-10-18T14:09:14.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.782 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.783 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1369847155, 2023-10-18T14:09:14.783 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631483, 2023-10-18T14:09:14.783 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/399.out" 2023-10-18T14:09:14.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.783 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.783 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.784 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1396705600, 2023-10-18T14:09:14.784 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628582, 2023-10-18T14:09:14.784 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/064.out" 2023-10-18T14:09:14.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.785 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.785 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1397438310, 2023-10-18T14:09:14.785 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628764, 2023-10-18T14:09:14.785 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/155.out" 2023-10-18T14:09:14.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.786 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.786 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1426738571, 2023-10-18T14:09:14.786 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631368, 2023-10-18T14:09:14.786 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/342.out" 2023-10-18T14:09:14.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.787 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.787 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1446749830, 2023-10-18T14:09:14.787 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629238, 2023-10-18T14:09:14.787 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/517.out" 2023-10-18T14:09:14.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.788 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.788 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1458136358, 2023-10-18T14:09:14.788 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631084, 2023-10-18T14:09:14.788 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/206.out" 2023-10-18T14:09:14.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.789 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.789 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1471473685, 2023-10-18T14:09:14.789 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632476, 2023-10-18T14:09:14.789 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/117" 2023-10-18T14:09:14.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.790 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.790 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1472854248, 2023-10-18T14:09:14.790 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633183, 2023-10-18T14:09:14.791 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/560" 2023-10-18T14:09:14.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.791 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.791 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1485282168, 2023-10-18T14:09:14.791 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629955, 2023-10-18T14:09:14.792 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/280.out" 2023-10-18T14:09:14.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.792 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.792 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1492570182, 2023-10-18T14:09:14.793 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628906, 2023-10-18T14:09:14.793 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/351.out" 2023-10-18T14:09:14.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.793 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.793 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1524183052, 2023-10-18T14:09:14.794 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633066, 2023-10-18T14:09:14.794 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/449" 2023-10-18T14:09:14.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.794 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.795 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1539415744, 2023-10-18T14:09:14.795 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630055, 2023-10-18T14:09:14.795 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/542.out" 2023-10-18T14:09:14.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.796 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.796 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1566152874, 2023-10-18T14:09:14.796 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628331, 2023-10-18T14:09:14.796 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/014.out" 2023-10-18T14:09:14.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.797 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.797 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1600000303, 2023-10-18T14:09:14.797 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633668, 2023-10-18T14:09:14.797 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/013" 2023-10-18T14:09:14.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.798 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.798 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1606824728, 2023-10-18T14:09:14.798 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632550, 2023-10-18T14:09:14.798 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/187" 2023-10-18T14:09:14.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.799 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.799 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1625041487, 2023-10-18T14:09:14.799 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629810, 2023-10-18T14:09:14.799 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/181.out" 2023-10-18T14:09:14.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.800 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.800 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1631136957, 2023-10-18T14:09:14.800 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631563, 2023-10-18T14:09:14.801 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/439.out" 2023-10-18T14:09:14.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.801 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.801 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1662586494, 2023-10-18T14:09:14.801 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630898, 2023-10-18T14:09:14.802 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/113.out" 2023-10-18T14:09:14.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.802 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.802 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1662718221, 2023-10-18T14:09:14.803 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630762, 2023-10-18T14:09:14.803 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/049.out" 2023-10-18T14:09:14.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.803 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.804 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1668494947, 2023-10-18T14:09:14.804 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633223, 2023-10-18T14:09:14.804 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/group" 2023-10-18T14:09:14.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.804 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.804 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.805 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1683434201, 2023-10-18T14:09:14.805 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632980, 2023-10-18T14:09:14.805 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/371" 2023-10-18T14:09:14.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.806 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.806 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1701158617, 2023-10-18T14:09:14.806 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629863, 2023-10-18T14:09:14.806 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/234.out" 2023-10-18T14:09:14.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.807 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.807 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1709129704, 2023-10-18T14:09:14.807 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633061, 2023-10-18T14:09:14.807 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/444" 2023-10-18T14:09:14.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.808 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.808 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1719352296, 2023-10-18T14:09:14.808 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632358, 2023-10-18T14:09:14.808 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/021" 2023-10-18T14:09:14.809 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.809 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.809 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1733553831, 2023-10-18T14:09:14.809 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632605, 2023-10-18T14:09:14.809 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/241" 2023-10-18T14:09:14.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.810 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.810 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1736800153, 2023-10-18T14:09:14.810 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628634, 2023-10-18T14:09:14.811 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/090.out" 2023-10-18T14:09:14.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.811 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.812 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1744398113, 2023-10-18T14:09:14.812 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628710, 2023-10-18T14:09:14.812 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/128.out" 2023-10-18T14:09:14.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.812 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.813 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1786456743, 2023-10-18T14:09:14.813 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629907, 2023-10-18T14:09:14.813 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/256.out" 2023-10-18T14:09:14.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.813 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.814 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1817024330, 2023-10-18T14:09:14.814 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631419, 2023-10-18T14:09:14.814 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/367.out" 2023-10-18T14:09:14.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.815 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.815 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1821877797, 2023-10-18T14:09:14.815 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629925, 2023-10-18T14:09:14.815 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/265.out" 2023-10-18T14:09:14.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.816 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.816 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1830253779, 2023-10-18T14:09:14.816 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629204, 2023-10-18T14:09:14.816 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/500.out" 2023-10-18T14:09:14.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.817 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.817 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1847337244, 2023-10-18T14:09:14.817 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632416, 2023-10-18T14:09:14.817 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/059" 2023-10-18T14:09:14.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.818 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.818 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.818 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1864153373, 2023-10-18T14:09:14.818 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628798, 2023-10-18T14:09:14.819 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/172.out" 2023-10-18T14:09:14.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.819 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.819 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1878339735, 2023-10-18T14:09:14.820 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631230, 2023-10-18T14:09:14.820 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/273.out" 2023-10-18T14:09:14.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.820 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.820 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1890627922, 2023-10-18T14:09:14.821 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632494, 2023-10-18T14:09:14.821 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/135" 2023-10-18T14:09:14.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.821 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.822 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1894090080, 2023-10-18T14:09:14.822 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633658, 2023-10-18T14:09:14.822 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/004" 2023-10-18T14:09:14.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.823 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.823 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1907395105, 2023-10-18T14:09:14.823 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633174, 2023-10-18T14:09:14.823 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/552" 2023-10-18T14:09:14.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.824 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.824 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1935968395, 2023-10-18T14:09:14.824 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631114, 2023-10-18T14:09:14.824 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/220.out" 2023-10-18T14:09:14.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.825 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.825 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1946990466, 2023-10-18T14:09:14.825 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632517, 2023-10-18T14:09:14.825 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/155" 2023-10-18T14:09:14.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.826 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.826 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1953580334, 2023-10-18T14:09:14.826 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631423, 2023-10-18T14:09:14.826 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/369.out" 2023-10-18T14:09:14.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.827 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.827 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1979509321, 2023-10-18T14:09:14.827 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631692, 2023-10-18T14:09:14.827 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/504.out" 2023-10-18T14:09:14.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.828 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.828 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.828 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1983002663, 2023-10-18T14:09:14.828 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633215, 2023-10-18T14:09:14.828 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/587" 2023-10-18T14:09:14.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.829 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.829 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2005128350, 2023-10-18T14:09:14.829 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628493, 2023-10-18T14:09:14.830 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/025.out" 2023-10-18T14:09:14.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.830 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.830 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2024369581, 2023-10-18T14:09:14.831 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631140, 2023-10-18T14:09:14.831 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/233.out" 2023-10-18T14:09:14.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.831 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.831 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2065458992, 2023-10-18T14:09:14.832 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632644, 2023-10-18T14:09:14.832 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/280" 2023-10-18T14:09:14.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.832 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.832 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2065598368, 2023-10-18T14:09:14.833 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632655, 2023-10-18T14:09:14.833 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/291" 2023-10-18T14:09:14.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.833 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.834 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2077286542, 2023-10-18T14:09:14.834 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633000, 2023-10-18T14:09:14.834 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/389" 2023-10-18T14:09:14.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.835 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.835 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2087223874, 2023-10-18T14:09:14.835 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631030, 2023-10-18T14:09:14.835 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/179.out" 2023-10-18T14:09:14.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.836 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.836 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2088212297, 2023-10-18T14:09:14.836 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629909, 2023-10-18T14:09:14.837 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/257.out" 2023-10-18T14:09:14.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.837 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.837 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.837 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2088467595, 2023-10-18T14:09:14.838 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630095, 2023-10-18T14:09:14.838 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/562.out" 2023-10-18T14:09:14.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.838 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.839 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2104384892, 2023-10-18T14:09:14.839 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633117, 2023-10-18T14:09:14.839 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/497" 2023-10-18T14:09:14.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.840 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.840 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2121643353, 2023-10-18T14:09:14.840 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632974, 2023-10-18T14:09:14.840 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/365" 2023-10-18T14:09:14.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.841 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.841 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2122070980, 2023-10-18T14:09:14.841 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628892, 2023-10-18T14:09:14.842 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/344.out" 2023-10-18T14:09:14.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.842 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.842 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2142640611, 2023-10-18T14:09:14.843 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632996, 2023-10-18T14:09:14.843 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/385" 2023-10-18T14:09:14.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.843 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.844 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2145515372, 2023-10-18T14:09:14.844 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628521, 2023-10-18T14:09:14.844 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/038.out" 2023-10-18T14:09:14.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.845 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.845 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2145960409, 2023-10-18T14:09:14.845 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631278, 2023-10-18T14:09:14.845 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/297.out" 2023-10-18T14:09:14.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.846 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.846 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2146818463, 2023-10-18T14:09:14.846 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632307, 2023-10-18T14:09:14.846 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/026" 2023-10-18T14:09:14.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.847 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.847 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2160576633, 2023-10-18T14:09:14.847 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628523, 2023-10-18T14:09:14.847 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/039.out" 2023-10-18T14:09:14.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.848 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.848 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2168582016, 2023-10-18T14:09:14.849 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631631, 2023-10-18T14:09:14.849 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/473.out" 2023-10-18T14:09:14.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.849 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.850 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2183468452, 2023-10-18T14:09:14.850 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631660, 2023-10-18T14:09:14.850 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/488.out" 2023-10-18T14:09:14.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.851 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.851 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2230754665, 2023-10-18T14:09:14.851 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632927, 2023-10-18T14:09:14.851 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/320" 2023-10-18T14:09:14.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.852 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.852 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.852 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2362046734, 2023-10-18T14:09:14.852 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631569, 2023-10-18T14:09:14.852 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/442.out" 2023-10-18T14:09:14.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.853 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.853 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2362113054, 2023-10-18T14:09:14.853 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632428, 2023-10-18T14:09:14.853 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/071" 2023-10-18T14:09:14.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.854 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.854 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2365776388, 2023-10-18T14:09:14.854 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632360, 2023-10-18T14:09:14.855 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/023" 2023-10-18T14:09:14.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.855 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.855 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.855 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2401771678, 2023-10-18T14:09:14.856 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631465, 2023-10-18T14:09:14.856 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/390.out" 2023-10-18T14:09:14.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.856 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.856 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.857 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2421819654, 2023-10-18T14:09:14.857 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629838, 2023-10-18T14:09:14.857 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/195.out" 2023-10-18T14:09:14.857 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.857 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.858 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.858 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2484360527, 2023-10-18T14:09:14.858 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632535, 2023-10-18T14:09:14.858 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/173" 2023-10-18T14:09:14.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.859 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.859 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2519791515, 2023-10-18T14:09:14.859 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629040, 2023-10-18T14:09:14.859 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/418.out" 2023-10-18T14:09:14.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.860 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.860 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2524150972, 2023-10-18T14:09:14.860 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628349, 2023-10-18T14:09:14.861 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/023.out" 2023-10-18T14:09:14.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.861 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.861 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.861 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2551884383, 2023-10-18T14:09:14.862 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633093, 2023-10-18T14:09:14.862 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/475" 2023-10-18T14:09:14.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.862 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.863 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2571108685, 2023-10-18T14:09:14.863 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631495, 2023-10-18T14:09:14.863 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/405.out" 2023-10-18T14:09:14.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.863 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.864 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.864 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2572163541, 2023-10-18T14:09:14.864 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631415, 2023-10-18T14:09:14.864 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/365.out" 2023-10-18T14:09:14.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.865 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.865 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.865 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2574237359, 2023-10-18T14:09:14.865 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629056, 2023-10-18T14:09:14.865 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/426.out" 2023-10-18T14:09:14.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.866 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.866 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.866 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2575666247, 2023-10-18T14:09:14.866 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630870, 2023-10-18T14:09:14.867 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/102.out" 2023-10-18T14:09:14.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.867 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.867 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.867 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2578238804, 2023-10-18T14:09:14.868 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631266, 2023-10-18T14:09:14.868 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/291.out" 2023-10-18T14:09:14.868 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.868 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.868 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.868 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2587617284, 2023-10-18T14:09:14.869 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631639, 2023-10-18T14:09:14.869 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/477.out" 2023-10-18T14:09:14.869 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.869 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.869 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.870 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2589401833, 2023-10-18T14:09:14.870 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633168, 2023-10-18T14:09:14.870 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/546" 2023-10-18T14:09:14.870 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.870 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.871 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.871 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2601256414, 2023-10-18T14:09:14.871 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630930, 2023-10-18T14:09:14.871 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/129.out" 2023-10-18T14:09:14.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.872 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.872 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.872 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2613212479, 2023-10-18T14:09:14.872 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633204, 2023-10-18T14:09:14.872 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/577" 2023-10-18T14:09:14.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.873 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.873 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.873 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2630499848, 2023-10-18T14:09:14.873 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629899, 2023-10-18T14:09:14.874 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/252.out" 2023-10-18T14:09:14.874 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.874 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.874 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.874 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2630728693, 2023-10-18T14:09:14.875 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630946, 2023-10-18T14:09:14.875 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/137.out" 2023-10-18T14:09:14.875 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.875 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.875 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.876 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2632569568, 2023-10-18T14:09:14.876 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631643, 2023-10-18T14:09:14.876 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/479.out" 2023-10-18T14:09:14.876 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.876 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.877 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.877 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2658470214, 2023-10-18T14:09:14.877 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631198, 2023-10-18T14:09:14.877 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/257.out" 2023-10-18T14:09:14.877 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.878 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.878 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.878 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2661361341, 2023-10-18T14:09:14.878 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632492, 2023-10-18T14:09:14.878 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/133" 2023-10-18T14:09:14.879 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.879 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.879 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.879 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2678338872, 2023-10-18T14:09:14.879 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628475, 2023-10-18T14:09:14.880 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/016.out" 2023-10-18T14:09:14.880 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.880 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.880 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.880 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2694788771, 2023-10-18T14:09:14.881 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630758, 2023-10-18T14:09:14.881 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/047.out" 2023-10-18T14:09:14.881 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.881 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.881 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.882 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2723167423, 2023-10-18T14:09:14.882 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631581, 2023-10-18T14:09:14.882 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/448.out" 2023-10-18T14:09:14.882 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.882 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.883 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.883 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2734412377, 2023-10-18T14:09:14.883 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631593, 2023-10-18T14:09:14.883 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/454.out" 2023-10-18T14:09:14.883 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.884 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.884 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.884 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2737901983, 2023-10-18T14:09:14.884 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632937, 2023-10-18T14:09:14.884 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/330" 2023-10-18T14:09:14.885 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.885 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.885 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.885 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2744665561, 2023-10-18T14:09:14.885 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630784, 2023-10-18T14:09:14.886 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/060.out" 2023-10-18T14:09:14.886 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.886 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.886 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.886 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2746082769, 2023-10-18T14:09:14.887 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628654, 2023-10-18T14:09:14.887 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/100.out" 2023-10-18T14:09:14.887 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.887 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.887 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.888 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2757056338, 2023-10-18T14:09:14.888 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630053, 2023-10-18T14:09:14.888 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/541.out" 2023-10-18T14:09:14.888 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.888 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.889 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.889 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2809591966, 2023-10-18T14:09:14.889 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631678, 2023-10-18T14:09:14.889 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/497.out" 2023-10-18T14:09:14.889 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.890 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.890 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.890 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2815642410, 2023-10-18T14:09:14.890 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632540, 2023-10-18T14:09:14.890 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/178" 2023-10-18T14:09:14.891 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.891 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.891 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.891 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2842664148, 2023-10-18T14:09:14.891 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632546, 2023-10-18T14:09:14.892 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/184" 2023-10-18T14:09:14.892 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.892 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.892 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.892 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2846783183, 2023-10-18T14:09:14.892 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631559, 2023-10-18T14:09:14.893 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/437.out" 2023-10-18T14:09:14.893 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.893 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.893 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.893 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2868719160, 2023-10-18T14:09:14.894 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633011, 2023-10-18T14:09:14.894 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/399" 2023-10-18T14:09:14.894 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.894 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.894 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.895 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2895888410, 2023-10-18T14:09:14.895 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633660, 2023-10-18T14:09:14.895 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/006" 2023-10-18T14:09:14.895 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.895 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.895 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.896 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2907392024, 2023-10-18T14:09:14.896 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630942, 2023-10-18T14:09:14.896 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/135.out" 2023-10-18T14:09:14.896 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.896 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.897 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.897 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2923719121, 2023-10-18T14:09:14.897 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631312, 2023-10-18T14:09:14.897 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/314.out" 2023-10-18T14:09:14.897 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.898 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.898 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.898 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2936877571, 2023-10-18T14:09:14.898 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632296, 2023-10-18T14:09:14.898 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/015" 2023-10-18T14:09:14.899 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.899 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.899 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.899 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2943784009, 2023-10-18T14:09:14.899 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631543, 2023-10-18T14:09:14.900 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/429.out" 2023-10-18T14:09:14.900 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.900 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.900 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.900 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2949348452, 2023-10-18T14:09:14.901 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632609, 2023-10-18T14:09:14.901 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/245" 2023-10-18T14:09:14.901 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.901 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.901 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.901 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2952535774, 2023-10-18T14:09:14.902 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628758, 2023-10-18T14:09:14.902 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/152.out" 2023-10-18T14:09:14.902 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.902 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.902 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.903 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2953696650, 2023-10-18T14:09:14.903 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632536, 2023-10-18T14:09:14.903 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/174" 2023-10-18T14:09:14.903 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.903 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.904 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.904 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2958575812, 2023-10-18T14:09:14.904 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632375, 2023-10-18T14:09:14.904 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/033.out" 2023-10-18T14:09:14.904 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.904 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.905 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.905 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2982010694, 2023-10-18T14:09:14.905 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633020, 2023-10-18T14:09:14.905 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/407" 2023-10-18T14:09:14.905 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.906 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.906 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.906 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2987088304, 2023-10-18T14:09:14.906 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631010, 2023-10-18T14:09:14.906 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/169.out" 2023-10-18T14:09:14.907 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.907 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.907 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.907 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3008846405, 2023-10-18T14:09:14.907 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628467, 2023-10-18T14:09:14.908 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/012.out" 2023-10-18T14:09:14.908 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.908 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.908 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.909 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3011995340, 2023-10-18T14:09:14.909 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630780, 2023-10-18T14:09:14.909 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/058.out" 2023-10-18T14:09:14.909 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.909 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.910 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.910 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3026736397, 2023-10-18T14:09:14.910 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632470, 2023-10-18T14:09:14.910 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/111" 2023-10-18T14:09:14.910 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.911 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.911 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.911 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3043435295, 2023-10-18T14:09:14.911 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630686, 2023-10-18T14:09:14.911 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/012.out" 2023-10-18T14:09:14.912 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.912 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.912 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.912 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3044547716, 2023-10-18T14:09:14.912 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631619, 2023-10-18T14:09:14.912 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/467.out" 2023-10-18T14:09:14.913 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.913 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.913 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.913 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3058384019, 2023-10-18T14:09:14.913 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629018, 2023-10-18T14:09:14.914 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/407.out" 2023-10-18T14:09:14.914 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.914 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.914 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.915 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3061011205, 2023-10-18T14:09:14.915 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631651, 2023-10-18T14:09:14.915 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/483.out" 2023-10-18T14:09:14.915 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.915 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.916 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.916 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3098536813, 2023-10-18T14:09:14.916 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632923, 2023-10-18T14:09:14.916 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/316" 2023-10-18T14:09:14.916 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.916 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.917 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.917 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3113455432, 2023-10-18T14:09:14.917 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629828, 2023-10-18T14:09:14.917 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/190.out" 2023-10-18T14:09:14.917 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.918 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.918 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.918 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3115950571, 2023-10-18T14:09:14.918 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633212, 2023-10-18T14:09:14.918 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/584" 2023-10-18T14:09:14.919 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.919 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.919 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.919 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3157317539, 2023-10-18T14:09:14.919 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628776, 2023-10-18T14:09:14.920 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/161.out" 2023-10-18T14:09:14.920 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.920 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.920 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.920 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3191307101, 2023-10-18T14:09:14.921 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629046, 2023-10-18T14:09:14.921 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/421.out" 2023-10-18T14:09:14.921 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.921 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.921 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.921 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3198943125, 2023-10-18T14:09:14.922 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630772, 2023-10-18T14:09:14.922 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/054.out" 2023-10-18T14:09:14.922 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.922 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.922 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.923 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3201373789, 2023-10-18T14:09:14.923 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629903, 2023-10-18T14:09:14.923 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/254.out" 2023-10-18T14:09:14.923 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.923 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.924 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.924 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3205641002, 2023-10-18T14:09:14.924 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633001, 2023-10-18T14:09:14.924 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/390" 2023-10-18T14:09:14.924 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.925 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.925 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.925 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3215666497, 2023-10-18T14:09:14.925 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629800, 2023-10-18T14:09:14.925 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/176.out" 2023-10-18T14:09:14.926 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.926 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.926 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.926 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3224229736, 2023-10-18T14:09:14.926 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632409, 2023-10-18T14:09:14.927 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/052" 2023-10-18T14:09:14.927 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.927 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.927 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.927 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3229190985, 2023-10-18T14:09:14.928 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632930, 2023-10-18T14:09:14.928 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/323" 2023-10-18T14:09:14.928 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.928 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.928 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.928 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3238268925, 2023-10-18T14:09:14.929 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631547, 2023-10-18T14:09:14.929 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/431.out" 2023-10-18T14:09:14.929 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.929 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.929 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.930 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3264735352, 2023-10-18T14:09:14.930 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628762, 2023-10-18T14:09:14.930 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/154.out" 2023-10-18T14:09:14.930 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.930 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.931 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.931 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3269289872, 2023-10-18T14:09:14.931 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633119, 2023-10-18T14:09:14.931 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/499" 2023-10-18T14:09:14.931 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.932 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.932 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.932 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3311162202, 2023-10-18T14:09:14.932 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633200, 2023-10-18T14:09:14.932 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/574.out" 2023-10-18T14:09:14.933 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.933 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.933 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.933 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3312472010, 2023-10-18T14:09:14.933 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628429, 2023-10-18T14:09:14.934 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/303.out" 2023-10-18T14:09:14.934 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.934 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.934 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.934 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3351386203, 2023-10-18T14:09:14.935 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628355, 2023-10-18T14:09:14.935 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/026.out" 2023-10-18T14:09:14.935 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.935 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.935 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.936 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3368140561, 2023-10-18T14:09:14.936 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632906, 2023-10-18T14:09:14.936 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/299" 2023-10-18T14:09:14.936 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.936 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.936 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.937 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3382457269, 2023-10-18T14:09:14.937 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629846, 2023-10-18T14:09:14.937 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/199.out" 2023-10-18T14:09:14.937 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.937 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.938 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.938 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3383533454, 2023-10-18T14:09:14.938 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633221, 2023-10-18T14:09:14.938 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/592" 2023-10-18T14:09:14.938 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.939 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.939 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.939 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3397157284, 2023-10-18T14:09:14.939 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632343, 2023-10-18T14:09:14.939 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/007" 2023-10-18T14:09:14.940 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.940 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.940 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.940 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3417892660, 2023-10-18T14:09:14.940 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629280, 2023-10-18T14:09:14.940 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/538.out" 2023-10-18T14:09:14.941 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.941 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.941 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.941 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3452859122, 2023-10-18T14:09:14.941 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632497, 2023-10-18T14:09:14.942 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/138" 2023-10-18T14:09:14.942 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.942 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.942 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.943 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3465445193, 2023-10-18T14:09:14.943 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632941, 2023-10-18T14:09:14.943 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/334" 2023-10-18T14:09:14.943 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.943 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.944 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.944 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3466458673, 2023-10-18T14:09:14.944 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632475, 2023-10-18T14:09:14.944 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/116" 2023-10-18T14:09:14.944 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.945 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.945 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.945 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3474247112, 2023-10-18T14:09:14.945 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628825, 2023-10-18T14:09:14.945 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/211.out" 2023-10-18T14:09:14.946 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.946 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.946 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.946 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3484341660, 2023-10-18T14:09:14.946 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631555, 2023-10-18T14:09:14.947 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/435.out" 2023-10-18T14:09:14.947 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.947 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.947 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.947 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3527284573, 2023-10-18T14:09:14.947 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630835, 2023-10-18T14:09:14.948 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/085.out" 2023-10-18T14:09:14.948 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.948 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.948 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.948 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3530685828, 2023-10-18T14:09:14.949 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629118, 2023-10-18T14:09:14.949 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/457.out" 2023-10-18T14:09:14.949 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.949 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.949 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.950 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3538040980, 2023-10-18T14:09:14.950 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629034, 2023-10-18T14:09:14.950 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/415.out" 2023-10-18T14:09:14.950 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.950 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.951 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.951 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3543828167, 2023-10-18T14:09:14.951 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631658, 2023-10-18T14:09:14.951 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/487.out" 2023-10-18T14:09:14.951 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.951 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.952 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.952 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3584681604, 2023-10-18T14:09:14.952 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628772, 2023-10-18T14:09:14.952 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/159.out" 2023-10-18T14:09:14.952 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.953 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.953 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.953 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3591743627, 2023-10-18T14:09:14.953 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629919, 2023-10-18T14:09:14.953 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/262.out" 2023-10-18T14:09:14.953 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.954 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.954 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.954 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3593754049, 2023-10-18T14:09:14.954 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633132, 2023-10-18T14:09:14.954 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/511" 2023-10-18T14:09:14.955 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.955 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.955 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.955 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3607602210, 2023-10-18T14:09:14.955 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632898, 2023-10-18T14:09:14.956 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/001" 2023-10-18T14:09:14.956 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.956 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.956 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.956 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3611434023, 2023-10-18T14:09:14.956 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632604, 2023-10-18T14:09:14.957 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/240" 2023-10-18T14:09:14.957 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.957 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.957 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.957 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3625789921, 2023-10-18T14:09:14.958 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630075, 2023-10-18T14:09:14.958 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/552.out" 2023-10-18T14:09:14.958 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.958 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.958 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.958 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3657485554, 2023-10-18T14:09:14.959 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631517, 2023-10-18T14:09:14.959 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/416.out" 2023-10-18T14:09:14.959 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.959 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.959 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.960 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3659783065, 2023-10-18T14:09:14.960 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632518, 2023-10-18T14:09:14.960 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/156" 2023-10-18T14:09:14.960 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.960 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.960 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.961 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3664936527, 2023-10-18T14:09:14.961 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629002, 2023-10-18T14:09:14.961 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/399.out" 2023-10-18T14:09:14.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.961 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.962 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.962 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3679620684, 2023-10-18T14:09:14.962 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630857, 2023-10-18T14:09:14.962 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/096.out.external" 2023-10-18T14:09:14.962 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.963 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.963 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.963 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3691959405, 2023-10-18T14:09:14.963 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632630, 2023-10-18T14:09:14.963 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/266" 2023-10-18T14:09:14.964 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.964 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.964 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.964 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3704223249, 2023-10-18T14:09:14.964 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631676, 2023-10-18T14:09:14.965 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/496.out" 2023-10-18T14:09:14.965 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.965 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.965 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.965 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3706319889, 2023-10-18T14:09:14.966 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630908, 2023-10-18T14:09:14.966 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/118.out" 2023-10-18T14:09:14.966 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.966 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.966 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.967 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3746550706, 2023-10-18T14:09:14.969 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632294, 2023-10-18T14:09:14.970 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/013" 2023-10-18T14:09:14.970 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.970 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.970 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.970 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3787431705, 2023-10-18T14:09:14.970 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628437, 2023-10-18T14:09:14.971 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/307.out" 2023-10-18T14:09:14.971 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.971 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.971 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.971 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3789607320, 2023-10-18T14:09:14.972 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632432, 2023-10-18T14:09:14.972 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/075" 2023-10-18T14:09:14.972 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.972 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.973 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.973 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3836270176, 2023-10-18T14:09:14.973 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632521, 2023-10-18T14:09:14.973 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/159" 2023-10-18T14:09:14.973 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.973 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.974 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.974 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3899005886, 2023-10-18T14:09:14.974 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630796, 2023-10-18T14:09:14.974 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/066.out" 2023-10-18T14:09:14.975 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.975 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.975 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.975 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3918424604, 2023-10-18T14:09:14.975 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631533, 2023-10-18T14:09:14.975 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/424.out" 2023-10-18T14:09:14.976 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.976 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.976 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.976 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3925646377, 2023-10-18T14:09:14.976 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631686, 2023-10-18T14:09:14.977 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/501.out" 2023-10-18T14:09:14.977 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.977 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.977 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.977 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3933645815, 2023-10-18T14:09:14.977 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630017, 2023-10-18T14:09:14.978 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/311.out" 2023-10-18T14:09:14.978 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.978 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.978 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.978 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3946925241, 2023-10-18T14:09:14.979 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632290, 2023-10-18T14:09:14.979 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/009" 2023-10-18T14:09:14.979 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.979 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.979 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.980 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3955526492, 2023-10-18T14:09:14.980 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629893, 2023-10-18T14:09:14.980 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/249.out" 2023-10-18T14:09:14.980 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.980 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.981 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.981 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4009572761, 2023-10-18T14:09:14.981 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629082, 2023-10-18T14:09:14.981 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/439.out" 2023-10-18T14:09:14.981 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.981 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.982 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.982 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4016903055, 2023-10-18T14:09:14.982 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631000, 2023-10-18T14:09:14.982 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/164.out" 2023-10-18T14:09:14.982 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.983 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.983 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.983 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4031059803, 2023-10-18T14:09:14.983 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631330, 2023-10-18T14:09:14.983 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/323.out" 2023-10-18T14:09:14.984 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.984 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.984 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.984 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4063014984, 2023-10-18T14:09:14.984 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628656, 2023-10-18T14:09:14.985 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/101.out" 2023-10-18T14:09:14.985 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.985 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.985 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.985 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4114815415, 2023-10-18T14:09:14.986 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632979, 2023-10-18T14:09:14.986 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/370" 2023-10-18T14:09:14.986 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.986 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.986 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.987 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4122178021, 2023-10-18T14:09:14.987 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630912, 2023-10-18T14:09:14.987 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/120.out" 2023-10-18T14:09:14.987 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.987 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.987 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.988 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4155051030, 2023-10-18T14:09:14.988 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630107, 2023-10-18T14:09:14.988 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/568.out" 2023-10-18T14:09:14.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.988 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.989 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.989 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4160395073, 2023-10-18T14:09:14.989 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631513, 2023-10-18T14:09:14.989 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/414.out" 2023-10-18T14:09:14.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.990 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.990 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.990 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4168073724, 2023-10-18T14:09:14.990 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628740, 2023-10-18T14:09:14.991 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/143.out" 2023-10-18T14:09:14.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.991 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.991 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4204030341, 2023-10-18T14:09:14.991 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631268, 2023-10-18T14:09:14.992 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/292.out" 2023-10-18T14:09:14.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.992 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.993 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4212544387, 2023-10-18T14:09:14.993 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632997, 2023-10-18T14:09:14.993 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/386" 2023-10-18T14:09:14.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.993 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.994 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.994 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4214336016, 2023-10-18T14:09:14.994 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628819, 2023-10-18T14:09:14.994 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/208.out" 2023-10-18T14:09:14.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.995 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.995 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.995 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4229285169, 2023-10-18T14:09:14.995 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632411, 2023-10-18T14:09:14.995 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/054" 2023-10-18T14:09:14.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.996 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.996 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.996 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4257787400, 2023-10-18T14:09:14.996 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633311, 2023-10-18T14:09:14.997 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.op" 2023-10-18T14:09:14.997 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.997 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.997 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.997 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4272968277, 2023-10-18T14:09:14.998 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628766, 2023-10-18T14:09:14.998 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/156.out" 2023-10-18T14:09:14.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:14.998 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:14.998 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:14.999 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4288614041, 2023-10-18T14:09:14.999 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630385, 2023-10-18T14:09:14.999 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/581.out" 2023-10-18T14:09:14.999 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:09:15.000 INFO:teuthology.orchestra.run.smithi114.stdout:] 2023-10-18T14:09:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70a5f17700 1 -- 172.21.15.114:0/3498076653 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f70880a15f0 msgr2=0x7f70880a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70a5f17700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f70880a15f0 0x7f70880a3ab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7090005fd0 tx=0x7f7090005dc0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70a5f17700 1 -- 172.21.15.114:0/3498076653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70a00ff120 msgr2=0x7f70a0100300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70a5f17700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70a00ff120 0x7f70a0100300 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7094004760 tx=0x7f7094004790 comp rx=0 tx=0).stop 2023-10-18T14:09:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70a5f17700 1 -- 172.21.15.114:0/3498076653 shutdown_connections 2023-10-18T14:09:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70a5f17700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f70880a15f0 0x7f70880a3ab0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70a5f17700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70a0106860 0x7f70a0100d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70a5f17700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70a00ff120 0x7f70a0100300 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70a5f17700 1 --2- 172.21.15.114:0/3498076653 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f70a00ffae0 0x7f70a0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70a5f17700 1 -- 172.21.15.114:0/3498076653 >> 172.21.15.114:0/3498076653 conn(0x7f70a0074890 msgr2=0x7f70a00fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:15.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70a5f17700 1 -- 172.21.15.114:0/3498076653 shutdown_connections 2023-10-18T14:09:15.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:14.621+0000 7f70a5f17700 1 -- 172.21.15.114:0/3498076653 wait complete. 2023-10-18T14:09:15.004 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:14 smithi114 ceph-mon[99494]: pgmap v437: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 KiB/s wr, 13 op/s 2023-10-18T14:09:15.005 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-18T14:09:15.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:14 smithi172 ceph-mon[103574]: pgmap v437: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 KiB/s wr, 13 op/s 2023-10-18T14:09:15.006 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:14 smithi158 ceph-mon[103317]: pgmap v437: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 KiB/s wr, 13 op/s 2023-10-18T14:09:15.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.137+0000 7fd37cfbd700 1 -- 172.21.15.114:0/3499747178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd378100000 msgr2=0x7fd37810c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.137+0000 7fd37cfbd700 1 --2- 172.21.15.114:0/3499747178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd378100000 0x7fd37810c510 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd37000b0a0 tx=0x7fd37000b3b0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.137+0000 7fd37cfbd700 1 -- 172.21.15.114:0/3499747178 shutdown_connections 2023-10-18T14:09:15.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.137+0000 7fd37cfbd700 1 --2- 172.21.15.114:0/3499747178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd378100000 0x7fd37810c510 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.137+0000 7fd37cfbd700 1 --2- 172.21.15.114:0/3499747178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd378105650 0x7fd378105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.137+0000 7fd37cfbd700 1 --2- 172.21.15.114:0/3499747178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3780ff640 0x7fd3780ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.137+0000 7fd37cfbd700 1 -- 172.21.15.114:0/3499747178 >> 172.21.15.114:0/3499747178 conn(0x7fd378076790 msgr2=0x7fd378076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:15.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.137+0000 7fd37cfbd700 1 -- 172.21.15.114:0/3499747178 shutdown_connections 2023-10-18T14:09:15.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.137+0000 7fd37cfbd700 1 -- 172.21.15.114:0/3499747178 wait complete. 2023-10-18T14:09:15.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.138+0000 7fd37cfbd700 1 Processor -- start 2023-10-18T14:09:15.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.138+0000 7fd37cfbd700 1 -- start start 2023-10-18T14:09:15.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.138+0000 7fd37cfbd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3780ff640 0x7fd37819b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.138+0000 7fd37cfbd700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd378100000 0x7fd37819bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.138+0000 7fd37cfbd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd378105650 0x7fd3781957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.138+0000 7fd37cfbd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd378195e70 con 0x7fd3780ff640 2023-10-18T14:09:15.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.138+0000 7fd37cfbd700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd378195fe0 con 0x7fd378100000 2023-10-18T14:09:15.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.138+0000 7fd37cfbd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3781961a0 con 0x7fd378105650 2023-10-18T14:09:15.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd37659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3780ff640 0x7fd37819b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd37659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3780ff640 0x7fd37819b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46600/0 (socket says 172.21.15.114:46600) 2023-10-18T14:09:15.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd37659c700 1 -- 172.21.15.114:0/1550890698 learned_addr learned my addr 172.21.15.114:0/1550890698 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:15.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd375d9b700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd378100000 0x7fd37819bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd376d9d700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd378105650 0x7fd3781957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd37659c700 1 -- 172.21.15.114:0/1550890698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd378105650 msgr2=0x7fd3781957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd37659c700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd378105650 0x7fd3781957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd37659c700 1 -- 172.21.15.114:0/1550890698 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd378100000 msgr2=0x7fd37819bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd37659c700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd378100000 0x7fd37819bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd37659c700 1 -- 172.21.15.114:0/1550890698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd370009d00 con 0x7fd3780ff640 2023-10-18T14:09:15.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd376d9d700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd378105650 0x7fd3781957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:09:15.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd375d9b700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd378100000 0x7fd37819bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:09:15.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd37659c700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3780ff640 0x7fd37819b670 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00e9a0 tx=0x7fd36c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:15.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd3677fe700 1 -- 172.21.15.114:0/1550890698 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c009790 con 0x7fd3780ff640 2023-10-18T14:09:15.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd3677fe700 1 -- 172.21.15.114:0/1550890698 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd36c00cbd0 con 0x7fd3780ff640 2023-10-18T14:09:15.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd37cfbd700 1 -- 172.21.15.114:0/1550890698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd378196480 con 0x7fd3780ff640 2023-10-18T14:09:15.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd3677fe700 1 -- 172.21.15.114:0/1550890698 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c018680 con 0x7fd3780ff640 2023-10-18T14:09:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.139+0000 7fd37cfbd700 1 -- 172.21.15.114:0/1550890698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3781a26a0 con 0x7fd3780ff640 2023-10-18T14:09:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.141+0000 7fd3677fe700 1 -- 172.21.15.114:0/1550890698 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fd36c00cd40 con 0x7fd3780ff640 2023-10-18T14:09:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.142+0000 7fd3677fe700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3600a15f0 0x7fd3600a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.142+0000 7fd3677fe700 1 -- 172.21.15.114:0/1550890698 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd36c014070 con 0x7fd3780ff640 2023-10-18T14:09:15.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.142+0000 7fd375d9b700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3600a15f0 0x7fd3600a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.142+0000 7fd375d9b700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3600a15f0 0x7fd3600a3ab0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd378196ef0 tx=0x7fd36800b5f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:15.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.142+0000 7fd3891a6b80 1 Processor -- start 2023-10-18T14:09:15.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd3891a6b80 1 -- start start 2023-10-18T14:09:15.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd3891a6b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecabe0 0x55b430ecafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd3891a6b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 0x55b430ec5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd3891a6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 0x55b430ec5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd3891a6b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b430e386e0 con 0x55b430ecb500 2023-10-18T14:09:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd3891a6b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b430e1ec60 con 0x55b430ecabe0 2023-10-18T14:09:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd3891a6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b430e1c580 con 0x55b430ec55d0 2023-10-18T14:09:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd375d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 0x55b430ec5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd375d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 0x55b430ec5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46610/0 (socket says 172.21.15.114:46610) 2023-10-18T14:09:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd375d9b700 1 -- 172.21.15.114:0/1572252076 learned_addr learned my addr 172.21.15.114:0/1572252076 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd375d9b700 1 -- 172.21.15.114:0/1572252076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 msgr2=0x55b430ec5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd375d9b700 1 --2- 172.21.15.114:0/1572252076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 0x55b430ec5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd375d9b700 1 -- 172.21.15.114:0/1572252076 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecabe0 msgr2=0x55b430ecafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd37659c700 1 --2- 172.21.15.114:0/1572252076 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecabe0 0x55b430ecafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd375d9b700 1 --2- 172.21.15.114:0/1572252076 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecabe0 0x55b430ecafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd375d9b700 1 -- 172.21.15.114:0/1572252076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b430dd53f0 con 0x55b430ecb500 2023-10-18T14:09:15.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.143+0000 7fd375d9b700 1 --2- 172.21.15.114:0/1572252076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 0x55b430ec5090 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd36800fce0 tx=0x7fd368012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91625f375d2dddc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:15.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.144+0000 7fd364ff9700 1 -- 172.21.15.114:0/1572252076 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368011b80 con 0x55b430ecb500 2023-10-18T14:09:15.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.144+0000 7fd364ff9700 1 -- 172.21.15.114:0/1572252076 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd368011ce0 con 0x55b430ecb500 2023-10-18T14:09:15.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.144+0000 7fd364ff9700 1 -- 172.21.15.114:0/1572252076 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36801d6e0 con 0x55b430ecb500 2023-10-18T14:09:15.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.144+0000 7fd3891a6b80 1 -- 172.21.15.114:0/1572252076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 msgr2=0x55b430ec5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.144+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/1572252076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 0x55b430ec5090 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd36800fce0 tx=0x7fd368012000 comp rx=0 tx=0).stop 2023-10-18T14:09:15.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.144+0000 7fd3891a6b80 1 -- 172.21.15.114:0/1572252076 shutdown_connections 2023-10-18T14:09:15.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.144+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/1572252076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 0x55b430ec5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.144+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/1572252076 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecabe0 0x55b430ecafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.144+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/1572252076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 0x55b430ec5090 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.144+0000 7fd3891a6b80 1 -- 172.21.15.114:0/1572252076 >> 172.21.15.114:0/1572252076 conn(0x55b430e39720 msgr2=0x55b430ebfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:15.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.144+0000 7fd3891a6b80 1 -- 172.21.15.114:0/1572252076 shutdown_connections 2023-10-18T14:09:15.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.144+0000 7fd3891a6b80 1 -- 172.21.15.114:0/1572252076 wait complete. 2023-10-18T14:09:15.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd3891a6b80 1 -- start start 2023-10-18T14:09:15.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd3891a6b80 1 Processor -- start 2023-10-18T14:09:15.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd3891a6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 0x55b430ed1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd3891a6b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecabe0 0x55b430ece830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd3891a6b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 0x55b430ecef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd3891a6b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b430e17e70 con 0x55b430ecb500 2023-10-18T14:09:15.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd3891a6b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b430db4710 con 0x55b430ecabe0 2023-10-18T14:09:15.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd3891a6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b430db43b0 con 0x55b430ec55d0 2023-10-18T14:09:15.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd3891a6b80 10 client.0 _ll_register_callbacks cb 0x55b430cfea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:09:15.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd376d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 0x55b430ecef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd376d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 0x55b430ecef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46618/0 (socket says 172.21.15.114:46618) 2023-10-18T14:09:15.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd376d9d700 1 -- 172.21.15.114:0/2509447638 learned_addr learned my addr 172.21.15.114:0/2509447638 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:15.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd37659c700 1 --2- 172.21.15.114:0/2509447638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 0x55b430ed1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd375d9b700 1 --2- 172.21.15.114:0/2509447638 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecabe0 0x55b430ece830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.145+0000 7fd376d9d700 1 -- 172.21.15.114:0/2509447638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 msgr2=0x55b430ed1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd376d9d700 1 --2- 172.21.15.114:0/2509447638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 0x55b430ed1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd376d9d700 1 -- 172.21.15.114:0/2509447638 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecabe0 msgr2=0x55b430ece830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd376d9d700 1 --2- 172.21.15.114:0/2509447638 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecabe0 0x55b430ece830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd376d9d700 1 -- 172.21.15.114:0/2509447638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36800f9c0 con 0x55b430ecb500 2023-10-18T14:09:15.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd376d9d700 1 --2- 172.21.15.114:0/2509447638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 0x55b430ecef70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd3700062a0 tx=0x7fd37000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf160c3184a6154 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:15.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd35dffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:09:15.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd35dffb700 1 -- 172.21.15.114:0/2509447638 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37000e070 con 0x55b430ecb500 2023-10-18T14:09:15.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd35dffb700 1 -- 172.21.15.114:0/2509447638 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd370009450 con 0x55b430ecb500 2023-10-18T14:09:15.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd3891a6b80 1 -- 172.21.15.114:0/2509447638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b430e1cef0 con 0x55b430ecb500 2023-10-18T14:09:15.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd35dffb700 1 -- 172.21.15.114:0/2509447638 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd370004e60 con 0x55b430ecb500 2023-10-18T14:09:15.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd3891a6b80 10 client.16656 fetch_fsmap learned FSMap version 44 2023-10-18T14:09:15.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd3891a6b80 1 -- 172.21.15.114:0/2509447638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55b430c42de0 con 0x55b430ecb500 2023-10-18T14:09:15.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd35dffb700 1 -- 172.21.15.114:0/2509447638 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd370030020 con 0x55b430ecb500 2023-10-18T14:09:15.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd35dffb700 1 -- 172.21.15.114:0/2509447638 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 44) v1 ==== 7958+0+0 (secure 0 0 0) 0x7fd37001ac20 con 0x55b430ecb500 2023-10-18T14:09:15.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd3891a6b80 10 client.16656 fetch_fsmap finished waiting for FSMap version 44 2023-10-18T14:09:15.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd3891a6b80 10 client.16656 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.b 2023-10-18T14:09:15.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd3891a6b80 20 client.16656 populate_metadata read hostname 'smithi114' 2023-10-18T14:09:15.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/2509447638 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b430edefa0 0x55b430ee13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd3891a6b80 4 client.16656 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:09:15.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.146+0000 7fd3891a6b80 1 -- 172.21.15.114:0/2509447638 --> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b430e948b0 con 0x55b430edefa0 2023-10-18T14:09:15.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.147+0000 7fd37659c700 1 --2- 172.21.15.114:0/2509447638 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b430edefa0 0x55b430ee13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.147+0000 7fd35dffb700 10 client.16656 ms_handle_connect on v2:172.21.15.158:6838/2616400572 2023-10-18T14:09:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.147+0000 7fd37659c700 1 --2- 172.21.15.114:0/2509447638 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b430edefa0 0x55b430ee13c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=23d6a82fb41d944a server_cookie=e4df41e0675000 in_seq=0 out_seq=0 2023-10-18T14:09:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd35dffb700 1 -- 172.21.15.114:0/2509447638 <== mds.3 v2:172.21.15.158:6838/2616400572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x7fd36c0b2e90 con 0x55b430edefa0 2023-10-18T14:09:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd35dffb700 10 client.16656 handle_command_reply: tid=0 2023-10-18T14:09:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd3891a6b80 1 client.16656 shutdown 2023-10-18T14:09:15.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd3891a6b80 1 -- 172.21.15.114:0/2509447638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 msgr2=0x55b430ecef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/2509447638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 0x55b430ecef70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd3700062a0 tx=0x7fd37000bce0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd3891a6b80 1 -- 172.21.15.114:0/2509447638 shutdown_connections 2023-10-18T14:09:15.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/2509447638 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b430edefa0 0x55b430ee13c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/2509447638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecb500 0x55b430ecef70 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd35dffb700 0 client.16656 ms_handle_reset on v2:172.21.15.158:6838/2616400572 2023-10-18T14:09:15.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/2509447638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 0x55b430ed1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/2509447638 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecabe0 0x55b430ece830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd3891a6b80 1 -- 172.21.15.114:0/2509447638 >> 172.21.15.114:0/2509447638 conn(0x55b430e39720 msgr2=0x55b430ec4080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:15.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd3891a6b80 1 -- 172.21.15.114:0/2509447638 shutdown_connections 2023-10-18T14:09:15.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd3891a6b80 1 -- 172.21.15.114:0/2509447638 wait complete. 2023-10-18T14:09:15.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.148+0000 7fd3891a6b80 20 client.16656 trim_cache size 0 max 16384 2023-10-18T14:09:15.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd3891a6b80 1 Processor -- start 2023-10-18T14:09:15.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd3891a6b80 1 -- start start 2023-10-18T14:09:15.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd3891a6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 0x55b430eba5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd3891a6b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 0x55b430ed5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd3891a6b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecb500 0x55b430ec59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd3891a6b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b430c98920 con 0x55b430ecabe0 2023-10-18T14:09:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd3891a6b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b430ec1410 con 0x55b430ecb500 2023-10-18T14:09:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd3891a6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b430ec0920 con 0x55b430ec55d0 2023-10-18T14:09:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd375d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 0x55b430ed5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd375d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 0x55b430ed5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46624/0 (socket says 172.21.15.114:46624) 2023-10-18T14:09:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd375d9b700 1 -- 172.21.15.114:0/3717072080 learned_addr learned my addr 172.21.15.114:0/3717072080 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd37659c700 1 --2- 172.21.15.114:0/3717072080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 0x55b430eba5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd376d9d700 1 --2- 172.21.15.114:0/3717072080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecb500 0x55b430ec59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd375d9b700 1 -- 172.21.15.114:0/3717072080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 msgr2=0x55b430eba5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd375d9b700 1 --2- 172.21.15.114:0/3717072080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 0x55b430eba5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd375d9b700 1 -- 172.21.15.114:0/3717072080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecb500 msgr2=0x55b430ec59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd375d9b700 1 --2- 172.21.15.114:0/3717072080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecb500 0x55b430ec59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd375d9b700 1 -- 172.21.15.114:0/3717072080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b430c2bc60 con 0x55b430ecabe0 2023-10-18T14:09:15.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd376d9d700 1 --2- 172.21.15.114:0/3717072080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecb500 0x55b430ec59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:09:15.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd375d9b700 1 --2- 172.21.15.114:0/3717072080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 0x55b430ed5ee0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd36800fcb0 tx=0x7fd368005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54c37ea68a8b57 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:15.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.161+0000 7fd3657fa700 1 -- 172.21.15.114:0/3717072080 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36802e070 con 0x55b430ecabe0 2023-10-18T14:09:15.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.162+0000 7fd3657fa700 1 -- 172.21.15.114:0/3717072080 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd368011e50 con 0x55b430ecabe0 2023-10-18T14:09:15.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.162+0000 7fd3657fa700 1 -- 172.21.15.114:0/3717072080 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368004c10 con 0x55b430ecabe0 2023-10-18T14:09:15.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.162+0000 7fd3891a6b80 1 -- 172.21.15.114:0/3717072080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 msgr2=0x55b430ed5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.162+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/3717072080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 0x55b430ed5ee0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd36800fcb0 tx=0x7fd368005b20 comp rx=0 tx=0).stop 2023-10-18T14:09:15.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.162+0000 7fd3891a6b80 1 -- 172.21.15.114:0/3717072080 shutdown_connections 2023-10-18T14:09:15.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.162+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/3717072080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ecb500 0x55b430ec59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.162+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/3717072080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ec55d0 0x55b430eba5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.162+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/3717072080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 0x55b430ed5ee0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.162+0000 7fd3891a6b80 1 -- 172.21.15.114:0/3717072080 >> 172.21.15.114:0/3717072080 conn(0x55b430e39720 msgr2=0x55b430ece0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:15.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.162+0000 7fd3891a6b80 1 -- 172.21.15.114:0/3717072080 shutdown_connections 2023-10-18T14:09:15.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.162+0000 7fd3891a6b80 1 -- 172.21.15.114:0/3717072080 wait complete. 2023-10-18T14:09:15.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.162+0000 7fd3891a6b80 1 -- start start 2023-10-18T14:09:15.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.162+0000 7fd3891a6b80 1 Processor -- start 2023-10-18T14:09:15.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd3891a6b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ec55d0 0x55b430ed5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd3891a6b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 0x55b430ed42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd3891a6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ecb500 0x55b430ed4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd3891a6b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b430ed4f70 con 0x55b430ecabe0 2023-10-18T14:09:15.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd3891a6b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b430ed50e0 con 0x55b430ec55d0 2023-10-18T14:09:15.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd3891a6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b430f32de0 con 0x55b430ecb500 2023-10-18T14:09:15.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd3891a6b80 10 client.0 _ll_register_callbacks cb 0x55b430cfea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:09:15.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd375d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 0x55b430ed42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd375d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 0x55b430ed42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46630/0 (socket says 172.21.15.114:46630) 2023-10-18T14:09:15.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd375d9b700 1 -- 172.21.15.114:0/3309008523 learned_addr learned my addr 172.21.15.114:0/3309008523 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:15.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd37659c700 1 --2- 172.21.15.114:0/3309008523 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ec55d0 0x55b430ed5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd375d9b700 1 -- 172.21.15.114:0/3309008523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ecb500 msgr2=0x55b430ed4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd375d9b700 1 --2- 172.21.15.114:0/3309008523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ecb500 0x55b430ed4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd375d9b700 1 -- 172.21.15.114:0/3309008523 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ec55d0 msgr2=0x55b430ed5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd375d9b700 1 --2- 172.21.15.114:0/3309008523 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ec55d0 0x55b430ed5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd375d9b700 1 -- 172.21.15.114:0/3309008523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b430dd53f0 con 0x55b430ecabe0 2023-10-18T14:09:15.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd37659c700 1 --2- 172.21.15.114:0/3309008523 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ec55d0 0x55b430ed5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:09:15.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd375d9b700 1 --2- 172.21.15.114:0/3309008523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 0x55b430ed42f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd368012fd0 tx=0x7fd368005330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b45a8dee78f47dd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:15.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd35dffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:09:15.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd35dffb700 1 -- 172.21.15.114:0/3309008523 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36802e040 con 0x55b430ecabe0 2023-10-18T14:09:15.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd3891a6b80 1 -- 172.21.15.114:0/3309008523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd368011ce0 con 0x55b430ecabe0 2023-10-18T14:09:15.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.163+0000 7fd35dffb700 1 -- 172.21.15.114:0/3309008523 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fd368004bc0 con 0x55b430ecabe0 2023-10-18T14:09:15.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd35dffb700 1 -- 172.21.15.114:0/3309008523 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd368011b50 con 0x55b430ecabe0 2023-10-18T14:09:15.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd3891a6b80 10 client.16662 fetch_fsmap learned FSMap version 44 2023-10-18T14:09:15.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd3891a6b80 1 -- 172.21.15.114:0/3309008523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55b430c69250 con 0x55b430ecabe0 2023-10-18T14:09:15.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd35dffb700 1 -- 172.21.15.114:0/3309008523 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd368049080 con 0x55b430ecabe0 2023-10-18T14:09:15.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd35dffb700 1 -- 172.21.15.114:0/3309008523 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 44) v1 ==== 7958+0+0 (secure 0 0 0) 0x7fd368003a10 con 0x55b430ecabe0 2023-10-18T14:09:15.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd3891a6b80 10 client.16662 fetch_fsmap finished waiting for FSMap version 44 2023-10-18T14:09:15.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd3891a6b80 10 client.16662 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.b 2023-10-18T14:09:15.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd3891a6b80 20 client.16662 populate_metadata read hostname 'smithi114' 2023-10-18T14:09:15.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/3309008523 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b430f34200 0x55b430f36620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd3891a6b80 4 client.16662 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:09:15.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd3891a6b80 1 -- 172.21.15.114:0/3309008523 --> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b430e10e50 con 0x55b430f34200 2023-10-18T14:09:15.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd37659c700 1 --2- 172.21.15.114:0/3309008523 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b430f34200 0x55b430f36620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd35dffb700 10 client.16662 ms_handle_connect on v2:172.21.15.158:6838/2616400572 2023-10-18T14:09:15.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.164+0000 7fd37659c700 1 --2- 172.21.15.114:0/3309008523 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b430f34200 0x55b430f36620 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1fb51289d2d45c11 server_cookie=d3ed7cfdc99f854c in_seq=0 out_seq=0 2023-10-18T14:09:15.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd35dffb700 1 -- 172.21.15.114:0/3309008523 <== mds.3 v2:172.21.15.158:6838/2616400572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+88954 (crc 0 0 0) 0x55b430e10e50 con 0x55b430f34200 2023-10-18T14:09:15.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd35dffb700 10 client.16662 handle_command_reply: tid=0 2023-10-18T14:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd3891a6b80 1 client.16662 shutdown 2023-10-18T14:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd3891a6b80 1 -- 172.21.15.114:0/3309008523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 msgr2=0x55b430ed42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/3309008523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 0x55b430ed42f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd368012fd0 tx=0x7fd368005330 comp rx=0 tx=0).stop 2023-10-18T14:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd3891a6b80 1 -- 172.21.15.114:0/3309008523 shutdown_connections 2023-10-18T14:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/3309008523 >> [v2:172.21.15.158:6838/2616400572,v1:172.21.15.158:6839/2616400572] conn(0x55b430f34200 0x55b430f36620 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/3309008523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b430ecb500 0x55b430ed4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd35dffb700 0 client.16662 ms_handle_reset on v2:172.21.15.158:6838/2616400572 2023-10-18T14:09:15.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/3309008523 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55b430ec55d0 0x55b430ed5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd3891a6b80 1 --2- 172.21.15.114:0/3309008523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b430ecabe0 0x55b430ed42f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd3891a6b80 1 -- 172.21.15.114:0/3309008523 >> 172.21.15.114:0/3309008523 conn(0x55b430e39720 msgr2=0x55b430ec86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:15.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd3891a6b80 1 -- 172.21.15.114:0/3309008523 shutdown_connections 2023-10-18T14:09:15.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd3891a6b80 1 -- 172.21.15.114:0/3309008523 wait complete. 2023-10-18T14:09:15.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd3891a6b80 20 client.16662 trim_cache size 0 max 16384 2023-10-18T14:09:15.199 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2023-10-18T14:09:15.199 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.200 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.200 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 5614669, 2023-10-18T14:09:15.200 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628962, 2023-10-18T14:09:15.200 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/379.out" 2023-10-18T14:09:15.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.201 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.201 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.201 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 13184544, 2023-10-18T14:09:15.201 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631052, 2023-10-18T14:09:15.201 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/190.out" 2023-10-18T14:09:15.202 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.202 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.202 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.202 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 31121790, 2023-10-18T14:09:15.202 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629869, 2023-10-18T14:09:15.203 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/237.out" 2023-10-18T14:09:15.203 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.203 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.203 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.203 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 36253208, 2023-10-18T14:09:15.204 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631356, 2023-10-18T14:09:15.204 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/336.out" 2023-10-18T14:09:15.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.204 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.204 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.204 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 38751388, 2023-10-18T14:09:15.205 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631354, 2023-10-18T14:09:15.205 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/335.out" 2023-10-18T14:09:15.205 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.205 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.205 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.206 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 62612262, 2023-10-18T14:09:15.206 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628676, 2023-10-18T14:09:15.206 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/111.out" 2023-10-18T14:09:15.206 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.206 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.207 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.207 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 68249931, 2023-10-18T14:09:15.207 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632496, 2023-10-18T14:09:15.207 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/137" 2023-10-18T14:09:15.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.208 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.208 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.208 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 76313302, 2023-10-18T14:09:15.208 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630914, 2023-10-18T14:09:15.208 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/121.out" 2023-10-18T14:09:15.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.209 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.209 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.209 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 76803449, 2023-10-18T14:09:15.209 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632568, 2023-10-18T14:09:15.209 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/204" 2023-10-18T14:09:15.210 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.210 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.210 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.210 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 91487025, 2023-10-18T14:09:15.210 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628608, 2023-10-18T14:09:15.211 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/077.out" 2023-10-18T14:09:15.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.211 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.211 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.211 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 94137826, 2023-10-18T14:09:15.212 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628914, 2023-10-18T14:09:15.212 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/355.out" 2023-10-18T14:09:15.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.212 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.212 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.213 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 110143907, 2023-10-18T14:09:15.213 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632563, 2023-10-18T14:09:15.213 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/200" 2023-10-18T14:09:15.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.213 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.214 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.214 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 115939555, 2023-10-18T14:09:15.214 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631070, 2023-10-18T14:09:15.214 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/199.out" 2023-10-18T14:09:15.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.215 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.215 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.215 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 120839913, 2023-10-18T14:09:15.215 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630640, 2023-10-18T14:09:15.215 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/001.out" 2023-10-18T14:09:15.216 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.216 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.216 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.216 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 140750949, 2023-10-18T14:09:15.217 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628774, 2023-10-18T14:09:15.217 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/160.out" 2023-10-18T14:09:15.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.217 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.217 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.218 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 152617219, 2023-10-18T14:09:15.218 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633224, 2023-10-18T14:09:15.218 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/001" 2023-10-18T14:09:15.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.218 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.219 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.219 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 163288050, 2023-10-18T14:09:15.219 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633677, 2023-10-18T14:09:15.219 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/020" 2023-10-18T14:09:15.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.220 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.220 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.220 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 177208745, 2023-10-18T14:09:15.220 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630800, 2023-10-18T14:09:15.220 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/068.out" 2023-10-18T14:09:15.221 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.221 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.221 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.221 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 188511165, 2023-10-18T14:09:15.221 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631228, 2023-10-18T14:09:15.221 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/272.out" 2023-10-18T14:09:15.222 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.222 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.222 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.222 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 206591152, 2023-10-18T14:09:15.222 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629961, 2023-10-18T14:09:15.223 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/283.out" 2023-10-18T14:09:15.223 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.223 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.223 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.223 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 218927223, 2023-10-18T14:09:15.224 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631647, 2023-10-18T14:09:15.224 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/481.out" 2023-10-18T14:09:15.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.224 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.225 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 255273469, 2023-10-18T14:09:15.225 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628664, 2023-10-18T14:09:15.225 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/105.out" 2023-10-18T14:09:15.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.225 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.226 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.226 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 271579322, 2023-10-18T14:09:15.226 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629855, 2023-10-18T14:09:15.226 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/230.out" 2023-10-18T14:09:15.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.227 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.227 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 280707145, 2023-10-18T14:09:15.227 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630658, 2023-10-18T14:09:15.227 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/298.out" 2023-10-18T14:09:15.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.228 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.228 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 282331355, 2023-10-18T14:09:15.228 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633018, 2023-10-18T14:09:15.229 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/405" 2023-10-18T14:09:15.229 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.229 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.229 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.229 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 294310310, 2023-10-18T14:09:15.230 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630744, 2023-10-18T14:09:15.230 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/040.out" 2023-10-18T14:09:15.230 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.230 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.230 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.231 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 302994493, 2023-10-18T14:09:15.231 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633153, 2023-10-18T14:09:15.231 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/531" 2023-10-18T14:09:15.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.232 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.232 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 310144316, 2023-10-18T14:09:15.232 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633670, 2023-10-18T14:09:15.232 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/015" 2023-10-18T14:09:15.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.233 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.233 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.233 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 310390426, 2023-10-18T14:09:15.233 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630876, 2023-10-18T14:09:15.233 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/105.out" 2023-10-18T14:09:15.234 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.234 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.234 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.234 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 323465172, 2023-10-18T14:09:15.234 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628956, 2023-10-18T14:09:15.235 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/376.out" 2023-10-18T14:09:15.235 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.235 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.235 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.235 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 332738090, 2023-10-18T14:09:15.236 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631144, 2023-10-18T14:09:15.236 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/235.out" 2023-10-18T14:09:15.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.236 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.236 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.237 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 341358264, 2023-10-18T14:09:15.237 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633149, 2023-10-18T14:09:15.237 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/527.out" 2023-10-18T14:09:15.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.237 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.237 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.238 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 342881870, 2023-10-18T14:09:15.238 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632573, 2023-10-18T14:09:15.238 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/209" 2023-10-18T14:09:15.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.239 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.239 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 347678802, 2023-10-18T14:09:15.239 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632332, 2023-10-18T14:09:15.239 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/308" 2023-10-18T14:09:15.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.240 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.240 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 348004205, 2023-10-18T14:09:15.240 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633217, 2023-10-18T14:09:15.240 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/589" 2023-10-18T14:09:15.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.241 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.241 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 353920356, 2023-10-18T14:09:15.241 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628752, 2023-10-18T14:09:15.242 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/149.out" 2023-10-18T14:09:15.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.242 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.242 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 355128617, 2023-10-18T14:09:15.243 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629802, 2023-10-18T14:09:15.243 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/177.out" 2023-10-18T14:09:15.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.243 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.244 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 359999645, 2023-10-18T14:09:15.244 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632306, 2023-10-18T14:09:15.244 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/025" 2023-10-18T14:09:15.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.245 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.245 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 395183988, 2023-10-18T14:09:15.245 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633657, 2023-10-18T14:09:15.245 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/003" 2023-10-18T14:09:15.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.246 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.246 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 397092459, 2023-10-18T14:09:15.246 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632514, 2023-10-18T14:09:15.246 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/152" 2023-10-18T14:09:15.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.247 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.247 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 408798834, 2023-10-18T14:09:15.247 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632945, 2023-10-18T14:09:15.247 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/338" 2023-10-18T14:09:15.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.248 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.248 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 432327179, 2023-10-18T14:09:15.248 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629248, 2023-10-18T14:09:15.248 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/522.out" 2023-10-18T14:09:15.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.249 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.249 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 448864527, 2023-10-18T14:09:15.249 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632969, 2023-10-18T14:09:15.250 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/360" 2023-10-18T14:09:15.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.250 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.250 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 460426045, 2023-10-18T14:09:15.251 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630099, 2023-10-18T14:09:15.251 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/564.out" 2023-10-18T14:09:15.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.251 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.252 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 463179453, 2023-10-18T14:09:15.252 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632479, 2023-10-18T14:09:15.252 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/120" 2023-10-18T14:09:15.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.253 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.253 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 469615187, 2023-10-18T14:09:15.253 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633308, 2023-10-18T14:09:15.253 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/102" 2023-10-18T14:09:15.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.254 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.254 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 470235420, 2023-10-18T14:09:15.254 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632472, 2023-10-18T14:09:15.254 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/113" 2023-10-18T14:09:15.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.255 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.255 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.255 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 473937773, 2023-10-18T14:09:15.255 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629933, 2023-10-18T14:09:15.256 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/269.out" 2023-10-18T14:09:15.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.256 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.256 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 489742129, 2023-10-18T14:09:15.257 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633068, 2023-10-18T14:09:15.257 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/451" 2023-10-18T14:09:15.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.257 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.257 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 490470032, 2023-10-18T14:09:15.258 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631058, 2023-10-18T14:09:15.258 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/193.out" 2023-10-18T14:09:15.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.258 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.259 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 494504159, 2023-10-18T14:09:15.259 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628744, 2023-10-18T14:09:15.259 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/145.out" 2023-10-18T14:09:15.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.259 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.260 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.260 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 501030497, 2023-10-18T14:09:15.260 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632291, 2023-10-18T14:09:15.260 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/010" 2023-10-18T14:09:15.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.261 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.261 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 508413978, 2023-10-18T14:09:15.261 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632374, 2023-10-18T14:09:15.261 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/033" 2023-10-18T14:09:15.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.262 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.262 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.262 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 526984784, 2023-10-18T14:09:15.262 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632289, 2023-10-18T14:09:15.263 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/008" 2023-10-18T14:09:15.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.263 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.263 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.263 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 555071475, 2023-10-18T14:09:15.263 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632361, 2023-10-18T14:09:15.264 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/024" 2023-10-18T14:09:15.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.264 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.264 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.264 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 555610220, 2023-10-18T14:09:15.265 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632372, 2023-10-18T14:09:15.265 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/032" 2023-10-18T14:09:15.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.265 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.265 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.266 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 556772524, 2023-10-18T14:09:15.266 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628481, 2023-10-18T14:09:15.266 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/019.out" 2023-10-18T14:09:15.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.266 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.267 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.267 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 557827240, 2023-10-18T14:09:15.267 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632648, 2023-10-18T14:09:15.267 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/284" 2023-10-18T14:09:15.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.268 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.268 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.268 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 562047051, 2023-10-18T14:09:15.268 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633667, 2023-10-18T14:09:15.268 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/012" 2023-10-18T14:09:15.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.269 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.269 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.269 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 575481623, 2023-10-18T14:09:15.269 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633067, 2023-10-18T14:09:15.270 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/450" 2023-10-18T14:09:15.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.270 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.270 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.270 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 577869265, 2023-10-18T14:09:15.271 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632431, 2023-10-18T14:09:15.271 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/074" 2023-10-18T14:09:15.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.271 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.272 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 591850434, 2023-10-18T14:09:15.272 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632638, 2023-10-18T14:09:15.272 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/274" 2023-10-18T14:09:15.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.272 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.272 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.273 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 592049349, 2023-10-18T14:09:15.273 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632950, 2023-10-18T14:09:15.273 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/343" 2023-10-18T14:09:15.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.273 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.274 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.274 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 596436190, 2023-10-18T14:09:15.274 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629184, 2023-10-18T14:09:15.274 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/490.out" 2023-10-18T14:09:15.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.275 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.275 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.275 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 618308353, 2023-10-18T14:09:15.275 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629116, 2023-10-18T14:09:15.275 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/456.out" 2023-10-18T14:09:15.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.276 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.276 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.276 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 649237375, 2023-10-18T14:09:15.276 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630383, 2023-10-18T14:09:15.277 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/580.out" 2023-10-18T14:09:15.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.277 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.277 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.277 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 663181031, 2023-10-18T14:09:15.278 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630746, 2023-10-18T14:09:15.278 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/041.out" 2023-10-18T14:09:15.278 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.278 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.279 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 666108787, 2023-10-18T14:09:15.279 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632477, 2023-10-18T14:09:15.279 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/118" 2023-10-18T14:09:15.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.279 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.280 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.280 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 673896455, 2023-10-18T14:09:15.280 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632961, 2023-10-18T14:09:15.280 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/353" 2023-10-18T14:09:15.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.281 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.281 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 708974759, 2023-10-18T14:09:15.281 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628457, 2023-10-18T14:09:15.281 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/007.out" 2023-10-18T14:09:15.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.282 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.282 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 713476522, 2023-10-18T14:09:15.282 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633228, 2023-10-18T14:09:15.283 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/Makefile" 2023-10-18T14:09:15.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.283 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.283 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.283 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 730033898, 2023-10-18T14:09:15.284 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631700, 2023-10-18T14:09:15.284 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/508.out" 2023-10-18T14:09:15.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.284 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.285 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 778516961, 2023-10-18T14:09:15.285 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632582, 2023-10-18T14:09:15.285 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/218" 2023-10-18T14:09:15.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.285 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.286 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.286 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 786886630, 2023-10-18T14:09:15.286 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633109, 2023-10-18T14:09:15.286 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/490" 2023-10-18T14:09:15.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.287 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.287 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.287 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 798282275, 2023-10-18T14:09:15.287 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629254, 2023-10-18T14:09:15.287 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/525.out" 2023-10-18T14:09:15.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.288 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.288 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.288 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 799226129, 2023-10-18T14:09:15.288 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632527, 2023-10-18T14:09:15.288 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/165" 2023-10-18T14:09:15.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.289 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.289 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.289 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 808013821, 2023-10-18T14:09:15.289 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633301, 2023-10-18T14:09:15.290 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/Makefile" 2023-10-18T14:09:15.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.290 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.290 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.290 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 812551194, 2023-10-18T14:09:15.291 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630065, 2023-10-18T14:09:15.291 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/547.out" 2023-10-18T14:09:15.291 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.291 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.291 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.292 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 846608612, 2023-10-18T14:09:15.292 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632629, 2023-10-18T14:09:15.292 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/265" 2023-10-18T14:09:15.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.292 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.293 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.293 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 849631924, 2023-10-18T14:09:15.293 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633012, 2023-10-18T14:09:15.293 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/400" 2023-10-18T14:09:15.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.294 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.294 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.294 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 855200786, 2023-10-18T14:09:15.294 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630436, 2023-10-18T14:09:15.294 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/001.out" 2023-10-18T14:09:15.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.295 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.295 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 870161164, 2023-10-18T14:09:15.295 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629108, 2023-10-18T14:09:15.296 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/452.out" 2023-10-18T14:09:15.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.296 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.296 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.296 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 881803448, 2023-10-18T14:09:15.296 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632420, 2023-10-18T14:09:15.297 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/063" 2023-10-18T14:09:15.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.297 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.297 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.297 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 885488727, 2023-10-18T14:09:15.298 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632505, 2023-10-18T14:09:15.298 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/143" 2023-10-18T14:09:15.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.298 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.298 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.299 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 887839689, 2023-10-18T14:09:15.299 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629208, 2023-10-18T14:09:15.299 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/502.out" 2023-10-18T14:09:15.299 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.299 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.300 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.300 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 897019333, 2023-10-18T14:09:15.300 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632485, 2023-10-18T14:09:15.300 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/126" 2023-10-18T14:09:15.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.300 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.301 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.301 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 899609167, 2023-10-18T14:09:15.301 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629927, 2023-10-18T14:09:15.301 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/266.out" 2023-10-18T14:09:15.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.302 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.302 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 912420127, 2023-10-18T14:09:15.302 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633187, 2023-10-18T14:09:15.302 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/564" 2023-10-18T14:09:15.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.303 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.303 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.303 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 925248722, 2023-10-18T14:09:15.303 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629929, 2023-10-18T14:09:15.304 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/267.out" 2023-10-18T14:09:15.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.304 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.304 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.304 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 925271523, 2023-10-18T14:09:15.305 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632355, 2023-10-18T14:09:15.305 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/019" 2023-10-18T14:09:15.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.305 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.305 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.306 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 931995838, 2023-10-18T14:09:15.306 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632595, 2023-10-18T14:09:15.306 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/231" 2023-10-18T14:09:15.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.306 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.307 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.307 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 938425511, 2023-10-18T14:09:15.307 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630819, 2023-10-18T14:09:15.307 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/077.out" 2023-10-18T14:09:15.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.307 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.308 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.308 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 941822618, 2023-10-18T14:09:15.308 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632951, 2023-10-18T14:09:15.308 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/344" 2023-10-18T14:09:15.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.309 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.309 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 995042973, 2023-10-18T14:09:15.309 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630950, 2023-10-18T14:09:15.309 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/139.out" 2023-10-18T14:09:15.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.310 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.310 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.310 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1003907389, 2023-10-18T14:09:15.310 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629985, 2023-10-18T14:09:15.310 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/295.out" 2023-10-18T14:09:15.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.311 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.311 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.311 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1032538566, 2023-10-18T14:09:15.311 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632985, 2023-10-18T14:09:15.312 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/374.out" 2023-10-18T14:09:15.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.312 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.312 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.312 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1049441351, 2023-10-18T14:09:15.313 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629881, 2023-10-18T14:09:15.313 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/243.out" 2023-10-18T14:09:15.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.313 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.314 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1068841837, 2023-10-18T14:09:15.314 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633300, 2023-10-18T14:09:15.314 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/001" 2023-10-18T14:09:15.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.314 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.315 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.315 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1072000380, 2023-10-18T14:09:15.315 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632292, 2023-10-18T14:09:15.315 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/011" 2023-10-18T14:09:15.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.316 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.316 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.316 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1086384592, 2023-10-18T14:09:15.316 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630906, 2023-10-18T14:09:15.316 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/117.out" 2023-10-18T14:09:15.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.317 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.317 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.317 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1094048003, 2023-10-18T14:09:15.317 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629106, 2023-10-18T14:09:15.317 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/451.out" 2023-10-18T14:09:15.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.318 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.318 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1109468611, 2023-10-18T14:09:15.318 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632911, 2023-10-18T14:09:15.319 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/304" 2023-10-18T14:09:15.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.319 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.319 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1119095754, 2023-10-18T14:09:15.320 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630756, 2023-10-18T14:09:15.320 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/046.out" 2023-10-18T14:09:15.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.320 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.320 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.321 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1152092911, 2023-10-18T14:09:15.321 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632424, 2023-10-18T14:09:15.321 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/067" 2023-10-18T14:09:15.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.321 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.322 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.322 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1157890226, 2023-10-18T14:09:15.322 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629832, 2023-10-18T14:09:15.322 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/192.out" 2023-10-18T14:09:15.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.323 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.323 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.323 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1164229983, 2023-10-18T14:09:15.323 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628674, 2023-10-18T14:09:15.323 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/110.out" 2023-10-18T14:09:15.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.324 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.324 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.324 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1167131428, 2023-10-18T14:09:15.324 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632631, 2023-10-18T14:09:15.325 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/267" 2023-10-18T14:09:15.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.325 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.325 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.325 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1170161789, 2023-10-18T14:09:15.326 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628590, 2023-10-18T14:09:15.326 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/068.out" 2023-10-18T14:09:15.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.326 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.326 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.327 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1173365969, 2023-10-18T14:09:15.327 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633302, 2023-10-18T14:09:15.327 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/group" 2023-10-18T14:09:15.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.328 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.328 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1175985609, 2023-10-18T14:09:15.328 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632481, 2023-10-18T14:09:15.328 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/122" 2023-10-18T14:09:15.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.329 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.329 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1176202904, 2023-10-18T14:09:15.329 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630676, 2023-10-18T14:09:15.329 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/007.out" 2023-10-18T14:09:15.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.330 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.330 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.330 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1191273891, 2023-10-18T14:09:15.330 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632442, 2023-10-18T14:09:15.330 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/085" 2023-10-18T14:09:15.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.331 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.331 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.331 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1215286134, 2023-10-18T14:09:15.331 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632453, 2023-10-18T14:09:15.332 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/094" 2023-10-18T14:09:15.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.332 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.332 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.332 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1231266702, 2023-10-18T14:09:15.332 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633222, 2023-10-18T14:09:15.333 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/Makefile" 2023-10-18T14:09:15.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.333 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.333 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.333 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1234160438, 2023-10-18T14:09:15.334 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629853, 2023-10-18T14:09:15.334 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/229.out" 2023-10-18T14:09:15.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.334 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.334 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.335 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1238567927, 2023-10-18T14:09:15.335 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629891, 2023-10-18T14:09:15.335 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/248.out" 2023-10-18T14:09:15.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.335 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.336 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.336 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1251434182, 2023-10-18T14:09:15.336 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629182, 2023-10-18T14:09:15.336 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/489.out" 2023-10-18T14:09:15.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.337 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.337 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.337 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1257691420, 2023-10-18T14:09:15.337 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633076, 2023-10-18T14:09:15.338 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/459" 2023-10-18T14:09:15.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.338 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.338 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.338 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1293225072, 2023-10-18T14:09:15.338 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632982, 2023-10-18T14:09:15.339 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/373" 2023-10-18T14:09:15.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.339 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.339 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.339 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1344857738, 2023-10-18T14:09:15.340 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628578, 2023-10-18T14:09:15.340 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/062.out" 2023-10-18T14:09:15.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.340 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.340 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.341 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1366326239, 2023-10-18T14:09:15.341 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633079, 2023-10-18T14:09:15.341 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/462" 2023-10-18T14:09:15.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.341 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.342 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.342 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1371027407, 2023-10-18T14:09:15.342 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630134, 2023-10-18T14:09:15.342 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/584.out" 2023-10-18T14:09:15.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.343 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.343 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.343 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1371559956, 2023-10-18T14:09:15.343 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629006, 2023-10-18T14:09:15.343 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/401.out" 2023-10-18T14:09:15.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.344 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.344 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.344 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1375075737, 2023-10-18T14:09:15.344 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629981, 2023-10-18T14:09:15.345 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/293.out" 2023-10-18T14:09:15.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.345 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.345 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.345 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1385510843, 2023-10-18T14:09:15.346 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632474, 2023-10-18T14:09:15.346 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/115" 2023-10-18T14:09:15.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.346 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.347 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1412236475, 2023-10-18T14:09:15.347 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632987, 2023-10-18T14:09:15.347 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/376" 2023-10-18T14:09:15.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.347 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.348 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.348 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1444392856, 2023-10-18T14:09:15.348 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628461, 2023-10-18T14:09:15.348 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/009.out" 2023-10-18T14:09:15.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.349 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.349 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.349 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1446769821, 2023-10-18T14:09:15.349 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628809, 2023-10-18T14:09:15.349 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/203.out" 2023-10-18T14:09:15.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.350 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.350 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.350 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1449860138, 2023-10-18T14:09:15.350 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628784, 2023-10-18T14:09:15.350 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/165.out" 2023-10-18T14:09:15.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.351 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.351 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1450178110, 2023-10-18T14:09:15.351 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630132, 2023-10-18T14:09:15.352 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/583.out" 2023-10-18T14:09:15.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.352 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.352 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.352 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1450681736, 2023-10-18T14:09:15.353 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631080, 2023-10-18T14:09:15.353 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/204.out" 2023-10-18T14:09:15.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.353 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.353 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.354 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1453206362, 2023-10-18T14:09:15.354 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631250, 2023-10-18T14:09:15.354 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/283.out" 2023-10-18T14:09:15.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.355 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.355 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1463142899, 2023-10-18T14:09:15.355 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631158, 2023-10-18T14:09:15.355 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/237.out" 2023-10-18T14:09:15.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.356 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.356 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1470974119, 2023-10-18T14:09:15.356 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629879, 2023-10-18T14:09:15.356 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/242.out" 2023-10-18T14:09:15.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.357 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.357 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1473323238, 2023-10-18T14:09:15.357 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633052, 2023-10-18T14:09:15.357 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/436" 2023-10-18T14:09:15.358 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.358 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.358 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.358 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1494273480, 2023-10-18T14:09:15.358 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629192, 2023-10-18T14:09:15.359 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/494.out" 2023-10-18T14:09:15.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.359 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.359 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.359 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1513106536, 2023-10-18T14:09:15.360 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631202, 2023-10-18T14:09:15.360 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/259.out" 2023-10-18T14:09:15.360 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.360 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.360 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.361 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1517896755, 2023-10-18T14:09:15.361 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633034, 2023-10-18T14:09:15.361 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/420" 2023-10-18T14:09:15.361 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.361 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.361 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.362 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1549922891, 2023-10-18T14:09:15.362 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630736, 2023-10-18T14:09:15.362 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/036.out" 2023-10-18T14:09:15.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.362 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.363 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.363 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1559265180, 2023-10-18T14:09:15.363 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630656, 2023-10-18T14:09:15.363 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/032.out" 2023-10-18T14:09:15.363 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.364 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.364 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.364 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1569560646, 2023-10-18T14:09:15.364 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632326, 2023-10-18T14:09:15.364 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/302" 2023-10-18T14:09:15.365 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.365 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.365 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.365 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1571911527, 2023-10-18T14:09:15.365 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628988, 2023-10-18T14:09:15.366 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/392.out" 2023-10-18T14:09:15.366 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.366 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.366 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.366 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1588451528, 2023-10-18T14:09:15.367 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628678, 2023-10-18T14:09:15.367 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/112.out" 2023-10-18T14:09:15.367 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.367 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.367 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.367 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1612406426, 2023-10-18T14:09:15.368 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628996, 2023-10-18T14:09:15.368 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/396.out" 2023-10-18T14:09:15.368 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.368 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.368 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.369 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1620244308, 2023-10-18T14:09:15.369 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632283, 2023-10-18T14:09:15.369 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/002.out" 2023-10-18T14:09:15.369 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.370 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.370 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.370 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1651670672, 2023-10-18T14:09:15.370 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633007, 2023-10-18T14:09:15.370 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/396" 2023-10-18T14:09:15.371 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.371 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.371 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.371 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1652672596, 2023-10-18T14:09:15.371 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629975, 2023-10-18T14:09:15.372 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/290.out" 2023-10-18T14:09:15.372 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.372 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.372 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.372 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1659010243, 2023-10-18T14:09:15.373 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629174, 2023-10-18T14:09:15.373 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/485.out" 2023-10-18T14:09:15.373 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.373 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.373 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.374 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1664673795, 2023-10-18T14:09:15.374 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633219, 2023-10-18T14:09:15.374 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/591" 2023-10-18T14:09:15.374 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.374 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.374 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.375 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1672004254, 2023-10-18T14:09:15.375 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630438, 2023-10-18T14:09:15.375 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/001.out" 2023-10-18T14:09:15.375 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.376 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.376 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.376 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1698153171, 2023-10-18T14:09:15.376 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631164, 2023-10-18T14:09:15.376 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/240.out" 2023-10-18T14:09:15.377 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.377 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.377 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.377 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1707056858, 2023-10-18T14:09:15.377 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628684, 2023-10-18T14:09:15.378 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/115.out" 2023-10-18T14:09:15.378 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.378 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.378 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.379 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1720142045, 2023-10-18T14:09:15.379 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632447, 2023-10-18T14:09:15.379 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/089" 2023-10-18T14:09:15.379 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.379 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.380 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.380 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1721392091, 2023-10-18T14:09:15.380 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631668, 2023-10-18T14:09:15.380 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/492.out" 2023-10-18T14:09:15.380 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.381 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.381 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.381 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1725240839, 2023-10-18T14:09:15.381 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631322, 2023-10-18T14:09:15.381 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/319.out" 2023-10-18T14:09:15.382 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.382 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.382 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.382 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1757901066, 2023-10-18T14:09:15.382 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633202, 2023-10-18T14:09:15.383 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/575.out" 2023-10-18T14:09:15.383 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.383 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.383 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.383 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1786937405, 2023-10-18T14:09:15.384 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630860, 2023-10-18T14:09:15.384 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/097.out" 2023-10-18T14:09:15.384 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.384 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.384 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.385 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1790862435, 2023-10-18T14:09:15.385 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632418, 2023-10-18T14:09:15.385 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/061" 2023-10-18T14:09:15.385 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.385 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.386 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.386 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1791820057, 2023-10-18T14:09:15.386 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631417, 2023-10-18T14:09:15.386 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/366.out" 2023-10-18T14:09:15.386 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.387 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.387 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.387 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1849811266, 2023-10-18T14:09:15.387 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632566, 2023-10-18T14:09:15.387 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/202" 2023-10-18T14:09:15.388 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.388 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.388 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.388 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1861036455, 2023-10-18T14:09:15.388 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630750, 2023-10-18T14:09:15.388 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/043.out" 2023-10-18T14:09:15.389 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.389 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.389 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.389 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1891305488, 2023-10-18T14:09:15.389 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632305, 2023-10-18T14:09:15.390 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/024" 2023-10-18T14:09:15.390 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.390 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.390 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.391 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1904762249, 2023-10-18T14:09:15.391 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631002, 2023-10-18T14:09:15.391 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/165.out" 2023-10-18T14:09:15.391 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.391 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.391 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.392 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1916670845, 2023-10-18T14:09:15.392 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632500, 2023-10-18T14:09:15.392 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/139.out" 2023-10-18T14:09:15.392 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.392 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.393 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.393 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1918448302, 2023-10-18T14:09:15.393 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628648, 2023-10-18T14:09:15.393 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/097.out" 2023-10-18T14:09:15.393 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.394 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.394 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.394 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1946718457, 2023-10-18T14:09:15.394 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632462, 2023-10-18T14:09:15.395 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/103" 2023-10-18T14:09:15.395 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.395 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.395 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.395 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1948909205, 2023-10-18T14:09:15.396 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629953, 2023-10-18T14:09:15.396 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/279.out" 2023-10-18T14:09:15.396 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.396 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.396 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.397 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1959561641, 2023-10-18T14:09:15.397 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633027, 2023-10-18T14:09:15.397 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/414" 2023-10-18T14:09:15.397 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.397 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.398 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.398 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1978405397, 2023-10-18T14:09:15.398 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631176, 2023-10-18T14:09:15.398 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/246.out" 2023-10-18T14:09:15.399 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.399 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.399 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.399 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2007229817, 2023-10-18T14:09:15.399 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630049, 2023-10-18T14:09:15.400 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/539.out" 2023-10-18T14:09:15.400 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.400 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.400 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.400 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2007390964, 2023-10-18T14:09:15.401 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628722, 2023-10-18T14:09:15.401 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/134.out" 2023-10-18T14:09:15.401 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.401 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.401 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.402 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2009029022, 2023-10-18T14:09:15.402 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633676, 2023-10-18T14:09:15.402 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/019.out" 2023-10-18T14:09:15.402 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.402 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.403 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.403 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2019225269, 2023-10-18T14:09:15.403 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633229, 2023-10-18T14:09:15.403 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/group" 2023-10-18T14:09:15.403 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.404 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.404 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.404 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2025907212, 2023-10-18T14:09:15.404 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629917, 2023-10-18T14:09:15.404 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/261.out" 2023-10-18T14:09:15.405 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.405 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.405 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.405 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2030175889, 2023-10-18T14:09:15.405 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628698, 2023-10-18T14:09:15.405 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/122.out" 2023-10-18T14:09:15.406 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.406 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.406 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.406 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2031587508, 2023-10-18T14:09:15.407 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631134, 2023-10-18T14:09:15.407 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/230.out" 2023-10-18T14:09:15.407 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.407 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.407 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.407 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2087742206, 2023-10-18T14:09:15.408 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629016, 2023-10-18T14:09:15.408 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/406.out" 2023-10-18T14:09:15.408 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.408 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.408 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.409 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2093514409, 2023-10-18T14:09:15.409 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628618, 2023-10-18T14:09:15.409 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/082.out" 2023-10-18T14:09:15.409 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.409 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.410 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.410 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2096819118, 2023-10-18T14:09:15.410 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633074, 2023-10-18T14:09:15.410 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/457" 2023-10-18T14:09:15.410 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.411 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.411 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.411 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2110883645, 2023-10-18T14:09:15.411 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632465, 2023-10-18T14:09:15.411 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/106" 2023-10-18T14:09:15.412 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.412 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.412 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.412 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2114804428, 2023-10-18T14:09:15.412 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631662, 2023-10-18T14:09:15.413 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/489.out" 2023-10-18T14:09:15.413 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.413 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.413 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.413 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2129906969, 2023-10-18T14:09:15.413 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632520, 2023-10-18T14:09:15.414 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/158" 2023-10-18T14:09:15.414 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.414 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.414 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.414 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2137617344, 2023-10-18T14:09:15.415 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633211, 2023-10-18T14:09:15.415 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/583" 2023-10-18T14:09:15.415 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.415 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.415 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.416 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2140043523, 2023-10-18T14:09:15.416 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631372, 2023-10-18T14:09:15.416 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/344.out" 2023-10-18T14:09:15.416 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.416 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.417 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.417 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2149300974, 2023-10-18T14:09:15.417 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631655, 2023-10-18T14:09:15.417 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/485.out" 2023-10-18T14:09:15.417 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.418 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.418 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.418 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2156077899, 2023-10-18T14:09:15.418 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628317, 2023-10-18T14:09:15.418 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/007.out" 2023-10-18T14:09:15.419 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.419 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.419 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.419 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2171905898, 2023-10-18T14:09:15.419 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629268, 2023-10-18T14:09:15.420 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/532.out" 2023-10-18T14:09:15.420 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.420 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.420 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.420 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2195793226, 2023-10-18T14:09:15.421 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632984, 2023-10-18T14:09:15.421 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/374" 2023-10-18T14:09:15.421 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.421 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.421 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.422 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2196662139, 2023-10-18T14:09:15.422 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628876, 2023-10-18T14:09:15.422 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/336.out" 2023-10-18T14:09:15.422 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.422 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.423 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.423 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2200112291, 2023-10-18T14:09:15.423 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633125, 2023-10-18T14:09:15.423 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/504" 2023-10-18T14:09:15.423 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.423 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.424 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.424 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2205394853, 2023-10-18T14:09:15.424 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632607, 2023-10-18T14:09:15.424 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/243" 2023-10-18T14:09:15.424 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.425 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.425 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.425 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2214229312, 2023-10-18T14:09:15.425 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632519, 2023-10-18T14:09:15.425 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/157" 2023-10-18T14:09:15.426 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.426 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.426 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.426 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2221427703, 2023-10-18T14:09:15.426 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628726, 2023-10-18T14:09:15.427 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/136.out" 2023-10-18T14:09:15.427 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.427 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.427 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.427 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2251238012, 2023-10-18T14:09:15.428 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629913, 2023-10-18T14:09:15.428 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/259.out" 2023-10-18T14:09:15.428 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.428 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.428 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.428 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2253818877, 2023-10-18T14:09:15.429 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629999, 2023-10-18T14:09:15.429 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/302.out" 2023-10-18T14:09:15.429 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.429 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.429 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.430 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2253918273, 2023-10-18T14:09:15.430 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629126, 2023-10-18T14:09:15.430 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/461.out" 2023-10-18T14:09:15.430 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.430 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.431 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.431 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2280461484, 2023-10-18T14:09:15.431 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632977, 2023-10-18T14:09:15.431 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/368" 2023-10-18T14:09:15.431 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.432 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.432 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.432 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2292126993, 2023-10-18T14:09:15.432 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630123, 2023-10-18T14:09:15.432 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/576.out" 2023-10-18T14:09:15.433 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.433 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.433 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.433 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2312007666, 2023-10-18T14:09:15.433 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632452, 2023-10-18T14:09:15.434 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/093.out" 2023-10-18T14:09:15.434 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.434 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.434 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.434 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2329891019, 2023-10-18T14:09:15.435 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633661, 2023-10-18T14:09:15.435 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/006.out" 2023-10-18T14:09:15.435 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.435 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.435 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.436 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2331211564, 2023-10-18T14:09:15.436 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632441, 2023-10-18T14:09:15.436 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/084" 2023-10-18T14:09:15.436 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.436 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.437 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.437 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2332634055, 2023-10-18T14:09:15.437 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632367, 2023-10-18T14:09:15.437 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/029.out" 2023-10-18T14:09:15.437 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.438 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.438 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.438 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2344409715, 2023-10-18T14:09:15.438 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631200, 2023-10-18T14:09:15.438 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/258.out" 2023-10-18T14:09:15.439 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.439 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.439 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.439 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2359540262, 2023-10-18T14:09:15.439 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632429, 2023-10-18T14:09:15.439 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/072" 2023-10-18T14:09:15.440 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.440 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.440 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.440 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2374533526, 2023-10-18T14:09:15.440 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629142, 2023-10-18T14:09:15.441 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/469.out" 2023-10-18T14:09:15.441 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.441 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.441 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.441 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2374831390, 2023-10-18T14:09:15.442 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628646, 2023-10-18T14:09:15.442 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/096.out" 2023-10-18T14:09:15.442 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.442 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.442 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.443 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2379107297, 2023-10-18T14:09:15.443 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631597, 2023-10-18T14:09:15.443 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/456.out" 2023-10-18T14:09:15.443 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.443 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.443 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.444 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2379319936, 2023-10-18T14:09:15.444 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630662, 2023-10-18T14:09:15.444 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/102.out" 2023-10-18T14:09:15.444 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.444 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.445 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.445 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2396626278, 2023-10-18T14:09:15.445 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628992, 2023-10-18T14:09:15.445 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/394.out" 2023-10-18T14:09:15.445 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.446 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.446 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.446 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2398628764, 2023-10-18T14:09:15.446 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629937, 2023-10-18T14:09:15.446 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/271.out" 2023-10-18T14:09:15.447 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.447 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.447 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.447 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2409288364, 2023-10-18T14:09:15.447 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632436, 2023-10-18T14:09:15.447 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/079" 2023-10-18T14:09:15.448 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.448 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.448 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.448 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2427290118, 2023-10-18T14:09:15.448 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628375, 2023-10-18T14:09:15.449 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/036.out" 2023-10-18T14:09:15.449 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.449 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.449 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.449 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2432396561, 2023-10-18T14:09:15.450 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630734, 2023-10-18T14:09:15.450 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/035.out" 2023-10-18T14:09:15.450 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.450 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.450 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.451 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2436481297, 2023-10-18T14:09:15.451 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632621, 2023-10-18T14:09:15.451 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/257" 2023-10-18T14:09:15.451 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.451 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.452 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.452 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2439069520, 2023-10-18T14:09:15.452 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629020, 2023-10-18T14:09:15.452 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/408.out" 2023-10-18T14:09:15.452 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.452 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.453 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.453 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2439985162, 2023-10-18T14:09:15.453 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632585, 2023-10-18T14:09:15.453 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/221" 2023-10-18T14:09:15.453 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.454 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.454 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.454 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2453476013, 2023-10-18T14:09:15.454 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632653, 2023-10-18T14:09:15.454 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/289" 2023-10-18T14:09:15.455 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.455 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.455 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.455 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2467265335, 2023-10-18T14:09:15.455 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631527, 2023-10-18T14:09:15.456 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/421.out" 2023-10-18T14:09:15.456 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.456 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.456 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.456 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2470294482, 2023-10-18T14:09:15.457 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632912, 2023-10-18T14:09:15.457 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/305" 2023-10-18T14:09:15.457 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.457 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.457 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.457 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2492456271, 2023-10-18T14:09:15.458 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632619, 2023-10-18T14:09:15.458 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/255" 2023-10-18T14:09:15.458 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.458 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.458 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.459 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2497465932, 2023-10-18T14:09:15.459 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631425, 2023-10-18T14:09:15.459 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/370.out" 2023-10-18T14:09:15.459 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.459 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.460 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.460 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2506463120, 2023-10-18T14:09:15.460 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632333, 2023-10-18T14:09:15.460 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/Makefile" 2023-10-18T14:09:15.460 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.461 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.461 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.461 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2510912037, 2023-10-18T14:09:15.461 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630672, 2023-10-18T14:09:15.461 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/005.out" 2023-10-18T14:09:15.461 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.462 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.462 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.462 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2519388609, 2023-10-18T14:09:15.462 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631429, 2023-10-18T14:09:15.462 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/372.out" 2023-10-18T14:09:15.463 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.463 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.463 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.463 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2519426870, 2023-10-18T14:09:15.463 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633303, 2023-10-18T14:09:15.464 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/002" 2023-10-18T14:09:15.464 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.464 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.464 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.464 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2519907237, 2023-10-18T14:09:15.464 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632434, 2023-10-18T14:09:15.465 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/077" 2023-10-18T14:09:15.465 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.465 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.465 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.465 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2523802763, 2023-10-18T14:09:15.466 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632523, 2023-10-18T14:09:15.466 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/161" 2023-10-18T14:09:15.466 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.466 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.466 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.467 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2533772678, 2023-10-18T14:09:15.467 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631216, 2023-10-18T14:09:15.467 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/266.out" 2023-10-18T14:09:15.467 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.467 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.468 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.468 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2534139172, 2023-10-18T14:09:15.468 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633116, 2023-10-18T14:09:15.468 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/496" 2023-10-18T14:09:15.468 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.469 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.469 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.469 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2546052981, 2023-10-18T14:09:15.469 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631395, 2023-10-18T14:09:15.469 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/355.out" 2023-10-18T14:09:15.470 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.470 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.470 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.470 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2561079821, 2023-10-18T14:09:15.470 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630097, 2023-10-18T14:09:15.471 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/563.out" 2023-10-18T14:09:15.471 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.471 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.471 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.471 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2576016916, 2023-10-18T14:09:15.472 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633040, 2023-10-18T14:09:15.472 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/426" 2023-10-18T14:09:15.472 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.472 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.472 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.473 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2578245178, 2023-10-18T14:09:15.473 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632541, 2023-10-18T14:09:15.473 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/179" 2023-10-18T14:09:15.473 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.473 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.474 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.474 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2589918334, 2023-10-18T14:09:15.474 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630654, 2023-10-18T14:09:15.474 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/002.out" 2023-10-18T14:09:15.474 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.475 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.475 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.475 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2607653272, 2023-10-18T14:09:15.475 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633304, 2023-10-18T14:09:15.475 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/032" 2023-10-18T14:09:15.476 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.476 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.476 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.476 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2629652175, 2023-10-18T14:09:15.476 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631274, 2023-10-18T14:09:15.477 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/295.out" 2023-10-18T14:09:15.477 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.477 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.477 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.477 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2674274466, 2023-10-18T14:09:15.477 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633663, 2023-10-18T14:09:15.478 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/008" 2023-10-18T14:09:15.478 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.478 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.478 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.478 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2712049560, 2023-10-18T14:09:15.479 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632574, 2023-10-18T14:09:15.479 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/210" 2023-10-18T14:09:15.479 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.479 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.479 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.480 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2719114715, 2023-10-18T14:09:15.480 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628796, 2023-10-18T14:09:15.480 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/171.out" 2023-10-18T14:09:15.480 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.480 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.481 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.481 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2728072832, 2023-10-18T14:09:15.481 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632967, 2023-10-18T14:09:15.481 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/358" 2023-10-18T14:09:15.481 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.482 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.482 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.482 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2734947780, 2023-10-18T14:09:15.482 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630868, 2023-10-18T14:09:15.482 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/101.out" 2023-10-18T14:09:15.483 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.483 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.483 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.483 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2753821748, 2023-10-18T14:09:15.483 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633154, 2023-10-18T14:09:15.483 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/532" 2023-10-18T14:09:15.484 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.484 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.484 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.484 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2764607749, 2023-10-18T14:09:15.484 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632530, 2023-10-18T14:09:15.485 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/168" 2023-10-18T14:09:15.485 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.485 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.485 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.485 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2773100941, 2023-10-18T14:09:15.486 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630680, 2023-10-18T14:09:15.486 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/009.out" 2023-10-18T14:09:15.486 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.486 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.486 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.487 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2781819919, 2023-10-18T14:09:15.487 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628862, 2023-10-18T14:09:15.487 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/329.out" 2023-10-18T14:09:15.487 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.487 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.488 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.488 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2788048263, 2023-10-18T14:09:15.488 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632435, 2023-10-18T14:09:15.488 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/078" 2023-10-18T14:09:15.488 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.489 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.489 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.489 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2799461084, 2023-10-18T14:09:15.489 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631016, 2023-10-18T14:09:15.489 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/172.out" 2023-10-18T14:09:15.489 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.490 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.490 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.490 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2855841286, 2023-10-18T14:09:15.490 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633085, 2023-10-18T14:09:15.491 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/468" 2023-10-18T14:09:15.491 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.491 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.491 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.491 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2862824780, 2023-10-18T14:09:15.491 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631611, 2023-10-18T14:09:15.492 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/463.out" 2023-10-18T14:09:15.492 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.492 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.492 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.492 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2863133201, 2023-10-18T14:09:15.493 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628477, 2023-10-18T14:09:15.493 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/017.out" 2023-10-18T14:09:15.493 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.493 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.493 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.493 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2870471315, 2023-10-18T14:09:15.494 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633671, 2023-10-18T14:09:15.494 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/016" 2023-10-18T14:09:15.494 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.494 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.494 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.495 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2886200028, 2023-10-18T14:09:15.495 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631491, 2023-10-18T14:09:15.495 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/403.out" 2023-10-18T14:09:15.495 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.496 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.496 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.496 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2910440692, 2023-10-18T14:09:15.496 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632412, 2023-10-18T14:09:15.496 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/055" 2023-10-18T14:09:15.497 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.497 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.497 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.497 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2913253974, 2023-10-18T14:09:15.497 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628936, 2023-10-18T14:09:15.497 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/366.out" 2023-10-18T14:09:15.498 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.498 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.498 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.498 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2920196087, 2023-10-18T14:09:15.498 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630035, 2023-10-18T14:09:15.499 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/320.out" 2023-10-18T14:09:15.499 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.499 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.499 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.499 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2923374952, 2023-10-18T14:09:15.500 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628554, 2023-10-18T14:09:15.500 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.xfsquota" 2023-10-18T14:09:15.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.500 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.500 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.501 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2925496266, 2023-10-18T14:09:15.501 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628447, 2023-10-18T14:09:15.501 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/002.out" 2023-10-18T14:09:15.501 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.501 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.501 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.502 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2929218949, 2023-10-18T14:09:15.502 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631232, 2023-10-18T14:09:15.502 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/274.out" 2023-10-18T14:09:15.502 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.502 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.503 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.503 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2931715410, 2023-10-18T14:09:15.503 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632965, 2023-10-18T14:09:15.503 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/356" 2023-10-18T14:09:15.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.504 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.504 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2938421458, 2023-10-18T14:09:15.504 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633194, 2023-10-18T14:09:15.504 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/570" 2023-10-18T14:09:15.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.505 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.505 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.505 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2942028078, 2023-10-18T14:09:15.505 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632339, 2023-10-18T14:09:15.506 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/003" 2023-10-18T14:09:15.506 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.506 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.506 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.506 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2975501184, 2023-10-18T14:09:15.507 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632542, 2023-10-18T14:09:15.507 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/180" 2023-10-18T14:09:15.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.507 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.507 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2982574846, 2023-10-18T14:09:15.508 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633307, 2023-10-18T14:09:15.508 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/group" 2023-10-18T14:09:15.508 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.508 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.508 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.509 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2998788893, 2023-10-18T14:09:15.509 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632451, 2023-10-18T14:09:15.509 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/093" 2023-10-18T14:09:15.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.509 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.509 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.510 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3001680951, 2023-10-18T14:09:15.510 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633054, 2023-10-18T14:09:15.510 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/438" 2023-10-18T14:09:15.510 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.510 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.511 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.511 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3004276620, 2023-10-18T14:09:15.511 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633019, 2023-10-18T14:09:15.511 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/406" 2023-10-18T14:09:15.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.512 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.512 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.512 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3017902409, 2023-10-18T14:09:15.512 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632344, 2023-10-18T14:09:15.512 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/008" 2023-10-18T14:09:15.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.513 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.513 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.513 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3042429337, 2023-10-18T14:09:15.513 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629160, 2023-10-18T14:09:15.514 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/478.out" 2023-10-18T14:09:15.514 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.514 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.514 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.518 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3051439941, 2023-10-18T14:09:15.518 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632613, 2023-10-18T14:09:15.518 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/249" 2023-10-18T14:09:15.519 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.519 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.519 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.519 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3067560705, 2023-10-18T14:09:15.519 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632480, 2023-10-18T14:09:15.520 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/121" 2023-10-18T14:09:15.520 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.520 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.520 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.520 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3083859280, 2023-10-18T14:09:15.521 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631132, 2023-10-18T14:09:15.521 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/229.out" 2023-10-18T14:09:15.521 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.521 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.521 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.522 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3086762348, 2023-10-18T14:09:15.522 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628688, 2023-10-18T14:09:15.522 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/117.out" 2023-10-18T14:09:15.522 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.522 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.523 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.523 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3089637985, 2023-10-18T14:09:15.523 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633026, 2023-10-18T14:09:15.523 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/413" 2023-10-18T14:09:15.523 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.524 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.524 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.524 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3100173530, 2023-10-18T14:09:15.524 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629190, 2023-10-18T14:09:15.524 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/493.out" 2023-10-18T14:09:15.525 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.525 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.525 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.525 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3117702108, 2023-10-18T14:09:15.525 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633309, 2023-10-18T14:09:15.526 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/Makefile" 2023-10-18T14:09:15.526 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.526 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.526 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.526 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3119946951, 2023-10-18T14:09:15.527 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630073, 2023-10-18T14:09:15.527 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/551.out" 2023-10-18T14:09:15.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.527 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.528 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3127192045, 2023-10-18T14:09:15.528 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632555, 2023-10-18T14:09:15.528 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/192" 2023-10-18T14:09:15.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.528 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.528 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.529 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3166842681, 2023-10-18T14:09:15.529 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628628, 2023-10-18T14:09:15.529 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/087.out" 2023-10-18T14:09:15.529 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.530 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.530 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3169276721, 2023-10-18T14:09:15.530 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630003, 2023-10-18T14:09:15.530 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/304.out" 2023-10-18T14:09:15.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.531 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.531 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3194648577, 2023-10-18T14:09:15.531 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632524, 2023-10-18T14:09:15.531 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/162" 2023-10-18T14:09:15.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.532 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.532 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.532 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3202724108, 2023-10-18T14:09:15.532 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629826, 2023-10-18T14:09:15.533 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/189.out" 2023-10-18T14:09:15.533 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.533 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.533 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.533 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3203119848, 2023-10-18T14:09:15.534 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628564, 2023-10-18T14:09:15.534 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/055.out" 2023-10-18T14:09:15.534 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.534 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.534 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.535 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3206634412, 2023-10-18T14:09:15.535 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629957, 2023-10-18T14:09:15.535 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/281.out" 2023-10-18T14:09:15.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.536 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.536 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3207553148, 2023-10-18T14:09:15.536 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632616, 2023-10-18T14:09:15.536 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/252" 2023-10-18T14:09:15.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.537 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.537 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.537 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3215383916, 2023-10-18T14:09:15.537 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633167, 2023-10-18T14:09:15.537 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/545" 2023-10-18T14:09:15.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.538 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.538 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3219614026, 2023-10-18T14:09:15.538 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629897, 2023-10-18T14:09:15.539 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/251.out" 2023-10-18T14:09:15.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.539 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.539 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.539 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3233485682, 2023-10-18T14:09:15.540 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632522, 2023-10-18T14:09:15.540 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/160" 2023-10-18T14:09:15.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.540 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.540 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.541 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3236510129, 2023-10-18T14:09:15.541 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628928, 2023-10-18T14:09:15.541 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/362.out" 2023-10-18T14:09:15.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.542 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.542 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3248491038, 2023-10-18T14:09:15.542 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633064, 2023-10-18T14:09:15.542 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/447" 2023-10-18T14:09:15.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.543 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.543 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3257653857, 2023-10-18T14:09:15.543 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631246, 2023-10-18T14:09:15.543 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/281.out" 2023-10-18T14:09:15.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.544 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.544 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3267952098, 2023-10-18T14:09:15.544 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633004, 2023-10-18T14:09:15.545 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/393" 2023-10-18T14:09:15.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.545 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.545 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3269873699, 2023-10-18T14:09:15.546 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630730, 2023-10-18T14:09:15.546 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/033.out.default" 2023-10-18T14:09:15.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.547 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.547 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3288370174, 2023-10-18T14:09:15.547 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631180, 2023-10-18T14:09:15.547 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/248.out" 2023-10-18T14:09:15.547 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.548 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.548 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3300771667, 2023-10-18T14:09:15.548 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631443, 2023-10-18T14:09:15.548 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/379.out" 2023-10-18T14:09:15.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.549 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.549 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3307287541, 2023-10-18T14:09:15.549 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632645, 2023-10-18T14:09:15.550 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/281" 2023-10-18T14:09:15.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.550 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.550 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3311447247, 2023-10-18T14:09:15.551 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629887, 2023-10-18T14:09:15.551 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/246.out" 2023-10-18T14:09:15.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.551 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.552 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3317335970, 2023-10-18T14:09:15.552 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633306, 2023-10-18T14:09:15.552 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/Makefile" 2023-10-18T14:09:15.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.553 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.553 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3328309162, 2023-10-18T14:09:15.553 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632359, 2023-10-18T14:09:15.553 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/022" 2023-10-18T14:09:15.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.554 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.554 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3331163527, 2023-10-18T14:09:15.554 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633135, 2023-10-18T14:09:15.554 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/514" 2023-10-18T14:09:15.555 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.555 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.555 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3331518068, 2023-10-18T14:09:15.555 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633225, 2023-10-18T14:09:15.556 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/Makefile" 2023-10-18T14:09:15.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.556 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.557 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3331612942, 2023-10-18T14:09:15.557 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629945, 2023-10-18T14:09:15.557 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/275.out" 2023-10-18T14:09:15.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.558 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.558 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3342965144, 2023-10-18T14:09:15.558 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631208, 2023-10-18T14:09:15.558 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/262.out" 2023-10-18T14:09:15.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.559 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.559 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3350757076, 2023-10-18T14:09:15.559 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632538, 2023-10-18T14:09:15.559 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/176" 2023-10-18T14:09:15.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.560 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.560 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3353151202, 2023-10-18T14:09:15.560 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628948, 2023-10-18T14:09:15.561 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/372.out" 2023-10-18T14:09:15.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.561 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.561 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3368555503, 2023-10-18T14:09:15.562 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632578, 2023-10-18T14:09:15.562 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/214" 2023-10-18T14:09:15.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.562 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.563 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3379276929, 2023-10-18T14:09:15.563 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632352, 2023-10-18T14:09:15.563 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/016" 2023-10-18T14:09:15.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.564 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.564 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3409374312, 2023-10-18T14:09:15.564 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632351, 2023-10-18T14:09:15.564 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/015" 2023-10-18T14:09:15.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.565 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.565 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3412017711, 2023-10-18T14:09:15.565 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633197, 2023-10-18T14:09:15.565 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/572.out" 2023-10-18T14:09:15.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.566 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.566 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3438687291, 2023-10-18T14:09:15.566 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631477, 2023-10-18T14:09:15.567 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/396.out" 2023-10-18T14:09:15.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.567 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.567 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3442206642, 2023-10-18T14:09:15.568 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632410, 2023-10-18T14:09:15.568 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/053" 2023-10-18T14:09:15.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.568 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.569 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3445687569, 2023-10-18T14:09:15.569 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631136, 2023-10-18T14:09:15.569 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/231.out" 2023-10-18T14:09:15.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.570 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.570 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3460440588, 2023-10-18T14:09:15.570 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633063, 2023-10-18T14:09:15.570 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/446" 2023-10-18T14:09:15.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.571 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.571 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.571 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3464855540, 2023-10-18T14:09:15.571 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632363, 2023-10-18T14:09:15.571 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/026" 2023-10-18T14:09:15.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.572 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.572 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3477997111, 2023-10-18T14:09:15.572 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629220, 2023-10-18T14:09:15.572 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/508.out" 2023-10-18T14:09:15.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.573 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.573 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3487100891, 2023-10-18T14:09:15.573 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628455, 2023-10-18T14:09:15.573 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/006.out" 2023-10-18T14:09:15.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.574 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.574 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3515928562, 2023-10-18T14:09:15.574 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630886, 2023-10-18T14:09:15.575 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/110.out" 2023-10-18T14:09:15.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.575 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.576 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3526274199, 2023-10-18T14:09:15.576 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633139, 2023-10-18T14:09:15.576 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/518" 2023-10-18T14:09:15.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.576 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.577 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3528386224, 2023-10-18T14:09:15.577 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630081, 2023-10-18T14:09:15.577 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/555.out" 2023-10-18T14:09:15.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.577 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.578 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3532657039, 2023-10-18T14:09:15.578 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631473, 2023-10-18T14:09:15.578 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/394.out" 2023-10-18T14:09:15.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.579 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.579 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3553110769, 2023-10-18T14:09:15.579 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631521, 2023-10-18T14:09:15.579 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/418.out" 2023-10-18T14:09:15.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.580 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.580 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3559266842, 2023-10-18T14:09:15.580 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633227, 2023-10-18T14:09:15.580 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/001" 2023-10-18T14:09:15.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.581 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.581 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3577110930, 2023-10-18T14:09:15.581 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633674, 2023-10-18T14:09:15.582 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.out" 2023-10-18T14:09:15.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.582 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.582 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3610631278, 2023-10-18T14:09:15.583 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633213, 2023-10-18T14:09:15.583 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/585" 2023-10-18T14:09:15.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.583 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.584 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3621157084, 2023-10-18T14:09:15.584 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628794, 2023-10-18T14:09:15.584 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/170.out" 2023-10-18T14:09:15.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.585 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.585 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3623961821, 2023-10-18T14:09:15.585 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628686, 2023-10-18T14:09:15.585 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/116.out" 2023-10-18T14:09:15.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.586 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.586 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3626852771, 2023-10-18T14:09:15.586 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630944, 2023-10-18T14:09:15.586 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/136.out" 2023-10-18T14:09:15.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.587 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.587 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3627509506, 2023-10-18T14:09:15.587 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633100, 2023-10-18T14:09:15.588 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/482" 2023-10-18T14:09:15.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.588 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.588 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3633664035, 2023-10-18T14:09:15.588 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629010, 2023-10-18T14:09:15.589 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/403.out" 2023-10-18T14:09:15.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.589 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.589 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.589 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3638575418, 2023-10-18T14:09:15.590 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632534, 2023-10-18T14:09:15.590 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/172" 2023-10-18T14:09:15.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.591 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.591 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3648180778, 2023-10-18T14:09:15.591 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632502, 2023-10-18T14:09:15.591 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/140.out" 2023-10-18T14:09:15.591 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.592 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.592 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3656403433, 2023-10-18T14:09:15.592 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632490, 2023-10-18T14:09:15.592 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/131" 2023-10-18T14:09:15.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.593 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.593 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3673071913, 2023-10-18T14:09:15.593 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632448, 2023-10-18T14:09:15.594 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/090" 2023-10-18T14:09:15.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.594 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.594 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3676542704, 2023-10-18T14:09:15.595 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630858, 2023-10-18T14:09:15.595 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/096.out.internal" 2023-10-18T14:09:15.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.595 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.596 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3678082080, 2023-10-18T14:09:15.596 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629796, 2023-10-18T14:09:15.596 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/174.out" 2023-10-18T14:09:15.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.596 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.597 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.597 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3678535599, 2023-10-18T14:09:15.597 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629824, 2023-10-18T14:09:15.597 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/188.out" 2023-10-18T14:09:15.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.598 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.598 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.598 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3681182922, 2023-10-18T14:09:15.598 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632457, 2023-10-18T14:09:15.598 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/098" 2023-10-18T14:09:15.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.599 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.599 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3693935583, 2023-10-18T14:09:15.599 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630025, 2023-10-18T14:09:15.600 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/315.out" 2023-10-18T14:09:15.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.600 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.600 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3696857792, 2023-10-18T14:09:15.601 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633045, 2023-10-18T14:09:15.601 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/430" 2023-10-18T14:09:15.601 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.601 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.601 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.602 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3700469178, 2023-10-18T14:09:15.602 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630011, 2023-10-18T14:09:15.602 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/308.out" 2023-10-18T14:09:15.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.603 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.603 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3708594286, 2023-10-18T14:09:15.603 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633069, 2023-10-18T14:09:15.603 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/452" 2023-10-18T14:09:15.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.604 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.604 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3717055855, 2023-10-18T14:09:15.604 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630788, 2023-10-18T14:09:15.605 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/062.out" 2023-10-18T14:09:15.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.605 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.605 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3767847585, 2023-10-18T14:09:15.606 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631690, 2023-10-18T14:09:15.606 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/503.out" 2023-10-18T14:09:15.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.606 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.607 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3768878080, 2023-10-18T14:09:15.607 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629830, 2023-10-18T14:09:15.607 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/191.out" 2023-10-18T14:09:15.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.607 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.608 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.608 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3774712405, 2023-10-18T14:09:15.608 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629166, 2023-10-18T14:09:15.608 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/481.out" 2023-10-18T14:09:15.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.609 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.609 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3808513111, 2023-10-18T14:09:15.609 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630033, 2023-10-18T14:09:15.609 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/319.out" 2023-10-18T14:09:15.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.610 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.610 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3814588232, 2023-10-18T14:09:15.610 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633021, 2023-10-18T14:09:15.610 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/408" 2023-10-18T14:09:15.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.611 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.611 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.611 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3825326291, 2023-10-18T14:09:15.611 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628972, 2023-10-18T14:09:15.612 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/384.out" 2023-10-18T14:09:15.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.612 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.612 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3832212778, 2023-10-18T14:09:15.613 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630067, 2023-10-18T14:09:15.613 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/548.out" 2023-10-18T14:09:15.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.613 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.614 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3883518912, 2023-10-18T14:09:15.614 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628425, 2023-10-18T14:09:15.614 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/301.out" 2023-10-18T14:09:15.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.615 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.615 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3885406727, 2023-10-18T14:09:15.615 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630864, 2023-10-18T14:09:15.615 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/099.out" 2023-10-18T14:09:15.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.615 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.616 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.616 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3891458930, 2023-10-18T14:09:15.616 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633058, 2023-10-18T14:09:15.616 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/441" 2023-10-18T14:09:15.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.617 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.617 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3899678352, 2023-10-18T14:09:15.617 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630732, 2023-10-18T14:09:15.617 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/034.out" 2023-10-18T14:09:15.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.618 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.618 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.618 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3905756999, 2023-10-18T14:09:15.618 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628966, 2023-10-18T14:09:15.618 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/381.out" 2023-10-18T14:09:15.618 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.619 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.619 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.619 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3909916854, 2023-10-18T14:09:15.619 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628926, 2023-10-18T14:09:15.619 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/361.out" 2023-10-18T14:09:15.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.620 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.620 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3913622144, 2023-10-18T14:09:15.620 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628944, 2023-10-18T14:09:15.621 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/370.out" 2023-10-18T14:09:15.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.621 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.621 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3922123549, 2023-10-18T14:09:15.622 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628786, 2023-10-18T14:09:15.622 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/166.out" 2023-10-18T14:09:15.622 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.622 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.622 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.623 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3925821576, 2023-10-18T14:09:15.623 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632482, 2023-10-18T14:09:15.623 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/123" 2023-10-18T14:09:15.623 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.623 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.623 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.624 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3961097890, 2023-10-18T14:09:15.624 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633226, 2023-10-18T14:09:15.624 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/group" 2023-10-18T14:09:15.624 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.624 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.625 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.625 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4007103523, 2023-10-18T14:09:15.625 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628708, 2023-10-18T14:09:15.625 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/127.out" 2023-10-18T14:09:15.625 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.626 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.626 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.626 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4011781744, 2023-10-18T14:09:15.626 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633104, 2023-10-18T14:09:15.626 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/485" 2023-10-18T14:09:15.627 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.627 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.627 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.627 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4024069664, 2023-10-18T14:09:15.627 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628525, 2023-10-18T14:09:15.628 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/040.out" 2023-10-18T14:09:15.628 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.628 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.628 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.628 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4035401893, 2023-10-18T14:09:15.628 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631670, 2023-10-18T14:09:15.629 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/493.out" 2023-10-18T14:09:15.629 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.629 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.629 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.629 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4043397926, 2023-10-18T14:09:15.629 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628652, 2023-10-18T14:09:15.630 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/099.out" 2023-10-18T14:09:15.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.630 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.630 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.630 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4066981012, 2023-10-18T14:09:15.631 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631314, 2023-10-18T14:09:15.631 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/315.out" 2023-10-18T14:09:15.631 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.631 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.631 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.632 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4077926621, 2023-10-18T14:09:15.632 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632469, 2023-10-18T14:09:15.632 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/110" 2023-10-18T14:09:15.632 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.632 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.633 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.633 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4078184747, 2023-10-18T14:09:15.633 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631623, 2023-10-18T14:09:15.633 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/469.out" 2023-10-18T14:09:15.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.634 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.634 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4092524990, 2023-10-18T14:09:15.634 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632617, 2023-10-18T14:09:15.634 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/253" 2023-10-18T14:09:15.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.635 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.635 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.635 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4093631750, 2023-10-18T14:09:15.635 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633305, 2023-10-18T14:09:15.635 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/298" 2023-10-18T14:09:15.636 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.636 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.636 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.636 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4096020274, 2023-10-18T14:09:15.636 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631664, 2023-10-18T14:09:15.637 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/490.out" 2023-10-18T14:09:15.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.637 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.637 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4110127582, 2023-10-18T14:09:15.638 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633162, 2023-10-18T14:09:15.638 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/540" 2023-10-18T14:09:15.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.638 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.638 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4119001223, 2023-10-18T14:09:15.639 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632421, 2023-10-18T14:09:15.639 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/064" 2023-10-18T14:09:15.639 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.639 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.639 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.640 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4122922908, 2023-10-18T14:09:15.640 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628636, 2023-10-18T14:09:15.640 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/091.out" 2023-10-18T14:09:15.640 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.640 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.641 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.641 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4123880939, 2023-10-18T14:09:15.641 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628696, 2023-10-18T14:09:15.641 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/121.out" 2023-10-18T14:09:15.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.641 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.642 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.642 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4129819140, 2023-10-18T14:09:15.642 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632654, 2023-10-18T14:09:15.642 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/290" 2023-10-18T14:09:15.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.643 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.643 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.643 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4143474000, 2023-10-18T14:09:15.643 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633310, 2023-10-18T14:09:15.643 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/group" 2023-10-18T14:09:15.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.644 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.644 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.644 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4153667939, 2023-10-18T14:09:15.644 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629050, 2023-10-18T14:09:15.645 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/423.out" 2023-10-18T14:09:15.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.645 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.645 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.645 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4156547608, 2023-10-18T14:09:15.646 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628513, 2023-10-18T14:09:15.646 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/035.cfg" 2023-10-18T14:09:15.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.646 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.646 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.646 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4160203397, 2023-10-18T14:09:15.647 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633158, 2023-10-18T14:09:15.647 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/536" 2023-10-18T14:09:15.647 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.647 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.647 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.648 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4170573824, 2023-10-18T14:09:15.648 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628922, 2023-10-18T14:09:15.648 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/359.out" 2023-10-18T14:09:15.648 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.648 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.649 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.649 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4184247108, 2023-10-18T14:09:15.649 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631048, 2023-10-18T14:09:15.649 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/188.out" 2023-10-18T14:09:15.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.649 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.650 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.650 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4184421620, 2023-10-18T14:09:15.650 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631186, 2023-10-18T14:09:15.650 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/251.out" 2023-10-18T14:09:15.650 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.651 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.651 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4184885917, 2023-10-18T14:09:15.651 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632971, 2023-10-18T14:09:15.651 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/362" 2023-10-18T14:09:15.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.652 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.652 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4211575842, 2023-10-18T14:09:15.652 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632460, 2023-10-18T14:09:15.652 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/101" 2023-10-18T14:09:15.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.653 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.653 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.653 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4211817520, 2023-10-18T14:09:15.653 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629004, 2023-10-18T14:09:15.654 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/400.out" 2023-10-18T14:09:15.654 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.654 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.654 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4223201369, 2023-10-18T14:09:15.655 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630902, 2023-10-18T14:09:15.655 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/115.out" 2023-10-18T14:09:15.655 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.655 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.656 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4231829728, 2023-10-18T14:09:15.656 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629252, 2023-10-18T14:09:15.656 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/524.out" 2023-10-18T14:09:15.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.656 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.657 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4237166946, 2023-10-18T14:09:15.657 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628610, 2023-10-18T14:09:15.657 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/078.out" 2023-10-18T14:09:15.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.658 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.658 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4244220287, 2023-10-18T14:09:15.658 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633010, 2023-10-18T14:09:15.658 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/398" 2023-10-18T14:09:15.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.659 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.659 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4246233705, 2023-10-18T14:09:15.659 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628453, 2023-10-18T14:09:15.659 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/005.out" 2023-10-18T14:09:15.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.660 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.660 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4262038656, 2023-10-18T14:09:15.660 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630954, 2023-10-18T14:09:15.660 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/141.out" 2023-10-18T14:09:15.661 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:09:15.661 INFO:teuthology.orchestra.run.smithi114.stdout:] 2023-10-18T14:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd37cfbd700 1 -- 172.21.15.114:0/1550890698 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3600a15f0 msgr2=0x7fd3600a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd37cfbd700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3600a15f0 0x7fd3600a3ab0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd378196ef0 tx=0x7fd36800b5f0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd37cfbd700 1 -- 172.21.15.114:0/1550890698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3780ff640 msgr2=0x7fd37819b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.167+0000 7fd37cfbd700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3780ff640 0x7fd37819b670 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00e9a0 tx=0x7fd36c00ed60 comp rx=0 tx=0).stop 2023-10-18T14:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.168+0000 7fd37cfbd700 1 -- 172.21.15.114:0/1550890698 shutdown_connections 2023-10-18T14:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.168+0000 7fd37cfbd700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fd3600a15f0 0x7fd3600a3ab0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.168+0000 7fd37cfbd700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd378105650 0x7fd3781957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.168+0000 7fd37cfbd700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3780ff640 0x7fd37819b670 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.168+0000 7fd37cfbd700 1 --2- 172.21.15.114:0/1550890698 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd378100000 0x7fd37819bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.168+0000 7fd37cfbd700 1 -- 172.21.15.114:0/1550890698 >> 172.21.15.114:0/1550890698 conn(0x7fd378076790 msgr2=0x7fd3780fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:15.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.168+0000 7fd37cfbd700 1 -- 172.21.15.114:0/1550890698 shutdown_connections 2023-10-18T14:09:15.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.168+0000 7fd37cfbd700 1 -- 172.21.15.114:0/1550890698 wait complete. 2023-10-18T14:09:15.666 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-18T14:09:15.694 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:15 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/283902190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:09:15.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:15 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/283902190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:09:15.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.799+0000 7f5580944700 1 -- 172.21.15.114:0/3883048281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f557c106860 msgr2=0x7f557c106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.799+0000 7f5580944700 1 --2- 172.21.15.114:0/3883048281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f557c106860 0x7f557c106c40 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f556c009990 tx=0x7f556c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.799+0000 7f5580944700 1 -- 172.21.15.114:0/3883048281 shutdown_connections 2023-10-18T14:09:15.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.799+0000 7f5580944700 1 --2- 172.21.15.114:0/3883048281 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f557c0ffae0 0x7f557c10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.799+0000 7f5580944700 1 --2- 172.21.15.114:0/3883048281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f557c106860 0x7f557c106c40 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.799+0000 7f5580944700 1 --2- 172.21.15.114:0/3883048281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f557c0ff120 0x7f557c0ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.799+0000 7f5580944700 1 -- 172.21.15.114:0/3883048281 >> 172.21.15.114:0/3883048281 conn(0x7f557c074890 msgr2=0x7f557c074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:15.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.799+0000 7f5580944700 1 -- 172.21.15.114:0/3883048281 shutdown_connections 2023-10-18T14:09:15.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.799+0000 7f5580944700 1 -- 172.21.15.114:0/3883048281 wait complete. 2023-10-18T14:09:15.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.799+0000 7f5580944700 1 Processor -- start 2023-10-18T14:09:15.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5580944700 1 -- start start 2023-10-18T14:09:15.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5580944700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f557c0ff120 0x7f557c19c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5580944700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f557c0ffae0 0x7f557c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5580944700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f557c106860 0x7f557c196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5580944700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c197080 con 0x7f557c0ffae0 2023-10-18T14:09:15.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5580944700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c1971f0 con 0x7f557c0ff120 2023-10-18T14:09:15.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5580944700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c1973b0 con 0x7f557c106860 2023-10-18T14:09:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5579d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f557c0ffae0 0x7f557c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5579d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f557c0ffae0 0x7f557c19ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46642/0 (socket says 172.21.15.114:46642) 2023-10-18T14:09:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5579d9b700 1 -- 172.21.15.114:0/326882182 learned_addr learned my addr 172.21.15.114:0/326882182 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f557ad9d700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f557c106860 0x7f557c196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f557a59c700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f557c0ff120 0x7f557c19c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5579d9b700 1 -- 172.21.15.114:0/326882182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f557c106860 msgr2=0x7f557c196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5579d9b700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f557c106860 0x7f557c196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5579d9b700 1 -- 172.21.15.114:0/326882182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f557c0ff120 msgr2=0x7f557c19c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5579d9b700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f557c0ff120 0x7f557c19c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5579d9b700 1 -- 172.21.15.114:0/326882182 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c0095f0 con 0x7f557c0ffae0 2023-10-18T14:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f557a59c700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f557c0ff120 0x7f557c19c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5579d9b700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f557c0ffae0 0x7f557c19ce30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f557000c920 tx=0x7f557000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f556b7fe700 1 -- 172.21.15.114:0/326882182 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570007b00 con 0x7f557c0ffae0 2023-10-18T14:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f556b7fe700 1 -- 172.21.15.114:0/326882182 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f557000ce70 con 0x7f557c0ffae0 2023-10-18T14:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.800+0000 7f5580944700 1 -- 172.21.15.114:0/326882182 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c197690 con 0x7f557c0ffae0 2023-10-18T14:09:15.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.801+0000 7f556b7fe700 1 -- 172.21.15.114:0/326882182 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700054e0 con 0x7f557c0ffae0 2023-10-18T14:09:15.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.801+0000 7f5580944700 1 -- 172.21.15.114:0/326882182 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c1a38e0 con 0x7f557c0ffae0 2023-10-18T14:09:15.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.803+0000 7f556b7fe700 1 -- 172.21.15.114:0/326882182 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f5570004750 con 0x7f557c0ffae0 2023-10-18T14:09:15.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.803+0000 7f556b7fe700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f55640a15f0 0x7f55640a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.803+0000 7f557a59c700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f55640a15f0 0x7f55640a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.803+0000 7f556b7fe700 1 -- 172.21.15.114:0/326882182 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f55700ccc50 con 0x7f557c0ffae0 2023-10-18T14:09:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.804+0000 7f557a59c700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f55640a15f0 0x7f55640a3ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f556c00b5c0 tx=0x7f556c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.804+0000 7f558cb2db80 1 Processor -- start 2023-10-18T14:09:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f558cb2db80 1 -- start start 2023-10-18T14:09:15.814 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:15 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/283902190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:09:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f558cb2db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4dabe0 0x55daac4dafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f558cb2db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4db500 0x55daac4d5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f558cb2db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 0x55daac4d5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f558cb2db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daac4486e0 con 0x55daac4d55d0 2023-10-18T14:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f558cb2db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daac42ec60 con 0x55daac4db500 2023-10-18T14:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f558cb2db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daac42c580 con 0x55daac4dabe0 2023-10-18T14:09:15.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f557ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 0x55daac4d5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f557ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 0x55daac4d5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46652/0 (socket says 172.21.15.114:46652) 2023-10-18T14:09:15.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f557ad9d700 1 -- 172.21.15.114:0/3048293101 learned_addr learned my addr 172.21.15.114:0/3048293101 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:15.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f557a59c700 1 --2- 172.21.15.114:0/3048293101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4dabe0 0x55daac4dafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f5579d9b700 1 --2- 172.21.15.114:0/3048293101 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4db500 0x55daac4d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f557ad9d700 1 -- 172.21.15.114:0/3048293101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4dabe0 msgr2=0x55daac4dafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f557ad9d700 1 --2- 172.21.15.114:0/3048293101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4dabe0 0x55daac4dafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f557ad9d700 1 -- 172.21.15.114:0/3048293101 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4db500 msgr2=0x55daac4d5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f557ad9d700 1 --2- 172.21.15.114:0/3048293101 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4db500 0x55daac4d5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f557ad9d700 1 -- 172.21.15.114:0/3048293101 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daac3e53f0 con 0x55daac4d55d0 2023-10-18T14:09:15.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f5579d9b700 1 --2- 172.21.15.114:0/3048293101 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4db500 0x55daac4d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:09:15.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.805+0000 7f557ad9d700 1 --2- 172.21.15.114:0/3048293101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 0x55daac4d5a50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f55740098f0 tx=0x7f5574009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1aa2eedf13924d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:15.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.806+0000 7f5568ff9700 1 -- 172.21.15.114:0/3048293101 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574019070 con 0x55daac4d55d0 2023-10-18T14:09:15.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.806+0000 7f5568ff9700 1 -- 172.21.15.114:0/3048293101 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f557400f040 con 0x55daac4d55d0 2023-10-18T14:09:15.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.806+0000 7f5568ff9700 1 -- 172.21.15.114:0/3048293101 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574007a60 con 0x55daac4d55d0 2023-10-18T14:09:15.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.806+0000 7f558cb2db80 1 -- 172.21.15.114:0/3048293101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 msgr2=0x55daac4d5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.806+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3048293101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 0x55daac4d5a50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f55740098f0 tx=0x7f5574009c00 comp rx=0 tx=0).stop 2023-10-18T14:09:15.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.806+0000 7f558cb2db80 1 -- 172.21.15.114:0/3048293101 shutdown_connections 2023-10-18T14:09:15.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.806+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3048293101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 0x55daac4d5a50 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.806+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3048293101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4dabe0 0x55daac4dafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.806+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3048293101 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4db500 0x55daac4d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.806+0000 7f558cb2db80 1 -- 172.21.15.114:0/3048293101 >> 172.21.15.114:0/3048293101 conn(0x55daac449720 msgr2=0x55daac4cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.806+0000 7f558cb2db80 1 -- 172.21.15.114:0/3048293101 shutdown_connections 2023-10-18T14:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.806+0000 7f558cb2db80 1 -- 172.21.15.114:0/3048293101 wait complete. 2023-10-18T14:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f558cb2db80 1 -- start start 2023-10-18T14:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f558cb2db80 1 Processor -- start 2023-10-18T14:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f558cb2db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4d55d0 0x55daac4e1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f558cb2db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 0x55daac4de680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f558cb2db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4db500 0x55daac4dec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f558cb2db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daac427e70 con 0x55daac4dabe0 2023-10-18T14:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f558cb2db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daac3c4710 con 0x55daac4d55d0 2023-10-18T14:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f558cb2db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daac3c43b0 con 0x55daac4db500 2023-10-18T14:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f558cb2db80 10 client.0 _ll_register_callbacks cb 0x55daac30ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f5579d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 0x55daac4de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f5579d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 0x55daac4de680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46656/0 (socket says 172.21.15.114:46656) 2023-10-18T14:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f5579d9b700 1 -- 172.21.15.114:0/3037279367 learned_addr learned my addr 172.21.15.114:0/3037279367 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f557ad9d700 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4db500 0x55daac4dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f557a59c700 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4d55d0 0x55daac4e1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f5579d9b700 1 -- 172.21.15.114:0/3037279367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4db500 msgr2=0x55daac4dec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f5579d9b700 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4db500 0x55daac4dec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f5579d9b700 1 -- 172.21.15.114:0/3037279367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4d55d0 msgr2=0x55daac4e1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f5579d9b700 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4d55d0 0x55daac4e1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f5579d9b700 1 -- 172.21.15.114:0/3037279367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5574003c50 con 0x55daac4dabe0 2023-10-18T14:09:15.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.807+0000 7f557a59c700 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4d55d0 0x55daac4e1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:09:15.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f5579d9b700 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 0x55daac4de680 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5570099c40 tx=0x7f557009a4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ece6d4569977e06 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:15.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f5561ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:09:15.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f5561ffb700 1 -- 172.21.15.114:0/3037279367 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700a2040 con 0x55daac4dabe0 2023-10-18T14:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f5561ffb700 1 -- 172.21.15.114:0/3037279367 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f5570099f10 con 0x55daac4dabe0 2023-10-18T14:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f558cb2db80 1 -- 172.21.15.114:0/3037279367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55daac42cef0 con 0x55daac4dabe0 2023-10-18T14:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f5561ffb700 1 -- 172.21.15.114:0/3037279367 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f557009a0d0 con 0x55daac4dabe0 2023-10-18T14:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f558cb2db80 10 client.16674 fetch_fsmap learned FSMap version 44 2023-10-18T14:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f558cb2db80 1 -- 172.21.15.114:0/3037279367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55daac252de0 con 0x55daac4dabe0 2023-10-18T14:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f5561ffb700 1 -- 172.21.15.114:0/3037279367 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55daac42cef0 con 0x55daac4dabe0 2023-10-18T14:09:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f5561ffb700 1 -- 172.21.15.114:0/3037279367 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 44) v1 ==== 7958+0+0 (secure 0 0 0) 0x7f55700a1d00 con 0x55daac4dabe0 2023-10-18T14:09:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f558cb2db80 10 client.16674 fetch_fsmap finished waiting for FSMap version 44 2023-10-18T14:09:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f558cb2db80 10 client.16674 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-18T14:09:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f558cb2db80 20 client.16674 populate_metadata read hostname 'smithi114' 2023-10-18T14:09:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55daac4eec10 0x55daac4f1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f558cb2db80 4 client.16674 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:09:15.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f558cb2db80 1 -- 172.21.15.114:0/3037279367 --> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55daac4a48b0 con 0x55daac4eec10 2023-10-18T14:09:15.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.808+0000 7f557a59c700 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55daac4eec10 0x55daac4f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.809+0000 7f5561ffb700 10 client.16674 ms_handle_connect on v2:172.21.15.172:6834/2655563129 2023-10-18T14:09:15.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.809+0000 7f557a59c700 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55daac4eec10 0x55daac4f1030 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3466fad2d81f330b server_cookie=23b5ee706b9e7b7 in_seq=0 out_seq=0 2023-10-18T14:09:15.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.809+0000 7f5561ffb700 1 -- 172.21.15.114:0/3037279367 <== mds.2 v2:172.21.15.172:6834/2655563129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55daac4a48b0 con 0x55daac4eec10 2023-10-18T14:09:15.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.809+0000 7f5561ffb700 10 client.16674 handle_command_reply: tid=0 2023-10-18T14:09:15.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.810+0000 7f558cb2db80 1 client.16674 shutdown 2023-10-18T14:09:15.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.810+0000 7f558cb2db80 1 -- 172.21.15.114:0/3037279367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 msgr2=0x55daac4de680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.810+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 0x55daac4de680 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5570099c40 tx=0x7f557009a4f0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.810+0000 7f558cb2db80 1 -- 172.21.15.114:0/3037279367 shutdown_connections 2023-10-18T14:09:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.810+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55daac4eec10 0x55daac4f1030 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.810+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4db500 0x55daac4dec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.810+0000 7f5561ffb700 0 client.16674 ms_handle_reset on v2:172.21.15.172:6834/2655563129 2023-10-18T14:09:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.810+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4d55d0 0x55daac4e1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.810+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3037279367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 0x55daac4de680 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.810+0000 7f558cb2db80 1 -- 172.21.15.114:0/3037279367 >> 172.21.15.114:0/3037279367 conn(0x55daac449720 msgr2=0x55daac4d4080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:15.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.810+0000 7f558cb2db80 1 -- 172.21.15.114:0/3037279367 shutdown_connections 2023-10-18T14:09:15.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.810+0000 7f558cb2db80 1 -- 172.21.15.114:0/3037279367 wait complete. 2023-10-18T14:09:15.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.810+0000 7f558cb2db80 20 client.16674 trim_cache size 0 max 16384 2023-10-18T14:09:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f558cb2db80 1 Processor -- start 2023-10-18T14:09:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f558cb2db80 1 -- start start 2023-10-18T14:09:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f558cb2db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4d55d0 0x55daac4ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f558cb2db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 0x55daac4e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f558cb2db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4db500 0x55daac4d59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f558cb2db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daac2a8920 con 0x55daac4dabe0 2023-10-18T14:09:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f558cb2db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daac4d00c0 con 0x55daac4d55d0 2023-10-18T14:09:15.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f558cb2db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daac4df210 con 0x55daac4db500 2023-10-18T14:09:15.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f5579d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 0x55daac4e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f5579d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 0x55daac4e5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46664/0 (socket says 172.21.15.114:46664) 2023-10-18T14:09:15.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f5579d9b700 1 -- 172.21.15.114:0/3599054360 learned_addr learned my addr 172.21.15.114:0/3599054360 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:15.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f557a59c700 1 --2- 172.21.15.114:0/3599054360 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4d55d0 0x55daac4ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f557ad9d700 1 --2- 172.21.15.114:0/3599054360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4db500 0x55daac4d59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f5579d9b700 1 -- 172.21.15.114:0/3599054360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4db500 msgr2=0x55daac4d59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f5579d9b700 1 --2- 172.21.15.114:0/3599054360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4db500 0x55daac4d59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f5579d9b700 1 -- 172.21.15.114:0/3599054360 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4d55d0 msgr2=0x55daac4ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f5579d9b700 1 --2- 172.21.15.114:0/3599054360 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4d55d0 0x55daac4ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f5579d9b700 1 -- 172.21.15.114:0/3599054360 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daac23bc60 con 0x55daac4dabe0 2023-10-18T14:09:15.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.823+0000 7f5579d9b700 1 --2- 172.21.15.114:0/3599054360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 0x55daac4e5ee0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f55700ca4d0 tx=0x7f5570000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd42a31ceebe606b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:15.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.824+0000 7f55697fa700 1 -- 172.21.15.114:0/3599054360 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700cacb0 con 0x55daac4dabe0 2023-10-18T14:09:15.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.824+0000 7f55697fa700 1 -- 172.21.15.114:0/3599054360 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55700a2040 con 0x55daac4dabe0 2023-10-18T14:09:15.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.824+0000 7f55697fa700 1 -- 172.21.15.114:0/3599054360 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700993c0 con 0x55daac4dabe0 2023-10-18T14:09:15.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.824+0000 7f558cb2db80 1 -- 172.21.15.114:0/3599054360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 msgr2=0x55daac4e5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.824+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3599054360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 0x55daac4e5ee0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f55700ca4d0 tx=0x7f5570000bc0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.824+0000 7f558cb2db80 1 -- 172.21.15.114:0/3599054360 shutdown_connections 2023-10-18T14:09:15.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.824+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3599054360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4db500 0x55daac4d59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.824+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3599054360 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4d55d0 0x55daac4ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.824+0000 7f558cb2db80 1 --2- 172.21.15.114:0/3599054360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4dabe0 0x55daac4e5ee0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.824+0000 7f558cb2db80 1 -- 172.21.15.114:0/3599054360 >> 172.21.15.114:0/3599054360 conn(0x55daac449720 msgr2=0x55daac4d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.824+0000 7f558cb2db80 1 -- 172.21.15.114:0/3599054360 shutdown_connections 2023-10-18T14:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.824+0000 7f558cb2db80 1 -- 172.21.15.114:0/3599054360 wait complete. 2023-10-18T14:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.824+0000 7f558cb2db80 1 -- start start 2023-10-18T14:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f558cb2db80 1 Processor -- start 2023-10-18T14:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f558cb2db80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 0x55daac4e40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f558cb2db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4dabe0 0x55daac4e45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f558cb2db80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4db500 0x55daac541a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f558cb2db80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daac541f60 con 0x55daac4d55d0 2023-10-18T14:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f558cb2db80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daac5420a0 con 0x55daac4db500 2023-10-18T14:09:15.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f558cb2db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daac5421e0 con 0x55daac4dabe0 2023-10-18T14:09:15.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f558cb2db80 10 client.0 _ll_register_callbacks cb 0x55daac30ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:09:15.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f557a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 0x55daac4e40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f557a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 0x55daac4e40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46668/0 (socket says 172.21.15.114:46668) 2023-10-18T14:09:15.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f557a59c700 1 -- 172.21.15.114:0/2090748340 learned_addr learned my addr 172.21.15.114:0/2090748340 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:15.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f557a59c700 1 -- 172.21.15.114:0/2090748340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4dabe0 msgr2=0x55daac4e45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f5579d9b700 1 --2- 172.21.15.114:0/2090748340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4dabe0 0x55daac4e45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f557a59c700 1 --2- 172.21.15.114:0/2090748340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4dabe0 0x55daac4e45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f557a59c700 1 -- 172.21.15.114:0/2090748340 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4db500 msgr2=0x55daac541a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:15.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f557a59c700 1 --2- 172.21.15.114:0/2090748340 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4db500 0x55daac541a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f557a59c700 1 -- 172.21.15.114:0/2090748340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55daac252de0 con 0x55daac4d55d0 2023-10-18T14:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f557a59c700 1 --2- 172.21.15.114:0/2090748340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 0x55daac4e40b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f556c015000 tx=0x7f556c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7dd2dbf3495ec6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f5561ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f5561ffb700 1 -- 172.21.15.114:0/2090748340 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c02a040 con 0x55daac4d55d0 2023-10-18T14:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f5561ffb700 1 -- 172.21.15.114:0/2090748340 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f556c032e00 con 0x55daac4d55d0 2023-10-18T14:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.825+0000 7f558cb2db80 1 -- 172.21.15.114:0/2090748340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f557400f040 con 0x55daac4d55d0 2023-10-18T14:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.826+0000 7f5561ffb700 1 -- 172.21.15.114:0/2090748340 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f556c032040 con 0x55daac4d55d0 2023-10-18T14:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.826+0000 7f558cb2db80 10 client.16680 fetch_fsmap learned FSMap version 44 2023-10-18T14:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.826+0000 7f558cb2db80 1 -- 172.21.15.114:0/2090748340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55daac279250 con 0x55daac4d55d0 2023-10-18T14:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.826+0000 7f5561ffb700 1 -- 172.21.15.114:0/2090748340 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f557400f040 con 0x55daac4d55d0 2023-10-18T14:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.826+0000 7f5561ffb700 1 -- 172.21.15.114:0/2090748340 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 44) v1 ==== 7958+0+0 (secure 0 0 0) 0x7f556c038020 con 0x55daac4d55d0 2023-10-18T14:09:15.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.826+0000 7f558cb2db80 10 client.16680 fetch_fsmap finished waiting for FSMap version 44 2023-10-18T14:09:15.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.826+0000 7f558cb2db80 10 client.16680 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-18T14:09:15.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.826+0000 7f558cb2db80 20 client.16680 populate_metadata read hostname 'smithi114' 2023-10-18T14:09:15.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.826+0000 7f558cb2db80 1 --2- 172.21.15.114:0/2090748340 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55daac4eec10 0x55daac5459f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:15.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.826+0000 7f558cb2db80 4 client.16680 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:09:15.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.826+0000 7f558cb2db80 1 -- 172.21.15.114:0/2090748340 --> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55daac420e50 con 0x55daac4eec10 2023-10-18T14:09:15.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.826+0000 7f5579d9b700 1 --2- 172.21.15.114:0/2090748340 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55daac4eec10 0x55daac5459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:15.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.827+0000 7f5561ffb700 10 client.16680 ms_handle_connect on v2:172.21.15.172:6834/2655563129 2023-10-18T14:09:15.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.827+0000 7f5579d9b700 1 --2- 172.21.15.114:0/2090748340 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55daac4eec10 0x55daac5459f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fb7da497fd8f300a server_cookie=b143374922bb191e in_seq=0 out_seq=0 2023-10-18T14:09:15.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.828+0000 7f5561ffb700 1 -- 172.21.15.114:0/2090748340 <== mds.2 v2:172.21.15.172:6834/2655563129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+71205 (crc 0 0 0) 0x55daac420e50 con 0x55daac4eec10 2023-10-18T14:09:15.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.828+0000 7f5561ffb700 10 client.16680 handle_command_reply: tid=0 2023-10-18T14:09:15.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.828+0000 7f558cb2db80 1 client.16680 shutdown 2023-10-18T14:09:15.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.828+0000 7f558cb2db80 1 -- 172.21.15.114:0/2090748340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 msgr2=0x55daac4e40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:15.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.828+0000 7f558cb2db80 1 --2- 172.21.15.114:0/2090748340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 0x55daac4e40b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f556c015000 tx=0x7f556c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f558cb2db80 1 -- 172.21.15.114:0/2090748340 shutdown_connections 2023-10-18T14:09:15.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f558cb2db80 1 --2- 172.21.15.114:0/2090748340 >> [v2:172.21.15.172:6834/2655563129,v1:172.21.15.172:6835/2655563129] conn(0x55daac4eec10 0x55daac5459f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f558cb2db80 1 --2- 172.21.15.114:0/2090748340 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55daac4db500 0x55daac541a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f5561ffb700 0 client.16680 ms_handle_reset on v2:172.21.15.172:6834/2655563129 2023-10-18T14:09:15.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f558cb2db80 1 --2- 172.21.15.114:0/2090748340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55daac4d55d0 0x55daac4e40b0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f558cb2db80 1 --2- 172.21.15.114:0/2090748340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55daac4dabe0 0x55daac4e45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:15.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f558cb2db80 1 -- 172.21.15.114:0/2090748340 >> 172.21.15.114:0/2090748340 conn(0x55daac449720 msgr2=0x55daac4d59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:15.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f558cb2db80 1 -- 172.21.15.114:0/2090748340 shutdown_connections 2023-10-18T14:09:15.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f558cb2db80 1 -- 172.21.15.114:0/2090748340 wait complete. 2023-10-18T14:09:15.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f558cb2db80 20 client.16680 trim_cache size 0 max 16384 2023-10-18T14:09:15.858 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2023-10-18T14:09:15.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.859 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.859 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 26016250, 2023-10-18T14:09:15.859 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631130, 2023-10-18T14:09:15.859 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/228.out" 2023-10-18T14:09:15.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.860 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.860 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 29614554, 2023-10-18T14:09:15.860 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631391, 2023-10-18T14:09:15.861 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/353.out" 2023-10-18T14:09:15.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.861 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.861 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.861 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 49562280, 2023-10-18T14:09:15.862 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633189, 2023-10-18T14:09:15.862 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/566" 2023-10-18T14:09:15.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.862 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.863 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 54203392, 2023-10-18T14:09:15.863 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633126, 2023-10-18T14:09:15.863 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/505" 2023-10-18T14:09:15.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.863 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.863 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.864 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 55834388, 2023-10-18T14:09:15.864 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633017, 2023-10-18T14:09:15.864 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/404.out" 2023-10-18T14:09:15.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.865 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.865 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.865 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 59500247, 2023-10-18T14:09:15.865 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630837, 2023-10-18T14:09:15.865 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/086.out" 2023-10-18T14:09:15.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.866 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.866 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.866 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 67387473, 2023-10-18T14:09:15.866 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629264, 2023-10-18T14:09:15.866 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/530.out" 2023-10-18T14:09:15.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.867 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.867 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.867 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 90583784, 2023-10-18T14:09:15.867 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632586, 2023-10-18T14:09:15.868 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/222" 2023-10-18T14:09:15.868 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.868 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.868 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.868 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 92277442, 2023-10-18T14:09:15.869 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630920, 2023-10-18T14:09:15.869 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/124.out" 2023-10-18T14:09:15.869 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.869 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.869 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.870 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 101725783, 2023-10-18T14:09:15.870 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631694, 2023-10-18T14:09:15.870 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/505.out" 2023-10-18T14:09:15.870 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.870 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.870 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.871 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 102741454, 2023-10-18T14:09:15.871 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630039, 2023-10-18T14:09:15.871 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/322.out" 2023-10-18T14:09:15.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.871 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.872 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.872 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 102951802, 2023-10-18T14:09:15.872 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631479, 2023-10-18T14:09:15.872 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/397.out" 2023-10-18T14:09:15.872 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.872 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.873 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.873 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 107614749, 2023-10-18T14:09:15.873 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629124, 2023-10-18T14:09:15.873 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/460.out" 2023-10-18T14:09:15.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.874 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.874 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.874 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 109934768, 2023-10-18T14:09:15.874 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629851, 2023-10-18T14:09:15.874 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/228.out" 2023-10-18T14:09:15.875 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.875 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.875 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.875 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 139681571, 2023-10-18T14:09:15.875 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632922, 2023-10-18T14:09:15.876 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/315" 2023-10-18T14:09:15.876 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.876 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.876 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.876 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 145898793, 2023-10-18T14:09:15.877 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633029, 2023-10-18T14:09:15.877 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/416" 2023-10-18T14:09:15.877 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.877 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.877 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.877 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 148644343, 2023-10-18T14:09:15.878 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628770, 2023-10-18T14:09:15.878 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/158.out" 2023-10-18T14:09:15.878 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.878 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.878 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.879 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 160078496, 2023-10-18T14:09:15.879 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631056, 2023-10-18T14:09:15.879 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/192.out" 2023-10-18T14:09:15.879 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.879 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.880 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.880 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 186794570, 2023-10-18T14:09:15.880 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628519, 2023-10-18T14:09:15.880 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/037.out" 2023-10-18T14:09:15.880 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.881 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.881 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.881 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 208093013, 2023-10-18T14:09:15.881 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632338, 2023-10-18T14:09:15.881 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/002" 2023-10-18T14:09:15.882 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.882 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.882 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.882 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 208568462, 2023-10-18T14:09:15.882 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631334, 2023-10-18T14:09:15.883 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/325.out" 2023-10-18T14:09:15.883 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.883 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.883 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.883 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 230047518, 2023-10-18T14:09:15.883 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633046, 2023-10-18T14:09:15.884 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/431" 2023-10-18T14:09:15.884 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.884 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.884 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.884 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 248189304, 2023-10-18T14:09:15.885 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628782, 2023-10-18T14:09:15.885 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/164.out" 2023-10-18T14:09:15.885 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.885 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.885 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.886 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 251412045, 2023-10-18T14:09:15.886 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633122, 2023-10-18T14:09:15.886 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/501.out" 2023-10-18T14:09:15.886 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.886 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.887 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.887 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 259699141, 2023-10-18T14:09:15.887 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633148, 2023-10-18T14:09:15.887 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/527" 2023-10-18T14:09:15.887 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.887 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.888 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.888 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 283691854, 2023-10-18T14:09:15.888 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633073, 2023-10-18T14:09:15.888 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/456" 2023-10-18T14:09:15.888 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.888 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.889 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.889 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 286336715, 2023-10-18T14:09:15.889 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629064, 2023-10-18T14:09:15.889 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/430.out" 2023-10-18T14:09:15.889 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.889 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.890 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.890 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 304324748, 2023-10-18T14:09:15.890 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633065, 2023-10-18T14:09:15.890 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/448" 2023-10-18T14:09:15.890 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.891 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.891 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.891 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 318590312, 2023-10-18T14:09:15.891 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629178, 2023-10-18T14:09:15.891 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/487.out" 2023-10-18T14:09:15.892 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.892 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.892 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.892 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 322696712, 2023-10-18T14:09:15.892 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631633, 2023-10-18T14:09:15.892 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/474.out" 2023-10-18T14:09:15.893 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.893 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.893 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.893 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 328872254, 2023-10-18T14:09:15.893 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632913, 2023-10-18T14:09:15.893 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/306" 2023-10-18T14:09:15.894 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.894 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.894 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.894 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 338939380, 2023-10-18T14:09:15.894 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630704, 2023-10-18T14:09:15.895 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/021.out" 2023-10-18T14:09:15.895 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.895 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.895 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.895 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 375203403, 2023-10-18T14:09:15.896 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631489, 2023-10-18T14:09:15.896 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/402.out" 2023-10-18T14:09:15.896 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.896 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.896 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.897 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 396331241, 2023-10-18T14:09:15.897 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630764, 2023-10-18T14:09:15.897 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/050.out" 2023-10-18T14:09:15.897 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.897 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.898 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.898 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 400677067, 2023-10-18T14:09:15.898 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632966, 2023-10-18T14:09:15.898 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/357" 2023-10-18T14:09:15.898 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.898 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.899 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.899 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 410269588, 2023-10-18T14:09:15.899 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633037, 2023-10-18T14:09:15.899 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/423" 2023-10-18T14:09:15.899 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.900 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.900 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.900 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 432475519, 2023-10-18T14:09:15.900 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633090, 2023-10-18T14:09:15.900 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/472" 2023-10-18T14:09:15.901 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.901 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.901 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.901 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 471567594, 2023-10-18T14:09:15.901 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632388, 2023-10-18T14:09:15.901 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/046" 2023-10-18T14:09:15.902 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.902 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.902 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.902 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 512749238, 2023-10-18T14:09:15.903 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633656, 2023-10-18T14:09:15.903 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/002" 2023-10-18T14:09:15.903 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.903 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.903 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.903 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 517167931, 2023-10-18T14:09:15.904 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630811, 2023-10-18T14:09:15.904 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/073.out" 2023-10-18T14:09:15.904 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.904 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.904 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.904 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 544250281, 2023-10-18T14:09:15.905 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632380, 2023-10-18T14:09:15.905 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/038" 2023-10-18T14:09:15.905 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.905 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.905 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.906 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 555904310, 2023-10-18T14:09:15.906 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628451, 2023-10-18T14:09:15.906 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/004.out" 2023-10-18T14:09:15.906 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.906 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.907 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.907 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 557083517, 2023-10-18T14:09:15.907 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633216, 2023-10-18T14:09:15.907 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/588" 2023-10-18T14:09:15.907 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.907 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.908 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.908 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 575318630, 2023-10-18T14:09:15.908 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633192, 2023-10-18T14:09:15.908 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/568" 2023-10-18T14:09:15.908 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.908 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.909 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.909 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 593608699, 2023-10-18T14:09:15.909 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632422, 2023-10-18T14:09:15.909 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/065" 2023-10-18T14:09:15.909 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.910 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.910 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.910 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 606845166, 2023-10-18T14:09:15.910 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629026, 2023-10-18T14:09:15.910 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/411.out" 2023-10-18T14:09:15.911 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.911 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.911 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.911 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 627551225, 2023-10-18T14:09:15.911 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628880, 2023-10-18T14:09:15.911 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/338.out" 2023-10-18T14:09:15.912 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.912 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.912 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.912 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 640170039, 2023-10-18T14:09:15.912 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631585, 2023-10-18T14:09:15.912 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/450.out" 2023-10-18T14:09:15.913 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.913 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.913 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.913 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 656563381, 2023-10-18T14:09:15.913 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631567, 2023-10-18T14:09:15.913 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/441.out" 2023-10-18T14:09:15.914 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.914 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.914 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.914 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 660874292, 2023-10-18T14:09:15.914 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628694, 2023-10-18T14:09:15.915 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/120.out" 2023-10-18T14:09:15.915 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.915 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.915 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.915 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 662318176, 2023-10-18T14:09:15.916 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629176, 2023-10-18T14:09:15.916 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/486.out" 2023-10-18T14:09:15.916 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.916 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.916 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.917 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 723283165, 2023-10-18T14:09:15.917 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630664, 2023-10-18T14:09:15.917 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/001.out" 2023-10-18T14:09:15.917 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.917 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.917 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.918 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 736674274, 2023-10-18T14:09:15.918 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630041, 2023-10-18T14:09:15.918 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/323.out" 2023-10-18T14:09:15.918 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.918 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.919 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.919 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 751938322, 2023-10-18T14:09:15.919 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632639, 2023-10-18T14:09:15.919 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/275" 2023-10-18T14:09:15.919 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.920 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.920 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.920 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 754233813, 2023-10-18T14:09:15.920 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629044, 2023-10-18T14:09:15.920 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/420.out" 2023-10-18T14:09:15.920 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.921 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.921 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.921 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 760190353, 2023-10-18T14:09:15.921 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629070, 2023-10-18T14:09:15.921 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/433.out" 2023-10-18T14:09:15.922 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.922 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.922 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.922 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 799089083, 2023-10-18T14:09:15.922 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632357, 2023-10-18T14:09:15.923 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/020.out" 2023-10-18T14:09:15.923 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.923 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.923 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.923 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 800278572, 2023-10-18T14:09:15.923 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628872, 2023-10-18T14:09:15.924 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/334.out" 2023-10-18T14:09:15.924 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.924 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.924 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.924 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 800987314, 2023-10-18T14:09:15.924 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633094, 2023-10-18T14:09:15.925 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/476" 2023-10-18T14:09:15.925 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.925 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.925 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.925 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 825849363, 2023-10-18T14:09:15.926 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629246, 2023-10-18T14:09:15.926 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/521.out" 2023-10-18T14:09:15.926 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.926 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.926 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.927 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 829785963, 2023-10-18T14:09:15.927 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631098, 2023-10-18T14:09:15.927 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/213.out" 2023-10-18T14:09:15.927 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.927 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.928 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.928 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 835294064, 2023-10-18T14:09:15.928 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628566, 2023-10-18T14:09:15.928 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/056.out" 2023-10-18T14:09:15.928 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.928 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.929 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.929 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 835729888, 2023-10-18T14:09:15.929 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629180, 2023-10-18T14:09:15.929 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/488.out" 2023-10-18T14:09:15.929 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.930 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.930 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.930 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 839213845, 2023-10-18T14:09:15.930 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629883, 2023-10-18T14:09:15.930 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/244.out" 2023-10-18T14:09:15.930 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.931 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.931 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.931 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 839257988, 2023-10-18T14:09:15.931 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632620, 2023-10-18T14:09:15.931 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/256" 2023-10-18T14:09:15.932 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.932 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.932 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.932 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 870823026, 2023-10-18T14:09:15.932 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631565, 2023-10-18T14:09:15.933 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/440.out" 2023-10-18T14:09:15.933 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.933 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.933 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.933 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 912841138, 2023-10-18T14:09:15.933 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628851, 2023-10-18T14:09:15.934 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/224.out" 2023-10-18T14:09:15.934 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.934 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.934 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.934 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 918115398, 2023-10-18T14:09:15.935 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632444, 2023-10-18T14:09:15.935 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/086.out" 2023-10-18T14:09:15.935 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.935 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.935 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.936 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 918126437, 2023-10-18T14:09:15.936 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631204, 2023-10-18T14:09:15.936 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/260.out" 2023-10-18T14:09:15.936 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.936 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.937 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.937 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 937496714, 2023-10-18T14:09:15.937 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632614, 2023-10-18T14:09:15.937 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/250" 2023-10-18T14:09:15.937 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.937 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.938 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.938 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 939854417, 2023-10-18T14:09:15.938 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630847, 2023-10-18T14:09:15.938 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/091.out" 2023-10-18T14:09:15.938 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.939 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.939 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.939 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 958943604, 2023-10-18T14:09:15.939 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633086, 2023-10-18T14:09:15.939 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/469" 2023-10-18T14:09:15.940 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.940 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.940 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.940 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 988403230, 2023-10-18T14:09:15.940 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629861, 2023-10-18T14:09:15.940 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/233.out" 2023-10-18T14:09:15.941 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.941 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.941 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.941 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 993462863, 2023-10-18T14:09:15.941 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628904, 2023-10-18T14:09:15.941 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/350.out" 2023-10-18T14:09:15.942 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.942 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.942 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.942 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 998278457, 2023-10-18T14:09:15.942 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633106, 2023-10-18T14:09:15.943 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/487" 2023-10-18T14:09:15.943 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.943 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.943 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.943 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1026199462, 2023-10-18T14:09:15.943 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632446, 2023-10-18T14:09:15.944 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/088" 2023-10-18T14:09:15.944 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.944 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.944 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.944 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1027256094, 2023-10-18T14:09:15.944 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633103, 2023-10-18T14:09:15.945 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/484.out" 2023-10-18T14:09:15.945 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.945 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.945 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.945 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1042228942, 2023-10-18T14:09:15.945 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632413, 2023-10-18T14:09:15.946 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/056" 2023-10-18T14:09:15.946 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.946 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.946 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.946 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1042614615, 2023-10-18T14:09:15.947 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633208, 2023-10-18T14:09:15.947 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/580" 2023-10-18T14:09:15.947 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.947 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.947 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.948 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1049807207, 2023-10-18T14:09:15.948 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628690, 2023-10-18T14:09:15.948 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/118.out" 2023-10-18T14:09:15.948 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.948 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.948 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.949 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1080943690, 2023-10-18T14:09:15.949 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629186, 2023-10-18T14:09:15.949 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/491.out" 2023-10-18T14:09:15.949 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.949 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.949 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.950 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1081552231, 2023-10-18T14:09:15.950 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633182, 2023-10-18T14:09:15.950 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/559" 2023-10-18T14:09:15.950 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.950 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.951 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.951 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1099866180, 2023-10-18T14:09:15.951 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630726, 2023-10-18T14:09:15.951 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/032.out" 2023-10-18T14:09:15.951 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.951 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.952 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.952 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1139487670, 2023-10-18T14:09:15.952 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633121, 2023-10-18T14:09:15.952 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/501" 2023-10-18T14:09:15.952 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.953 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.953 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.953 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1165834224, 2023-10-18T14:09:15.953 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631074, 2023-10-18T14:09:15.953 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/201.out" 2023-10-18T14:09:15.953 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.954 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.954 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.954 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1215276523, 2023-10-18T14:09:15.954 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628658, 2023-10-18T14:09:15.954 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/102.out" 2023-10-18T14:09:15.955 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.955 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.955 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.955 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1217937204, 2023-10-18T14:09:15.955 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631467, 2023-10-18T14:09:15.956 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/391.out" 2023-10-18T14:09:15.956 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.956 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.956 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.956 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1222791298, 2023-10-18T14:09:15.957 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628918, 2023-10-18T14:09:15.957 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/357.out" 2023-10-18T14:09:15.957 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.957 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.957 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.957 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1235407671, 2023-10-18T14:09:15.958 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630940, 2023-10-18T14:09:15.958 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/134.out" 2023-10-18T14:09:15.958 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.958 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.958 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.959 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1239021142, 2023-10-18T14:09:15.959 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629278, 2023-10-18T14:09:15.959 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/537.out" 2023-10-18T14:09:15.959 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.959 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.960 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.960 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1239175168, 2023-10-18T14:09:15.960 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628788, 2023-10-18T14:09:15.960 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/167.out" 2023-10-18T14:09:15.960 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.961 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.961 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.961 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1250169323, 2023-10-18T14:09:15.961 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631262, 2023-10-18T14:09:15.961 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/289.out" 2023-10-18T14:09:15.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.962 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.962 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.962 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1274794263, 2023-10-18T14:09:15.962 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633188, 2023-10-18T14:09:15.962 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/565" 2023-10-18T14:09:15.963 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.963 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.963 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.963 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1277061171, 2023-10-18T14:09:15.963 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630874, 2023-10-18T14:09:15.964 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/104.out" 2023-10-18T14:09:15.964 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.964 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.964 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.964 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1295189787, 2023-10-18T14:09:15.964 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632495, 2023-10-18T14:09:15.965 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/136" 2023-10-18T14:09:15.965 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.965 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.965 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.965 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1308238669, 2023-10-18T14:09:15.966 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630839, 2023-10-18T14:09:15.966 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/087.out" 2023-10-18T14:09:15.966 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.966 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.966 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.967 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1316058906, 2023-10-18T14:09:15.967 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632954, 2023-10-18T14:09:15.967 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/347" 2023-10-18T14:09:15.967 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.967 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.967 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.968 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1329266401, 2023-10-18T14:09:15.968 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632600, 2023-10-18T14:09:15.968 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/236" 2023-10-18T14:09:15.968 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.968 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.969 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.969 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1341080967, 2023-10-18T14:09:15.969 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631340, 2023-10-18T14:09:15.969 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/328.out" 2023-10-18T14:09:15.969 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.969 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.970 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.970 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1342552314, 2023-10-18T14:09:15.970 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632455, 2023-10-18T14:09:15.970 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/096" 2023-10-18T14:09:15.970 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.971 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.971 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.971 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1346506185, 2023-10-18T14:09:15.971 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632584, 2023-10-18T14:09:15.971 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/220" 2023-10-18T14:09:15.971 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.972 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.972 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.972 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1356638679, 2023-10-18T14:09:15.972 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629989, 2023-10-18T14:09:15.972 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/297.out" 2023-10-18T14:09:15.973 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.973 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.973 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.973 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1384878726, 2023-10-18T14:09:15.973 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631292, 2023-10-18T14:09:15.973 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/304.out" 2023-10-18T14:09:15.974 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.974 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.974 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.974 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1423855575, 2023-10-18T14:09:15.974 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632583, 2023-10-18T14:09:15.975 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/219" 2023-10-18T14:09:15.975 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.975 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.975 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.975 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1431872236, 2023-10-18T14:09:15.976 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630678, 2023-10-18T14:09:15.976 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/008.out" 2023-10-18T14:09:15.976 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.976 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.976 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.976 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1437238386, 2023-10-18T14:09:15.977 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629030, 2023-10-18T14:09:15.977 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/413.out" 2023-10-18T14:09:15.977 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.977 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.977 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.978 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1467584646, 2023-10-18T14:09:15.978 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631296, 2023-10-18T14:09:15.978 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/306.out" 2023-10-18T14:09:15.978 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.978 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.978 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.979 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1481036197, 2023-10-18T14:09:15.979 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631222, 2023-10-18T14:09:15.979 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/269.out" 2023-10-18T14:09:15.979 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.979 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.980 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.980 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1487605899, 2023-10-18T14:09:15.980 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631282, 2023-10-18T14:09:15.980 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/299.out" 2023-10-18T14:09:15.980 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.981 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.981 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.981 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1489837030, 2023-10-18T14:09:15.981 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633120, 2023-10-18T14:09:15.981 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/500" 2023-10-18T14:09:15.982 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.982 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.982 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.982 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1514152449, 2023-10-18T14:09:15.982 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631549, 2023-10-18T14:09:15.982 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/432.out" 2023-10-18T14:09:15.983 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.983 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.983 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.983 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1516430761, 2023-10-18T14:09:15.983 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631310, 2023-10-18T14:09:15.984 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/313.out" 2023-10-18T14:09:15.984 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.984 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.984 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.984 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1523058312, 2023-10-18T14:09:15.985 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631082, 2023-10-18T14:09:15.985 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/205.out" 2023-10-18T14:09:15.985 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.985 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.985 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.986 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1542933348, 2023-10-18T14:09:15.986 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630051, 2023-10-18T14:09:15.986 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/540.out" 2023-10-18T14:09:15.986 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.986 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.987 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.987 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1544206235, 2023-10-18T14:09:15.987 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633088, 2023-10-18T14:09:15.987 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/471" 2023-10-18T14:09:15.987 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.988 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.988 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.988 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1553062552, 2023-10-18T14:09:15.988 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631688, 2023-10-18T14:09:15.988 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/502.out" 2023-10-18T14:09:15.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.989 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.989 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.989 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1573966306, 2023-10-18T14:09:15.989 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628529, 2023-10-18T14:09:15.989 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/042.out" 2023-10-18T14:09:15.990 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.990 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.990 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.990 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1591952493, 2023-10-18T14:09:15.990 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632903, 2023-10-18T14:09:15.990 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/296" 2023-10-18T14:09:15.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.991 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.991 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.991 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1593215482, 2023-10-18T14:09:15.991 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628586, 2023-10-18T14:09:15.992 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/066.out" 2023-10-18T14:09:15.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.992 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.992 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.992 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1593521698, 2023-10-18T14:09:15.992 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630666, 2023-10-18T14:09:15.993 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/002.out" 2023-10-18T14:09:15.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.993 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.993 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.993 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1604437220, 2023-10-18T14:09:15.994 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631218, 2023-10-18T14:09:15.994 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/267.out" 2023-10-18T14:09:15.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:15.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:15.999 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:15.999 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1605731716, 2023-10-18T14:09:16.000 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630752, 2023-10-18T14:09:16.000 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/044.out" 2023-10-18T14:09:16.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.000 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.000 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.001 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1613880769, 2023-10-18T14:09:16.001 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628835, 2023-10-18T14:09:16.001 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/216.out" 2023-10-18T14:09:16.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.001 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.002 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.002 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1622926604, 2023-10-18T14:09:16.002 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630005, 2023-10-18T14:09:16.002 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/305.out" 2023-10-18T14:09:16.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.003 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.003 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.003 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1629003080, 2023-10-18T14:09:16.003 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632938, 2023-10-18T14:09:16.003 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/331" 2023-10-18T14:09:16.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.004 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.004 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.004 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1630399933, 2023-10-18T14:09:16.004 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632581, 2023-10-18T14:09:16.005 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/217" 2023-10-18T14:09:16.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.005 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.005 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1636864303, 2023-10-18T14:09:16.006 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632575, 2023-10-18T14:09:16.006 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/211" 2023-10-18T14:09:16.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.006 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.007 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1647458144, 2023-10-18T14:09:16.007 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630926, 2023-10-18T14:09:16.007 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/127.out" 2023-10-18T14:09:16.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.008 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.008 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1655733319, 2023-10-18T14:09:16.008 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629262, 2023-10-18T14:09:16.008 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/529.out" 2023-10-18T14:09:16.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.009 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.009 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1658585098, 2023-10-18T14:09:16.009 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629991, 2023-10-18T14:09:16.009 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/298.out" 2023-10-18T14:09:16.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.010 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.010 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1667566242, 2023-10-18T14:09:16.010 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633152, 2023-10-18T14:09:16.010 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/530" 2023-10-18T14:09:16.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.011 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.011 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.011 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1673478065, 2023-10-18T14:09:16.011 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632601, 2023-10-18T14:09:16.012 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/237" 2023-10-18T14:09:16.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.012 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.012 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1677521449, 2023-10-18T14:09:16.013 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630111, 2023-10-18T14:09:16.013 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/570.out" 2023-10-18T14:09:16.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.013 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.014 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1727729299, 2023-10-18T14:09:16.014 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631170, 2023-10-18T14:09:16.014 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/243.out" 2023-10-18T14:09:16.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.014 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.015 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1738822320, 2023-10-18T14:09:16.015 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631501, 2023-10-18T14:09:16.015 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/408.out" 2023-10-18T14:09:16.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.016 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.016 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1758361903, 2023-10-18T14:09:16.016 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631493, 2023-10-18T14:09:16.016 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/404.out" 2023-10-18T14:09:16.016 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.016 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.017 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.017 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1769860536, 2023-10-18T14:09:16.017 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632991, 2023-10-18T14:09:16.017 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/380" 2023-10-18T14:09:16.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.018 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.018 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.018 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1784921936, 2023-10-18T14:09:16.018 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633155, 2023-10-18T14:09:16.018 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/533" 2023-10-18T14:09:16.019 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.019 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.019 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.019 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1804075260, 2023-10-18T14:09:16.019 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628754, 2023-10-18T14:09:16.019 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/150.out" 2023-10-18T14:09:16.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.020 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.020 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.020 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1808652880, 2023-10-18T14:09:16.020 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632915, 2023-10-18T14:09:16.020 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/308" 2023-10-18T14:09:16.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.021 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.021 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.021 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1830073160, 2023-10-18T14:09:16.021 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632515, 2023-10-18T14:09:16.021 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/153" 2023-10-18T14:09:16.022 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.022 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.022 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.022 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1846294589, 2023-10-18T14:09:16.022 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630146, 2023-10-18T14:09:16.023 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/590.out" 2023-10-18T14:09:16.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.023 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.023 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.023 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1879965851, 2023-10-18T14:09:16.023 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629014, 2023-10-18T14:09:16.024 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/405.out" 2023-10-18T14:09:16.024 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.024 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.024 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1885723938, 2023-10-18T14:09:16.025 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632543, 2023-10-18T14:09:16.025 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/181" 2023-10-18T14:09:16.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.025 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.025 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.026 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1908144996, 2023-10-18T14:09:16.026 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628660, 2023-10-18T14:09:16.026 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/103.out" 2023-10-18T14:09:16.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.026 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.027 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.027 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1910738882, 2023-10-18T14:09:16.027 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632588, 2023-10-18T14:09:16.027 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/224" 2023-10-18T14:09:16.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.028 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.028 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1916716589, 2023-10-18T14:09:16.028 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632468, 2023-10-18T14:09:16.028 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/109" 2023-10-18T14:09:16.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.029 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.029 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.029 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1920665674, 2023-10-18T14:09:16.029 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628650, 2023-10-18T14:09:16.029 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/098.out" 2023-10-18T14:09:16.030 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.030 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.030 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.030 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1923155702, 2023-10-18T14:09:16.030 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631138, 2023-10-18T14:09:16.031 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/232.out" 2023-10-18T14:09:16.031 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.031 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.031 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.031 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1936628617, 2023-10-18T14:09:16.032 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631324, 2023-10-18T14:09:16.032 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/320.out" 2023-10-18T14:09:16.032 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.032 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.032 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.033 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1944661797, 2023-10-18T14:09:16.033 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633081, 2023-10-18T14:09:16.033 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/464" 2023-10-18T14:09:16.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.033 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.033 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.034 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1956586486, 2023-10-18T14:09:16.034 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631459, 2023-10-18T14:09:16.034 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/387.out" 2023-10-18T14:09:16.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.034 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.035 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.035 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1971579575, 2023-10-18T14:09:16.035 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631362, 2023-10-18T14:09:16.035 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/339.out" 2023-10-18T14:09:16.035 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.036 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.036 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.036 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2017136850, 2023-10-18T14:09:16.036 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631507, 2023-10-18T14:09:16.036 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/411.out" 2023-10-18T14:09:16.036 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.037 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.037 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.037 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2019440721, 2023-10-18T14:09:16.037 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633009, 2023-10-18T14:09:16.037 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/397.out" 2023-10-18T14:09:16.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.038 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.038 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.038 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2038553580, 2023-10-18T14:09:16.038 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633055, 2023-10-18T14:09:16.038 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/439" 2023-10-18T14:09:16.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.039 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.039 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.039 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2043416597, 2023-10-18T14:09:16.039 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633150, 2023-10-18T14:09:16.040 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/528" 2023-10-18T14:09:16.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.040 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.040 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.040 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2051660248, 2023-10-18T14:09:16.040 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631068, 2023-10-18T14:09:16.041 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/198.out" 2023-10-18T14:09:16.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.041 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.041 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.041 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2054632944, 2023-10-18T14:09:16.042 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632611, 2023-10-18T14:09:16.042 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/247" 2023-10-18T14:09:16.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.042 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.042 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2074507350, 2023-10-18T14:09:16.043 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629808, 2023-10-18T14:09:16.043 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/180.out" 2023-10-18T14:09:16.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.043 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.043 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.044 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2107942867, 2023-10-18T14:09:16.044 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629798, 2023-10-18T14:09:16.044 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/175.out" 2023-10-18T14:09:16.044 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.044 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.045 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.045 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2124562749, 2023-10-18T14:09:16.045 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631635, 2023-10-18T14:09:16.045 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/475.out" 2023-10-18T14:09:16.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.046 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.046 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.046 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2133426442, 2023-10-18T14:09:16.046 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632345, 2023-10-18T14:09:16.046 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/009" 2023-10-18T14:09:16.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.047 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.047 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2152640493, 2023-10-18T14:09:16.047 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632975, 2023-10-18T14:09:16.047 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/366" 2023-10-18T14:09:16.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.048 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.048 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2160729841, 2023-10-18T14:09:16.048 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630718, 2023-10-18T14:09:16.049 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/028.out" 2023-10-18T14:09:16.049 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.049 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.049 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.049 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2174435291, 2023-10-18T14:09:16.050 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632596, 2023-10-18T14:09:16.050 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/232" 2023-10-18T14:09:16.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.050 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.050 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2182499443, 2023-10-18T14:09:16.051 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632491, 2023-10-18T14:09:16.051 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/132" 2023-10-18T14:09:16.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.051 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.051 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.052 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2200913390, 2023-10-18T14:09:16.052 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629969, 2023-10-18T14:09:16.052 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/287.out" 2023-10-18T14:09:16.052 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.052 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.052 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.053 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2242137698, 2023-10-18T14:09:16.053 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631184, 2023-10-18T14:09:16.053 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/250.out" 2023-10-18T14:09:16.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.053 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.054 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.054 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2252300209, 2023-10-18T14:09:16.054 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630910, 2023-10-18T14:09:16.054 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/119.out" 2023-10-18T14:09:16.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.055 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.055 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2253986122, 2023-10-18T14:09:16.055 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628946, 2023-10-18T14:09:16.055 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/371.out" 2023-10-18T14:09:16.055 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.056 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.056 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2267894951, 2023-10-18T14:09:16.056 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633214, 2023-10-18T14:09:16.056 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/586" 2023-10-18T14:09:16.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.057 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.057 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.057 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2315645800, 2023-10-18T14:09:16.057 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630692, 2023-10-18T14:09:16.058 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/015.out" 2023-10-18T14:09:16.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.058 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.058 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2348511921, 2023-10-18T14:09:16.059 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628894, 2023-10-18T14:09:16.059 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/345.out" 2023-10-18T14:09:16.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.059 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.059 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.059 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2353339327, 2023-10-18T14:09:16.060 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633092, 2023-10-18T14:09:16.060 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/474" 2023-10-18T14:09:16.060 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.060 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.061 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2367287058, 2023-10-18T14:09:16.061 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633144, 2023-10-18T14:09:16.061 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/523" 2023-10-18T14:09:16.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.061 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.062 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2388683504, 2023-10-18T14:09:16.062 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631100, 2023-10-18T14:09:16.062 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/214.out" 2023-10-18T14:09:16.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.063 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.063 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2394746619, 2023-10-18T14:09:16.063 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631587, 2023-10-18T14:09:16.063 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/451.out" 2023-10-18T14:09:16.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.064 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.064 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2409582164, 2023-10-18T14:09:16.064 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632993, 2023-10-18T14:09:16.064 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/382" 2023-10-18T14:09:16.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.065 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.065 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2418547886, 2023-10-18T14:09:16.065 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630085, 2023-10-18T14:09:16.065 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/557.out" 2023-10-18T14:09:16.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.066 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.066 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2446095729, 2023-10-18T14:09:16.066 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628682, 2023-10-18T14:09:16.066 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/114.out" 2023-10-18T14:09:16.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.067 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.067 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2467530895, 2023-10-18T14:09:16.067 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632973, 2023-10-18T14:09:16.068 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/364" 2023-10-18T14:09:16.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.068 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.068 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2494919721, 2023-10-18T14:09:16.068 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631605, 2023-10-18T14:09:16.069 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/460.out" 2023-10-18T14:09:16.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.069 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.069 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2505685133, 2023-10-18T14:09:16.070 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633014, 2023-10-18T14:09:16.070 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/402" 2023-10-18T14:09:16.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.070 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.071 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2521267614, 2023-10-18T14:09:16.071 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631431, 2023-10-18T14:09:16.071 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/373.out" 2023-10-18T14:09:16.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.071 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.072 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2533784286, 2023-10-18T14:09:16.072 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628588, 2023-10-18T14:09:16.072 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/067.out" 2023-10-18T14:09:16.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.073 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.073 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2549406210, 2023-10-18T14:09:16.073 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632606, 2023-10-18T14:09:16.073 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/242" 2023-10-18T14:09:16.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.074 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.074 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2575245399, 2023-10-18T14:09:16.074 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630142, 2023-10-18T14:09:16.074 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/588.out" 2023-10-18T14:09:16.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.075 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.075 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2575465184, 2023-10-18T14:09:16.075 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631682, 2023-10-18T14:09:16.075 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/499.out" 2023-10-18T14:09:16.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.076 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.076 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2584241356, 2023-10-18T14:09:16.076 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629804, 2023-10-18T14:09:16.076 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/178.out" 2023-10-18T14:09:16.077 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.077 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.077 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2587563095, 2023-10-18T14:09:16.077 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632656, 2023-10-18T14:09:16.078 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/292" 2023-10-18T14:09:16.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.078 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.078 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2603427313, 2023-10-18T14:09:16.079 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632932, 2023-10-18T14:09:16.079 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/325" 2023-10-18T14:09:16.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.079 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.079 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.079 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2608274019, 2023-10-18T14:09:16.080 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629967, 2023-10-18T14:09:16.080 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/286.out" 2023-10-18T14:09:16.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.080 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.081 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2620981606, 2023-10-18T14:09:16.081 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632976, 2023-10-18T14:09:16.081 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/367" 2023-10-18T14:09:16.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.081 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.082 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2634965796, 2023-10-18T14:09:16.082 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631050, 2023-10-18T14:09:16.082 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/189.out" 2023-10-18T14:09:16.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.083 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.083 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2640872145, 2023-10-18T14:09:16.083 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628515, 2023-10-18T14:09:16.083 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/035.out.nfs" 2023-10-18T14:09:16.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.084 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.084 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2667384368, 2023-10-18T14:09:16.084 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629921, 2023-10-18T14:09:16.084 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/263.out" 2023-10-18T14:09:16.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.085 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.085 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2674247479, 2023-10-18T14:09:16.085 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633070, 2023-10-18T14:09:16.085 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/453" 2023-10-18T14:09:16.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.086 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.086 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.086 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2697987718, 2023-10-18T14:09:16.086 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633096, 2023-10-18T14:09:16.087 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/478" 2023-10-18T14:09:16.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.087 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.087 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2711625644, 2023-10-18T14:09:16.088 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630766, 2023-10-18T14:09:16.088 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/051.out" 2023-10-18T14:09:16.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.088 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.088 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2724233021, 2023-10-18T14:09:16.089 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628714, 2023-10-18T14:09:16.089 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/130.out" 2023-10-18T14:09:16.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.089 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.090 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2733855586, 2023-10-18T14:09:16.090 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628942, 2023-10-18T14:09:16.090 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/369.out" 2023-10-18T14:09:16.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.091 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.091 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2741616568, 2023-10-18T14:09:16.091 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632528, 2023-10-18T14:09:16.091 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/166" 2023-10-18T14:09:16.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.092 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.092 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2744772389, 2023-10-18T14:09:16.092 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632641, 2023-10-18T14:09:16.092 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/277" 2023-10-18T14:09:16.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.093 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.093 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2745590318, 2023-10-18T14:09:16.093 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633201, 2023-10-18T14:09:16.093 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/575" 2023-10-18T14:09:16.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.094 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.094 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2759734471, 2023-10-18T14:09:16.094 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631433, 2023-10-18T14:09:16.094 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/374.out" 2023-10-18T14:09:16.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.095 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.095 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.095 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2771487597, 2023-10-18T14:09:16.095 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628807, 2023-10-18T14:09:16.095 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/202.out" 2023-10-18T14:09:16.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.096 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.096 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2790525734, 2023-10-18T14:09:16.096 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630918, 2023-10-18T14:09:16.097 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/123.out" 2023-10-18T14:09:16.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.097 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.097 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2795298567, 2023-10-18T14:09:16.098 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632963, 2023-10-18T14:09:16.098 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/354" 2023-10-18T14:09:16.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.098 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.099 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2802088035, 2023-10-18T14:09:16.099 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629152, 2023-10-18T14:09:16.099 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/474.out" 2023-10-18T14:09:16.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.100 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.100 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2811393575, 2023-10-18T14:09:16.100 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633172, 2023-10-18T14:09:16.100 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/550" 2023-10-18T14:09:16.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.101 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.101 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2823040074, 2023-10-18T14:09:16.101 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628459, 2023-10-18T14:09:16.101 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/008.out" 2023-10-18T14:09:16.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.102 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.102 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2835328690, 2023-10-18T14:09:16.102 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631403, 2023-10-18T14:09:16.102 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/359.out" 2023-10-18T14:09:16.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.103 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.103 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.103 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2840780440, 2023-10-18T14:09:16.103 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633078, 2023-10-18T14:09:16.103 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/461" 2023-10-18T14:09:16.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.104 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.104 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2849563270, 2023-10-18T14:09:16.104 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629022, 2023-10-18T14:09:16.105 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/409.out" 2023-10-18T14:09:16.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.105 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.105 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2879047158, 2023-10-18T14:09:16.105 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633051, 2023-10-18T14:09:16.106 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/435.out" 2023-10-18T14:09:16.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.106 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.106 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2896127113, 2023-10-18T14:09:16.107 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632924, 2023-10-18T14:09:16.107 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/317" 2023-10-18T14:09:16.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.107 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.108 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2908315454, 2023-10-18T14:09:16.108 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628831, 2023-10-18T14:09:16.108 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/214.out" 2023-10-18T14:09:16.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.108 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.109 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2917538177, 2023-10-18T14:09:16.109 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632623, 2023-10-18T14:09:16.109 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/259" 2023-10-18T14:09:16.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.110 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.110 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2918121978, 2023-10-18T14:09:16.110 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633006, 2023-10-18T14:09:16.110 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/395" 2023-10-18T14:09:16.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.111 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.111 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2918323474, 2023-10-18T14:09:16.111 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631120, 2023-10-18T14:09:16.111 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/223.out" 2023-10-18T14:09:16.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.112 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.112 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2948513708, 2023-10-18T14:09:16.112 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631627, 2023-10-18T14:09:16.112 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/471.out" 2023-10-18T14:09:16.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.113 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.113 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2955295231, 2023-10-18T14:09:16.113 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628827, 2023-10-18T14:09:16.113 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/212.out" 2023-10-18T14:09:16.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.114 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.114 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2962905757, 2023-10-18T14:09:16.114 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632919, 2023-10-18T14:09:16.114 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/312" 2023-10-18T14:09:16.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.115 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.115 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2967768326, 2023-10-18T14:09:16.115 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629078, 2023-10-18T14:09:16.116 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/437.out" 2023-10-18T14:09:16.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.116 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.116 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2969110988, 2023-10-18T14:09:16.116 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633057, 2023-10-18T14:09:16.117 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/440.out" 2023-10-18T14:09:16.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.117 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.117 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2976980220, 2023-10-18T14:09:16.118 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629170, 2023-10-18T14:09:16.118 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/483.out" 2023-10-18T14:09:16.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.118 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.119 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2982601903, 2023-10-18T14:09:16.119 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629132, 2023-10-18T14:09:16.119 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/464.out" 2023-10-18T14:09:16.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.120 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.120 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2992639656, 2023-10-18T14:09:16.120 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629100, 2023-10-18T14:09:16.120 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/448.out" 2023-10-18T14:09:16.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.121 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.121 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2994834917, 2023-10-18T14:09:16.121 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632567, 2023-10-18T14:09:16.121 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/203" 2023-10-18T14:09:16.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.122 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.122 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3019989974, 2023-10-18T14:09:16.122 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628746, 2023-10-18T14:09:16.122 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/146.out" 2023-10-18T14:09:16.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.123 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.123 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3065929442, 2023-10-18T14:09:16.123 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630670, 2023-10-18T14:09:16.123 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/004.out" 2023-10-18T14:09:16.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.124 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.124 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3080000834, 2023-10-18T14:09:16.124 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628606, 2023-10-18T14:09:16.125 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/076.out" 2023-10-18T14:09:16.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.125 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.125 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3094762100, 2023-10-18T14:09:16.126 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632484, 2023-10-18T14:09:16.126 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/125" 2023-10-18T14:09:16.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.126 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.126 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3099652051, 2023-10-18T14:09:16.127 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629232, 2023-10-18T14:09:16.127 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/514.out" 2023-10-18T14:09:16.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.127 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.128 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3117595750, 2023-10-18T14:09:16.128 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631090, 2023-10-18T14:09:16.128 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/209.out" 2023-10-18T14:09:16.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.128 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.129 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3136253782, 2023-10-18T14:09:16.129 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632561, 2023-10-18T14:09:16.129 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/198" 2023-10-18T14:09:16.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.129 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.130 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3169138991, 2023-10-18T14:09:16.130 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632612, 2023-10-18T14:09:16.130 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/248" 2023-10-18T14:09:16.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.131 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.131 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3176167243, 2023-10-18T14:09:16.131 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629820, 2023-10-18T14:09:16.131 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/186.out" 2023-10-18T14:09:16.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.132 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.132 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3177642833, 2023-10-18T14:09:16.132 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632647, 2023-10-18T14:09:16.132 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/283" 2023-10-18T14:09:16.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.133 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.133 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3201720634, 2023-10-18T14:09:16.133 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628958, 2023-10-18T14:09:16.133 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/377.out" 2023-10-18T14:09:16.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.134 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.134 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3202417248, 2023-10-18T14:09:16.134 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629156, 2023-10-18T14:09:16.134 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/476.out" 2023-10-18T14:09:16.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.135 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.135 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3202658122, 2023-10-18T14:09:16.135 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630794, 2023-10-18T14:09:16.135 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/065.out" 2023-10-18T14:09:16.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.136 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.136 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3211038363, 2023-10-18T14:09:16.136 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631284, 2023-10-18T14:09:16.136 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/300.out" 2023-10-18T14:09:16.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.137 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.137 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3231480473, 2023-10-18T14:09:16.137 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632557, 2023-10-18T14:09:16.138 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/194" 2023-10-18T14:09:16.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.138 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.138 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3240627565, 2023-10-18T14:09:16.138 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630813, 2023-10-18T14:09:16.139 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/074.out" 2023-10-18T14:09:16.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.139 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.139 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3276273674, 2023-10-18T14:09:16.140 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630714, 2023-10-18T14:09:16.140 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/026.out" 2023-10-18T14:09:16.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.140 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.140 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3312731990, 2023-10-18T14:09:16.141 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631190, 2023-10-18T14:09:16.141 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/253.out" 2023-10-18T14:09:16.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.141 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.141 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.142 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3335831882, 2023-10-18T14:09:16.142 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630815, 2023-10-18T14:09:16.142 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/075.out" 2023-10-18T14:09:16.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.142 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.143 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3338352973, 2023-10-18T14:09:16.143 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628680, 2023-10-18T14:09:16.143 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/113.out" 2023-10-18T14:09:16.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.144 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.144 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3341384694, 2023-10-18T14:09:16.144 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629148, 2023-10-18T14:09:16.144 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/472.out" 2023-10-18T14:09:16.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.145 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.145 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3343041403, 2023-10-18T14:09:16.145 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629240, 2023-10-18T14:09:16.145 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/518.out" 2023-10-18T14:09:16.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.146 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.146 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3343386530, 2023-10-18T14:09:16.146 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628860, 2023-10-18T14:09:16.146 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/328.out" 2023-10-18T14:09:16.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.147 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.147 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3344929642, 2023-10-18T14:09:16.147 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631393, 2023-10-18T14:09:16.147 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/354.out" 2023-10-18T14:09:16.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.148 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.148 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.148 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3367098089, 2023-10-18T14:09:16.148 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628592, 2023-10-18T14:09:16.149 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/069.out" 2023-10-18T14:09:16.149 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.149 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.149 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3405267306, 2023-10-18T14:09:16.149 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631038, 2023-10-18T14:09:16.150 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/183.out" 2023-10-18T14:09:16.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.150 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.150 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3426165730, 2023-10-18T14:09:16.151 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632570, 2023-10-18T14:09:16.151 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/206" 2023-10-18T14:09:16.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.151 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.152 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3427606720, 2023-10-18T14:09:16.152 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631342, 2023-10-18T14:09:16.152 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/329.out" 2023-10-18T14:09:16.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.152 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.153 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3432052508, 2023-10-18T14:09:16.153 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628558, 2023-10-18T14:09:16.153 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/052.out" 2023-10-18T14:09:16.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.153 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.154 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3438542057, 2023-10-18T14:09:16.154 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632364, 2023-10-18T14:09:16.154 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/027" 2023-10-18T14:09:16.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.155 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.155 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3450151790, 2023-10-18T14:09:16.155 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628839, 2023-10-18T14:09:16.155 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/218.out" 2023-10-18T14:09:16.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.156 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.156 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3451793096, 2023-10-18T14:09:16.156 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630684, 2023-10-18T14:09:16.156 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/011.out" 2023-10-18T14:09:16.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.157 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.157 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3467139745, 2023-10-18T14:09:16.157 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632928, 2023-10-18T14:09:16.157 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/321" 2023-10-18T14:09:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3510379326, 2023-10-18T14:09:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633028, 2023-10-18T14:09:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/415" 2023-10-18T14:09:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3519320052, 2023-10-18T14:09:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630900, 2023-10-18T14:09:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/114.out" 2023-10-18T14:09:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3531752303, 2023-10-18T14:09:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630770, 2023-10-18T14:09:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/053.out" 2023-10-18T14:09:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3559612422, 2023-10-18T14:09:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630009, 2023-10-18T14:09:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/307.out" 2023-10-18T14:09:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3581447119, 2023-10-18T14:09:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633141, 2023-10-18T14:09:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/520" 2023-10-18T14:09:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.164 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.164 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3582404761, 2023-10-18T14:09:16.164 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630140, 2023-10-18T14:09:16.164 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/587.out" 2023-10-18T14:09:16.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.165 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.165 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3588549066, 2023-10-18T14:09:16.165 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631503, 2023-10-18T14:09:16.165 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/409.out" 2023-10-18T14:09:16.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.166 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.166 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3607773775, 2023-10-18T14:09:16.166 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633163, 2023-10-18T14:09:16.166 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/541" 2023-10-18T14:09:16.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.167 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.167 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3663276724, 2023-10-18T14:09:16.167 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628833, 2023-10-18T14:09:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/215.out" 2023-10-18T14:09:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3682342062, 2023-10-18T14:09:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630712, 2023-10-18T14:09:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/025.out" 2023-10-18T14:09:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3683945032, 2023-10-18T14:09:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632511, 2023-10-18T14:09:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/149" 2023-10-18T14:09:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.171 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.171 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3690465472, 2023-10-18T14:09:16.171 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631509, 2023-10-18T14:09:16.171 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/412.out" 2023-10-18T14:09:16.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.172 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.172 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3694368025, 2023-10-18T14:09:16.172 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632366, 2023-10-18T14:09:16.172 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/029" 2023-10-18T14:09:16.172 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3696588253, 2023-10-18T14:09:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628756, 2023-10-18T14:09:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/151.out" 2023-10-18T14:09:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3698426071, 2023-10-18T14:09:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628580, 2023-10-18T14:09:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/063.out" 2023-10-18T14:09:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3721440012, 2023-10-18T14:09:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632634, 2023-10-18T14:09:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/270" 2023-10-18T14:09:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3736446088, 2023-10-18T14:09:16.177 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633140, 2023-10-18T14:09:16.177 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/519" 2023-10-18T14:09:16.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.177 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.177 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3843147313, 2023-10-18T14:09:16.178 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628465, 2023-10-18T14:09:16.178 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/011.out" 2023-10-18T14:09:16.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.178 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.179 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3863965186, 2023-10-18T14:09:16.179 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628778, 2023-10-18T14:09:16.179 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/162.out" 2023-10-18T14:09:16.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.179 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.180 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3871903266, 2023-10-18T14:09:16.180 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630381, 2023-10-18T14:09:16.180 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/579.out" 2023-10-18T14:09:16.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.181 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.181 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3902156049, 2023-10-18T14:09:16.181 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633113, 2023-10-18T14:09:16.181 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/494" 2023-10-18T14:09:16.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.182 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.182 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3913624005, 2023-10-18T14:09:16.182 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629963, 2023-10-18T14:09:16.182 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/284.out" 2023-10-18T14:09:16.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.183 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.183 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3925238585, 2023-10-18T14:09:16.183 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633114, 2023-10-18T14:09:16.183 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/495" 2023-10-18T14:09:16.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.184 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.184 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3942171670, 2023-10-18T14:09:16.184 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631096, 2023-10-18T14:09:16.185 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/212.out" 2023-10-18T14:09:16.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.185 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.185 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.185 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3957459892, 2023-10-18T14:09:16.186 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633124, 2023-10-18T14:09:16.186 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/503" 2023-10-18T14:09:16.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.186 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.187 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3961335400, 2023-10-18T14:09:16.187 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628662, 2023-10-18T14:09:16.187 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/104.out" 2023-10-18T14:09:16.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.187 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.187 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.188 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3990911662, 2023-10-18T14:09:16.188 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628552, 2023-10-18T14:09:16.188 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.default" 2023-10-18T14:09:16.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.189 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.189 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3991463347, 2023-10-18T14:09:16.189 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633042, 2023-10-18T14:09:16.189 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/428" 2023-10-18T14:09:16.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.190 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.190 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4001543413, 2023-10-18T14:09:16.190 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633151, 2023-10-18T14:09:16.190 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/529" 2023-10-18T14:09:16.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.191 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.191 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.191 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4002800208, 2023-10-18T14:09:16.191 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630048, 2023-10-18T14:09:16.191 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/200.out" 2023-10-18T14:09:16.192 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.192 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.192 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.192 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4007090266, 2023-10-18T14:09:16.192 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631066, 2023-10-18T14:09:16.193 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/197.out" 2023-10-18T14:09:16.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.193 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.193 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.193 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4007781039, 2023-10-18T14:09:16.193 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633312, 2023-10-18T14:09:16.194 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.trans_buf" 2023-10-18T14:09:16.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.194 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.194 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.198 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4013840465, 2023-10-18T14:09:16.198 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631399, 2023-10-18T14:09:16.198 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/357.out" 2023-10-18T14:09:16.198 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.199 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.199 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.199 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4024073838, 2023-10-18T14:09:16.199 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631086, 2023-10-18T14:09:16.199 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/207.out" 2023-10-18T14:09:16.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.200 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.200 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4038805104, 2023-10-18T14:09:16.200 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629935, 2023-10-18T14:09:16.200 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/270.out" 2023-10-18T14:09:16.201 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.201 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.201 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.201 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4059353667, 2023-10-18T14:09:16.201 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631579, 2023-10-18T14:09:16.202 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/447.out" 2023-10-18T14:09:16.202 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.202 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.202 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.202 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4093882647, 2023-10-18T14:09:16.203 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631621, 2023-10-18T14:09:16.203 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/468.out" 2023-10-18T14:09:16.203 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.203 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.203 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.203 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4145048180, 2023-10-18T14:09:16.204 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628497, 2023-10-18T14:09:16.204 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/027.out" 2023-10-18T14:09:16.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.204 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.204 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.205 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4163509267, 2023-10-18T14:09:16.205 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631060, 2023-10-18T14:09:16.205 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/194.out" 2023-10-18T14:09:16.205 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.205 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.206 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.206 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4164263704, 2023-10-18T14:09:16.206 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632925, 2023-10-18T14:09:16.206 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/318" 2023-10-18T14:09:16.206 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.206 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.207 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.207 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4166973065, 2023-10-18T14:09:16.207 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630089, 2023-10-18T14:09:16.207 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/559.out" 2023-10-18T14:09:16.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.208 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.208 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.208 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4201770670, 2023-10-18T14:09:16.208 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632610, 2023-10-18T14:09:16.208 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/246" 2023-10-18T14:09:16.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.209 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.209 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.209 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4203319257, 2023-10-18T14:09:16.209 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632939, 2023-10-18T14:09:16.209 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/332" 2023-10-18T14:09:16.210 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.210 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.210 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.210 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4206034676, 2023-10-18T14:09:16.210 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633313, 2023-10-18T14:09:16.211 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.trans_inode" 2023-10-18T14:09:16.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.211 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.211 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.211 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4226144637, 2023-10-18T14:09:16.211 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629806, 2023-10-18T14:09:16.212 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/179.out" 2023-10-18T14:09:16.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.212 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.212 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.212 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4237273788, 2023-10-18T14:09:16.213 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632549, 2023-10-18T14:09:16.213 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/186" 2023-10-18T14:09:16.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.213 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.213 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.214 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4251562313, 2023-10-18T14:09:16.214 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628934, 2023-10-18T14:09:16.214 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/365.out" 2023-10-18T14:09:16.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.214 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.215 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.215 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4262065571, 2023-10-18T14:09:16.215 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629068, 2023-10-18T14:09:16.215 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/432.out" 2023-10-18T14:09:16.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.216 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.216 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.216 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4263344688, 2023-10-18T14:09:16.216 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633185, 2023-10-18T14:09:16.216 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/562" 2023-10-18T14:09:16.217 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:09:16.217 INFO:teuthology.orchestra.run.smithi114.stdout:] 2023-10-18T14:09:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f5580944700 1 -- 172.21.15.114:0/326882182 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f55640a15f0 msgr2=0x7f55640a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f5580944700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f55640a15f0 0x7f55640a3ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f556c00b5c0 tx=0x7f556c005fb0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f5580944700 1 -- 172.21.15.114:0/326882182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f557c0ffae0 msgr2=0x7f557c19ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:16.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f5580944700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f557c0ffae0 0x7f557c19ce30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f557000c920 tx=0x7f557000cc30 comp rx=0 tx=0).stop 2023-10-18T14:09:16.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f5580944700 1 -- 172.21.15.114:0/326882182 shutdown_connections 2023-10-18T14:09:16.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f5580944700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f55640a15f0 0x7f55640a3ab0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f5580944700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f557c106860 0x7f557c196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f5580944700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f557c0ff120 0x7f557c19c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f5580944700 1 --2- 172.21.15.114:0/326882182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f557c0ffae0 0x7f557c19ce30 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f5580944700 1 -- 172.21.15.114:0/326882182 >> 172.21.15.114:0/326882182 conn(0x7f557c074890 msgr2=0x7f557c0fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f5580944700 1 -- 172.21.15.114:0/326882182 shutdown_connections 2023-10-18T14:09:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:15.829+0000 7f5580944700 1 -- 172.21.15.114:0/326882182 wait complete. 2023-10-18T14:09:16.221 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-18T14:09:16.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.381+0000 7f7125fcc700 1 -- 172.21.15.114:0/928123400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71200ff640 msgr2=0x7f71200ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:16.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.381+0000 7f7125fcc700 1 --2- 172.21.15.114:0/928123400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71200ff640 0x7f71200ffac0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7110009990 tx=0x7f7110009ca0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.381+0000 7f7125fcc700 1 -- 172.21.15.114:0/928123400 shutdown_connections 2023-10-18T14:09:16.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.381+0000 7f7125fcc700 1 --2- 172.21.15.114:0/928123400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7120100000 0x7f712010c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.381+0000 7f7125fcc700 1 --2- 172.21.15.114:0/928123400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71201056e0 0x7f7120105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.381+0000 7f7125fcc700 1 --2- 172.21.15.114:0/928123400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71200ff640 0x7f71200ffac0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.381+0000 7f7125fcc700 1 -- 172.21.15.114:0/928123400 >> 172.21.15.114:0/928123400 conn(0x7f71200767f0 msgr2=0x7f7120076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:16.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.381+0000 7f7125fcc700 1 -- 172.21.15.114:0/928123400 shutdown_connections 2023-10-18T14:09:16.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.381+0000 7f7125fcc700 1 -- 172.21.15.114:0/928123400 wait complete. 2023-10-18T14:09:16.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f7125fcc700 1 Processor -- start 2023-10-18T14:09:16.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f7125fcc700 1 -- start start 2023-10-18T14:09:16.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f7125fcc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71200ff640 0x7f71201979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f7125fcc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7120100000 0x7f7120197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f7125fcc700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f71201056e0 0x7f71201a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f7125fcc700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71201987a0 con 0x7f71200ff640 2023-10-18T14:09:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f7125fcc700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71201a2fb0 con 0x7f71201056e0 2023-10-18T14:09:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f7125fcc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71201a30f0 con 0x7f7120100000 2023-10-18T14:09:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f711f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71200ff640 0x7f71201979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f711f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71200ff640 0x7f71201979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46680/0 (socket says 172.21.15.114:46680) 2023-10-18T14:09:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f711f7fe700 1 -- 172.21.15.114:0/2491333952 learned_addr learned my addr 172.21.15.114:0/2491333952 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f711ffff700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f71201056e0 0x7f71201a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f711effd700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7120100000 0x7f7120197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f711f7fe700 1 -- 172.21.15.114:0/2491333952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7120100000 msgr2=0x7f7120197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:16.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f711f7fe700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7120100000 0x7f7120197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f711f7fe700 1 -- 172.21.15.114:0/2491333952 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f71201056e0 msgr2=0x7f71201a2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:16.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f711f7fe700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f71201056e0 0x7f71201a2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.382+0000 7f711f7fe700 1 -- 172.21.15.114:0/2491333952 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100095f0 con 0x7f71200ff640 2023-10-18T14:09:16.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.383+0000 7f711f7fe700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71200ff640 0x7f71201979f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f711400c920 tx=0x7f711400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:16.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.383+0000 7f711cff9700 1 -- 172.21.15.114:0/2491333952 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114007b00 con 0x7f71200ff640 2023-10-18T14:09:16.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.383+0000 7f711cff9700 1 -- 172.21.15.114:0/2491333952 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7114004cf0 con 0x7f71200ff640 2023-10-18T14:09:16.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.383+0000 7f7125fcc700 1 -- 172.21.15.114:0/2491333952 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71201a3380 con 0x7f71200ff640 2023-10-18T14:09:16.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.383+0000 7f711cff9700 1 -- 172.21.15.114:0/2491333952 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114005520 con 0x7f71200ff640 2023-10-18T14:09:16.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.383+0000 7f7125fcc700 1 -- 172.21.15.114:0/2491333952 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71201a3890 con 0x7f71200ff640 2023-10-18T14:09:16.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.386+0000 7f711cff9700 1 -- 172.21.15.114:0/2491333952 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f7114004750 con 0x7f71200ff640 2023-10-18T14:09:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.386+0000 7f711cff9700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f71080a15f0 0x7f71080a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.386+0000 7f711effd700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f71080a15f0 0x7f71080a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.386+0000 7f711cff9700 1 -- 172.21.15.114:0/2491333952 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f71140cccd0 con 0x7f71200ff640 2023-10-18T14:09:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f71321b5b80 1 Processor -- start 2023-10-18T14:09:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f71321b5b80 1 -- start start 2023-10-18T14:09:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f711effd700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f71080a15f0 0x7f71080a3ab0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7110005850 tx=0x7f711001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f71321b5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ebbe0 0x55d64d7ebfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f71321b5b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7ec500 0x55d64d7e6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f71321b5b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 0x55d64d7e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f71321b5b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64d7596e0 con 0x55d64d7e65d0 2023-10-18T14:09:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f71321b5b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64d73fc60 con 0x55d64d7ec500 2023-10-18T14:09:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f71321b5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64d73d580 con 0x55d64d7ebbe0 2023-10-18T14:09:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f711ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 0x55d64d7e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f711ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 0x55d64d7e6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46692/0 (socket says 172.21.15.114:46692) 2023-10-18T14:09:16.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f711ffff700 1 -- 172.21.15.114:0/4281202713 learned_addr learned my addr 172.21.15.114:0/4281202713 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:16.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f711effd700 1 --2- 172.21.15.114:0/4281202713 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7ec500 0x55d64d7e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f711f7fe700 1 --2- 172.21.15.114:0/4281202713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ebbe0 0x55d64d7ebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f711ffff700 1 -- 172.21.15.114:0/4281202713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ebbe0 msgr2=0x55d64d7ebfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:16.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f711ffff700 1 --2- 172.21.15.114:0/4281202713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ebbe0 0x55d64d7ebfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f711ffff700 1 -- 172.21.15.114:0/4281202713 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7ec500 msgr2=0x55d64d7e6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:16.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f711ffff700 1 --2- 172.21.15.114:0/4281202713 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7ec500 0x55d64d7e6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.387+0000 7f711ffff700 1 -- 172.21.15.114:0/4281202713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d64d6f63f0 con 0x55d64d7e65d0 2023-10-18T14:09:16.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.388+0000 7f711ffff700 1 --2- 172.21.15.114:0/4281202713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 0x55d64d7e6a50 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7118009d00 tx=0x7f71180077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d8075346344f52 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:16.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.388+0000 7f7105ffb700 1 -- 172.21.15.114:0/4281202713 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7118019070 con 0x55d64d7e65d0 2023-10-18T14:09:16.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.388+0000 7f7105ffb700 1 -- 172.21.15.114:0/4281202713 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f711800f050 con 0x55d64d7e65d0 2023-10-18T14:09:16.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.388+0000 7f7105ffb700 1 -- 172.21.15.114:0/4281202713 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71180048c0 con 0x55d64d7e65d0 2023-10-18T14:09:16.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.388+0000 7f71321b5b80 1 -- 172.21.15.114:0/4281202713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 msgr2=0x55d64d7e6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:16.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.388+0000 7f71321b5b80 1 --2- 172.21.15.114:0/4281202713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 0x55d64d7e6a50 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7118009d00 tx=0x7f71180077e0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.388+0000 7f71321b5b80 1 -- 172.21.15.114:0/4281202713 shutdown_connections 2023-10-18T14:09:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.388+0000 7f71321b5b80 1 --2- 172.21.15.114:0/4281202713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 0x55d64d7e6a50 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.388+0000 7f71321b5b80 1 --2- 172.21.15.114:0/4281202713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ebbe0 0x55d64d7ebfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.388+0000 7f71321b5b80 1 --2- 172.21.15.114:0/4281202713 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7ec500 0x55d64d7e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.388+0000 7f71321b5b80 1 -- 172.21.15.114:0/4281202713 >> 172.21.15.114:0/4281202713 conn(0x55d64d75a720 msgr2=0x55d64d7e0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.388+0000 7f71321b5b80 1 -- 172.21.15.114:0/4281202713 shutdown_connections 2023-10-18T14:09:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.388+0000 7f71321b5b80 1 -- 172.21.15.114:0/4281202713 wait complete. 2023-10-18T14:09:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.389+0000 7f71321b5b80 1 -- start start 2023-10-18T14:09:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.389+0000 7f71321b5b80 1 Processor -- start 2023-10-18T14:09:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.389+0000 7f71321b5b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7e65d0 0x55d64d7f2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.389+0000 7f71321b5b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 0x55d64d7ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.389+0000 7f71321b5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 0x55d64d7efc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.389+0000 7f71321b5b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64d738e70 con 0x55d64d7ebbe0 2023-10-18T14:09:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.389+0000 7f71321b5b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64d6d5710 con 0x55d64d7e65d0 2023-10-18T14:09:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.389+0000 7f71321b5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64d6d53b0 con 0x55d64d7ec500 2023-10-18T14:09:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.389+0000 7f71321b5b80 10 client.0 _ll_register_callbacks cb 0x55d64d61fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:09:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.389+0000 7f711effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 0x55d64d7ef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.389+0000 7f711effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 0x55d64d7ef6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46696/0 (socket says 172.21.15.114:46696) 2023-10-18T14:09:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.389+0000 7f711effd700 1 -- 172.21.15.114:0/9739987 learned_addr learned my addr 172.21.15.114:0/9739987 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.389+0000 7f711ffff700 1 --2- 172.21.15.114:0/9739987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 0x55d64d7efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f711f7fe700 1 --2- 172.21.15.114:0/9739987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7e65d0 0x55d64d7f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f711effd700 1 -- 172.21.15.114:0/9739987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 msgr2=0x55d64d7efc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:16.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f711effd700 1 --2- 172.21.15.114:0/9739987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 0x55d64d7efc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f711effd700 1 -- 172.21.15.114:0/9739987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7e65d0 msgr2=0x55d64d7f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:16.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f711effd700 1 --2- 172.21.15.114:0/9739987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7e65d0 0x55d64d7f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f711effd700 1 -- 172.21.15.114:0/9739987 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7118009960 con 0x55d64d7ebbe0 2023-10-18T14:09:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f711effd700 1 --2- 172.21.15.114:0/9739987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 0x55d64d7ef6d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7110009990 tx=0x7f7110009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b55309b7eb8ec server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f70feffd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:09:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f70feffd700 1 -- 172.21.15.114:0/9739987 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711002a050 con 0x55d64d7ebbe0 2023-10-18T14:09:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f70feffd700 1 -- 172.21.15.114:0/9739987 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7110004d80 con 0x55d64d7ebbe0 2023-10-18T14:09:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f71321b5b80 1 -- 172.21.15.114:0/9739987 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d64d73def0 con 0x55d64d7ebbe0 2023-10-18T14:09:16.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f70feffd700 1 -- 172.21.15.114:0/9739987 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f711001d040 con 0x55d64d7ebbe0 2023-10-18T14:09:16.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f71321b5b80 10 client.16692 fetch_fsmap learned FSMap version 44 2023-10-18T14:09:16.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f71321b5b80 1 -- 172.21.15.114:0/9739987 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55d64d563de0 con 0x55d64d7ebbe0 2023-10-18T14:09:16.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.390+0000 7f70feffd700 1 -- 172.21.15.114:0/9739987 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d64d73def0 con 0x55d64d7ebbe0 2023-10-18T14:09:16.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.391+0000 7f70feffd700 1 -- 172.21.15.114:0/9739987 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 44) v1 ==== 7958+0+0 (secure 0 0 0) 0x7f7110024440 con 0x55d64d7ebbe0 2023-10-18T14:09:16.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.391+0000 7f71321b5b80 10 client.16692 fetch_fsmap finished waiting for FSMap version 44 2023-10-18T14:09:16.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.391+0000 7f71321b5b80 10 client.16692 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-18T14:09:16.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.391+0000 7f71321b5b80 20 client.16692 populate_metadata read hostname 'smithi114' 2023-10-18T14:09:16.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.391+0000 7f71321b5b80 1 --2- 172.21.15.114:0/9739987 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55d64d7ffe90 0x55d64d8022b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.391+0000 7f71321b5b80 4 client.16692 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:09:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.391+0000 7f71321b5b80 1 -- 172.21.15.114:0/9739987 --> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d64d7b58b0 con 0x55d64d7ffe90 2023-10-18T14:09:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.391+0000 7f711f7fe700 1 --2- 172.21.15.114:0/9739987 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55d64d7ffe90 0x55d64d8022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.391+0000 7f70feffd700 10 client.16692 ms_handle_connect on v2:172.21.15.172:6836/1821444438 2023-10-18T14:09:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.391+0000 7f711f7fe700 1 --2- 172.21.15.114:0/9739987 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55d64d7ffe90 0x55d64d8022b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2eccabf74329cdb3 server_cookie=75ec9818a83a41c9 in_seq=0 out_seq=0 2023-10-18T14:09:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f70feffd700 1 -- 172.21.15.114:0/9739987 <== mds.1 v2:172.21.15.172:6836/1821444438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d64d7b58b0 con 0x55d64d7ffe90 2023-10-18T14:09:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f70feffd700 10 client.16692 handle_command_reply: tid=0 2023-10-18T14:09:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f71321b5b80 1 client.16692 shutdown 2023-10-18T14:09:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f71321b5b80 1 -- 172.21.15.114:0/9739987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 msgr2=0x55d64d7ef6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f71321b5b80 1 --2- 172.21.15.114:0/9739987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 0x55d64d7ef6d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7110009990 tx=0x7f7110009ca0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f71321b5b80 1 -- 172.21.15.114:0/9739987 shutdown_connections 2023-10-18T14:09:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f71321b5b80 1 --2- 172.21.15.114:0/9739987 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55d64d7ffe90 0x55d64d8022b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f71321b5b80 1 --2- 172.21.15.114:0/9739987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 0x55d64d7efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f70feffd700 0 client.16692 ms_handle_reset on v2:172.21.15.172:6836/1821444438 2023-10-18T14:09:16.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f71321b5b80 1 --2- 172.21.15.114:0/9739987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7e65d0 0x55d64d7f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f71321b5b80 1 --2- 172.21.15.114:0/9739987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 0x55d64d7ef6d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f71321b5b80 1 -- 172.21.15.114:0/9739987 >> 172.21.15.114:0/9739987 conn(0x55d64d75a720 msgr2=0x55d64d7e5080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:16.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f71321b5b80 1 -- 172.21.15.114:0/9739987 shutdown_connections 2023-10-18T14:09:16.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f71321b5b80 1 -- 172.21.15.114:0/9739987 wait complete. 2023-10-18T14:09:16.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.392+0000 7f71321b5b80 20 client.16692 trim_cache size 0 max 16384 2023-10-18T14:09:16.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.405+0000 7f71321b5b80 1 Processor -- start 2023-10-18T14:09:16.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.405+0000 7f71321b5b80 1 -- start start 2023-10-18T14:09:16.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.405+0000 7f71321b5b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 0x55d64d7f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.405+0000 7f71321b5b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7ebbe0 0x55d64d7e5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.405+0000 7f71321b5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 0x55d64d7e9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.405+0000 7f71321b5b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64d5b9920 con 0x55d64d7e65d0 2023-10-18T14:09:16.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.405+0000 7f71321b5b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64d7d9090 con 0x55d64d7ebbe0 2023-10-18T14:09:16.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.405+0000 7f71321b5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64d7dd230 con 0x55d64d7ec500 2023-10-18T14:09:16.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.405+0000 7f711f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 0x55d64d7f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.405+0000 7f711f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 0x55d64d7f6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46702/0 (socket says 172.21.15.114:46702) 2023-10-18T14:09:16.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.405+0000 7f711f7fe700 1 -- 172.21.15.114:0/557712489 learned_addr learned my addr 172.21.15.114:0/557712489 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:16.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f711effd700 1 --2- 172.21.15.114:0/557712489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7ebbe0 0x55d64d7e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f711ffff700 1 --2- 172.21.15.114:0/557712489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 0x55d64d7e9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f711f7fe700 1 -- 172.21.15.114:0/557712489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 msgr2=0x55d64d7e9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:16.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f711f7fe700 1 --2- 172.21.15.114:0/557712489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 0x55d64d7e9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f711f7fe700 1 -- 172.21.15.114:0/557712489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7ebbe0 msgr2=0x55d64d7e5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:16.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f711f7fe700 1 --2- 172.21.15.114:0/557712489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7ebbe0 0x55d64d7e5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f711f7fe700 1 -- 172.21.15.114:0/557712489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d64d54cc60 con 0x55d64d7e65d0 2023-10-18T14:09:16.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f711effd700 1 --2- 172.21.15.114:0/557712489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7ebbe0 0x55d64d7e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:09:16.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f711f7fe700 1 --2- 172.21.15.114:0/557712489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 0x55d64d7f6eb0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f71140ca500 tx=0x7f711401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bb9966e7bd88e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:16.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f71067fc700 1 -- 172.21.15.114:0/557712489 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711409a430 con 0x55d64d7e65d0 2023-10-18T14:09:16.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f71067fc700 1 -- 172.21.15.114:0/557712489 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7114099d30 con 0x55d64d7e65d0 2023-10-18T14:09:16.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f71067fc700 1 -- 172.21.15.114:0/557712489 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114098180 con 0x55d64d7e65d0 2023-10-18T14:09:16.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f71321b5b80 1 -- 172.21.15.114:0/557712489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 msgr2=0x55d64d7f6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:16.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f71321b5b80 1 --2- 172.21.15.114:0/557712489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 0x55d64d7f6eb0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f71140ca500 tx=0x7f711401a040 comp rx=0 tx=0).stop 2023-10-18T14:09:16.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f71321b5b80 1 -- 172.21.15.114:0/557712489 shutdown_connections 2023-10-18T14:09:16.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f71321b5b80 1 --2- 172.21.15.114:0/557712489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 0x55d64d7e9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f71321b5b80 1 --2- 172.21.15.114:0/557712489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7e65d0 0x55d64d7f6eb0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.406+0000 7f71321b5b80 1 --2- 172.21.15.114:0/557712489 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7ebbe0 0x55d64d7e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f71321b5b80 1 -- 172.21.15.114:0/557712489 >> 172.21.15.114:0/557712489 conn(0x55d64d75a720 msgr2=0x55d64d7e69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:16.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f71321b5b80 1 -- 172.21.15.114:0/557712489 shutdown_connections 2023-10-18T14:09:16.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f71321b5b80 1 -- 172.21.15.114:0/557712489 wait complete. 2023-10-18T14:09:16.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f71321b5b80 1 -- start start 2023-10-18T14:09:16.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f71321b5b80 1 Processor -- start 2023-10-18T14:09:16.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f71321b5b80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7e65d0 0x55d64d7fbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f71321b5b80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 0x55d64d7f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f71321b5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 0x55d64d7f6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f71321b5b80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64d7f6960 con 0x55d64d7ebbe0 2023-10-18T14:09:16.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f71321b5b80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64d7f6ad0 con 0x55d64d7e65d0 2023-10-18T14:09:16.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f71321b5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64d7f6c90 con 0x55d64d7ec500 2023-10-18T14:09:16.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f71321b5b80 10 client.0 _ll_register_callbacks cb 0x55d64d61fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:09:16.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f711effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 0x55d64d7f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f711effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 0x55d64d7f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46710/0 (socket says 172.21.15.114:46710) 2023-10-18T14:09:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f711effd700 1 -- 172.21.15.114:0/1800002310 learned_addr learned my addr 172.21.15.114:0/1800002310 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f711ffff700 1 --2- 172.21.15.114:0/1800002310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 0x55d64d7f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.407+0000 7f711f7fe700 1 --2- 172.21.15.114:0/1800002310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7e65d0 0x55d64d7fbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f711effd700 1 -- 172.21.15.114:0/1800002310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 msgr2=0x55d64d7f6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f711effd700 1 --2- 172.21.15.114:0/1800002310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 0x55d64d7f6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f711effd700 1 -- 172.21.15.114:0/1800002310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7e65d0 msgr2=0x55d64d7fbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:16.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f711effd700 1 --2- 172.21.15.114:0/1800002310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7e65d0 0x55d64d7fbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f711effd700 1 -- 172.21.15.114:0/1800002310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71201a3890 con 0x55d64d7ebbe0 2023-10-18T14:09:16.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f711effd700 1 --2- 172.21.15.114:0/1800002310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 0x55d64d7f5ee0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f71100248a0 tx=0x7f7110004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7caefc22159c519d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:16.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f70feffd700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:09:16.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f70feffd700 1 -- 172.21.15.114:0/1800002310 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711002a040 con 0x55d64d7ebbe0 2023-10-18T14:09:16.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f70feffd700 1 -- 172.21.15.114:0/1800002310 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7f7110042680 con 0x55d64d7ebbe0 2023-10-18T14:09:16.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f71321b5b80 1 -- 172.21.15.114:0/1800002310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f711800f050 con 0x55d64d7ebbe0 2023-10-18T14:09:16.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f70feffd700 1 -- 172.21.15.114:0/1800002310 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f711001d040 con 0x55d64d7ebbe0 2023-10-18T14:09:16.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f71321b5b80 10 client.16698 fetch_fsmap learned FSMap version 44 2023-10-18T14:09:16.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f71321b5b80 1 -- 172.21.15.114:0/1800002310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55d64d58a250 con 0x55d64d7ebbe0 2023-10-18T14:09:16.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f70feffd700 1 -- 172.21.15.114:0/1800002310 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7110050020 con 0x55d64d7ebbe0 2023-10-18T14:09:16.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f70feffd700 1 -- 172.21.15.114:0/1800002310 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 44) v1 ==== 7958+0+0 (secure 0 0 0) 0x7f711000f8f0 con 0x55d64d7ebbe0 2023-10-18T14:09:16.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f71321b5b80 10 client.16698 fetch_fsmap finished waiting for FSMap version 44 2023-10-18T14:09:16.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f71321b5b80 10 client.16698 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-18T14:09:16.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f71321b5b80 20 client.16698 populate_metadata read hostname 'smithi114' 2023-10-18T14:09:16.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.408+0000 7f71321b5b80 1 --2- 172.21.15.114:0/1800002310 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55d64d854e70 0x55d64d857290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:16.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.409+0000 7f71321b5b80 4 client.16698 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:09:16.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.409+0000 7f71321b5b80 1 -- 172.21.15.114:0/1800002310 --> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d64d731e50 con 0x55d64d854e70 2023-10-18T14:09:16.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.409+0000 7f711f7fe700 1 --2- 172.21.15.114:0/1800002310 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55d64d854e70 0x55d64d857290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:16.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.409+0000 7f70feffd700 10 client.16698 ms_handle_connect on v2:172.21.15.172:6836/1821444438 2023-10-18T14:09:16.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.409+0000 7f711f7fe700 1 --2- 172.21.15.114:0/1800002310 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55d64d854e70 0x55d64d857290 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=160b2b65166f9275 server_cookie=2026bc761da38063 in_seq=0 out_seq=0 2023-10-18T14:09:16.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.412+0000 7f70feffd700 1 -- 172.21.15.114:0/1800002310 <== mds.1 v2:172.21.15.172:6836/1821444438 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+130638 (crc 0 0 0) 0x55d64d731e50 con 0x55d64d854e70 2023-10-18T14:09:16.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.412+0000 7f70feffd700 10 client.16698 handle_command_reply: tid=0 2023-10-18T14:09:16.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.412+0000 7f71321b5b80 1 client.16698 shutdown 2023-10-18T14:09:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.412+0000 7f71321b5b80 1 -- 172.21.15.114:0/1800002310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 msgr2=0x55d64d7f5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.412+0000 7f71321b5b80 1 --2- 172.21.15.114:0/1800002310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 0x55d64d7f5ee0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f71100248a0 tx=0x7f7110004d30 comp rx=0 tx=0).stop 2023-10-18T14:09:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.412+0000 7f71321b5b80 1 -- 172.21.15.114:0/1800002310 shutdown_connections 2023-10-18T14:09:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.412+0000 7f71321b5b80 1 --2- 172.21.15.114:0/1800002310 >> [v2:172.21.15.172:6836/1821444438,v1:172.21.15.172:6837/1821444438] conn(0x55d64d854e70 0x55d64d857290 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.412+0000 7f71321b5b80 1 --2- 172.21.15.114:0/1800002310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d64d7ec500 0x55d64d7f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.412+0000 7f71321b5b80 1 --2- 172.21.15.114:0/1800002310 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x55d64d7e65d0 0x55d64d7fbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.412+0000 7f71321b5b80 1 --2- 172.21.15.114:0/1800002310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d64d7ebbe0 0x55d64d7f5ee0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:16.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.412+0000 7f71321b5b80 1 -- 172.21.15.114:0/1800002310 >> 172.21.15.114:0/1800002310 conn(0x55d64d75a720 msgr2=0x55d64d7edf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:16.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.412+0000 7f70feffd700 0 client.16698 ms_handle_reset on v2:172.21.15.172:6836/1821444438 2023-10-18T14:09:16.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.412+0000 7f71321b5b80 1 -- 172.21.15.114:0/1800002310 shutdown_connections 2023-10-18T14:09:16.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f71321b5b80 1 -- 172.21.15.114:0/1800002310 wait complete. 2023-10-18T14:09:16.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f71321b5b80 20 client.16698 trim_cache size 0 max 16384 2023-10-18T14:09:16.442 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2023-10-18T14:09:16.443 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.443 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.443 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2345057, 2023-10-18T14:09:16.443 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632213, 2023-10-18T14:09:16.443 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/pending.dat" 2023-10-18T14:09:16.444 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.444 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.444 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.444 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 18814733, 2023-10-18T14:09:16.444 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631625, 2023-10-18T14:09:16.445 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/470.out" 2023-10-18T14:09:16.445 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.445 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.445 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.445 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 21765670, 2023-10-18T14:09:16.446 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632113, 2023-10-18T14:09:16.446 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/populate" 2023-10-18T14:09:16.446 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.446 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.446 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.447 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 35417343, 2023-10-18T14:09:16.447 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627789, 2023-10-18T14:09:16.447 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD" 2023-10-18T14:09:16.447 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.447 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.447 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.448 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 36325342, 2023-10-18T14:09:16.448 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630136, 2023-10-18T14:09:16.448 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/585.out" 2023-10-18T14:09:16.448 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.448 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.448 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.449 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 52035521, 2023-10-18T14:09:16.449 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629393, 2023-10-18T14:09:16.449 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/dataascii.h" 2023-10-18T14:09:16.449 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.449 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.450 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.450 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 59076168, 2023-10-18T14:09:16.450 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631376, 2023-10-18T14:09:16.450 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/346.out" 2023-10-18T14:09:16.450 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.450 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.451 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.451 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 63104623, 2023-10-18T14:09:16.451 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628994, 2023-10-18T14:09:16.451 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/395.out" 2023-10-18T14:09:16.451 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.451 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.452 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.452 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 76230101, 2023-10-18T14:09:16.452 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629288, 2023-10-18T14:09:16.452 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample" 2023-10-18T14:09:16.452 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.453 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.453 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.453 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 78501597, 2023-10-18T14:09:16.453 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629818, 2023-10-18T14:09:16.453 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/185.out" 2023-10-18T14:09:16.453 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.454 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.454 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.454 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 81502930, 2023-10-18T14:09:16.454 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629409, 2023-10-18T14:09:16.454 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/forker.c" 2023-10-18T14:09:16.455 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.455 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.455 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.455 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 99280910, 2023-10-18T14:09:16.455 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632204, 2023-10-18T14:09:16.456 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/ls_to_copy" 2023-10-18T14:09:16.456 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.456 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.456 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.456 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 116012325, 2023-10-18T14:09:16.456 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630742, 2023-10-18T14:09:16.457 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/039.out" 2023-10-18T14:09:16.457 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.457 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.457 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.457 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 125885476, 2023-10-18T14:09:16.457 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630866, 2023-10-18T14:09:16.458 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/100.out" 2023-10-18T14:09:16.458 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.458 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.458 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.458 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 126884692, 2023-10-18T14:09:16.459 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629380, 2023-10-18T14:09:16.459 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/configs/localhost.config" 2023-10-18T14:09:16.459 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.459 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.459 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.460 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 128056026, 2023-10-18T14:09:16.460 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629244, 2023-10-18T14:09:16.460 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/520.out" 2023-10-18T14:09:16.460 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.460 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.460 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.461 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 132112635, 2023-10-18T14:09:16.461 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627807, 2023-10-18T14:09:16.461 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/tar/Makefile" 2023-10-18T14:09:16.461 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.461 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.461 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.462 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 136786343, 2023-10-18T14:09:16.462 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629441, 2023-10-18T14:09:16.462 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_utilies.m4" 2023-10-18T14:09:16.462 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.462 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.463 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.463 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 136872224, 2023-10-18T14:09:16.463 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633129, 2023-10-18T14:09:16.463 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/508" 2023-10-18T14:09:16.463 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.464 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.464 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.464 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 137084953, 2023-10-18T14:09:16.464 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629410, 2023-10-18T14:09:16.464 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/open_flags.c" 2023-10-18T14:09:16.464 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.465 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.465 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.465 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 147027080, 2023-10-18T14:09:16.465 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631629, 2023-10-18T14:09:16.465 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/472.out" 2023-10-18T14:09:16.466 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.466 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.466 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.466 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 156085629, 2023-10-18T14:09:16.466 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629362, 2023-10-18T14:09:16.467 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/nfs" 2023-10-18T14:09:16.467 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.467 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.467 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.467 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 156124036, 2023-10-18T14:09:16.467 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628632, 2023-10-18T14:09:16.468 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/089.out" 2023-10-18T14:09:16.468 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.468 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.468 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.468 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 160985517, 2023-10-18T14:09:16.469 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631110, 2023-10-18T14:09:16.469 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/218.out" 2023-10-18T14:09:16.469 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.469 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.469 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.469 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 178319610, 2023-10-18T14:09:16.470 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632670, 2023-10-18T14:09:16.470 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/dist" 2023-10-18T14:09:16.470 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.470 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.470 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.471 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 181777886, 2023-10-18T14:09:16.471 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632156, 2023-10-18T14:09:16.471 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_dirattrs.c" 2023-10-18T14:09:16.471 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.471 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.472 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.472 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 196850462, 2023-10-18T14:09:16.472 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632157, 2023-10-18T14:09:16.472 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_dmattr.c" 2023-10-18T14:09:16.472 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.473 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.473 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.473 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 212525071, 2023-10-18T14:09:16.473 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632397, 2023-10-18T14:09:16.473 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src" 2023-10-18T14:09:16.473 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.474 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.474 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.474 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 224921586, 2023-10-18T14:09:16.474 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632483, 2023-10-18T14:09:16.474 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/124" 2023-10-18T14:09:16.475 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.475 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.475 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.475 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 235553526, 2023-10-18T14:09:16.475 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632668, 2023-10-18T14:09:16.476 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data" 2023-10-18T14:09:16.476 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.476 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.476 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.476 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 264706884, 2023-10-18T14:09:16.477 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633184, 2023-10-18T14:09:16.477 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/561" 2023-10-18T14:09:16.477 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.477 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.477 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.477 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 266520406, 2023-10-18T14:09:16.478 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631118, 2023-10-18T14:09:16.478 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/222.out" 2023-10-18T14:09:16.478 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.478 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.478 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.478 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 267533688, 2023-10-18T14:09:16.479 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632443, 2023-10-18T14:09:16.479 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/086" 2023-10-18T14:09:16.479 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.479 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.479 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.480 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 268723583, 2023-10-18T14:09:16.480 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629440, 2023-10-18T14:09:16.480 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_types.m4" 2023-10-18T14:09:16.480 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.480 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.480 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.481 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 278242058, 2023-10-18T14:09:16.481 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632160, 2023-10-18T14:09:16.481 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_fileattr.c" 2023-10-18T14:09:16.481 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.481 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.482 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.482 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 279489221, 2023-10-18T14:09:16.482 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630706, 2023-10-18T14:09:16.482 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/022.out" 2023-10-18T14:09:16.482 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.483 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.483 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.483 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 307346647, 2023-10-18T14:09:16.483 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632628, 2023-10-18T14:09:16.483 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/264" 2023-10-18T14:09:16.484 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.484 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.484 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.484 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 326227622, 2023-10-18T14:09:16.484 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631455, 2023-10-18T14:09:16.485 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/385.out" 2023-10-18T14:09:16.485 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.485 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.485 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.485 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 345891196, 2023-10-18T14:09:16.486 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632217, 2023-10-18T14:09:16.486 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/standard.dat" 2023-10-18T14:09:16.486 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.486 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.486 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.486 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 346767523, 2023-10-18T14:09:16.487 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629120, 2023-10-18T14:09:16.487 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/458.out" 2023-10-18T14:09:16.487 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.487 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.487 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.488 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 351480711, 2023-10-18T14:09:16.488 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633107, 2023-10-18T14:09:16.488 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/488" 2023-10-18T14:09:16.488 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.488 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.489 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.489 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 357494775, 2023-10-18T14:09:16.489 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628668, 2023-10-18T14:09:16.489 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/107.out" 2023-10-18T14:09:16.489 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.489 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.490 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.490 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 360059733, 2023-10-18T14:09:16.490 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632179, 2023-10-18T14:09:16.490 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/probe_hole.c" 2023-10-18T14:09:16.490 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.491 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.491 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.491 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 375695578, 2023-10-18T14:09:16.491 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633083, 2023-10-18T14:09:16.491 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/466" 2023-10-18T14:09:16.492 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.492 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.492 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.492 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 379860756, 2023-10-18T14:09:16.492 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632393, 2023-10-18T14:09:16.492 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/README.auto-qa" 2023-10-18T14:09:16.493 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.493 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.493 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.493 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 380648209, 2023-10-18T14:09:16.493 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629414, 2023-10-18T14:09:16.494 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/str_to_bytes.c" 2023-10-18T14:09:16.494 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.494 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.494 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.494 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 386586157, 2023-10-18T14:09:16.495 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632151, 2023-10-18T14:09:16.495 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/dm_handle.c" 2023-10-18T14:09:16.495 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.495 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.495 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.496 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 389424615, 2023-10-18T14:09:16.496 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629402, 2023-10-18T14:09:16.496 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/string_to_tokens.h" 2023-10-18T14:09:16.496 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.496 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.497 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.497 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 417705142, 2023-10-18T14:09:16.497 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629790, 2023-10-18T14:09:16.497 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks" 2023-10-18T14:09:16.497 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.498 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.498 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.498 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 418147743, 2023-10-18T14:09:16.498 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627792, 2023-10-18T14:09:16.498 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes" 2023-10-18T14:09:16.499 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.499 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.499 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.499 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 420425432, 2023-10-18T14:09:16.499 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633049, 2023-10-18T14:09:16.499 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/434" 2023-10-18T14:09:16.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.500 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.500 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.500 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 426901955, 2023-10-18T14:09:16.500 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632671, 2023-10-18T14:09:16.501 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/dist/README" 2023-10-18T14:09:16.501 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.501 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.501 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.501 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 429172273, 2023-10-18T14:09:16.502 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631318, 2023-10-18T14:09:16.502 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/317.out" 2023-10-18T14:09:16.502 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.502 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.502 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.502 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 437930813, 2023-10-18T14:09:16.503 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631196, 2023-10-18T14:09:16.503 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/256.out" 2023-10-18T14:09:16.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.503 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.503 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.504 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 439695566, 2023-10-18T14:09:16.504 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632548, 2023-10-18T14:09:16.504 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/185" 2023-10-18T14:09:16.504 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.505 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.505 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 448165643, 2023-10-18T14:09:16.505 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633180, 2023-10-18T14:09:16.505 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/557" 2023-10-18T14:09:16.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.505 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.506 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.506 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 448429699, 2023-10-18T14:09:16.506 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631094, 2023-10-18T14:09:16.506 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/211.out" 2023-10-18T14:09:16.506 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.507 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.507 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 448977212, 2023-10-18T14:09:16.507 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632108, 2023-10-18T14:09:16.507 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/fuzzy" 2023-10-18T14:09:16.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.508 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.508 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.508 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 449194702, 2023-10-18T14:09:16.508 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627817, 2023-10-18T14:09:16.508 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/Makefile" 2023-10-18T14:09:16.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.509 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.509 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.509 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 451113501, 2023-10-18T14:09:16.509 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629128, 2023-10-18T14:09:16.510 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/462.out" 2023-10-18T14:09:16.510 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.510 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.510 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.510 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 460063084, 2023-10-18T14:09:16.511 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632209, 2023-10-18T14:09:16.511 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/test_allocinfo_2" 2023-10-18T14:09:16.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.511 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.511 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.511 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 460994319, 2023-10-18T14:09:16.512 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632094, 2023-10-18T14:09:16.512 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/btrfs" 2023-10-18T14:09:16.512 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.512 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.512 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.513 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 463514336, 2023-10-18T14:09:16.513 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630778, 2023-10-18T14:09:16.513 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/057.out" 2023-10-18T14:09:16.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.513 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.513 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.514 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 488906557, 2023-10-18T14:09:16.514 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630696, 2023-10-18T14:09:16.514 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/017.out" 2023-10-18T14:09:16.514 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.514 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.515 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.515 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 496508111, 2023-10-18T14:09:16.515 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633662, 2023-10-18T14:09:16.515 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/007" 2023-10-18T14:09:16.515 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.516 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.516 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.516 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 500078678, 2023-10-18T14:09:16.516 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632092, 2023-10-18T14:09:16.516 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/xfstests.spec.in" 2023-10-18T14:09:16.517 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.517 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.517 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.517 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 502771305, 2023-10-18T14:09:16.517 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632207, 2023-10-18T14:09:16.518 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/stf" 2023-10-18T14:09:16.518 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.518 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.518 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.518 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 507533329, 2023-10-18T14:09:16.519 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629318, 2023-10-18T14:09:16.519 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/config" 2023-10-18T14:09:16.519 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.519 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.519 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.519 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 508258552, 2023-10-18T14:09:16.520 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629397, 2023-10-18T14:09:16.520 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/install-sh" 2023-10-18T14:09:16.520 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.520 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.520 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.521 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 513794964, 2023-10-18T14:09:16.521 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629877, 2023-10-18T14:09:16.521 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/241.out" 2023-10-18T14:09:16.521 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.521 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.522 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.522 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 542330042, 2023-10-18T14:09:16.522 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629442, 2023-10-18T14:09:16.522 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_uuiddev.m4" 2023-10-18T14:09:16.522 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.523 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.523 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.523 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 547454755, 2023-10-18T14:09:16.523 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632399, 2023-10-18T14:09:16.523 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common" 2023-10-18T14:09:16.524 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.524 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.524 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.524 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 548028193, 2023-10-18T14:09:16.524 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632508, 2023-10-18T14:09:16.525 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/146" 2023-10-18T14:09:16.525 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.525 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.525 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.525 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 560274101, 2023-10-18T14:09:16.526 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632194, 2023-10-18T14:09:16.526 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_fileattr.c" 2023-10-18T14:09:16.526 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.526 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.526 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.526 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 563238746, 2023-10-18T14:09:16.527 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631226, 2023-10-18T14:09:16.527 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/271.out" 2023-10-18T14:09:16.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.527 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.528 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 563527600, 2023-10-18T14:09:16.528 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632095, 2023-10-18T14:09:16.528 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/casefold" 2023-10-18T14:09:16.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.528 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.528 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.529 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 568971489, 2023-10-18T14:09:16.529 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632506, 2023-10-18T14:09:16.529 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/144" 2023-10-18T14:09:16.529 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.529 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.530 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 578753116, 2023-10-18T14:09:16.530 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633056, 2023-10-18T14:09:16.530 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/440" 2023-10-18T14:09:16.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.530 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.531 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.531 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 581307609, 2023-10-18T14:09:16.531 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632073, 2023-10-18T14:09:16.531 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/ag-wipe" 2023-10-18T14:09:16.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.532 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.532 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 583604121, 2023-10-18T14:09:16.532 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628728, 2023-10-18T14:09:16.532 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/137.out" 2023-10-18T14:09:16.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.533 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.533 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.533 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 584890585, 2023-10-18T14:09:16.533 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629413, 2023-10-18T14:09:16.533 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/random_range.c" 2023-10-18T14:09:16.533 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.534 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.534 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.534 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 586215015, 2023-10-18T14:09:16.534 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633190, 2023-10-18T14:09:16.534 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/567" 2023-10-18T14:09:16.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.535 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.535 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 588879119, 2023-10-18T14:09:16.536 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631032, 2023-10-18T14:09:16.536 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/180.out" 2023-10-18T14:09:16.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.536 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.536 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.536 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 598936587, 2023-10-18T14:09:16.537 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629230, 2023-10-18T14:09:16.537 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/513.out" 2023-10-18T14:09:16.537 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.537 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.537 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.538 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 599235343, 2023-10-18T14:09:16.538 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629364, 2023-10-18T14:09:16.538 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/perf" 2023-10-18T14:09:16.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.538 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.539 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.539 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 599584380, 2023-10-18T14:09:16.539 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632225, 2023-10-18T14:09:16.539 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mmap_cp.c" 2023-10-18T14:09:16.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.539 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.540 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.540 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 606061066, 2023-10-18T14:09:16.540 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627805, 2023-10-18T14:09:16.540 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/Makefile" 2023-10-18T14:09:16.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.541 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.541 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.541 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 615948104, 2023-10-18T14:09:16.541 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628541, 2023-10-18T14:09:16.541 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/048.out" 2023-10-18T14:09:16.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.542 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.542 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.542 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 627172530, 2023-10-18T14:09:16.542 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632660, 2023-10-18T14:09:16.543 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1" 2023-10-18T14:09:16.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.543 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.543 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.543 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 633386592, 2023-10-18T14:09:16.544 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632248, 2023-10-18T14:09:16.544 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_xfslibs.m4" 2023-10-18T14:09:16.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.544 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.544 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.544 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 638242767, 2023-10-18T14:09:16.545 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632214, 2023-10-18T14:09:16.545 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/pending_nfs.dat" 2023-10-18T14:09:16.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.545 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.545 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.546 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 645761066, 2023-10-18T14:09:16.546 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632143, 2023-10-18T14:09:16.546 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/wbee.c" 2023-10-18T14:09:16.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.547 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.547 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 668244118, 2023-10-18T14:09:16.547 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633036, 2023-10-18T14:09:16.547 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/422" 2023-10-18T14:09:16.547 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.548 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.548 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 676285501, 2023-10-18T14:09:16.548 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633210, 2023-10-18T14:09:16.548 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/582" 2023-10-18T14:09:16.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.548 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.549 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.549 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 697802284, 2023-10-18T14:09:16.549 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631088, 2023-10-18T14:09:16.549 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/208.out" 2023-10-18T14:09:16.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.550 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.550 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 699747252, 2023-10-18T14:09:16.550 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631463, 2023-10-18T14:09:16.550 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/389.out" 2023-10-18T14:09:16.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.551 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.551 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.551 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 700129659, 2023-10-18T14:09:16.551 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631680, 2023-10-18T14:09:16.551 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/498.out" 2023-10-18T14:09:16.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.552 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.552 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.552 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 702041834, 2023-10-18T14:09:16.552 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632674, 2023-10-18T14:09:16.552 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src" 2023-10-18T14:09:16.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.553 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.553 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.553 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 706012603, 2023-10-18T14:09:16.553 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632180, 2023-10-18T14:09:16.553 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/probe_punch_xfsctl_hole.c" 2023-10-18T14:09:16.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.554 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.554 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.554 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 727662085, 2023-10-18T14:09:16.554 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629408, 2023-10-18T14:09:16.555 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/file_lock.c" 2023-10-18T14:09:16.555 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.555 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.555 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.555 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 729146628, 2023-10-18T14:09:16.556 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632657, 2023-10-18T14:09:16.556 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/293" 2023-10-18T14:09:16.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.556 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.557 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 747834543, 2023-10-18T14:09:16.557 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630853, 2023-10-18T14:09:16.557 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/094.out" 2023-10-18T14:09:16.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.557 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.557 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.558 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 773236190, 2023-10-18T14:09:16.558 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632394, 2023-10-18T14:09:16.558 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/attr" 2023-10-18T14:09:16.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.559 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.559 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.559 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 792894682, 2023-10-18T14:09:16.559 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629222, 2023-10-18T14:09:16.559 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/509.out" 2023-10-18T14:09:16.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.560 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.560 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.560 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 798871492, 2023-10-18T14:09:16.560 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631617, 2023-10-18T14:09:16.561 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/466.out" 2023-10-18T14:09:16.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.561 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.561 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 799925837, 2023-10-18T14:09:16.562 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632129, 2023-10-18T14:09:16.562 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/write_invis.c" 2023-10-18T14:09:16.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.562 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.563 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 810873148, 2023-10-18T14:09:16.563 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632152, 2023-10-18T14:09:16.563 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/downgrade_right.c" 2023-10-18T14:09:16.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.563 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.564 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.564 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 815917515, 2023-10-18T14:09:16.564 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628670, 2023-10-18T14:09:16.564 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/108.out" 2023-10-18T14:09:16.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.565 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.565 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.565 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 818471653, 2023-10-18T14:09:16.565 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629383, 2023-10-18T14:09:16.565 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/xfscrash" 2023-10-18T14:09:16.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.566 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.566 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.566 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 822686576, 2023-10-18T14:09:16.566 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632427, 2023-10-18T14:09:16.567 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/070" 2023-10-18T14:09:16.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.567 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.567 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.567 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 825018502, 2023-10-18T14:09:16.567 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632914, 2023-10-18T14:09:16.568 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/307" 2023-10-18T14:09:16.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.568 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.568 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.568 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 836213459, 2023-10-18T14:09:16.569 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632651, 2023-10-18T14:09:16.569 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/287" 2023-10-18T14:09:16.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.569 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.569 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.569 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 842771998, 2023-10-18T14:09:16.570 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627813, 2023-10-18T14:09:16.570 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/README" 2023-10-18T14:09:16.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.570 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.570 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.571 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 849056503, 2023-10-18T14:09:16.571 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632123, 2023-10-18T14:09:16.571 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/xfs" 2023-10-18T14:09:16.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.572 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.572 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.572 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 855810453, 2023-10-18T14:09:16.572 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632244, 2023-10-18T14:09:16.572 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_attrdev.m4" 2023-10-18T14:09:16.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.573 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.573 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.573 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 868015638, 2023-10-18T14:09:16.573 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629289, 2023-10-18T14:09:16.573 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample" 2023-10-18T14:09:16.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.574 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.574 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.574 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 874052498, 2023-10-18T14:09:16.574 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631421, 2023-10-18T14:09:16.575 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/368.out" 2023-10-18T14:09:16.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.575 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.575 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.575 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 875355548, 2023-10-18T14:09:16.576 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632116, 2023-10-18T14:09:16.576 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/rc" 2023-10-18T14:09:16.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.576 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.576 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.577 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 887711216, 2023-10-18T14:09:16.577 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632075, 2023-10-18T14:09:16.577 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/compare-failures" 2023-10-18T14:09:16.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.577 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.578 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.578 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 889463939, 2023-10-18T14:09:16.578 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632401, 2023-10-18T14:09:16.578 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd" 2023-10-18T14:09:16.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.579 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.579 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.579 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 909118318, 2023-10-18T14:09:16.579 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629292, 2023-10-18T14:09:16.579 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample" 2023-10-18T14:09:16.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.580 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.580 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.580 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 910333209, 2023-10-18T14:09:16.580 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632450, 2023-10-18T14:09:16.580 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/092" 2023-10-18T14:09:16.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.581 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.581 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.581 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 911544802, 2023-10-18T14:09:16.581 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632663, 2023-10-18T14:09:16.581 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/Makefile" 2023-10-18T14:09:16.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.582 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.582 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 924302299, 2023-10-18T14:09:16.582 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632115, 2023-10-18T14:09:16.583 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/quota" 2023-10-18T14:09:16.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.583 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.583 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 940122261, 2023-10-18T14:09:16.583 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632206, 2023-10-18T14:09:16.584 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/run_test" 2023-10-18T14:09:16.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.584 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.584 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 947558783, 2023-10-18T14:09:16.585 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628535, 2023-10-18T14:09:16.585 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/045.out" 2023-10-18T14:09:16.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.585 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.585 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.586 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 957511462, 2023-10-18T14:09:16.586 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631242, 2023-10-18T14:09:16.586 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/279.out" 2023-10-18T14:09:16.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.587 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.587 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 985915341, 2023-10-18T14:09:16.587 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629094, 2023-10-18T14:09:16.587 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/445.out" 2023-10-18T14:09:16.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.588 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.588 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 990772219, 2023-10-18T14:09:16.588 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632128, 2023-10-18T14:09:16.588 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/set_return_on_destroy.c" 2023-10-18T14:09:16.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.588 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.589 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.589 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1006643838, 2023-10-18T14:09:16.589 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629398, 2023-10-18T14:09:16.589 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/open_flags.h" 2023-10-18T14:09:16.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.590 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.590 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.590 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1021922310, 2023-10-18T14:09:16.590 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632389, 2023-10-18T14:09:16.590 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/047" 2023-10-18T14:09:16.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.591 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.591 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.591 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1023976415, 2023-10-18T14:09:16.591 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632507, 2023-10-18T14:09:16.591 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/145" 2023-10-18T14:09:16.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.592 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.592 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1028331153, 2023-10-18T14:09:16.592 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632591, 2023-10-18T14:09:16.592 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/227" 2023-10-18T14:09:16.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.593 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.593 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.593 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1033348745, 2023-10-18T14:09:16.593 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629979, 2023-10-18T14:09:16.594 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/292.out" 2023-10-18T14:09:16.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.594 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.594 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.595 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1036710319, 2023-10-18T14:09:16.595 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629439, 2023-10-18T14:09:16.595 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_pthread.m4" 2023-10-18T14:09:16.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.595 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.595 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.596 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1038737295, 2023-10-18T14:09:16.596 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631397, 2023-10-18T14:09:16.596 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/356.out" 2023-10-18T14:09:16.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.597 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.597 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.597 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1039632325, 2023-10-18T14:09:16.597 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629411, 2023-10-18T14:09:16.597 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/pattern.c" 2023-10-18T14:09:16.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.598 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.598 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.598 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1039691480, 2023-10-18T14:09:16.598 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632153, 2023-10-18T14:09:16.598 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/fd_to_handle.c" 2023-10-18T14:09:16.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.599 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.599 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.599 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1042994543, 2023-10-18T14:09:16.599 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632243, 2023-10-18T14:09:16.600 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/iogen.c" 2023-10-18T14:09:16.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.600 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.600 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1043859242, 2023-10-18T14:09:16.600 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631306, 2023-10-18T14:09:16.601 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/311.out" 2023-10-18T14:09:16.601 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.601 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.601 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.601 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1048694305, 2023-10-18T14:09:16.602 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633669, 2023-10-18T14:09:16.602 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/014" 2023-10-18T14:09:16.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.602 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.603 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1058728963, 2023-10-18T14:09:16.603 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632189, 2023-10-18T14:09:16.603 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/security_hole.c" 2023-10-18T14:09:16.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.604 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.604 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.604 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1062204123, 2023-10-18T14:09:16.604 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633672, 2023-10-18T14:09:16.604 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/017" 2023-10-18T14:09:16.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.605 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.605 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.605 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1062708109, 2023-10-18T14:09:16.606 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630694, 2023-10-18T14:09:16.606 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/016.out" 2023-10-18T14:09:16.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.606 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.606 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.607 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1066870364, 2023-10-18T14:09:16.607 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629415, 2023-10-18T14:09:16.607 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/string_to_tokens.c" 2023-10-18T14:09:16.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.607 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.607 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.608 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1069062917, 2023-10-18T14:09:16.608 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628718, 2023-10-18T14:09:16.608 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/132.out" 2023-10-18T14:09:16.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.608 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.609 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.609 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1072178981, 2023-10-18T14:09:16.609 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629384, 2023-10-18T14:09:16.609 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/auxiliary-programs.txt" 2023-10-18T14:09:16.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.610 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.610 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.610 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1072500703, 2023-10-18T14:09:16.610 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632191, 2023-10-18T14:09:16.610 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_disp.c" 2023-10-18T14:09:16.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.611 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.611 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.611 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1078358378, 2023-10-18T14:09:16.611 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632198, 2023-10-18T14:09:16.612 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/upgrade_right.c" 2023-10-18T14:09:16.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.612 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.612 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.612 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1088875555, 2023-10-18T14:09:16.613 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632104, 2023-10-18T14:09:16.613 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/encrypt" 2023-10-18T14:09:16.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.613 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.613 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.614 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1099012628, 2023-10-18T14:09:16.614 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632112, 2023-10-18T14:09:16.614 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/overlay" 2023-10-18T14:09:16.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.614 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.615 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.615 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1099218838, 2023-10-18T14:09:16.615 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627796, 2023-10-18T14:09:16.615 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/HEAD" 2023-10-18T14:09:16.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.616 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.616 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1107337025, 2023-10-18T14:09:16.616 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631244, 2023-10-18T14:09:16.616 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/280.out" 2023-10-18T14:09:16.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.617 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.617 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.617 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1108114394, 2023-10-18T14:09:16.617 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629276, 2023-10-18T14:09:16.618 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/536.out" 2023-10-18T14:09:16.618 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.618 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.618 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.619 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1111917931, 2023-10-18T14:09:16.619 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631160, 2023-10-18T14:09:16.619 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/238.out" 2023-10-18T14:09:16.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.620 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.620 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.620 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1116886406, 2023-10-18T14:09:16.620 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627791, 2023-10-18T14:09:16.620 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs" 2023-10-18T14:09:16.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.621 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.621 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.621 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1117546209, 2023-10-18T14:09:16.621 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632136, 2023-10-18T14:09:16.622 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/README" 2023-10-18T14:09:16.622 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.622 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.622 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.622 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1129057608, 2023-10-18T14:09:16.623 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628594, 2023-10-18T14:09:16.623 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/070.out" 2023-10-18T14:09:16.623 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.623 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.623 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.624 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1137141494, 2023-10-18T14:09:16.624 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627794, 2023-10-18T14:09:16.624 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD" 2023-10-18T14:09:16.624 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.624 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.624 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.625 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1154885349, 2023-10-18T14:09:16.625 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627787, 2023-10-18T14:09:16.625 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes" 2023-10-18T14:09:16.625 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.625 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.626 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.626 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1158789418, 2023-10-18T14:09:16.626 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629420, 2023-10-18T14:09:16.626 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/aio-stress.c" 2023-10-18T14:09:16.626 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.627 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.627 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.627 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1159318098, 2023-10-18T14:09:16.627 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627815, 2023-10-18T14:09:16.627 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/CHANGES" 2023-10-18T14:09:16.628 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.628 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.628 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.628 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1168631388, 2023-10-18T14:09:16.628 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632900, 2023-10-18T14:09:16.629 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/001" 2023-10-18T14:09:16.629 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.629 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.629 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.629 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1169184141, 2023-10-18T14:09:16.629 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632956, 2023-10-18T14:09:16.630 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/349" 2023-10-18T14:09:16.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.630 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.630 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.631 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1169797437, 2023-10-18T14:09:16.631 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632121, 2023-10-18T14:09:16.631 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/scsi_debug" 2023-10-18T14:09:16.631 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.631 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.631 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.632 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1178795057, 2023-10-18T14:09:16.632 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629432, 2023-10-18T14:09:16.632 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_gdbmdev.m4" 2023-10-18T14:09:16.632 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.632 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1181076440, 2023-10-18T14:09:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629951, 2023-10-18T14:09:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/278.out" 2023-10-18T14:09:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1185838679, 2023-10-18T14:09:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632221, 2023-10-18T14:09:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/dm_test_daemon.c" 2023-10-18T14:09:16.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.635 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.635 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.635 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1196744198, 2023-10-18T14:09:16.635 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629412, 2023-10-18T14:09:16.635 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/random.c" 2023-10-18T14:09:16.636 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.636 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.636 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.636 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1204258878, 2023-10-18T14:09:16.636 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631294, 2023-10-18T14:09:16.637 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/305.out" 2023-10-18T14:09:16.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.637 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.637 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1212837731, 2023-10-18T14:09:16.638 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628938, 2023-10-18T14:09:16.638 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/367.out" 2023-10-18T14:09:16.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.638 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.638 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.639 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1224200212, 2023-10-18T14:09:16.639 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632122, 2023-10-18T14:09:16.639 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/verity" 2023-10-18T14:09:16.639 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.639 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.640 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.640 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1225305579, 2023-10-18T14:09:16.640 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632137, 2023-10-18T14:09:16.640 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migfind.c" 2023-10-18T14:09:16.640 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.640 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.641 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.641 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1228825214, 2023-10-18T14:09:16.641 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630849, 2023-10-18T14:09:16.641 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/092.out" 2023-10-18T14:09:16.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.642 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.642 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.642 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1242949608, 2023-10-18T14:09:16.642 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632099, 2023-10-18T14:09:16.642 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmerror" 2023-10-18T14:09:16.643 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.643 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.643 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.643 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1252339606, 2023-10-18T14:09:16.643 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629260, 2023-10-18T14:09:16.644 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/528.out" 2023-10-18T14:09:16.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.644 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.644 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.644 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1254019093, 2023-10-18T14:09:16.644 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629794, 2023-10-18T14:09:16.645 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/tags" 2023-10-18T14:09:16.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.645 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.645 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.645 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1262116084, 2023-10-18T14:09:16.646 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632184, 2023-10-18T14:09:16.646 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/release_right.c" 2023-10-18T14:09:16.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.646 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.646 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.646 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1280619038, 2023-10-18T14:09:16.647 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632145, 2023-10-18T14:09:16.647 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_destroy_session.c" 2023-10-18T14:09:16.647 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.647 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.647 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.648 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1287867343, 2023-10-18T14:09:16.648 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633186, 2023-10-18T14:09:16.648 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/563" 2023-10-18T14:09:16.648 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.648 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.649 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.649 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1297199208, 2023-10-18T14:09:16.649 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629417, 2023-10-18T14:09:16.649 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/write_log.c" 2023-10-18T14:09:16.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.650 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.650 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.650 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1301901136, 2023-10-18T14:09:16.650 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627790, 2023-10-18T14:09:16.650 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs" 2023-10-18T14:09:16.650 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.651 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.651 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1311143401, 2023-10-18T14:09:16.651 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632130, 2023-10-18T14:09:16.651 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/dmport.h" 2023-10-18T14:09:16.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.652 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.652 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1312495557, 2023-10-18T14:09:16.652 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632141, 2023-10-18T14:09:16.653 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/mls.c" 2023-10-18T14:09:16.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.653 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.653 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.653 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1327219029, 2023-10-18T14:09:16.653 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632163, 2023-10-18T14:09:16.654 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/getall_disp.c" 2023-10-18T14:09:16.654 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.654 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.654 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.654 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1337628162, 2023-10-18T14:09:16.655 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632168, 2023-10-18T14:09:16.655 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/link_test.c" 2023-10-18T14:09:16.655 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.655 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.655 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.656 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1359996459, 2023-10-18T14:09:16.656 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632183, 2023-10-18T14:09:16.656 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/randomize_file.c" 2023-10-18T14:09:16.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.657 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.657 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1368238452, 2023-10-18T14:09:16.657 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629788, 2023-10-18T14:09:16.657 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/info" 2023-10-18T14:09:16.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.658 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.658 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1369416245, 2023-10-18T14:09:16.658 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631350, 2023-10-18T14:09:16.658 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/333.out" 2023-10-18T14:09:16.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.659 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.659 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1379574376, 2023-10-18T14:09:16.659 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632172, 2023-10-18T14:09:16.659 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_query.c" 2023-10-18T14:09:16.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.660 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.660 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1379909340, 2023-10-18T14:09:16.660 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631413, 2023-10-18T14:09:16.660 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/364.out" 2023-10-18T14:09:16.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.661 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.661 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1382666443, 2023-10-18T14:09:16.661 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632637, 2023-10-18T14:09:16.662 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/273" 2023-10-18T14:09:16.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.662 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.662 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1387595736, 2023-10-18T14:09:16.663 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628940, 2023-10-18T14:09:16.663 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/368.out" 2023-10-18T14:09:16.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.663 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.663 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1389530927, 2023-10-18T14:09:16.664 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627798, 2023-10-18T14:09:16.664 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master" 2023-10-18T14:09:16.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.664 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.665 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1399184374, 2023-10-18T14:09:16.665 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632433, 2023-10-18T14:09:16.665 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/076" 2023-10-18T14:09:16.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.666 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.666 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1404167147, 2023-10-18T14:09:16.666 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629331, 2023-10-18T14:09:16.666 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/macros.template" 2023-10-18T14:09:16.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.667 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.667 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1405973113, 2023-10-18T14:09:16.667 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632241, 2023-10-18T14:09:16.667 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/fsstress.c" 2023-10-18T14:09:16.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.668 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.668 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1415006167, 2023-10-18T14:09:16.668 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629433, 2023-10-18T14:09:16.668 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_globals.m4" 2023-10-18T14:09:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1417038738, 2023-10-18T14:09:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633142, 2023-10-18T14:09:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/521" 2023-10-18T14:09:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1431671376, 2023-10-18T14:09:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632162, 2023-10-18T14:09:16.671 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_region.c" 2023-10-18T14:09:16.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.671 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.671 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.671 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1433642132, 2023-10-18T14:09:16.671 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633159, 2023-10-18T14:09:16.672 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/537" 2023-10-18T14:09:16.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.672 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.672 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1444770174, 2023-10-18T14:09:16.673 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627797, 2023-10-18T14:09:16.673 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/heads" 2023-10-18T14:09:16.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.673 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.673 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1451335781, 2023-10-18T14:09:16.674 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630103, 2023-10-18T14:09:16.674 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/566.out" 2023-10-18T14:09:16.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.674 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.675 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1465839920, 2023-10-18T14:09:16.675 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632603, 2023-10-18T14:09:16.675 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/239" 2023-10-18T14:09:16.675 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.675 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.676 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.676 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1470815823, 2023-10-18T14:09:16.676 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632664, 2023-10-18T14:09:16.676 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2" 2023-10-18T14:09:16.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.677 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.677 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1472314844, 2023-10-18T14:09:16.677 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628630, 2023-10-18T14:09:16.677 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/088.out" 2023-10-18T14:09:16.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.678 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.678 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1483937997, 2023-10-18T14:09:16.678 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632677, 2023-10-18T14:09:16.678 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/builddefs.in" 2023-10-18T14:09:16.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.679 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.679 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1488549637, 2023-10-18T14:09:16.679 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632134, 2023-10-18T14:09:16.679 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/stubs.c" 2023-10-18T14:09:16.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.680 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.680 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.680 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1494364386, 2023-10-18T14:09:16.680 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628976, 2023-10-18T14:09:16.681 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/386.out" 2023-10-18T14:09:16.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.681 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.681 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1518822989, 2023-10-18T14:09:16.682 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632235, 2023-10-18T14:09:16.682 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_invis.c" 2023-10-18T14:09:16.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.682 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.682 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.683 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1529023831, 2023-10-18T14:09:16.683 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632166, 2023-10-18T14:09:16.683 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/handle_to_path.c" 2023-10-18T14:09:16.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.683 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.684 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1550819921, 2023-10-18T14:09:16.684 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630724, 2023-10-18T14:09:16.684 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/031.out" 2023-10-18T14:09:16.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.685 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.685 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1553350410, 2023-10-18T14:09:16.685 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630817, 2023-10-18T14:09:16.685 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/076.out" 2023-10-18T14:09:16.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.685 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.686 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.686 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1559707320, 2023-10-18T14:09:16.686 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629110, 2023-10-18T14:09:16.686 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/453.out" 2023-10-18T14:09:16.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.687 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.687 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.687 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1565594661, 2023-10-18T14:09:16.687 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632593, 2023-10-18T14:09:16.687 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/229" 2023-10-18T14:09:16.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.688 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.688 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.688 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1577828781, 2023-10-18T14:09:16.688 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628843, 2023-10-18T14:09:16.689 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/220.out" 2023-10-18T14:09:16.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.689 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.689 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.689 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1590767472, 2023-10-18T14:09:16.690 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633077, 2023-10-18T14:09:16.690 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/460" 2023-10-18T14:09:16.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.690 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.690 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.690 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1610553993, 2023-10-18T14:09:16.691 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629434, 2023-10-18T14:09:16.691 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_libbtrfs.m4" 2023-10-18T14:09:16.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.691 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.691 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.692 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1611567519, 2023-10-18T14:09:16.692 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628738, 2023-10-18T14:09:16.692 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/142.out" 2023-10-18T14:09:16.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.692 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.693 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.693 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1613991024, 2023-10-18T14:09:16.693 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631272, 2023-10-18T14:09:16.693 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/294.out" 2023-10-18T14:09:16.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.694 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.694 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.694 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1618809794, 2023-10-18T14:09:16.694 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629032, 2023-10-18T14:09:16.694 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/414.out" 2023-10-18T14:09:16.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.695 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.695 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.695 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1622780743, 2023-10-18T14:09:16.695 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633108, 2023-10-18T14:09:16.695 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/489" 2023-10-18T14:09:16.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.696 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.696 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1622937910, 2023-10-18T14:09:16.696 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631589, 2023-10-18T14:09:16.697 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/452.out" 2023-10-18T14:09:16.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.697 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.697 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.697 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1636452869, 2023-10-18T14:09:16.698 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632173, 2023-10-18T14:09:16.698 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_rele.c" 2023-10-18T14:09:16.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.698 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.698 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.699 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1641487868, 2023-10-18T14:09:16.699 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628896, 2023-10-18T14:09:16.699 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/346.out" 2023-10-18T14:09:16.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.699 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.700 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1652814155, 2023-10-18T14:09:16.700 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633032, 2023-10-18T14:09:16.700 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/419" 2023-10-18T14:09:16.700 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.700 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.701 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.701 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1660313984, 2023-10-18T14:09:16.701 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628712, 2023-10-18T14:09:16.701 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/129.out" 2023-10-18T14:09:16.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.702 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.702 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1661820858, 2023-10-18T14:09:16.702 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632201, 2023-10-18T14:09:16.702 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/README" 2023-10-18T14:09:16.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.703 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.703 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.703 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1678994965, 2023-10-18T14:09:16.703 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632239, 2023-10-18T14:09:16.703 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/Makefile" 2023-10-18T14:09:16.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.704 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.704 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.704 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1682632960, 2023-10-18T14:09:16.704 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628858, 2023-10-18T14:09:16.704 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/327.out" 2023-10-18T14:09:16.705 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.705 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.705 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.705 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1687646520, 2023-10-18T14:09:16.705 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632676, 2023-10-18T14:09:16.706 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/requirement-checking.txt" 2023-10-18T14:09:16.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.706 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.706 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.706 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1690017483, 2023-10-18T14:09:16.707 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632077, 2023-10-18T14:09:16.707 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/db-walk" 2023-10-18T14:09:16.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.707 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.707 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.708 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1692968667, 2023-10-18T14:09:16.708 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629403, 2023-10-18T14:09:16.708 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/tlibio.h" 2023-10-18T14:09:16.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.708 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.708 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.709 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1697080350, 2023-10-18T14:09:16.709 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629394, 2023-10-18T14:09:16.709 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/databin.h" 2023-10-18T14:09:16.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.709 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.710 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.710 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1701610931, 2023-10-18T14:09:16.710 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631451, 2023-10-18T14:09:16.710 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/383.out" 2023-10-18T14:09:16.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.710 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.711 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.711 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1707961420, 2023-10-18T14:09:16.711 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632675, 2023-10-18T14:09:16.711 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/Makefile" 2023-10-18T14:09:16.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.712 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.712 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.712 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1708646884, 2023-10-18T14:09:16.712 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631449, 2023-10-18T14:09:16.712 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/382.out" 2023-10-18T14:09:16.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.713 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.713 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.713 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1709922419, 2023-10-18T14:09:16.713 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629293, 2023-10-18T14:09:16.713 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample" 2023-10-18T14:09:16.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.714 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.714 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1734654466, 2023-10-18T14:09:16.714 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632240, 2023-10-18T14:09:16.715 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/doio.c" 2023-10-18T14:09:16.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.715 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.715 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.715 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1777606809, 2023-10-18T14:09:16.716 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632665, 2023-10-18T14:09:16.716 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/DMAPI_aliases" 2023-10-18T14:09:16.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.716 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.717 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1784218312, 2023-10-18T14:09:16.717 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631674, 2023-10-18T14:09:16.717 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/495.out" 2023-10-18T14:09:16.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.717 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.717 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.718 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1787023362, 2023-10-18T14:09:16.718 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632102, 2023-10-18T14:09:16.718 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmthin" 2023-10-18T14:09:16.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.718 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.719 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.719 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1794999047, 2023-10-18T14:09:16.719 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632154, 2023-10-18T14:09:16.719 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_allocinfo.c" 2023-10-18T14:09:16.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.720 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.720 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1802731051, 2023-10-18T14:09:16.720 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632147, 2023-10-18T14:09:16.720 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_getall_sessions.c" 2023-10-18T14:09:16.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.721 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.721 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.721 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1803212628, 2023-10-18T14:09:16.721 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632661, 2023-10-18T14:09:16.721 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/Makefile" 2023-10-18T14:09:16.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.722 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.722 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.722 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1805802909, 2023-10-18T14:09:16.722 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632237, 2023-10-18T14:09:16.723 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_rights.c" 2023-10-18T14:09:16.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.723 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.723 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.723 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1807522866, 2023-10-18T14:09:16.724 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629298, 2023-10-18T14:09:16.724 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample" 2023-10-18T14:09:16.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.724 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.724 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.724 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1812920708, 2023-10-18T14:09:16.725 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631541, 2023-10-18T14:09:16.725 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/428.out" 2023-10-18T14:09:16.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.725 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.725 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.726 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1828741668, 2023-10-18T14:09:16.726 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629080, 2023-10-18T14:09:16.726 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/438.out" 2023-10-18T14:09:16.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.726 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.727 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.727 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1849551080, 2023-10-18T14:09:16.727 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632247, 2023-10-18T14:09:16.727 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_ncurses.m4" 2023-10-18T14:09:16.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.728 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.728 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.728 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1860675799, 2023-10-18T14:09:16.728 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627804, 2023-10-18T14:09:16.728 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm" 2023-10-18T14:09:16.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.729 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.729 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.729 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1860824977, 2023-10-18T14:09:16.729 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632643, 2023-10-18T14:09:16.729 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/279" 2023-10-18T14:09:16.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.730 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.730 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.730 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1864250441, 2023-10-18T14:09:16.730 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633102, 2023-10-18T14:09:16.731 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/484" 2023-10-18T14:09:16.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.731 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.731 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1871331559, 2023-10-18T14:09:16.731 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629096, 2023-10-18T14:09:16.732 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/446.out" 2023-10-18T14:09:16.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.732 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.732 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1887394508, 2023-10-18T14:09:16.733 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633039, 2023-10-18T14:09:16.733 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/425" 2023-10-18T14:09:16.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.733 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.733 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.734 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1888760046, 2023-10-18T14:09:16.734 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633022, 2023-10-18T14:09:16.734 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/409" 2023-10-18T14:09:16.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.734 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.735 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1906873853, 2023-10-18T14:09:16.735 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632178, 2023-10-18T14:09:16.735 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/print_fshandle.c" 2023-10-18T14:09:16.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.735 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.736 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.736 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1913685294, 2023-10-18T14:09:16.736 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628463, 2023-10-18T14:09:16.736 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/010.out" 2023-10-18T14:09:16.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1919615504, 2023-10-18T14:09:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632133, 2023-10-18T14:09:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/print.c" 2023-10-18T14:09:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1923817108, 2023-10-18T14:09:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632396, 2023-10-18T14:09:16.739 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/Makefile" 2023-10-18T14:09:16.739 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.739 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.739 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.739 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1946484744, 2023-10-18T14:09:16.739 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628620, 2023-10-18T14:09:16.740 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/083.out" 2023-10-18T14:09:16.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.740 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.740 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1951766435, 2023-10-18T14:09:16.741 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632487, 2023-10-18T14:09:16.741 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/128" 2023-10-18T14:09:16.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.741 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.741 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.741 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1953405202, 2023-10-18T14:09:16.742 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632245, 2023-10-18T14:09:16.742 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_dmapidev.m4" 2023-10-18T14:09:16.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.742 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.743 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1960006144, 2023-10-18T14:09:16.743 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632227, 2023-10-18T14:09:16.743 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/send_msg.c" 2023-10-18T14:09:16.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.743 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.744 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.744 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1966155956, 2023-10-18T14:09:16.744 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633170, 2023-10-18T14:09:16.744 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/548" 2023-10-18T14:09:16.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.744 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.745 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.745 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1974131548, 2023-10-18T14:09:16.745 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633041, 2023-10-18T14:09:16.745 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/427" 2023-10-18T14:09:16.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.746 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.746 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1981095959, 2023-10-18T14:09:16.746 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631487, 2023-10-18T14:09:16.746 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/401.out" 2023-10-18T14:09:16.747 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.747 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.747 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.747 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 1992539236, 2023-10-18T14:09:16.747 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632220, 2023-10-18T14:09:16.748 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/check_dmapi.c" 2023-10-18T14:09:16.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.748 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.748 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.748 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2001618610, 2023-10-18T14:09:16.748 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632159, 2023-10-18T14:09:16.749 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_events.c" 2023-10-18T14:09:16.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.749 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.749 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.749 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2018828664, 2023-10-18T14:09:16.750 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632667, 2023-10-18T14:09:16.750 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/crttf" 2023-10-18T14:09:16.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.750 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.750 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.751 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2023043947, 2023-10-18T14:09:16.751 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629314, 2023-10-18T14:09:16.751 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/packed-refs" 2023-10-18T14:09:16.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.751 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.752 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.752 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2028527383, 2023-10-18T14:09:16.752 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632230, 2023-10-18T14:09:16.752 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_dmattr.c" 2023-10-18T14:09:16.752 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.753 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.753 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2037234834, 2023-10-18T14:09:16.753 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633673, 2023-10-18T14:09:16.753 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018" 2023-10-18T14:09:16.754 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.754 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.754 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.754 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2038351763, 2023-10-18T14:09:16.754 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629266, 2023-10-18T14:09:16.754 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/531.out" 2023-10-18T14:09:16.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.755 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.755 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.755 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2048208421, 2023-10-18T14:09:16.755 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631178, 2023-10-18T14:09:16.756 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/247.out" 2023-10-18T14:09:16.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.756 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.756 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2062921553, 2023-10-18T14:09:16.757 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631595, 2023-10-18T14:09:16.757 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/455.out" 2023-10-18T14:09:16.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.757 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.757 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.757 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2069123330, 2023-10-18T14:09:16.758 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633171, 2023-10-18T14:09:16.758 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/549" 2023-10-18T14:09:16.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.758 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.758 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.759 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2070642300, 2023-10-18T14:09:16.759 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632170, 2023-10-18T14:09:16.759 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/make_sparse.c" 2023-10-18T14:09:16.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.760 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.760 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2072838034, 2023-10-18T14:09:16.760 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628864, 2023-10-18T14:09:16.760 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/330.out" 2023-10-18T14:09:16.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.761 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.761 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.761 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2080112809, 2023-10-18T14:09:16.761 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631308, 2023-10-18T14:09:16.761 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/312.out" 2023-10-18T14:09:16.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.762 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.762 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.762 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2085431815, 2023-10-18T14:09:16.762 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629867, 2023-10-18T14:09:16.762 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/236.out" 2023-10-18T14:09:16.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.763 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.763 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2085606411, 2023-10-18T14:09:16.763 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629312, 2023-10-18T14:09:16.764 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/shallow" 2023-10-18T14:09:16.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.764 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.764 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.764 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2086775435, 2023-10-18T14:09:16.765 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632905, 2023-10-18T14:09:16.765 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/298" 2023-10-18T14:09:16.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.765 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.765 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.766 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2092444770, 2023-10-18T14:09:16.766 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630970, 2023-10-18T14:09:16.766 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/149.out" 2023-10-18T14:09:16.766 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.766 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.767 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.767 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2095148540, 2023-10-18T14:09:16.767 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632666, 2023-10-18T14:09:16.767 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir" 2023-10-18T14:09:16.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.768 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.768 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.768 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2097894836, 2023-10-18T14:09:16.768 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631485, 2023-10-18T14:09:16.768 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/400.out" 2023-10-18T14:09:16.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.769 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.769 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2105164348, 2023-10-18T14:09:16.769 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632551, 2023-10-18T14:09:16.769 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/188" 2023-10-18T14:09:16.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.770 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.770 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.770 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2112516595, 2023-10-18T14:09:16.770 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630720, 2023-10-18T14:09:16.770 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/029.out" 2023-10-18T14:09:16.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.771 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.771 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.771 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2116696664, 2023-10-18T14:09:16.771 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627819, 2023-10-18T14:09:16.772 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/Makefile" 2023-10-18T14:09:16.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.772 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.772 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.772 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2122531503, 2023-10-18T14:09:16.773 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632105, 2023-10-18T14:09:16.773 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filestreams" 2023-10-18T14:09:16.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.773 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.773 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.774 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2124020246, 2023-10-18T14:09:16.774 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631641, 2023-10-18T14:09:16.774 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/478.out" 2023-10-18T14:09:16.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.774 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.775 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.775 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2129385038, 2023-10-18T14:09:16.775 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632216, 2023-10-18T14:09:16.775 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/smallq.dat" 2023-10-18T14:09:16.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.776 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.776 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2140824114, 2023-10-18T14:09:16.776 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629052, 2023-10-18T14:09:16.776 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/424.out" 2023-10-18T14:09:16.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.777 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.777 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.777 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2146169379, 2023-10-18T14:09:16.777 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628574, 2023-10-18T14:09:16.778 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/060.out" 2023-10-18T14:09:16.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.778 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.778 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.778 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2162533110, 2023-10-18T14:09:16.779 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629296, 2023-10-18T14:09:16.779 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample" 2023-10-18T14:09:16.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.779 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.779 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.779 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2164046968, 2023-10-18T14:09:16.780 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632120, 2023-10-18T14:09:16.780 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/report" 2023-10-18T14:09:16.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.780 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.781 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2167370121, 2023-10-18T14:09:16.781 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632233, 2023-10-18T14:09:16.781 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_fileattr.c" 2023-10-18T14:09:16.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.782 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.782 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2184341316, 2023-10-18T14:09:16.782 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632114, 2023-10-18T14:09:16.782 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/punch" 2023-10-18T14:09:16.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.783 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.783 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2189109500, 2023-10-18T14:09:16.783 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628596, 2023-10-18T14:09:16.783 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/071.out" 2023-10-18T14:09:16.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.784 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.784 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2197327014, 2023-10-18T14:09:16.784 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629297, 2023-10-18T14:09:16.784 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample" 2023-10-18T14:09:16.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.785 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.785 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.785 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2197846670, 2023-10-18T14:09:16.785 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632232, 2023-10-18T14:09:16.785 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_eventlist.c" 2023-10-18T14:09:16.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.786 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.786 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.786 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2198024339, 2023-10-18T14:09:16.786 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629840, 2023-10-18T14:09:16.787 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/196.out" 2023-10-18T14:09:16.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.787 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.787 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.787 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2201254194, 2023-10-18T14:09:16.787 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629382, 2023-10-18T14:09:16.788 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/rc.sysinit" 2023-10-18T14:09:16.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.788 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.788 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2209274001, 2023-10-18T14:09:16.789 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632103, 2023-10-18T14:09:16.789 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dump" 2023-10-18T14:09:16.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.789 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.790 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2211920068, 2023-10-18T14:09:16.790 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629401, 2023-10-18T14:09:16.790 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/str_to_bytes.h" 2023-10-18T14:09:16.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.791 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.791 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2219334248, 2023-10-18T14:09:16.791 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629345, 2023-10-18T14:09:16.791 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmhugedisk" 2023-10-18T14:09:16.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.792 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.792 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2221359930, 2023-10-18T14:09:16.792 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629444, 2023-10-18T14:09:16.792 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/visibility_hidden.m4" 2023-10-18T14:09:16.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.793 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.793 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2228199502, 2023-10-18T14:09:16.793 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632127, 2023-10-18T14:09:16.793 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/set_region.c" 2023-10-18T14:09:16.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.794 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.794 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2229562332, 2023-10-18T14:09:16.794 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632142, 2023-10-18T14:09:16.794 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/mrmean.c" 2023-10-18T14:09:16.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.795 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.795 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2246607251, 2023-10-18T14:09:16.795 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631320, 2023-10-18T14:09:16.796 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/318.out" 2023-10-18T14:09:16.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.796 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.796 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2252473155, 2023-10-18T14:09:16.797 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632908, 2023-10-18T14:09:16.797 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/301" 2023-10-18T14:09:16.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.797 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.798 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2261663644, 2023-10-18T14:09:16.798 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632212, 2023-10-18T14:09:16.798 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/nfs.dat" 2023-10-18T14:09:16.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.799 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.799 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2266234733, 2023-10-18T14:09:16.799 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629406, 2023-10-18T14:09:16.799 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/databin.c" 2023-10-18T14:09:16.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.800 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.800 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2276602568, 2023-10-18T14:09:16.800 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629200, 2023-10-18T14:09:16.800 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/498.out" 2023-10-18T14:09:16.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.801 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.801 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2290929763, 2023-10-18T14:09:16.801 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632231, 2023-10-18T14:09:16.801 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_efault.c" 2023-10-18T14:09:16.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.802 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.802 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2291369688, 2023-10-18T14:09:16.802 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632229, 2023-10-18T14:09:16.803 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_bulkattr.c" 2023-10-18T14:09:16.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.803 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.803 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2292261133, 2023-10-18T14:09:16.803 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632594, 2023-10-18T14:09:16.804 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/230" 2023-10-18T14:09:16.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.804 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.804 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.804 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2293005062, 2023-10-18T14:09:16.805 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629102, 2023-10-18T14:09:16.805 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/449.out" 2023-10-18T14:09:16.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.805 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.805 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.806 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2301532005, 2023-10-18T14:09:16.806 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631387, 2023-10-18T14:09:16.806 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/351.out" 2023-10-18T14:09:16.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.806 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.807 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.807 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2310798003, 2023-10-18T14:09:16.807 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629295, 2023-10-18T14:09:16.807 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample" 2023-10-18T14:09:16.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.807 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.808 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.808 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2318087532, 2023-10-18T14:09:16.808 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632226, 2023-10-18T14:09:16.808 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/region_test.c" 2023-10-18T14:09:16.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.809 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.809 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2321137721, 2023-10-18T14:09:16.809 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629340, 2023-10-18T14:09:16.809 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/defrag" 2023-10-18T14:09:16.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.810 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.810 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.810 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2323391735, 2023-10-18T14:09:16.810 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632398, 2023-10-18T14:09:16.811 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/Makefile" 2023-10-18T14:09:16.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.811 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.811 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.811 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2336433697, 2023-10-18T14:09:16.811 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631092, 2023-10-18T14:09:16.812 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/210.out" 2023-10-18T14:09:16.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.813 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.813 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.813 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2352470083, 2023-10-18T14:09:16.813 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627785, 2023-10-18T14:09:16.814 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack" 2023-10-18T14:09:16.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.814 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.814 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.814 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2362190334, 2023-10-18T14:09:16.815 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629060, 2023-10-18T14:09:16.815 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/428.out" 2023-10-18T14:09:16.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.815 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.815 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.816 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2400249934, 2023-10-18T14:09:16.816 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631539, 2023-10-18T14:09:16.816 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/427.out" 2023-10-18T14:09:16.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.817 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.817 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2410548601, 2023-10-18T14:09:16.817 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629216, 2023-10-18T14:09:16.817 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/506.out" 2023-10-18T14:09:16.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.817 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.818 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.818 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2421665172, 2023-10-18T14:09:16.818 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632402, 2023-10-18T14:09:16.818 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/Makefile" 2023-10-18T14:09:16.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.819 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.819 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.819 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2424663158, 2023-10-18T14:09:16.819 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631062, 2023-10-18T14:09:16.819 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/195.out" 2023-10-18T14:09:16.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.820 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.820 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.820 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2429127431, 2023-10-18T14:09:16.820 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632242, 2023-10-18T14:09:16.820 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/fsx.c" 2023-10-18T14:09:16.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.821 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.821 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.821 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2437844450, 2023-10-18T14:09:16.821 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632218, 2023-10-18T14:09:16.822 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/standard_nfs.dat" 2023-10-18T14:09:16.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.822 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.822 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2441193998, 2023-10-18T14:09:16.822 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627803, 2023-10-18T14:09:16.823 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/Makefile" 2023-10-18T14:09:16.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.823 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.823 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.823 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2443729570, 2023-10-18T14:09:16.824 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629400, 2023-10-18T14:09:16.824 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/random_range.h" 2023-10-18T14:09:16.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.824 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.824 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.825 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2449850926, 2023-10-18T14:09:16.825 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631575, 2023-10-18T14:09:16.825 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/445.out" 2023-10-18T14:09:16.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.825 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.826 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2450935375, 2023-10-18T14:09:16.826 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633098, 2023-10-18T14:09:16.826 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/480" 2023-10-18T14:09:16.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.826 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.827 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.827 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2460798266, 2023-10-18T14:09:16.827 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632989, 2023-10-18T14:09:16.827 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/378" 2023-10-18T14:09:16.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.827 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.828 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.828 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2461738764, 2023-10-18T14:09:16.828 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632633, 2023-10-18T14:09:16.828 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/269" 2023-10-18T14:09:16.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.829 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.829 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2469787851, 2023-10-18T14:09:16.829 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632174, 2023-10-18T14:09:16.829 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/path_to_fshandle.c" 2023-10-18T14:09:16.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.830 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.830 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2481797898, 2023-10-18T14:09:16.830 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629226, 2023-10-18T14:09:16.830 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/511.out" 2023-10-18T14:09:16.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.831 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.831 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.831 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2490801150, 2023-10-18T14:09:16.831 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632219, 2023-10-18T14:09:16.832 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/menu_test" 2023-10-18T14:09:16.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.832 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.832 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.832 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2506246858, 2023-10-18T14:09:16.832 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630001, 2023-10-18T14:09:16.833 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/303.out" 2023-10-18T14:09:16.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.833 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.833 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.833 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2521884431, 2023-10-18T14:09:16.834 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629234, 2023-10-18T14:09:16.834 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/515.out" 2023-10-18T14:09:16.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.834 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.835 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2527330157, 2023-10-18T14:09:16.835 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632199, 2023-10-18T14:09:16.835 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/function_coverage" 2023-10-18T14:09:16.835 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.835 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.835 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.836 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2531837989, 2023-10-18T14:09:16.836 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632981, 2023-10-18T14:09:16.836 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/372" 2023-10-18T14:09:16.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.836 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.837 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.837 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2533503955, 2023-10-18T14:09:16.837 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631004, 2023-10-18T14:09:16.837 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/166.out" 2023-10-18T14:09:16.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.838 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.838 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2536244430, 2023-10-18T14:09:16.838 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632148, 2023-10-18T14:09:16.838 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_getall_tokens.c" 2023-10-18T14:09:16.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.839 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.839 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.839 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2538229183, 2023-10-18T14:09:16.839 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632234, 2023-10-18T14:09:16.839 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_hole.c" 2023-10-18T14:09:16.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.840 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.840 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2541582032, 2023-10-18T14:09:16.840 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627806, 2023-10-18T14:09:16.841 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/tar" 2023-10-18T14:09:16.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.841 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.841 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2554041841, 2023-10-18T14:09:16.841 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632181, 2023-10-18T14:09:16.842 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/punch_hole.c" 2023-10-18T14:09:16.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.842 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.842 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2562301716, 2023-10-18T14:09:16.843 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629359, 2023-10-18T14:09:16.843 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/locktest" 2023-10-18T14:09:16.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.843 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.844 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2579209102, 2023-10-18T14:09:16.844 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629425, 2023-10-18T14:09:16.844 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/growfiles.c" 2023-10-18T14:09:16.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.845 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.845 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2589235566, 2023-10-18T14:09:16.845 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632146, 2023-10-18T14:09:16.845 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_find_eventmsg.c" 2023-10-18T14:09:16.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.846 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.846 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.846 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2591557182, 2023-10-18T14:09:16.846 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632187, 2023-10-18T14:09:16.846 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/respond_event.c" 2023-10-18T14:09:16.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.847 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.847 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2597855528, 2023-10-18T14:09:16.847 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628853, 2023-10-18T14:09:16.847 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/225.out" 2023-10-18T14:09:16.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.848 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.848 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2605949535, 2023-10-18T14:09:16.848 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632202, 2023-10-18T14:09:16.849 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/README_for_check_dmapi" 2023-10-18T14:09:16.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.849 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.849 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2608404275, 2023-10-18T14:09:16.849 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631206, 2023-10-18T14:09:16.850 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/261.out" 2023-10-18T14:09:16.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.850 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.850 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2621630548, 2023-10-18T14:09:16.851 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632110, 2023-10-18T14:09:16.851 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/log" 2023-10-18T14:09:16.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.851 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.851 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.852 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2631746028, 2023-10-18T14:09:16.852 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630138, 2023-10-18T14:09:16.852 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/586.out" 2023-10-18T14:09:16.852 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.852 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.853 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.853 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2636545277, 2023-10-18T14:09:16.853 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629291, 2023-10-18T14:09:16.853 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample" 2023-10-18T14:09:16.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.854 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.854 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2649100979, 2023-10-18T14:09:16.854 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632400, 2023-10-18T14:09:16.854 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/Makefile" 2023-10-18T14:09:16.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.855 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.855 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.855 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2654114702, 2023-10-18T14:09:16.855 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632158, 2023-10-18T14:09:16.855 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_eventlist.c" 2023-10-18T14:09:16.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.856 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.856 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.856 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2657188151, 2023-10-18T14:09:16.856 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630928, 2023-10-18T14:09:16.857 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/128.out" 2023-10-18T14:09:16.857 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.857 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.857 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.857 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2659301386, 2023-10-18T14:09:16.858 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629375, 2023-10-18T14:09:16.858 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/test_names" 2023-10-18T14:09:16.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.858 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.858 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.859 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2670190008, 2023-10-18T14:09:16.859 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628539, 2023-10-18T14:09:16.859 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/047.out" 2023-10-18T14:09:16.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.859 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.860 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.860 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2672810243, 2023-10-18T14:09:16.860 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632098, 2023-10-18T14:09:16.860 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmdelay" 2023-10-18T14:09:16.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.861 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.861 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2680078098, 2023-10-18T14:09:16.861 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631515, 2023-10-18T14:09:16.861 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/415.out" 2023-10-18T14:09:16.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.862 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.862 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2684763236, 2023-10-18T14:09:16.862 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627783, 2023-10-18T14:09:16.862 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack" 2023-10-18T14:09:16.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.863 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.863 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.863 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2694228259, 2023-10-18T14:09:16.863 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628920, 2023-10-18T14:09:16.863 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/358.out" 2023-10-18T14:09:16.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.864 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.864 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.864 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2705040832, 2023-10-18T14:09:16.864 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632414, 2023-10-18T14:09:16.865 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/057" 2023-10-18T14:09:16.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.865 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.865 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.865 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2709440673, 2023-10-18T14:09:16.865 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630774, 2023-10-18T14:09:16.866 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/055.out" 2023-10-18T14:09:16.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.866 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.866 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.866 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2711225033, 2023-10-18T14:09:16.867 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631535, 2023-10-18T14:09:16.867 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/425.out" 2023-10-18T14:09:16.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.867 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.867 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.868 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2718558595, 2023-10-18T14:09:16.868 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630101, 2023-10-18T14:09:16.868 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/565.out" 2023-10-18T14:09:16.868 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.868 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.868 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.869 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2725106707, 2023-10-18T14:09:16.869 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632597, 2023-10-18T14:09:16.869 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/233" 2023-10-18T14:09:16.869 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.869 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.870 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.870 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2729744391, 2023-10-18T14:09:16.870 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632936, 2023-10-18T14:09:16.870 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/329" 2023-10-18T14:09:16.870 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.871 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.871 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.871 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2739140427, 2023-10-18T14:09:16.871 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630782, 2023-10-18T14:09:16.871 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/059.out" 2023-10-18T14:09:16.872 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.872 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.872 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.872 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2741019838, 2023-10-18T14:09:16.872 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632109, 2023-10-18T14:09:16.872 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/inject" 2023-10-18T14:09:16.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.873 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.873 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.873 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2752922573, 2023-10-18T14:09:16.873 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632236, 2023-10-18T14:09:16.874 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_region.c" 2023-10-18T14:09:16.874 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.874 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.874 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.874 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2772110443, 2023-10-18T14:09:16.875 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631461, 2023-10-18T14:09:16.875 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/388.out" 2023-10-18T14:09:16.875 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.875 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.875 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.876 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2774391838, 2023-10-18T14:09:16.876 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629294, 2023-10-18T14:09:16.876 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample" 2023-10-18T14:09:16.876 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.876 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.877 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.877 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2774450343, 2023-10-18T14:09:16.877 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633031, 2023-10-18T14:09:16.877 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/418" 2023-10-18T14:09:16.877 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.878 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.878 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.878 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2791316934, 2023-10-18T14:09:16.878 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629428, 2023-10-18T14:09:16.878 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/manual_format.m4" 2023-10-18T14:09:16.879 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.879 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.879 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.879 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2811520518, 2023-10-18T14:09:16.879 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632190, 2023-10-18T14:09:16.880 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/security_hole2.c" 2023-10-18T14:09:16.880 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.880 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.880 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.880 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2812861177, 2023-10-18T14:09:16.881 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632119, 2023-10-18T14:09:16.881 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/repair" 2023-10-18T14:09:16.881 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.881 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.881 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.881 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2822442761, 2023-10-18T14:09:16.882 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632659, 2023-10-18T14:09:16.882 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/Makefile" 2023-10-18T14:09:16.882 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.882 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.882 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.883 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2828287980, 2023-10-18T14:09:16.883 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629873, 2023-10-18T14:09:16.883 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/239.out" 2023-10-18T14:09:16.883 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.883 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.884 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.884 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2859067649, 2023-10-18T14:09:16.884 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632155, 2023-10-18T14:09:16.884 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_config_events.c" 2023-10-18T14:09:16.884 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.885 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.885 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.885 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2875410018, 2023-10-18T14:09:16.885 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629290, 2023-10-18T14:09:16.885 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/update.sample" 2023-10-18T14:09:16.886 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.886 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.886 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.886 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2883371993, 2023-10-18T14:09:16.886 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628855, 2023-10-18T14:09:16.887 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/226.out" 2023-10-18T14:09:16.887 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.887 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.887 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.887 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2898250833, 2023-10-18T14:09:16.888 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631457, 2023-10-18T14:09:16.888 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/386.out" 2023-10-18T14:09:16.888 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.888 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.888 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.889 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2903511801, 2023-10-18T14:09:16.889 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628489, 2023-10-18T14:09:16.889 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/023.out" 2023-10-18T14:09:16.889 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.889 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.889 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.890 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2918676258, 2023-10-18T14:09:16.890 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633165, 2023-10-18T14:09:16.890 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/543" 2023-10-18T14:09:16.890 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.890 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.891 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.891 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2926622738, 2023-10-18T14:09:16.891 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627795, 2023-10-18T14:09:16.891 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/heads/master" 2023-10-18T14:09:16.891 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.892 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.892 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.892 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2934492185, 2023-10-18T14:09:16.892 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632192, 2023-10-18T14:09:16.892 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_dmattr.c" 2023-10-18T14:09:16.893 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.893 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.893 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.893 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2953150033, 2023-10-18T14:09:16.893 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632478, 2023-10-18T14:09:16.893 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/119" 2023-10-18T14:09:16.894 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.894 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.894 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.894 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2958488067, 2023-10-18T14:09:16.894 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630843, 2023-10-18T14:09:16.895 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/089.out" 2023-10-18T14:09:16.895 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.895 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.895 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.895 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2969460228, 2023-10-18T14:09:16.896 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632193, 2023-10-18T14:09:16.896 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_eventlist.c" 2023-10-18T14:09:16.896 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.896 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.896 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.897 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 2972879463, 2023-10-18T14:09:16.897 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633044, 2023-10-18T14:09:16.897 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/429.out" 2023-10-18T14:09:16.897 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.897 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.897 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.898 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3006533893, 2023-10-18T14:09:16.898 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632425, 2023-10-18T14:09:16.898 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/068" 2023-10-18T14:09:16.898 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.898 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.899 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.899 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3013960526, 2023-10-18T14:09:16.899 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632188, 2023-10-18T14:09:16.899 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/rwt.c" 2023-10-18T14:09:16.899 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.900 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.900 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.900 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3014915570, 2023-10-18T14:09:16.900 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632196, 2023-10-18T14:09:16.900 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/sync_by_handle.c" 2023-10-18T14:09:16.900 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.901 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.901 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.901 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3025994982, 2023-10-18T14:09:16.901 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632126, 2023-10-18T14:09:16.901 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/read_invis.c" 2023-10-18T14:09:16.902 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.902 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.902 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.902 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3057733878, 2023-10-18T14:09:16.902 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630855, 2023-10-18T14:09:16.903 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/095.out" 2023-10-18T14:09:16.903 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.903 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.903 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.903 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3069515423, 2023-10-18T14:09:16.904 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633060, 2023-10-18T14:09:16.904 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/443" 2023-10-18T14:09:16.904 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.904 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.904 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.905 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3090041948, 2023-10-18T14:09:16.905 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627793, 2023-10-18T14:09:16.905 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin" 2023-10-18T14:09:16.905 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.905 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.905 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.906 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3091231892, 2023-10-18T14:09:16.906 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631702, 2023-10-18T14:09:16.906 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/509.out" 2023-10-18T14:09:16.906 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.906 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.907 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.907 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3101360435, 2023-10-18T14:09:16.907 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631194, 2023-10-18T14:09:16.907 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/255.out" 2023-10-18T14:09:16.907 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.908 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.908 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.908 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3102876958, 2023-10-18T14:09:16.908 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632673, 2023-10-18T14:09:16.908 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/lib/errtest.h" 2023-10-18T14:09:16.909 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.909 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.909 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.909 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3105849138, 2023-10-18T14:09:16.909 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632228, 2023-10-18T14:09:16.909 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_bulkall.c" 2023-10-18T14:09:16.910 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.910 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.910 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.910 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3111275276, 2023-10-18T14:09:16.910 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631704, 2023-10-18T14:09:16.911 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/510.out" 2023-10-18T14:09:16.911 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.911 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.911 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.911 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3112933776, 2023-10-18T14:09:16.912 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631302, 2023-10-18T14:09:16.912 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/309.out" 2023-10-18T14:09:16.912 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.912 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.912 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.912 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3120343544, 2023-10-18T14:09:16.913 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629000, 2023-10-18T14:09:16.913 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/398.out" 2023-10-18T14:09:16.913 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.913 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.913 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.914 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3121519329, 2023-10-18T14:09:16.914 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631497, 2023-10-18T14:09:16.914 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/406.out" 2023-10-18T14:09:16.914 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.914 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.915 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.915 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3123694953, 2023-10-18T14:09:16.915 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632117, 2023-10-18T14:09:16.915 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/reflink" 2023-10-18T14:09:16.915 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.915 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.916 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.916 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3124834572, 2023-10-18T14:09:16.916 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629405, 2023-10-18T14:09:16.916 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/dataascii.c" 2023-10-18T14:09:16.916 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.917 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.917 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.917 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3139898213, 2023-10-18T14:09:16.917 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632953, 2023-10-18T14:09:16.917 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/346" 2023-10-18T14:09:16.917 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.918 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.918 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.918 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3142106760, 2023-10-18T14:09:16.918 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628780, 2023-10-18T14:09:16.918 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/163.out" 2023-10-18T14:09:16.919 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.919 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.919 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.919 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3146054022, 2023-10-18T14:09:16.919 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629941, 2023-10-18T14:09:16.920 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/273.out" 2023-10-18T14:09:16.920 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.920 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.920 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.920 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3160628712, 2023-10-18T14:09:16.920 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629399, 2023-10-18T14:09:16.921 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/pattern.h" 2023-10-18T14:09:16.921 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.921 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:16.921 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:16.921 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3168820018, 2023-10-18T14:09:16.922 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632097, 2023-10-18T14:09:16.922 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmapi" 2023-10-18T14:09:16.922 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:16.922 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.020 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3178208065, 2023-10-18T14:09:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629198, 2023-10-18T14:09:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/497.out" 2023-10-18T14:09:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.021 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3193828082, 2023-10-18T14:09:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632408, 2023-10-18T14:09:17.022 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/051" 2023-10-18T14:09:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3197982621, 2023-10-18T14:09:17.023 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632223, 2023-10-18T14:09:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mm_fill.c" 2023-10-18T14:09:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.024 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3209675222, 2023-10-18T14:09:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632164, 2023-10-18T14:09:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/getall_dmattr.c" 2023-10-18T14:09:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3216815387, 2023-10-18T14:09:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628968, 2023-10-18T14:09:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/382.out" 2023-10-18T14:09:17.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3216883654, 2023-10-18T14:09:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632169, 2023-10-18T14:09:17.027 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/make_rt_sparse.c" 2023-10-18T14:09:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3226891776, 2023-10-18T14:09:17.028 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629404, 2023-10-18T14:09:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/write_log.h" 2023-10-18T14:09:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.029 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3231939609, 2023-10-18T14:09:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630740, 2023-10-18T14:09:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/038.out" 2023-10-18T14:09:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.030 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3245839726, 2023-10-18T14:09:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631370, 2023-10-18T14:09:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/343.out" 2023-10-18T14:09:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.031 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3246761975, 2023-10-18T14:09:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632658, 2023-10-18T14:09:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple" 2023-10-18T14:09:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.032 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3248362805, 2023-10-18T14:09:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629212, 2023-10-18T14:09:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/504.out" 2023-10-18T14:09:17.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3258885749, 2023-10-18T14:09:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632904, 2023-10-18T14:09:17.034 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/297" 2023-10-18T14:09:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3261273748, 2023-10-18T14:09:17.035 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632131, 2023-10-18T14:09:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/find_session.c" 2023-10-18T14:09:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.036 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3262990852, 2023-10-18T14:09:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632118, 2023-10-18T14:09:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/renameat2" 2023-10-18T14:09:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.037 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3276731158, 2023-10-18T14:09:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629114, 2023-10-18T14:09:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/455.out" 2023-10-18T14:09:17.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3281146348, 2023-10-18T14:09:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633075, 2023-10-18T14:09:17.039 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/458" 2023-10-18T14:09:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3288082289, 2023-10-18T14:09:17.040 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632100, 2023-10-18T14:09:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmflakey" 2023-10-18T14:09:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3292398960, 2023-10-18T14:09:17.041 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632999, 2023-10-18T14:09:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/388" 2023-10-18T14:09:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.042 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3293204102, 2023-10-18T14:09:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630150, 2023-10-18T14:09:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/592.out" 2023-10-18T14:09:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.043 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3298433805, 2023-10-18T14:09:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629299, 2023-10-18T14:09:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample" 2023-10-18T14:09:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.044 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3299487874, 2023-10-18T14:09:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632208, 2023-10-18T14:09:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/test_allocinfo_1" 2023-10-18T14:09:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3303327713, 2023-10-18T14:09:17.046 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632994, 2023-10-18T14:09:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/383" 2023-10-18T14:09:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.047 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3304650473, 2023-10-18T14:09:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632559, 2023-10-18T14:09:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/196" 2023-10-18T14:09:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3306079283, 2023-10-18T14:09:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631672, 2023-10-18T14:09:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/494.out" 2023-10-18T14:09:17.049 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3309604927, 2023-10-18T14:09:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632096, 2023-10-18T14:09:17.050 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/config" 2023-10-18T14:09:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3310118620, 2023-10-18T14:09:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632944, 2023-10-18T14:09:17.051 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/337" 2023-10-18T14:09:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3310307825, 2023-10-18T14:09:17.052 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631551, 2023-10-18T14:09:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/433.out" 2023-10-18T14:09:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.053 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3318525093, 2023-10-18T14:09:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632404, 2023-10-18T14:09:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/Makefile" 2023-10-18T14:09:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3318835982, 2023-10-18T14:09:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632132, 2023-10-18T14:09:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/hsm.h" 2023-10-18T14:09:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.055 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3320801692, 2023-10-18T14:09:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629196, 2023-10-18T14:09:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/496.out" 2023-10-18T14:09:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3323569170, 2023-10-18T14:09:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629287, 2023-10-18T14:09:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/description" 2023-10-18T14:09:17.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3364299425, 2023-10-18T14:09:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629048, 2023-10-18T14:09:17.058 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/422.out" 2023-10-18T14:09:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3374971539, 2023-10-18T14:09:17.059 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628491, 2023-10-18T14:09:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/024.out" 2023-10-18T14:09:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3380293506, 2023-10-18T14:09:17.060 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632624, 2023-10-18T14:09:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/260" 2023-10-18T14:09:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.061 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3381944278, 2023-10-18T14:09:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631234, 2023-10-18T14:09:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/275.out" 2023-10-18T14:09:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.062 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3398153068, 2023-10-18T14:09:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628724, 2023-10-18T14:09:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/135.out" 2023-10-18T14:09:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.063 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3399540191, 2023-10-18T14:09:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632678, 2023-10-18T14:09:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/Makefile" 2023-10-18T14:09:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3438942891, 2023-10-18T14:09:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632197, 2023-10-18T14:09:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/test_assumption.c" 2023-10-18T14:09:17.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3440766770, 2023-10-18T14:09:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631064, 2023-10-18T14:09:17.066 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/196.out" 2023-10-18T14:09:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3445250360, 2023-10-18T14:09:17.067 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629427, 2023-10-18T14:09:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/rwtest.sh" 2023-10-18T14:09:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3451481850, 2023-10-18T14:09:17.068 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632205, 2023-10-18T14:09:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/make_holey" 2023-10-18T14:09:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.069 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3461840086, 2023-10-18T14:09:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627811, 2023-10-18T14:09:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/configs/example.config" 2023-10-18T14:09:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.070 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3461911781, 2023-10-18T14:09:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633080, 2023-10-18T14:09:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/463" 2023-10-18T14:09:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3463949271, 2023-10-18T14:09:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632135, 2023-10-18T14:09:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/util.c" 2023-10-18T14:09:17.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3470867422, 2023-10-18T14:09:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632920, 2023-10-18T14:09:17.073 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/313" 2023-10-18T14:09:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3491152234, 2023-10-18T14:09:17.074 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627782, 2023-10-18T14:09:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects" 2023-10-18T14:09:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3496874457, 2023-10-18T14:09:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632203, 2023-10-18T14:09:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/ctf" 2023-10-18T14:09:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.076 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3507477181, 2023-10-18T14:09:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631336, 2023-10-18T14:09:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/326.out" 2023-10-18T14:09:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.077 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3510862706, 2023-10-18T14:09:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632195, 2023-10-18T14:09:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/struct_test.c" 2023-10-18T14:09:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.078 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3530839227, 2023-10-18T14:09:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629395, 2023-10-18T14:09:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/file_lock.h" 2023-10-18T14:09:17.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3547875882, 2023-10-18T14:09:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632106, 2023-10-18T14:09:17.080 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filter" 2023-10-18T14:09:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3562275879, 2023-10-18T14:09:17.081 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628750, 2023-10-18T14:09:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/148.out" 2023-10-18T14:09:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.082 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3568315008, 2023-10-18T14:09:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631577, 2023-10-18T14:09:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/446.out" 2023-10-18T14:09:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3578869738, 2023-10-18T14:09:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627809, 2023-10-18T14:09:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/Makefile" 2023-10-18T14:09:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.084 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3594141634, 2023-10-18T14:09:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628916, 2023-10-18T14:09:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/356.out" 2023-10-18T14:09:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.085 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3599144300, 2023-10-18T14:09:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632211, 2023-10-18T14:09:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/main.dat" 2023-10-18T14:09:17.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3601636700, 2023-10-18T14:09:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632440, 2023-10-18T14:09:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/083" 2023-10-18T14:09:17.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.088 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.088 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.088 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3604006873, 2023-10-18T14:09:17.088 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629391, 2023-10-18T14:09:17.088 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/buildmacros" 2023-10-18T14:09:17.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.089 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.089 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3612913236, 2023-10-18T14:09:17.089 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629392, 2023-10-18T14:09:17.090 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/buildrules" 2023-10-18T14:09:17.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.090 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.090 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.090 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3641877175, 2023-10-18T14:09:17.091 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632165, 2023-10-18T14:09:17.091 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/handle_to_fshandle.c" 2023-10-18T14:09:17.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.091 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.091 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.091 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3648296259, 2023-10-18T14:09:17.092 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629162, 2023-10-18T14:09:17.092 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/479.out" 2023-10-18T14:09:17.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.092 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.092 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.093 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3665930018, 2023-10-18T14:09:17.093 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633013, 2023-10-18T14:09:17.093 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/401" 2023-10-18T14:09:17.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.093 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.093 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.094 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3672661163, 2023-10-18T14:09:17.094 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629134, 2023-10-18T14:09:17.094 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/465.out" 2023-10-18T14:09:17.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.094 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.095 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.095 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3677988300, 2023-10-18T14:09:17.095 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632405, 2023-10-18T14:09:17.095 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm" 2023-10-18T14:09:17.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.096 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.096 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.096 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3683021204, 2023-10-18T14:09:17.096 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630768, 2023-10-18T14:09:17.096 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/052.out" 2023-10-18T14:09:17.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.097 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.097 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.097 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3695661119, 2023-10-18T14:09:17.097 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629429, 2023-10-18T14:09:17.097 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/multilib.m4" 2023-10-18T14:09:17.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.098 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.098 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3696495951, 2023-10-18T14:09:17.098 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628568, 2023-10-18T14:09:17.099 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/057.out" 2023-10-18T14:09:17.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.099 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.099 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3710155920, 2023-10-18T14:09:17.100 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632929, 2023-10-18T14:09:17.100 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/322" 2023-10-18T14:09:17.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.100 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.100 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3712724985, 2023-10-18T14:09:17.101 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632672, 2023-10-18T14:09:17.101 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/lib" 2023-10-18T14:09:17.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.101 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.101 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.102 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3721427728, 2023-10-18T14:09:17.102 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629416, 2023-10-18T14:09:17.102 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/tlibio.c" 2023-10-18T14:09:17.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.103 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.103 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3741748526, 2023-10-18T14:09:17.103 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632669, 2023-10-18T14:09:17.103 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/fail.dat" 2023-10-18T14:09:17.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.104 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.104 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3752199539, 2023-10-18T14:09:17.104 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632246, 2023-10-18T14:09:17.104 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_libcdev.m4" 2023-10-18T14:09:17.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.105 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.105 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.105 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3757454452, 2023-10-18T14:09:17.105 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632222, 2023-10-18T14:09:17.105 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/invis_test.c" 2023-10-18T14:09:17.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.106 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.106 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3766029741, 2023-10-18T14:09:17.106 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632111, 2023-10-18T14:09:17.107 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/module" 2023-10-18T14:09:17.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.107 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.107 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.107 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3772739687, 2023-10-18T14:09:17.108 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629338, 2023-10-18T14:09:17.108 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/cgroup2" 2023-10-18T14:09:17.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.108 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.108 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3779176208, 2023-10-18T14:09:17.109 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632171, 2023-10-18T14:09:17.109 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_hold.c" 2023-10-18T14:09:17.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.109 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.110 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3779673269, 2023-10-18T14:09:17.110 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629792, 2023-10-18T14:09:17.110 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs" 2023-10-18T14:09:17.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.111 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.111 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3802085066, 2023-10-18T14:09:17.111 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632662, 2023-10-18T14:09:17.111 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd" 2023-10-18T14:09:17.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.112 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.112 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.112 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3813288859, 2023-10-18T14:09:17.112 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632210, 2023-10-18T14:09:17.112 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/create_cpio" 2023-10-18T14:09:17.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.113 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.113 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3837487250, 2023-10-18T14:09:17.113 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632464, 2023-10-18T14:09:17.113 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/105" 2023-10-18T14:09:17.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.114 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.114 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3842077863, 2023-10-18T14:09:17.114 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632175, 2023-10-18T14:09:17.115 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/path_to_handle.c" 2023-10-18T14:09:17.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.115 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.115 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.115 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3846501030, 2023-10-18T14:09:17.116 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627788, 2023-10-18T14:09:17.116 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes/origin" 2023-10-18T14:09:17.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.116 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.117 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3853496240, 2023-10-18T14:09:17.117 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632176, 2023-10-18T14:09:17.117 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/pending.c" 2023-10-18T14:09:17.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.117 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.117 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.118 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3856004631, 2023-10-18T14:09:17.118 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632185, 2023-10-18T14:09:17.118 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/remove_dmattr.c" 2023-10-18T14:09:17.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.119 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.119 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3859321636, 2023-10-18T14:09:17.119 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632150, 2023-10-18T14:09:17.119 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/create_userevent.c" 2023-10-18T14:09:17.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.120 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.120 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.120 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3888461168, 2023-10-18T14:09:17.120 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632592, 2023-10-18T14:09:17.120 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/228" 2023-10-18T14:09:17.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.121 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.121 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3903992450, 2023-10-18T14:09:17.122 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629430, 2023-10-18T14:09:17.122 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_acldev.m4" 2023-10-18T14:09:17.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.122 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.123 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.123 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3913356263, 2023-10-18T14:09:17.123 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632149, 2023-10-18T14:09:17.123 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_query_session.c" 2023-10-18T14:09:17.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.124 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.124 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3915216873, 2023-10-18T14:09:17.124 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630821, 2023-10-18T14:09:17.125 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/078.out" 2023-10-18T14:09:17.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.125 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.125 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3917315269, 2023-10-18T14:09:17.126 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632182, 2023-10-18T14:09:17.126 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/query_right.c" 2023-10-18T14:09:17.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.126 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.127 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.127 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3917493118, 2023-10-18T14:09:17.127 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632215, 2023-10-18T14:09:17.127 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/realtime.dat" 2023-10-18T14:09:17.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.128 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.128 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3929664208, 2023-10-18T14:09:17.128 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632167, 2023-10-18T14:09:17.129 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/init_service.c" 2023-10-18T14:09:17.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.129 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.129 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.129 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3931396377, 2023-10-18T14:09:17.129 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632107, 2023-10-18T14:09:17.130 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filter.btrfs" 2023-10-18T14:09:17.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.130 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.130 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3932510617, 2023-10-18T14:09:17.131 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627786, 2023-10-18T14:09:17.131 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx" 2023-10-18T14:09:17.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.131 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.132 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3934827748, 2023-10-18T14:09:17.132 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628974, 2023-10-18T14:09:17.132 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/385.out" 2023-10-18T14:09:17.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.133 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.133 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3947604659, 2023-10-18T14:09:17.133 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628471, 2023-10-18T14:09:17.133 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/014.out" 2023-10-18T14:09:17.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.133 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.134 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.134 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3950164777, 2023-10-18T14:09:17.134 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632125, 2023-10-18T14:09:17.134 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/README" 2023-10-18T14:09:17.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.135 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.135 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3958295795, 2023-10-18T14:09:17.135 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631571, 2023-10-18T14:09:17.135 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/443.out" 2023-10-18T14:09:17.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.136 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.136 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3960146991, 2023-10-18T14:09:17.136 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632144, 2023-10-18T14:09:17.137 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_create_session.c" 2023-10-18T14:09:17.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.137 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.137 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.137 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3991726227, 2023-10-18T14:09:17.137 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629092, 2023-10-18T14:09:17.138 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/444.out" 2023-10-18T14:09:17.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.138 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.138 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3996031263, 2023-10-18T14:09:17.139 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629072, 2023-10-18T14:09:17.139 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/434.out" 2023-10-18T14:09:17.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.139 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.139 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.140 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3999495133, 2023-10-18T14:09:17.140 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629431, 2023-10-18T14:09:17.140 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_aiodev.m4" 2023-10-18T14:09:17.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.140 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.141 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.141 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 3999640913, 2023-10-18T14:09:17.141 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630130, 2023-10-18T14:09:17.141 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/582.out" 2023-10-18T14:09:17.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.142 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.142 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.142 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4017606081, 2023-10-18T14:09:17.142 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629396, 2023-10-18T14:09:17.142 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/forker.h" 2023-10-18T14:09:17.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.143 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.143 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.143 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4019489878, 2023-10-18T14:09:17.143 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632101, 2023-10-18T14:09:17.143 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmlogwrites" 2023-10-18T14:09:17.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.144 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.144 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.144 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4026927121, 2023-10-18T14:09:17.144 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632349, 2023-10-18T14:09:17.145 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/013" 2023-10-18T14:09:17.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.145 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.145 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.145 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4028042795, 2023-10-18T14:09:17.146 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631142, 2023-10-18T14:09:17.146 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/234.out" 2023-10-18T14:09:17.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.146 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.146 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.147 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4052680394, 2023-10-18T14:09:17.147 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629923, 2023-10-18T14:09:17.147 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/264.out" 2023-10-18T14:09:17.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.147 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.148 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.148 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4058372603, 2023-10-18T14:09:17.148 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631288, 2023-10-18T14:09:17.148 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/302.out" 2023-10-18T14:09:17.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.149 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.149 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4061198890, 2023-10-18T14:09:17.149 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632986, 2023-10-18T14:09:17.149 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/375" 2023-10-18T14:09:17.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.150 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.150 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4062992821, 2023-10-18T14:09:17.151 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629270, 2023-10-18T14:09:17.151 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/533.out" 2023-10-18T14:09:17.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.151 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.151 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4070814570, 2023-10-18T14:09:17.152 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511630884, 2023-10-18T14:09:17.152 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/109.out" 2023-10-18T14:09:17.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.152 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.153 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4075117263, 2023-10-18T14:09:17.153 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629793, 2023-10-18T14:09:17.153 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/heads" 2023-10-18T14:09:17.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.154 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.154 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4078605351, 2023-10-18T14:09:17.154 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632224, 2023-10-18T14:09:17.154 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mmap.c" 2023-10-18T14:09:17.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.155 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.155 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.155 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4083485776, 2023-10-18T14:09:17.155 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631188, 2023-10-18T14:09:17.155 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/252.out" 2023-10-18T14:09:17.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.156 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.156 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4099581048, 2023-10-18T14:09:17.156 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632081, 2023-10-18T14:09:17.156 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/interop" 2023-10-18T14:09:17.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.157 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.157 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4109292730, 2023-10-18T14:09:17.157 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632139, 2023-10-18T14:09:17.158 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migout.c" 2023-10-18T14:09:17.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.158 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.158 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4110406692, 2023-10-18T14:09:17.159 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629789, 2023-10-18T14:09:17.159 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/info/exclude" 2023-10-18T14:09:17.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.159 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.159 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4111404366, 2023-10-18T14:09:17.160 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632200, 2023-10-18T14:09:17.160 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/Makefile" 2023-10-18T14:09:17.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.160 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.161 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4114848442, 2023-10-18T14:09:17.161 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628570, 2023-10-18T14:09:17.161 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/058.out" 2023-10-18T14:09:17.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.161 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.162 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4116014183, 2023-10-18T14:09:17.162 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629977, 2023-10-18T14:09:17.162 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/291.out" 2023-10-18T14:09:17.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.163 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.163 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4120756007, 2023-10-18T14:09:17.163 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631537, 2023-10-18T14:09:17.163 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/426.out" 2023-10-18T14:09:17.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.164 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.164 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4123890945, 2023-10-18T14:09:17.164 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632161, 2023-10-18T14:09:17.164 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_mountinfo.c" 2023-10-18T14:09:17.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.165 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.165 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4128834406, 2023-10-18T14:09:17.165 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633050, 2023-10-18T14:09:17.166 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/435" 2023-10-18T14:09:17.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.166 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.166 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4138948063, 2023-10-18T14:09:17.167 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632510, 2023-10-18T14:09:17.167 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/148" 2023-10-18T14:09:17.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.167 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.167 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4146579585, 2023-10-18T14:09:17.168 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632403, 2023-10-18T14:09:17.168 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib" 2023-10-18T14:09:17.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.168 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.169 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4169715852, 2023-10-18T14:09:17.169 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632406, 2023-10-18T14:09:17.169 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/Makefile" 2023-10-18T14:09:17.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.170 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.170 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4173364855, 2023-10-18T14:09:17.170 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629791, 2023-10-18T14:09:17.170 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample" 2023-10-18T14:09:17.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.171 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.171 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.171 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4174587989, 2023-10-18T14:09:17.171 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632353, 2023-10-18T14:09:17.171 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/017" 2023-10-18T14:09:17.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.172 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.172 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4185528519, 2023-10-18T14:09:17.172 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633196, 2023-10-18T14:09:17.172 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/572" 2023-10-18T14:09:17.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.173 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.173 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4202668207, 2023-10-18T14:09:17.173 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631366, 2023-10-18T14:09:17.174 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/341.out" 2023-10-18T14:09:17.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.174 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.174 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4207675309, 2023-10-18T14:09:17.175 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629076, 2023-10-18T14:09:17.175 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/436.out" 2023-10-18T14:09:17.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.175 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.175 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4209237004, 2023-10-18T14:09:17.176 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629422, 2023-10-18T14:09:17.176 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/doio.h" 2023-10-18T14:09:17.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.176 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.177 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4221471888, 2023-10-18T14:09:17.177 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633137, 2023-10-18T14:09:17.177 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/516" 2023-10-18T14:09:17.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.178 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.178 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4223554864, 2023-10-18T14:09:17.178 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633181, 2023-10-18T14:09:17.178 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/558" 2023-10-18T14:09:17.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.179 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.179 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4231837032, 2023-10-18T14:09:17.179 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628672, 2023-10-18T14:09:17.179 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/109.out" 2023-10-18T14:09:17.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.180 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.180 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4231854753, 2023-10-18T14:09:17.180 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511631557, 2023-10-18T14:09:17.181 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/436.out" 2023-10-18T14:09:17.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.181 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.181 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4232143938, 2023-10-18T14:09:17.182 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511633059, 2023-10-18T14:09:17.182 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/442" 2023-10-18T14:09:17.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.183 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.183 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4235198455, 2023-10-18T14:09:17.183 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629286, 2023-10-18T14:09:17.183 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/branches" 2023-10-18T14:09:17.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.184 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.184 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4257720125, 2023-10-18T14:09:17.184 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632138, 2023-10-18T14:09:17.184 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migin.c" 2023-10-18T14:09:17.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.185 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.185 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.185 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4269627748, 2023-10-18T14:09:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511629407, 2023-10-18T14:09:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/datapid.c" 2023-10-18T14:09:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.187 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4272495690, 2023-10-18T14:09:17.187 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511627784, 2023-10-18T14:09:17.187 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/info" 2023-10-18T14:09:17.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.188 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.188 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4282207535, 2023-10-18T14:09:17.188 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632079, 2023-10-18T14:09:17.188 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/fs-walk" 2023-10-18T14:09:17.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.189 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.189 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4285478250, 2023-10-18T14:09:17.189 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632186, 2023-10-18T14:09:17.190 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/request_right.c" 2023-10-18T14:09:17.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:09:17.190 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:09:17.190 INFO:teuthology.orchestra.run.smithi114.stdout: "damage_type": "backtrace", 2023-10-18T14:09:17.191 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4293485891, 2023-10-18T14:09:17.191 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511632177, 2023-10-18T14:09:17.191 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/print_event.c" 2023-10-18T14:09:17.191 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:09:17.191 INFO:teuthology.orchestra.run.smithi114.stdout:] 2023-10-18T14:09:17.193 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:16 smithi172 ceph-mon[103574]: pgmap v438: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-10-18T14:09:17.193 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:16 smithi158 ceph-mon[103317]: pgmap v438: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-10-18T14:09:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f7125fcc700 1 -- 172.21.15.114:0/2491333952 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f71080a15f0 msgr2=0x7f71080a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f7125fcc700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f71080a15f0 0x7f71080a3ab0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7110005850 tx=0x7f711001a040 comp rx=0 tx=0).stop 2023-10-18T14:09:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f7125fcc700 1 -- 172.21.15.114:0/2491333952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71200ff640 msgr2=0x7f71201979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f7125fcc700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71200ff640 0x7f71201979f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f711400c920 tx=0x7f711400cce0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f7125fcc700 1 -- 172.21.15.114:0/2491333952 shutdown_connections 2023-10-18T14:09:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f7125fcc700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f71080a15f0 0x7f71080a3ab0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f7125fcc700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f71201056e0 0x7f71201a2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f7125fcc700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71200ff640 0x7f71201979f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f7125fcc700 1 --2- 172.21.15.114:0/2491333952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7120100000 0x7f7120197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f7125fcc700 1 -- 172.21.15.114:0/2491333952 >> 172.21.15.114:0/2491333952 conn(0x7f71200767f0 msgr2=0x7f71200fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:17.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f7125fcc700 1 -- 172.21.15.114:0/2491333952 shutdown_connections 2023-10-18T14:09:17.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:16.413+0000 7f7125fcc700 1 -- 172.21.15.114:0/2491333952 wait complete. 2023-10-18T14:09:17.197 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-18T14:09:17.198 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:16 smithi114 ceph-mon[99494]: pgmap v438: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-10-18T14:09:17.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.323+0000 7fee48ac6700 1 -- 172.21.15.114:0/3177821716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee44106710 msgr2=0x7fee44106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:17.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.323+0000 7fee48ac6700 1 --2- 172.21.15.114:0/3177821716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee44106710 0x7fee44106af0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fee34009990 tx=0x7fee34009ca0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.324+0000 7fee48ac6700 1 -- 172.21.15.114:0/3177821716 shutdown_connections 2023-10-18T14:09:17.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.324+0000 7fee48ac6700 1 --2- 172.21.15.114:0/3177821716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee441010c0 0x7fee4410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.324+0000 7fee48ac6700 1 --2- 172.21.15.114:0/3177821716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee44106710 0x7fee44106af0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.324+0000 7fee48ac6700 1 --2- 172.21.15.114:0/3177821716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee44100700 0x7fee44100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.324+0000 7fee48ac6700 1 -- 172.21.15.114:0/3177821716 >> 172.21.15.114:0/3177821716 conn(0x7fee440fc1d0 msgr2=0x7fee440fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:17.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.324+0000 7fee48ac6700 1 -- 172.21.15.114:0/3177821716 shutdown_connections 2023-10-18T14:09:17.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.324+0000 7fee48ac6700 1 -- 172.21.15.114:0/3177821716 wait complete. 2023-10-18T14:09:17.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.324+0000 7fee48ac6700 1 Processor -- start 2023-10-18T14:09:17.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.324+0000 7fee48ac6700 1 -- start start 2023-10-18T14:09:17.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee48ac6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee44100700 0x7fee4419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee48ac6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee441010c0 0x7fee4419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee48ac6700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee44106710 0x7fee44196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee48ac6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee44196fb0 con 0x7fee44100700 2023-10-18T14:09:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee48ac6700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee44197120 con 0x7fee44106710 2023-10-18T14:09:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee48ac6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee441972e0 con 0x7fee441010c0 2023-10-18T14:09:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee4259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee44100700 0x7fee4419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee4259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee44100700 0x7fee4419c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46720/0 (socket says 172.21.15.114:46720) 2023-10-18T14:09:17.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee4259c700 1 -- 172.21.15.114:0/708105702 learned_addr learned my addr 172.21.15.114:0/708105702 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:17.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee42d9d700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee44106710 0x7fee44196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee4259c700 1 -- 172.21.15.114:0/708105702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee441010c0 msgr2=0x7fee4419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:17.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee4259c700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee441010c0 0x7fee4419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee4259c700 1 -- 172.21.15.114:0/708105702 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee44106710 msgr2=0x7fee44196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:17.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee4259c700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee44106710 0x7fee44196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee4259c700 1 -- 172.21.15.114:0/708105702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee340095f0 con 0x7fee44100700 2023-10-18T14:09:17.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee42d9d700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee44106710 0x7fee44196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:09:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee4259c700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee44100700 0x7fee4419c820 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fee340098e0 tx=0x7fee3400f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee337fe700 1 -- 172.21.15.114:0/708105702 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3401d070 con 0x7fee44100700 2023-10-18T14:09:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee48ac6700 1 -- 172.21.15.114:0/708105702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee44197560 con 0x7fee44100700 2023-10-18T14:09:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee337fe700 1 -- 172.21.15.114:0/708105702 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee3400fb90 con 0x7fee44100700 2023-10-18T14:09:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee337fe700 1 -- 172.21.15.114:0/708105702 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34017650 con 0x7fee44100700 2023-10-18T14:09:17.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.325+0000 7fee48ac6700 1 -- 172.21.15.114:0/708105702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee441a3810 con 0x7fee44100700 2023-10-18T14:09:17.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.328+0000 7fee337fe700 1 -- 172.21.15.114:0/708105702 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fee3400fd00 con 0x7fee44100700 2023-10-18T14:09:17.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.328+0000 7fee337fe700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fee2c0a15f0 0x7fee2c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.329+0000 7fee337fe700 1 -- 172.21.15.114:0/708105702 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fee340ce1c0 con 0x7fee44100700 2023-10-18T14:09:17.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.329+0000 7fee41d9b700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fee2c0a15f0 0x7fee2c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.329+0000 7fee41d9b700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fee2c0a15f0 0x7fee2c0a3ab0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fee38005950 tx=0x7fee380058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:17.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.329+0000 7fee54cafb80 1 Processor -- start 2023-10-18T14:09:17.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.329+0000 7fee54cafb80 1 -- start start 2023-10-18T14:09:17.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee54cafb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c80fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee54cafb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c81500 0x561937c7b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee54cafb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c7b5d0 0x561937c7ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee54cafb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561937bee6e0 con 0x561937c80be0 2023-10-18T14:09:17.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee54cafb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561937bd4c60 con 0x561937c7b5d0 2023-10-18T14:09:17.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee54cafb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561937bd2580 con 0x561937c81500 2023-10-18T14:09:17.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee4259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c80fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee4259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c80fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46728/0 (socket says 172.21.15.114:46728) 2023-10-18T14:09:17.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee4259c700 1 -- 172.21.15.114:0/3804871414 learned_addr learned my addr 172.21.15.114:0/3804871414 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:17.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee42d9d700 1 --2- 172.21.15.114:0/3804871414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c7b5d0 0x561937c7ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee41d9b700 1 --2- 172.21.15.114:0/3804871414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c81500 0x561937c7b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee4259c700 1 -- 172.21.15.114:0/3804871414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c81500 msgr2=0x561937c7b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:17.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee4259c700 1 --2- 172.21.15.114:0/3804871414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c81500 0x561937c7b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee4259c700 1 -- 172.21.15.114:0/3804871414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c7b5d0 msgr2=0x561937c7ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:17.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee4259c700 1 --2- 172.21.15.114:0/3804871414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c7b5d0 0x561937c7ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee4259c700 1 -- 172.21.15.114:0/3804871414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561937b8b3f0 con 0x561937c80be0 2023-10-18T14:09:17.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee41d9b700 1 --2- 172.21.15.114:0/3804871414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c81500 0x561937c7b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:09:17.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee42d9d700 1 --2- 172.21.15.114:0/3804871414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c7b5d0 0x561937c7ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:09:17.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee4259c700 1 --2- 172.21.15.114:0/3804871414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c80fc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fee34097cc0 tx=0x7fee3409ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b92ed5de7fc851 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:17.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee30ff9700 1 -- 172.21.15.114:0/3804871414 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3409f170 con 0x561937c80be0 2023-10-18T14:09:17.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee30ff9700 1 -- 172.21.15.114:0/3804871414 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee3409b250 con 0x561937c80be0 2023-10-18T14:09:17.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.330+0000 7fee30ff9700 1 -- 172.21.15.114:0/3804871414 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3409a9a0 con 0x561937c80be0 2023-10-18T14:09:17.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.331+0000 7fee54cafb80 1 -- 172.21.15.114:0/3804871414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 msgr2=0x561937c80fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:17.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.331+0000 7fee54cafb80 1 --2- 172.21.15.114:0/3804871414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c80fc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fee34097cc0 tx=0x7fee3409ae80 comp rx=0 tx=0).stop 2023-10-18T14:09:17.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.331+0000 7fee54cafb80 1 -- 172.21.15.114:0/3804871414 shutdown_connections 2023-10-18T14:09:17.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.331+0000 7fee54cafb80 1 --2- 172.21.15.114:0/3804871414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c7b5d0 0x561937c7ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.331+0000 7fee54cafb80 1 --2- 172.21.15.114:0/3804871414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c80fc0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.331+0000 7fee54cafb80 1 --2- 172.21.15.114:0/3804871414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c81500 0x561937c7b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.331+0000 7fee54cafb80 1 -- 172.21.15.114:0/3804871414 >> 172.21.15.114:0/3804871414 conn(0x561937bef720 msgr2=0x561937c75b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:17.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.331+0000 7fee54cafb80 1 -- 172.21.15.114:0/3804871414 shutdown_connections 2023-10-18T14:09:17.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.331+0000 7fee54cafb80 1 -- 172.21.15.114:0/3804871414 wait complete. 2023-10-18T14:09:17.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee54cafb80 1 -- start start 2023-10-18T14:09:17.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee54cafb80 1 Processor -- start 2023-10-18T14:09:17.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee54cafb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c7b5d0 0x561937c84820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee54cafb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c80be0 0x561937c84d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee54cafb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c81500 0x561937c852a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee54cafb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561937bcde70 con 0x561937c81500 2023-10-18T14:09:17.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee54cafb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561937b6a710 con 0x561937c80be0 2023-10-18T14:09:17.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee54cafb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561937b6a3b0 con 0x561937c7b5d0 2023-10-18T14:09:17.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee54cafb80 10 client.0 _ll_register_callbacks cb 0x561937ab4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:09:17.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee42d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c81500 0x561937c852a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee42d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c81500 0x561937c852a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46738/0 (socket says 172.21.15.114:46738) 2023-10-18T14:09:17.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee42d9d700 1 -- 172.21.15.114:0/1329029944 learned_addr learned my addr 172.21.15.114:0/1329029944 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:17.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee41d9b700 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c80be0 0x561937c84d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee4259c700 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c7b5d0 0x561937c84820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee42d9d700 1 -- 172.21.15.114:0/1329029944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c7b5d0 msgr2=0x561937c84820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:17.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee42d9d700 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c7b5d0 0x561937c84820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee42d9d700 1 -- 172.21.15.114:0/1329029944 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c80be0 msgr2=0x561937c84d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:17.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee42d9d700 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c80be0 0x561937c84d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee42d9d700 1 -- 172.21.15.114:0/1329029944 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee441a3810 con 0x561937c81500 2023-10-18T14:09:17.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.332+0000 7fee41d9b700 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c80be0 0x561937c84d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:09:17.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee42d9d700 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c81500 0x561937c852a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fee3c007990 tx=0x7fee3c007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93aad0d0983d70c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:17.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee29ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:09:17.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee29ffb700 1 -- 172.21.15.114:0/1329029944 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c010860 con 0x561937c81500 2023-10-18T14:09:17.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee29ffb700 1 -- 172.21.15.114:0/1329029944 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fee3c0109c0 con 0x561937c81500 2023-10-18T14:09:17.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee54cafb80 1 -- 172.21.15.114:0/1329029944 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561937bd2ef0 con 0x561937c81500 2023-10-18T14:09:17.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee29ffb700 1 -- 172.21.15.114:0/1329029944 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee3c010b80 con 0x561937c81500 2023-10-18T14:09:17.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee54cafb80 10 client.16710 fetch_fsmap learned FSMap version 44 2023-10-18T14:09:17.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee54cafb80 1 -- 172.21.15.114:0/1329029944 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x5619379f8de0 con 0x561937c81500 2023-10-18T14:09:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee29ffb700 1 -- 172.21.15.114:0/1329029944 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561937bd2ef0 con 0x561937c81500 2023-10-18T14:09:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee29ffb700 1 -- 172.21.15.114:0/1329029944 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 44) v1 ==== 7958+0+0 (secure 0 0 0) 0x7fee3c01f400 con 0x561937c81500 2023-10-18T14:09:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee54cafb80 10 client.16710 fetch_fsmap finished waiting for FSMap version 44 2023-10-18T14:09:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee54cafb80 10 client.16710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:09:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee54cafb80 20 client.16710 populate_metadata read hostname 'smithi114' 2023-10-18T14:09:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee54cafb80 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561937c94c80 0x561937c970a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee54cafb80 4 client.16710 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T14:09:17.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.333+0000 7fee54cafb80 1 -- 172.21.15.114:0/1329029944 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561937c4a8b0 con 0x561937c94c80 2023-10-18T14:09:17.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.334+0000 7fee4259c700 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561937c94c80 0x561937c970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.334+0000 7fee29ffb700 10 client.16710 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:09:17.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.334+0000 7fee4259c700 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561937c94c80 0x561937c970a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d3d015f4b56f5cf server_cookie=b2f56b72d0efad00 in_seq=0 out_seq=0 2023-10-18T14:09:17.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.334+0000 7fee29ffb700 1 -- 172.21.15.114:0/1329029944 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561937c4a8b0 con 0x561937c94c80 2023-10-18T14:09:17.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.334+0000 7fee29ffb700 10 client.16710 handle_command_reply: tid=0 2023-10-18T14:09:17.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.335+0000 7fee54cafb80 1 client.16710 shutdown 2023-10-18T14:09:17.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.335+0000 7fee54cafb80 1 -- 172.21.15.114:0/1329029944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c81500 msgr2=0x561937c852a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:17.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.335+0000 7fee54cafb80 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c81500 0x561937c852a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fee3c007990 tx=0x7fee3c007d50 comp rx=0 tx=0).stop 2023-10-18T14:09:17.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.335+0000 7fee54cafb80 1 -- 172.21.15.114:0/1329029944 shutdown_connections 2023-10-18T14:09:17.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.335+0000 7fee54cafb80 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561937c94c80 0x561937c970a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.335+0000 7fee54cafb80 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c81500 0x561937c852a0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.335+0000 7fee54cafb80 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c7b5d0 0x561937c84820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.335+0000 7fee54cafb80 1 --2- 172.21.15.114:0/1329029944 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c80be0 0x561937c84d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.335+0000 7fee54cafb80 1 -- 172.21.15.114:0/1329029944 >> 172.21.15.114:0/1329029944 conn(0x561937bef720 msgr2=0x561937c7a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:17.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.335+0000 7fee29ffb700 0 client.16710 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:09:17.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.335+0000 7fee54cafb80 1 -- 172.21.15.114:0/1329029944 shutdown_connections 2023-10-18T14:09:17.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.335+0000 7fee54cafb80 1 -- 172.21.15.114:0/1329029944 wait complete. 2023-10-18T14:09:17.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.335+0000 7fee54cafb80 20 client.16710 trim_cache size 0 max 16384 2023-10-18T14:09:17.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.347+0000 7fee54cafb80 1 Processor -- start 2023-10-18T14:09:17.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.347+0000 7fee54cafb80 1 -- start start 2023-10-18T14:09:17.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee54cafb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c7b5d0 0x561937c83110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee54cafb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c83650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee54cafb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c81500 0x561937c7e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee54cafb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561937a4e920 con 0x561937c80be0 2023-10-18T14:09:17.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee54cafb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561937c80fc0 con 0x561937c81500 2023-10-18T14:09:17.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee54cafb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561937c7c030 con 0x561937c7b5d0 2023-10-18T14:09:17.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee41d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c83650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee41d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c83650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46744/0 (socket says 172.21.15.114:46744) 2023-10-18T14:09:17.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee41d9b700 1 -- 172.21.15.114:0/568955085 learned_addr learned my addr 172.21.15.114:0/568955085 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:17.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee42d9d700 1 --2- 172.21.15.114:0/568955085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c81500 0x561937c7e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee41d9b700 1 -- 172.21.15.114:0/568955085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c7b5d0 msgr2=0x561937c83110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:17.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee41d9b700 1 --2- 172.21.15.114:0/568955085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c7b5d0 0x561937c83110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee41d9b700 1 -- 172.21.15.114:0/568955085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c81500 msgr2=0x561937c7e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:17.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee41d9b700 1 --2- 172.21.15.114:0/568955085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c81500 0x561937c7e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee41d9b700 1 -- 172.21.15.114:0/568955085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619379e1c60 con 0x561937c80be0 2023-10-18T14:09:17.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee42d9d700 1 --2- 172.21.15.114:0/568955085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c81500 0x561937c7e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:09:17.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee41d9b700 1 --2- 172.21.15.114:0/568955085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c83650 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fee44197b10 tx=0x7fee38010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e469e45936794928 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:17.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee317fa700 1 -- 172.21.15.114:0/568955085 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38010af0 con 0x561937c80be0 2023-10-18T14:09:17.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee317fa700 1 -- 172.21.15.114:0/568955085 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee38010c50 con 0x561937c80be0 2023-10-18T14:09:17.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.348+0000 7fee317fa700 1 -- 172.21.15.114:0/568955085 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3801e650 con 0x561937c80be0 2023-10-18T14:09:17.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.349+0000 7fee54cafb80 1 -- 172.21.15.114:0/568955085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 msgr2=0x561937c83650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:17.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.349+0000 7fee54cafb80 1 --2- 172.21.15.114:0/568955085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c83650 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fee44197b10 tx=0x7fee38010000 comp rx=0 tx=0).stop 2023-10-18T14:09:17.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.349+0000 7fee54cafb80 1 -- 172.21.15.114:0/568955085 shutdown_connections 2023-10-18T14:09:17.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.349+0000 7fee54cafb80 1 --2- 172.21.15.114:0/568955085 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c81500 0x561937c7e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.349+0000 7fee54cafb80 1 --2- 172.21.15.114:0/568955085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c7b5d0 0x561937c83110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.349+0000 7fee54cafb80 1 --2- 172.21.15.114:0/568955085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c83650 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.349+0000 7fee54cafb80 1 -- 172.21.15.114:0/568955085 >> 172.21.15.114:0/568955085 conn(0x561937bef720 msgr2=0x561937c75810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.349+0000 7fee54cafb80 1 -- 172.21.15.114:0/568955085 shutdown_connections 2023-10-18T14:09:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.349+0000 7fee54cafb80 1 -- 172.21.15.114:0/568955085 wait complete. 2023-10-18T14:09:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.349+0000 7fee54cafb80 1 -- start start 2023-10-18T14:09:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.349+0000 7fee54cafb80 1 Processor -- start 2023-10-18T14:09:17.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee54cafb80 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c7b5d0 0x561937c89e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee54cafb80 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c8a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee54cafb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c81500 0x561937ce1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee54cafb80 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561937ce2030 con 0x561937c80be0 2023-10-18T14:09:17.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee54cafb80 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x561937ce21a0 con 0x561937c7b5d0 2023-10-18T14:09:17.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee54cafb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561937ce2360 con 0x561937c81500 2023-10-18T14:09:17.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee54cafb80 10 client.0 _ll_register_callbacks cb 0x561937ab4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T14:09:17.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee41d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c8a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee41d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c8a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46750/0 (socket says 172.21.15.114:46750) 2023-10-18T14:09:17.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee41d9b700 1 -- 172.21.15.114:0/105466251 learned_addr learned my addr 172.21.15.114:0/105466251 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:09:17.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee4259c700 1 --2- 172.21.15.114:0/105466251 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c7b5d0 0x561937c89e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee41d9b700 1 -- 172.21.15.114:0/105466251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c81500 msgr2=0x561937ce1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:17.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee41d9b700 1 --2- 172.21.15.114:0/105466251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c81500 0x561937ce1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee41d9b700 1 -- 172.21.15.114:0/105466251 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c7b5d0 msgr2=0x561937c89e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T14:09:17.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee41d9b700 1 --2- 172.21.15.114:0/105466251 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c7b5d0 0x561937c89e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee41d9b700 1 -- 172.21.15.114:0/105466251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3800d8c0 con 0x561937c80be0 2023-10-18T14:09:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee4259c700 1 --2- 172.21.15.114:0/105466251 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c7b5d0 0x561937c89e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:09:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee41d9b700 1 --2- 172.21.15.114:0/105466251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c8a360 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fee3800e010 tx=0x7fee38010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb044f33e405e38 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:09:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee29ffb700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T14:09:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee29ffb700 1 -- 172.21.15.114:0/105466251 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee380266c0 con 0x561937c80be0 2023-10-18T14:09:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee29ffb700 1 -- 172.21.15.114:0/105466251 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8397+0+0 (secure 0 0 0) 0x7fee38026820 con 0x561937c80be0 2023-10-18T14:09:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee54cafb80 1 -- 172.21.15.114:0/105466251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee3409b250 con 0x561937c80be0 2023-10-18T14:09:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee29ffb700 1 -- 172.21.15.114:0/105466251 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee3803b430 con 0x561937c80be0 2023-10-18T14:09:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee54cafb80 10 client.16716 fetch_fsmap learned FSMap version 44 2023-10-18T14:09:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.350+0000 7fee54cafb80 1 -- 172.21.15.114:0/105466251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x561937a1f250 con 0x561937c80be0 2023-10-18T14:09:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.351+0000 7fee29ffb700 1 -- 172.21.15.114:0/105466251 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee3803f020 con 0x561937c80be0 2023-10-18T14:09:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.351+0000 7fee29ffb700 1 -- 172.21.15.114:0/105466251 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 44) v1 ==== 7958+0+0 (secure 0 0 0) 0x7fee38024020 con 0x561937c80be0 2023-10-18T14:09:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.351+0000 7fee54cafb80 10 client.16716 fetch_fsmap finished waiting for FSMap version 44 2023-10-18T14:09:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.351+0000 7fee54cafb80 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-18T14:09:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.351+0000 7fee54cafb80 20 client.16716 populate_metadata read hostname 'smithi114' 2023-10-18T14:09:17.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.351+0000 7fee54cafb80 1 --2- 172.21.15.114:0/105466251 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561937ce9ab0 0x561937cebed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:09:17.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.351+0000 7fee54cafb80 4 client.16716 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-18T14:09:17.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.351+0000 7fee54cafb80 1 -- 172.21.15.114:0/105466251 --> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561937bc6e50 con 0x561937ce9ab0 2023-10-18T14:09:17.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.351+0000 7fee4259c700 1 --2- 172.21.15.114:0/105466251 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561937ce9ab0 0x561937cebed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:09:17.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee29ffb700 10 client.16716 ms_handle_connect on v2:172.21.15.172:6838/2447269366 2023-10-18T14:09:17.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee4259c700 1 --2- 172.21.15.114:0/105466251 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561937ce9ab0 0x561937cebed0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3cd2c1ed6e51186 server_cookie=cf85e8fb82f1708e in_seq=0 out_seq=0 2023-10-18T14:09:17.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee29ffb700 1 -- 172.21.15.114:0/105466251 <== mds.0 v2:172.21.15.172:6838/2447269366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561937bc6e50 con 0x561937ce9ab0 2023-10-18T14:09:17.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee29ffb700 10 client.16716 handle_command_reply: tid=0 2023-10-18T14:09:17.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee54cafb80 1 client.16716 shutdown 2023-10-18T14:09:17.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee54cafb80 1 -- 172.21.15.114:0/105466251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 msgr2=0x561937c8a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:17.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee54cafb80 1 --2- 172.21.15.114:0/105466251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c8a360 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fee3800e010 tx=0x7fee38010bd0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee54cafb80 1 -- 172.21.15.114:0/105466251 shutdown_connections 2023-10-18T14:09:17.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee54cafb80 1 --2- 172.21.15.114:0/105466251 >> [v2:172.21.15.172:6838/2447269366,v1:172.21.15.172:6839/2447269366] conn(0x561937ce9ab0 0x561937cebed0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee54cafb80 1 --2- 172.21.15.114:0/105466251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561937c81500 0x561937ce1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee54cafb80 1 --2- 172.21.15.114:0/105466251 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x561937c7b5d0 0x561937c89e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee29ffb700 0 client.16716 ms_handle_reset on v2:172.21.15.172:6838/2447269366 2023-10-18T14:09:17.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee54cafb80 1 --2- 172.21.15.114:0/105466251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x561937c80be0 0x561937c8a360 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee54cafb80 1 -- 172.21.15.114:0/105466251 >> 172.21.15.114:0/105466251 conn(0x561937bef720 msgr2=0x561937c83080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:17.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee54cafb80 1 -- 172.21.15.114:0/105466251 shutdown_connections 2023-10-18T14:09:17.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee54cafb80 1 -- 172.21.15.114:0/105466251 wait complete. 2023-10-18T14:09:17.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee54cafb80 20 client.16716 trim_cache size 0 max 16384 2023-10-18T14:09:17.383 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2023-10-18T14:09:17.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee48ac6700 1 -- 172.21.15.114:0/708105702 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fee2c0a15f0 msgr2=0x7fee2c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:17.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee48ac6700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fee2c0a15f0 0x7fee2c0a3ab0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fee38005950 tx=0x7fee380058e0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee48ac6700 1 -- 172.21.15.114:0/708105702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee44100700 msgr2=0x7fee4419c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:09:17.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.352+0000 7fee48ac6700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee44100700 0x7fee4419c820 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fee340098e0 tx=0x7fee3400f720 comp rx=0 tx=0).stop 2023-10-18T14:09:17.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.353+0000 7fee48ac6700 1 -- 172.21.15.114:0/708105702 shutdown_connections 2023-10-18T14:09:17.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.353+0000 7fee48ac6700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fee2c0a15f0 0x7fee2c0a3ab0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.353+0000 7fee48ac6700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fee44106710 0x7fee44196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.353+0000 7fee48ac6700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee44100700 0x7fee4419c820 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.353+0000 7fee48ac6700 1 --2- 172.21.15.114:0/708105702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee441010c0 0x7fee4419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:09:17.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.353+0000 7fee48ac6700 1 -- 172.21.15.114:0/708105702 >> 172.21.15.114:0/708105702 conn(0x7fee440fc1d0 msgr2=0x7fee440fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:09:17.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.353+0000 7fee48ac6700 1 -- 172.21.15.114:0/708105702 shutdown_connections 2023-10-18T14:09:17.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:09:17.353+0000 7fee48ac6700 1 -- 172.21.15.114:0/708105702 wait complete. 2023-10-18T14:09:17.388 ERROR:tasks.fwd_scrub:rank 4 damaged: [{'damage_type': 'backtrace', 'id': 5194099, 'ino': 1099511631706, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/511.out'}, {'damage_type': 'backtrace', 'id': 15379541, 'ino': 1099511631573, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/444.out'}, {'damage_type': 'backtrace', 'id': 24745406, 'ino': 1099511630023, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/314.out'}, {'damage_type': 'backtrace', 'id': 35548548, 'ino': 1099511631401, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/358.out'}, {'damage_type': 'backtrace', 'id': 41703135, 'ino': 1099511631238, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/277.out'}, {'damage_type': 'backtrace', 'id': 58194184, 'ino': 1099511632650, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/286'}, {'damage_type': 'backtrace', 'id': 66190420, 'ino': 1099511632602, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/238'}, {'damage_type': 'backtrace', 'id': 97672317, 'ino': 1099511632486, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/127'}, {'damage_type': 'backtrace', 'id': 106682814, 'ino': 1099511628433, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/305.out'}, {'damage_type': 'backtrace', 'id': 116184688, 'ino': 1099511631475, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/395.out'}, {'damage_type': 'backtrace', 'id': 117604627, 'ino': 1099511631236, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/276.out'}, {'damage_type': 'backtrace', 'id': 122675859, 'ino': 1099511631034, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/181.out'}, {'damage_type': 'backtrace', 'id': 130767515, 'ino': 1099511631374, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/345.out'}, {'damage_type': 'backtrace', 'id': 131817381, 'ino': 1099511628706, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/126.out'}, {'damage_type': 'backtrace', 'id': 133472476, 'ino': 1099511631591, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/453.out'}, {'damage_type': 'backtrace', 'id': 135115736, 'ino': 1099511628449, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/003.out'}, {'damage_type': 'backtrace', 'id': 143032561, 'ino': 1099511631352, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/334.out'}, {'damage_type': 'backtrace', 'id': 151010142, 'ino': 1099511631637, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/476.out'}, {'damage_type': 'backtrace', 'id': 153675479, 'ino': 1099511628351, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/024.out'}, {'damage_type': 'backtrace', 'id': 164431962, 'ino': 1099511630047, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/326.out'}, {'damage_type': 'backtrace', 'id': 229347142, 'ino': 1099511632391, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/049'}, {'damage_type': 'backtrace', 'id': 260419294, 'ino': 1099511631553, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/434.out'}, {'damage_type': 'backtrace', 'id': 265297887, 'ino': 1099511632415, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/058'}, {'damage_type': 'backtrace', 'id': 269017621, 'ino': 1099511629993, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/299.out'}, {'damage_type': 'backtrace', 'id': 271337472, 'ino': 1099511632943, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/336'}, {'damage_type': 'backtrace', 'id': 277554283, 'ino': 1099511633164, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/542'}, {'damage_type': 'backtrace', 'id': 279311230, 'ino': 1099511630079, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/554.out'}, {'damage_type': 'backtrace', 'id': 283802522, 'ino': 1099511633131, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/510'}, {'damage_type': 'backtrace', 'id': 303903949, 'ino': 1099511630922, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/125.out'}, {'damage_type': 'backtrace', 'id': 309721522, 'ino': 1099511631316, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/316.out'}, {'damage_type': 'backtrace', 'id': 311106094, 'ino': 1099511628487, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/022.out'}, {'damage_type': 'backtrace', 'id': 319973604, 'ino': 1099511631172, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/244.out'}, {'damage_type': 'backtrace', 'id': 356742260, 'ino': 1099511631684, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/500.out'}, {'damage_type': 'backtrace', 'id': 366627470, 'ino': 1099511632558, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/195'}, {'damage_type': 'backtrace', 'id': 367442426, 'ino': 1099511632968, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/359'}, {'damage_type': 'backtrace', 'id': 391008305, 'ino': 1099511629158, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/477.out'}, {'damage_type': 'backtrace', 'id': 395472320, 'ino': 1099511632988, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/377'}, {'damage_type': 'backtrace', 'id': 397390657, 'ino': 1099511633072, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/455'}, {'damage_type': 'backtrace', 'id': 399973646, 'ino': 1099511632554, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/191'}, {'damage_type': 'backtrace', 'id': 400539427, 'ino': 1099511629144, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/470.out'}, {'damage_type': 'backtrace', 'id': 415674261, 'ino': 1099511629112, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/454.out'}, {'damage_type': 'backtrace', 'id': 433663705, 'ino': 1099511629965, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/285.out'}, {'damage_type': 'backtrace', 'id': 443690343, 'ino': 1099511628902, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/349.out'}, {'damage_type': 'backtrace', 'id': 457041475, 'ino': 1099511631346, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/331.out'}, {'damage_type': 'backtrace', 'id': 459908076, 'ino': 1099511631378, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/347.out'}, {'damage_type': 'backtrace', 'id': 468893487, 'ino': 1099511633016, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/404'}, {'damage_type': 'backtrace', 'id': 480945935, 'ino': 1099511631599, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/457.out'}, {'damage_type': 'backtrace', 'id': 487947058, 'ino': 1099511631649, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/482.out'}, {'damage_type': 'backtrace', 'id': 490207651, 'ino': 1099511629090, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/443.out'}, {'damage_type': 'backtrace', 'id': 520292411, 'ino': 1099511631615, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/465.out'}, {'damage_type': 'backtrace', 'id': 521662858, 'ino': 1099511631603, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/459.out'}, {'damage_type': 'backtrace', 'id': 571005504, 'ino': 1099511630798, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/067.out'}, {'damage_type': 'backtrace', 'id': 581284538, 'ino': 1099511628874, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/335.out'}, {'damage_type': 'backtrace', 'id': 592831098, 'ino': 1099511629210, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/503.out'}, {'damage_type': 'backtrace', 'id': 607653522, 'ino': 1099511630792, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/064.out'}, {'damage_type': 'backtrace', 'id': 618545236, 'ino': 1099511629236, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/516.out'}, {'damage_type': 'backtrace', 'id': 638345652, 'ino': 1099511632369, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/030.out'}, {'damage_type': 'backtrace', 'id': 690123381, 'ino': 1099511630938, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/133.out'}, {'damage_type': 'backtrace', 'id': 696257643, 'ino': 1099511631214, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/265.out'}, {'damage_type': 'backtrace', 'id': 701130355, 'ino': 1099511629889, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/247.out'}, {'damage_type': 'backtrace', 'id': 709125886, 'ino': 1099511632983, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/373.out'}, {'damage_type': 'backtrace', 'id': 709747368, 'ino': 1099511632579, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/215'}, {'damage_type': 'backtrace', 'id': 725756796, 'ino': 1099511632383, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/041'}, {'damage_type': 'backtrace', 'id': 782079720, 'ino': 1099511631561, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/438.out'}, {'damage_type': 'backtrace', 'id': 784086821, 'ino': 1099511631601, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/458.out'}, {'damage_type': 'backtrace', 'id': 789110480, 'ino': 1099511631405, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/360.out'}, {'damage_type': 'backtrace', 'id': 799266497, 'ino': 1099511628768, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/157.out'}, {'damage_type': 'backtrace', 'id': 807849490, 'ino': 1099511628982, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/389.out'}, {'damage_type': 'backtrace', 'id': 823520534, 'ino': 1099511631326, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/321.out'}, {'damage_type': 'backtrace', 'id': 830160152, 'ino': 1099511632473, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/114'}, {'damage_type': 'backtrace', 'id': 834223673, 'ino': 1099511631166, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/241.out'}, {'damage_type': 'backtrace', 'id': 851748622, 'ino': 1099511628553, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.nojournal'}, {'damage_type': 'backtrace', 'id': 884970421, 'ino': 1099511631519, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/417.out'}, {'damage_type': 'backtrace', 'id': 890653585, 'ino': 1099511628868, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/332.out'}, {'damage_type': 'backtrace', 'id': 892571780, 'ino': 1099511632952, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/345'}, {'damage_type': 'backtrace', 'id': 893227871, 'ino': 1099511628551, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.cfg'}, {'damage_type': 'backtrace', 'id': 910331455, 'ino': 1099511631645, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/480.out'}, {'damage_type': 'backtrace', 'id': 924811554, 'ino': 1099511628323, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/010.out'}, {'damage_type': 'backtrace', 'id': 936940106, 'ino': 1099511632331, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/307'}, {'damage_type': 'backtrace', 'id': 944101427, 'ino': 1099511630071, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/550.out'}, {'damage_type': 'backtrace', 'id': 950716093, 'ino': 1099511632590, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/226'}, {'damage_type': 'backtrace', 'id': 997939441, 'ino': 1099511631511, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/413.out'}, {'damage_type': 'backtrace', 'id': 1008312425, 'ino': 1099511630668, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/003.out'}, {'damage_type': 'backtrace', 'id': 1047205289, 'ino': 1099511628884, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/340.out'}, {'damage_type': 'backtrace', 'id': 1047325037, 'ino': 1099511631698, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/507.out'}, {'damage_type': 'backtrace', 'id': 1078574817, 'ino': 1099511633173, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/551'}, {'damage_type': 'backtrace', 'id': 1087736557, 'ino': 1099511631240, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/278.out'}, {'damage_type': 'backtrace', 'id': 1089115581, 'ino': 1099511631609, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/462.out'}, {'damage_type': 'backtrace', 'id': 1103675912, 'ino': 1099511632957, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/350'}, {'damage_type': 'backtrace', 'id': 1150984856, 'ino': 1099511629834, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/193.out'}, {'damage_type': 'backtrace', 'id': 1164301765, 'ino': 1099511632341, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/005'}, {'damage_type': 'backtrace', 'id': 1166616487, 'ino': 1099511628517, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/036.out'}, {'damage_type': 'backtrace', 'id': 1182557407, 'ino': 1099511629885, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/245.out'}, {'damage_type': 'backtrace', 'id': 1193352819, 'ino': 1099511631290, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/303.out'}, {'damage_type': 'backtrace', 'id': 1195441342, 'ino': 1099511632626, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/262'}, {'damage_type': 'backtrace', 'id': 1223164286, 'ino': 1099511632385, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/043'}, {'damage_type': 'backtrace', 'id': 1233954801, 'ino': 1099511633003, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/392'}, {'damage_type': 'backtrace', 'id': 1241585199, 'ino': 1099511630738, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/037.out'}, {'damage_type': 'backtrace', 'id': 1266190664, 'ino': 1099511628353, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/025.out'}, {'damage_type': 'backtrace', 'id': 1269802364, 'ino': 1099511630924, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/126.out'}, {'damage_type': 'backtrace', 'id': 1281192578, 'ino': 1099511633091, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/473'}, {'damage_type': 'backtrace', 'id': 1289460414, 'ino': 1099511629857, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/231.out'}, {'damage_type': 'backtrace', 'id': 1299177162, 'ino': 1099511631583, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/449.out'}, {'damage_type': 'backtrace', 'id': 1303565943, 'ino': 1099511633048, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/433'}, {'damage_type': 'backtrace', 'id': 1315839230, 'ino': 1099511633105, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/486'}, {'damage_type': 'backtrace', 'id': 1316753218, 'ino': 1099511631122, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/224.out'}, {'damage_type': 'backtrace', 'id': 1329764628, 'ino': 1099511628387, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/042.out'}, {'damage_type': 'backtrace', 'id': 1333668470, 'ino': 1099511633199, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/574'}, {'damage_type': 'backtrace', 'id': 1337631038, 'ino': 1099511628495, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/026.out'}, {'damage_type': 'backtrace', 'id': 1369847155, 'ino': 1099511631483, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/399.out'}, {'damage_type': 'backtrace', 'id': 1396705600, 'ino': 1099511628582, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/064.out'}, {'damage_type': 'backtrace', 'id': 1397438310, 'ino': 1099511628764, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/155.out'}, {'damage_type': 'backtrace', 'id': 1426738571, 'ino': 1099511631368, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/342.out'}, {'damage_type': 'backtrace', 'id': 1446749830, 'ino': 1099511629238, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/517.out'}, {'damage_type': 'backtrace', 'id': 1458136358, 'ino': 1099511631084, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/206.out'}, {'damage_type': 'backtrace', 'id': 1471473685, 'ino': 1099511632476, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/117'}, {'damage_type': 'backtrace', 'id': 1472854248, 'ino': 1099511633183, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/560'}, {'damage_type': 'backtrace', 'id': 1485282168, 'ino': 1099511629955, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/280.out'}, {'damage_type': 'backtrace', 'id': 1492570182, 'ino': 1099511628906, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/351.out'}, {'damage_type': 'backtrace', 'id': 1524183052, 'ino': 1099511633066, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/449'}, {'damage_type': 'backtrace', 'id': 1539415744, 'ino': 1099511630055, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/542.out'}, {'damage_type': 'backtrace', 'id': 1566152874, 'ino': 1099511628331, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/014.out'}, {'damage_type': 'backtrace', 'id': 1600000303, 'ino': 1099511633668, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/013'}, {'damage_type': 'backtrace', 'id': 1606824728, 'ino': 1099511632550, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/187'}, {'damage_type': 'backtrace', 'id': 1625041487, 'ino': 1099511629810, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/181.out'}, {'damage_type': 'backtrace', 'id': 1631136957, 'ino': 1099511631563, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/439.out'}, {'damage_type': 'backtrace', 'id': 1662586494, 'ino': 1099511630898, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/113.out'}, {'damage_type': 'backtrace', 'id': 1662718221, 'ino': 1099511630762, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/049.out'}, {'damage_type': 'backtrace', 'id': 1668494947, 'ino': 1099511633223, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/group'}, {'damage_type': 'backtrace', 'id': 1683434201, 'ino': 1099511632980, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/371'}, {'damage_type': 'backtrace', 'id': 1701158617, 'ino': 1099511629863, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/234.out'}, {'damage_type': 'backtrace', 'id': 1709129704, 'ino': 1099511633061, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/444'}, {'damage_type': 'backtrace', 'id': 1719352296, 'ino': 1099511632358, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/021'}, {'damage_type': 'backtrace', 'id': 1733553831, 'ino': 1099511632605, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/241'}, {'damage_type': 'backtrace', 'id': 1736800153, 'ino': 1099511628634, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/090.out'}, {'damage_type': 'backtrace', 'id': 1744398113, 'ino': 1099511628710, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/128.out'}, {'damage_type': 'backtrace', 'id': 1786456743, 'ino': 1099511629907, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/256.out'}, {'damage_type': 'backtrace', 'id': 1817024330, 'ino': 1099511631419, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/367.out'}, {'damage_type': 'backtrace', 'id': 1821877797, 'ino': 1099511629925, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/265.out'}, {'damage_type': 'backtrace', 'id': 1830253779, 'ino': 1099511629204, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/500.out'}, {'damage_type': 'backtrace', 'id': 1847337244, 'ino': 1099511632416, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/059'}, {'damage_type': 'backtrace', 'id': 1864153373, 'ino': 1099511628798, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/172.out'}, {'damage_type': 'backtrace', 'id': 1878339735, 'ino': 1099511631230, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/273.out'}, {'damage_type': 'backtrace', 'id': 1890627922, 'ino': 1099511632494, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/135'}, {'damage_type': 'backtrace', 'id': 1894090080, 'ino': 1099511633658, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/004'}, {'damage_type': 'backtrace', 'id': 1907395105, 'ino': 1099511633174, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/552'}, {'damage_type': 'backtrace', 'id': 1935968395, 'ino': 1099511631114, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/220.out'}, {'damage_type': 'backtrace', 'id': 1946990466, 'ino': 1099511632517, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/155'}, {'damage_type': 'backtrace', 'id': 1953580334, 'ino': 1099511631423, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/369.out'}, {'damage_type': 'backtrace', 'id': 1979509321, 'ino': 1099511631692, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/504.out'}, {'damage_type': 'backtrace', 'id': 1983002663, 'ino': 1099511633215, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/587'}, {'damage_type': 'backtrace', 'id': 2005128350, 'ino': 1099511628493, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/025.out'}, {'damage_type': 'backtrace', 'id': 2024369581, 'ino': 1099511631140, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/233.out'}, {'damage_type': 'backtrace', 'id': 2065458992, 'ino': 1099511632644, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/280'}, {'damage_type': 'backtrace', 'id': 2065598368, 'ino': 1099511632655, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/291'}, {'damage_type': 'backtrace', 'id': 2077286542, 'ino': 1099511633000, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/389'}, {'damage_type': 'backtrace', 'id': 2087223874, 'ino': 1099511631030, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/179.out'}, {'damage_type': 'backtrace', 'id': 2088212297, 'ino': 1099511629909, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/257.out'}, {'damage_type': 'backtrace', 'id': 2088467595, 'ino': 1099511630095, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/562.out'}, {'damage_type': 'backtrace', 'id': 2104384892, 'ino': 1099511633117, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/497'}, {'damage_type': 'backtrace', 'id': 2121643353, 'ino': 1099511632974, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/365'}, {'damage_type': 'backtrace', 'id': 2122070980, 'ino': 1099511628892, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/344.out'}, {'damage_type': 'backtrace', 'id': 2142640611, 'ino': 1099511632996, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/385'}, {'damage_type': 'backtrace', 'id': 2145515372, 'ino': 1099511628521, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/038.out'}, {'damage_type': 'backtrace', 'id': 2145960409, 'ino': 1099511631278, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/297.out'}, {'damage_type': 'backtrace', 'id': 2146818463, 'ino': 1099511632307, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/026'}, {'damage_type': 'backtrace', 'id': 2160576633, 'ino': 1099511628523, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/039.out'}, {'damage_type': 'backtrace', 'id': 2168582016, 'ino': 1099511631631, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/473.out'}, {'damage_type': 'backtrace', 'id': 2183468452, 'ino': 1099511631660, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/488.out'}, {'damage_type': 'backtrace', 'id': 2230754665, 'ino': 1099511632927, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/320'}, {'damage_type': 'backtrace', 'id': 2362046734, 'ino': 1099511631569, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/442.out'}, {'damage_type': 'backtrace', 'id': 2362113054, 'ino': 1099511632428, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/071'}, {'damage_type': 'backtrace', 'id': 2365776388, 'ino': 1099511632360, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/023'}, {'damage_type': 'backtrace', 'id': 2401771678, 'ino': 1099511631465, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/390.out'}, {'damage_type': 'backtrace', 'id': 2421819654, 'ino': 1099511629838, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/195.out'}, {'damage_type': 'backtrace', 'id': 2484360527, 'ino': 1099511632535, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/173'}, {'damage_type': 'backtrace', 'id': 2519791515, 'ino': 1099511629040, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/418.out'}, {'damage_type': 'backtrace', 'id': 2524150972, 'ino': 1099511628349, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/023.out'}, {'damage_type': 'backtrace', 'id': 2551884383, 'ino': 1099511633093, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/475'}, {'damage_type': 'backtrace', 'id': 2571108685, 'ino': 1099511631495, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/405.out'}, {'damage_type': 'backtrace', 'id': 2572163541, 'ino': 1099511631415, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/365.out'}, {'damage_type': 'backtrace', 'id': 2574237359, 'ino': 1099511629056, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/426.out'}, {'damage_type': 'backtrace', 'id': 2575666247, 'ino': 1099511630870, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/102.out'}, {'damage_type': 'backtrace', 'id': 2578238804, 'ino': 1099511631266, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/291.out'}, {'damage_type': 'backtrace', 'id': 2587617284, 'ino': 1099511631639, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/477.out'}, {'damage_type': 'backtrace', 'id': 2589401833, 'ino': 1099511633168, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/546'}, {'damage_type': 'backtrace', 'id': 2601256414, 'ino': 1099511630930, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/129.out'}, {'damage_type': 'backtrace', 'id': 2613212479, 'ino': 1099511633204, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/577'}, {'damage_type': 'backtrace', 'id': 2630499848, 'ino': 1099511629899, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/252.out'}, {'damage_type': 'backtrace', 'id': 2630728693, 'ino': 1099511630946, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/137.out'}, {'damage_type': 'backtrace', 'id': 2632569568, 'ino': 1099511631643, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/479.out'}, {'damage_type': 'backtrace', 'id': 2658470214, 'ino': 1099511631198, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/257.out'}, {'damage_type': 'backtrace', 'id': 2661361341, 'ino': 1099511632492, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/133'}, {'damage_type': 'backtrace', 'id': 2678338872, 'ino': 1099511628475, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/016.out'}, {'damage_type': 'backtrace', 'id': 2694788771, 'ino': 1099511630758, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/047.out'}, {'damage_type': 'backtrace', 'id': 2723167423, 'ino': 1099511631581, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/448.out'}, {'damage_type': 'backtrace', 'id': 2734412377, 'ino': 1099511631593, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/454.out'}, {'damage_type': 'backtrace', 'id': 2737901983, 'ino': 1099511632937, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/330'}, {'damage_type': 'backtrace', 'id': 2744665561, 'ino': 1099511630784, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/060.out'}, {'damage_type': 'backtrace', 'id': 2746082769, 'ino': 1099511628654, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/100.out'}, {'damage_type': 'backtrace', 'id': 2757056338, 'ino': 1099511630053, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/541.out'}, {'damage_type': 'backtrace', 'id': 2809591966, 'ino': 1099511631678, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/497.out'}, {'damage_type': 'backtrace', 'id': 2815642410, 'ino': 1099511632540, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/178'}, {'damage_type': 'backtrace', 'id': 2842664148, 'ino': 1099511632546, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/184'}, {'damage_type': 'backtrace', 'id': 2846783183, 'ino': 1099511631559, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/437.out'}, {'damage_type': 'backtrace', 'id': 2868719160, 'ino': 1099511633011, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/399'}, {'damage_type': 'backtrace', 'id': 2895888410, 'ino': 1099511633660, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/006'}, {'damage_type': 'backtrace', 'id': 2907392024, 'ino': 1099511630942, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/135.out'}, {'damage_type': 'backtrace', 'id': 2923719121, 'ino': 1099511631312, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/314.out'}, {'damage_type': 'backtrace', 'id': 2936877571, 'ino': 1099511632296, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/015'}, {'damage_type': 'backtrace', 'id': 2943784009, 'ino': 1099511631543, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/429.out'}, {'damage_type': 'backtrace', 'id': 2949348452, 'ino': 1099511632609, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/245'}, {'damage_type': 'backtrace', 'id': 2952535774, 'ino': 1099511628758, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/152.out'}, {'damage_type': 'backtrace', 'id': 2953696650, 'ino': 1099511632536, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/174'}, {'damage_type': 'backtrace', 'id': 2958575812, 'ino': 1099511632375, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/033.out'}, {'damage_type': 'backtrace', 'id': 2982010694, 'ino': 1099511633020, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/407'}, {'damage_type': 'backtrace', 'id': 2987088304, 'ino': 1099511631010, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/169.out'}, {'damage_type': 'backtrace', 'id': 3008846405, 'ino': 1099511628467, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/012.out'}, {'damage_type': 'backtrace', 'id': 3011995340, 'ino': 1099511630780, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/058.out'}, {'damage_type': 'backtrace', 'id': 3026736397, 'ino': 1099511632470, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/111'}, {'damage_type': 'backtrace', 'id': 3043435295, 'ino': 1099511630686, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/012.out'}, {'damage_type': 'backtrace', 'id': 3044547716, 'ino': 1099511631619, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/467.out'}, {'damage_type': 'backtrace', 'id': 3058384019, 'ino': 1099511629018, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/407.out'}, {'damage_type': 'backtrace', 'id': 3061011205, 'ino': 1099511631651, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/483.out'}, {'damage_type': 'backtrace', 'id': 3098536813, 'ino': 1099511632923, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/316'}, {'damage_type': 'backtrace', 'id': 3113455432, 'ino': 1099511629828, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/190.out'}, {'damage_type': 'backtrace', 'id': 3115950571, 'ino': 1099511633212, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/584'}, {'damage_type': 'backtrace', 'id': 3157317539, 'ino': 1099511628776, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/161.out'}, {'damage_type': 'backtrace', 'id': 3191307101, 'ino': 1099511629046, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/421.out'}, {'damage_type': 'backtrace', 'id': 3198943125, 'ino': 1099511630772, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/054.out'}, {'damage_type': 'backtrace', 'id': 3201373789, 'ino': 1099511629903, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/254.out'}, {'damage_type': 'backtrace', 'id': 3205641002, 'ino': 1099511633001, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/390'}, {'damage_type': 'backtrace', 'id': 3215666497, 'ino': 1099511629800, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/176.out'}, {'damage_type': 'backtrace', 'id': 3224229736, 'ino': 1099511632409, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/052'}, {'damage_type': 'backtrace', 'id': 3229190985, 'ino': 1099511632930, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/323'}, {'damage_type': 'backtrace', 'id': 3238268925, 'ino': 1099511631547, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/431.out'}, {'damage_type': 'backtrace', 'id': 3264735352, 'ino': 1099511628762, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/154.out'}, {'damage_type': 'backtrace', 'id': 3269289872, 'ino': 1099511633119, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/499'}, {'damage_type': 'backtrace', 'id': 3311162202, 'ino': 1099511633200, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/574.out'}, {'damage_type': 'backtrace', 'id': 3312472010, 'ino': 1099511628429, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/303.out'}, {'damage_type': 'backtrace', 'id': 3351386203, 'ino': 1099511628355, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/026.out'}, {'damage_type': 'backtrace', 'id': 3368140561, 'ino': 1099511632906, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/299'}, {'damage_type': 'backtrace', 'id': 3382457269, 'ino': 1099511629846, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/199.out'}, {'damage_type': 'backtrace', 'id': 3383533454, 'ino': 1099511633221, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/592'}, {'damage_type': 'backtrace', 'id': 3397157284, 'ino': 1099511632343, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/007'}, {'damage_type': 'backtrace', 'id': 3417892660, 'ino': 1099511629280, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/538.out'}, {'damage_type': 'backtrace', 'id': 3452859122, 'ino': 1099511632497, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/138'}, {'damage_type': 'backtrace', 'id': 3465445193, 'ino': 1099511632941, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/334'}, {'damage_type': 'backtrace', 'id': 3466458673, 'ino': 1099511632475, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/116'}, {'damage_type': 'backtrace', 'id': 3474247112, 'ino': 1099511628825, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/211.out'}, {'damage_type': 'backtrace', 'id': 3484341660, 'ino': 1099511631555, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/435.out'}, {'damage_type': 'backtrace', 'id': 3527284573, 'ino': 1099511630835, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/085.out'}, {'damage_type': 'backtrace', 'id': 3530685828, 'ino': 1099511629118, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/457.out'}, {'damage_type': 'backtrace', 'id': 3538040980, 'ino': 1099511629034, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/415.out'}, {'damage_type': 'backtrace', 'id': 3543828167, 'ino': 1099511631658, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/487.out'}, {'damage_type': 'backtrace', 'id': 3584681604, 'ino': 1099511628772, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/159.out'}, {'damage_type': 'backtrace', 'id': 3591743627, 'ino': 1099511629919, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/262.out'}, {'damage_type': 'backtrace', 'id': 3593754049, 'ino': 1099511633132, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/511'}, {'damage_type': 'backtrace', 'id': 3607602210, 'ino': 1099511632898, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/001'}, {'damage_type': 'backtrace', 'id': 3611434023, 'ino': 1099511632604, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/240'}, {'damage_type': 'backtrace', 'id': 3625789921, 'ino': 1099511630075, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/552.out'}, {'damage_type': 'backtrace', 'id': 3657485554, 'ino': 1099511631517, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/416.out'}, {'damage_type': 'backtrace', 'id': 3659783065, 'ino': 1099511632518, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/156'}, {'damage_type': 'backtrace', 'id': 3664936527, 'ino': 1099511629002, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/399.out'}, {'damage_type': 'backtrace', 'id': 3679620684, 'ino': 1099511630857, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/096.out.external'}, {'damage_type': 'backtrace', 'id': 3691959405, 'ino': 1099511632630, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/266'}, {'damage_type': 'backtrace', 'id': 3704223249, 'ino': 1099511631676, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/496.out'}, {'damage_type': 'backtrace', 'id': 3706319889, 'ino': 1099511630908, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/118.out'}, {'damage_type': 'backtrace', 'id': 3746550706, 'ino': 1099511632294, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/013'}, {'damage_type': 'backtrace', 'id': 3787431705, 'ino': 1099511628437, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/307.out'}, {'damage_type': 'backtrace', 'id': 3789607320, 'ino': 1099511632432, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/075'}, {'damage_type': 'backtrace', 'id': 3836270176, 'ino': 1099511632521, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/159'}, {'damage_type': 'backtrace', 'id': 3899005886, 'ino': 1099511630796, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/066.out'}, {'damage_type': 'backtrace', 'id': 3918424604, 'ino': 1099511631533, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/424.out'}, {'damage_type': 'backtrace', 'id': 3925646377, 'ino': 1099511631686, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/501.out'}, {'damage_type': 'backtrace', 'id': 3933645815, 'ino': 1099511630017, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/311.out'}, {'damage_type': 'backtrace', 'id': 3946925241, 'ino': 1099511632290, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/009'}, {'damage_type': 'backtrace', 'id': 3955526492, 'ino': 1099511629893, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/249.out'}, {'damage_type': 'backtrace', 'id': 4009572761, 'ino': 1099511629082, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/439.out'}, {'damage_type': 'backtrace', 'id': 4016903055, 'ino': 1099511631000, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/164.out'}, {'damage_type': 'backtrace', 'id': 4031059803, 'ino': 1099511631330, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/323.out'}, {'damage_type': 'backtrace', 'id': 4063014984, 'ino': 1099511628656, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/101.out'}, {'damage_type': 'backtrace', 'id': 4114815415, 'ino': 1099511632979, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/370'}, {'damage_type': 'backtrace', 'id': 4122178021, 'ino': 1099511630912, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/120.out'}, {'damage_type': 'backtrace', 'id': 4155051030, 'ino': 1099511630107, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/568.out'}, {'damage_type': 'backtrace', 'id': 4160395073, 'ino': 1099511631513, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/414.out'}, {'damage_type': 'backtrace', 'id': 4168073724, 'ino': 1099511628740, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/143.out'}, {'damage_type': 'backtrace', 'id': 4204030341, 'ino': 1099511631268, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/292.out'}, {'damage_type': 'backtrace', 'id': 4212544387, 'ino': 1099511632997, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/386'}, {'damage_type': 'backtrace', 'id': 4214336016, 'ino': 1099511628819, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/208.out'}, {'damage_type': 'backtrace', 'id': 4229285169, 'ino': 1099511632411, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/054'}, {'damage_type': 'backtrace', 'id': 4257787400, 'ino': 1099511633311, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.op'}, {'damage_type': 'backtrace', 'id': 4272968277, 'ino': 1099511628766, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/156.out'}, {'damage_type': 'backtrace', 'id': 4288614041, 'ino': 1099511630385, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/581.out'}] 2023-10-18T14:09:17.389 ERROR:tasks.fwd_scrub:rank 3 damaged: [{'damage_type': 'backtrace', 'id': 5614669, 'ino': 1099511628962, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/379.out'}, {'damage_type': 'backtrace', 'id': 13184544, 'ino': 1099511631052, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/190.out'}, {'damage_type': 'backtrace', 'id': 31121790, 'ino': 1099511629869, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/237.out'}, {'damage_type': 'backtrace', 'id': 36253208, 'ino': 1099511631356, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/336.out'}, {'damage_type': 'backtrace', 'id': 38751388, 'ino': 1099511631354, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/335.out'}, {'damage_type': 'backtrace', 'id': 62612262, 'ino': 1099511628676, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/111.out'}, {'damage_type': 'backtrace', 'id': 68249931, 'ino': 1099511632496, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/137'}, {'damage_type': 'backtrace', 'id': 76313302, 'ino': 1099511630914, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/121.out'}, {'damage_type': 'backtrace', 'id': 76803449, 'ino': 1099511632568, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/204'}, {'damage_type': 'backtrace', 'id': 91487025, 'ino': 1099511628608, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/077.out'}, {'damage_type': 'backtrace', 'id': 94137826, 'ino': 1099511628914, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/355.out'}, {'damage_type': 'backtrace', 'id': 110143907, 'ino': 1099511632563, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/200'}, {'damage_type': 'backtrace', 'id': 115939555, 'ino': 1099511631070, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/199.out'}, {'damage_type': 'backtrace', 'id': 120839913, 'ino': 1099511630640, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/001.out'}, {'damage_type': 'backtrace', 'id': 140750949, 'ino': 1099511628774, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/160.out'}, {'damage_type': 'backtrace', 'id': 152617219, 'ino': 1099511633224, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/001'}, {'damage_type': 'backtrace', 'id': 163288050, 'ino': 1099511633677, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/020'}, {'damage_type': 'backtrace', 'id': 177208745, 'ino': 1099511630800, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/068.out'}, {'damage_type': 'backtrace', 'id': 188511165, 'ino': 1099511631228, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/272.out'}, {'damage_type': 'backtrace', 'id': 206591152, 'ino': 1099511629961, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/283.out'}, {'damage_type': 'backtrace', 'id': 218927223, 'ino': 1099511631647, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/481.out'}, {'damage_type': 'backtrace', 'id': 255273469, 'ino': 1099511628664, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/105.out'}, {'damage_type': 'backtrace', 'id': 271579322, 'ino': 1099511629855, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/230.out'}, {'damage_type': 'backtrace', 'id': 280707145, 'ino': 1099511630658, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/298.out'}, {'damage_type': 'backtrace', 'id': 282331355, 'ino': 1099511633018, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/405'}, {'damage_type': 'backtrace', 'id': 294310310, 'ino': 1099511630744, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/040.out'}, {'damage_type': 'backtrace', 'id': 302994493, 'ino': 1099511633153, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/531'}, {'damage_type': 'backtrace', 'id': 310144316, 'ino': 1099511633670, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/015'}, {'damage_type': 'backtrace', 'id': 310390426, 'ino': 1099511630876, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/105.out'}, {'damage_type': 'backtrace', 'id': 323465172, 'ino': 1099511628956, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/376.out'}, {'damage_type': 'backtrace', 'id': 332738090, 'ino': 1099511631144, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/235.out'}, {'damage_type': 'backtrace', 'id': 341358264, 'ino': 1099511633149, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/527.out'}, {'damage_type': 'backtrace', 'id': 342881870, 'ino': 1099511632573, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/209'}, {'damage_type': 'backtrace', 'id': 347678802, 'ino': 1099511632332, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/308'}, {'damage_type': 'backtrace', 'id': 348004205, 'ino': 1099511633217, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/589'}, {'damage_type': 'backtrace', 'id': 353920356, 'ino': 1099511628752, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/149.out'}, {'damage_type': 'backtrace', 'id': 355128617, 'ino': 1099511629802, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/177.out'}, {'damage_type': 'backtrace', 'id': 359999645, 'ino': 1099511632306, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/025'}, {'damage_type': 'backtrace', 'id': 395183988, 'ino': 1099511633657, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/003'}, {'damage_type': 'backtrace', 'id': 397092459, 'ino': 1099511632514, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/152'}, {'damage_type': 'backtrace', 'id': 408798834, 'ino': 1099511632945, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/338'}, {'damage_type': 'backtrace', 'id': 432327179, 'ino': 1099511629248, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/522.out'}, {'damage_type': 'backtrace', 'id': 448864527, 'ino': 1099511632969, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/360'}, {'damage_type': 'backtrace', 'id': 460426045, 'ino': 1099511630099, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/564.out'}, {'damage_type': 'backtrace', 'id': 463179453, 'ino': 1099511632479, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/120'}, {'damage_type': 'backtrace', 'id': 469615187, 'ino': 1099511633308, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/102'}, {'damage_type': 'backtrace', 'id': 470235420, 'ino': 1099511632472, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/113'}, {'damage_type': 'backtrace', 'id': 473937773, 'ino': 1099511629933, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/269.out'}, {'damage_type': 'backtrace', 'id': 489742129, 'ino': 1099511633068, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/451'}, {'damage_type': 'backtrace', 'id': 490470032, 'ino': 1099511631058, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/193.out'}, {'damage_type': 'backtrace', 'id': 494504159, 'ino': 1099511628744, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/145.out'}, {'damage_type': 'backtrace', 'id': 501030497, 'ino': 1099511632291, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/010'}, {'damage_type': 'backtrace', 'id': 508413978, 'ino': 1099511632374, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/033'}, {'damage_type': 'backtrace', 'id': 526984784, 'ino': 1099511632289, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/008'}, {'damage_type': 'backtrace', 'id': 555071475, 'ino': 1099511632361, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/024'}, {'damage_type': 'backtrace', 'id': 555610220, 'ino': 1099511632372, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/032'}, {'damage_type': 'backtrace', 'id': 556772524, 'ino': 1099511628481, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/019.out'}, {'damage_type': 'backtrace', 'id': 557827240, 'ino': 1099511632648, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/284'}, {'damage_type': 'backtrace', 'id': 562047051, 'ino': 1099511633667, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/012'}, {'damage_type': 'backtrace', 'id': 575481623, 'ino': 1099511633067, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/450'}, {'damage_type': 'backtrace', 'id': 577869265, 'ino': 1099511632431, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/074'}, {'damage_type': 'backtrace', 'id': 591850434, 'ino': 1099511632638, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/274'}, {'damage_type': 'backtrace', 'id': 592049349, 'ino': 1099511632950, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/343'}, {'damage_type': 'backtrace', 'id': 596436190, 'ino': 1099511629184, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/490.out'}, {'damage_type': 'backtrace', 'id': 618308353, 'ino': 1099511629116, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/456.out'}, {'damage_type': 'backtrace', 'id': 649237375, 'ino': 1099511630383, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/580.out'}, {'damage_type': 'backtrace', 'id': 663181031, 'ino': 1099511630746, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/041.out'}, {'damage_type': 'backtrace', 'id': 666108787, 'ino': 1099511632477, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/118'}, {'damage_type': 'backtrace', 'id': 673896455, 'ino': 1099511632961, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/353'}, {'damage_type': 'backtrace', 'id': 708974759, 'ino': 1099511628457, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/007.out'}, {'damage_type': 'backtrace', 'id': 713476522, 'ino': 1099511633228, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/Makefile'}, {'damage_type': 'backtrace', 'id': 730033898, 'ino': 1099511631700, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/508.out'}, {'damage_type': 'backtrace', 'id': 778516961, 'ino': 1099511632582, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/218'}, {'damage_type': 'backtrace', 'id': 786886630, 'ino': 1099511633109, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/490'}, {'damage_type': 'backtrace', 'id': 798282275, 'ino': 1099511629254, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/525.out'}, {'damage_type': 'backtrace', 'id': 799226129, 'ino': 1099511632527, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/165'}, {'damage_type': 'backtrace', 'id': 808013821, 'ino': 1099511633301, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/Makefile'}, {'damage_type': 'backtrace', 'id': 812551194, 'ino': 1099511630065, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/547.out'}, {'damage_type': 'backtrace', 'id': 846608612, 'ino': 1099511632629, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/265'}, {'damage_type': 'backtrace', 'id': 849631924, 'ino': 1099511633012, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/400'}, {'damage_type': 'backtrace', 'id': 855200786, 'ino': 1099511630436, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/001.out'}, {'damage_type': 'backtrace', 'id': 870161164, 'ino': 1099511629108, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/452.out'}, {'damage_type': 'backtrace', 'id': 881803448, 'ino': 1099511632420, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/063'}, {'damage_type': 'backtrace', 'id': 885488727, 'ino': 1099511632505, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/143'}, {'damage_type': 'backtrace', 'id': 887839689, 'ino': 1099511629208, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/502.out'}, {'damage_type': 'backtrace', 'id': 897019333, 'ino': 1099511632485, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/126'}, {'damage_type': 'backtrace', 'id': 899609167, 'ino': 1099511629927, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/266.out'}, {'damage_type': 'backtrace', 'id': 912420127, 'ino': 1099511633187, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/564'}, {'damage_type': 'backtrace', 'id': 925248722, 'ino': 1099511629929, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/267.out'}, {'damage_type': 'backtrace', 'id': 925271523, 'ino': 1099511632355, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/019'}, {'damage_type': 'backtrace', 'id': 931995838, 'ino': 1099511632595, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/231'}, {'damage_type': 'backtrace', 'id': 938425511, 'ino': 1099511630819, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/077.out'}, {'damage_type': 'backtrace', 'id': 941822618, 'ino': 1099511632951, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/344'}, {'damage_type': 'backtrace', 'id': 995042973, 'ino': 1099511630950, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/139.out'}, {'damage_type': 'backtrace', 'id': 1003907389, 'ino': 1099511629985, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/295.out'}, {'damage_type': 'backtrace', 'id': 1032538566, 'ino': 1099511632985, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/374.out'}, {'damage_type': 'backtrace', 'id': 1049441351, 'ino': 1099511629881, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/243.out'}, {'damage_type': 'backtrace', 'id': 1068841837, 'ino': 1099511633300, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/001'}, {'damage_type': 'backtrace', 'id': 1072000380, 'ino': 1099511632292, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/011'}, {'damage_type': 'backtrace', 'id': 1086384592, 'ino': 1099511630906, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/117.out'}, {'damage_type': 'backtrace', 'id': 1094048003, 'ino': 1099511629106, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/451.out'}, {'damage_type': 'backtrace', 'id': 1109468611, 'ino': 1099511632911, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/304'}, {'damage_type': 'backtrace', 'id': 1119095754, 'ino': 1099511630756, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/046.out'}, {'damage_type': 'backtrace', 'id': 1152092911, 'ino': 1099511632424, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/067'}, {'damage_type': 'backtrace', 'id': 1157890226, 'ino': 1099511629832, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/192.out'}, {'damage_type': 'backtrace', 'id': 1164229983, 'ino': 1099511628674, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/110.out'}, {'damage_type': 'backtrace', 'id': 1167131428, 'ino': 1099511632631, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/267'}, {'damage_type': 'backtrace', 'id': 1170161789, 'ino': 1099511628590, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/068.out'}, {'damage_type': 'backtrace', 'id': 1173365969, 'ino': 1099511633302, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/perf/group'}, {'damage_type': 'backtrace', 'id': 1175985609, 'ino': 1099511632481, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/122'}, {'damage_type': 'backtrace', 'id': 1176202904, 'ino': 1099511630676, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/007.out'}, {'damage_type': 'backtrace', 'id': 1191273891, 'ino': 1099511632442, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/085'}, {'damage_type': 'backtrace', 'id': 1215286134, 'ino': 1099511632453, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/094'}, {'damage_type': 'backtrace', 'id': 1231266702, 'ino': 1099511633222, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/Makefile'}, {'damage_type': 'backtrace', 'id': 1234160438, 'ino': 1099511629853, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/229.out'}, {'damage_type': 'backtrace', 'id': 1238567927, 'ino': 1099511629891, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/248.out'}, {'damage_type': 'backtrace', 'id': 1251434182, 'ino': 1099511629182, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/489.out'}, {'damage_type': 'backtrace', 'id': 1257691420, 'ino': 1099511633076, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/459'}, {'damage_type': 'backtrace', 'id': 1293225072, 'ino': 1099511632982, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/373'}, {'damage_type': 'backtrace', 'id': 1344857738, 'ino': 1099511628578, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/062.out'}, {'damage_type': 'backtrace', 'id': 1366326239, 'ino': 1099511633079, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/462'}, {'damage_type': 'backtrace', 'id': 1371027407, 'ino': 1099511630134, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/584.out'}, {'damage_type': 'backtrace', 'id': 1371559956, 'ino': 1099511629006, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/401.out'}, {'damage_type': 'backtrace', 'id': 1375075737, 'ino': 1099511629981, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/293.out'}, {'damage_type': 'backtrace', 'id': 1385510843, 'ino': 1099511632474, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/115'}, {'damage_type': 'backtrace', 'id': 1412236475, 'ino': 1099511632987, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/376'}, {'damage_type': 'backtrace', 'id': 1444392856, 'ino': 1099511628461, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/009.out'}, {'damage_type': 'backtrace', 'id': 1446769821, 'ino': 1099511628809, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/203.out'}, {'damage_type': 'backtrace', 'id': 1449860138, 'ino': 1099511628784, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/165.out'}, {'damage_type': 'backtrace', 'id': 1450178110, 'ino': 1099511630132, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/583.out'}, {'damage_type': 'backtrace', 'id': 1450681736, 'ino': 1099511631080, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/204.out'}, {'damage_type': 'backtrace', 'id': 1453206362, 'ino': 1099511631250, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/283.out'}, {'damage_type': 'backtrace', 'id': 1463142899, 'ino': 1099511631158, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/237.out'}, {'damage_type': 'backtrace', 'id': 1470974119, 'ino': 1099511629879, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/242.out'}, {'damage_type': 'backtrace', 'id': 1473323238, 'ino': 1099511633052, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/436'}, {'damage_type': 'backtrace', 'id': 1494273480, 'ino': 1099511629192, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/494.out'}, {'damage_type': 'backtrace', 'id': 1513106536, 'ino': 1099511631202, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/259.out'}, {'damage_type': 'backtrace', 'id': 1517896755, 'ino': 1099511633034, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/420'}, {'damage_type': 'backtrace', 'id': 1549922891, 'ino': 1099511630736, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/036.out'}, {'damage_type': 'backtrace', 'id': 1559265180, 'ino': 1099511630656, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/032.out'}, {'damage_type': 'backtrace', 'id': 1569560646, 'ino': 1099511632326, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/302'}, {'damage_type': 'backtrace', 'id': 1571911527, 'ino': 1099511628988, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/392.out'}, {'damage_type': 'backtrace', 'id': 1588451528, 'ino': 1099511628678, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/112.out'}, {'damage_type': 'backtrace', 'id': 1612406426, 'ino': 1099511628996, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/396.out'}, {'damage_type': 'backtrace', 'id': 1620244308, 'ino': 1099511632283, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/002.out'}, {'damage_type': 'backtrace', 'id': 1651670672, 'ino': 1099511633007, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/396'}, {'damage_type': 'backtrace', 'id': 1652672596, 'ino': 1099511629975, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/290.out'}, {'damage_type': 'backtrace', 'id': 1659010243, 'ino': 1099511629174, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/485.out'}, {'damage_type': 'backtrace', 'id': 1664673795, 'ino': 1099511633219, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/591'}, {'damage_type': 'backtrace', 'id': 1672004254, 'ino': 1099511630438, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/001.out'}, {'damage_type': 'backtrace', 'id': 1698153171, 'ino': 1099511631164, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/240.out'}, {'damage_type': 'backtrace', 'id': 1707056858, 'ino': 1099511628684, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/115.out'}, {'damage_type': 'backtrace', 'id': 1720142045, 'ino': 1099511632447, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/089'}, {'damage_type': 'backtrace', 'id': 1721392091, 'ino': 1099511631668, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/492.out'}, {'damage_type': 'backtrace', 'id': 1725240839, 'ino': 1099511631322, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/319.out'}, {'damage_type': 'backtrace', 'id': 1757901066, 'ino': 1099511633202, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/575.out'}, {'damage_type': 'backtrace', 'id': 1786937405, 'ino': 1099511630860, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/097.out'}, {'damage_type': 'backtrace', 'id': 1790862435, 'ino': 1099511632418, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/061'}, {'damage_type': 'backtrace', 'id': 1791820057, 'ino': 1099511631417, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/366.out'}, {'damage_type': 'backtrace', 'id': 1849811266, 'ino': 1099511632566, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/202'}, {'damage_type': 'backtrace', 'id': 1861036455, 'ino': 1099511630750, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/043.out'}, {'damage_type': 'backtrace', 'id': 1891305488, 'ino': 1099511632305, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/024'}, {'damage_type': 'backtrace', 'id': 1904762249, 'ino': 1099511631002, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/165.out'}, {'damage_type': 'backtrace', 'id': 1916670845, 'ino': 1099511632500, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/139.out'}, {'damage_type': 'backtrace', 'id': 1918448302, 'ino': 1099511628648, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/097.out'}, {'damage_type': 'backtrace', 'id': 1946718457, 'ino': 1099511632462, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/103'}, {'damage_type': 'backtrace', 'id': 1948909205, 'ino': 1099511629953, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/279.out'}, {'damage_type': 'backtrace', 'id': 1959561641, 'ino': 1099511633027, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/414'}, {'damage_type': 'backtrace', 'id': 1978405397, 'ino': 1099511631176, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/246.out'}, {'damage_type': 'backtrace', 'id': 2007229817, 'ino': 1099511630049, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/539.out'}, {'damage_type': 'backtrace', 'id': 2007390964, 'ino': 1099511628722, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/134.out'}, {'damage_type': 'backtrace', 'id': 2009029022, 'ino': 1099511633676, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/019.out'}, {'damage_type': 'backtrace', 'id': 2019225269, 'ino': 1099511633229, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/group'}, {'damage_type': 'backtrace', 'id': 2025907212, 'ino': 1099511629917, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/261.out'}, {'damage_type': 'backtrace', 'id': 2030175889, 'ino': 1099511628698, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/122.out'}, {'damage_type': 'backtrace', 'id': 2031587508, 'ino': 1099511631134, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/230.out'}, {'damage_type': 'backtrace', 'id': 2087742206, 'ino': 1099511629016, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/406.out'}, {'damage_type': 'backtrace', 'id': 2093514409, 'ino': 1099511628618, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/082.out'}, {'damage_type': 'backtrace', 'id': 2096819118, 'ino': 1099511633074, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/457'}, {'damage_type': 'backtrace', 'id': 2110883645, 'ino': 1099511632465, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/106'}, {'damage_type': 'backtrace', 'id': 2114804428, 'ino': 1099511631662, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/489.out'}, {'damage_type': 'backtrace', 'id': 2129906969, 'ino': 1099511632520, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/158'}, {'damage_type': 'backtrace', 'id': 2137617344, 'ino': 1099511633211, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/583'}, {'damage_type': 'backtrace', 'id': 2140043523, 'ino': 1099511631372, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/344.out'}, {'damage_type': 'backtrace', 'id': 2149300974, 'ino': 1099511631655, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/485.out'}, {'damage_type': 'backtrace', 'id': 2156077899, 'ino': 1099511628317, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/007.out'}, {'damage_type': 'backtrace', 'id': 2171905898, 'ino': 1099511629268, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/532.out'}, {'damage_type': 'backtrace', 'id': 2195793226, 'ino': 1099511632984, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/374'}, {'damage_type': 'backtrace', 'id': 2196662139, 'ino': 1099511628876, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/336.out'}, {'damage_type': 'backtrace', 'id': 2200112291, 'ino': 1099511633125, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/504'}, {'damage_type': 'backtrace', 'id': 2205394853, 'ino': 1099511632607, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/243'}, {'damage_type': 'backtrace', 'id': 2214229312, 'ino': 1099511632519, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/157'}, {'damage_type': 'backtrace', 'id': 2221427703, 'ino': 1099511628726, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/136.out'}, {'damage_type': 'backtrace', 'id': 2251238012, 'ino': 1099511629913, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/259.out'}, {'damage_type': 'backtrace', 'id': 2253818877, 'ino': 1099511629999, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/302.out'}, {'damage_type': 'backtrace', 'id': 2253918273, 'ino': 1099511629126, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/461.out'}, {'damage_type': 'backtrace', 'id': 2280461484, 'ino': 1099511632977, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/368'}, {'damage_type': 'backtrace', 'id': 2292126993, 'ino': 1099511630123, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/576.out'}, {'damage_type': 'backtrace', 'id': 2312007666, 'ino': 1099511632452, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/093.out'}, {'damage_type': 'backtrace', 'id': 2329891019, 'ino': 1099511633661, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/006.out'}, {'damage_type': 'backtrace', 'id': 2331211564, 'ino': 1099511632441, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/084'}, {'damage_type': 'backtrace', 'id': 2332634055, 'ino': 1099511632367, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/029.out'}, {'damage_type': 'backtrace', 'id': 2344409715, 'ino': 1099511631200, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/258.out'}, {'damage_type': 'backtrace', 'id': 2359540262, 'ino': 1099511632429, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/072'}, {'damage_type': 'backtrace', 'id': 2374533526, 'ino': 1099511629142, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/469.out'}, {'damage_type': 'backtrace', 'id': 2374831390, 'ino': 1099511628646, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/096.out'}, {'damage_type': 'backtrace', 'id': 2379107297, 'ino': 1099511631597, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/456.out'}, {'damage_type': 'backtrace', 'id': 2379319936, 'ino': 1099511630662, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/102.out'}, {'damage_type': 'backtrace', 'id': 2396626278, 'ino': 1099511628992, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/394.out'}, {'damage_type': 'backtrace', 'id': 2398628764, 'ino': 1099511629937, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/271.out'}, {'damage_type': 'backtrace', 'id': 2409288364, 'ino': 1099511632436, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/079'}, {'damage_type': 'backtrace', 'id': 2427290118, 'ino': 1099511628375, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/036.out'}, {'damage_type': 'backtrace', 'id': 2432396561, 'ino': 1099511630734, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/035.out'}, {'damage_type': 'backtrace', 'id': 2436481297, 'ino': 1099511632621, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/257'}, {'damage_type': 'backtrace', 'id': 2439069520, 'ino': 1099511629020, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/408.out'}, {'damage_type': 'backtrace', 'id': 2439985162, 'ino': 1099511632585, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/221'}, {'damage_type': 'backtrace', 'id': 2453476013, 'ino': 1099511632653, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/289'}, {'damage_type': 'backtrace', 'id': 2467265335, 'ino': 1099511631527, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/421.out'}, {'damage_type': 'backtrace', 'id': 2470294482, 'ino': 1099511632912, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/305'}, {'damage_type': 'backtrace', 'id': 2492456271, 'ino': 1099511632619, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/255'}, {'damage_type': 'backtrace', 'id': 2497465932, 'ino': 1099511631425, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/370.out'}, {'damage_type': 'backtrace', 'id': 2506463120, 'ino': 1099511632333, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/Makefile'}, {'damage_type': 'backtrace', 'id': 2510912037, 'ino': 1099511630672, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/005.out'}, {'damage_type': 'backtrace', 'id': 2519388609, 'ino': 1099511631429, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/372.out'}, {'damage_type': 'backtrace', 'id': 2519426870, 'ino': 1099511633303, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/002'}, {'damage_type': 'backtrace', 'id': 2519907237, 'ino': 1099511632434, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/077'}, {'damage_type': 'backtrace', 'id': 2523802763, 'ino': 1099511632523, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/161'}, {'damage_type': 'backtrace', 'id': 2533772678, 'ino': 1099511631216, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/266.out'}, {'damage_type': 'backtrace', 'id': 2534139172, 'ino': 1099511633116, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/496'}, {'damage_type': 'backtrace', 'id': 2546052981, 'ino': 1099511631395, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/355.out'}, {'damage_type': 'backtrace', 'id': 2561079821, 'ino': 1099511630097, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/563.out'}, {'damage_type': 'backtrace', 'id': 2576016916, 'ino': 1099511633040, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/426'}, {'damage_type': 'backtrace', 'id': 2578245178, 'ino': 1099511632541, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/179'}, {'damage_type': 'backtrace', 'id': 2589918334, 'ino': 1099511630654, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/002.out'}, {'damage_type': 'backtrace', 'id': 2607653272, 'ino': 1099511633304, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/032'}, {'damage_type': 'backtrace', 'id': 2629652175, 'ino': 1099511631274, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/295.out'}, {'damage_type': 'backtrace', 'id': 2674274466, 'ino': 1099511633663, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/008'}, {'damage_type': 'backtrace', 'id': 2712049560, 'ino': 1099511632574, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/210'}, {'damage_type': 'backtrace', 'id': 2719114715, 'ino': 1099511628796, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/171.out'}, {'damage_type': 'backtrace', 'id': 2728072832, 'ino': 1099511632967, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/358'}, {'damage_type': 'backtrace', 'id': 2734947780, 'ino': 1099511630868, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/101.out'}, {'damage_type': 'backtrace', 'id': 2753821748, 'ino': 1099511633154, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/532'}, {'damage_type': 'backtrace', 'id': 2764607749, 'ino': 1099511632530, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/168'}, {'damage_type': 'backtrace', 'id': 2773100941, 'ino': 1099511630680, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/009.out'}, {'damage_type': 'backtrace', 'id': 2781819919, 'ino': 1099511628862, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/329.out'}, {'damage_type': 'backtrace', 'id': 2788048263, 'ino': 1099511632435, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/078'}, {'damage_type': 'backtrace', 'id': 2799461084, 'ino': 1099511631016, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/172.out'}, {'damage_type': 'backtrace', 'id': 2855841286, 'ino': 1099511633085, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/468'}, {'damage_type': 'backtrace', 'id': 2862824780, 'ino': 1099511631611, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/463.out'}, {'damage_type': 'backtrace', 'id': 2863133201, 'ino': 1099511628477, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/017.out'}, {'damage_type': 'backtrace', 'id': 2870471315, 'ino': 1099511633671, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/016'}, {'damage_type': 'backtrace', 'id': 2886200028, 'ino': 1099511631491, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/403.out'}, {'damage_type': 'backtrace', 'id': 2910440692, 'ino': 1099511632412, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/055'}, {'damage_type': 'backtrace', 'id': 2913253974, 'ino': 1099511628936, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/366.out'}, {'damage_type': 'backtrace', 'id': 2920196087, 'ino': 1099511630035, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/320.out'}, {'damage_type': 'backtrace', 'id': 2923374952, 'ino': 1099511628554, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.xfsquota'}, {'damage_type': 'backtrace', 'id': 2925496266, 'ino': 1099511628447, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/002.out'}, {'damage_type': 'backtrace', 'id': 2929218949, 'ino': 1099511631232, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/274.out'}, {'damage_type': 'backtrace', 'id': 2931715410, 'ino': 1099511632965, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/356'}, {'damage_type': 'backtrace', 'id': 2938421458, 'ino': 1099511633194, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/570'}, {'damage_type': 'backtrace', 'id': 2942028078, 'ino': 1099511632339, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/003'}, {'damage_type': 'backtrace', 'id': 2975501184, 'ino': 1099511632542, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/180'}, {'damage_type': 'backtrace', 'id': 2982574846, 'ino': 1099511633307, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/group'}, {'damage_type': 'backtrace', 'id': 2998788893, 'ino': 1099511632451, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/093'}, {'damage_type': 'backtrace', 'id': 3001680951, 'ino': 1099511633054, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/438'}, {'damage_type': 'backtrace', 'id': 3004276620, 'ino': 1099511633019, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/406'}, {'damage_type': 'backtrace', 'id': 3017902409, 'ino': 1099511632344, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/008'}, {'damage_type': 'backtrace', 'id': 3042429337, 'ino': 1099511629160, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/478.out'}, {'damage_type': 'backtrace', 'id': 3051439941, 'ino': 1099511632613, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/249'}, {'damage_type': 'backtrace', 'id': 3067560705, 'ino': 1099511632480, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/121'}, {'damage_type': 'backtrace', 'id': 3083859280, 'ino': 1099511631132, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/229.out'}, {'damage_type': 'backtrace', 'id': 3086762348, 'ino': 1099511628688, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/117.out'}, {'damage_type': 'backtrace', 'id': 3089637985, 'ino': 1099511633026, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/413'}, {'damage_type': 'backtrace', 'id': 3100173530, 'ino': 1099511629190, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/493.out'}, {'damage_type': 'backtrace', 'id': 3117702108, 'ino': 1099511633309, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/Makefile'}, {'damage_type': 'backtrace', 'id': 3119946951, 'ino': 1099511630073, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/551.out'}, {'damage_type': 'backtrace', 'id': 3127192045, 'ino': 1099511632555, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/192'}, {'damage_type': 'backtrace', 'id': 3166842681, 'ino': 1099511628628, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/087.out'}, {'damage_type': 'backtrace', 'id': 3169276721, 'ino': 1099511630003, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/304.out'}, {'damage_type': 'backtrace', 'id': 3194648577, 'ino': 1099511632524, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/162'}, {'damage_type': 'backtrace', 'id': 3202724108, 'ino': 1099511629826, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/189.out'}, {'damage_type': 'backtrace', 'id': 3203119848, 'ino': 1099511628564, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/055.out'}, {'damage_type': 'backtrace', 'id': 3206634412, 'ino': 1099511629957, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/281.out'}, {'damage_type': 'backtrace', 'id': 3207553148, 'ino': 1099511632616, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/252'}, {'damage_type': 'backtrace', 'id': 3215383916, 'ino': 1099511633167, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/545'}, {'damage_type': 'backtrace', 'id': 3219614026, 'ino': 1099511629897, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/251.out'}, {'damage_type': 'backtrace', 'id': 3233485682, 'ino': 1099511632522, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/160'}, {'damage_type': 'backtrace', 'id': 3236510129, 'ino': 1099511628928, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/362.out'}, {'damage_type': 'backtrace', 'id': 3248491038, 'ino': 1099511633064, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/447'}, {'damage_type': 'backtrace', 'id': 3257653857, 'ino': 1099511631246, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/281.out'}, {'damage_type': 'backtrace', 'id': 3267952098, 'ino': 1099511633004, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/393'}, {'damage_type': 'backtrace', 'id': 3269873699, 'ino': 1099511630730, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/033.out.default'}, {'damage_type': 'backtrace', 'id': 3288370174, 'ino': 1099511631180, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/248.out'}, {'damage_type': 'backtrace', 'id': 3300771667, 'ino': 1099511631443, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/379.out'}, {'damage_type': 'backtrace', 'id': 3307287541, 'ino': 1099511632645, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/281'}, {'damage_type': 'backtrace', 'id': 3311447247, 'ino': 1099511629887, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/246.out'}, {'damage_type': 'backtrace', 'id': 3317335970, 'ino': 1099511633306, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/Makefile'}, {'damage_type': 'backtrace', 'id': 3328309162, 'ino': 1099511632359, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/022'}, {'damage_type': 'backtrace', 'id': 3331163527, 'ino': 1099511633135, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/514'}, {'damage_type': 'backtrace', 'id': 3331518068, 'ino': 1099511633225, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/Makefile'}, {'damage_type': 'backtrace', 'id': 3331612942, 'ino': 1099511629945, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/275.out'}, {'damage_type': 'backtrace', 'id': 3342965144, 'ino': 1099511631208, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/262.out'}, {'damage_type': 'backtrace', 'id': 3350757076, 'ino': 1099511632538, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/176'}, {'damage_type': 'backtrace', 'id': 3353151202, 'ino': 1099511628948, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/372.out'}, {'damage_type': 'backtrace', 'id': 3368555503, 'ino': 1099511632578, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/214'}, {'damage_type': 'backtrace', 'id': 3379276929, 'ino': 1099511632352, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/016'}, {'damage_type': 'backtrace', 'id': 3409374312, 'ino': 1099511632351, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/015'}, {'damage_type': 'backtrace', 'id': 3412017711, 'ino': 1099511633197, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/572.out'}, {'damage_type': 'backtrace', 'id': 3438687291, 'ino': 1099511631477, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/396.out'}, {'damage_type': 'backtrace', 'id': 3442206642, 'ino': 1099511632410, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/053'}, {'damage_type': 'backtrace', 'id': 3445687569, 'ino': 1099511631136, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/231.out'}, {'damage_type': 'backtrace', 'id': 3460440588, 'ino': 1099511633063, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/446'}, {'damage_type': 'backtrace', 'id': 3464855540, 'ino': 1099511632363, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/026'}, {'damage_type': 'backtrace', 'id': 3477997111, 'ino': 1099511629220, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/508.out'}, {'damage_type': 'backtrace', 'id': 3487100891, 'ino': 1099511628455, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/006.out'}, {'damage_type': 'backtrace', 'id': 3515928562, 'ino': 1099511630886, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/110.out'}, {'damage_type': 'backtrace', 'id': 3526274199, 'ino': 1099511633139, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/518'}, {'damage_type': 'backtrace', 'id': 3528386224, 'ino': 1099511630081, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/555.out'}, {'damage_type': 'backtrace', 'id': 3532657039, 'ino': 1099511631473, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/394.out'}, {'damage_type': 'backtrace', 'id': 3553110769, 'ino': 1099511631521, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/418.out'}, {'damage_type': 'backtrace', 'id': 3559266842, 'ino': 1099511633227, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ocfs2/001'}, {'damage_type': 'backtrace', 'id': 3577110930, 'ino': 1099511633674, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.out'}, {'damage_type': 'backtrace', 'id': 3610631278, 'ino': 1099511633213, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/585'}, {'damage_type': 'backtrace', 'id': 3621157084, 'ino': 1099511628794, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/170.out'}, {'damage_type': 'backtrace', 'id': 3623961821, 'ino': 1099511628686, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/116.out'}, {'damage_type': 'backtrace', 'id': 3626852771, 'ino': 1099511630944, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/136.out'}, {'damage_type': 'backtrace', 'id': 3627509506, 'ino': 1099511633100, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/482'}, {'damage_type': 'backtrace', 'id': 3633664035, 'ino': 1099511629010, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/403.out'}, {'damage_type': 'backtrace', 'id': 3638575418, 'ino': 1099511632534, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/172'}, {'damage_type': 'backtrace', 'id': 3648180778, 'ino': 1099511632502, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/140.out'}, {'damage_type': 'backtrace', 'id': 3656403433, 'ino': 1099511632490, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/131'}, {'damage_type': 'backtrace', 'id': 3673071913, 'ino': 1099511632448, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/090'}, {'damage_type': 'backtrace', 'id': 3676542704, 'ino': 1099511630858, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/096.out.internal'}, {'damage_type': 'backtrace', 'id': 3678082080, 'ino': 1099511629796, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/174.out'}, {'damage_type': 'backtrace', 'id': 3678535599, 'ino': 1099511629824, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/188.out'}, {'damage_type': 'backtrace', 'id': 3681182922, 'ino': 1099511632457, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/098'}, {'damage_type': 'backtrace', 'id': 3693935583, 'ino': 1099511630025, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/315.out'}, {'damage_type': 'backtrace', 'id': 3696857792, 'ino': 1099511633045, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/430'}, {'damage_type': 'backtrace', 'id': 3700469178, 'ino': 1099511630011, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/308.out'}, {'damage_type': 'backtrace', 'id': 3708594286, 'ino': 1099511633069, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/452'}, {'damage_type': 'backtrace', 'id': 3717055855, 'ino': 1099511630788, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/062.out'}, {'damage_type': 'backtrace', 'id': 3767847585, 'ino': 1099511631690, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/503.out'}, {'damage_type': 'backtrace', 'id': 3768878080, 'ino': 1099511629830, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/191.out'}, {'damage_type': 'backtrace', 'id': 3774712405, 'ino': 1099511629166, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/481.out'}, {'damage_type': 'backtrace', 'id': 3808513111, 'ino': 1099511630033, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/319.out'}, {'damage_type': 'backtrace', 'id': 3814588232, 'ino': 1099511633021, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/408'}, {'damage_type': 'backtrace', 'id': 3825326291, 'ino': 1099511628972, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/384.out'}, {'damage_type': 'backtrace', 'id': 3832212778, 'ino': 1099511630067, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/548.out'}, {'damage_type': 'backtrace', 'id': 3883518912, 'ino': 1099511628425, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/ext4/301.out'}, {'damage_type': 'backtrace', 'id': 3885406727, 'ino': 1099511630864, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/099.out'}, {'damage_type': 'backtrace', 'id': 3891458930, 'ino': 1099511633058, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/441'}, {'damage_type': 'backtrace', 'id': 3899678352, 'ino': 1099511630732, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/034.out'}, {'damage_type': 'backtrace', 'id': 3905756999, 'ino': 1099511628966, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/381.out'}, {'damage_type': 'backtrace', 'id': 3909916854, 'ino': 1099511628926, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/361.out'}, {'damage_type': 'backtrace', 'id': 3913622144, 'ino': 1099511628944, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/370.out'}, {'damage_type': 'backtrace', 'id': 3922123549, 'ino': 1099511628786, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/166.out'}, {'damage_type': 'backtrace', 'id': 3925821576, 'ino': 1099511632482, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/123'}, {'damage_type': 'backtrace', 'id': 3961097890, 'ino': 1099511633226, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/nfs/group'}, {'damage_type': 'backtrace', 'id': 4007103523, 'ino': 1099511628708, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/127.out'}, {'damage_type': 'backtrace', 'id': 4011781744, 'ino': 1099511633104, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/485'}, {'damage_type': 'backtrace', 'id': 4024069664, 'ino': 1099511628525, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/040.out'}, {'damage_type': 'backtrace', 'id': 4035401893, 'ino': 1099511631670, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/493.out'}, {'damage_type': 'backtrace', 'id': 4043397926, 'ino': 1099511628652, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/099.out'}, {'damage_type': 'backtrace', 'id': 4066981012, 'ino': 1099511631314, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/315.out'}, {'damage_type': 'backtrace', 'id': 4077926621, 'ino': 1099511632469, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/110'}, {'damage_type': 'backtrace', 'id': 4078184747, 'ino': 1099511631623, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/469.out'}, {'damage_type': 'backtrace', 'id': 4092524990, 'ino': 1099511632617, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/253'}, {'damage_type': 'backtrace', 'id': 4093631750, 'ino': 1099511633305, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/shared/298'}, {'damage_type': 'backtrace', 'id': 4096020274, 'ino': 1099511631664, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/490.out'}, {'damage_type': 'backtrace', 'id': 4110127582, 'ino': 1099511633162, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/540'}, {'damage_type': 'backtrace', 'id': 4119001223, 'ino': 1099511632421, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/064'}, {'damage_type': 'backtrace', 'id': 4122922908, 'ino': 1099511628636, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/091.out'}, {'damage_type': 'backtrace', 'id': 4123880939, 'ino': 1099511628696, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/121.out'}, {'damage_type': 'backtrace', 'id': 4129819140, 'ino': 1099511632654, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/290'}, {'damage_type': 'backtrace', 'id': 4143474000, 'ino': 1099511633310, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/udf/group'}, {'damage_type': 'backtrace', 'id': 4153667939, 'ino': 1099511629050, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/423.out'}, {'damage_type': 'backtrace', 'id': 4156547608, 'ino': 1099511628513, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/035.cfg'}, {'damage_type': 'backtrace', 'id': 4160203397, 'ino': 1099511633158, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/536'}, {'damage_type': 'backtrace', 'id': 4170573824, 'ino': 1099511628922, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/359.out'}, {'damage_type': 'backtrace', 'id': 4184247108, 'ino': 1099511631048, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/188.out'}, {'damage_type': 'backtrace', 'id': 4184421620, 'ino': 1099511631186, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/251.out'}, {'damage_type': 'backtrace', 'id': 4184885917, 'ino': 1099511632971, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/362'}, {'damage_type': 'backtrace', 'id': 4211575842, 'ino': 1099511632460, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/101'}, {'damage_type': 'backtrace', 'id': 4211817520, 'ino': 1099511629004, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/400.out'}, {'damage_type': 'backtrace', 'id': 4223201369, 'ino': 1099511630902, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/115.out'}, {'damage_type': 'backtrace', 'id': 4231829728, 'ino': 1099511629252, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/524.out'}, {'damage_type': 'backtrace', 'id': 4237166946, 'ino': 1099511628610, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/078.out'}, {'damage_type': 'backtrace', 'id': 4244220287, 'ino': 1099511633010, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/398'}, {'damage_type': 'backtrace', 'id': 4246233705, 'ino': 1099511628453, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/005.out'}, {'damage_type': 'backtrace', 'id': 4262038656, 'ino': 1099511630954, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/141.out'}] 2023-10-18T14:09:17.390 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 26016250, 'ino': 1099511631130, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/228.out'}, {'damage_type': 'backtrace', 'id': 29614554, 'ino': 1099511631391, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/353.out'}, {'damage_type': 'backtrace', 'id': 49562280, 'ino': 1099511633189, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/566'}, {'damage_type': 'backtrace', 'id': 54203392, 'ino': 1099511633126, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/505'}, {'damage_type': 'backtrace', 'id': 55834388, 'ino': 1099511633017, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/404.out'}, {'damage_type': 'backtrace', 'id': 59500247, 'ino': 1099511630837, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/086.out'}, {'damage_type': 'backtrace', 'id': 67387473, 'ino': 1099511629264, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/530.out'}, {'damage_type': 'backtrace', 'id': 90583784, 'ino': 1099511632586, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/222'}, {'damage_type': 'backtrace', 'id': 92277442, 'ino': 1099511630920, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/124.out'}, {'damage_type': 'backtrace', 'id': 101725783, 'ino': 1099511631694, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/505.out'}, {'damage_type': 'backtrace', 'id': 102741454, 'ino': 1099511630039, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/322.out'}, {'damage_type': 'backtrace', 'id': 102951802, 'ino': 1099511631479, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/397.out'}, {'damage_type': 'backtrace', 'id': 107614749, 'ino': 1099511629124, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/460.out'}, {'damage_type': 'backtrace', 'id': 109934768, 'ino': 1099511629851, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/228.out'}, {'damage_type': 'backtrace', 'id': 139681571, 'ino': 1099511632922, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/315'}, {'damage_type': 'backtrace', 'id': 145898793, 'ino': 1099511633029, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/416'}, {'damage_type': 'backtrace', 'id': 148644343, 'ino': 1099511628770, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/158.out'}, {'damage_type': 'backtrace', 'id': 160078496, 'ino': 1099511631056, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/192.out'}, {'damage_type': 'backtrace', 'id': 186794570, 'ino': 1099511628519, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/037.out'}, {'damage_type': 'backtrace', 'id': 208093013, 'ino': 1099511632338, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/002'}, {'damage_type': 'backtrace', 'id': 208568462, 'ino': 1099511631334, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/325.out'}, {'damage_type': 'backtrace', 'id': 230047518, 'ino': 1099511633046, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/431'}, {'damage_type': 'backtrace', 'id': 248189304, 'ino': 1099511628782, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/164.out'}, {'damage_type': 'backtrace', 'id': 251412045, 'ino': 1099511633122, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/501.out'}, {'damage_type': 'backtrace', 'id': 259699141, 'ino': 1099511633148, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/527'}, {'damage_type': 'backtrace', 'id': 283691854, 'ino': 1099511633073, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/456'}, {'damage_type': 'backtrace', 'id': 286336715, 'ino': 1099511629064, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/430.out'}, {'damage_type': 'backtrace', 'id': 304324748, 'ino': 1099511633065, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/448'}, {'damage_type': 'backtrace', 'id': 318590312, 'ino': 1099511629178, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/487.out'}, {'damage_type': 'backtrace', 'id': 322696712, 'ino': 1099511631633, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/474.out'}, {'damage_type': 'backtrace', 'id': 328872254, 'ino': 1099511632913, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/306'}, {'damage_type': 'backtrace', 'id': 338939380, 'ino': 1099511630704, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/021.out'}, {'damage_type': 'backtrace', 'id': 375203403, 'ino': 1099511631489, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/402.out'}, {'damage_type': 'backtrace', 'id': 396331241, 'ino': 1099511630764, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/050.out'}, {'damage_type': 'backtrace', 'id': 400677067, 'ino': 1099511632966, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/357'}, {'damage_type': 'backtrace', 'id': 410269588, 'ino': 1099511633037, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/423'}, {'damage_type': 'backtrace', 'id': 432475519, 'ino': 1099511633090, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/472'}, {'damage_type': 'backtrace', 'id': 471567594, 'ino': 1099511632388, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/046'}, {'damage_type': 'backtrace', 'id': 512749238, 'ino': 1099511633656, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/002'}, {'damage_type': 'backtrace', 'id': 517167931, 'ino': 1099511630811, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/073.out'}, {'damage_type': 'backtrace', 'id': 544250281, 'ino': 1099511632380, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/038'}, {'damage_type': 'backtrace', 'id': 555904310, 'ino': 1099511628451, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/004.out'}, {'damage_type': 'backtrace', 'id': 557083517, 'ino': 1099511633216, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/588'}, {'damage_type': 'backtrace', 'id': 575318630, 'ino': 1099511633192, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/568'}, {'damage_type': 'backtrace', 'id': 593608699, 'ino': 1099511632422, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/065'}, {'damage_type': 'backtrace', 'id': 606845166, 'ino': 1099511629026, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/411.out'}, {'damage_type': 'backtrace', 'id': 627551225, 'ino': 1099511628880, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/338.out'}, {'damage_type': 'backtrace', 'id': 640170039, 'ino': 1099511631585, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/450.out'}, {'damage_type': 'backtrace', 'id': 656563381, 'ino': 1099511631567, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/441.out'}, {'damage_type': 'backtrace', 'id': 660874292, 'ino': 1099511628694, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/120.out'}, {'damage_type': 'backtrace', 'id': 662318176, 'ino': 1099511629176, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/486.out'}, {'damage_type': 'backtrace', 'id': 723283165, 'ino': 1099511630664, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/001.out'}, {'damage_type': 'backtrace', 'id': 736674274, 'ino': 1099511630041, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/323.out'}, {'damage_type': 'backtrace', 'id': 751938322, 'ino': 1099511632639, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/275'}, {'damage_type': 'backtrace', 'id': 754233813, 'ino': 1099511629044, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/420.out'}, {'damage_type': 'backtrace', 'id': 760190353, 'ino': 1099511629070, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/433.out'}, {'damage_type': 'backtrace', 'id': 799089083, 'ino': 1099511632357, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/020.out'}, {'damage_type': 'backtrace', 'id': 800278572, 'ino': 1099511628872, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/334.out'}, {'damage_type': 'backtrace', 'id': 800987314, 'ino': 1099511633094, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/476'}, {'damage_type': 'backtrace', 'id': 825849363, 'ino': 1099511629246, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/521.out'}, {'damage_type': 'backtrace', 'id': 829785963, 'ino': 1099511631098, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/213.out'}, {'damage_type': 'backtrace', 'id': 835294064, 'ino': 1099511628566, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/056.out'}, {'damage_type': 'backtrace', 'id': 835729888, 'ino': 1099511629180, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/488.out'}, {'damage_type': 'backtrace', 'id': 839213845, 'ino': 1099511629883, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/244.out'}, {'damage_type': 'backtrace', 'id': 839257988, 'ino': 1099511632620, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/256'}, {'damage_type': 'backtrace', 'id': 870823026, 'ino': 1099511631565, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/440.out'}, {'damage_type': 'backtrace', 'id': 912841138, 'ino': 1099511628851, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/224.out'}, {'damage_type': 'backtrace', 'id': 918115398, 'ino': 1099511632444, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/086.out'}, {'damage_type': 'backtrace', 'id': 918126437, 'ino': 1099511631204, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/260.out'}, {'damage_type': 'backtrace', 'id': 937496714, 'ino': 1099511632614, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/250'}, {'damage_type': 'backtrace', 'id': 939854417, 'ino': 1099511630847, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/091.out'}, {'damage_type': 'backtrace', 'id': 958943604, 'ino': 1099511633086, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/469'}, {'damage_type': 'backtrace', 'id': 988403230, 'ino': 1099511629861, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/233.out'}, {'damage_type': 'backtrace', 'id': 993462863, 'ino': 1099511628904, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/350.out'}, {'damage_type': 'backtrace', 'id': 998278457, 'ino': 1099511633106, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/487'}, {'damage_type': 'backtrace', 'id': 1026199462, 'ino': 1099511632446, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/088'}, {'damage_type': 'backtrace', 'id': 1027256094, 'ino': 1099511633103, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/484.out'}, {'damage_type': 'backtrace', 'id': 1042228942, 'ino': 1099511632413, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/056'}, {'damage_type': 'backtrace', 'id': 1042614615, 'ino': 1099511633208, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/580'}, {'damage_type': 'backtrace', 'id': 1049807207, 'ino': 1099511628690, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/118.out'}, {'damage_type': 'backtrace', 'id': 1080943690, 'ino': 1099511629186, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/491.out'}, {'damage_type': 'backtrace', 'id': 1081552231, 'ino': 1099511633182, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/559'}, {'damage_type': 'backtrace', 'id': 1099866180, 'ino': 1099511630726, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/032.out'}, {'damage_type': 'backtrace', 'id': 1139487670, 'ino': 1099511633121, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/501'}, {'damage_type': 'backtrace', 'id': 1165834224, 'ino': 1099511631074, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/201.out'}, {'damage_type': 'backtrace', 'id': 1215276523, 'ino': 1099511628658, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/102.out'}, {'damage_type': 'backtrace', 'id': 1217937204, 'ino': 1099511631467, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/391.out'}, {'damage_type': 'backtrace', 'id': 1222791298, 'ino': 1099511628918, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/357.out'}, {'damage_type': 'backtrace', 'id': 1235407671, 'ino': 1099511630940, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/134.out'}, {'damage_type': 'backtrace', 'id': 1239021142, 'ino': 1099511629278, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/537.out'}, {'damage_type': 'backtrace', 'id': 1239175168, 'ino': 1099511628788, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/167.out'}, {'damage_type': 'backtrace', 'id': 1250169323, 'ino': 1099511631262, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/289.out'}, {'damage_type': 'backtrace', 'id': 1274794263, 'ino': 1099511633188, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/565'}, {'damage_type': 'backtrace', 'id': 1277061171, 'ino': 1099511630874, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/104.out'}, {'damage_type': 'backtrace', 'id': 1295189787, 'ino': 1099511632495, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/136'}, {'damage_type': 'backtrace', 'id': 1308238669, 'ino': 1099511630839, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/087.out'}, {'damage_type': 'backtrace', 'id': 1316058906, 'ino': 1099511632954, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/347'}, {'damage_type': 'backtrace', 'id': 1329266401, 'ino': 1099511632600, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/236'}, {'damage_type': 'backtrace', 'id': 1341080967, 'ino': 1099511631340, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/328.out'}, {'damage_type': 'backtrace', 'id': 1342552314, 'ino': 1099511632455, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/096'}, {'damage_type': 'backtrace', 'id': 1346506185, 'ino': 1099511632584, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/220'}, {'damage_type': 'backtrace', 'id': 1356638679, 'ino': 1099511629989, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/297.out'}, {'damage_type': 'backtrace', 'id': 1384878726, 'ino': 1099511631292, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/304.out'}, {'damage_type': 'backtrace', 'id': 1423855575, 'ino': 1099511632583, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/219'}, {'damage_type': 'backtrace', 'id': 1431872236, 'ino': 1099511630678, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/008.out'}, {'damage_type': 'backtrace', 'id': 1437238386, 'ino': 1099511629030, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/413.out'}, {'damage_type': 'backtrace', 'id': 1467584646, 'ino': 1099511631296, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/306.out'}, {'damage_type': 'backtrace', 'id': 1481036197, 'ino': 1099511631222, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/269.out'}, {'damage_type': 'backtrace', 'id': 1487605899, 'ino': 1099511631282, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/299.out'}, {'damage_type': 'backtrace', 'id': 1489837030, 'ino': 1099511633120, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/500'}, {'damage_type': 'backtrace', 'id': 1514152449, 'ino': 1099511631549, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/432.out'}, {'damage_type': 'backtrace', 'id': 1516430761, 'ino': 1099511631310, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/313.out'}, {'damage_type': 'backtrace', 'id': 1523058312, 'ino': 1099511631082, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/205.out'}, {'damage_type': 'backtrace', 'id': 1542933348, 'ino': 1099511630051, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/540.out'}, {'damage_type': 'backtrace', 'id': 1544206235, 'ino': 1099511633088, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/471'}, {'damage_type': 'backtrace', 'id': 1553062552, 'ino': 1099511631688, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/502.out'}, {'damage_type': 'backtrace', 'id': 1573966306, 'ino': 1099511628529, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/042.out'}, {'damage_type': 'backtrace', 'id': 1591952493, 'ino': 1099511632903, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/296'}, {'damage_type': 'backtrace', 'id': 1593215482, 'ino': 1099511628586, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/066.out'}, {'damage_type': 'backtrace', 'id': 1593521698, 'ino': 1099511630666, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/002.out'}, {'damage_type': 'backtrace', 'id': 1604437220, 'ino': 1099511631218, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/267.out'}, {'damage_type': 'backtrace', 'id': 1605731716, 'ino': 1099511630752, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/044.out'}, {'damage_type': 'backtrace', 'id': 1613880769, 'ino': 1099511628835, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/216.out'}, {'damage_type': 'backtrace', 'id': 1622926604, 'ino': 1099511630005, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/305.out'}, {'damage_type': 'backtrace', 'id': 1629003080, 'ino': 1099511632938, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/331'}, {'damage_type': 'backtrace', 'id': 1630399933, 'ino': 1099511632581, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/217'}, {'damage_type': 'backtrace', 'id': 1636864303, 'ino': 1099511632575, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/211'}, {'damage_type': 'backtrace', 'id': 1647458144, 'ino': 1099511630926, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/127.out'}, {'damage_type': 'backtrace', 'id': 1655733319, 'ino': 1099511629262, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/529.out'}, {'damage_type': 'backtrace', 'id': 1658585098, 'ino': 1099511629991, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/298.out'}, {'damage_type': 'backtrace', 'id': 1667566242, 'ino': 1099511633152, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/530'}, {'damage_type': 'backtrace', 'id': 1673478065, 'ino': 1099511632601, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/237'}, {'damage_type': 'backtrace', 'id': 1677521449, 'ino': 1099511630111, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/570.out'}, {'damage_type': 'backtrace', 'id': 1727729299, 'ino': 1099511631170, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/243.out'}, {'damage_type': 'backtrace', 'id': 1738822320, 'ino': 1099511631501, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/408.out'}, {'damage_type': 'backtrace', 'id': 1758361903, 'ino': 1099511631493, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/404.out'}, {'damage_type': 'backtrace', 'id': 1769860536, 'ino': 1099511632991, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/380'}, {'damage_type': 'backtrace', 'id': 1784921936, 'ino': 1099511633155, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/533'}, {'damage_type': 'backtrace', 'id': 1804075260, 'ino': 1099511628754, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/150.out'}, {'damage_type': 'backtrace', 'id': 1808652880, 'ino': 1099511632915, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/308'}, {'damage_type': 'backtrace', 'id': 1830073160, 'ino': 1099511632515, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/153'}, {'damage_type': 'backtrace', 'id': 1846294589, 'ino': 1099511630146, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/590.out'}, {'damage_type': 'backtrace', 'id': 1879965851, 'ino': 1099511629014, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/405.out'}, {'damage_type': 'backtrace', 'id': 1885723938, 'ino': 1099511632543, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/181'}, {'damage_type': 'backtrace', 'id': 1908144996, 'ino': 1099511628660, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/103.out'}, {'damage_type': 'backtrace', 'id': 1910738882, 'ino': 1099511632588, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/224'}, {'damage_type': 'backtrace', 'id': 1916716589, 'ino': 1099511632468, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/109'}, {'damage_type': 'backtrace', 'id': 1920665674, 'ino': 1099511628650, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/098.out'}, {'damage_type': 'backtrace', 'id': 1923155702, 'ino': 1099511631138, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/232.out'}, {'damage_type': 'backtrace', 'id': 1936628617, 'ino': 1099511631324, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/320.out'}, {'damage_type': 'backtrace', 'id': 1944661797, 'ino': 1099511633081, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/464'}, {'damage_type': 'backtrace', 'id': 1956586486, 'ino': 1099511631459, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/387.out'}, {'damage_type': 'backtrace', 'id': 1971579575, 'ino': 1099511631362, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/339.out'}, {'damage_type': 'backtrace', 'id': 2017136850, 'ino': 1099511631507, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/411.out'}, {'damage_type': 'backtrace', 'id': 2019440721, 'ino': 1099511633009, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/397.out'}, {'damage_type': 'backtrace', 'id': 2038553580, 'ino': 1099511633055, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/439'}, {'damage_type': 'backtrace', 'id': 2043416597, 'ino': 1099511633150, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/528'}, {'damage_type': 'backtrace', 'id': 2051660248, 'ino': 1099511631068, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/198.out'}, {'damage_type': 'backtrace', 'id': 2054632944, 'ino': 1099511632611, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/247'}, {'damage_type': 'backtrace', 'id': 2074507350, 'ino': 1099511629808, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/180.out'}, {'damage_type': 'backtrace', 'id': 2107942867, 'ino': 1099511629798, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/175.out'}, {'damage_type': 'backtrace', 'id': 2124562749, 'ino': 1099511631635, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/475.out'}, {'damage_type': 'backtrace', 'id': 2133426442, 'ino': 1099511632345, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/009'}, {'damage_type': 'backtrace', 'id': 2152640493, 'ino': 1099511632975, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/366'}, {'damage_type': 'backtrace', 'id': 2160729841, 'ino': 1099511630718, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/028.out'}, {'damage_type': 'backtrace', 'id': 2174435291, 'ino': 1099511632596, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/232'}, {'damage_type': 'backtrace', 'id': 2182499443, 'ino': 1099511632491, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/132'}, {'damage_type': 'backtrace', 'id': 2200913390, 'ino': 1099511629969, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/287.out'}, {'damage_type': 'backtrace', 'id': 2242137698, 'ino': 1099511631184, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/250.out'}, {'damage_type': 'backtrace', 'id': 2252300209, 'ino': 1099511630910, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/119.out'}, {'damage_type': 'backtrace', 'id': 2253986122, 'ino': 1099511628946, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/371.out'}, {'damage_type': 'backtrace', 'id': 2267894951, 'ino': 1099511633214, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/586'}, {'damage_type': 'backtrace', 'id': 2315645800, 'ino': 1099511630692, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/015.out'}, {'damage_type': 'backtrace', 'id': 2348511921, 'ino': 1099511628894, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/345.out'}, {'damage_type': 'backtrace', 'id': 2353339327, 'ino': 1099511633092, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/474'}, {'damage_type': 'backtrace', 'id': 2367287058, 'ino': 1099511633144, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/523'}, {'damage_type': 'backtrace', 'id': 2388683504, 'ino': 1099511631100, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/214.out'}, {'damage_type': 'backtrace', 'id': 2394746619, 'ino': 1099511631587, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/451.out'}, {'damage_type': 'backtrace', 'id': 2409582164, 'ino': 1099511632993, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/382'}, {'damage_type': 'backtrace', 'id': 2418547886, 'ino': 1099511630085, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/557.out'}, {'damage_type': 'backtrace', 'id': 2446095729, 'ino': 1099511628682, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/114.out'}, {'damage_type': 'backtrace', 'id': 2467530895, 'ino': 1099511632973, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/364'}, {'damage_type': 'backtrace', 'id': 2494919721, 'ino': 1099511631605, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/460.out'}, {'damage_type': 'backtrace', 'id': 2505685133, 'ino': 1099511633014, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/402'}, {'damage_type': 'backtrace', 'id': 2521267614, 'ino': 1099511631431, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/373.out'}, {'damage_type': 'backtrace', 'id': 2533784286, 'ino': 1099511628588, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/067.out'}, {'damage_type': 'backtrace', 'id': 2549406210, 'ino': 1099511632606, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/242'}, {'damage_type': 'backtrace', 'id': 2575245399, 'ino': 1099511630142, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/588.out'}, {'damage_type': 'backtrace', 'id': 2575465184, 'ino': 1099511631682, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/499.out'}, {'damage_type': 'backtrace', 'id': 2584241356, 'ino': 1099511629804, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/178.out'}, {'damage_type': 'backtrace', 'id': 2587563095, 'ino': 1099511632656, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/292'}, {'damage_type': 'backtrace', 'id': 2603427313, 'ino': 1099511632932, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/325'}, {'damage_type': 'backtrace', 'id': 2608274019, 'ino': 1099511629967, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/286.out'}, {'damage_type': 'backtrace', 'id': 2620981606, 'ino': 1099511632976, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/367'}, {'damage_type': 'backtrace', 'id': 2634965796, 'ino': 1099511631050, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/189.out'}, {'damage_type': 'backtrace', 'id': 2640872145, 'ino': 1099511628515, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/035.out.nfs'}, {'damage_type': 'backtrace', 'id': 2667384368, 'ino': 1099511629921, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/263.out'}, {'damage_type': 'backtrace', 'id': 2674247479, 'ino': 1099511633070, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/453'}, {'damage_type': 'backtrace', 'id': 2697987718, 'ino': 1099511633096, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/478'}, {'damage_type': 'backtrace', 'id': 2711625644, 'ino': 1099511630766, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/051.out'}, {'damage_type': 'backtrace', 'id': 2724233021, 'ino': 1099511628714, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/130.out'}, {'damage_type': 'backtrace', 'id': 2733855586, 'ino': 1099511628942, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/369.out'}, {'damage_type': 'backtrace', 'id': 2741616568, 'ino': 1099511632528, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/166'}, {'damage_type': 'backtrace', 'id': 2744772389, 'ino': 1099511632641, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/277'}, {'damage_type': 'backtrace', 'id': 2745590318, 'ino': 1099511633201, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/575'}, {'damage_type': 'backtrace', 'id': 2759734471, 'ino': 1099511631433, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/374.out'}, {'damage_type': 'backtrace', 'id': 2771487597, 'ino': 1099511628807, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/202.out'}, {'damage_type': 'backtrace', 'id': 2790525734, 'ino': 1099511630918, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/123.out'}, {'damage_type': 'backtrace', 'id': 2795298567, 'ino': 1099511632963, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/354'}, {'damage_type': 'backtrace', 'id': 2802088035, 'ino': 1099511629152, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/474.out'}, {'damage_type': 'backtrace', 'id': 2811393575, 'ino': 1099511633172, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/550'}, {'damage_type': 'backtrace', 'id': 2823040074, 'ino': 1099511628459, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/008.out'}, {'damage_type': 'backtrace', 'id': 2835328690, 'ino': 1099511631403, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/359.out'}, {'damage_type': 'backtrace', 'id': 2840780440, 'ino': 1099511633078, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/461'}, {'damage_type': 'backtrace', 'id': 2849563270, 'ino': 1099511629022, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/409.out'}, {'damage_type': 'backtrace', 'id': 2879047158, 'ino': 1099511633051, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/435.out'}, {'damage_type': 'backtrace', 'id': 2896127113, 'ino': 1099511632924, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/317'}, {'damage_type': 'backtrace', 'id': 2908315454, 'ino': 1099511628831, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/214.out'}, {'damage_type': 'backtrace', 'id': 2917538177, 'ino': 1099511632623, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/259'}, {'damage_type': 'backtrace', 'id': 2918121978, 'ino': 1099511633006, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/395'}, {'damage_type': 'backtrace', 'id': 2918323474, 'ino': 1099511631120, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/223.out'}, {'damage_type': 'backtrace', 'id': 2948513708, 'ino': 1099511631627, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/471.out'}, {'damage_type': 'backtrace', 'id': 2955295231, 'ino': 1099511628827, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/212.out'}, {'damage_type': 'backtrace', 'id': 2962905757, 'ino': 1099511632919, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/312'}, {'damage_type': 'backtrace', 'id': 2967768326, 'ino': 1099511629078, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/437.out'}, {'damage_type': 'backtrace', 'id': 2969110988, 'ino': 1099511633057, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/440.out'}, {'damage_type': 'backtrace', 'id': 2976980220, 'ino': 1099511629170, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/483.out'}, {'damage_type': 'backtrace', 'id': 2982601903, 'ino': 1099511629132, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/464.out'}, {'damage_type': 'backtrace', 'id': 2992639656, 'ino': 1099511629100, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/448.out'}, {'damage_type': 'backtrace', 'id': 2994834917, 'ino': 1099511632567, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/203'}, {'damage_type': 'backtrace', 'id': 3019989974, 'ino': 1099511628746, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/146.out'}, {'damage_type': 'backtrace', 'id': 3065929442, 'ino': 1099511630670, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/004.out'}, {'damage_type': 'backtrace', 'id': 3080000834, 'ino': 1099511628606, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/076.out'}, {'damage_type': 'backtrace', 'id': 3094762100, 'ino': 1099511632484, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/125'}, {'damage_type': 'backtrace', 'id': 3099652051, 'ino': 1099511629232, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/514.out'}, {'damage_type': 'backtrace', 'id': 3117595750, 'ino': 1099511631090, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/209.out'}, {'damage_type': 'backtrace', 'id': 3136253782, 'ino': 1099511632561, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/198'}, {'damage_type': 'backtrace', 'id': 3169138991, 'ino': 1099511632612, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/248'}, {'damage_type': 'backtrace', 'id': 3176167243, 'ino': 1099511629820, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/186.out'}, {'damage_type': 'backtrace', 'id': 3177642833, 'ino': 1099511632647, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/283'}, {'damage_type': 'backtrace', 'id': 3201720634, 'ino': 1099511628958, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/377.out'}, {'damage_type': 'backtrace', 'id': 3202417248, 'ino': 1099511629156, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/476.out'}, {'damage_type': 'backtrace', 'id': 3202658122, 'ino': 1099511630794, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/065.out'}, {'damage_type': 'backtrace', 'id': 3211038363, 'ino': 1099511631284, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/300.out'}, {'damage_type': 'backtrace', 'id': 3231480473, 'ino': 1099511632557, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/194'}, {'damage_type': 'backtrace', 'id': 3240627565, 'ino': 1099511630813, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/074.out'}, {'damage_type': 'backtrace', 'id': 3276273674, 'ino': 1099511630714, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/026.out'}, {'damage_type': 'backtrace', 'id': 3312731990, 'ino': 1099511631190, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/253.out'}, {'damage_type': 'backtrace', 'id': 3335831882, 'ino': 1099511630815, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/075.out'}, {'damage_type': 'backtrace', 'id': 3338352973, 'ino': 1099511628680, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/113.out'}, {'damage_type': 'backtrace', 'id': 3341384694, 'ino': 1099511629148, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/472.out'}, {'damage_type': 'backtrace', 'id': 3343041403, 'ino': 1099511629240, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/518.out'}, {'damage_type': 'backtrace', 'id': 3343386530, 'ino': 1099511628860, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/328.out'}, {'damage_type': 'backtrace', 'id': 3344929642, 'ino': 1099511631393, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/354.out'}, {'damage_type': 'backtrace', 'id': 3367098089, 'ino': 1099511628592, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/069.out'}, {'damage_type': 'backtrace', 'id': 3405267306, 'ino': 1099511631038, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/183.out'}, {'damage_type': 'backtrace', 'id': 3426165730, 'ino': 1099511632570, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/206'}, {'damage_type': 'backtrace', 'id': 3427606720, 'ino': 1099511631342, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/329.out'}, {'damage_type': 'backtrace', 'id': 3432052508, 'ino': 1099511628558, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/052.out'}, {'damage_type': 'backtrace', 'id': 3438542057, 'ino': 1099511632364, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/027'}, {'damage_type': 'backtrace', 'id': 3450151790, 'ino': 1099511628839, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/218.out'}, {'damage_type': 'backtrace', 'id': 3451793096, 'ino': 1099511630684, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/011.out'}, {'damage_type': 'backtrace', 'id': 3467139745, 'ino': 1099511632928, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/321'}, {'damage_type': 'backtrace', 'id': 3510379326, 'ino': 1099511633028, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/415'}, {'damage_type': 'backtrace', 'id': 3519320052, 'ino': 1099511630900, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/114.out'}, {'damage_type': 'backtrace', 'id': 3531752303, 'ino': 1099511630770, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/053.out'}, {'damage_type': 'backtrace', 'id': 3559612422, 'ino': 1099511630009, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/307.out'}, {'damage_type': 'backtrace', 'id': 3581447119, 'ino': 1099511633141, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/520'}, {'damage_type': 'backtrace', 'id': 3582404761, 'ino': 1099511630140, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/587.out'}, {'damage_type': 'backtrace', 'id': 3588549066, 'ino': 1099511631503, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/409.out'}, {'damage_type': 'backtrace', 'id': 3607773775, 'ino': 1099511633163, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/541'}, {'damage_type': 'backtrace', 'id': 3663276724, 'ino': 1099511628833, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/215.out'}, {'damage_type': 'backtrace', 'id': 3682342062, 'ino': 1099511630712, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/025.out'}, {'damage_type': 'backtrace', 'id': 3683945032, 'ino': 1099511632511, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/149'}, {'damage_type': 'backtrace', 'id': 3690465472, 'ino': 1099511631509, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/412.out'}, {'damage_type': 'backtrace', 'id': 3694368025, 'ino': 1099511632366, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/029'}, {'damage_type': 'backtrace', 'id': 3696588253, 'ino': 1099511628756, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/151.out'}, {'damage_type': 'backtrace', 'id': 3698426071, 'ino': 1099511628580, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/063.out'}, {'damage_type': 'backtrace', 'id': 3721440012, 'ino': 1099511632634, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/270'}, {'damage_type': 'backtrace', 'id': 3736446088, 'ino': 1099511633140, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/519'}, {'damage_type': 'backtrace', 'id': 3843147313, 'ino': 1099511628465, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/011.out'}, {'damage_type': 'backtrace', 'id': 3863965186, 'ino': 1099511628778, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/162.out'}, {'damage_type': 'backtrace', 'id': 3871903266, 'ino': 1099511630381, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/579.out'}, {'damage_type': 'backtrace', 'id': 3902156049, 'ino': 1099511633113, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/494'}, {'damage_type': 'backtrace', 'id': 3913624005, 'ino': 1099511629963, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/284.out'}, {'damage_type': 'backtrace', 'id': 3925238585, 'ino': 1099511633114, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/495'}, {'damage_type': 'backtrace', 'id': 3942171670, 'ino': 1099511631096, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/212.out'}, {'damage_type': 'backtrace', 'id': 3957459892, 'ino': 1099511633124, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/503'}, {'damage_type': 'backtrace', 'id': 3961335400, 'ino': 1099511628662, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/104.out'}, {'damage_type': 'backtrace', 'id': 3990911662, 'ino': 1099511628552, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/050.out.default'}, {'damage_type': 'backtrace', 'id': 3991463347, 'ino': 1099511633042, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/428'}, {'damage_type': 'backtrace', 'id': 4001543413, 'ino': 1099511633151, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/529'}, {'damage_type': 'backtrace', 'id': 4002800208, 'ino': 1099511630048, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/200.out'}, {'damage_type': 'backtrace', 'id': 4007090266, 'ino': 1099511631066, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/197.out'}, {'damage_type': 'backtrace', 'id': 4007781039, 'ino': 1099511633312, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.trans_buf'}, {'damage_type': 'backtrace', 'id': 4013840465, 'ino': 1099511631399, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/357.out'}, {'damage_type': 'backtrace', 'id': 4024073838, 'ino': 1099511631086, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/207.out'}, {'damage_type': 'backtrace', 'id': 4038805104, 'ino': 1099511629935, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/270.out'}, {'damage_type': 'backtrace', 'id': 4059353667, 'ino': 1099511631579, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/447.out'}, {'damage_type': 'backtrace', 'id': 4093882647, 'ino': 1099511631621, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/468.out'}, {'damage_type': 'backtrace', 'id': 4145048180, 'ino': 1099511628497, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/027.out'}, {'damage_type': 'backtrace', 'id': 4163509267, 'ino': 1099511631060, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/194.out'}, {'damage_type': 'backtrace', 'id': 4164263704, 'ino': 1099511632925, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/318'}, {'damage_type': 'backtrace', 'id': 4166973065, 'ino': 1099511630089, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/559.out'}, {'damage_type': 'backtrace', 'id': 4201770670, 'ino': 1099511632610, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/246'}, {'damage_type': 'backtrace', 'id': 4203319257, 'ino': 1099511632939, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/332'}, {'damage_type': 'backtrace', 'id': 4206034676, 'ino': 1099511633313, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018.trans_inode'}, {'damage_type': 'backtrace', 'id': 4226144637, 'ino': 1099511629806, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/179.out'}, {'damage_type': 'backtrace', 'id': 4237273788, 'ino': 1099511632549, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/186'}, {'damage_type': 'backtrace', 'id': 4251562313, 'ino': 1099511628934, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/365.out'}, {'damage_type': 'backtrace', 'id': 4262065571, 'ino': 1099511629068, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/432.out'}, {'damage_type': 'backtrace', 'id': 4263344688, 'ino': 1099511633185, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/562'}] 2023-10-18T14:09:17.391 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 2345057, 'ino': 1099511632213, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/pending.dat'}, {'damage_type': 'backtrace', 'id': 18814733, 'ino': 1099511631625, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/470.out'}, {'damage_type': 'backtrace', 'id': 21765670, 'ino': 1099511632113, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/populate'}, {'damage_type': 'backtrace', 'id': 35417343, 'ino': 1099511627789, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD'}, {'damage_type': 'backtrace', 'id': 36325342, 'ino': 1099511630136, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/585.out'}, {'damage_type': 'backtrace', 'id': 52035521, 'ino': 1099511629393, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/dataascii.h'}, {'damage_type': 'backtrace', 'id': 59076168, 'ino': 1099511631376, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/346.out'}, {'damage_type': 'backtrace', 'id': 63104623, 'ino': 1099511628994, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/395.out'}, {'damage_type': 'backtrace', 'id': 76230101, 'ino': 1099511629288, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample'}, {'damage_type': 'backtrace', 'id': 78501597, 'ino': 1099511629818, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/185.out'}, {'damage_type': 'backtrace', 'id': 81502930, 'ino': 1099511629409, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/forker.c'}, {'damage_type': 'backtrace', 'id': 99280910, 'ino': 1099511632204, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/ls_to_copy'}, {'damage_type': 'backtrace', 'id': 116012325, 'ino': 1099511630742, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/039.out'}, {'damage_type': 'backtrace', 'id': 125885476, 'ino': 1099511630866, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/100.out'}, {'damage_type': 'backtrace', 'id': 126884692, 'ino': 1099511629380, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/configs/localhost.config'}, {'damage_type': 'backtrace', 'id': 128056026, 'ino': 1099511629244, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/520.out'}, {'damage_type': 'backtrace', 'id': 132112635, 'ino': 1099511627807, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/tar/Makefile'}, {'damage_type': 'backtrace', 'id': 136786343, 'ino': 1099511629441, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_utilies.m4'}, {'damage_type': 'backtrace', 'id': 136872224, 'ino': 1099511633129, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/508'}, {'damage_type': 'backtrace', 'id': 137084953, 'ino': 1099511629410, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/open_flags.c'}, {'damage_type': 'backtrace', 'id': 147027080, 'ino': 1099511631629, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/472.out'}, {'damage_type': 'backtrace', 'id': 156085629, 'ino': 1099511629362, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/nfs'}, {'damage_type': 'backtrace', 'id': 156124036, 'ino': 1099511628632, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/089.out'}, {'damage_type': 'backtrace', 'id': 160985517, 'ino': 1099511631110, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/218.out'}, {'damage_type': 'backtrace', 'id': 178319610, 'ino': 1099511632670, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/dist'}, {'damage_type': 'backtrace', 'id': 181777886, 'ino': 1099511632156, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_dirattrs.c'}, {'damage_type': 'backtrace', 'id': 196850462, 'ino': 1099511632157, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_dmattr.c'}, {'damage_type': 'backtrace', 'id': 212525071, 'ino': 1099511632397, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src'}, {'damage_type': 'backtrace', 'id': 224921586, 'ino': 1099511632483, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/124'}, {'damage_type': 'backtrace', 'id': 235553526, 'ino': 1099511632668, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data'}, {'damage_type': 'backtrace', 'id': 264706884, 'ino': 1099511633184, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/561'}, {'damage_type': 'backtrace', 'id': 266520406, 'ino': 1099511631118, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/222.out'}, {'damage_type': 'backtrace', 'id': 267533688, 'ino': 1099511632443, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/086'}, {'damage_type': 'backtrace', 'id': 268723583, 'ino': 1099511629440, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_types.m4'}, {'damage_type': 'backtrace', 'id': 278242058, 'ino': 1099511632160, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_fileattr.c'}, {'damage_type': 'backtrace', 'id': 279489221, 'ino': 1099511630706, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/022.out'}, {'damage_type': 'backtrace', 'id': 307346647, 'ino': 1099511632628, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/264'}, {'damage_type': 'backtrace', 'id': 326227622, 'ino': 1099511631455, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/385.out'}, {'damage_type': 'backtrace', 'id': 345891196, 'ino': 1099511632217, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/standard.dat'}, {'damage_type': 'backtrace', 'id': 346767523, 'ino': 1099511629120, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/458.out'}, {'damage_type': 'backtrace', 'id': 351480711, 'ino': 1099511633107, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/488'}, {'damage_type': 'backtrace', 'id': 357494775, 'ino': 1099511628668, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/107.out'}, {'damage_type': 'backtrace', 'id': 360059733, 'ino': 1099511632179, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/probe_hole.c'}, {'damage_type': 'backtrace', 'id': 375695578, 'ino': 1099511633083, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/466'}, {'damage_type': 'backtrace', 'id': 379860756, 'ino': 1099511632393, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/README.auto-qa'}, {'damage_type': 'backtrace', 'id': 380648209, 'ino': 1099511629414, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/str_to_bytes.c'}, {'damage_type': 'backtrace', 'id': 386586157, 'ino': 1099511632151, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/dm_handle.c'}, {'damage_type': 'backtrace', 'id': 389424615, 'ino': 1099511629402, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/string_to_tokens.h'}, {'damage_type': 'backtrace', 'id': 417705142, 'ino': 1099511629790, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks'}, {'damage_type': 'backtrace', 'id': 418147743, 'ino': 1099511627792, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes'}, {'damage_type': 'backtrace', 'id': 420425432, 'ino': 1099511633049, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/434'}, {'damage_type': 'backtrace', 'id': 426901955, 'ino': 1099511632671, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/dist/README'}, {'damage_type': 'backtrace', 'id': 429172273, 'ino': 1099511631318, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/317.out'}, {'damage_type': 'backtrace', 'id': 437930813, 'ino': 1099511631196, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/256.out'}, {'damage_type': 'backtrace', 'id': 439695566, 'ino': 1099511632548, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/185'}, {'damage_type': 'backtrace', 'id': 448165643, 'ino': 1099511633180, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/557'}, {'damage_type': 'backtrace', 'id': 448429699, 'ino': 1099511631094, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/211.out'}, {'damage_type': 'backtrace', 'id': 448977212, 'ino': 1099511632108, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/fuzzy'}, {'damage_type': 'backtrace', 'id': 449194702, 'ino': 1099511627817, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/Makefile'}, {'damage_type': 'backtrace', 'id': 451113501, 'ino': 1099511629128, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/462.out'}, {'damage_type': 'backtrace', 'id': 460063084, 'ino': 1099511632209, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/test_allocinfo_2'}, {'damage_type': 'backtrace', 'id': 460994319, 'ino': 1099511632094, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/btrfs'}, {'damage_type': 'backtrace', 'id': 463514336, 'ino': 1099511630778, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/057.out'}, {'damage_type': 'backtrace', 'id': 488906557, 'ino': 1099511630696, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/017.out'}, {'damage_type': 'backtrace', 'id': 496508111, 'ino': 1099511633662, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/007'}, {'damage_type': 'backtrace', 'id': 500078678, 'ino': 1099511632092, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/xfstests.spec.in'}, {'damage_type': 'backtrace', 'id': 502771305, 'ino': 1099511632207, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/stf'}, {'damage_type': 'backtrace', 'id': 507533329, 'ino': 1099511629318, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/config'}, {'damage_type': 'backtrace', 'id': 508258552, 'ino': 1099511629397, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/install-sh'}, {'damage_type': 'backtrace', 'id': 513794964, 'ino': 1099511629877, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/241.out'}, {'damage_type': 'backtrace', 'id': 542330042, 'ino': 1099511629442, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_uuiddev.m4'}, {'damage_type': 'backtrace', 'id': 547454755, 'ino': 1099511632399, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common'}, {'damage_type': 'backtrace', 'id': 548028193, 'ino': 1099511632508, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/146'}, {'damage_type': 'backtrace', 'id': 560274101, 'ino': 1099511632194, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_fileattr.c'}, {'damage_type': 'backtrace', 'id': 563238746, 'ino': 1099511631226, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/271.out'}, {'damage_type': 'backtrace', 'id': 563527600, 'ino': 1099511632095, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/casefold'}, {'damage_type': 'backtrace', 'id': 568971489, 'ino': 1099511632506, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/144'}, {'damage_type': 'backtrace', 'id': 578753116, 'ino': 1099511633056, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/440'}, {'damage_type': 'backtrace', 'id': 581307609, 'ino': 1099511632073, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/ag-wipe'}, {'damage_type': 'backtrace', 'id': 583604121, 'ino': 1099511628728, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/137.out'}, {'damage_type': 'backtrace', 'id': 584890585, 'ino': 1099511629413, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/random_range.c'}, {'damage_type': 'backtrace', 'id': 586215015, 'ino': 1099511633190, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/567'}, {'damage_type': 'backtrace', 'id': 588879119, 'ino': 1099511631032, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/180.out'}, {'damage_type': 'backtrace', 'id': 598936587, 'ino': 1099511629230, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/513.out'}, {'damage_type': 'backtrace', 'id': 599235343, 'ino': 1099511629364, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/perf'}, {'damage_type': 'backtrace', 'id': 599584380, 'ino': 1099511632225, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mmap_cp.c'}, {'damage_type': 'backtrace', 'id': 606061066, 'ino': 1099511627805, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/Makefile'}, {'damage_type': 'backtrace', 'id': 615948104, 'ino': 1099511628541, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/048.out'}, {'damage_type': 'backtrace', 'id': 627172530, 'ino': 1099511632660, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1'}, {'damage_type': 'backtrace', 'id': 633386592, 'ino': 1099511632248, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_xfslibs.m4'}, {'damage_type': 'backtrace', 'id': 638242767, 'ino': 1099511632214, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/pending_nfs.dat'}, {'damage_type': 'backtrace', 'id': 645761066, 'ino': 1099511632143, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/wbee.c'}, {'damage_type': 'backtrace', 'id': 668244118, 'ino': 1099511633036, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/422'}, {'damage_type': 'backtrace', 'id': 676285501, 'ino': 1099511633210, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/582'}, {'damage_type': 'backtrace', 'id': 697802284, 'ino': 1099511631088, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/208.out'}, {'damage_type': 'backtrace', 'id': 699747252, 'ino': 1099511631463, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/389.out'}, {'damage_type': 'backtrace', 'id': 700129659, 'ino': 1099511631680, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/498.out'}, {'damage_type': 'backtrace', 'id': 702041834, 'ino': 1099511632674, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src'}, {'damage_type': 'backtrace', 'id': 706012603, 'ino': 1099511632180, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/probe_punch_xfsctl_hole.c'}, {'damage_type': 'backtrace', 'id': 727662085, 'ino': 1099511629408, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/file_lock.c'}, {'damage_type': 'backtrace', 'id': 729146628, 'ino': 1099511632657, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/293'}, {'damage_type': 'backtrace', 'id': 747834543, 'ino': 1099511630853, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/094.out'}, {'damage_type': 'backtrace', 'id': 773236190, 'ino': 1099511632394, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/attr'}, {'damage_type': 'backtrace', 'id': 792894682, 'ino': 1099511629222, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/509.out'}, {'damage_type': 'backtrace', 'id': 798871492, 'ino': 1099511631617, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/466.out'}, {'damage_type': 'backtrace', 'id': 799925837, 'ino': 1099511632129, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/write_invis.c'}, {'damage_type': 'backtrace', 'id': 810873148, 'ino': 1099511632152, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/downgrade_right.c'}, {'damage_type': 'backtrace', 'id': 815917515, 'ino': 1099511628670, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/108.out'}, {'damage_type': 'backtrace', 'id': 818471653, 'ino': 1099511629383, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/xfscrash'}, {'damage_type': 'backtrace', 'id': 822686576, 'ino': 1099511632427, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/070'}, {'damage_type': 'backtrace', 'id': 825018502, 'ino': 1099511632914, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/307'}, {'damage_type': 'backtrace', 'id': 836213459, 'ino': 1099511632651, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/287'}, {'damage_type': 'backtrace', 'id': 842771998, 'ino': 1099511627813, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/README'}, {'damage_type': 'backtrace', 'id': 849056503, 'ino': 1099511632123, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/xfs'}, {'damage_type': 'backtrace', 'id': 855810453, 'ino': 1099511632244, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_attrdev.m4'}, {'damage_type': 'backtrace', 'id': 868015638, 'ino': 1099511629289, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample'}, {'damage_type': 'backtrace', 'id': 874052498, 'ino': 1099511631421, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/368.out'}, {'damage_type': 'backtrace', 'id': 875355548, 'ino': 1099511632116, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/rc'}, {'damage_type': 'backtrace', 'id': 887711216, 'ino': 1099511632075, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/compare-failures'}, {'damage_type': 'backtrace', 'id': 889463939, 'ino': 1099511632401, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd'}, {'damage_type': 'backtrace', 'id': 909118318, 'ino': 1099511629292, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample'}, {'damage_type': 'backtrace', 'id': 910333209, 'ino': 1099511632450, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/092'}, {'damage_type': 'backtrace', 'id': 911544802, 'ino': 1099511632663, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/Makefile'}, {'damage_type': 'backtrace', 'id': 924302299, 'ino': 1099511632115, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/quota'}, {'damage_type': 'backtrace', 'id': 940122261, 'ino': 1099511632206, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/run_test'}, {'damage_type': 'backtrace', 'id': 947558783, 'ino': 1099511628535, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/045.out'}, {'damage_type': 'backtrace', 'id': 957511462, 'ino': 1099511631242, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/279.out'}, {'damage_type': 'backtrace', 'id': 985915341, 'ino': 1099511629094, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/445.out'}, {'damage_type': 'backtrace', 'id': 990772219, 'ino': 1099511632128, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/set_return_on_destroy.c'}, {'damage_type': 'backtrace', 'id': 1006643838, 'ino': 1099511629398, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/open_flags.h'}, {'damage_type': 'backtrace', 'id': 1021922310, 'ino': 1099511632389, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/047'}, {'damage_type': 'backtrace', 'id': 1023976415, 'ino': 1099511632507, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/145'}, {'damage_type': 'backtrace', 'id': 1028331153, 'ino': 1099511632591, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/227'}, {'damage_type': 'backtrace', 'id': 1033348745, 'ino': 1099511629979, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/292.out'}, {'damage_type': 'backtrace', 'id': 1036710319, 'ino': 1099511629439, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_pthread.m4'}, {'damage_type': 'backtrace', 'id': 1038737295, 'ino': 1099511631397, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/356.out'}, {'damage_type': 'backtrace', 'id': 1039632325, 'ino': 1099511629411, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/pattern.c'}, {'damage_type': 'backtrace', 'id': 1039691480, 'ino': 1099511632153, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/fd_to_handle.c'}, {'damage_type': 'backtrace', 'id': 1042994543, 'ino': 1099511632243, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/iogen.c'}, {'damage_type': 'backtrace', 'id': 1043859242, 'ino': 1099511631306, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/311.out'}, {'damage_type': 'backtrace', 'id': 1048694305, 'ino': 1099511633669, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/014'}, {'damage_type': 'backtrace', 'id': 1058728963, 'ino': 1099511632189, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/security_hole.c'}, {'damage_type': 'backtrace', 'id': 1062204123, 'ino': 1099511633672, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/017'}, {'damage_type': 'backtrace', 'id': 1062708109, 'ino': 1099511630694, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/016.out'}, {'damage_type': 'backtrace', 'id': 1066870364, 'ino': 1099511629415, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/string_to_tokens.c'}, {'damage_type': 'backtrace', 'id': 1069062917, 'ino': 1099511628718, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/132.out'}, {'damage_type': 'backtrace', 'id': 1072178981, 'ino': 1099511629384, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/auxiliary-programs.txt'}, {'damage_type': 'backtrace', 'id': 1072500703, 'ino': 1099511632191, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_disp.c'}, {'damage_type': 'backtrace', 'id': 1078358378, 'ino': 1099511632198, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/upgrade_right.c'}, {'damage_type': 'backtrace', 'id': 1088875555, 'ino': 1099511632104, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/encrypt'}, {'damage_type': 'backtrace', 'id': 1099012628, 'ino': 1099511632112, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/overlay'}, {'damage_type': 'backtrace', 'id': 1099218838, 'ino': 1099511627796, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/HEAD'}, {'damage_type': 'backtrace', 'id': 1107337025, 'ino': 1099511631244, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/280.out'}, {'damage_type': 'backtrace', 'id': 1108114394, 'ino': 1099511629276, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/536.out'}, {'damage_type': 'backtrace', 'id': 1111917931, 'ino': 1099511631160, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/238.out'}, {'damage_type': 'backtrace', 'id': 1116886406, 'ino': 1099511627791, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs'}, {'damage_type': 'backtrace', 'id': 1117546209, 'ino': 1099511632136, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/README'}, {'damage_type': 'backtrace', 'id': 1129057608, 'ino': 1099511628594, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/070.out'}, {'damage_type': 'backtrace', 'id': 1137141494, 'ino': 1099511627794, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD'}, {'damage_type': 'backtrace', 'id': 1154885349, 'ino': 1099511627787, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes'}, {'damage_type': 'backtrace', 'id': 1158789418, 'ino': 1099511629420, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/aio-stress.c'}, {'damage_type': 'backtrace', 'id': 1159318098, 'ino': 1099511627815, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/CHANGES'}, {'damage_type': 'backtrace', 'id': 1168631388, 'ino': 1099511632900, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/001'}, {'damage_type': 'backtrace', 'id': 1169184141, 'ino': 1099511632956, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/349'}, {'damage_type': 'backtrace', 'id': 1169797437, 'ino': 1099511632121, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/scsi_debug'}, {'damage_type': 'backtrace', 'id': 1178795057, 'ino': 1099511629432, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_gdbmdev.m4'}, {'damage_type': 'backtrace', 'id': 1181076440, 'ino': 1099511629951, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/278.out'}, {'damage_type': 'backtrace', 'id': 1185838679, 'ino': 1099511632221, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/dm_test_daemon.c'}, {'damage_type': 'backtrace', 'id': 1196744198, 'ino': 1099511629412, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/random.c'}, {'damage_type': 'backtrace', 'id': 1204258878, 'ino': 1099511631294, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/305.out'}, {'damage_type': 'backtrace', 'id': 1212837731, 'ino': 1099511628938, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/367.out'}, {'damage_type': 'backtrace', 'id': 1224200212, 'ino': 1099511632122, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/verity'}, {'damage_type': 'backtrace', 'id': 1225305579, 'ino': 1099511632137, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migfind.c'}, {'damage_type': 'backtrace', 'id': 1228825214, 'ino': 1099511630849, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/092.out'}, {'damage_type': 'backtrace', 'id': 1242949608, 'ino': 1099511632099, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmerror'}, {'damage_type': 'backtrace', 'id': 1252339606, 'ino': 1099511629260, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/528.out'}, {'damage_type': 'backtrace', 'id': 1254019093, 'ino': 1099511629794, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/tags'}, {'damage_type': 'backtrace', 'id': 1262116084, 'ino': 1099511632184, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/release_right.c'}, {'damage_type': 'backtrace', 'id': 1280619038, 'ino': 1099511632145, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_destroy_session.c'}, {'damage_type': 'backtrace', 'id': 1287867343, 'ino': 1099511633186, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/563'}, {'damage_type': 'backtrace', 'id': 1297199208, 'ino': 1099511629417, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/write_log.c'}, {'damage_type': 'backtrace', 'id': 1301901136, 'ino': 1099511627790, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs'}, {'damage_type': 'backtrace', 'id': 1311143401, 'ino': 1099511632130, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/dmport.h'}, {'damage_type': 'backtrace', 'id': 1312495557, 'ino': 1099511632141, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/mls.c'}, {'damage_type': 'backtrace', 'id': 1327219029, 'ino': 1099511632163, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/getall_disp.c'}, {'damage_type': 'backtrace', 'id': 1337628162, 'ino': 1099511632168, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/link_test.c'}, {'damage_type': 'backtrace', 'id': 1359996459, 'ino': 1099511632183, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/randomize_file.c'}, {'damage_type': 'backtrace', 'id': 1368238452, 'ino': 1099511629788, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/info'}, {'damage_type': 'backtrace', 'id': 1369416245, 'ino': 1099511631350, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/333.out'}, {'damage_type': 'backtrace', 'id': 1379574376, 'ino': 1099511632172, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_query.c'}, {'damage_type': 'backtrace', 'id': 1379909340, 'ino': 1099511631413, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/364.out'}, {'damage_type': 'backtrace', 'id': 1382666443, 'ino': 1099511632637, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/273'}, {'damage_type': 'backtrace', 'id': 1387595736, 'ino': 1099511628940, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/368.out'}, {'damage_type': 'backtrace', 'id': 1389530927, 'ino': 1099511627798, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master'}, {'damage_type': 'backtrace', 'id': 1399184374, 'ino': 1099511632433, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/076'}, {'damage_type': 'backtrace', 'id': 1404167147, 'ino': 1099511629331, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm/macros.template'}, {'damage_type': 'backtrace', 'id': 1405973113, 'ino': 1099511632241, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/fsstress.c'}, {'damage_type': 'backtrace', 'id': 1415006167, 'ino': 1099511629433, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_globals.m4'}, {'damage_type': 'backtrace', 'id': 1417038738, 'ino': 1099511633142, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/521'}, {'damage_type': 'backtrace', 'id': 1431671376, 'ino': 1099511632162, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_region.c'}, {'damage_type': 'backtrace', 'id': 1433642132, 'ino': 1099511633159, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/537'}, {'damage_type': 'backtrace', 'id': 1444770174, 'ino': 1099511627797, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/heads'}, {'damage_type': 'backtrace', 'id': 1451335781, 'ino': 1099511630103, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/566.out'}, {'damage_type': 'backtrace', 'id': 1465839920, 'ino': 1099511632603, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/239'}, {'damage_type': 'backtrace', 'id': 1470815823, 'ino': 1099511632664, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2'}, {'damage_type': 'backtrace', 'id': 1472314844, 'ino': 1099511628630, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/088.out'}, {'damage_type': 'backtrace', 'id': 1483937997, 'ino': 1099511632677, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/builddefs.in'}, {'damage_type': 'backtrace', 'id': 1488549637, 'ino': 1099511632134, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/stubs.c'}, {'damage_type': 'backtrace', 'id': 1494364386, 'ino': 1099511628976, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/386.out'}, {'damage_type': 'backtrace', 'id': 1518822989, 'ino': 1099511632235, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_invis.c'}, {'damage_type': 'backtrace', 'id': 1529023831, 'ino': 1099511632166, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/handle_to_path.c'}, {'damage_type': 'backtrace', 'id': 1550819921, 'ino': 1099511630724, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/031.out'}, {'damage_type': 'backtrace', 'id': 1553350410, 'ino': 1099511630817, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/076.out'}, {'damage_type': 'backtrace', 'id': 1559707320, 'ino': 1099511629110, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/453.out'}, {'damage_type': 'backtrace', 'id': 1565594661, 'ino': 1099511632593, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/229'}, {'damage_type': 'backtrace', 'id': 1577828781, 'ino': 1099511628843, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/220.out'}, {'damage_type': 'backtrace', 'id': 1590767472, 'ino': 1099511633077, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/460'}, {'damage_type': 'backtrace', 'id': 1610553993, 'ino': 1099511629434, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_libbtrfs.m4'}, {'damage_type': 'backtrace', 'id': 1611567519, 'ino': 1099511628738, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/142.out'}, {'damage_type': 'backtrace', 'id': 1613991024, 'ino': 1099511631272, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/294.out'}, {'damage_type': 'backtrace', 'id': 1618809794, 'ino': 1099511629032, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/414.out'}, {'damage_type': 'backtrace', 'id': 1622780743, 'ino': 1099511633108, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/489'}, {'damage_type': 'backtrace', 'id': 1622937910, 'ino': 1099511631589, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/452.out'}, {'damage_type': 'backtrace', 'id': 1636452869, 'ino': 1099511632173, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_rele.c'}, {'damage_type': 'backtrace', 'id': 1641487868, 'ino': 1099511628896, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/346.out'}, {'damage_type': 'backtrace', 'id': 1652814155, 'ino': 1099511633032, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/419'}, {'damage_type': 'backtrace', 'id': 1660313984, 'ino': 1099511628712, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/129.out'}, {'damage_type': 'backtrace', 'id': 1661820858, 'ino': 1099511632201, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/README'}, {'damage_type': 'backtrace', 'id': 1678994965, 'ino': 1099511632239, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/Makefile'}, {'damage_type': 'backtrace', 'id': 1682632960, 'ino': 1099511628858, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/327.out'}, {'damage_type': 'backtrace', 'id': 1687646520, 'ino': 1099511632676, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/doc/requirement-checking.txt'}, {'damage_type': 'backtrace', 'id': 1690017483, 'ino': 1099511632077, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/db-walk'}, {'damage_type': 'backtrace', 'id': 1692968667, 'ino': 1099511629403, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/tlibio.h'}, {'damage_type': 'backtrace', 'id': 1697080350, 'ino': 1099511629394, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/databin.h'}, {'damage_type': 'backtrace', 'id': 1701610931, 'ino': 1099511631451, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/383.out'}, {'damage_type': 'backtrace', 'id': 1707961420, 'ino': 1099511632675, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/Makefile'}, {'damage_type': 'backtrace', 'id': 1708646884, 'ino': 1099511631449, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/382.out'}, {'damage_type': 'backtrace', 'id': 1709922419, 'ino': 1099511629293, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample'}, {'damage_type': 'backtrace', 'id': 1734654466, 'ino': 1099511632240, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/doio.c'}, {'damage_type': 'backtrace', 'id': 1777606809, 'ino': 1099511632665, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/DMAPI_aliases'}, {'damage_type': 'backtrace', 'id': 1784218312, 'ino': 1099511631674, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/495.out'}, {'damage_type': 'backtrace', 'id': 1787023362, 'ino': 1099511632102, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmthin'}, {'damage_type': 'backtrace', 'id': 1794999047, 'ino': 1099511632154, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_allocinfo.c'}, {'damage_type': 'backtrace', 'id': 1802731051, 'ino': 1099511632147, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_getall_sessions.c'}, {'damage_type': 'backtrace', 'id': 1803212628, 'ino': 1099511632661, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/Makefile'}, {'damage_type': 'backtrace', 'id': 1805802909, 'ino': 1099511632237, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_rights.c'}, {'damage_type': 'backtrace', 'id': 1807522866, 'ino': 1099511629298, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample'}, {'damage_type': 'backtrace', 'id': 1812920708, 'ino': 1099511631541, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/428.out'}, {'damage_type': 'backtrace', 'id': 1828741668, 'ino': 1099511629080, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/438.out'}, {'damage_type': 'backtrace', 'id': 1849551080, 'ino': 1099511632247, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_ncurses.m4'}, {'damage_type': 'backtrace', 'id': 1860675799, 'ino': 1099511627804, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/rpm'}, {'damage_type': 'backtrace', 'id': 1860824977, 'ino': 1099511632643, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/279'}, {'damage_type': 'backtrace', 'id': 1864250441, 'ino': 1099511633102, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/484'}, {'damage_type': 'backtrace', 'id': 1871331559, 'ino': 1099511629096, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/446.out'}, {'damage_type': 'backtrace', 'id': 1887394508, 'ino': 1099511633039, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/425'}, {'damage_type': 'backtrace', 'id': 1888760046, 'ino': 1099511633022, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/409'}, {'damage_type': 'backtrace', 'id': 1906873853, 'ino': 1099511632178, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/print_fshandle.c'}, {'damage_type': 'backtrace', 'id': 1913685294, 'ino': 1099511628463, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/010.out'}, {'damage_type': 'backtrace', 'id': 1919615504, 'ino': 1099511632133, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/print.c'}, {'damage_type': 'backtrace', 'id': 1923817108, 'ino': 1099511632396, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/Makefile'}, {'damage_type': 'backtrace', 'id': 1946484744, 'ino': 1099511628620, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/083.out'}, {'damage_type': 'backtrace', 'id': 1951766435, 'ino': 1099511632487, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/128'}, {'damage_type': 'backtrace', 'id': 1953405202, 'ino': 1099511632245, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_dmapidev.m4'}, {'damage_type': 'backtrace', 'id': 1960006144, 'ino': 1099511632227, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/send_msg.c'}, {'damage_type': 'backtrace', 'id': 1966155956, 'ino': 1099511633170, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/548'}, {'damage_type': 'backtrace', 'id': 1974131548, 'ino': 1099511633041, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/427'}, {'damage_type': 'backtrace', 'id': 1981095959, 'ino': 1099511631487, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/401.out'}, {'damage_type': 'backtrace', 'id': 1992539236, 'ino': 1099511632220, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/check_dmapi.c'}, {'damage_type': 'backtrace', 'id': 2001618610, 'ino': 1099511632159, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_events.c'}, {'damage_type': 'backtrace', 'id': 2018828664, 'ino': 1099511632667, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/crttf'}, {'damage_type': 'backtrace', 'id': 2023043947, 'ino': 1099511629314, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/packed-refs'}, {'damage_type': 'backtrace', 'id': 2028527383, 'ino': 1099511632230, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_dmattr.c'}, {'damage_type': 'backtrace', 'id': 2037234834, 'ino': 1099511633673, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/018'}, {'damage_type': 'backtrace', 'id': 2038351763, 'ino': 1099511629266, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/531.out'}, {'damage_type': 'backtrace', 'id': 2048208421, 'ino': 1099511631178, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/247.out'}, {'damage_type': 'backtrace', 'id': 2062921553, 'ino': 1099511631595, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/455.out'}, {'damage_type': 'backtrace', 'id': 2069123330, 'ino': 1099511633171, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/549'}, {'damage_type': 'backtrace', 'id': 2070642300, 'ino': 1099511632170, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/make_sparse.c'}, {'damage_type': 'backtrace', 'id': 2072838034, 'ino': 1099511628864, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/330.out'}, {'damage_type': 'backtrace', 'id': 2080112809, 'ino': 1099511631308, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/312.out'}, {'damage_type': 'backtrace', 'id': 2085431815, 'ino': 1099511629867, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/236.out'}, {'damage_type': 'backtrace', 'id': 2085606411, 'ino': 1099511629312, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/shallow'}, {'damage_type': 'backtrace', 'id': 2086775435, 'ino': 1099511632905, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/298'}, {'damage_type': 'backtrace', 'id': 2092444770, 'ino': 1099511630970, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/149.out'}, {'damage_type': 'backtrace', 'id': 2095148540, 'ino': 1099511632666, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir'}, {'damage_type': 'backtrace', 'id': 2097894836, 'ino': 1099511631485, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/400.out'}, {'damage_type': 'backtrace', 'id': 2105164348, 'ino': 1099511632551, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/188'}, {'damage_type': 'backtrace', 'id': 2112516595, 'ino': 1099511630720, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/029.out'}, {'damage_type': 'backtrace', 'id': 2116696664, 'ino': 1099511627819, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/Makefile'}, {'damage_type': 'backtrace', 'id': 2122531503, 'ino': 1099511632105, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filestreams'}, {'damage_type': 'backtrace', 'id': 2124020246, 'ino': 1099511631641, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/478.out'}, {'damage_type': 'backtrace', 'id': 2129385038, 'ino': 1099511632216, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/smallq.dat'}, {'damage_type': 'backtrace', 'id': 2140824114, 'ino': 1099511629052, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/424.out'}, {'damage_type': 'backtrace', 'id': 2146169379, 'ino': 1099511628574, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/060.out'}, {'damage_type': 'backtrace', 'id': 2162533110, 'ino': 1099511629296, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample'}, {'damage_type': 'backtrace', 'id': 2164046968, 'ino': 1099511632120, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/report'}, {'damage_type': 'backtrace', 'id': 2167370121, 'ino': 1099511632233, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_fileattr.c'}, {'damage_type': 'backtrace', 'id': 2184341316, 'ino': 1099511632114, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/punch'}, {'damage_type': 'backtrace', 'id': 2189109500, 'ino': 1099511628596, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/071.out'}, {'damage_type': 'backtrace', 'id': 2197327014, 'ino': 1099511629297, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample'}, {'damage_type': 'backtrace', 'id': 2197846670, 'ino': 1099511632232, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_eventlist.c'}, {'damage_type': 'backtrace', 'id': 2198024339, 'ino': 1099511629840, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/196.out'}, {'damage_type': 'backtrace', 'id': 2201254194, 'ino': 1099511629382, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/crash/rc.sysinit'}, {'damage_type': 'backtrace', 'id': 2209274001, 'ino': 1099511632103, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dump'}, {'damage_type': 'backtrace', 'id': 2211920068, 'ino': 1099511629401, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/str_to_bytes.h'}, {'damage_type': 'backtrace', 'id': 2219334248, 'ino': 1099511629345, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmhugedisk'}, {'damage_type': 'backtrace', 'id': 2221359930, 'ino': 1099511629444, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/visibility_hidden.m4'}, {'damage_type': 'backtrace', 'id': 2228199502, 'ino': 1099511632127, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/set_region.c'}, {'damage_type': 'backtrace', 'id': 2229562332, 'ino': 1099511632142, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/mrmean.c'}, {'damage_type': 'backtrace', 'id': 2246607251, 'ino': 1099511631320, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/318.out'}, {'damage_type': 'backtrace', 'id': 2252473155, 'ino': 1099511632908, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/301'}, {'damage_type': 'backtrace', 'id': 2261663644, 'ino': 1099511632212, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/nfs.dat'}, {'damage_type': 'backtrace', 'id': 2266234733, 'ino': 1099511629406, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/databin.c'}, {'damage_type': 'backtrace', 'id': 2276602568, 'ino': 1099511629200, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/498.out'}, {'damage_type': 'backtrace', 'id': 2290929763, 'ino': 1099511632231, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_efault.c'}, {'damage_type': 'backtrace', 'id': 2291369688, 'ino': 1099511632229, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_bulkattr.c'}, {'damage_type': 'backtrace', 'id': 2292261133, 'ino': 1099511632594, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/230'}, {'damage_type': 'backtrace', 'id': 2293005062, 'ino': 1099511629102, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/449.out'}, {'damage_type': 'backtrace', 'id': 2301532005, 'ino': 1099511631387, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/351.out'}, {'damage_type': 'backtrace', 'id': 2310798003, 'ino': 1099511629295, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample'}, {'damage_type': 'backtrace', 'id': 2318087532, 'ino': 1099511632226, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/region_test.c'}, {'damage_type': 'backtrace', 'id': 2321137721, 'ino': 1099511629340, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/defrag'}, {'damage_type': 'backtrace', 'id': 2323391735, 'ino': 1099511632398, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/Makefile'}, {'damage_type': 'backtrace', 'id': 2336433697, 'ino': 1099511631092, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/210.out'}, {'damage_type': 'backtrace', 'id': 2352470083, 'ino': 1099511627785, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack'}, {'damage_type': 'backtrace', 'id': 2362190334, 'ino': 1099511629060, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/428.out'}, {'damage_type': 'backtrace', 'id': 2400249934, 'ino': 1099511631539, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/427.out'}, {'damage_type': 'backtrace', 'id': 2410548601, 'ino': 1099511629216, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/506.out'}, {'damage_type': 'backtrace', 'id': 2421665172, 'ino': 1099511632402, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/Makefile'}, {'damage_type': 'backtrace', 'id': 2424663158, 'ino': 1099511631062, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/195.out'}, {'damage_type': 'backtrace', 'id': 2429127431, 'ino': 1099511632242, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/fsx.c'}, {'damage_type': 'backtrace', 'id': 2437844450, 'ino': 1099511632218, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/standard_nfs.dat'}, {'damage_type': 'backtrace', 'id': 2441193998, 'ino': 1099511627803, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/Makefile'}, {'damage_type': 'backtrace', 'id': 2443729570, 'ino': 1099511629400, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/random_range.h'}, {'damage_type': 'backtrace', 'id': 2449850926, 'ino': 1099511631575, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/445.out'}, {'damage_type': 'backtrace', 'id': 2450935375, 'ino': 1099511633098, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/480'}, {'damage_type': 'backtrace', 'id': 2460798266, 'ino': 1099511632989, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/378'}, {'damage_type': 'backtrace', 'id': 2461738764, 'ino': 1099511632633, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/269'}, {'damage_type': 'backtrace', 'id': 2469787851, 'ino': 1099511632174, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/path_to_fshandle.c'}, {'damage_type': 'backtrace', 'id': 2481797898, 'ino': 1099511629226, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/511.out'}, {'damage_type': 'backtrace', 'id': 2490801150, 'ino': 1099511632219, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/menu_test'}, {'damage_type': 'backtrace', 'id': 2506246858, 'ino': 1099511630001, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/303.out'}, {'damage_type': 'backtrace', 'id': 2521884431, 'ino': 1099511629234, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/515.out'}, {'damage_type': 'backtrace', 'id': 2527330157, 'ino': 1099511632199, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/function_coverage'}, {'damage_type': 'backtrace', 'id': 2531837989, 'ino': 1099511632981, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/372'}, {'damage_type': 'backtrace', 'id': 2533503955, 'ino': 1099511631004, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/166.out'}, {'damage_type': 'backtrace', 'id': 2536244430, 'ino': 1099511632148, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_getall_tokens.c'}, {'damage_type': 'backtrace', 'id': 2538229183, 'ino': 1099511632234, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_hole.c'}, {'damage_type': 'backtrace', 'id': 2541582032, 'ino': 1099511627806, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/build/tar'}, {'damage_type': 'backtrace', 'id': 2554041841, 'ino': 1099511632181, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/punch_hole.c'}, {'damage_type': 'backtrace', 'id': 2562301716, 'ino': 1099511629359, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/locktest'}, {'damage_type': 'backtrace', 'id': 2579209102, 'ino': 1099511629425, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/growfiles.c'}, {'damage_type': 'backtrace', 'id': 2589235566, 'ino': 1099511632146, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_find_eventmsg.c'}, {'damage_type': 'backtrace', 'id': 2591557182, 'ino': 1099511632187, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/respond_event.c'}, {'damage_type': 'backtrace', 'id': 2597855528, 'ino': 1099511628853, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/225.out'}, {'damage_type': 'backtrace', 'id': 2605949535, 'ino': 1099511632202, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/README_for_check_dmapi'}, {'damage_type': 'backtrace', 'id': 2608404275, 'ino': 1099511631206, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/261.out'}, {'damage_type': 'backtrace', 'id': 2621630548, 'ino': 1099511632110, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/log'}, {'damage_type': 'backtrace', 'id': 2631746028, 'ino': 1099511630138, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/586.out'}, {'damage_type': 'backtrace', 'id': 2636545277, 'ino': 1099511629291, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample'}, {'damage_type': 'backtrace', 'id': 2649100979, 'ino': 1099511632400, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/Makefile'}, {'damage_type': 'backtrace', 'id': 2654114702, 'ino': 1099511632158, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_eventlist.c'}, {'damage_type': 'backtrace', 'id': 2657188151, 'ino': 1099511630928, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/128.out'}, {'damage_type': 'backtrace', 'id': 2659301386, 'ino': 1099511629375, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/test_names'}, {'damage_type': 'backtrace', 'id': 2670190008, 'ino': 1099511628539, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/047.out'}, {'damage_type': 'backtrace', 'id': 2672810243, 'ino': 1099511632098, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmdelay'}, {'damage_type': 'backtrace', 'id': 2680078098, 'ino': 1099511631515, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/415.out'}, {'damage_type': 'backtrace', 'id': 2684763236, 'ino': 1099511627783, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack'}, {'damage_type': 'backtrace', 'id': 2694228259, 'ino': 1099511628920, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/358.out'}, {'damage_type': 'backtrace', 'id': 2705040832, 'ino': 1099511632414, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/057'}, {'damage_type': 'backtrace', 'id': 2709440673, 'ino': 1099511630774, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/055.out'}, {'damage_type': 'backtrace', 'id': 2711225033, 'ino': 1099511631535, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/425.out'}, {'damage_type': 'backtrace', 'id': 2718558595, 'ino': 1099511630101, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/565.out'}, {'damage_type': 'backtrace', 'id': 2725106707, 'ino': 1099511632597, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/233'}, {'damage_type': 'backtrace', 'id': 2729744391, 'ino': 1099511632936, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/329'}, {'damage_type': 'backtrace', 'id': 2739140427, 'ino': 1099511630782, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/059.out'}, {'damage_type': 'backtrace', 'id': 2741019838, 'ino': 1099511632109, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/inject'}, {'damage_type': 'backtrace', 'id': 2752922573, 'ino': 1099511632236, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_region.c'}, {'damage_type': 'backtrace', 'id': 2772110443, 'ino': 1099511631461, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/388.out'}, {'damage_type': 'backtrace', 'id': 2774391838, 'ino': 1099511629294, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample'}, {'damage_type': 'backtrace', 'id': 2774450343, 'ino': 1099511633031, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/418'}, {'damage_type': 'backtrace', 'id': 2791316934, 'ino': 1099511629428, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/manual_format.m4'}, {'damage_type': 'backtrace', 'id': 2811520518, 'ino': 1099511632190, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/security_hole2.c'}, {'damage_type': 'backtrace', 'id': 2812861177, 'ino': 1099511632119, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/repair'}, {'damage_type': 'backtrace', 'id': 2822442761, 'ino': 1099511632659, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/Makefile'}, {'damage_type': 'backtrace', 'id': 2828287980, 'ino': 1099511629873, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/239.out'}, {'damage_type': 'backtrace', 'id': 2859067649, 'ino': 1099511632155, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_config_events.c'}, {'damage_type': 'backtrace', 'id': 2875410018, 'ino': 1099511629290, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/update.sample'}, {'damage_type': 'backtrace', 'id': 2883371993, 'ino': 1099511628855, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/226.out'}, {'damage_type': 'backtrace', 'id': 2898250833, 'ino': 1099511631457, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/386.out'}, {'damage_type': 'backtrace', 'id': 2903511801, 'ino': 1099511628489, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/023.out'}, {'damage_type': 'backtrace', 'id': 2918676258, 'ino': 1099511633165, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/543'}, {'damage_type': 'backtrace', 'id': 2926622738, 'ino': 1099511627795, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/heads/master'}, {'damage_type': 'backtrace', 'id': 2934492185, 'ino': 1099511632192, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_dmattr.c'}, {'damage_type': 'backtrace', 'id': 2953150033, 'ino': 1099511632478, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/119'}, {'damage_type': 'backtrace', 'id': 2958488067, 'ino': 1099511630843, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/089.out'}, {'damage_type': 'backtrace', 'id': 2969460228, 'ino': 1099511632193, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/set_eventlist.c'}, {'damage_type': 'backtrace', 'id': 2972879463, 'ino': 1099511633044, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/429.out'}, {'damage_type': 'backtrace', 'id': 3006533893, 'ino': 1099511632425, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/068'}, {'damage_type': 'backtrace', 'id': 3013960526, 'ino': 1099511632188, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/rwt.c'}, {'damage_type': 'backtrace', 'id': 3014915570, 'ino': 1099511632196, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/sync_by_handle.c'}, {'damage_type': 'backtrace', 'id': 3025994982, 'ino': 1099511632126, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/cmd/read_invis.c'}, {'damage_type': 'backtrace', 'id': 3057733878, 'ino': 1099511630855, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/095.out'}, {'damage_type': 'backtrace', 'id': 3069515423, 'ino': 1099511633060, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/443'}, {'damage_type': 'backtrace', 'id': 3090041948, 'ino': 1099511627793, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin'}, {'damage_type': 'backtrace', 'id': 3091231892, 'ino': 1099511631702, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/509.out'}, {'damage_type': 'backtrace', 'id': 3101360435, 'ino': 1099511631194, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/255.out'}, {'damage_type': 'backtrace', 'id': 3102876958, 'ino': 1099511632673, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/lib/errtest.h'}, {'damage_type': 'backtrace', 'id': 3105849138, 'ino': 1099511632228, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/test_bulkall.c'}, {'damage_type': 'backtrace', 'id': 3111275276, 'ino': 1099511631704, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/510.out'}, {'damage_type': 'backtrace', 'id': 3112933776, 'ino': 1099511631302, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/309.out'}, {'damage_type': 'backtrace', 'id': 3120343544, 'ino': 1099511629000, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/398.out'}, {'damage_type': 'backtrace', 'id': 3121519329, 'ino': 1099511631497, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/406.out'}, {'damage_type': 'backtrace', 'id': 3123694953, 'ino': 1099511632117, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/reflink'}, {'damage_type': 'backtrace', 'id': 3124834572, 'ino': 1099511629405, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/dataascii.c'}, {'damage_type': 'backtrace', 'id': 3139898213, 'ino': 1099511632953, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/346'}, {'damage_type': 'backtrace', 'id': 3142106760, 'ino': 1099511628780, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/163.out'}, {'damage_type': 'backtrace', 'id': 3146054022, 'ino': 1099511629941, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/273.out'}, {'damage_type': 'backtrace', 'id': 3160628712, 'ino': 1099511629399, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/pattern.h'}, {'damage_type': 'backtrace', 'id': 3168820018, 'ino': 1099511632097, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmapi'}, {'damage_type': 'backtrace', 'id': 3178208065, 'ino': 1099511629198, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/497.out'}, {'damage_type': 'backtrace', 'id': 3193828082, 'ino': 1099511632408, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/051'}, {'damage_type': 'backtrace', 'id': 3197982621, 'ino': 1099511632223, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mm_fill.c'}, {'damage_type': 'backtrace', 'id': 3209675222, 'ino': 1099511632164, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/getall_dmattr.c'}, {'damage_type': 'backtrace', 'id': 3216815387, 'ino': 1099511628968, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/382.out'}, {'damage_type': 'backtrace', 'id': 3216883654, 'ino': 1099511632169, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/make_rt_sparse.c'}, {'damage_type': 'backtrace', 'id': 3226891776, 'ino': 1099511629404, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/write_log.h'}, {'damage_type': 'backtrace', 'id': 3231939609, 'ino': 1099511630740, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/038.out'}, {'damage_type': 'backtrace', 'id': 3245839726, 'ino': 1099511631370, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/343.out'}, {'damage_type': 'backtrace', 'id': 3246761975, 'ino': 1099511632658, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple'}, {'damage_type': 'backtrace', 'id': 3248362805, 'ino': 1099511629212, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/504.out'}, {'damage_type': 'backtrace', 'id': 3258885749, 'ino': 1099511632904, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/297'}, {'damage_type': 'backtrace', 'id': 3261273748, 'ino': 1099511632131, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/find_session.c'}, {'damage_type': 'backtrace', 'id': 3262990852, 'ino': 1099511632118, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/renameat2'}, {'damage_type': 'backtrace', 'id': 3276731158, 'ino': 1099511629114, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/455.out'}, {'damage_type': 'backtrace', 'id': 3281146348, 'ino': 1099511633075, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/458'}, {'damage_type': 'backtrace', 'id': 3288082289, 'ino': 1099511632100, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmflakey'}, {'damage_type': 'backtrace', 'id': 3292398960, 'ino': 1099511632999, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/388'}, {'damage_type': 'backtrace', 'id': 3293204102, 'ino': 1099511630150, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/592.out'}, {'damage_type': 'backtrace', 'id': 3298433805, 'ino': 1099511629299, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample'}, {'damage_type': 'backtrace', 'id': 3299487874, 'ino': 1099511632208, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/test_allocinfo_1'}, {'damage_type': 'backtrace', 'id': 3303327713, 'ino': 1099511632994, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/383'}, {'damage_type': 'backtrace', 'id': 3304650473, 'ino': 1099511632559, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/196'}, {'damage_type': 'backtrace', 'id': 3306079283, 'ino': 1099511631672, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/494.out'}, {'damage_type': 'backtrace', 'id': 3309604927, 'ino': 1099511632096, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/config'}, {'damage_type': 'backtrace', 'id': 3310118620, 'ino': 1099511632944, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/337'}, {'damage_type': 'backtrace', 'id': 3310307825, 'ino': 1099511631551, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/433.out'}, {'damage_type': 'backtrace', 'id': 3318525093, 'ino': 1099511632404, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/Makefile'}, {'damage_type': 'backtrace', 'id': 3318835982, 'ino': 1099511632132, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/hsm.h'}, {'damage_type': 'backtrace', 'id': 3320801692, 'ino': 1099511629196, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/496.out'}, {'damage_type': 'backtrace', 'id': 3323569170, 'ino': 1099511629287, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/description'}, {'damage_type': 'backtrace', 'id': 3364299425, 'ino': 1099511629048, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/422.out'}, {'damage_type': 'backtrace', 'id': 3374971539, 'ino': 1099511628491, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/024.out'}, {'damage_type': 'backtrace', 'id': 3380293506, 'ino': 1099511632624, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/260'}, {'damage_type': 'backtrace', 'id': 3381944278, 'ino': 1099511631234, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/275.out'}, {'damage_type': 'backtrace', 'id': 3398153068, 'ino': 1099511628724, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/135.out'}, {'damage_type': 'backtrace', 'id': 3399540191, 'ino': 1099511632678, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/Makefile'}, {'damage_type': 'backtrace', 'id': 3438942891, 'ino': 1099511632197, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/test_assumption.c'}, {'damage_type': 'backtrace', 'id': 3440766770, 'ino': 1099511631064, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/196.out'}, {'damage_type': 'backtrace', 'id': 3445250360, 'ino': 1099511629427, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/rwtest.sh'}, {'damage_type': 'backtrace', 'id': 3451481850, 'ino': 1099511632205, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/make_holey'}, {'damage_type': 'backtrace', 'id': 3461840086, 'ino': 1099511627811, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/configs/example.config'}, {'damage_type': 'backtrace', 'id': 3461911781, 'ino': 1099511633080, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/463'}, {'damage_type': 'backtrace', 'id': 3463949271, 'ino': 1099511632135, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib/util.c'}, {'damage_type': 'backtrace', 'id': 3470867422, 'ino': 1099511632920, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/313'}, {'damage_type': 'backtrace', 'id': 3491152234, 'ino': 1099511627782, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects'}, {'damage_type': 'backtrace', 'id': 3496874457, 'ino': 1099511632203, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/bindir/ctf'}, {'damage_type': 'backtrace', 'id': 3507477181, 'ino': 1099511631336, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/326.out'}, {'damage_type': 'backtrace', 'id': 3510862706, 'ino': 1099511632195, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/struct_test.c'}, {'damage_type': 'backtrace', 'id': 3530839227, 'ino': 1099511629395, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/file_lock.h'}, {'damage_type': 'backtrace', 'id': 3547875882, 'ino': 1099511632106, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filter'}, {'damage_type': 'backtrace', 'id': 3562275879, 'ino': 1099511628750, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/148.out'}, {'damage_type': 'backtrace', 'id': 3568315008, 'ino': 1099511631577, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/446.out'}, {'damage_type': 'backtrace', 'id': 3578869738, 'ino': 1099511627809, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/Makefile'}, {'damage_type': 'backtrace', 'id': 3594141634, 'ino': 1099511628916, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/356.out'}, {'damage_type': 'backtrace', 'id': 3599144300, 'ino': 1099511632211, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/main.dat'}, {'damage_type': 'backtrace', 'id': 3601636700, 'ino': 1099511632440, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/083'}, {'damage_type': 'backtrace', 'id': 3604006873, 'ino': 1099511629391, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/buildmacros'}, {'damage_type': 'backtrace', 'id': 3612913236, 'ino': 1099511629392, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/buildrules'}, {'damage_type': 'backtrace', 'id': 3641877175, 'ino': 1099511632165, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/handle_to_fshandle.c'}, {'damage_type': 'backtrace', 'id': 3648296259, 'ino': 1099511629162, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/479.out'}, {'damage_type': 'backtrace', 'id': 3665930018, 'ino': 1099511633013, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/401'}, {'damage_type': 'backtrace', 'id': 3672661163, 'ino': 1099511629134, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/465.out'}, {'damage_type': 'backtrace', 'id': 3677988300, 'ino': 1099511632405, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm'}, {'damage_type': 'backtrace', 'id': 3683021204, 'ino': 1099511630768, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/052.out'}, {'damage_type': 'backtrace', 'id': 3695661119, 'ino': 1099511629429, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/multilib.m4'}, {'damage_type': 'backtrace', 'id': 3696495951, 'ino': 1099511628568, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/057.out'}, {'damage_type': 'backtrace', 'id': 3710155920, 'ino': 1099511632929, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/322'}, {'damage_type': 'backtrace', 'id': 3712724985, 'ino': 1099511632672, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/lib'}, {'damage_type': 'backtrace', 'id': 3721427728, 'ino': 1099511629416, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/tlibio.c'}, {'damage_type': 'backtrace', 'id': 3741748526, 'ino': 1099511632669, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/fail.dat'}, {'damage_type': 'backtrace', 'id': 3752199539, 'ino': 1099511632246, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_libcdev.m4'}, {'damage_type': 'backtrace', 'id': 3757454452, 'ino': 1099511632222, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/invis_test.c'}, {'damage_type': 'backtrace', 'id': 3766029741, 'ino': 1099511632111, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/module'}, {'damage_type': 'backtrace', 'id': 3772739687, 'ino': 1099511629338, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/cgroup2'}, {'damage_type': 'backtrace', 'id': 3779176208, 'ino': 1099511632171, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/obj_ref_hold.c'}, {'damage_type': 'backtrace', 'id': 3779673269, 'ino': 1099511629792, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs'}, {'damage_type': 'backtrace', 'id': 3802085066, 'ino': 1099511632662, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd'}, {'damage_type': 'backtrace', 'id': 3813288859, 'ino': 1099511632210, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/create_cpio'}, {'damage_type': 'backtrace', 'id': 3837487250, 'ino': 1099511632464, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/105'}, {'damage_type': 'backtrace', 'id': 3842077863, 'ino': 1099511632175, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/path_to_handle.c'}, {'damage_type': 'backtrace', 'id': 3846501030, 'ino': 1099511627788, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/remotes/origin'}, {'damage_type': 'backtrace', 'id': 3853496240, 'ino': 1099511632176, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/pending.c'}, {'damage_type': 'backtrace', 'id': 3856004631, 'ino': 1099511632185, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/remove_dmattr.c'}, {'damage_type': 'backtrace', 'id': 3859321636, 'ino': 1099511632150, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/create_userevent.c'}, {'damage_type': 'backtrace', 'id': 3888461168, 'ino': 1099511632592, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/228'}, {'damage_type': 'backtrace', 'id': 3903992450, 'ino': 1099511629430, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_acldev.m4'}, {'damage_type': 'backtrace', 'id': 3913356263, 'ino': 1099511632149, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_query_session.c'}, {'damage_type': 'backtrace', 'id': 3915216873, 'ino': 1099511630821, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/078.out'}, {'damage_type': 'backtrace', 'id': 3917315269, 'ino': 1099511632182, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/query_right.c'}, {'damage_type': 'backtrace', 'id': 3917493118, 'ino': 1099511632215, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/data/realtime.dat'}, {'damage_type': 'backtrace', 'id': 3929664208, 'ino': 1099511632167, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/init_service.c'}, {'damage_type': 'backtrace', 'id': 3931396377, 'ino': 1099511632107, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/filter.btrfs'}, {'damage_type': 'backtrace', 'id': 3932510617, 'ino': 1099511627786, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx'}, {'damage_type': 'backtrace', 'id': 3934827748, 'ino': 1099511628974, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/385.out'}, {'damage_type': 'backtrace', 'id': 3947604659, 'ino': 1099511628471, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/014.out'}, {'damage_type': 'backtrace', 'id': 3950164777, 'ino': 1099511632125, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/README'}, {'damage_type': 'backtrace', 'id': 3958295795, 'ino': 1099511631571, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/443.out'}, {'damage_type': 'backtrace', 'id': 3960146991, 'ino': 1099511632144, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/simple/dm_create_session.c'}, {'damage_type': 'backtrace', 'id': 3991726227, 'ino': 1099511629092, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/444.out'}, {'damage_type': 'backtrace', 'id': 3996031263, 'ino': 1099511629072, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/434.out'}, {'damage_type': 'backtrace', 'id': 3999495133, 'ino': 1099511629431, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/m4/package_aiodev.m4'}, {'damage_type': 'backtrace', 'id': 3999640913, 'ino': 1099511630130, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/582.out'}, {'damage_type': 'backtrace', 'id': 4017606081, 'ino': 1099511629396, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/include/forker.h'}, {'damage_type': 'backtrace', 'id': 4019489878, 'ino': 1099511632101, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/common/dmlogwrites'}, {'damage_type': 'backtrace', 'id': 4026927121, 'ino': 1099511632349, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/013'}, {'damage_type': 'backtrace', 'id': 4028042795, 'ino': 1099511631142, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/234.out'}, {'damage_type': 'backtrace', 'id': 4052680394, 'ino': 1099511629923, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/264.out'}, {'damage_type': 'backtrace', 'id': 4058372603, 'ino': 1099511631288, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/302.out'}, {'damage_type': 'backtrace', 'id': 4061198890, 'ino': 1099511632986, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/375'}, {'damage_type': 'backtrace', 'id': 4062992821, 'ino': 1099511629270, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/533.out'}, {'damage_type': 'backtrace', 'id': 4070814570, 'ino': 1099511630884, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/109.out'}, {'damage_type': 'backtrace', 'id': 4075117263, 'ino': 1099511629793, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/refs/heads'}, {'damage_type': 'backtrace', 'id': 4078605351, 'ino': 1099511632224, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/src/mmap.c'}, {'damage_type': 'backtrace', 'id': 4083485776, 'ino': 1099511631188, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/252.out'}, {'damage_type': 'backtrace', 'id': 4099581048, 'ino': 1099511632081, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/interop'}, {'damage_type': 'backtrace', 'id': 4109292730, 'ino': 1099511632139, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migout.c'}, {'damage_type': 'backtrace', 'id': 4110406692, 'ino': 1099511629789, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/info/exclude'}, {'damage_type': 'backtrace', 'id': 4111404366, 'ino': 1099511632200, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite2/Makefile'}, {'damage_type': 'backtrace', 'id': 4114848442, 'ino': 1099511628570, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/058.out'}, {'damage_type': 'backtrace', 'id': 4116014183, 'ino': 1099511629977, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/291.out'}, {'damage_type': 'backtrace', 'id': 4120756007, 'ino': 1099511631537, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/426.out'}, {'damage_type': 'backtrace', 'id': 4123890945, 'ino': 1099511632161, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/get_mountinfo.c'}, {'damage_type': 'backtrace', 'id': 4128834406, 'ino': 1099511633050, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/435'}, {'damage_type': 'backtrace', 'id': 4138948063, 'ino': 1099511632510, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/148'}, {'damage_type': 'backtrace', 'id': 4146579585, 'ino': 1099511632403, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/common/lib'}, {'damage_type': 'backtrace', 'id': 4169715852, 'ino': 1099511632406, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/Makefile'}, {'damage_type': 'backtrace', 'id': 4173364855, 'ino': 1099511629791, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample'}, {'damage_type': 'backtrace', 'id': 4174587989, 'ino': 1099511632353, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/017'}, {'damage_type': 'backtrace', 'id': 4185528519, 'ino': 1099511633196, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/572'}, {'damage_type': 'backtrace', 'id': 4202668207, 'ino': 1099511631366, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/341.out'}, {'damage_type': 'backtrace', 'id': 4207675309, 'ino': 1099511629076, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/436.out'}, {'damage_type': 'backtrace', 'id': 4209237004, 'ino': 1099511629422, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/ltp/doio.h'}, {'damage_type': 'backtrace', 'id': 4221471888, 'ino': 1099511633137, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/516'}, {'damage_type': 'backtrace', 'id': 4223554864, 'ino': 1099511633181, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/558'}, {'damage_type': 'backtrace', 'id': 4231837032, 'ino': 1099511628672, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/109.out'}, {'damage_type': 'backtrace', 'id': 4231854753, 'ino': 1099511631557, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/xfs/436.out'}, {'damage_type': 'backtrace', 'id': 4232143938, 'ino': 1099511633059, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tests/generic/442'}, {'damage_type': 'backtrace', 'id': 4235198455, 'ino': 1099511629286, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/branches'}, {'damage_type': 'backtrace', 'id': 4257720125, 'ino': 1099511632138, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/sample_hsm/migin.c'}, {'damage_type': 'backtrace', 'id': 4269627748, 'ino': 1099511629407, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/lib/datapid.c'}, {'damage_type': 'backtrace', 'id': 4272495690, 'ino': 1099511627784, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/.git/objects/info'}, {'damage_type': 'backtrace', 'id': 4282207535, 'ino': 1099511632079, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/tools/fs-walk'}, {'damage_type': 'backtrace', 'id': 4285478250, 'ino': 1099511632186, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/request_right.c'}, {'damage_type': 'backtrace', 'id': 4293485891, 'ino': 1099511632177, 'path': '/volumes/_nogroup/sv_1/613810c7-990b-4e91-aaf2-48e4fc84828c/client.0/tmp/xfstests-dev/dmapi/src/suite1/cmd/print_event.c'}] 2023-10-18T14:09:17.392 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2023-10-18T14:09:19.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:18 smithi158 ceph-mon[103317]: pgmap v439: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-18T14:09:19.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:18 smithi172 ceph-mon[103574]: pgmap v439: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-18T14:09:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:18 smithi114 ceph-mon[99494]: pgmap v439: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-18T14:09:21.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:20 smithi158 ceph-mon[103317]: pgmap v440: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 11 op/s 2023-10-18T14:09:21.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:20 smithi172 ceph-mon[103574]: pgmap v440: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 11 op/s 2023-10-18T14:09:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:20 smithi114 ceph-mon[99494]: pgmap v440: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 11 op/s 2023-10-18T14:09:23.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:22 smithi158 ceph-mon[103317]: pgmap v441: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-18T14:09:23.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:22 smithi172 ceph-mon[103574]: pgmap v441: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-18T14:09:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:22 smithi114 ceph-mon[99494]: pgmap v441: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-18T14:09:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:24 smithi158 ceph-mon[103317]: pgmap v442: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:09:24.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:24 smithi172 ceph-mon[103574]: pgmap v442: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:09:24.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:24 smithi114 ceph-mon[99494]: pgmap v442: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:09:27.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:26 smithi158 ceph-mon[103317]: pgmap v443: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-18T14:09:27.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:26 smithi172 ceph-mon[103574]: pgmap v443: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-18T14:09:27.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:26 smithi114 ceph-mon[99494]: pgmap v443: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-18T14:09:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:28 smithi158 ceph-mon[103317]: pgmap v444: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:09:29.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:28 smithi172 ceph-mon[103574]: pgmap v444: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:09:29.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:28 smithi114 ceph-mon[99494]: pgmap v444: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:09:31.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:30 smithi158 ceph-mon[103317]: pgmap v445: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:09:31.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:30 smithi172 ceph-mon[103574]: pgmap v445: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:09:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:30 smithi114 ceph-mon[99494]: pgmap v445: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:09:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:32 smithi158 ceph-mon[103317]: pgmap v446: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:09:33.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:32 smithi172 ceph-mon[103574]: pgmap v446: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:09:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:32 smithi114 ceph-mon[99494]: pgmap v446: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:09:34.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:34 smithi158 ceph-mon[103317]: pgmap v447: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:09:34.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:34 smithi172 ceph-mon[103574]: pgmap v447: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:09:34.839 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:34 smithi114 ceph-mon[99494]: pgmap v447: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:09:37.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:36 smithi158 ceph-mon[103317]: pgmap v448: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-18T14:09:37.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:36 smithi172 ceph-mon[103574]: pgmap v448: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-18T14:09:37.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:36 smithi114 ceph-mon[99494]: pgmap v448: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-18T14:09:39.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:38 smithi158 ceph-mon[103317]: pgmap v449: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:09:39.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:38 smithi172 ceph-mon[103574]: pgmap v449: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:09:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:38 smithi114 ceph-mon[99494]: pgmap v449: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:09:41.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:40 smithi158 ceph-mon[103317]: pgmap v450: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:09:41.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:40 smithi172 ceph-mon[103574]: pgmap v450: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:09:41.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:40 smithi114 ceph-mon[99494]: pgmap v450: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:09:43.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:42 smithi158 ceph-mon[103317]: pgmap v451: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:09:43.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:42 smithi172 ceph-mon[103574]: pgmap v451: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:09:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:42 smithi114 ceph-mon[99494]: pgmap v451: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:09:44.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:44 smithi158 ceph-mon[103317]: pgmap v452: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:09:44.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:44 smithi172 ceph-mon[103574]: pgmap v452: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:09:44.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:44 smithi114 ceph-mon[99494]: pgmap v452: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:09:47.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:46 smithi158 ceph-mon[103317]: pgmap v453: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-18T14:09:47.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:46 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:09:47.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:46 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:09:47.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:46 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:09:47.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:46 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:09:47.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:46 smithi172 ceph-mon[103574]: pgmap v453: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-18T14:09:47.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:46 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:09:47.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:46 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:09:47.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:46 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:09:47.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:46 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:09:47.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:46 smithi114 ceph-mon[99494]: pgmap v453: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-18T14:09:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:46 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:09:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:46 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:09:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:46 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:09:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:46 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:09:49.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:48 smithi158 ceph-mon[103317]: pgmap v454: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:09:49.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:48 smithi172 ceph-mon[103574]: pgmap v454: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:09:49.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:48 smithi114 ceph-mon[99494]: pgmap v454: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:09:51.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:50 smithi158 ceph-mon[103317]: pgmap v455: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:09:51.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:50 smithi172 ceph-mon[103574]: pgmap v455: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:09:51.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:50 smithi114 ceph-mon[99494]: pgmap v455: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:09:53.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:52 smithi158 ceph-mon[103317]: pgmap v456: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:09:53.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:52 smithi172 ceph-mon[103574]: pgmap v456: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:09:53.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:52 smithi114 ceph-mon[99494]: pgmap v456: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:09:54.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:54 smithi158 ceph-mon[103317]: pgmap v457: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:09:54.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:54 smithi172 ceph-mon[103574]: pgmap v457: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:09:54.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:54 smithi114 ceph-mon[99494]: pgmap v457: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:09:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:56 smithi158 ceph-mon[103317]: pgmap v458: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-18T14:09:57.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:56 smithi172 ceph-mon[103574]: pgmap v458: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-18T14:09:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:56 smithi114 ceph-mon[99494]: pgmap v458: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-10-18T14:09:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:09:58 smithi158 ceph-mon[103317]: pgmap v459: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:09:59.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:09:58 smithi172 ceph-mon[103574]: pgmap v459: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:09:59.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:09:58 smithi114 ceph-mon[99494]: pgmap v459: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:10:00.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a[99470]: 2023-10-18T14:09:59.999+0000 7fdd357d7700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 4 MDSs report damaged metadata 2023-10-18T14:10:00.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a[99470]: 2023-10-18T14:09:59.999+0000 7fdd357d7700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 4 MDSs report damaged metadata 2023-10-18T14:10:00.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a[99470]: 2023-10-18T14:09:59.999+0000 7fdd357d7700 -1 log_channel(cluster) log [ERR] : mds.a(mds.4): Metadata damage detected 2023-10-18T14:10:00.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a[99470]: 2023-10-18T14:09:59.999+0000 7fdd357d7700 -1 log_channel(cluster) log [ERR] : mds.b(mds.3): Metadata damage detected 2023-10-18T14:10:00.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a[99470]: 2023-10-18T14:09:59.999+0000 7fdd357d7700 -1 log_channel(cluster) log [ERR] : mds.f(mds.2): Metadata damage detected 2023-10-18T14:10:00.340 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a[99470]: 2023-10-18T14:09:59.999+0000 7fdd357d7700 -1 log_channel(cluster) log [ERR] : mds.c(mds.1): Metadata damage detected 2023-10-18T14:10:01.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:00 smithi158 ceph-mon[103317]: pgmap v460: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:10:01.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:00 smithi158 ceph-mon[103317]: Health detail: HEALTH_ERR 4 MDSs report damaged metadata 2023-10-18T14:10:01.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:00 smithi158 ceph-mon[103317]: [ERR] MDS_DAMAGE: 4 MDSs report damaged metadata 2023-10-18T14:10:01.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:00 smithi158 ceph-mon[103317]: mds.a(mds.4): Metadata damage detected 2023-10-18T14:10:01.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:00 smithi158 ceph-mon[103317]: mds.b(mds.3): Metadata damage detected 2023-10-18T14:10:01.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:00 smithi158 ceph-mon[103317]: mds.f(mds.2): Metadata damage detected 2023-10-18T14:10:01.023 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:00 smithi158 ceph-mon[103317]: mds.c(mds.1): Metadata damage detected 2023-10-18T14:10:01.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:00 smithi172 ceph-mon[103574]: pgmap v460: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:10:01.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:00 smithi172 ceph-mon[103574]: Health detail: HEALTH_ERR 4 MDSs report damaged metadata 2023-10-18T14:10:01.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:00 smithi172 ceph-mon[103574]: [ERR] MDS_DAMAGE: 4 MDSs report damaged metadata 2023-10-18T14:10:01.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:00 smithi172 ceph-mon[103574]: mds.a(mds.4): Metadata damage detected 2023-10-18T14:10:01.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:00 smithi172 ceph-mon[103574]: mds.b(mds.3): Metadata damage detected 2023-10-18T14:10:01.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:00 smithi172 ceph-mon[103574]: mds.f(mds.2): Metadata damage detected 2023-10-18T14:10:01.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:00 smithi172 ceph-mon[103574]: mds.c(mds.1): Metadata damage detected 2023-10-18T14:10:01.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:00 smithi114 ceph-mon[99494]: pgmap v460: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:10:01.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:00 smithi114 ceph-mon[99494]: Health detail: HEALTH_ERR 4 MDSs report damaged metadata 2023-10-18T14:10:01.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:00 smithi114 ceph-mon[99494]: [ERR] MDS_DAMAGE: 4 MDSs report damaged metadata 2023-10-18T14:10:01.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:00 smithi114 ceph-mon[99494]: mds.a(mds.4): Metadata damage detected 2023-10-18T14:10:01.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:00 smithi114 ceph-mon[99494]: mds.b(mds.3): Metadata damage detected 2023-10-18T14:10:01.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:00 smithi114 ceph-mon[99494]: mds.f(mds.2): Metadata damage detected 2023-10-18T14:10:01.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:00 smithi114 ceph-mon[99494]: mds.c(mds.1): Metadata damage detected 2023-10-18T14:10:03.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:02 smithi158 ceph-mon[103317]: pgmap v461: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 22 op/s 2023-10-18T14:10:03.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:02 smithi172 ceph-mon[103574]: pgmap v461: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 22 op/s 2023-10-18T14:10:03.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:02 smithi114 ceph-mon[99494]: pgmap v461: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 22 op/s 2023-10-18T14:10:04.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:04 smithi158 ceph-mon[103317]: pgmap v462: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-18T14:10:04.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:04 smithi172 ceph-mon[103574]: pgmap v462: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-18T14:10:04.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:04 smithi114 ceph-mon[99494]: pgmap v462: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-18T14:10:07.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:06 smithi158 ceph-mon[103317]: pgmap v463: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-10-18T14:10:07.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:06 smithi172 ceph-mon[103574]: pgmap v463: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-10-18T14:10:07.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:06 smithi114 ceph-mon[99494]: pgmap v463: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-10-18T14:10:09.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:08 smithi158 ceph-mon[103317]: pgmap v464: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-18T14:10:09.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:08 smithi172 ceph-mon[103574]: pgmap v464: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-18T14:10:09.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:08 smithi114 ceph-mon[99494]: pgmap v464: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-18T14:10:11.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:10 smithi158 ceph-mon[103317]: pgmap v465: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-10-18T14:10:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:10 smithi172 ceph-mon[103574]: pgmap v465: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-10-18T14:10:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:10 smithi114 ceph-mon[99494]: pgmap v465: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-10-18T14:10:13.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:12 smithi158 ceph-mon[103317]: pgmap v466: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-10-18T14:10:13.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:12 smithi172 ceph-mon[103574]: pgmap v466: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-10-18T14:10:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:12 smithi114 ceph-mon[99494]: pgmap v466: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-10-18T14:10:14.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:14 smithi158 ceph-mon[103317]: pgmap v467: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-18T14:10:14.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:14 smithi172 ceph-mon[103574]: pgmap v467: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-18T14:10:14.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:14 smithi114 ceph-mon[99494]: pgmap v467: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-18T14:10:17.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:16 smithi158 ceph-mon[103317]: pgmap v468: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2023-10-18T14:10:17.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:16 smithi172 ceph-mon[103574]: pgmap v468: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2023-10-18T14:10:17.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:16 smithi114 ceph-mon[99494]: pgmap v468: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2023-10-18T14:10:19.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:18 smithi158 ceph-mon[103317]: pgmap v469: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-10-18T14:10:19.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:18 smithi172 ceph-mon[103574]: pgmap v469: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-10-18T14:10:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:18 smithi114 ceph-mon[99494]: pgmap v469: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2023-10-18T14:10:21.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:20 smithi158 ceph-mon[103317]: pgmap v470: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-18T14:10:21.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:20 smithi172 ceph-mon[103574]: pgmap v470: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-18T14:10:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:20 smithi114 ceph-mon[99494]: pgmap v470: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-18T14:10:23.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:22 smithi158 ceph-mon[103317]: pgmap v471: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-18T14:10:23.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:22 smithi172 ceph-mon[103574]: pgmap v471: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-18T14:10:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:22 smithi114 ceph-mon[99494]: pgmap v471: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-18T14:10:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:24 smithi158 ceph-mon[103317]: pgmap v472: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:24.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:24 smithi172 ceph-mon[103574]: pgmap v472: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:24.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:24 smithi114 ceph-mon[99494]: pgmap v472: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:27.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:26 smithi158 ceph-mon[103317]: pgmap v473: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:27.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:26 smithi172 ceph-mon[103574]: pgmap v473: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:27.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:26 smithi114 ceph-mon[99494]: pgmap v473: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:28 smithi158 ceph-mon[103317]: pgmap v474: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:10:29.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:28 smithi172 ceph-mon[103574]: pgmap v474: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:10:29.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:28 smithi114 ceph-mon[99494]: pgmap v474: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-18T14:10:31.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:30 smithi158 ceph-mon[103317]: pgmap v475: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:10:31.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:30 smithi172 ceph-mon[103574]: pgmap v475: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:10:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:30 smithi114 ceph-mon[99494]: pgmap v475: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:10:33.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:32 smithi158 ceph-mon[103317]: pgmap v476: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:33.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:32 smithi172 ceph-mon[103574]: pgmap v476: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:32 smithi114 ceph-mon[99494]: pgmap v476: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:34.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:34 smithi158 ceph-mon[103317]: pgmap v477: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:34.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:34 smithi172 ceph-mon[103574]: pgmap v477: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:34.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:34 smithi114 ceph-mon[99494]: pgmap v477: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:37.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:36 smithi158 ceph-mon[103317]: pgmap v478: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:37.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:36 smithi172 ceph-mon[103574]: pgmap v478: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:37.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:36 smithi114 ceph-mon[99494]: pgmap v478: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:38.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:37 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:10:38.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:37 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:10:38.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:37 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:10:39.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:38 smithi158 ceph-mon[103317]: pgmap v479: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:10:39.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:38 smithi172 ceph-mon[103574]: pgmap v479: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:10:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:38 smithi114 ceph-mon[99494]: pgmap v479: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:10:41.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:40 smithi158 ceph-mon[103317]: pgmap v480: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:10:41.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:40 smithi172 ceph-mon[103574]: pgmap v480: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:10:41.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:40 smithi114 ceph-mon[99494]: pgmap v480: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-18T14:10:43.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:42 smithi158 ceph-mon[103317]: pgmap v481: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:43.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:42 smithi172 ceph-mon[103574]: pgmap v481: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:42 smithi114 ceph-mon[99494]: pgmap v481: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:44.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:44 smithi158 ceph-mon[103317]: pgmap v482: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:44.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:44 smithi172 ceph-mon[103574]: pgmap v482: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:44.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:44 smithi114 ceph-mon[99494]: pgmap v482: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:47.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:46 smithi158 ceph-mon[103317]: pgmap v483: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:47.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:46 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:10:47.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:46 smithi172 ceph-mon[103574]: pgmap v483: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:47.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:46 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:10:47.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:46 smithi114 ceph-mon[99494]: pgmap v483: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:47.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:46 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:10:48.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:47 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:10:48.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:47 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:10:48.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:47 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:10:48.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:47 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:10:48.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:47 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:10:48.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:47 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:10:48.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:47 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:10:48.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:47 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:10:48.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:47 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:10:49.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:48 smithi158 ceph-mon[103317]: pgmap v484: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:10:49.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:48 smithi172 ceph-mon[103574]: pgmap v484: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:10:49.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:48 smithi114 ceph-mon[99494]: pgmap v484: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:10:51.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:50 smithi158 ceph-mon[103317]: pgmap v485: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:51.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:50 smithi172 ceph-mon[103574]: pgmap v485: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:51.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:50 smithi114 ceph-mon[99494]: pgmap v485: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:53.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:52 smithi158 ceph-mon[103317]: pgmap v486: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:53.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:52 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:10:53.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:52 smithi172 ceph-mon[103574]: pgmap v486: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:53.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:52 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:10:53.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:52 smithi114 ceph-mon[99494]: pgmap v486: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:53.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:52 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:10:54.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:54 smithi158 ceph-mon[103317]: pgmap v487: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:54.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:54 smithi172 ceph-mon[103574]: pgmap v487: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:54.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:54 smithi114 ceph-mon[99494]: pgmap v487: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:10:57.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:56 smithi158 ceph-mon[103317]: pgmap v488: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:57.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:56 smithi172 ceph-mon[103574]: pgmap v488: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:56 smithi114 ceph-mon[99494]: pgmap v488: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:10:58.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:57 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:10:58.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:57 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:10:58.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:57 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:10:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:10:58 smithi158 ceph-mon[103317]: pgmap v489: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:10:59.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:10:58 smithi172 ceph-mon[103574]: pgmap v489: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:10:59.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:10:58 smithi114 ceph-mon[99494]: pgmap v489: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:11:01.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:00 smithi158 ceph-mon[103317]: pgmap v490: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:01.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:00 smithi172 ceph-mon[103574]: pgmap v490: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:01.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:00 smithi114 ceph-mon[99494]: pgmap v490: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:03.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:02 smithi158 ceph-mon[103317]: pgmap v491: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 KiB/s wr, 23 op/s 2023-10-18T14:11:03.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:02 smithi172 ceph-mon[103574]: pgmap v491: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 KiB/s wr, 23 op/s 2023-10-18T14:11:03.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:02 smithi114 ceph-mon[99494]: pgmap v491: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 KiB/s wr, 23 op/s 2023-10-18T14:11:05.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:04 smithi172 ceph-mon[103574]: pgmap v492: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-18T14:11:05.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:04 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:05.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:04 smithi114 ceph-mon[99494]: pgmap v492: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-18T14:11:05.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:04 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:05.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:04 smithi158 ceph-mon[103317]: pgmap v492: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-18T14:11:05.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:04 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:07.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:06 smithi172 ceph-mon[103574]: pgmap v493: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-10-18T14:11:07.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:06 smithi114 ceph-mon[99494]: pgmap v493: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-10-18T14:11:07.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:06 smithi158 ceph-mon[103317]: pgmap v493: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-10-18T14:11:08.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:07 smithi172 ceph-mon[103574]: osdmap e87: 12 total, 12 up, 12 in 2023-10-18T14:11:08.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:07 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:08.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:07 smithi114 ceph-mon[99494]: osdmap e87: 12 total, 12 up, 12 in 2023-10-18T14:11:08.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:07 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:08.275 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:07 smithi158 ceph-mon[103317]: osdmap e87: 12 total, 12 up, 12 in 2023-10-18T14:11:08.276 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:07 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:09.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:08 smithi172 ceph-mon[103574]: pgmap v495: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-18T14:11:09.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:08 smithi114 ceph-mon[99494]: pgmap v495: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-18T14:11:09.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:08 smithi158 ceph-mon[103317]: pgmap v495: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-18T14:11:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:10 smithi172 ceph-mon[103574]: pgmap v496: 97 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 63 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-18T14:11:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:10 smithi114 ceph-mon[99494]: pgmap v496: 97 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 63 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-18T14:11:11.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:10 smithi158 ceph-mon[103317]: pgmap v496: 97 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 63 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-18T14:11:12.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:11 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:12.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:11 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:12.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:11 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:12 smithi114 ceph-mon[99494]: pgmap v497: 97 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 63 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 28 KiB/s wr, 14 op/s 2023-10-18T14:11:13.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:12 smithi158 ceph-mon[103317]: pgmap v497: 97 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 63 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 28 KiB/s wr, 14 op/s 2023-10-18T14:11:13.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:12 smithi172 ceph-mon[103574]: pgmap v497: 97 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 63 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 28 KiB/s wr, 14 op/s 2023-10-18T14:11:14.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:14 smithi158 ceph-mon[103317]: pgmap v498: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-18T14:11:14.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:14 smithi172 ceph-mon[103574]: pgmap v498: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-18T14:11:14.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:14 smithi114 ceph-mon[99494]: pgmap v498: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-18T14:11:17.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:16 smithi158 ceph-mon[103317]: pgmap v499: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:11:17.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:16 smithi172 ceph-mon[103574]: pgmap v499: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:11:17.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:16 smithi114 ceph-mon[99494]: pgmap v499: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:11:19.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:18 smithi158 ceph-mon[103317]: pgmap v500: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 187 B/s wr, 11 op/s 2023-10-18T14:11:19.022 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:18 smithi158 ceph-mon[103317]: osdmap e88: 12 total, 12 up, 12 in 2023-10-18T14:11:19.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:18 smithi172 ceph-mon[103574]: pgmap v500: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 187 B/s wr, 11 op/s 2023-10-18T14:11:19.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:18 smithi172 ceph-mon[103574]: osdmap e88: 12 total, 12 up, 12 in 2023-10-18T14:11:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:18 smithi114 ceph-mon[99494]: pgmap v500: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 187 B/s wr, 11 op/s 2023-10-18T14:11:19.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:18 smithi114 ceph-mon[99494]: osdmap e88: 12 total, 12 up, 12 in 2023-10-18T14:11:21.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:20 smithi158 ceph-mon[103317]: pgmap v502: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:11:21.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:20 smithi172 ceph-mon[103574]: pgmap v502: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:11:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:20 smithi114 ceph-mon[99494]: pgmap v502: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:11:22.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:21 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:22.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:21 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:22.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:21 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:23.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:22 smithi172 ceph-mon[103574]: pgmap v503: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:11:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:22 smithi114 ceph-mon[99494]: pgmap v503: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:11:23.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:22 smithi158 ceph-mon[103317]: pgmap v503: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:11:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:24 smithi158 ceph-mon[103317]: pgmap v504: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:11:24.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:24 smithi172 ceph-mon[103574]: pgmap v504: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:11:24.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:24 smithi114 ceph-mon[99494]: pgmap v504: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:11:27.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:26 smithi158 ceph-mon[103317]: pgmap v505: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:11:27.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:26 smithi172 ceph-mon[103574]: pgmap v505: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:11:27.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:26 smithi114 ceph-mon[99494]: pgmap v505: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:11:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:28 smithi158 ceph-mon[103317]: pgmap v506: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:11:29.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:28 smithi172 ceph-mon[103574]: pgmap v506: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:11:29.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:28 smithi114 ceph-mon[99494]: pgmap v506: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:11:30.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:29 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:30.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:29 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:30.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:29 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:31.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:30 smithi172 ceph-mon[103574]: pgmap v507: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2023-10-18T14:11:31.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:30 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:30 smithi114 ceph-mon[99494]: pgmap v507: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2023-10-18T14:11:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:30 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:31.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:30 smithi158 ceph-mon[103317]: pgmap v507: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2023-10-18T14:11:31.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:30 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:33.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:32 smithi172 ceph-mon[103574]: pgmap v508: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:32 smithi114 ceph-mon[99494]: pgmap v508: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:33.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:32 smithi158 ceph-mon[103317]: pgmap v508: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:35.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:34 smithi172 ceph-mon[103574]: pgmap v509: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:35.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:34 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:35.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:34 smithi114 ceph-mon[99494]: pgmap v509: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:35.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:34 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:35.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:34 smithi158 ceph-mon[103317]: pgmap v509: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:35.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:34 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:37.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:36 smithi172 ceph-mon[103574]: pgmap v510: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:37.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:36 smithi114 ceph-mon[99494]: pgmap v510: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:37.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:36 smithi158 ceph-mon[103317]: pgmap v510: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:38.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:37 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:38.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:37 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:38.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:37 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:39.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:38 smithi172 ceph-mon[103574]: pgmap v511: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:11:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:38 smithi114 ceph-mon[99494]: pgmap v511: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:11:39.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:38 smithi158 ceph-mon[103317]: pgmap v511: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:11:41.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:40 smithi114 ceph-mon[99494]: pgmap v512: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:41.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:40 smithi158 ceph-mon[103317]: pgmap v512: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:41.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:40 smithi172 ceph-mon[103574]: pgmap v512: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:42.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:41 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:42.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:41 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:42.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:41 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:42 smithi114 ceph-mon[99494]: pgmap v513: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:43.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:42 smithi158 ceph-mon[103317]: pgmap v513: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:43.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:42 smithi172 ceph-mon[103574]: pgmap v513: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:44.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:44 smithi158 ceph-mon[103317]: pgmap v514: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:44.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:44 smithi172 ceph-mon[103574]: pgmap v514: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:44.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:44 smithi114 ceph-mon[99494]: pgmap v514: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:47.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:46 smithi158 ceph-mon[103317]: pgmap v515: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:47.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:46 smithi172 ceph-mon[103574]: pgmap v515: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:47.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:46 smithi114 ceph-mon[99494]: pgmap v515: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:48.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:47 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:11:48.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:47 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:11:48.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:47 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:11:49.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: pgmap v516: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:11:49.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi158 to 196.2M 2023-10-18T14:11:49.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi114 to 196.2M 2023-10-18T14:11:49.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: Unable to set osd_memory_target on smithi158 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-18T14:11:49.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: Unable to set osd_memory_target on smithi114 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-18T14:11:49.063 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:11:49.063 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:11:49.063 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:11:49.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: pgmap v516: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:11:49.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi158 to 196.2M 2023-10-18T14:11:49.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi114 to 196.2M 2023-10-18T14:11:49.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: Unable to set osd_memory_target on smithi158 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-18T14:11:49.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: Unable to set osd_memory_target on smithi114 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-18T14:11:49.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:11:49.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:11:49.092 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:11:49.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: pgmap v516: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:11:49.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:11:49.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi158 to 196.2M 2023-10-18T14:11:49.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi114 to 196.2M 2023-10-18T14:11:49.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: Unable to set osd_memory_target on smithi158 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-18T14:11:49.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: Unable to set osd_memory_target on smithi114 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-18T14:11:49.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:11:49.275 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:11:49.275 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:11:50.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:49 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:50.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:49 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:50.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:49 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:51.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:50 smithi172 ceph-mon[103574]: pgmap v517: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:51.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:50 smithi114 ceph-mon[99494]: pgmap v517: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:51.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:50 smithi158 ceph-mon[103317]: pgmap v517: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:53.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:52 smithi172 ceph-mon[103574]: pgmap v518: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:53.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:52 smithi114 ceph-mon[99494]: pgmap v518: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:53.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:52 smithi158 ceph-mon[103317]: pgmap v518: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:54.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:54 smithi158 ceph-mon[103317]: pgmap v519: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:54.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:54 smithi172 ceph-mon[103574]: pgmap v519: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:54.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:54 smithi114 ceph-mon[99494]: pgmap v519: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:11:55.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:55 smithi158 ceph-mon[103317]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:55.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:55 smithi172 ceph-mon[103574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:55.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:55 smithi114 ceph-mon[99494]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-18T14:11:56.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:56 smithi158 ceph-mon[103317]: pgmap v520: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:56.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:56 smithi172 ceph-mon[103574]: pgmap v520: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:56.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:56 smithi114 ceph-mon[99494]: pgmap v520: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:11:59.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:11:58 smithi158 ceph-mon[103317]: pgmap v521: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:11:59.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:11:58 smithi172 ceph-mon[103574]: pgmap v521: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:11:59.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:11:58 smithi114 ceph-mon[99494]: pgmap v521: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:12:01.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:00 smithi172 ceph-mon[103574]: pgmap v522: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:12:01.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:00 smithi114 ceph-mon[99494]: pgmap v522: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:12:01.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:00 smithi158 ceph-mon[103317]: pgmap v522: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:12:03.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:02 smithi172 ceph-mon[103574]: pgmap v523: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 19 op/s 2023-10-18T14:12:03.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:02 smithi114 ceph-mon[99494]: pgmap v523: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 19 op/s 2023-10-18T14:12:03.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:02 smithi158 ceph-mon[103317]: pgmap v523: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 19 op/s 2023-10-18T14:12:04.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:04 smithi158 ceph-mon[103317]: pgmap v524: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 20 op/s 2023-10-18T14:12:04.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:04 smithi172 ceph-mon[103574]: pgmap v524: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 20 op/s 2023-10-18T14:12:04.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:04 smithi114 ceph-mon[99494]: pgmap v524: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 KiB/s wr, 20 op/s 2023-10-18T14:12:07.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:06 smithi172 ceph-mon[103574]: pgmap v525: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-18T14:12:07.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:06 smithi114 ceph-mon[99494]: pgmap v525: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-18T14:12:07.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:06 smithi158 ceph-mon[103317]: pgmap v525: 97 pgs: 97 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-18T14:12:08.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:07 smithi172 ceph-mon[103574]: osdmap e89: 12 total, 12 up, 12 in 2023-10-18T14:12:08.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:07 smithi114 ceph-mon[99494]: osdmap e89: 12 total, 12 up, 12 in 2023-10-18T14:12:08.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:07 smithi158 ceph-mon[103317]: osdmap e89: 12 total, 12 up, 12 in 2023-10-18T14:12:09.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:08 smithi172 ceph-mon[103574]: pgmap v527: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:12:09.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:08 smithi114 ceph-mon[99494]: pgmap v527: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:12:09.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:08 smithi158 ceph-mon[103317]: pgmap v527: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 93 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:12:11.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:10 smithi172 ceph-mon[103574]: pgmap v528: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:12:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:10 smithi114 ceph-mon[99494]: pgmap v528: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:12:11.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:10 smithi158 ceph-mon[103317]: pgmap v528: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:12:13.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:12 smithi172 ceph-mon[103574]: pgmap v529: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 41 KiB/s wr, 19 op/s 2023-10-18T14:12:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:12 smithi114 ceph-mon[99494]: pgmap v529: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 41 KiB/s wr, 19 op/s 2023-10-18T14:12:13.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:12 smithi158 ceph-mon[103317]: pgmap v529: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 41 KiB/s wr, 19 op/s 2023-10-18T14:12:14.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:14 smithi158 ceph-mon[103317]: pgmap v530: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 14 KiB/s wr, 16 op/s 2023-10-18T14:12:14.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:14 smithi172 ceph-mon[103574]: pgmap v530: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 14 KiB/s wr, 16 op/s 2023-10-18T14:12:14.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:14 smithi114 ceph-mon[99494]: pgmap v530: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 14 KiB/s wr, 16 op/s 2023-10-18T14:12:17.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:16 smithi172 ceph-mon[103574]: pgmap v531: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:12:17.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:16 smithi114 ceph-mon[99494]: pgmap v531: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:12:17.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:16 smithi158 ceph-mon[103317]: pgmap v531: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:12:19.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:18 smithi172 ceph-mon[103574]: pgmap v532: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 11 op/s 2023-10-18T14:12:19.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:18 smithi172 ceph-mon[103574]: osdmap e90: 12 total, 12 up, 12 in 2023-10-18T14:12:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:18 smithi114 ceph-mon[99494]: pgmap v532: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 11 op/s 2023-10-18T14:12:19.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:18 smithi114 ceph-mon[99494]: osdmap e90: 12 total, 12 up, 12 in 2023-10-18T14:12:19.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:18 smithi158 ceph-mon[103317]: pgmap v532: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 11 op/s 2023-10-18T14:12:19.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:18 smithi158 ceph-mon[103317]: osdmap e90: 12 total, 12 up, 12 in 2023-10-18T14:12:21.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:20 smithi172 ceph-mon[103574]: pgmap v534: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:12:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:20 smithi114 ceph-mon[99494]: pgmap v534: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:12:21.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:20 smithi158 ceph-mon[103317]: pgmap v534: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:12:23.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:22 smithi172 ceph-mon[103574]: pgmap v535: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:12:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:22 smithi114 ceph-mon[99494]: pgmap v535: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:12:23.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:22 smithi158 ceph-mon[103317]: pgmap v535: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:12:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:24 smithi158 ceph-mon[103317]: pgmap v536: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:12:24.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:24 smithi172 ceph-mon[103574]: pgmap v536: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:12:24.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:24 smithi114 ceph-mon[99494]: pgmap v536: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:12:27.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:26 smithi172 ceph-mon[103574]: pgmap v537: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:12:27.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:26 smithi114 ceph-mon[99494]: pgmap v537: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:12:27.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:26 smithi158 ceph-mon[103317]: pgmap v537: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:12:29.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:28 smithi172 ceph-mon[103574]: pgmap v538: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:12:29.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:28 smithi114 ceph-mon[99494]: pgmap v538: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:12:29.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:28 smithi158 ceph-mon[103317]: pgmap v538: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:12:31.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:30 smithi172 ceph-mon[103574]: pgmap v539: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2023-10-18T14:12:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:30 smithi114 ceph-mon[99494]: pgmap v539: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2023-10-18T14:12:31.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:30 smithi158 ceph-mon[103317]: pgmap v539: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2023-10-18T14:12:33.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:32 smithi172 ceph-mon[103574]: pgmap v540: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:12:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:32 smithi114 ceph-mon[99494]: pgmap v540: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:12:33.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:32 smithi158 ceph-mon[103317]: pgmap v540: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:12:34.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:34 smithi158 ceph-mon[103317]: pgmap v541: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:12:34.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:34 smithi172 ceph-mon[103574]: pgmap v541: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:12:34.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:34 smithi114 ceph-mon[99494]: pgmap v541: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:12:37.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:36 smithi172 ceph-mon[103574]: pgmap v542: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:12:37.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:36 smithi114 ceph-mon[99494]: pgmap v542: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:12:37.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:36 smithi158 ceph-mon[103317]: pgmap v542: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:12:39.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:38 smithi172 ceph-mon[103574]: pgmap v543: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:12:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:38 smithi114 ceph-mon[99494]: pgmap v543: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:12:39.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:38 smithi158 ceph-mon[103317]: pgmap v543: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:12:41.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:40 smithi172 ceph-mon[103574]: pgmap v544: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:12:41.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:40 smithi114 ceph-mon[99494]: pgmap v544: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:12:41.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:40 smithi158 ceph-mon[103317]: pgmap v544: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:12:43.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:42 smithi172 ceph-mon[103574]: pgmap v545: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:12:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:42 smithi114 ceph-mon[99494]: pgmap v545: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:12:43.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:42 smithi158 ceph-mon[103317]: pgmap v545: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:12:44.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:44 smithi158 ceph-mon[103317]: pgmap v546: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:12:44.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:44 smithi172 ceph-mon[103574]: pgmap v546: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:12:44.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:44 smithi114 ceph-mon[99494]: pgmap v546: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:12:47.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:46 smithi172 ceph-mon[103574]: pgmap v547: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-18T14:12:47.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:46 smithi114 ceph-mon[99494]: pgmap v547: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-18T14:12:47.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:46 smithi158 ceph-mon[103317]: pgmap v547: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-18T14:12:49.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:48 smithi172 ceph-mon[103574]: pgmap v548: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2023-10-18T14:12:49.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:12:49.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:12:49.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:12:49.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:12:49.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:12:49.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:12:49.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:12:49.062 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:12:49.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:48 smithi114 ceph-mon[99494]: pgmap v548: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2023-10-18T14:12:49.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:12:49.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:12:49.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:12:49.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:12:49.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:12:49.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:12:49.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:12:49.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:12:49.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:48 smithi158 ceph-mon[103317]: pgmap v548: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2023-10-18T14:12:49.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:12:49.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:12:49.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:12:49.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:12:49.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-18T14:12:49.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:12:49.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:12:49.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:12:50.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:49 smithi172 ceph-mon[103574]: Adjusting osd_memory_target on smithi172 to 196.2M 2023-10-18T14:12:50.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:49 smithi172 ceph-mon[103574]: Unable to set osd_memory_target on smithi172 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-18T14:12:50.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:49 smithi114 ceph-mon[99494]: Adjusting osd_memory_target on smithi172 to 196.2M 2023-10-18T14:12:50.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:49 smithi114 ceph-mon[99494]: Unable to set osd_memory_target on smithi172 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-18T14:12:50.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:49 smithi158 ceph-mon[103317]: Adjusting osd_memory_target on smithi172 to 196.2M 2023-10-18T14:12:50.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:49 smithi158 ceph-mon[103317]: Unable to set osd_memory_target on smithi172 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-18T14:12:51.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:50 smithi172 ceph-mon[103574]: pgmap v549: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-10-18T14:12:51.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:50 smithi114 ceph-mon[99494]: pgmap v549: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-10-18T14:12:51.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:50 smithi158 ceph-mon[103317]: pgmap v549: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-10-18T14:12:53.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:52 smithi172 ceph-mon[103574]: pgmap v550: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-18T14:12:53.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:52 smithi114 ceph-mon[99494]: pgmap v550: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-18T14:12:53.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:52 smithi158 ceph-mon[103317]: pgmap v550: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-18T14:12:54.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:54 smithi158 ceph-mon[103317]: pgmap v551: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-10-18T14:12:54.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:54 smithi172 ceph-mon[103574]: pgmap v551: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-10-18T14:12:54.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:54 smithi114 ceph-mon[99494]: pgmap v551: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-10-18T14:12:57.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:56 smithi172 ceph-mon[103574]: pgmap v552: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-18T14:12:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:56 smithi114 ceph-mon[99494]: pgmap v552: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-18T14:12:57.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:56 smithi158 ceph-mon[103317]: pgmap v552: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-18T14:12:59.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:12:58 smithi172 ceph-mon[103574]: pgmap v553: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:12:59.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:12:58 smithi114 ceph-mon[99494]: pgmap v553: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:12:59.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:12:58 smithi158 ceph-mon[103317]: pgmap v553: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:13:01.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:00 smithi172 ceph-mon[103574]: pgmap v554: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:01.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:00 smithi114 ceph-mon[99494]: pgmap v554: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:01.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:00 smithi158 ceph-mon[103317]: pgmap v554: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:03.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:02 smithi172 ceph-mon[103574]: pgmap v555: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:03.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:02 smithi114 ceph-mon[99494]: pgmap v555: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:03.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:02 smithi158 ceph-mon[103317]: pgmap v555: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:04.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:04 smithi158 ceph-mon[103317]: pgmap v556: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 22 KiB/s wr, 12 op/s 2023-10-18T14:13:04.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:04 smithi172 ceph-mon[103574]: pgmap v556: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 22 KiB/s wr, 12 op/s 2023-10-18T14:13:04.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:04 smithi114 ceph-mon[99494]: pgmap v556: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 22 KiB/s wr, 12 op/s 2023-10-18T14:13:07.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:06 smithi172 ceph-mon[103574]: pgmap v557: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-18T14:13:07.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:06 smithi114 ceph-mon[99494]: pgmap v557: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-18T14:13:07.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:06 smithi158 ceph-mon[103317]: pgmap v557: 97 pgs: 97 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-18T14:13:08.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:07 smithi114 ceph-mon[99494]: osdmap e91: 12 total, 12 up, 12 in 2023-10-18T14:13:08.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:07 smithi158 ceph-mon[103317]: osdmap e91: 12 total, 12 up, 12 in 2023-10-18T14:13:08.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:07 smithi172 ceph-mon[103574]: osdmap e91: 12 total, 12 up, 12 in 2023-10-18T14:13:09.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:08 smithi114 ceph-mon[99494]: pgmap v559: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:13:09.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:08 smithi158 ceph-mon[103317]: pgmap v559: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:13:09.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:08 smithi172 ceph-mon[103574]: pgmap v559: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 92 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:13:11.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:10 smithi114 ceph-mon[99494]: pgmap v560: 97 pgs: 6 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 74 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:13:11.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:10 smithi158 ceph-mon[103317]: pgmap v560: 97 pgs: 6 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 74 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:13:11.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:10 smithi172 ceph-mon[103574]: pgmap v560: 97 pgs: 6 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 74 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:13:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:12 smithi114 ceph-mon[99494]: pgmap v561: 97 pgs: 6 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 74 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:13:13.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:12 smithi158 ceph-mon[103317]: pgmap v561: 97 pgs: 6 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 74 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:13:13.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:12 smithi172 ceph-mon[103574]: pgmap v561: 97 pgs: 6 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 74 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-18T14:13:14.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:14 smithi158 ceph-mon[103317]: pgmap v562: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 26 op/s 2023-10-18T14:13:14.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:14 smithi172 ceph-mon[103574]: pgmap v562: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 26 op/s 2023-10-18T14:13:14.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:14 smithi114 ceph-mon[99494]: pgmap v562: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 26 op/s 2023-10-18T14:13:17.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:16 smithi172 ceph-mon[103574]: pgmap v563: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:13:17.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:16 smithi114 ceph-mon[99494]: pgmap v563: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:13:17.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:16 smithi158 ceph-mon[103317]: pgmap v563: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:13:19.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:18 smithi172 ceph-mon[103574]: pgmap v564: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 11 op/s 2023-10-18T14:13:19.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:18 smithi172 ceph-mon[103574]: osdmap e92: 12 total, 12 up, 12 in 2023-10-18T14:13:19.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:18 smithi114 ceph-mon[99494]: pgmap v564: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 11 op/s 2023-10-18T14:13:19.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:18 smithi114 ceph-mon[99494]: osdmap e92: 12 total, 12 up, 12 in 2023-10-18T14:13:19.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:18 smithi158 ceph-mon[103317]: pgmap v564: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 187 B/s wr, 11 op/s 2023-10-18T14:13:19.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:18 smithi158 ceph-mon[103317]: osdmap e92: 12 total, 12 up, 12 in 2023-10-18T14:13:21.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:20 smithi172 ceph-mon[103574]: pgmap v566: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:13:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:20 smithi114 ceph-mon[99494]: pgmap v566: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:13:21.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:20 smithi158 ceph-mon[103317]: pgmap v566: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:13:23.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:22 smithi172 ceph-mon[103574]: pgmap v567: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:13:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:22 smithi114 ceph-mon[99494]: pgmap v567: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:13:23.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:22 smithi158 ceph-mon[103317]: pgmap v567: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:13:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:24 smithi158 ceph-mon[103317]: pgmap v568: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:13:24.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:24 smithi172 ceph-mon[103574]: pgmap v568: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:13:24.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:24 smithi114 ceph-mon[99494]: pgmap v568: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:13:27.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:26 smithi172 ceph-mon[103574]: pgmap v569: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:13:27.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:26 smithi114 ceph-mon[99494]: pgmap v569: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:13:27.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:26 smithi158 ceph-mon[103317]: pgmap v569: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:13:29.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:28 smithi172 ceph-mon[103574]: pgmap v570: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:13:29.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:28 smithi114 ceph-mon[99494]: pgmap v570: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:13:29.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:28 smithi158 ceph-mon[103317]: pgmap v570: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:13:31.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:30 smithi172 ceph-mon[103574]: pgmap v571: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2023-10-18T14:13:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:30 smithi114 ceph-mon[99494]: pgmap v571: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2023-10-18T14:13:31.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:30 smithi158 ceph-mon[103317]: pgmap v571: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2023-10-18T14:13:33.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:32 smithi172 ceph-mon[103574]: pgmap v572: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:32 smithi114 ceph-mon[99494]: pgmap v572: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:33.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:32 smithi158 ceph-mon[103317]: pgmap v572: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:34.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:34 smithi158 ceph-mon[103317]: pgmap v573: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:34.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:34 smithi172 ceph-mon[103574]: pgmap v573: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:34.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:34 smithi114 ceph-mon[99494]: pgmap v573: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:37.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:36 smithi172 ceph-mon[103574]: pgmap v574: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:37.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:36 smithi114 ceph-mon[99494]: pgmap v574: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:37.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:36 smithi158 ceph-mon[103317]: pgmap v574: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:39.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:38 smithi172 ceph-mon[103574]: pgmap v575: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:13:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:38 smithi114 ceph-mon[99494]: pgmap v575: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:13:39.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:38 smithi158 ceph-mon[103317]: pgmap v575: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:13:41.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:40 smithi172 ceph-mon[103574]: pgmap v576: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:41.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:40 smithi114 ceph-mon[99494]: pgmap v576: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:41.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:40 smithi158 ceph-mon[103317]: pgmap v576: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:43.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:42 smithi172 ceph-mon[103574]: pgmap v577: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:42 smithi114 ceph-mon[99494]: pgmap v577: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:43.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:42 smithi158 ceph-mon[103317]: pgmap v577: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:44.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:44 smithi158 ceph-mon[103317]: pgmap v578: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:44.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:44 smithi172 ceph-mon[103574]: pgmap v578: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:44.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:44 smithi114 ceph-mon[99494]: pgmap v578: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:47.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:46 smithi172 ceph-mon[103574]: pgmap v579: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:47.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:46 smithi114 ceph-mon[99494]: pgmap v579: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:47.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:46 smithi158 ceph-mon[103317]: pgmap v579: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:49.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:48 smithi172 ceph-mon[103574]: pgmap v580: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:13:49.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:48 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:13:49.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:48 smithi114 ceph-mon[99494]: pgmap v580: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:13:49.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:48 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:13:49.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:48 smithi158 ceph-mon[103317]: pgmap v580: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:13:49.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:48 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-18T14:13:50.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:49 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:13:50.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:49 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:13:50.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:49 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:13:50.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:49 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:13:50.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:49 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:13:50.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:49 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:13:50.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:49 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-18T14:13:50.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:49 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-18T14:13:50.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:49 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' 2023-10-18T14:13:51.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:50 smithi172 ceph-mon[103574]: pgmap v581: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:51.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:50 smithi114 ceph-mon[99494]: pgmap v581: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:51.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:50 smithi158 ceph-mon[103317]: pgmap v581: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:53.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:52 smithi114 ceph-mon[99494]: pgmap v582: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:53.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:52 smithi158 ceph-mon[103317]: pgmap v582: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:53.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:52 smithi172 ceph-mon[103574]: pgmap v582: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:54.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:54 smithi158 ceph-mon[103317]: pgmap v583: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:54.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:54 smithi172 ceph-mon[103574]: pgmap v583: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:54.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:54 smithi114 ceph-mon[99494]: pgmap v583: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:13:57.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:56 smithi172 ceph-mon[103574]: pgmap v584: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:57.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:56 smithi114 ceph-mon[99494]: pgmap v584: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:57.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:56 smithi158 ceph-mon[103317]: pgmap v584: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:13:59.060 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:13:58 smithi172 ceph-mon[103574]: pgmap v585: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:13:59.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:13:58 smithi114 ceph-mon[99494]: pgmap v585: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:13:59.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:13:58 smithi158 ceph-mon[103317]: pgmap v585: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:14:01.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:00 smithi114 ceph-mon[99494]: pgmap v586: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:14:01.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:00 smithi158 ceph-mon[103317]: pgmap v586: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:14:01.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:00 smithi172 ceph-mon[103574]: pgmap v586: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:14:03.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:02 smithi114 ceph-mon[99494]: pgmap v587: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:14:03.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:02 smithi158 ceph-mon[103317]: pgmap v587: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:14:03.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:02 smithi172 ceph-mon[103574]: pgmap v587: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:14:04.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-18T14:14:04.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.674+0000 7f401a75c700 1 -- 172.21.15.114:0/1409757189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40140ff5d0 msgr2=0x7f40140ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.674+0000 7f401a75c700 1 --2- 172.21.15.114:0/1409757189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40140ff5d0 0x7f40140ffa50 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f4004009990 tx=0x7f4004009ca0 comp rx=0 tx=0).stop 2023-10-18T14:14:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.674+0000 7f401a75c700 1 -- 172.21.15.114:0/1409757189 shutdown_connections 2023-10-18T14:14:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.674+0000 7f401a75c700 1 --2- 172.21.15.114:0/1409757189 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40140fff90 0x7f401410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:04.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.674+0000 7f401a75c700 1 --2- 172.21.15.114:0/1409757189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40141045e0 0x7f40141049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:04.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.674+0000 7f401a75c700 1 --2- 172.21.15.114:0/1409757189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40140ff5d0 0x7f40140ffa50 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:04.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.674+0000 7f401a75c700 1 -- 172.21.15.114:0/1409757189 >> 172.21.15.114:0/1409757189 conn(0x7f4014076790 msgr2=0x7f4014076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:04.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.674+0000 7f401a75c700 1 -- 172.21.15.114:0/1409757189 shutdown_connections 2023-10-18T14:14:04.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.674+0000 7f401a75c700 1 -- 172.21.15.114:0/1409757189 wait complete. 2023-10-18T14:14:04.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f401a75c700 1 Processor -- start 2023-10-18T14:14:04.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f401a75c700 1 -- start start 2023-10-18T14:14:04.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f401a75c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40140ff5d0 0x7f401419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:04.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f401a75c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40140fff90 0x7f401419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:04.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f401a75c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40141045e0 0x7f40141968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:04.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f401a75c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4014197090 con 0x7f40140ff5d0 2023-10-18T14:14:04.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f401a75c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4014197200 con 0x7f40141045e0 2023-10-18T14:14:04.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f401a75c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40141973c0 con 0x7f40140fff90 2023-10-18T14:14:04.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f4013fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40140ff5d0 0x7f401419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:04.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f4013fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40140ff5d0 0x7f401419c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46780/0 (socket says 172.21.15.114:46780) 2023-10-18T14:14:04.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f4013fff700 1 -- 172.21.15.114:0/3649542826 learned_addr learned my addr 172.21.15.114:0/3649542826 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:04.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f40137fe700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40140fff90 0x7f401419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:04.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f4018cf9700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40141045e0 0x7f40141968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:04.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f4013fff700 1 -- 172.21.15.114:0/3649542826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40140fff90 msgr2=0x7f401419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:04.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f4013fff700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40140fff90 0x7f401419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:04.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f4013fff700 1 -- 172.21.15.114:0/3649542826 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40141045e0 msgr2=0x7f40141968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:04.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f4013fff700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40141045e0 0x7f40141968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:04.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f4013fff700 1 -- 172.21.15.114:0/3649542826 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40040095f0 con 0x7f40140ff5d0 2023-10-18T14:14:04.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.675+0000 7f4018cf9700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40141045e0 0x7f40141968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:14:04.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.676+0000 7f4013fff700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40140ff5d0 0x7f401419c820 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f400800c990 tx=0x7f400800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:04.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.676+0000 7f40117fa700 1 -- 172.21.15.114:0/3649542826 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008007b00 con 0x7f40140ff5d0 2023-10-18T14:14:04.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.676+0000 7f40117fa700 1 -- 172.21.15.114:0/3649542826 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4008007c60 con 0x7f40140ff5d0 2023-10-18T14:14:04.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.676+0000 7f401a75c700 1 -- 172.21.15.114:0/3649542826 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40141976a0 con 0x7f40140ff5d0 2023-10-18T14:14:04.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.676+0000 7f40117fa700 1 -- 172.21.15.114:0/3649542826 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008018660 con 0x7f40140ff5d0 2023-10-18T14:14:04.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.676+0000 7f401a75c700 1 -- 172.21.15.114:0/3649542826 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4014101330 con 0x7f40140ff5d0 2023-10-18T14:14:04.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.677+0000 7f401a75c700 1 -- 172.21.15.114:0/3649542826 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4014108bf0 con 0x7f40140ff5d0 2023-10-18T14:14:04.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.678+0000 7f40117fa700 1 -- 172.21.15.114:0/3649542826 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f400800f450 con 0x7f40140ff5d0 2023-10-18T14:14:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.678+0000 7f40117fa700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f3ffc0a15f0 0x7f3ffc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.679+0000 7f40137fe700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f3ffc0a15f0 0x7f3ffc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.679+0000 7f40117fa700 1 -- 172.21.15.114:0/3649542826 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f40080cd2e0 con 0x7f40140ff5d0 2023-10-18T14:14:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.679+0000 7f40137fe700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f3ffc0a15f0 0x7f3ffc0a3ab0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4004006010 tx=0x7f400401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.682+0000 7f40117fa700 1 -- 172.21.15.114:0/3649542826 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f40080965f0 con 0x7f40140ff5d0 2023-10-18T14:14:04.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:04 smithi158 ceph-mon[103317]: pgmap v588: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 22 KiB/s wr, 12 op/s 2023-10-18T14:14:04.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:04 smithi172 ceph-mon[103574]: pgmap v588: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 22 KiB/s wr, 12 op/s 2023-10-18T14:14:04.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:04 smithi114 ceph-mon[99494]: pgmap v588: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 22 KiB/s wr, 12 op/s 2023-10-18T14:14:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.895+0000 7f401a75c700 1 -- 172.21.15.114:0/3649542826 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f4014197e10 con 0x7f3ffc0a15f0 2023-10-18T14:14:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.903+0000 7f40117fa700 1 -- 172.21.15.114:0/3649542826 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+335 (secure 0 0 0) 0x7f4014197e10 con 0x7f3ffc0a15f0 2023-10-18T14:14:04.907 INFO:teuthology.orchestra.run.smithi114.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-18T00:00:00", "created": "2023-10-18T14:04:03", "first": "2023-10-18T14:05:00", "last": "2023-10-18T14:14:00", "last_pruned": "2023-10-18T14:14:00", "created_count": 10, "pruned_count": 4, "active": true} 2023-10-18T14:14:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.905+0000 7f401a75c700 1 -- 172.21.15.114:0/3649542826 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f3ffc0a15f0 msgr2=0x7f3ffc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.905+0000 7f401a75c700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f3ffc0a15f0 0x7f3ffc0a3ab0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4004006010 tx=0x7f400401a040 comp rx=0 tx=0).stop 2023-10-18T14:14:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.905+0000 7f401a75c700 1 -- 172.21.15.114:0/3649542826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40140ff5d0 msgr2=0x7f401419c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.905+0000 7f401a75c700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40140ff5d0 0x7f401419c820 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f400800c990 tx=0x7f400800cd50 comp rx=0 tx=0).stop 2023-10-18T14:14:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.905+0000 7f401a75c700 1 -- 172.21.15.114:0/3649542826 shutdown_connections 2023-10-18T14:14:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.905+0000 7f401a75c700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f3ffc0a15f0 0x7f3ffc0a3ab0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.905+0000 7f401a75c700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40141045e0 0x7f40141968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.905+0000 7f401a75c700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40140ff5d0 0x7f401419c820 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.905+0000 7f401a75c700 1 --2- 172.21.15.114:0/3649542826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40140fff90 0x7f401419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.905+0000 7f401a75c700 1 -- 172.21.15.114:0/3649542826 >> 172.21.15.114:0/3649542826 conn(0x7f4014076790 msgr2=0x7f4014067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.905+0000 7f401a75c700 1 -- 172.21.15.114:0/3649542826 shutdown_connections 2023-10-18T14:14:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:04.905+0000 7f401a75c700 1 -- 172.21.15.114:0/3649542826 wait complete. 2023-10-18T14:14:04.921 DEBUG:teuthology.orchestra.run.smithi114:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-18T14:14:05.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.040+0000 7fe80e5f0700 1 -- 172.21.15.114:0/1006644642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8081059a0 msgr2=0x7fe80810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:05.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.040+0000 7fe80e5f0700 1 --2- 172.21.15.114:0/1006644642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8081059a0 0x7fe80810d5f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe80000b0a0 tx=0x7fe80000b3b0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.040+0000 7fe80e5f0700 1 -- 172.21.15.114:0/1006644642 shutdown_connections 2023-10-18T14:14:05.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.040+0000 7fe80e5f0700 1 --2- 172.21.15.114:0/1006644642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8081059a0 0x7fe80810d5f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.040+0000 7fe80e5f0700 1 --2- 172.21.15.114:0/1006644642 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe8080fef10 0x7fe8080ff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.040+0000 7fe80e5f0700 1 --2- 172.21.15.114:0/1006644642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8080ff8c0 0x7fe808105270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.040+0000 7fe80e5f0700 1 -- 172.21.15.114:0/1006644642 >> 172.21.15.114:0/1006644642 conn(0x7fe808075bf0 msgr2=0x7fe8080fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.040+0000 7fe80e5f0700 1 -- 172.21.15.114:0/1006644642 shutdown_connections 2023-10-18T14:14:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.040+0000 7fe80e5f0700 1 -- 172.21.15.114:0/1006644642 wait complete. 2023-10-18T14:14:05.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.040+0000 7fe80e5f0700 1 Processor -- start 2023-10-18T14:14:05.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.040+0000 7fe80e5f0700 1 -- start start 2023-10-18T14:14:05.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe80e5f0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8080fef10 0x7fe8080ffe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:05.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe80e5f0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8081059a0 0x7fe8081003c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:05.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe80e5f0700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe808100900 0x7fe8081a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:05.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe80e5f0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8081a5570 con 0x7fe8081059a0 2023-10-18T14:14:05.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe80e5f0700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8081a56e0 con 0x7fe808100900 2023-10-18T14:14:05.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe80e5f0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8081a58a0 con 0x7fe8080fef10 2023-10-18T14:14:05.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe8077fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8081059a0 0x7fe8081003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:05.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe8077fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8081059a0 0x7fe8081003c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46796/0 (socket says 172.21.15.114:46796) 2023-10-18T14:14:05.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe8077fe700 1 -- 172.21.15.114:0/641471739 learned_addr learned my addr 172.21.15.114:0/641471739 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:05.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe807fff700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8080fef10 0x7fe8080ffe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:05.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe80cb8d700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe808100900 0x7fe8081a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:05.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe8077fe700 1 -- 172.21.15.114:0/641471739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8080fef10 msgr2=0x7fe8080ffe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:05.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe8077fe700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8080fef10 0x7fe8080ffe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe8077fe700 1 -- 172.21.15.114:0/641471739 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe808100900 msgr2=0x7fe8081a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:05.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe8077fe700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe808100900 0x7fe8081a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe8077fe700 1 -- 172.21.15.114:0/641471739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe800009d00 con 0x7fe8081059a0 2023-10-18T14:14:05.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe8077fe700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8081059a0 0x7fe8081003c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00e9f0 tx=0x7fe7fc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:05.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe8057fa700 1 -- 172.21.15.114:0/641471739 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc009750 con 0x7fe8081059a0 2023-10-18T14:14:05.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe80e5f0700 1 -- 172.21.15.114:0/641471739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8081a5b80 con 0x7fe8081059a0 2023-10-18T14:14:05.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe8057fa700 1 -- 172.21.15.114:0/641471739 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7fc004cf0 con 0x7fe8081059a0 2023-10-18T14:14:05.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe8057fa700 1 -- 172.21.15.114:0/641471739 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc00eee0 con 0x7fe8081059a0 2023-10-18T14:14:05.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.041+0000 7fe80e5f0700 1 -- 172.21.15.114:0/641471739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8081a6040 con 0x7fe8081059a0 2023-10-18T14:14:05.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.042+0000 7fe80e5f0700 1 -- 172.21.15.114:0/641471739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe808108d00 con 0x7fe8081059a0 2023-10-18T14:14:05.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.043+0000 7fe8057fa700 1 -- 172.21.15.114:0/641471739 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fe7fc004750 con 0x7fe8081059a0 2023-10-18T14:14:05.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.044+0000 7fe8057fa700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe7f00a15f0 0x7fe7f00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:05.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.044+0000 7fe807fff700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe7f00a15f0 0x7fe7f00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:05.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.044+0000 7fe8057fa700 1 -- 172.21.15.114:0/641471739 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fe7fc014070 con 0x7fe8081059a0 2023-10-18T14:14:05.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.044+0000 7fe807fff700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe7f00a15f0 0x7fe7f00a3ab0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8005950 tx=0x7fe7f800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:05.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.047+0000 7fe8057fa700 1 -- 172.21.15.114:0/641471739 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe7fc096830 con 0x7fe8081059a0 2023-10-18T14:14:05.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.264+0000 7fe80e5f0700 1 -- 172.21.15.114:0/641471739 --> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe808101360 con 0x7fe7f00a15f0 2023-10-18T14:14:05.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.271+0000 7fe8057fa700 1 -- 172.21.15.114:0/641471739 <== mgr.14217 v2:172.21.15.114:6800/3416629288 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7fe808101360 con 0x7fe7f00a15f0 2023-10-18T14:14:05.275 INFO:teuthology.orchestra.run.smithi114.stdout:/ 1m 6m3h 2023-10-18T14:14:05.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.273+0000 7fe80e5f0700 1 -- 172.21.15.114:0/641471739 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe7f00a15f0 msgr2=0x7fe7f00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:05.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.273+0000 7fe80e5f0700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe7f00a15f0 0x7fe7f00a3ab0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8005950 tx=0x7fe7f800b410 comp rx=0 tx=0).stop 2023-10-18T14:14:05.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.273+0000 7fe80e5f0700 1 -- 172.21.15.114:0/641471739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8081059a0 msgr2=0x7fe8081003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:05.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.273+0000 7fe80e5f0700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8081059a0 0x7fe8081003c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00e9f0 tx=0x7fe7fc00ed00 comp rx=0 tx=0).stop 2023-10-18T14:14:05.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.273+0000 7fe80e5f0700 1 -- 172.21.15.114:0/641471739 shutdown_connections 2023-10-18T14:14:05.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.273+0000 7fe80e5f0700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fe7f00a15f0 0x7fe7f00a3ab0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.273+0000 7fe80e5f0700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe808100900 0x7fe8081a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.273+0000 7fe80e5f0700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8080fef10 0x7fe8080ffe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.273+0000 7fe80e5f0700 1 --2- 172.21.15.114:0/641471739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8081059a0 0x7fe8081003c0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.273+0000 7fe80e5f0700 1 -- 172.21.15.114:0/641471739 >> 172.21.15.114:0/641471739 conn(0x7fe808075bf0 msgr2=0x7fe808103be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:05.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.273+0000 7fe80e5f0700 1 -- 172.21.15.114:0/641471739 shutdown_connections 2023-10-18T14:14:05.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.273+0000 7fe80e5f0700 1 -- 172.21.15.114:0/641471739 wait complete. 2023-10-18T14:14:05.289 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-18T14:14:05.300 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-18T14:14:05.301 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-10-18T14:14:05.301 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-18T14:14:05.336 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:14:05.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.454+0000 7f47f0629700 1 -- 172.21.15.114:0/1682033182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47e8105670 msgr2=0x7f47e8105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:05.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.454+0000 7f47f0629700 1 --2- 172.21.15.114:0/1682033182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47e8105670 0x7f47e8105a50 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f47e40099c0 tx=0x7f47e4009cd0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.454+0000 7f47f0629700 1 -- 172.21.15.114:0/1682033182 shutdown_connections 2023-10-18T14:14:05.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.454+0000 7f47f0629700 1 --2- 172.21.15.114:0/1682033182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47e80fff70 0x7f47e810c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.454+0000 7f47f0629700 1 --2- 172.21.15.114:0/1682033182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47e8105670 0x7f47e8105a50 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.454+0000 7f47f0629700 1 --2- 172.21.15.114:0/1682033182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f47e80ff5b0 0x7f47e80ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.454+0000 7f47f0629700 1 -- 172.21.15.114:0/1682033182 >> 172.21.15.114:0/1682033182 conn(0x7f47e80fb060 msgr2=0x7f47e80fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.454+0000 7f47f0629700 1 -- 172.21.15.114:0/1682033182 shutdown_connections 2023-10-18T14:14:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.455+0000 7f47f0629700 1 -- 172.21.15.114:0/1682033182 wait complete. 2023-10-18T14:14:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.455+0000 7f47f0629700 1 Processor -- start 2023-10-18T14:14:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.455+0000 7f47f0629700 1 -- start start 2023-10-18T14:14:05.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.455+0000 7f47f0629700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47e80ff5b0 0x7f47e8197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:05.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.455+0000 7f47f0629700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f47e80fff70 0x7f47e8197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:05.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.455+0000 7f47f0629700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47e8105670 0x7f47e81a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:05.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.455+0000 7f47f0629700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8198730 con 0x7f47e8105670 2023-10-18T14:14:05.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.455+0000 7f47f0629700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e81a2ef0 con 0x7f47e80fff70 2023-10-18T14:14:05.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.455+0000 7f47f0629700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e81a3030 con 0x7f47e80ff5b0 2023-10-18T14:14:05.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.455+0000 7f47eebc6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47e8105670 0x7f47e81a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:05.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.455+0000 7f47eebc6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47e8105670 0x7f47e81a29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46812/0 (socket says 172.21.15.114:46812) 2023-10-18T14:14:05.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.455+0000 7f47eebc6700 1 -- 172.21.15.114:0/2753220220 learned_addr learned my addr 172.21.15.114:0/2753220220 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:05.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.456+0000 7f47ee3c5700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47e80ff5b0 0x7f47e8197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:05.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.456+0000 7f47edbc4700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f47e80fff70 0x7f47e8197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:05.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.456+0000 7f47eebc6700 1 -- 172.21.15.114:0/2753220220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47e80ff5b0 msgr2=0x7f47e8197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:05.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.456+0000 7f47eebc6700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47e80ff5b0 0x7f47e8197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.456+0000 7f47eebc6700 1 -- 172.21.15.114:0/2753220220 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f47e80fff70 msgr2=0x7f47e8197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:05.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.456+0000 7f47eebc6700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f47e80fff70 0x7f47e8197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.456+0000 7f47eebc6700 1 -- 172.21.15.114:0/2753220220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e40095f0 con 0x7f47e8105670 2023-10-18T14:14:05.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.456+0000 7f47eebc6700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47e8105670 0x7f47e81a29b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f47e0007ee0 tx=0x7f47e000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:05.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.456+0000 7f47df7fe700 1 -- 172.21.15.114:0/2753220220 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0017070 con 0x7f47e8105670 2023-10-18T14:14:05.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.456+0000 7f47df7fe700 1 -- 172.21.15.114:0/2753220220 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47e000f040 con 0x7f47e8105670 2023-10-18T14:14:05.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.456+0000 7f47f0629700 1 -- 172.21.15.114:0/2753220220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e81a3310 con 0x7f47e8105670 2023-10-18T14:14:05.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.456+0000 7f47df7fe700 1 -- 172.21.15.114:0/2753220220 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0005580 con 0x7f47e8105670 2023-10-18T14:14:05.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.456+0000 7f47f0629700 1 -- 172.21.15.114:0/2753220220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e81a3870 con 0x7f47e8105670 2023-10-18T14:14:05.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.457+0000 7f47f0629700 1 -- 172.21.15.114:0/2753220220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e8107af0 con 0x7f47e8105670 2023-10-18T14:14:05.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.458+0000 7f47df7fe700 1 -- 172.21.15.114:0/2753220220 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f47e000db20 con 0x7f47e8105670 2023-10-18T14:14:05.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.459+0000 7f47df7fe700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47d40a1670 0x7f47d40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:05.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.459+0000 7f47ee3c5700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47d40a1670 0x7f47d40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:05.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.459+0000 7f47df7fe700 1 -- 172.21.15.114:0/2753220220 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f47e00ccd50 con 0x7f47e8105670 2023-10-18T14:14:05.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.459+0000 7f47ee3c5700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47d40a1670 0x7f47d40a3b30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009990 tx=0x7f47e4003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:05.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.463+0000 7f47df7fe700 1 -- 172.21.15.114:0/2753220220 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f47e00960c0 con 0x7f47e8105670 2023-10-18T14:14:05.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:05 smithi114 ceph-mon[99494]: from='client.16722 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:14:05.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.656+0000 7f47f0629700 1 -- 172.21.15.114:0/2753220220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47e8069050 con 0x7f47e8105670 2023-10-18T14:14:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.658+0000 7f47df7fe700 1 -- 172.21.15.114:0/2753220220 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+22997 (secure 0 0 0) 0x7f47e00996e0 con 0x7f47e8105670 2023-10-18T14:14:05.662 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:14:05.663 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":92,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:13:18.414925+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":13,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":4,"length":1},{"begin":13,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:14:05.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.660+0000 7f47f0629700 1 -- 172.21.15.114:0/2753220220 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47d40a1670 msgr2=0x7f47d40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:05.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.660+0000 7f47f0629700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47d40a1670 0x7f47d40a3b30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009990 tx=0x7f47e4003680 comp rx=0 tx=0).stop 2023-10-18T14:14:05.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.660+0000 7f47f0629700 1 -- 172.21.15.114:0/2753220220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47e8105670 msgr2=0x7f47e81a29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:05.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.660+0000 7f47f0629700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47e8105670 0x7f47e81a29b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f47e0007ee0 tx=0x7f47e000d3b0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.660+0000 7f47f0629700 1 -- 172.21.15.114:0/2753220220 shutdown_connections 2023-10-18T14:14:05.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.660+0000 7f47f0629700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f47d40a1670 0x7f47d40a3b30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.660+0000 7f47f0629700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47e8105670 0x7f47e81a29b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.660+0000 7f47f0629700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47e80ff5b0 0x7f47e8197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.660+0000 7f47f0629700 1 --2- 172.21.15.114:0/2753220220 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f47e80fff70 0x7f47e8197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.660+0000 7f47f0629700 1 -- 172.21.15.114:0/2753220220 >> 172.21.15.114:0/2753220220 conn(0x7f47e80fb060 msgr2=0x7f47e80fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:05.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.660+0000 7f47f0629700 1 -- 172.21.15.114:0/2753220220 shutdown_connections 2023-10-18T14:14:05.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.660+0000 7f47f0629700 1 -- 172.21.15.114:0/2753220220 wait complete. 2023-10-18T14:14:05.676 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T13:58:43.813590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T14:02:30.693853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T14:02:31.426625+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 13, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T14:14:05.677 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T14:14:05.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:05 smithi158 ceph-mon[103317]: from='client.16722 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:14:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.798+0000 7fdc96644700 1 -- 172.21.15.114:0/1235568813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc900ff9d0 msgr2=0x7fdc900ffdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.798+0000 7fdc96644700 1 --2- 172.21.15.114:0/1235568813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc900ff9d0 0x7fdc900ffdb0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009990 tx=0x7fdc80009ca0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.798+0000 7fdc96644700 1 -- 172.21.15.114:0/1235568813 shutdown_connections 2023-10-18T14:14:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.798+0000 7fdc96644700 1 --2- 172.21.15.114:0/1235568813 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc90101ba0 0x7fdc9010c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.798+0000 7fdc96644700 1 --2- 172.21.15.114:0/1235568813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc900ff9d0 0x7fdc900ffdb0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.798+0000 7fdc96644700 1 --2- 172.21.15.114:0/1235568813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc901011e0 0x7fdc90101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.798+0000 7fdc96644700 1 -- 172.21.15.114:0/1235568813 >> 172.21.15.114:0/1235568813 conn(0x7fdc900fb0a0 msgr2=0x7fdc900fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.798+0000 7fdc96644700 1 -- 172.21.15.114:0/1235568813 shutdown_connections 2023-10-18T14:14:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.799+0000 7fdc96644700 1 -- 172.21.15.114:0/1235568813 wait complete. 2023-10-18T14:14:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.799+0000 7fdc96644700 1 Processor -- start 2023-10-18T14:14:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.799+0000 7fdc96644700 1 -- start start 2023-10-18T14:14:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.799+0000 7fdc96644700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc900ff9d0 0x7fdc90197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.799+0000 7fdc96644700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc901011e0 0x7fdc90198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.799+0000 7fdc96644700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc90101ba0 0x7fdc901a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.799+0000 7fdc96644700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc90198900 con 0x7fdc900ff9d0 2023-10-18T14:14:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.799+0000 7fdc96644700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc901a3110 con 0x7fdc901011e0 2023-10-18T14:14:05.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.799+0000 7fdc96644700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc901a3250 con 0x7fdc90101ba0 2023-10-18T14:14:05.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc8ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc900ff9d0 0x7fdc90197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:05.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc8ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc900ff9d0 0x7fdc90197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46822/0 (socket says 172.21.15.114:46822) 2023-10-18T14:14:05.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc8ffff700 1 -- 172.21.15.114:0/3713731982 learned_addr learned my addr 172.21.15.114:0/3713731982 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:05.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc8f7fe700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc901011e0 0x7fdc90198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:05.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc94be1700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc90101ba0 0x7fdc901a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:05.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc8ffff700 1 -- 172.21.15.114:0/3713731982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc90101ba0 msgr2=0x7fdc901a2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:05.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc8ffff700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc90101ba0 0x7fdc901a2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc8ffff700 1 -- 172.21.15.114:0/3713731982 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc901011e0 msgr2=0x7fdc90198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:05.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc8ffff700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc901011e0 0x7fdc90198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:05.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc8ffff700 1 -- 172.21.15.114:0/3713731982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc800095f0 con 0x7fdc900ff9d0 2023-10-18T14:14:05.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc8ffff700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc900ff9d0 0x7fdc90197b50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fdc80000c00 tx=0x7fdc8000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:05.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc8d7fa700 1 -- 172.21.15.114:0/3713731982 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8001d070 con 0x7fdc900ff9d0 2023-10-18T14:14:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc8d7fa700 1 -- 172.21.15.114:0/3713731982 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc8000fb90 con 0x7fdc900ff9d0 2023-10-18T14:14:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc96644700 1 -- 172.21.15.114:0/3713731982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc901a3480 con 0x7fdc900ff9d0 2023-10-18T14:14:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc8d7fa700 1 -- 172.21.15.114:0/3713731982 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80017650 con 0x7fdc900ff9d0 2023-10-18T14:14:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.800+0000 7fdc96644700 1 -- 172.21.15.114:0/3713731982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc901a3930 con 0x7fdc900ff9d0 2023-10-18T14:14:05.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.801+0000 7fdc96644700 1 -- 172.21.15.114:0/3713731982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc90107cc0 con 0x7fdc900ff9d0 2023-10-18T14:14:05.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:05 smithi172 ceph-mon[103574]: from='client.16722 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:14:05.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.802+0000 7fdc8d7fa700 1 -- 172.21.15.114:0/3713731982 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fdc8000fd00 con 0x7fdc900ff9d0 2023-10-18T14:14:05.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.803+0000 7fdc8d7fa700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdc780a15f0 0x7fdc780a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:05.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.803+0000 7fdc8f7fe700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdc780a15f0 0x7fdc780a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:05.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.803+0000 7fdc8d7fa700 1 -- 172.21.15.114:0/3713731982 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fdc800ce550 con 0x7fdc900ff9d0 2023-10-18T14:14:05.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.803+0000 7fdc8f7fe700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdc780a15f0 0x7fdc780a3ab0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdc90069260 tx=0x7fdc84009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:05.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.808+0000 7fdc8d7fa700 1 -- 172.21.15.114:0/3713731982 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdc80097950 con 0x7fdc900ff9d0 2023-10-18T14:14:06.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.998+0000 7fdc96644700 1 -- 172.21.15.114:0/3713731982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc90066d40 con 0x7fdc900ff9d0 2023-10-18T14:14:06.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:05.999+0000 7fdc8d7fa700 1 -- 172.21.15.114:0/3713731982 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc8009af70 con 0x7fdc900ff9d0 2023-10-18T14:14:06.003 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T14:14:06.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.001+0000 7fdc96644700 1 -- 172.21.15.114:0/3713731982 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdc780a15f0 msgr2=0x7fdc780a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:06.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.001+0000 7fdc96644700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdc780a15f0 0x7fdc780a3ab0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdc90069260 tx=0x7fdc84009190 comp rx=0 tx=0).stop 2023-10-18T14:14:06.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.001+0000 7fdc96644700 1 -- 172.21.15.114:0/3713731982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc900ff9d0 msgr2=0x7fdc90197b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:06.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.001+0000 7fdc96644700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc900ff9d0 0x7fdc90197b50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fdc80000c00 tx=0x7fdc8000f670 comp rx=0 tx=0).stop 2023-10-18T14:14:06.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.001+0000 7fdc96644700 1 -- 172.21.15.114:0/3713731982 shutdown_connections 2023-10-18T14:14:06.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.001+0000 7fdc96644700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdc780a15f0 0x7fdc780a3ab0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.001+0000 7fdc96644700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc90101ba0 0x7fdc901a2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.001+0000 7fdc96644700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc900ff9d0 0x7fdc90197b50 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.001+0000 7fdc96644700 1 --2- 172.21.15.114:0/3713731982 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc901011e0 0x7fdc90198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.001+0000 7fdc96644700 1 -- 172.21.15.114:0/3713731982 >> 172.21.15.114:0/3713731982 conn(0x7fdc900fb0a0 msgr2=0x7fdc900fb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:06.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.001+0000 7fdc96644700 1 -- 172.21.15.114:0/3713731982 shutdown_connections 2023-10-18T14:14:06.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.001+0000 7fdc96644700 1 -- 172.21.15.114:0/3713731982 wait complete. 2023-10-18T14:14:06.017 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T14:14:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.136+0000 7f60563a8700 1 -- 172.21.15.114:0/3000084429 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6050104630 msgr2=0x7f6050104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:06.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.136+0000 7f60563a8700 1 --2- 172.21.15.114:0/3000084429 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6050104630 0x7f6050104a10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f6044009990 tx=0x7f6044009ca0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.136+0000 7f60563a8700 1 -- 172.21.15.114:0/3000084429 shutdown_connections 2023-10-18T14:14:06.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.136+0000 7f60563a8700 1 --2- 172.21.15.114:0/3000084429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6050105d20 0x7f605010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.136+0000 7f60563a8700 1 --2- 172.21.15.114:0/3000084429 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6050104630 0x7f6050104a10 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.136+0000 7f60563a8700 1 --2- 172.21.15.114:0/3000084429 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6050105360 0x7f60501057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.136+0000 7f60563a8700 1 -- 172.21.15.114:0/3000084429 >> 172.21.15.114:0/3000084429 conn(0x7f6050074890 msgr2=0x7f6050074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:06.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.136+0000 7f60563a8700 1 -- 172.21.15.114:0/3000084429 shutdown_connections 2023-10-18T14:14:06.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.136+0000 7f60563a8700 1 -- 172.21.15.114:0/3000084429 wait complete. 2023-10-18T14:14:06.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.137+0000 7f60563a8700 1 Processor -- start 2023-10-18T14:14:06.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.137+0000 7f60563a8700 1 -- start start 2023-10-18T14:14:06.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.137+0000 7f60563a8700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6050104630 0x7f6050196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:06.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.137+0000 7f60563a8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6050105360 0x7f6050197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:06.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.137+0000 7f60563a8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6050105d20 0x7f605019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:06.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.137+0000 7f60563a8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605019ab40 con 0x7f6050105360 2023-10-18T14:14:06.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.137+0000 7f60563a8700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605019acb0 con 0x7f6050104630 2023-10-18T14:14:06.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.137+0000 7f60563a8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605019ae70 con 0x7f6050105d20 2023-10-18T14:14:06.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.137+0000 7f604f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6050105360 0x7f6050197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:06.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.137+0000 7f604f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6050105360 0x7f6050197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46838/0 (socket says 172.21.15.114:46838) 2023-10-18T14:14:06.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.137+0000 7f604f7fe700 1 -- 172.21.15.114:0/2165464052 learned_addr learned my addr 172.21.15.114:0/2165464052 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:06.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.137+0000 7f604ffff700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6050104630 0x7f6050196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:06.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.137+0000 7f6054945700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6050105d20 0x7f605019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:06.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.138+0000 7f604f7fe700 1 -- 172.21.15.114:0/2165464052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6050105d20 msgr2=0x7f605019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:06.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.138+0000 7f604f7fe700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6050105d20 0x7f605019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.138+0000 7f604f7fe700 1 -- 172.21.15.114:0/2165464052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6050104630 msgr2=0x7f6050196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:06.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.138+0000 7f604f7fe700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6050104630 0x7f6050196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.138+0000 7f604f7fe700 1 -- 172.21.15.114:0/2165464052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60440095f0 con 0x7f6050105360 2023-10-18T14:14:06.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.138+0000 7f6054945700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6050105d20 0x7f605019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:14:06.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.138+0000 7f604f7fe700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6050105360 0x7f6050197250 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f604000d950 tx=0x7f604000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:06.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.138+0000 7f604d7fa700 1 -- 172.21.15.114:0/2165464052 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040009940 con 0x7f6050105360 2023-10-18T14:14:06.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.138+0000 7f604d7fa700 1 -- 172.21.15.114:0/2165464052 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6040010460 con 0x7f6050105360 2023-10-18T14:14:06.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.138+0000 7f60563a8700 1 -- 172.21.15.114:0/2165464052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605019b150 con 0x7f6050105360 2023-10-18T14:14:06.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.138+0000 7f604d7fa700 1 -- 172.21.15.114:0/2165464052 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604000f620 con 0x7f6050105360 2023-10-18T14:14:06.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.138+0000 7f60563a8700 1 -- 172.21.15.114:0/2165464052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60501a3ab0 con 0x7f6050105360 2023-10-18T14:14:06.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.139+0000 7f60563a8700 1 -- 172.21.15.114:0/2165464052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6050067330 con 0x7f6050105360 2023-10-18T14:14:06.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.140+0000 7f604d7fa700 1 -- 172.21.15.114:0/2165464052 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f60400108d0 con 0x7f6050105360 2023-10-18T14:14:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.140+0000 7f604d7fa700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f60380a15f0 0x7f60380a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.141+0000 7f604ffff700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f60380a15f0 0x7f60380a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.141+0000 7f604d7fa700 1 -- 172.21.15.114:0/2165464052 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f60400ccf50 con 0x7f6050105360 2023-10-18T14:14:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.141+0000 7f604ffff700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f60380a15f0 0x7f60380a3ab0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f604400b5c0 tx=0x7f6044005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:06.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.144+0000 7f604d7fa700 1 -- 172.21.15.114:0/2165464052 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f60400962c0 con 0x7f6050105360 2023-10-18T14:14:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.335+0000 7f60563a8700 1 -- 172.21.15.114:0/2165464052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6050197fd0 con 0x7f6050105360 2023-10-18T14:14:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.336+0000 7f604d7fa700 1 -- 172.21.15.114:0/2165464052 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6040020020 con 0x7f6050105360 2023-10-18T14:14:06.340 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T14:14:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.338+0000 7f60563a8700 1 -- 172.21.15.114:0/2165464052 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f60380a15f0 msgr2=0x7f60380a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.338+0000 7f60563a8700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f60380a15f0 0x7f60380a3ab0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f604400b5c0 tx=0x7f6044005960 comp rx=0 tx=0).stop 2023-10-18T14:14:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.338+0000 7f60563a8700 1 -- 172.21.15.114:0/2165464052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6050105360 msgr2=0x7f6050197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.338+0000 7f60563a8700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6050105360 0x7f6050197250 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f604000d950 tx=0x7f604000dc60 comp rx=0 tx=0).stop 2023-10-18T14:14:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.338+0000 7f60563a8700 1 -- 172.21.15.114:0/2165464052 shutdown_connections 2023-10-18T14:14:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.338+0000 7f60563a8700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f60380a15f0 0x7f60380a3ab0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.338+0000 7f60563a8700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6050105d20 0x7f605019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.338+0000 7f60563a8700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6050104630 0x7f6050196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.338+0000 7f60563a8700 1 --2- 172.21.15.114:0/2165464052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6050105360 0x7f6050197250 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.338+0000 7f60563a8700 1 -- 172.21.15.114:0/2165464052 >> 172.21.15.114:0/2165464052 conn(0x7f6050074890 msgr2=0x7f6050101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.338+0000 7f60563a8700 1 -- 172.21.15.114:0/2165464052 shutdown_connections 2023-10-18T14:14:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.338+0000 7f60563a8700 1 -- 172.21.15.114:0/2165464052 wait complete. 2023-10-18T14:14:06.354 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T14:14:06.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.505+0000 7fceb07e9700 1 -- 172.21.15.114:0/959840359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcea810f380 msgr2=0x7fcea8107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:06.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.505+0000 7fceb07e9700 1 --2- 172.21.15.114:0/959840359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcea810f380 0x7fcea8107d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fce98009990 tx=0x7fce98009ca0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.505+0000 7fceb07e9700 1 -- 172.21.15.114:0/959840359 shutdown_connections 2023-10-18T14:14:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.505+0000 7fceb07e9700 1 --2- 172.21.15.114:0/959840359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcea8119fd0 0x7fcea811c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.505+0000 7fceb07e9700 1 --2- 172.21.15.114:0/959840359 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcea810ef10 0x7fcea81077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.505+0000 7fceb07e9700 1 --2- 172.21.15.114:0/959840359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcea810f380 0x7fcea8107d30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.505+0000 7fceb07e9700 1 -- 172.21.15.114:0/959840359 >> 172.21.15.114:0/959840359 conn(0x7fcea806b840 msgr2=0x7fcea806bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.506+0000 7fceb07e9700 1 -- 172.21.15.114:0/959840359 shutdown_connections 2023-10-18T14:14:06.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.506+0000 7fceb07e9700 1 -- 172.21.15.114:0/959840359 wait complete. 2023-10-18T14:14:06.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.507+0000 7fceb07e9700 1 Processor -- start 2023-10-18T14:14:06.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.508+0000 7fceb07e9700 1 -- start start 2023-10-18T14:14:06.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.508+0000 7fceb07e9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcea810ef10 0x7fcea81183f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:06.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.508+0000 7fceb07e9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcea810f380 0x7fcea8118970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:06.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.508+0000 7fceb07e9700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcea8119fd0 0x7fcea81115e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:06.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.508+0000 7fceb07e9700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8111db0 con 0x7fcea810f380 2023-10-18T14:14:06.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.508+0000 7fceb07e9700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8111f20 con 0x7fcea8119fd0 2023-10-18T14:14:06.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.508+0000 7fceb07e9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea81120e0 con 0x7fcea810ef10 2023-10-18T14:14:06.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.509+0000 7fceae585700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcea810ef10 0x7fcea81183f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:06.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.509+0000 7fceae585700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcea810ef10 0x7fcea81183f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:50786/0 (socket says 172.21.15.114:50786) 2023-10-18T14:14:06.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.509+0000 7fceae585700 1 -- 172.21.15.114:0/3020076734 learned_addr learned my addr 172.21.15.114:0/3020076734 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:06.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.510+0000 7fceadd84700 1 --2- 172.21.15.114:0/3020076734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcea810f380 0x7fcea8118970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:06.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.510+0000 7fceadd84700 1 -- 172.21.15.114:0/3020076734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcea810ef10 msgr2=0x7fcea81183f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:06.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.510+0000 7fceadd84700 1 --2- 172.21.15.114:0/3020076734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcea810ef10 0x7fcea81183f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.510+0000 7fceadd84700 1 -- 172.21.15.114:0/3020076734 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcea8119fd0 msgr2=0x7fcea81115e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:06.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.510+0000 7fceadd84700 1 --2- 172.21.15.114:0/3020076734 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcea8119fd0 0x7fcea81115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.510+0000 7fceadd84700 1 -- 172.21.15.114:0/3020076734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce980095f0 con 0x7fcea810f380 2023-10-18T14:14:06.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.510+0000 7fceadd84700 1 --2- 172.21.15.114:0/3020076734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcea810f380 0x7fcea8118970 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fce980098e0 tx=0x7fce98005af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:06.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.511+0000 7fce9f7fe700 1 -- 172.21.15.114:0/3020076734 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9801d070 con 0x7fcea810f380 2023-10-18T14:14:06.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.511+0000 7fce9f7fe700 1 -- 172.21.15.114:0/3020076734 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce98021410 con 0x7fcea810f380 2023-10-18T14:14:06.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.511+0000 7fce9f7fe700 1 -- 172.21.15.114:0/3020076734 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce98017650 con 0x7fcea810f380 2023-10-18T14:14:06.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.512+0000 7fceb07e9700 1 -- 172.21.15.114:0/3020076734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea8115f80 con 0x7fcea810f380 2023-10-18T14:14:06.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.512+0000 7fceb07e9700 1 -- 172.21.15.114:0/3020076734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea81163e0 con 0x7fcea810f380 2023-10-18T14:14:06.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.513+0000 7fceb07e9700 1 -- 172.21.15.114:0/3020076734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea806ccd0 con 0x7fcea810f380 2023-10-18T14:14:06.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.521+0000 7fce9f7fe700 1 -- 172.21.15.114:0/3020076734 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fce98021580 con 0x7fcea810f380 2023-10-18T14:14:06.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.522+0000 7fce9f7fe700 1 --2- 172.21.15.114:0/3020076734 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fce940a1800 0x7fce940a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:06.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.522+0000 7fce9f7fe700 1 -- 172.21.15.114:0/3020076734 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fce980cea30 con 0x7fcea810f380 2023-10-18T14:14:06.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.523+0000 7fceae585700 1 --2- 172.21.15.114:0/3020076734 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fce940a1800 0x7fce940a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:06.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.523+0000 7fce9f7fe700 1 -- 172.21.15.114:0/3020076734 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fce98097e20 con 0x7fcea810f380 2023-10-18T14:14:06.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.524+0000 7fceae585700 1 --2- 172.21.15.114:0/3020076734 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fce940a1800 0x7fce940a3cc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009cb0 tx=0x7fcea4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:06.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:06 smithi158 ceph-mon[103317]: from='client.16728 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:14:06.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:06 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2753220220' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:14:06.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:06 smithi158 ceph-mon[103317]: pgmap v589: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-10-18T14:14:06.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:06 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3713731982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:14:06.772 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:06 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2165464052' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:14:06.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:06 smithi172 ceph-mon[103574]: from='client.16728 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:14:06.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:06 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2753220220' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:14:06.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:06 smithi172 ceph-mon[103574]: pgmap v589: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-10-18T14:14:06.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:06 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3713731982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:14:06.811 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:06 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2165464052' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:14:06.840 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:06 smithi114 ceph-mon[99494]: from='client.16728 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-18T14:14:06.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:06 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2753220220' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:14:06.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:06 smithi114 ceph-mon[99494]: pgmap v589: 97 pgs: 97 active+clean; 86 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-10-18T14:14:06.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:06 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3713731982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:14:06.841 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:06 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2165464052' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:14:06.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.906+0000 7fceb07e9700 1 -- 172.21.15.114:0/3020076734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcea81129a0 con 0x7fcea810f380 2023-10-18T14:14:06.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.907+0000 7fce9f7fe700 1 -- 172.21.15.114:0/3020076734 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce98026020 con 0x7fcea810f380 2023-10-18T14:14:06.913 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T14:14:06.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.911+0000 7fceb07e9700 1 -- 172.21.15.114:0/3020076734 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fce940a1800 msgr2=0x7fce940a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:06.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.911+0000 7fceb07e9700 1 --2- 172.21.15.114:0/3020076734 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fce940a1800 0x7fce940a3cc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009cb0 tx=0x7fcea4009260 comp rx=0 tx=0).stop 2023-10-18T14:14:06.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.911+0000 7fceb07e9700 1 -- 172.21.15.114:0/3020076734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcea810f380 msgr2=0x7fcea8118970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:06.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.911+0000 7fceb07e9700 1 --2- 172.21.15.114:0/3020076734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcea810f380 0x7fcea8118970 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fce980098e0 tx=0x7fce98005af0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.911+0000 7fceb07e9700 1 -- 172.21.15.114:0/3020076734 shutdown_connections 2023-10-18T14:14:06.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.911+0000 7fceb07e9700 1 --2- 172.21.15.114:0/3020076734 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fce940a1800 0x7fce940a3cc0 secure :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009cb0 tx=0x7fcea4009260 comp rx=0 tx=0).stop 2023-10-18T14:14:06.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.911+0000 7fceb07e9700 1 --2- 172.21.15.114:0/3020076734 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fcea8119fd0 0x7fcea81115e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.911+0000 7fceb07e9700 1 --2- 172.21.15.114:0/3020076734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcea810ef10 0x7fcea81183f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.911+0000 7fceb07e9700 1 --2- 172.21.15.114:0/3020076734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcea810f380 0x7fcea8118970 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.911+0000 7fceb07e9700 1 -- 172.21.15.114:0/3020076734 >> 172.21.15.114:0/3020076734 conn(0x7fcea806b840 msgr2=0x7fcea806f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.913+0000 7fceb07e9700 1 -- 172.21.15.114:0/3020076734 shutdown_connections 2023-10-18T14:14:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:06.914+0000 7fceb07e9700 1 -- 172.21.15.114:0/3020076734 wait complete. 2023-10-18T14:14:06.938 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-18T14:14:07.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.143+0000 7fb05a700700 1 -- 172.21.15.114:0/644480963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb054107a60 msgr2=0x7fb054107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:07.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.143+0000 7fb05a700700 1 --2- 172.21.15.114:0/644480963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb054107a60 0x7fb054107e40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb04400b970 tx=0x7fb044009260 comp rx=0 tx=0).stop 2023-10-18T14:14:07.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.144+0000 7fb05a700700 1 -- 172.21.15.114:0/644480963 shutdown_connections 2023-10-18T14:14:07.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.144+0000 7fb05a700700 1 --2- 172.21.15.114:0/644480963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb05410c020 0x7fb054078b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:07.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.144+0000 7fb05a700700 1 --2- 172.21.15.114:0/644480963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb054107a60 0x7fb054107e40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:07.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.144+0000 7fb05a700700 1 --2- 172.21.15.114:0/644480963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb054108410 0x7fb05410b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:07.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.144+0000 7fb05a700700 1 -- 172.21.15.114:0/644480963 >> 172.21.15.114:0/644480963 conn(0x7fb05406b7d0 msgr2=0x7fb05406bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:07.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.145+0000 7fb05a700700 1 -- 172.21.15.114:0/644480963 shutdown_connections 2023-10-18T14:14:07.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.145+0000 7fb05a700700 1 -- 172.21.15.114:0/644480963 wait complete. 2023-10-18T14:14:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.145+0000 7fb05a700700 1 Processor -- start 2023-10-18T14:14:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.145+0000 7fb05a700700 1 -- start start 2023-10-18T14:14:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb05a700700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb054107a60 0x7fb0540831a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb05a700700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb05410c020 0x7fb05407d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:07.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb05a700700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb05407d780 0x7fb05407dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:07.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb05a700700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0541ba8c0 con 0x7fb054107a60 2023-10-18T14:14:07.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb05a700700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0541baa30 con 0x7fb05407d780 2023-10-18T14:14:07.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb05a700700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0541babf0 con 0x7fb05410c020 2023-10-18T14:14:07.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb053fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb054107a60 0x7fb0540831a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb053fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb054107a60 0x7fb0540831a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46864/0 (socket says 172.21.15.114:46864) 2023-10-18T14:14:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb053fff700 1 -- 172.21.15.114:0/825754168 learned_addr learned my addr 172.21.15.114:0/825754168 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb058c9d700 1 --2- 172.21.15.114:0/825754168 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb05407d780 0x7fb05407dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb053fff700 1 -- 172.21.15.114:0/825754168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb05410c020 msgr2=0x7fb05407d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb053fff700 1 --2- 172.21.15.114:0/825754168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb05410c020 0x7fb05407d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb053fff700 1 -- 172.21.15.114:0/825754168 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb05407d780 msgr2=0x7fb05407dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb053fff700 1 --2- 172.21.15.114:0/825754168 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb05407d780 0x7fb05407dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.146+0000 7fb053fff700 1 -- 172.21.15.114:0/825754168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04400b5a0 con 0x7fb054107a60 2023-10-18T14:14:07.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.147+0000 7fb053fff700 1 --2- 172.21.15.114:0/825754168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb054107a60 0x7fb0540831a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb044009fd0 tx=0x7fb044013980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:07.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.151+0000 7fb051ffb700 1 -- 172.21.15.114:0/825754168 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044009c50 con 0x7fb054107a60 2023-10-18T14:14:07.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.151+0000 7fb051ffb700 1 -- 172.21.15.114:0/825754168 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb044005580 con 0x7fb054107a60 2023-10-18T14:14:07.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.151+0000 7fb051ffb700 1 -- 172.21.15.114:0/825754168 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04401e420 con 0x7fb054107a60 2023-10-18T14:14:07.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.151+0000 7fb05a700700 1 -- 172.21.15.114:0/825754168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0541bae70 con 0x7fb054107a60 2023-10-18T14:14:07.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.151+0000 7fb05a700700 1 -- 172.21.15.114:0/825754168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0541bb2d0 con 0x7fb054107a60 2023-10-18T14:14:07.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.152+0000 7fb05a700700 1 -- 172.21.15.114:0/825754168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb054074030 con 0x7fb054107a60 2023-10-18T14:14:07.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.154+0000 7fb051ffb700 1 -- 172.21.15.114:0/825754168 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fb04401e580 con 0x7fb054107a60 2023-10-18T14:14:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.155+0000 7fb051ffb700 1 --2- 172.21.15.114:0/825754168 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb0400a1740 0x7fb0400a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.155+0000 7fb051ffb700 1 -- 172.21.15.114:0/825754168 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8485+0+0 (secure 0 0 0) 0x7fb0440cedf0 con 0x7fb054107a60 2023-10-18T14:14:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.155+0000 7fb04bfff700 1 --2- 172.21.15.114:0/825754168 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb0400a1740 0x7fb0400a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.156+0000 7fb04bfff700 1 --2- 172.21.15.114:0/825754168 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb0400a1740 0x7fb0400a3c00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb05407e970 tx=0x7fb03c00f040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:07.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.162+0000 7fb051ffb700 1 -- 172.21.15.114:0/825754168 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb044062100 con 0x7fb054107a60 2023-10-18T14:14:07.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.608+0000 7fb05a700700 1 -- 172.21.15.114:0/825754168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fb054067530 con 0x7fb054107a60 2023-10-18T14:14:07.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.619+0000 7fb051ffb700 1 -- 172.21.15.114:0/825754168 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) v1 ==== 81+0+734418 (secure 0 0 0) 0x7fb044098240 con 0x7fb054107a60 2023-10-18T14:14:07.632 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:14:07.633 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:14:07.633 INFO:teuthology.orchestra.run.smithi114.stdout: "epoch": 24, 2023-10-18T14:14:07.633 INFO:teuthology.orchestra.run.smithi114.stdout: "active_gid": 14217, 2023-10-18T14:14:07.633 INFO:teuthology.orchestra.run.smithi114.stdout: "active_name": "x", 2023-10-18T14:14:07.633 INFO:teuthology.orchestra.run.smithi114.stdout: "active_addrs": { 2023-10-18T14:14:07.634 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2023-10-18T14:14:07.634 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:07.634 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2023-10-18T14:14:07.634 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.114:6800", 2023-10-18T14:14:07.635 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 3416629288 2023-10-18T14:14:07.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.635 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:07.635 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-10-18T14:14:07.635 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.114:6801", 2023-10-18T14:14:07.636 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 3416629288 2023-10-18T14:14:07.636 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:07.636 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-10-18T14:14:07.636 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.636 INFO:teuthology.orchestra.run.smithi114.stdout: "active_addr": "172.21.15.114:6801/3416629288", 2023-10-18T14:14:07.637 INFO:teuthology.orchestra.run.smithi114.stdout: "active_change": "2023-10-18T13:57:07.487256+0000", 2023-10-18T14:14:07.637 INFO:teuthology.orchestra.run.smithi114.stdout: "active_mgr_features": 4540138322906710015, 2023-10-18T14:14:07.637 INFO:teuthology.orchestra.run.smithi114.stdout: "available": true, 2023-10-18T14:14:07.637 INFO:teuthology.orchestra.run.smithi114.stdout: "standbys": [ 2023-10-18T14:14:07.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:07.638 INFO:teuthology.orchestra.run.smithi114.stdout: "gid": 24136, 2023-10-18T14:14:07.638 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "z", 2023-10-18T14:14:07.638 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr_features": 4540138322906710015, 2023-10-18T14:14:07.638 INFO:teuthology.orchestra.run.smithi114.stdout: "available_modules": [ 2023-10-18T14:14:07.639 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:07.639 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "alerts", 2023-10-18T14:14:07.640 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:07.640 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:07.640 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:07.641 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:07.641 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:07.641 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:07.642 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.642 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.642 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:07.643 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.643 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.643 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.644 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How frequently to reexamine health status", 2023-10-18T14:14:07.644 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.644 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.645 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.645 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.645 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:07.645 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:07.645 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.646 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.646 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.646 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.646 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.646 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.647 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:07.647 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:07.647 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:07.647 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:07.647 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:07.648 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:07.648 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:07.648 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:07.648 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.648 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.649 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.649 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.649 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:07.649 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:07.650 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.650 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.650 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.650 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.650 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.651 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.651 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.651 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.651 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.652 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.652 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.652 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:07.652 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:07.652 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.653 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.653 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.653 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:07.653 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.653 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.654 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:07.654 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:07.654 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:07.654 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:07.654 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:07.655 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:07.655 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:07.655 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:07.655 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.655 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.656 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.656 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.656 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:07.656 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:07.657 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.657 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.657 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.657 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.657 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.658 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.658 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.658 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.658 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.658 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.659 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.659 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_destination": { 2023-10-18T14:14:07.659 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_destination", 2023-10-18T14:14:07.659 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.660 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.660 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.660 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.660 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.660 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.661 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.661 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Email address to send alerts to", 2023-10-18T14:14:07.661 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.661 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.661 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.662 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_from_name": { 2023-10-18T14:14:07.662 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_from_name", 2023-10-18T14:14:07.662 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.662 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.663 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.663 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "Ceph", 2023-10-18T14:14:07.663 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.663 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.663 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.664 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Email From: name", 2023-10-18T14:14:07.664 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.664 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.664 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.665 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_host": { 2023-10-18T14:14:07.665 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_host", 2023-10-18T14:14:07.665 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.665 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.665 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.666 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.666 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.666 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.666 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.667 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP server", 2023-10-18T14:14:07.667 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.667 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.667 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.668 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_password": { 2023-10-18T14:14:07.668 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_password", 2023-10-18T14:14:07.668 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.668 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.668 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.669 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.669 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.669 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.669 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.669 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Password to authenticate with", 2023-10-18T14:14:07.670 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.670 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.670 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.671 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_port": { 2023-10-18T14:14:07.671 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_port", 2023-10-18T14:14:07.671 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:07.671 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.671 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.672 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "465", 2023-10-18T14:14:07.672 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.672 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.672 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.672 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP port", 2023-10-18T14:14:07.673 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.673 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.673 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.674 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_sender": { 2023-10-18T14:14:07.674 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_sender", 2023-10-18T14:14:07.674 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.674 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.675 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.675 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.675 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.675 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.676 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.676 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP envelope sender", 2023-10-18T14:14:07.676 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.677 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.677 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.678 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_ssl": { 2023-10-18T14:14:07.678 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_ssl", 2023-10-18T14:14:07.678 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.678 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.679 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.679 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.679 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.679 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.679 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.680 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-18T14:14:07.680 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.680 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.680 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.681 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_user": { 2023-10-18T14:14:07.681 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_user", 2023-10-18T14:14:07.681 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.681 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.681 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.681 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.682 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.682 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.682 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.682 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "User to authenticate as", 2023-10-18T14:14:07.683 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.683 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.683 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.683 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:07.684 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:07.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.684 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:07.685 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "balancer", 2023-10-18T14:14:07.685 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:07.685 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:07.685 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:07.686 INFO:teuthology.orchestra.run.smithi114.stdout: "active": { 2023-10-18T14:14:07.686 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "active", 2023-10-18T14:14:07.686 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.687 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.687 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.687 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.688 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.688 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.688 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.689 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "automatically balance PGs across cluster", 2023-10-18T14:14:07.689 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.690 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.690 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.691 INFO:teuthology.orchestra.run.smithi114.stdout: "begin_time": { 2023-10-18T14:14:07.691 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "begin_time", 2023-10-18T14:14:07.691 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.692 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.692 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.692 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0000", 2023-10-18T14:14:07.693 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.693 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.693 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.694 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "beginning time of day to automatically balance", 2023-10-18T14:14:07.694 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-18T14:14:07.694 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.695 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.695 INFO:teuthology.orchestra.run.smithi114.stdout: "begin_weekday": { 2023-10-18T14:14:07.695 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "begin_weekday", 2023-10-18T14:14:07.696 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:07.696 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.696 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.696 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:07.696 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0", 2023-10-18T14:14:07.697 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "6", 2023-10-18T14:14:07.697 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.697 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-18T14:14:07.697 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-18T14:14:07.697 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.698 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.698 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_max_iterations": { 2023-10-18T14:14:07.698 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_max_iterations", 2023-10-18T14:14:07.698 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:07.699 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.699 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.699 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "25", 2023-10-18T14:14:07.699 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2023-10-18T14:14:07.699 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "250", 2023-10-18T14:14:07.700 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.700 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-18T14:14:07.700 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.700 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.700 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.701 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_metrics": { 2023-10-18T14:14:07.701 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_metrics", 2023-10-18T14:14:07.701 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.701 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.702 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.702 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "pgs,objects,bytes", 2023-10-18T14:14:07.702 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.702 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.702 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.703 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-18T14:14:07.703 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-18T14:14:07.703 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.703 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.704 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_step": { 2023-10-18T14:14:07.704 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_step", 2023-10-18T14:14:07.704 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:07.704 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.704 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.705 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0.5", 2023-10-18T14:14:07.705 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0.001", 2023-10-18T14:14:07.705 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "0.999", 2023-10-18T14:14:07.705 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.706 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "aggressiveness of optimization", 2023-10-18T14:14:07.706 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-18T14:14:07.706 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.706 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.707 INFO:teuthology.orchestra.run.smithi114.stdout: "end_time": { 2023-10-18T14:14:07.707 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "end_time", 2023-10-18T14:14:07.707 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.707 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.708 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.708 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "2359", 2023-10-18T14:14:07.708 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.708 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.708 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.709 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "ending time of day to automatically balance", 2023-10-18T14:14:07.709 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-18T14:14:07.709 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.709 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.710 INFO:teuthology.orchestra.run.smithi114.stdout: "end_weekday": { 2023-10-18T14:14:07.710 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "end_weekday", 2023-10-18T14:14:07.710 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:07.710 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.711 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.711 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:07.711 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0", 2023-10-18T14:14:07.711 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "6", 2023-10-18T14:14:07.711 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.711 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-18T14:14:07.712 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-18T14:14:07.712 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.712 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.712 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:07.713 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:07.713 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.713 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.713 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.713 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.714 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.714 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.714 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:07.714 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:07.714 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:07.715 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:07.715 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:07.715 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:07.715 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:07.716 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:07.716 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.716 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.716 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.716 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.717 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:07.717 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:07.717 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.717 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.718 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.718 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.718 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.718 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.719 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.719 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.719 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.719 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.719 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.720 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:07.720 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:07.720 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.720 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.720 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.721 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:07.721 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.721 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.721 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:07.721 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:07.722 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:07.722 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:07.722 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:07.722 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:07.722 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:07.723 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:07.723 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.723 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.723 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.723 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.724 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:07.724 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:07.724 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.725 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.725 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.725 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.725 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.725 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.726 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.726 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.726 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.726 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.727 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.727 INFO:teuthology.orchestra.run.smithi114.stdout: "min_score": { 2023-10-18T14:14:07.727 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "min_score", 2023-10-18T14:14:07.728 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:07.728 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.728 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.728 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:07.728 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.729 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.729 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.729 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-18T14:14:07.729 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.729 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.730 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.730 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": { 2023-10-18T14:14:07.730 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mode", 2023-10-18T14:14:07.730 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.731 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.731 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.731 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "upmap", 2023-10-18T14:14:07.731 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.731 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.733 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:07.733 INFO:teuthology.orchestra.run.smithi114.stdout: "crush-compat", 2023-10-18T14:14:07.733 INFO:teuthology.orchestra.run.smithi114.stdout: "none", 2023-10-18T14:14:07.734 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap" 2023-10-18T14:14:07.734 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:07.734 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Balancer mode", 2023-10-18T14:14:07.734 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.734 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.735 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.735 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_ids": { 2023-10-18T14:14:07.735 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pool_ids", 2023-10-18T14:14:07.735 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.736 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.736 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.736 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.736 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.736 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.737 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.737 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-18T14:14:07.737 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.737 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.737 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.738 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:07.738 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:07.738 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:07.738 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.739 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.739 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:07.739 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.739 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.739 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.740 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-18T14:14:07.740 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.740 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.740 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.740 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap_max_deviation": { 2023-10-18T14:14:07.741 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "upmap_max_deviation", 2023-10-18T14:14:07.741 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:07.741 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.741 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.741 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2023-10-18T14:14:07.742 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2023-10-18T14:14:07.742 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.742 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.742 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-18T14:14:07.742 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-18T14:14:07.743 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.743 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.743 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap_max_optimizations": { 2023-10-18T14:14:07.743 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "upmap_max_optimizations", 2023-10-18T14:14:07.744 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:07.744 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.744 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.744 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:07.744 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.745 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.745 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.745 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-18T14:14:07.745 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.745 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.746 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.746 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:07.746 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:07.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:07.747 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephadm", 2023-10-18T14:14:07.747 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:07.747 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:07.747 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:07.747 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_down_multiplier": { 2023-10-18T14:14:07.748 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_down_multiplier", 2023-10-18T14:14:07.748 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:07.748 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.748 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.749 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3.0", 2023-10-18T14:14:07.749 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.749 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.749 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.749 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-18T14:14:07.750 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.750 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.750 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.750 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_refresh_rate": { 2023-10-18T14:14:07.751 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_refresh_rate", 2023-10-18T14:14:07.751 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:07.751 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.751 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.751 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "20", 2023-10-18T14:14:07.752 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.752 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.752 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.752 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-18T14:14:07.752 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.753 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.753 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.753 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_starting_port": { 2023-10-18T14:14:07.753 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_starting_port", 2023-10-18T14:14:07.753 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:07.754 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.754 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.754 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "4721", 2023-10-18T14:14:07.754 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.755 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.755 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.755 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-18T14:14:07.755 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.755 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.756 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.756 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_ptrace": { 2023-10-18T14:14:07.756 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_ptrace", 2023-10-18T14:14:07.756 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.757 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.757 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.757 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.757 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.757 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.758 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.758 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-18T14:14:07.758 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-18T14:14:07.758 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.759 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.759 INFO:teuthology.orchestra.run.smithi114.stdout: "autotune_interval": { 2023-10-18T14:14:07.759 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "autotune_interval", 2023-10-18T14:14:07.760 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:07.760 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.760 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.760 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:07.760 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.761 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.761 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.761 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-18T14:14:07.761 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.761 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.762 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.762 INFO:teuthology.orchestra.run.smithi114.stdout: "autotune_memory_target_ratio": { 2023-10-18T14:14:07.762 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "autotune_memory_target_ratio", 2023-10-18T14:14:07.762 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:07.763 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.763 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.763 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0.7", 2023-10-18T14:14:07.763 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.764 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.764 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.764 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-18T14:14:07.764 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.765 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.765 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.765 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm_log_destination": { 2023-10-18T14:14:07.765 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephadm_log_destination", 2023-10-18T14:14:07.766 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.766 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.766 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.766 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.766 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.767 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.767 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:07.767 INFO:teuthology.orchestra.run.smithi114.stdout: "file", 2023-10-18T14:14:07.767 INFO:teuthology.orchestra.run.smithi114.stdout: "file,syslog", 2023-10-18T14:14:07.767 INFO:teuthology.orchestra.run.smithi114.stdout: "syslog" 2023-10-18T14:14:07.768 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:07.768 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-18T14:14:07.768 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.768 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.768 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.769 INFO:teuthology.orchestra.run.smithi114.stdout: "cgroups_split": { 2023-10-18T14:14:07.769 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cgroups_split", 2023-10-18T14:14:07.769 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.769 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.770 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.770 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.770 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.770 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.771 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.771 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-18T14:14:07.771 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.771 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.771 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.772 INFO:teuthology.orchestra.run.smithi114.stdout: "config_checks_enabled": { 2023-10-18T14:14:07.772 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "config_checks_enabled", 2023-10-18T14:14:07.772 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.772 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.773 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.773 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.773 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.773 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.773 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.773 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-18T14:14:07.774 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.774 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.774 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.775 INFO:teuthology.orchestra.run.smithi114.stdout: "config_dashboard": { 2023-10-18T14:14:07.775 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "config_dashboard", 2023-10-18T14:14:07.775 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.775 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.775 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.776 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.776 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.776 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.776 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.776 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-18T14:14:07.777 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.777 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.777 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.777 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_alertmanager": { 2023-10-18T14:14:07.778 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_alertmanager", 2023-10-18T14:14:07.778 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.778 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.778 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.779 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-18T14:14:07.779 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.779 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.780 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.780 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2023-10-18T14:14:07.780 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.781 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.781 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.782 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_base": { 2023-10-18T14:14:07.782 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_base", 2023-10-18T14:14:07.782 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.783 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.783 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.783 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-18T14:14:07.784 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.784 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.784 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.784 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Container image name, without the tag", 2023-10-18T14:14:07.785 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.785 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.785 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.785 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_elasticsearch": { 2023-10-18T14:14:07.786 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_elasticsearch", 2023-10-18T14:14:07.786 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.786 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.786 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.786 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-18T14:14:07.787 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.787 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.787 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.787 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "elasticsearch container image", 2023-10-18T14:14:07.787 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.788 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.788 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.788 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_grafana": { 2023-10-18T14:14:07.789 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_grafana", 2023-10-18T14:14:07.789 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.789 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.789 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.789 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-18T14:14:07.790 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.790 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.790 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.790 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2023-10-18T14:14:07.790 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.791 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.791 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.791 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_haproxy": { 2023-10-18T14:14:07.791 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_haproxy", 2023-10-18T14:14:07.791 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.792 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.792 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.792 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-18T14:14:07.792 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.792 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.793 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.793 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "HAproxy container image", 2023-10-18T14:14:07.793 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.794 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.794 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.795 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_agent": { 2023-10-18T14:14:07.795 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_agent", 2023-10-18T14:14:07.795 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.795 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.796 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.796 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-18T14:14:07.796 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.797 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.797 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.798 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger agent container image", 2023-10-18T14:14:07.798 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.798 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.799 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.799 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_collector": { 2023-10-18T14:14:07.800 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_collector", 2023-10-18T14:14:07.800 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.800 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.801 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.801 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-18T14:14:07.801 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.802 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.802 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.802 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger collector container image", 2023-10-18T14:14:07.803 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.803 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.804 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.804 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_query": { 2023-10-18T14:14:07.804 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_query", 2023-10-18T14:14:07.805 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.805 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.805 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.805 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-18T14:14:07.805 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.806 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.806 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.806 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger query container image", 2023-10-18T14:14:07.806 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.806 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.807 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.807 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_keepalived": { 2023-10-18T14:14:07.807 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_keepalived", 2023-10-18T14:14:07.808 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.808 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.808 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.808 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-18T14:14:07.808 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.809 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.809 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.809 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Keepalived container image", 2023-10-18T14:14:07.809 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.809 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.810 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.810 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_loki": { 2023-10-18T14:14:07.810 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_loki", 2023-10-18T14:14:07.811 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.811 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.811 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.812 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-18T14:14:07.812 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.812 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.812 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.812 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Loki container image", 2023-10-18T14:14:07.812 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.813 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.813 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.813 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_node_exporter": { 2023-10-18T14:14:07.813 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_node_exporter", 2023-10-18T14:14:07.814 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.814 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.814 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.814 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-18T14:14:07.815 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.815 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.815 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.815 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2023-10-18T14:14:07.815 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.816 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.816 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.816 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_nvmeof": { 2023-10-18T14:14:07.816 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_nvmeof", 2023-10-18T14:14:07.817 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.817 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.817 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.817 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-18T14:14:07.817 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.818 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.818 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.818 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Nvme-of container image", 2023-10-18T14:14:07.818 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.818 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.819 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.819 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_prometheus": { 2023-10-18T14:14:07.819 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_prometheus", 2023-10-18T14:14:07.819 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.820 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.820 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.820 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-18T14:14:07.820 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.820 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.821 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.821 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2023-10-18T14:14:07.821 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.821 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.822 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.822 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_promtail": { 2023-10-18T14:14:07.822 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_promtail", 2023-10-18T14:14:07.823 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.823 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.823 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.823 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-18T14:14:07.823 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.824 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.824 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.824 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Promtail container image", 2023-10-18T14:14:07.824 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.824 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.825 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.825 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_snmp_gateway": { 2023-10-18T14:14:07.825 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_snmp_gateway", 2023-10-18T14:14:07.826 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.826 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.826 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.826 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-18T14:14:07.827 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.827 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.827 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.827 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SNMP Gateway container image", 2023-10-18T14:14:07.827 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.828 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.828 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.828 INFO:teuthology.orchestra.run.smithi114.stdout: "container_init": { 2023-10-18T14:14:07.828 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_init", 2023-10-18T14:14:07.828 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.829 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.829 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.829 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.829 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.829 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.829 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.830 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Run podman/docker with `--init`", 2023-10-18T14:14:07.830 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.830 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.830 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.831 INFO:teuthology.orchestra.run.smithi114.stdout: "daemon_cache_timeout": { 2023-10-18T14:14:07.831 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "daemon_cache_timeout", 2023-10-18T14:14:07.831 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:07.831 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.832 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.832 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:07.832 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.832 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.833 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.833 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-18T14:14:07.833 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.833 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.834 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.834 INFO:teuthology.orchestra.run.smithi114.stdout: "default_cephadm_command_timeout": { 2023-10-18T14:14:07.834 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "default_cephadm_command_timeout", 2023-10-18T14:14:07.835 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:07.835 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.835 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.837 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "900", 2023-10-18T14:14:07.837 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.837 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.838 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.838 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-18T14:14:07.838 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.838 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.838 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.839 INFO:teuthology.orchestra.run.smithi114.stdout: "default_registry": { 2023-10-18T14:14:07.839 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "default_registry", 2023-10-18T14:14:07.839 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.839 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.840 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.840 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io", 2023-10-18T14:14:07.840 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.840 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.840 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.840 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-18T14:14:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: "device_cache_timeout": { 2023-10-18T14:14:07.842 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_cache_timeout", 2023-10-18T14:14:07.842 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:07.842 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.843 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.843 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1800", 2023-10-18T14:14:07.843 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.843 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.843 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.844 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache device inventory", 2023-10-18T14:14:07.844 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.844 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.844 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.845 INFO:teuthology.orchestra.run.smithi114.stdout: "device_enhanced_scan": { 2023-10-18T14:14:07.845 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_enhanced_scan", 2023-10-18T14:14:07.845 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.845 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.845 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.846 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.846 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.846 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.846 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.847 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-18T14:14:07.847 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.847 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.847 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.847 INFO:teuthology.orchestra.run.smithi114.stdout: "facts_cache_timeout": { 2023-10-18T14:14:07.848 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "facts_cache_timeout", 2023-10-18T14:14:07.848 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:07.848 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.848 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.848 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:07.849 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.849 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.849 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.849 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache host facts data", 2023-10-18T14:14:07.850 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.850 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.850 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.850 INFO:teuthology.orchestra.run.smithi114.stdout: "host_check_interval": { 2023-10-18T14:14:07.851 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "host_check_interval", 2023-10-18T14:14:07.851 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:07.851 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.851 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.851 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:07.852 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.852 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.852 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.853 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to perform a host check", 2023-10-18T14:14:07.853 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.853 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.853 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.854 INFO:teuthology.orchestra.run.smithi114.stdout: "inventory_list_all": { 2023-10-18T14:14:07.854 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "inventory_list_all", 2023-10-18T14:14:07.854 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.854 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.854 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.855 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.855 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.855 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.855 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.855 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-18T14:14:07.856 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.856 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.856 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.856 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:07.857 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:07.857 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.857 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.857 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.857 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.858 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.858 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.858 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:07.858 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:07.859 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:07.859 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:07.859 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:07.859 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:07.859 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:07.859 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:07.860 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.860 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.860 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.860 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.861 INFO:teuthology.orchestra.run.smithi114.stdout: "log_refresh_metadata": { 2023-10-18T14:14:07.861 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_refresh_metadata", 2023-10-18T14:14:07.861 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.861 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.862 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.862 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.862 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.862 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.863 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.863 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-18T14:14:07.863 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.863 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.864 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.864 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:07.864 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:07.864 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.865 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.865 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.865 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.865 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.865 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.866 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.866 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-18T14:14:07.866 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.866 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.866 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.867 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:07.867 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:07.867 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.867 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.868 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.868 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:07.868 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.868 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.868 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:07.869 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:07.869 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:07.869 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:07.869 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:07.869 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:07.870 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:07.870 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:07.870 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.870 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.870 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.871 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.871 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:07.871 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:07.872 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.872 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.872 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.873 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.873 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.874 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.874 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.874 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.875 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.875 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.875 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.876 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.876 INFO:teuthology.orchestra.run.smithi114.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-18T14:14:07.876 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-18T14:14:07.876 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.877 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.877 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.877 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.878 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.878 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.878 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.879 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-18T14:14:07.879 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.879 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.879 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.879 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.880 INFO:teuthology.orchestra.run.smithi114.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-18T14:14:07.880 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-18T14:14:07.880 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.880 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.880 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.881 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "*", 2023-10-18T14:14:07.881 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.881 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.881 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.882 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-18T14:14:07.882 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.882 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.882 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.883 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.883 INFO:teuthology.orchestra.run.smithi114.stdout: "max_count_per_host": { 2023-10-18T14:14:07.883 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_count_per_host", 2023-10-18T14:14:07.884 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:07.884 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.884 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.884 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:07.885 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.885 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.885 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.885 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "max number of daemons per service per host", 2023-10-18T14:14:07.885 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.886 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.886 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.886 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.886 INFO:teuthology.orchestra.run.smithi114.stdout: "max_osd_draining_count": { 2023-10-18T14:14:07.886 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_osd_draining_count", 2023-10-18T14:14:07.887 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:07.887 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.887 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.887 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:07.887 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.888 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.888 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.888 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-18T14:14:07.888 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.888 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.889 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.889 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.889 INFO:teuthology.orchestra.run.smithi114.stdout: "migration_current": { 2023-10-18T14:14:07.889 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "migration_current", 2023-10-18T14:14:07.889 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:07.890 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.890 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.890 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.890 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.891 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.891 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.891 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "internal - do not modify", 2023-10-18T14:14:07.891 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.891 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.892 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.892 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.892 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": { 2023-10-18T14:14:07.892 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mode", 2023-10-18T14:14:07.892 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.893 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.893 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.893 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "root", 2023-10-18T14:14:07.893 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.893 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.894 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:07.894 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm-package", 2023-10-18T14:14:07.894 INFO:teuthology.orchestra.run.smithi114.stdout: "root" 2023-10-18T14:14:07.894 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:07.895 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "mode for remote execution of cephadm", 2023-10-18T14:14:07.895 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.895 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.895 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.895 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.896 INFO:teuthology.orchestra.run.smithi114.stdout: "prometheus_alerts_path": { 2023-10-18T14:14:07.896 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prometheus_alerts_path", 2023-10-18T14:14:07.896 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.896 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.896 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.897 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-18T14:14:07.897 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.897 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.897 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.898 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-18T14:14:07.898 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.898 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.898 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.898 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.899 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_insecure": { 2023-10-18T14:14:07.899 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_insecure", 2023-10-18T14:14:07.899 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.899 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.899 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.900 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.900 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.900 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.900 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.900 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-18T14:14:07.900 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.901 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.901 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.901 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.901 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_password": { 2023-10-18T14:14:07.901 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_password", 2023-10-18T14:14:07.902 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.902 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.902 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.902 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.902 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.903 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.903 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.903 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-18T14:14:07.903 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.904 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.904 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.904 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.904 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_url": { 2023-10-18T14:14:07.905 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_url", 2023-10-18T14:14:07.905 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.905 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.905 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.905 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.906 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.906 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.906 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.906 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-18T14:14:07.907 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.907 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.907 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.907 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.907 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_username": { 2023-10-18T14:14:07.908 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_username", 2023-10-18T14:14:07.908 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.908 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.908 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.908 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.909 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.909 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.909 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.909 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-18T14:14:07.909 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.910 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.910 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.910 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.910 INFO:teuthology.orchestra.run.smithi114.stdout: "secure_monitoring_stack": { 2023-10-18T14:14:07.910 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "secure_monitoring_stack", 2023-10-18T14:14:07.911 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.911 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.911 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.912 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.912 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.912 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.912 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.912 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-18T14:14:07.913 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.913 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.913 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.913 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.913 INFO:teuthology.orchestra.run.smithi114.stdout: "service_discovery_port": { 2023-10-18T14:14:07.914 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "service_discovery_port", 2023-10-18T14:14:07.914 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:07.914 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.914 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.915 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8765", 2023-10-18T14:14:07.915 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.915 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.915 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.915 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "cephadm service discovery port", 2023-10-18T14:14:07.916 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.916 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.916 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.916 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.916 INFO:teuthology.orchestra.run.smithi114.stdout: "ssh_config_file": { 2023-10-18T14:14:07.917 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssh_config_file", 2023-10-18T14:14:07.917 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.917 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.917 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.917 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.918 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.918 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.918 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.918 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-18T14:14:07.918 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.919 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.919 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.919 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.919 INFO:teuthology.orchestra.run.smithi114.stdout: "use_agent": { 2023-10-18T14:14:07.919 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "use_agent", 2023-10-18T14:14:07.920 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.920 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.920 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.920 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.920 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.921 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.921 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.921 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-18T14:14:07.921 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.921 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.922 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.922 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.922 INFO:teuthology.orchestra.run.smithi114.stdout: "use_repo_digest": { 2023-10-18T14:14:07.922 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "use_repo_digest", 2023-10-18T14:14:07.922 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.923 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.923 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.923 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.923 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.923 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.924 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.924 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-18T14:14:07.924 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.924 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.924 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.925 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.925 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_failed_host_check": { 2023-10-18T14:14:07.925 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_failed_host_check", 2023-10-18T14:14:07.925 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.925 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.926 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.926 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.926 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.926 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.927 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.927 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if the host check fails", 2023-10-18T14:14:07.927 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.927 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.928 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.928 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.928 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_stray_daemons": { 2023-10-18T14:14:07.928 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_stray_daemons", 2023-10-18T14:14:07.928 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.929 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.929 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.929 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.929 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.929 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.929 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.930 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-18T14:14:07.930 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.930 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.930 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.930 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.931 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_stray_hosts": { 2023-10-18T14:14:07.931 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_stray_hosts", 2023-10-18T14:14:07.931 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.931 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.931 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.932 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.932 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.932 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.932 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.932 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-18T14:14:07.933 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.933 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.933 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.933 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:07.933 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:07.934 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.934 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:07.934 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crash", 2023-10-18T14:14:07.934 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:07.934 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:07.935 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:07.935 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:07.935 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:07.935 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.935 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.936 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.936 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.936 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.936 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.936 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:07.937 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:07.937 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:07.937 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:07.937 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:07.937 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:07.938 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:07.938 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:07.938 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.938 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.938 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.939 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.939 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.939 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:07.939 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:07.939 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.939 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.940 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.940 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.940 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.940 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.940 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.941 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.941 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.941 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.941 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.941 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.942 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:07.942 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:07.942 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.942 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.942 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.942 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:07.943 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.943 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.943 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:07.943 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:07.943 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:07.944 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:07.944 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:07.944 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:07.944 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:07.944 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:07.945 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.945 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.945 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.945 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.945 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.946 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:07.946 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:07.946 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.946 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.947 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.947 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.947 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.947 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.947 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.948 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.948 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.948 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.948 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.948 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.949 INFO:teuthology.orchestra.run.smithi114.stdout: "retain_interval": { 2023-10-18T14:14:07.949 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "retain_interval", 2023-10-18T14:14:07.949 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:07.949 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.949 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.949 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "31536000", 2023-10-18T14:14:07.950 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.950 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.950 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.950 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-18T14:14:07.950 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.951 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.951 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.951 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.951 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_recent_interval": { 2023-10-18T14:14:07.951 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_recent_interval", 2023-10-18T14:14:07.952 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:07.952 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.952 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:07.952 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1209600", 2023-10-18T14:14:07.952 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.953 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.953 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.953 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-18T14:14:07.953 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.953 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.954 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.954 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:07.954 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:07.954 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.954 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:07.955 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "dashboard", 2023-10-18T14:14:07.955 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:07.955 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:07.955 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:07.955 INFO:teuthology.orchestra.run.smithi114.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-18T14:14:07.956 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-18T14:14:07.956 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:07.956 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.956 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.956 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:07.957 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.957 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.957 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.957 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.957 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.957 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.958 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.958 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.958 INFO:teuthology.orchestra.run.smithi114.stdout: "ALERTMANAGER_API_HOST": { 2023-10-18T14:14:07.958 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-18T14:14:07.959 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.959 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.959 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.959 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.959 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.959 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.960 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.960 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.960 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.960 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.960 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.961 INFO:teuthology.orchestra.run.smithi114.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-18T14:14:07.961 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-18T14:14:07.961 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.961 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.962 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.962 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.962 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.962 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.962 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.963 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.963 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.963 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.963 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.963 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.964 INFO:teuthology.orchestra.run.smithi114.stdout: "AUDIT_API_ENABLED": { 2023-10-18T14:14:07.964 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "AUDIT_API_ENABLED", 2023-10-18T14:14:07.964 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.964 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.964 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.965 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:07.965 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.965 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.965 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.965 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.966 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.966 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.966 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.966 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.966 INFO:teuthology.orchestra.run.smithi114.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-18T14:14:07.967 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-18T14:14:07.967 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.967 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.967 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.967 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.967 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.968 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.968 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.968 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.968 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.968 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.969 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.969 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.969 INFO:teuthology.orchestra.run.smithi114.stdout: "ENABLE_BROWSABLE_API": { 2023-10-18T14:14:07.969 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-18T14:14:07.969 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.969 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.970 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.970 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.970 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.970 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.970 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.971 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.971 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.971 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.971 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.971 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.972 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-18T14:14:07.972 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-18T14:14:07.972 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.972 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.972 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.973 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.973 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.973 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.973 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.973 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.974 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.974 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.974 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.974 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.974 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-18T14:14:07.975 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-18T14:14:07.975 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.975 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.975 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.975 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.975 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.976 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.976 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.976 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.976 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.976 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.977 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.977 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.977 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-18T14:14:07.977 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-18T14:14:07.977 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.978 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.978 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.978 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.978 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.978 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.979 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.979 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.979 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.979 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.979 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.980 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.980 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-18T14:14:07.980 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-18T14:14:07.980 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.980 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.981 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.981 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.981 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.981 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.981 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.982 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.982 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.982 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.982 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.982 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.983 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-18T14:14:07.983 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-18T14:14:07.983 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.983 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.983 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.984 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.984 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.984 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.984 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.984 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.985 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.985 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.985 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.985 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.985 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-18T14:14:07.986 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-18T14:14:07.986 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.986 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.986 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.986 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.987 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.987 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.987 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.987 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.987 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.987 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.988 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.988 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-18T14:14:07.988 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-18T14:14:07.988 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.989 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.989 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.989 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.989 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.989 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.990 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.990 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.990 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.990 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.990 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.991 INFO:teuthology.orchestra.run.smithi114.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-18T14:14:07.991 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-18T14:14:07.991 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.991 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.992 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.992 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:07.992 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.992 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.992 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.993 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.993 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.993 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.993 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.993 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_PASSWORD": { 2023-10-18T14:14:07.994 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-18T14:14:07.994 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.994 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.994 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.994 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2023-10-18T14:14:07.995 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.995 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.995 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.995 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.995 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.996 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.996 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.996 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-18T14:14:07.996 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-18T14:14:07.997 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:07.997 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:07.997 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:07.997 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:07.997 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:07.997 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:07.998 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:07.998 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:07.998 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:07.998 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:07.998 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:07.999 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:07.999 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_URL": { 2023-10-18T14:14:07.999 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_URL", 2023-10-18T14:14:07.999 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:07.999 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.000 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.000 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.000 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.000 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.000 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.001 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.001 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.001 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.001 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.002 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_USERNAME": { 2023-10-18T14:14:08.002 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-18T14:14:08.002 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.002 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.002 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.003 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2023-10-18T14:14:08.003 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.003 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.003 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.003 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.004 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.004 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.004 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.004 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-18T14:14:08.005 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-18T14:14:08.005 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.005 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.005 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.005 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.006 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.006 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.006 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.006 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.006 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.007 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.007 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.007 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-18T14:14:08.007 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-18T14:14:08.008 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.008 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.008 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.008 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.008 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.008 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.009 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.009 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.009 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.009 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.009 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.010 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.010 INFO:teuthology.orchestra.run.smithi114.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-18T14:14:08.010 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-18T14:14:08.010 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.010 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.011 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.011 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.011 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.011 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.011 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.012 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.012 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.012 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.012 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.012 INFO:teuthology.orchestra.run.smithi114.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-18T14:14:08.013 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-18T14:14:08.013 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.013 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.013 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.013 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.014 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.014 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.014 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.014 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.014 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.015 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.015 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.015 INFO:teuthology.orchestra.run.smithi114.stdout: "PROMETHEUS_API_HOST": { 2023-10-18T14:14:08.015 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-18T14:14:08.016 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.016 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.016 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.016 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.016 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.017 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.017 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.017 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.017 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.017 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.018 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.018 INFO:teuthology.orchestra.run.smithi114.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-18T14:14:08.018 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-18T14:14:08.018 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.019 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.019 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.019 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.019 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.019 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.020 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.020 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.020 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.020 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.020 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.021 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-18T14:14:08.021 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-18T14:14:08.021 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.021 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.022 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.022 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.022 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.022 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.022 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.023 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.023 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.023 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.023 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-18T14:14:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-18T14:14:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-18T14:14:08.027 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-18T14:14:08.027 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.027 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.027 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.027 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.027 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.028 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.028 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.028 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.028 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.028 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.029 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.029 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-18T14:14:08.029 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-18T14:14:08.029 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.030 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.030 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.030 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.030 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.030 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.031 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.031 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.031 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.031 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.031 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.032 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.032 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-18T14:14:08.032 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-18T14:14:08.032 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.032 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.033 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.033 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.033 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.033 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.033 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.034 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.034 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.034 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.034 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.035 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-18T14:14:08.035 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-18T14:14:08.035 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.035 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.035 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.036 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.036 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.036 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.036 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.036 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.037 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.037 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.037 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.037 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-18T14:14:08.037 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-18T14:14:08.038 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.038 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.038 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.038 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.038 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.039 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.039 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.039 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.039 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.039 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.040 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.040 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_ENABLED": { 2023-10-18T14:14:08.040 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-18T14:14:08.040 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.041 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.041 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.041 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.041 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.041 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.042 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.042 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.042 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.042 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.042 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.043 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-18T14:14:08.043 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-18T14:14:08.043 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.043 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.044 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.044 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-18T14:14:08.044 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.044 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.044 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.045 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.045 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.045 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.045 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.045 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-18T14:14:08.046 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-18T14:14:08.046 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.046 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.046 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.046 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:08.047 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.047 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.047 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.047 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.047 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.048 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.048 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.048 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-18T14:14:08.048 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-18T14:14:08.048 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.049 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.049 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.049 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8", 2023-10-18T14:14:08.049 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.050 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.050 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.050 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.050 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.050 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.051 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.051 INFO:teuthology.orchestra.run.smithi114.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-18T14:14:08.051 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-18T14:14:08.051 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.051 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.052 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.052 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "45", 2023-10-18T14:14:08.052 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.052 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.052 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.053 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.053 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.053 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.053 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.054 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_ACCESS_KEY": { 2023-10-18T14:14:08.054 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-18T14:14:08.054 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.054 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.054 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.055 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.055 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.055 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.055 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.055 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.056 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.056 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.056 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.056 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-18T14:14:08.057 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-18T14:14:08.057 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.057 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.057 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.057 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2023-10-18T14:14:08.058 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.058 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.058 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.058 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.058 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.059 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.059 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.059 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_SECRET_KEY": { 2023-10-18T14:14:08.059 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-18T14:14:08.060 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.060 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.060 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.060 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.060 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.061 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.061 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.061 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.061 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.061 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.062 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.062 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_SSL_VERIFY": { 2023-10-18T14:14:08.062 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-18T14:14:08.062 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.063 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.063 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.063 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.063 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.063 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.063 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.064 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.064 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.064 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.064 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.065 INFO:teuthology.orchestra.run.smithi114.stdout: "UNSAFE_TLS_v1_2": { 2023-10-18T14:14:08.065 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-18T14:14:08.065 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.065 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.065 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.066 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.066 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.066 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.066 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.066 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.067 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.067 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.067 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.067 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-18T14:14:08.068 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-18T14:14:08.068 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.068 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.068 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.068 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:08.068 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.069 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.069 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.069 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.069 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.069 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.070 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.070 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-18T14:14:08.070 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-18T14:14:08.071 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.071 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.071 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.071 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:08.071 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.071 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.072 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.072 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.072 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.072 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.072 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.073 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-18T14:14:08.073 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-18T14:14:08.073 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.073 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.074 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.074 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2023-10-18T14:14:08.074 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.074 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.074 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.075 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.075 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.075 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.075 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.075 INFO:teuthology.orchestra.run.smithi114.stdout: "cross_origin_url": { 2023-10-18T14:14:08.076 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cross_origin_url", 2023-10-18T14:14:08.076 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.076 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.076 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.076 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.077 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.077 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.077 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.077 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.077 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.078 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.078 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.078 INFO:teuthology.orchestra.run.smithi114.stdout: "crt_file": { 2023-10-18T14:14:08.078 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crt_file", 2023-10-18T14:14:08.079 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.079 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.079 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.079 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.079 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.080 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.080 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.080 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.080 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.080 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.081 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.081 INFO:teuthology.orchestra.run.smithi114.stdout: "debug": { 2023-10-18T14:14:08.081 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "debug", 2023-10-18T14:14:08.081 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.081 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.082 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.082 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.082 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.082 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.082 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.083 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable/disable debug options", 2023-10-18T14:14:08.083 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.083 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.083 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.084 INFO:teuthology.orchestra.run.smithi114.stdout: "jwt_token_ttl": { 2023-10-18T14:14:08.084 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "jwt_token_ttl", 2023-10-18T14:14:08.084 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.084 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.084 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.085 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "28800", 2023-10-18T14:14:08.085 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.085 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.085 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.085 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.086 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.086 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.086 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.086 INFO:teuthology.orchestra.run.smithi114.stdout: "key_file": { 2023-10-18T14:14:08.087 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "key_file", 2023-10-18T14:14:08.087 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.087 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.087 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.087 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.088 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.088 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.088 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.088 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.088 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.088 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.089 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.089 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.089 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.089 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.090 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.090 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.090 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.090 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.090 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.091 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.091 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.091 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.091 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.091 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.092 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.092 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.092 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.092 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.092 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.093 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.093 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.093 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.093 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.094 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.094 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.094 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.094 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.094 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.095 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.095 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.095 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.095 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.095 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.096 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.096 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.096 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.096 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.097 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.097 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.097 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.097 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.097 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.098 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.098 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.098 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.098 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.098 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.099 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.099 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.099 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.099 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.099 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.099 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.100 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.100 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.100 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.100 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.101 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.101 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.101 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.101 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.101 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.102 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.102 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.102 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.102 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.102 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.103 INFO:teuthology.orchestra.run.smithi114.stdout: "motd": { 2023-10-18T14:14:08.103 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "motd", 2023-10-18T14:14:08.103 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.103 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.104 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.104 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.104 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.104 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.104 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.105 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "The message of the day", 2023-10-18T14:14:08.105 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.105 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.105 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.106 INFO:teuthology.orchestra.run.smithi114.stdout: "redirect_resolve_ip_addr": { 2023-10-18T14:14:08.106 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "redirect_resolve_ip_addr", 2023-10-18T14:14:08.106 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.106 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.106 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.107 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.107 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.107 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.107 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.107 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.108 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.108 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.108 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.108 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2023-10-18T14:14:08.109 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2023-10-18T14:14:08.109 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.109 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.109 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.109 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "::", 2023-10-18T14:14:08.109 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.110 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.110 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.110 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.110 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.110 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.111 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.111 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2023-10-18T14:14:08.111 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2023-10-18T14:14:08.111 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.112 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.112 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.112 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8080", 2023-10-18T14:14:08.112 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.112 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.112 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.113 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.113 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.113 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.113 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.114 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl": { 2023-10-18T14:14:08.114 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl", 2023-10-18T14:14:08.114 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.114 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.115 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.115 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.115 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.115 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.115 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.116 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.116 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.116 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.116 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.116 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl_server_port": { 2023-10-18T14:14:08.117 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl_server_port", 2023-10-18T14:14:08.117 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.117 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.117 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.117 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8443", 2023-10-18T14:14:08.118 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.118 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.118 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.118 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.118 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.119 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.119 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.119 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_behaviour": { 2023-10-18T14:14:08.119 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_behaviour", 2023-10-18T14:14:08.120 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.120 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.120 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.120 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "redirect", 2023-10-18T14:14:08.120 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.120 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.121 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.121 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.121 INFO:teuthology.orchestra.run.smithi114.stdout: "redirect" 2023-10-18T14:14:08.121 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.121 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.122 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.122 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.122 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.122 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_error_status_code": { 2023-10-18T14:14:08.123 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_error_status_code", 2023-10-18T14:14:08.123 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.123 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.123 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.123 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "500", 2023-10-18T14:14:08.124 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "400", 2023-10-18T14:14:08.124 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "599", 2023-10-18T14:14:08.124 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.124 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.124 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.125 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.125 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.125 INFO:teuthology.orchestra.run.smithi114.stdout: "url_prefix": { 2023-10-18T14:14:08.125 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "url_prefix", 2023-10-18T14:14:08.125 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.126 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.126 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.126 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.126 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.126 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.127 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.127 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.127 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.127 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.127 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.128 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.128 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.128 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "devicehealth", 2023-10-18T14:14:08.129 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.129 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.129 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.129 INFO:teuthology.orchestra.run.smithi114.stdout: "enable_monitoring": { 2023-10-18T14:14:08.130 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enable_monitoring", 2023-10-18T14:14:08.130 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.130 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.130 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.130 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.131 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.131 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.131 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.131 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "monitor device health metrics", 2023-10-18T14:14:08.131 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.131 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.132 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.132 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.132 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.132 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.133 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.133 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.133 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.133 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.133 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.134 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.134 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.134 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.134 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.134 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.135 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.135 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.135 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.135 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.135 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.135 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.136 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.136 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.136 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.136 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.137 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.137 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.137 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.137 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.137 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.138 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.138 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.138 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.138 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.138 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.139 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.139 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.139 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.139 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.140 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.140 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.140 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.140 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.140 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.141 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.141 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.141 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.141 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.141 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.141 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.142 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.142 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.142 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.142 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.142 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.143 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.143 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.143 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.143 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.144 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.144 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.144 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.144 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.144 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.145 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.145 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.145 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.145 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.146 INFO:teuthology.orchestra.run.smithi114.stdout: "mark_out_threshold": { 2023-10-18T14:14:08.146 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mark_out_threshold", 2023-10-18T14:14:08.146 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.146 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.146 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.147 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "2419200", 2023-10-18T14:14:08.147 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.147 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.147 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.147 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-18T14:14:08.148 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.148 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.148 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.148 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_name": { 2023-10-18T14:14:08.149 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pool_name", 2023-10-18T14:14:08.149 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.149 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.149 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.149 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "device_health_metrics", 2023-10-18T14:14:08.150 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.150 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.150 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.150 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-18T14:14:08.150 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.151 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.151 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.151 INFO:teuthology.orchestra.run.smithi114.stdout: "retention_period": { 2023-10-18T14:14:08.151 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "retention_period", 2023-10-18T14:14:08.151 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.152 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.152 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.152 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15552000", 2023-10-18T14:14:08.152 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.152 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.153 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.153 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long to retain device health metrics", 2023-10-18T14:14:08.153 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.153 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.153 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.154 INFO:teuthology.orchestra.run.smithi114.stdout: "scrape_frequency": { 2023-10-18T14:14:08.154 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "scrape_frequency", 2023-10-18T14:14:08.154 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.154 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.155 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.155 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "86400", 2023-10-18T14:14:08.155 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.155 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.155 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.156 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-18T14:14:08.156 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.156 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.156 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.157 INFO:teuthology.orchestra.run.smithi114.stdout: "self_heal": { 2023-10-18T14:14:08.157 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "self_heal", 2023-10-18T14:14:08.157 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.157 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.157 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.158 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.158 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.158 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.158 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.158 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-18T14:14:08.159 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.159 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.159 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.159 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:08.159 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:08.160 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.160 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.160 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.160 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:08.160 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.161 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.161 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.161 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to wake up and check device health", 2023-10-18T14:14:08.161 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.161 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.162 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.162 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_threshold": { 2023-10-18T14:14:08.162 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_threshold", 2023-10-18T14:14:08.162 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.163 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.163 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.163 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "7257600", 2023-10-18T14:14:08.163 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.163 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.164 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.164 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-18T14:14:08.164 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.164 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.164 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.165 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.165 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.165 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "diskprediction_local", 2023-10-18T14:14:08.166 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.166 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.166 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.166 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.166 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.167 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.167 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.167 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.167 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.167 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.168 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.168 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.168 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.168 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.168 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.168 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.169 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.169 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.169 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.169 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.169 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.170 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.170 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.170 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.170 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.171 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.171 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.171 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.171 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.171 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.172 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.172 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.172 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.172 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.172 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.173 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.173 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.173 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.173 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.174 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.174 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.174 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.174 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.174 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.175 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.175 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.175 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.175 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.175 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.176 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.176 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.176 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.176 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.176 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.177 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.177 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.177 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.177 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.177 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.178 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.178 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.178 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.178 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.178 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.179 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.179 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.179 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.179 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.179 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.180 INFO:teuthology.orchestra.run.smithi114.stdout: "predict_interval": { 2023-10-18T14:14:08.180 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "predict_interval", 2023-10-18T14:14:08.180 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.180 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.181 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.181 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "86400", 2023-10-18T14:14:08.181 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.181 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.181 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.182 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.182 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.182 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.182 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.183 INFO:teuthology.orchestra.run.smithi114.stdout: "predictor_model": { 2023-10-18T14:14:08.183 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "predictor_model", 2023-10-18T14:14:08.183 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.183 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.183 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.184 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "prophetstor", 2023-10-18T14:14:08.184 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.184 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.184 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.184 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.185 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.185 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.185 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.185 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:08.186 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:08.186 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.186 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.186 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.186 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:08.187 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.187 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.187 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.187 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.187 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.188 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.188 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.188 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.188 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.189 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "influx", 2023-10-18T14:14:08.189 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": false, 2023-10-18T14:14:08.189 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "influxdb python module not found", 2023-10-18T14:14:08.189 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.189 INFO:teuthology.orchestra.run.smithi114.stdout: "batch_size": { 2023-10-18T14:14:08.190 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "batch_size", 2023-10-18T14:14:08.190 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.190 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.190 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.190 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5000", 2023-10-18T14:14:08.191 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.191 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.191 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.191 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-18T14:14:08.191 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.192 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.192 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.192 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.192 INFO:teuthology.orchestra.run.smithi114.stdout: "database": { 2023-10-18T14:14:08.192 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "database", 2023-10-18T14:14:08.193 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.193 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.193 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.193 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "ceph", 2023-10-18T14:14:08.193 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.193 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.194 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.194 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-18T14:14:08.194 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.194 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.195 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.195 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": { 2023-10-18T14:14:08.195 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "hostname", 2023-10-18T14:14:08.195 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.196 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.196 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.196 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.196 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.196 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.196 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.197 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB server hostname", 2023-10-18T14:14:08.197 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.197 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.197 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.197 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.198 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:08.198 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:08.198 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.198 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.198 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.199 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "30", 2023-10-18T14:14:08.199 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "5", 2023-10-18T14:14:08.199 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.199 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.199 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-18T14:14:08.200 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.200 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.200 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.200 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.200 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.201 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.201 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.201 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.201 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.201 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.202 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.202 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.202 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.202 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.202 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.203 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.203 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.203 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.203 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.203 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.204 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.204 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.204 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.204 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.205 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.205 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.205 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.205 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.205 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.206 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.206 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.206 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.206 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.206 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.207 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.207 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.207 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.207 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.208 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.208 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.208 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.208 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.208 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.209 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.209 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.209 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.209 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.209 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.210 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.210 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.210 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.210 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.210 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.210 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.211 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.211 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.211 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.211 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.212 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.212 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.212 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.212 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.212 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.213 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.213 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.213 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.213 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.213 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.214 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.214 INFO:teuthology.orchestra.run.smithi114.stdout: "password": { 2023-10-18T14:14:08.214 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "password", 2023-10-18T14:14:08.214 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.215 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.215 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.215 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.215 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.215 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.216 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.216 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "password of InfluxDB server user", 2023-10-18T14:14:08.216 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.216 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.216 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.217 INFO:teuthology.orchestra.run.smithi114.stdout: "port": { 2023-10-18T14:14:08.217 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "port", 2023-10-18T14:14:08.217 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.217 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.217 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.218 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8086", 2023-10-18T14:14:08.218 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.218 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.218 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.219 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB server port", 2023-10-18T14:14:08.219 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.219 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.219 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.219 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl": { 2023-10-18T14:14:08.220 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl", 2023-10-18T14:14:08.220 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.220 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.220 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.220 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "false", 2023-10-18T14:14:08.221 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.221 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.221 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.221 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-18T14:14:08.221 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.222 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.222 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.222 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.222 INFO:teuthology.orchestra.run.smithi114.stdout: "threads": { 2023-10-18T14:14:08.222 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "threads", 2023-10-18T14:14:08.223 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.223 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.223 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.223 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2023-10-18T14:14:08.223 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2023-10-18T14:14:08.223 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "32", 2023-10-18T14:14:08.224 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.224 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-18T14:14:08.224 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.224 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.224 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.225 INFO:teuthology.orchestra.run.smithi114.stdout: "username": { 2023-10-18T14:14:08.225 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "username", 2023-10-18T14:14:08.225 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.225 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.226 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.226 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.226 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.226 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.226 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.227 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "username of InfluxDB server user", 2023-10-18T14:14:08.227 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.227 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.227 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.228 INFO:teuthology.orchestra.run.smithi114.stdout: "verify_ssl": { 2023-10-18T14:14:08.228 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "verify_ssl", 2023-10-18T14:14:08.228 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.228 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.228 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.229 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "true", 2023-10-18T14:14:08.229 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.229 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.229 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.229 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-18T14:14:08.229 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.230 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.230 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.230 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.230 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.230 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.231 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.231 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "insights", 2023-10-18T14:14:08.231 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.231 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.231 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.232 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.232 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.232 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.232 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.232 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.233 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.233 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.233 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.233 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.233 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.234 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.234 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.234 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.234 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.234 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.235 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.235 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.235 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.235 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.235 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.236 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.236 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.236 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.236 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.237 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.237 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.237 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.237 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.237 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.238 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.238 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.238 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.238 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.239 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.239 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.239 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.239 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.239 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.240 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.240 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.240 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.240 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.240 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.241 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.241 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.241 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.241 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.241 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.242 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.242 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.242 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.242 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.242 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.243 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.243 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.243 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.243 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.244 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.244 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.244 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.244 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.244 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.244 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.245 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.245 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.245 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.245 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.245 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.246 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "iostat", 2023-10-18T14:14:08.246 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.246 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.247 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.247 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.247 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.247 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.247 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.248 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.248 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.248 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.248 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.248 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.249 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.249 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.249 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.249 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.249 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.250 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.250 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.250 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.250 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.250 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.251 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.251 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.251 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.251 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.251 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.252 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.252 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.252 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.252 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.252 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.253 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.253 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.253 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.253 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.254 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.254 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.254 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.254 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.254 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.255 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.255 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.255 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.255 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.255 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.256 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.256 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.256 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.256 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.256 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.257 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.257 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.257 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.257 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.257 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.258 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.258 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.258 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.258 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.258 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.259 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.259 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.259 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.259 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.259 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.260 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.260 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.260 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.260 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.260 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.261 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.261 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "k8sevents", 2023-10-18T14:14:08.261 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.261 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.262 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.262 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_event_retention_days": { 2023-10-18T14:14:08.262 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ceph_event_retention_days", 2023-10-18T14:14:08.262 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.262 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.263 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.263 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "7", 2023-10-18T14:14:08.263 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.263 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.263 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.264 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-18T14:14:08.264 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.264 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.264 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.264 INFO:teuthology.orchestra.run.smithi114.stdout: "config_check_secs": { 2023-10-18T14:14:08.265 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "config_check_secs", 2023-10-18T14:14:08.265 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.265 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.265 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.265 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:08.266 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "10", 2023-10-18T14:14:08.266 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.266 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.266 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-18T14:14:08.266 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.267 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.267 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.267 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.267 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.268 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.268 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.268 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.268 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.268 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.269 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.269 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.269 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.269 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.269 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.269 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.270 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.270 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.270 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.270 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.270 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.271 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.271 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.271 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.271 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.272 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.272 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.272 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.272 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.272 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.273 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.273 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.273 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.273 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.273 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.274 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.274 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.274 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.274 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.275 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.275 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.275 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.275 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.275 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.276 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.276 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.276 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.276 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.276 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.277 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.277 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.277 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.277 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.278 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.278 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.278 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.278 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.278 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.278 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.279 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.279 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.279 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.279 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.279 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.280 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.280 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.280 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.280 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.280 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.281 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.281 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.281 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.281 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.282 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "localpool", 2023-10-18T14:14:08.282 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.282 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.282 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.282 INFO:teuthology.orchestra.run.smithi114.stdout: "failure_domain": { 2023-10-18T14:14:08.283 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "failure_domain", 2023-10-18T14:14:08.283 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.283 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.283 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.283 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "host", 2023-10-18T14:14:08.284 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.284 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.284 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.284 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "failure domain for any created local pool", 2023-10-18T14:14:08.284 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-18T14:14:08.285 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.285 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.285 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.285 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.286 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.286 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.286 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.286 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.286 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.287 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.287 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.287 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.287 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.287 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.287 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.288 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.288 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.288 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.288 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.288 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.289 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.289 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.289 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.289 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.290 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.290 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.290 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.290 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.290 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.291 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.291 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.291 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.291 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.291 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.291 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.292 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.292 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.292 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.292 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.293 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.293 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.293 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.293 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.293 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.294 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.294 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.294 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.294 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.294 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.295 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.295 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.295 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.295 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.295 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.296 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.296 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.296 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.296 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.296 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.297 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.297 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.297 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.297 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.297 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.298 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.298 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.298 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.298 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.299 INFO:teuthology.orchestra.run.smithi114.stdout: "min_size": { 2023-10-18T14:14:08.299 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "min_size", 2023-10-18T14:14:08.299 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.299 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.299 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.300 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.300 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.300 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.300 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.300 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default min_size for any created local pool", 2023-10-18T14:14:08.301 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-18T14:14:08.301 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.301 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.301 INFO:teuthology.orchestra.run.smithi114.stdout: "num_rep": { 2023-10-18T14:14:08.302 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "num_rep", 2023-10-18T14:14:08.302 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.302 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.302 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.302 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3", 2023-10-18T14:14:08.303 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.303 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.303 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.303 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default replica count for any created local pool", 2023-10-18T14:14:08.303 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.304 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.304 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.304 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_num": { 2023-10-18T14:14:08.304 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pg_num", 2023-10-18T14:14:08.304 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.305 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.305 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.305 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "128", 2023-10-18T14:14:08.305 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.305 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.306 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.306 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default pg_num for any created local pool", 2023-10-18T14:14:08.306 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.306 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.306 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.307 INFO:teuthology.orchestra.run.smithi114.stdout: "prefix": { 2023-10-18T14:14:08.307 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prefix", 2023-10-18T14:14:08.307 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.307 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.308 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.308 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.308 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.308 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.308 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.309 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "name prefix for any created local pool", 2023-10-18T14:14:08.309 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.309 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.309 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.309 INFO:teuthology.orchestra.run.smithi114.stdout: "subtree": { 2023-10-18T14:14:08.310 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "subtree", 2023-10-18T14:14:08.310 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.310 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.310 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.310 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "rack", 2023-10-18T14:14:08.311 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.311 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.311 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.311 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-18T14:14:08.311 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-18T14:14:08.312 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.312 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.312 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.312 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.312 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.313 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.313 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mds_autoscaler", 2023-10-18T14:14:08.313 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.313 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.313 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.314 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.314 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.314 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.314 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.314 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.315 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.315 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.315 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.315 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.315 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.316 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.316 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.316 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.316 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.316 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.317 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.317 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.317 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.317 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.317 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.318 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.318 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.318 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.318 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.318 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.319 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.319 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.319 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.319 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.319 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.319 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.320 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.320 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.320 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.320 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.321 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.321 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.321 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.321 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.321 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.322 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.322 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.322 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.322 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.322 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.322 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.323 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.323 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.323 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.323 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.323 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.324 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.324 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.324 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.324 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.325 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.325 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.325 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.325 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.325 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.326 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.326 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.326 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.326 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.326 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.326 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.327 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.327 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.327 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.327 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.328 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mirroring", 2023-10-18T14:14:08.328 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.328 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.328 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.328 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.329 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.329 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.329 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.329 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.329 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.330 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.330 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.330 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.330 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.330 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.331 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.331 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.331 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.331 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.331 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.331 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.332 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.332 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.332 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.332 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.333 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.333 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.333 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.333 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.333 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.334 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.334 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.334 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.334 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.334 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.335 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.335 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.335 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.335 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.336 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.336 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.336 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.336 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.336 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.337 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.337 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.337 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.337 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.337 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.337 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.338 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.338 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.338 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.338 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.338 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.339 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.339 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.339 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.339 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.340 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.340 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.340 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.340 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.340 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.340 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.341 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.341 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.341 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.341 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.341 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.342 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.342 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.342 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "nfs", 2023-10-18T14:14:08.343 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.343 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.343 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.343 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.343 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.344 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.344 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.344 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.344 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.344 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.345 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.345 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.345 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.345 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.345 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.345 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.346 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.346 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.346 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.346 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.346 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.347 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.347 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.347 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.347 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.348 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.348 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.348 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.348 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.348 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.349 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.349 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.349 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.349 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.349 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.349 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.350 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.350 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.350 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.351 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.351 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.351 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.351 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.351 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.353 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.353 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.353 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.354 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.354 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.354 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.354 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.354 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.355 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.355 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.355 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.355 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.356 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.356 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.356 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.356 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.356 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.357 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.357 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.357 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.357 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.357 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.358 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.358 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.358 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.358 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.358 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.359 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.359 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "orchestrator", 2023-10-18T14:14:08.359 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.359 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.360 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.360 INFO:teuthology.orchestra.run.smithi114.stdout: "fail_fs": { 2023-10-18T14:14:08.360 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "fail_fs", 2023-10-18T14:14:08.360 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.360 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.360 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.361 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.361 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.361 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.361 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.361 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-18T14:14:08.362 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.362 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.362 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.362 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.363 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.363 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.363 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.363 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.363 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.364 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.364 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.364 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.364 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.364 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.365 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.365 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.365 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.365 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.365 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.366 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.366 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.366 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.366 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.366 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.367 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.367 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.367 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.367 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.367 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.368 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.368 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.368 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.368 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.368 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.369 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.369 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.369 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.369 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.369 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.369 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.370 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.370 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.370 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.370 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.370 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.371 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.371 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.371 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.371 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.371 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.372 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.372 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.372 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.372 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.372 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.372 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.373 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.373 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.373 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.373 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.373 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.374 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.374 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.374 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.374 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.374 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.375 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.375 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.375 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.375 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.375 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.376 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.376 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.376 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator": { 2023-10-18T14:14:08.376 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "orchestrator", 2023-10-18T14:14:08.376 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.377 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.377 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.377 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.377 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.377 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.377 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.378 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm", 2023-10-18T14:14:08.378 INFO:teuthology.orchestra.run.smithi114.stdout: "rook", 2023-10-18T14:14:08.378 INFO:teuthology.orchestra.run.smithi114.stdout: "test_orchestrator" 2023-10-18T14:14:08.378 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.378 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Orchestrator backend", 2023-10-18T14:14:08.379 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.379 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.379 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.379 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.379 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.380 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.380 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.380 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "osd_perf_query", 2023-10-18T14:14:08.380 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.380 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.380 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.381 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.381 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.381 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.381 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.381 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.382 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.382 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.382 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.382 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.382 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.383 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.383 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.383 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.383 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.383 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.384 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.384 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.384 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.384 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.384 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.385 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.385 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.385 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.385 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.385 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.385 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.386 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.386 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.386 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.386 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.387 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.387 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.387 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.387 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.387 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.387 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.388 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.388 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.388 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.388 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.388 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.389 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.389 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.389 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.389 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.389 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.390 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.390 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.390 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.390 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.391 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.391 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.391 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.391 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.391 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.392 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.392 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.392 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.392 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.392 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.393 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.393 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.393 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.393 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.393 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.393 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.394 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.394 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.394 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.394 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.394 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.395 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.395 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.395 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "osd_support", 2023-10-18T14:14:08.395 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.395 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.396 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.396 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.396 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.396 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.396 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.397 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.397 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.397 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.397 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.397 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.398 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.398 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.398 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.398 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.398 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.398 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.399 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.399 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.399 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.399 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.399 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.400 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.400 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.400 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.400 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.400 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.401 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.401 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.401 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.401 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.401 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.402 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.402 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.402 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.402 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.402 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.403 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.403 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.403 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.403 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.403 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.404 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.404 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.404 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.404 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.404 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.405 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.405 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.405 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.405 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.405 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.405 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.406 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.406 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.406 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.406 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.407 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.407 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.407 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.407 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.407 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.408 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.408 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.408 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.408 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.408 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.408 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.409 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.409 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.409 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.409 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.409 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.410 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.410 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.410 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pg_autoscaler", 2023-10-18T14:14:08.410 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.410 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.411 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.411 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.411 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.411 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.411 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.412 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.412 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.412 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.412 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.412 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.413 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.413 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.413 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.413 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.413 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.413 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.414 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.414 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.414 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.414 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.415 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.415 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.415 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.415 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.415 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.415 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.416 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.416 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.416 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.416 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.416 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.417 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.417 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.417 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.417 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.417 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.418 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.418 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.418 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.418 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.418 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.419 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.419 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.419 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.419 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.419 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.420 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.420 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.420 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.420 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.420 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.420 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.421 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.421 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.421 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.421 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.421 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.421 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.422 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.422 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.422 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.422 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.422 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.423 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.423 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.423 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.423 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.423 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.424 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.424 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.424 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.424 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:08.424 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:08.425 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.425 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.425 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.425 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:08.425 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.426 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.426 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.426 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.426 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.426 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.427 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.427 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.427 INFO:teuthology.orchestra.run.smithi114.stdout: "threshold": { 2023-10-18T14:14:08.427 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "threshold", 2023-10-18T14:14:08.427 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:08.427 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.428 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.428 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3.0", 2023-10-18T14:14:08.428 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1.0", 2023-10-18T14:14:08.428 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.429 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.429 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "scaling threshold", 2023-10-18T14:14:08.429 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-18T14:14:08.429 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.429 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.429 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.430 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.430 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.430 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.430 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "progress", 2023-10-18T14:14:08.430 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.431 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.431 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.431 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_pg_recovery_event": { 2023-10-18T14:14:08.431 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_pg_recovery_event", 2023-10-18T14:14:08.431 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.432 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.432 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.432 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.432 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.432 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.433 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.433 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-18T14:14:08.433 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.433 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.433 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.434 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.434 INFO:teuthology.orchestra.run.smithi114.stdout: "enabled": { 2023-10-18T14:14:08.434 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enabled", 2023-10-18T14:14:08.434 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.434 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.435 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.435 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.435 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.435 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.435 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.436 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.436 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.436 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.436 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.436 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.437 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.437 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.437 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.437 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.437 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.438 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.438 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.438 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.438 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.438 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.438 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.439 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.439 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.439 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.439 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.439 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.440 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.440 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.440 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.440 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.440 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.441 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.441 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.441 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.441 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.441 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.441 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.442 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.442 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.442 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.442 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.442 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.443 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.443 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.443 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.443 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.443 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.444 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.444 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.444 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.444 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.444 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.445 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.445 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.445 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.445 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.445 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.446 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.446 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.446 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.446 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.446 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.447 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.447 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.447 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.447 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.447 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.448 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.448 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.448 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.448 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.448 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.448 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.449 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.449 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.449 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.449 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.449 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.450 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.450 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.450 INFO:teuthology.orchestra.run.smithi114.stdout: "max_completed_events": { 2023-10-18T14:14:08.450 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_completed_events", 2023-10-18T14:14:08.450 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.451 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.451 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.451 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "50", 2023-10-18T14:14:08.451 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.451 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.451 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.452 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "number of past completed events to remember", 2023-10-18T14:14:08.452 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.452 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.452 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.452 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.453 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:08.453 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:08.453 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.453 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.453 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.454 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2023-10-18T14:14:08.454 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.454 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.454 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.454 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long the module is going to sleep", 2023-10-18T14:14:08.455 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.455 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.455 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.455 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.455 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.456 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.456 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.456 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prometheus", 2023-10-18T14:14:08.456 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.456 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.457 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.457 INFO:teuthology.orchestra.run.smithi114.stdout: "cache": { 2023-10-18T14:14:08.457 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cache", 2023-10-18T14:14:08.457 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.457 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.457 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.458 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.458 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.458 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.458 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.458 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.459 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.459 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.459 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.459 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.459 INFO:teuthology.orchestra.run.smithi114.stdout: "exclude_perf_counters": { 2023-10-18T14:14:08.460 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "exclude_perf_counters", 2023-10-18T14:14:08.460 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.460 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.460 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.460 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.460 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.461 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.461 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.461 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-18T14:14:08.461 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-18T14:14:08.461 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.462 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.462 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.462 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.462 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.462 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.463 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.463 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.463 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.463 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.463 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.464 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.464 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.464 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.464 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.464 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.465 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.465 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.465 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.465 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.465 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.466 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.466 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.466 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.466 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.466 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.467 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.467 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.467 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.467 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.467 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.468 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.468 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.468 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.468 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.468 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.468 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.469 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.469 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.469 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.469 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.469 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.470 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.470 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.470 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.470 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.470 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.471 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.471 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.471 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.471 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.471 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.471 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.472 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.472 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.472 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.472 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.472 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.473 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.473 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.473 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.473 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.473 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.473 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.474 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.474 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.474 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.474 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.474 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.475 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.475 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.475 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.475 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.475 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_stats_pools": { 2023-10-18T14:14:08.476 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_stats_pools", 2023-10-18T14:14:08.476 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.476 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.476 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.476 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.477 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.477 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.477 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.477 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.477 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.477 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.478 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.478 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.478 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-18T14:14:08.478 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-18T14:14:08.478 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.479 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.479 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.479 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "300", 2023-10-18T14:14:08.479 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.479 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.480 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.480 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.480 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.480 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.480 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.480 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.481 INFO:teuthology.orchestra.run.smithi114.stdout: "scrape_interval": { 2023-10-18T14:14:08.481 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "scrape_interval", 2023-10-18T14:14:08.481 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:08.481 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.481 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.482 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15.0", 2023-10-18T14:14:08.482 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.482 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.482 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.482 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.483 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.483 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.483 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.483 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.483 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2023-10-18T14:14:08.483 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2023-10-18T14:14:08.484 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.484 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.484 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.484 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "::", 2023-10-18T14:14:08.484 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.485 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.485 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.485 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-18T14:14:08.485 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.485 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.486 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.486 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.486 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2023-10-18T14:14:08.486 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2023-10-18T14:14:08.486 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.487 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.487 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.487 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "9283", 2023-10-18T14:14:08.487 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.487 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.488 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.488 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-18T14:14:08.488 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.488 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.488 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.488 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.489 INFO:teuthology.orchestra.run.smithi114.stdout: "stale_cache_strategy": { 2023-10-18T14:14:08.489 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "stale_cache_strategy", 2023-10-18T14:14:08.489 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.489 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.489 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.490 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "log", 2023-10-18T14:14:08.490 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.490 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.490 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.490 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.491 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.491 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.491 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.491 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.491 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_behaviour": { 2023-10-18T14:14:08.492 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_behaviour", 2023-10-18T14:14:08.492 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.492 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.492 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.492 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "default", 2023-10-18T14:14:08.493 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.493 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.493 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.493 INFO:teuthology.orchestra.run.smithi114.stdout: "default", 2023-10-18T14:14:08.493 INFO:teuthology.orchestra.run.smithi114.stdout: "error" 2023-10-18T14:14:08.493 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.494 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.494 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.494 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.494 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.495 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.495 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_error_status_code": { 2023-10-18T14:14:08.495 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_error_status_code", 2023-10-18T14:14:08.495 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.495 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.495 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.496 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "500", 2023-10-18T14:14:08.496 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "400", 2023-10-18T14:14:08.496 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "599", 2023-10-18T14:14:08.496 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.496 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.497 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.497 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.497 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.497 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.497 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.498 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.498 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.498 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_support", 2023-10-18T14:14:08.498 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.498 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.499 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.499 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.499 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.499 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.499 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.500 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.500 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.500 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.500 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.500 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.500 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.501 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.501 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.501 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.501 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.501 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.502 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.502 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.502 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.502 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.502 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.503 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.503 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.503 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.503 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.504 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.504 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.504 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.504 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.504 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.505 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.505 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.505 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.505 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.505 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.506 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.506 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.506 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.506 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.506 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.507 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.507 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.507 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.507 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.507 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.508 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.508 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.508 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.508 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.508 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.509 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.509 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.509 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.509 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.510 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.510 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.510 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.510 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.510 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.511 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.511 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.511 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.511 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.511 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.511 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.512 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.512 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.512 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.512 INFO:teuthology.orchestra.run.smithi114.stdout: "max_concurrent_snap_create": { 2023-10-18T14:14:08.512 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_concurrent_snap_create", 2023-10-18T14:14:08.513 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.513 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.513 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.513 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:08.513 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.514 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.514 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.514 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.514 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.514 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.515 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.515 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.515 INFO:teuthology.orchestra.run.smithi114.stdout: "mirror_snapshot_schedule": { 2023-10-18T14:14:08.515 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mirror_snapshot_schedule", 2023-10-18T14:14:08.516 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.516 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.516 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.516 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.516 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.517 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.517 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.517 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.517 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.517 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.518 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.518 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.518 INFO:teuthology.orchestra.run.smithi114.stdout: "trash_purge_schedule": { 2023-10-18T14:14:08.518 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "trash_purge_schedule", 2023-10-18T14:14:08.518 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.519 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.519 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.519 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.519 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.519 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.520 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.520 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.520 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.520 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.520 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.521 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.521 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.521 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.521 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.521 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "restful", 2023-10-18T14:14:08.521 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.522 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.522 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.522 INFO:teuthology.orchestra.run.smithi114.stdout: "enable_auth": { 2023-10-18T14:14:08.522 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enable_auth", 2023-10-18T14:14:08.522 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.523 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.523 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.523 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.523 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.523 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.524 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.524 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.524 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.524 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.524 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.525 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.525 INFO:teuthology.orchestra.run.smithi114.stdout: "key_file": { 2023-10-18T14:14:08.525 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "key_file", 2023-10-18T14:14:08.525 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.525 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.525 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.526 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.526 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.526 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.526 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.527 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.527 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.527 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.527 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.527 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.528 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.528 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.528 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.528 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.528 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.529 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.529 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.529 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.529 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.529 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.530 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.530 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.530 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.530 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.530 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.531 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.531 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.531 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.531 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.531 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.532 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.532 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.532 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.532 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.532 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.533 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.533 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.533 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.533 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.533 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.534 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.534 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.534 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.534 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.534 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.535 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.535 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.535 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.535 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.536 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.536 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.536 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.536 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.536 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.537 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.537 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.537 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.537 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.538 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.538 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.538 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.538 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.538 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.539 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.539 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.539 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.539 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.540 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.540 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.540 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.540 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.540 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.541 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.541 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.541 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.541 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.542 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2023-10-18T14:14:08.542 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2023-10-18T14:14:08.542 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.542 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.542 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.543 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.543 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.543 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.543 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.543 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.544 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.544 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.544 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.544 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2023-10-18T14:14:08.545 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2023-10-18T14:14:08.545 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.545 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.545 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.545 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.545 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.546 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.546 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.546 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.546 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.546 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.547 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.547 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.547 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.547 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.547 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.548 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rgw", 2023-10-18T14:14:08.548 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.548 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.548 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.548 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.549 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.549 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.549 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.549 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.549 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.550 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.550 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.550 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.550 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.550 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.551 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.551 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.551 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.551 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.551 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.551 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.552 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.552 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.552 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.552 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.553 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.553 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.553 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.553 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.553 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.554 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.554 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.554 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.554 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.554 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.555 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.555 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.555 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.555 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.555 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.556 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.556 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.556 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.556 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.556 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.556 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.557 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.557 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.557 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.557 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.557 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.558 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.558 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.558 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.558 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.558 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.559 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.559 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.559 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.559 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.560 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.560 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.560 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.560 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.560 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.561 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.561 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.561 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.561 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.561 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.561 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.562 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.562 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.562 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.562 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.562 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rook", 2023-10-18T14:14:08.563 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.563 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.563 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.563 INFO:teuthology.orchestra.run.smithi114.stdout: "drive_group_interval": { 2023-10-18T14:14:08.563 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "drive_group_interval", 2023-10-18T14:14:08.564 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:08.564 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.564 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.564 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "300.0", 2023-10-18T14:14:08.564 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.565 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.565 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.565 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-18T14:14:08.565 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.565 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.566 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.566 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.566 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.566 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.566 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.567 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.567 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.567 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.567 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.567 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.568 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.568 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.568 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.568 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.568 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.569 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.569 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.569 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.569 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.569 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.569 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.570 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.570 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.570 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.570 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.571 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.571 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.571 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.571 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.571 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.572 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.572 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.572 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.572 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.572 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.573 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.573 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.573 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.573 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.574 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.574 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.574 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.574 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.574 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.575 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.575 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.575 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.575 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.575 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.576 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.576 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.576 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.576 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.576 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.577 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.577 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.577 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.577 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.578 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.578 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.578 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.578 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.578 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.579 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.579 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.579 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.579 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.579 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.580 INFO:teuthology.orchestra.run.smithi114.stdout: "storage_class": { 2023-10-18T14:14:08.580 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "storage_class", 2023-10-18T14:14:08.580 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.580 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.581 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.581 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "local", 2023-10-18T14:14:08.581 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.581 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.581 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.581 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-18T14:14:08.582 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.582 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.582 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.582 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.582 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.583 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.583 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "selftest", 2023-10-18T14:14:08.583 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.583 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.584 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.584 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.584 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.584 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.584 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.585 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.585 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.585 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.585 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.585 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.586 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.586 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.586 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.586 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.586 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.587 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.587 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.587 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.587 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.587 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.588 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.588 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.588 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.588 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.589 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.589 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.589 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.589 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.589 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.589 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.590 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.590 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.590 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.590 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.591 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.591 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.591 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.591 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.591 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.592 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.592 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.592 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.592 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.592 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.593 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.593 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.593 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.593 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.593 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.594 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.594 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.594 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.594 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.594 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.595 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.595 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.595 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.595 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.595 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.596 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.596 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.596 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.596 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.596 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.597 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.597 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.597 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.597 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.598 INFO:teuthology.orchestra.run.smithi114.stdout: "roption1": { 2023-10-18T14:14:08.598 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "roption1", 2023-10-18T14:14:08.598 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.598 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.598 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.598 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.599 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.599 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.599 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.599 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.599 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.600 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.600 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.600 INFO:teuthology.orchestra.run.smithi114.stdout: "roption2": { 2023-10-18T14:14:08.600 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "roption2", 2023-10-18T14:14:08.601 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.601 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.601 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.601 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "xyz", 2023-10-18T14:14:08.601 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.602 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.602 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.602 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.602 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.602 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.603 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.603 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption1": { 2023-10-18T14:14:08.603 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption1", 2023-10-18T14:14:08.603 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.603 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.604 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.604 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.604 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.604 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.604 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.605 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.605 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.605 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.605 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.606 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption2": { 2023-10-18T14:14:08.606 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption2", 2023-10-18T14:14:08.606 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.606 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.606 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.607 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.607 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.607 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.607 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.607 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.608 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.608 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.608 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.608 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption3": { 2023-10-18T14:14:08.609 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption3", 2023-10-18T14:14:08.609 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:08.609 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.609 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.609 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.609 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.610 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.610 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.610 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.610 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.610 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.611 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.611 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption4": { 2023-10-18T14:14:08.611 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption4", 2023-10-18T14:14:08.611 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.612 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.612 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.612 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.612 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.612 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.613 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.613 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.613 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.613 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.613 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.614 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption5": { 2023-10-18T14:14:08.614 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption5", 2023-10-18T14:14:08.614 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.614 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.615 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.615 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.615 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.615 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.615 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.616 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.616 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.616 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.616 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.617 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption6": { 2023-10-18T14:14:08.617 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption6", 2023-10-18T14:14:08.617 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.617 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.617 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.617 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.618 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.618 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.618 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.618 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.618 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.619 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.619 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.619 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption7": { 2023-10-18T14:14:08.619 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption7", 2023-10-18T14:14:08.620 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.620 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.620 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.620 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.620 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2023-10-18T14:14:08.621 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "42", 2023-10-18T14:14:08.621 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.621 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.621 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.621 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.622 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.622 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.622 INFO:teuthology.orchestra.run.smithi114.stdout: "testkey": { 2023-10-18T14:14:08.622 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testkey", 2023-10-18T14:14:08.622 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.622 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.623 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.623 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.623 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.623 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.623 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.624 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.624 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.624 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.624 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.624 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.625 INFO:teuthology.orchestra.run.smithi114.stdout: "testlkey": { 2023-10-18T14:14:08.625 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testlkey", 2023-10-18T14:14:08.625 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.625 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.625 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.626 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.626 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.626 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.626 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.626 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.627 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.627 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.627 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.627 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.627 INFO:teuthology.orchestra.run.smithi114.stdout: "testnewline": { 2023-10-18T14:14:08.628 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testnewline", 2023-10-18T14:14:08.628 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.628 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.628 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.628 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.628 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.629 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.629 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.629 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.629 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.629 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.630 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.630 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.630 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.630 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.630 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snap_schedule", 2023-10-18T14:14:08.631 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.631 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.631 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.631 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_m_granularity": { 2023-10-18T14:14:08.631 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_m_granularity", 2023-10-18T14:14:08.632 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.632 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.632 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.632 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.632 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.633 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.633 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.633 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow minute scheduled snapshots", 2023-10-18T14:14:08.633 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.633 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.634 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.634 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.634 INFO:teuthology.orchestra.run.smithi114.stdout: "dump_on_update": { 2023-10-18T14:14:08.634 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "dump_on_update", 2023-10-18T14:14:08.634 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.635 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.635 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.635 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.635 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.635 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.636 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.636 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "dump database to debug log on update", 2023-10-18T14:14:08.636 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.636 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.636 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.637 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.637 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.637 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.637 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.637 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.638 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.638 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.638 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.638 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.638 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.639 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.639 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.639 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.639 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.639 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.640 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.640 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.640 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.640 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.640 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.641 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.641 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.641 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.641 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.641 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.642 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.642 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.642 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.642 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.642 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.643 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.643 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.643 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.643 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.643 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.644 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.644 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.644 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.644 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.644 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.645 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.645 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.645 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.645 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.645 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.646 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.646 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.646 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.646 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.646 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.647 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.647 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.647 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.647 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.647 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.648 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.648 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.648 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.648 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.648 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.648 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.649 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.649 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.649 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.649 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.649 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.650 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.650 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.650 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.650 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.650 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.651 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.651 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "stats", 2023-10-18T14:14:08.651 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.651 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.651 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.652 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.652 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.652 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.652 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.652 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.653 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.653 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.653 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.653 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.653 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.654 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.654 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.654 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.654 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.654 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.655 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.655 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.655 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.655 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.655 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.656 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.656 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.656 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.656 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.656 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "status", 2023-10-18T14:14:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.671 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.671 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.671 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.671 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.671 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.672 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.672 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.672 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.672 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.672 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.673 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.673 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.673 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.673 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.674 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.674 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.674 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.674 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.674 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.675 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.675 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.675 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.675 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.675 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.676 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.676 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.676 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.676 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.676 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.676 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.677 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.677 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.677 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.677 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.678 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.678 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.678 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.678 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.678 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.679 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.679 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.679 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.679 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.679 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.680 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.680 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.680 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.680 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.681 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "telegraf", 2023-10-18T14:14:08.681 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.681 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.681 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.681 INFO:teuthology.orchestra.run.smithi114.stdout: "address": { 2023-10-18T14:14:08.682 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "address", 2023-10-18T14:14:08.682 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.682 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.682 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.682 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-18T14:14:08.683 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.683 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.683 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.683 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.683 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.684 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.684 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.684 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:08.684 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:08.685 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.685 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.685 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.685 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15", 2023-10-18T14:14:08.685 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.685 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.686 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.686 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.686 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.686 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.686 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.687 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.687 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.687 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.687 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.688 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.688 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.688 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.688 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.688 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.689 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.689 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.689 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.689 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.689 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.690 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.690 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.690 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.690 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.690 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.691 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.691 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.691 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.691 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.692 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.692 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.692 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.692 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.692 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.693 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.693 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.693 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.693 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.693 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.694 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.694 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.694 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.694 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.695 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.695 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.695 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.695 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.695 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.695 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.696 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.696 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.696 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.696 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.696 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.697 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.697 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.697 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.697 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.697 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.698 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.698 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.698 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.698 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.698 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.699 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.699 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.699 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.699 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.699 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.700 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.700 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.700 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.700 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.700 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.700 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.701 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.701 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "telemetry", 2023-10-18T14:14:08.701 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.701 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.702 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.702 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_basic": { 2023-10-18T14:14:08.702 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_basic", 2023-10-18T14:14:08.702 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.702 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.703 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.703 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.703 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.703 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.703 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.704 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-18T14:14:08.704 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.704 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.704 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.705 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_crash": { 2023-10-18T14:14:08.705 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_crash", 2023-10-18T14:14:08.705 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.705 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.705 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.705 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.706 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.706 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.706 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.706 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-18T14:14:08.706 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.707 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.707 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.707 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_device": { 2023-10-18T14:14:08.707 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_device", 2023-10-18T14:14:08.708 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.708 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.708 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.708 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.708 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.709 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.709 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.709 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-18T14:14:08.709 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.709 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.710 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.710 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_ident": { 2023-10-18T14:14:08.710 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_ident", 2023-10-18T14:14:08.710 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.711 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.711 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.711 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.711 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.711 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.712 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.712 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-18T14:14:08.712 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.712 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.712 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.713 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_perf": { 2023-10-18T14:14:08.713 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_perf", 2023-10-18T14:14:08.713 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.713 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.713 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.714 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.714 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.714 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.714 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.714 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-18T14:14:08.715 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.715 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.715 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.715 INFO:teuthology.orchestra.run.smithi114.stdout: "contact": { 2023-10-18T14:14:08.716 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "contact", 2023-10-18T14:14:08.716 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.716 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.716 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.716 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.717 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.717 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.717 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.717 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.717 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.718 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.718 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.718 INFO:teuthology.orchestra.run.smithi114.stdout: "description": { 2023-10-18T14:14:08.718 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "description", 2023-10-18T14:14:08.719 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.719 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.719 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.719 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.719 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.719 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.720 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.720 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.720 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.720 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.720 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.721 INFO:teuthology.orchestra.run.smithi114.stdout: "device_url": { 2023-10-18T14:14:08.721 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_url", 2023-10-18T14:14:08.721 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.721 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.722 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.722 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-18T14:14:08.722 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.722 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.722 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.723 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.723 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.723 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.723 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.724 INFO:teuthology.orchestra.run.smithi114.stdout: "enabled": { 2023-10-18T14:14:08.724 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enabled", 2023-10-18T14:14:08.724 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.724 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.724 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.724 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.725 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.725 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.725 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.725 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.726 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.726 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.726 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.726 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:08.727 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:08.727 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.727 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.727 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.727 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "24", 2023-10-18T14:14:08.727 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "8", 2023-10-18T14:14:08.728 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.728 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.728 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.728 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.728 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.729 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.729 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.729 INFO:teuthology.orchestra.run.smithi114.stdout: "last_opt_revision": { 2023-10-18T14:14:08.729 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "last_opt_revision", 2023-10-18T14:14:08.729 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.730 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.730 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.730 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1", 2023-10-18T14:14:08.730 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.730 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.731 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.731 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.731 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.731 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.731 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.732 INFO:teuthology.orchestra.run.smithi114.stdout: "leaderboard": { 2023-10-18T14:14:08.732 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "leaderboard", 2023-10-18T14:14:08.732 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.732 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.732 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.733 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.733 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.733 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.733 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.733 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.734 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.734 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.734 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.734 INFO:teuthology.orchestra.run.smithi114.stdout: "leaderboard_description": { 2023-10-18T14:14:08.735 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "leaderboard_description", 2023-10-18T14:14:08.735 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.735 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.735 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.735 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.736 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.736 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.736 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.736 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.736 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.736 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.737 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.737 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.737 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.737 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.738 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.738 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.738 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.738 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.738 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.739 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.739 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.739 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.739 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.739 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.740 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.740 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.740 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.740 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.740 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.740 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.741 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.741 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.741 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.741 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.742 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.742 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.742 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.742 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.742 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.743 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.743 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.743 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.743 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.743 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.744 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.744 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.744 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.744 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.745 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.745 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.745 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.745 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.745 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.746 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.746 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.746 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.746 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.746 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.747 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.747 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.747 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.747 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.747 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.748 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.748 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.748 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.748 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.749 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.749 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.749 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.749 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.749 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.750 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.750 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.750 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.750 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.750 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.751 INFO:teuthology.orchestra.run.smithi114.stdout: "organization": { 2023-10-18T14:14:08.751 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "organization", 2023-10-18T14:14:08.751 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.751 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.752 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.752 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.752 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.752 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.752 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.753 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.753 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.753 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.753 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.754 INFO:teuthology.orchestra.run.smithi114.stdout: "proxy": { 2023-10-18T14:14:08.754 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "proxy", 2023-10-18T14:14:08.754 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.754 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.754 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.755 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.755 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.755 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.755 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.755 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.755 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.756 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.756 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.756 INFO:teuthology.orchestra.run.smithi114.stdout: "url": { 2023-10-18T14:14:08.756 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "url", 2023-10-18T14:14:08.757 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.757 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.757 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.757 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-18T14:14:08.757 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.758 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.758 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.758 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.758 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.758 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.759 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.759 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.759 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.759 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.760 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "test_orchestrator", 2023-10-18T14:14:08.760 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.760 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.760 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.760 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.761 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.761 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.761 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.761 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.761 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.762 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.762 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.762 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.762 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.762 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.763 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.763 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.763 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.763 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.764 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.764 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.764 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.764 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.764 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.765 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.765 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.765 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.765 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.766 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.766 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.766 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.766 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.766 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.767 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.767 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.767 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.767 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.767 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.768 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.768 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.768 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.768 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.768 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.769 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.769 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.769 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.769 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.769 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.769 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.770 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.770 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.770 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.770 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.771 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.771 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.771 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.771 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.771 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.772 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.772 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.772 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.772 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.772 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.773 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.773 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.773 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.773 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.773 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.774 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.774 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.774 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.774 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.775 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.775 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "volumes", 2023-10-18T14:14:08.775 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.775 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.775 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.776 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.776 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.776 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.776 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.776 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.776 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.777 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.777 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.777 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.777 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.777 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.778 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.778 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.778 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.778 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.778 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.778 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.779 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.779 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.779 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.779 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.780 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.780 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.780 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.780 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.780 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.781 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.781 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.781 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.781 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.781 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.782 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.782 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.782 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.782 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.782 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.783 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.783 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.783 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.783 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.783 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.784 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.784 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.784 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.784 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.784 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.785 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.785 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.785 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.785 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.785 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.786 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.786 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.786 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.786 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.787 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.787 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.787 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.787 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.787 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.788 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.788 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.788 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.788 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.788 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.789 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.789 INFO:teuthology.orchestra.run.smithi114.stdout: "max_concurrent_clones": { 2023-10-18T14:14:08.789 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_concurrent_clones", 2023-10-18T14:14:08.789 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.790 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.790 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.790 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "4", 2023-10-18T14:14:08.790 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.790 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.791 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.791 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-18T14:14:08.791 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.791 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.791 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.792 INFO:teuthology.orchestra.run.smithi114.stdout: "periodic_async_work": { 2023-10-18T14:14:08.792 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "periodic_async_work", 2023-10-18T14:14:08.792 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.792 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.792 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.793 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.793 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.793 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.793 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.793 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Periodically check for async work", 2023-10-18T14:14:08.794 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.794 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.794 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.794 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot_clone_delay": { 2023-10-18T14:14:08.795 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snapshot_clone_delay", 2023-10-18T14:14:08.795 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.795 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.795 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.795 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:08.796 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.796 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.796 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.796 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-18T14:14:08.796 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.797 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.797 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.797 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.797 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.798 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix", 2023-10-18T14:14:08.798 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.798 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.798 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.799 INFO:teuthology.orchestra.run.smithi114.stdout: "discovery_interval": { 2023-10-18T14:14:08.799 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "discovery_interval", 2023-10-18T14:14:08.799 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:08.799 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.799 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.800 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "100", 2023-10-18T14:14:08.800 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.800 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.800 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.800 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.800 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.801 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.801 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.801 INFO:teuthology.orchestra.run.smithi114.stdout: "identifier": { 2023-10-18T14:14:08.802 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "identifier", 2023-10-18T14:14:08.802 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.802 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.802 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.802 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.803 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.803 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.803 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.803 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.803 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.803 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.804 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.804 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:08.804 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:08.805 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.805 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.805 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.805 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:08.805 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.805 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.806 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.806 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.806 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.806 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.806 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.807 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.807 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.807 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.807 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.808 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.808 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.808 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.808 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.808 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.809 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.809 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.809 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.809 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.809 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.810 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.810 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.810 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.810 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.810 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.810 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.811 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.811 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.811 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.811 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.812 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.812 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.812 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.812 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.812 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.813 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.813 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.813 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.813 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.814 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.814 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.814 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.814 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.814 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.815 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.815 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.815 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.815 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.815 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.816 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.816 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.816 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.816 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.816 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.817 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.817 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.817 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.817 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.817 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.818 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.818 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.818 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.818 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.818 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.819 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.819 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.819 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.819 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.819 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.820 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.820 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.820 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.820 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_host": { 2023-10-18T14:14:08.821 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_host", 2023-10-18T14:14:08.821 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.821 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.821 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.821 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.821 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.822 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.822 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.822 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.822 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.823 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.823 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.823 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_port": { 2023-10-18T14:14:08.823 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_port", 2023-10-18T14:14:08.824 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.824 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.824 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.824 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10051", 2023-10-18T14:14:08.824 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.825 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.825 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.825 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.825 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.825 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.825 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.826 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_sender": { 2023-10-18T14:14:08.826 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_sender", 2023-10-18T14:14:08.826 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.826 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.827 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.827 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-18T14:14:08.827 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.827 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.827 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.828 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.828 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.828 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.828 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.828 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.829 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.829 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.829 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-10-18T14:14:08.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.829 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.829 INFO:teuthology.orchestra.run.smithi114.stdout: "gid": 24149, 2023-10-18T14:14:08.830 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "y", 2023-10-18T14:14:08.830 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr_features": 4540138322906710015, 2023-10-18T14:14:08.830 INFO:teuthology.orchestra.run.smithi114.stdout: "available_modules": [ 2023-10-18T14:14:08.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.830 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "alerts", 2023-10-18T14:14:08.831 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.831 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.831 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.831 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:08.831 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:08.832 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.832 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.832 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.832 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:08.832 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.833 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.833 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.833 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How frequently to reexamine health status", 2023-10-18T14:14:08.833 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.833 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.834 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.834 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.834 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.834 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.835 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.835 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.835 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.835 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.835 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.835 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.836 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.836 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.836 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.836 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.836 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.837 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.837 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.837 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.837 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.837 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.838 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.838 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.838 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.838 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.839 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.839 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.839 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.839 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.839 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.840 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.840 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.840 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.840 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.840 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.841 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.841 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.841 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.841 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.841 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.842 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.842 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.842 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.842 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.842 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.843 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.843 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.843 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.843 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.844 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.844 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.844 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.844 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.844 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.844 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.845 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.845 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.845 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.845 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.846 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.846 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.846 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.846 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.846 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.847 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.847 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.847 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.847 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.848 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_destination": { 2023-10-18T14:14:08.848 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_destination", 2023-10-18T14:14:08.848 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.848 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.848 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.849 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.849 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.849 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.849 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.849 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Email address to send alerts to", 2023-10-18T14:14:08.850 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.850 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.850 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.850 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_from_name": { 2023-10-18T14:14:08.850 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_from_name", 2023-10-18T14:14:08.851 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.851 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.851 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.851 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "Ceph", 2023-10-18T14:14:08.851 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.852 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.852 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.852 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Email From: name", 2023-10-18T14:14:08.852 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.852 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.853 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.853 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_host": { 2023-10-18T14:14:08.853 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_host", 2023-10-18T14:14:08.853 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.854 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.854 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.854 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.854 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.854 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.855 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.855 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP server", 2023-10-18T14:14:08.855 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.855 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.855 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.856 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_password": { 2023-10-18T14:14:08.856 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_password", 2023-10-18T14:14:08.856 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.856 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.856 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.857 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.857 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.857 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.857 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.857 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Password to authenticate with", 2023-10-18T14:14:08.858 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.858 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.858 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.858 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_port": { 2023-10-18T14:14:08.859 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_port", 2023-10-18T14:14:08.859 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.859 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.859 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.859 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "465", 2023-10-18T14:14:08.859 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.860 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.860 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.860 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP port", 2023-10-18T14:14:08.860 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.860 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.861 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.861 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_sender": { 2023-10-18T14:14:08.861 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_sender", 2023-10-18T14:14:08.861 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.862 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.862 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.862 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.862 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.862 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.863 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.863 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP envelope sender", 2023-10-18T14:14:08.863 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.863 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.863 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.864 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_ssl": { 2023-10-18T14:14:08.864 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_ssl", 2023-10-18T14:14:08.864 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.864 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.865 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.865 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.865 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.865 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.865 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.866 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-18T14:14:08.866 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.866 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.866 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.866 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_user": { 2023-10-18T14:14:08.867 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_user", 2023-10-18T14:14:08.867 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.867 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.867 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.867 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.868 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.868 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.868 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.868 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "User to authenticate as", 2023-10-18T14:14:08.868 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.869 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.869 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.869 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.869 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.869 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.870 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.870 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "balancer", 2023-10-18T14:14:08.870 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.870 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.870 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.870 INFO:teuthology.orchestra.run.smithi114.stdout: "active": { 2023-10-18T14:14:08.871 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "active", 2023-10-18T14:14:08.871 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.871 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.871 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.871 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.872 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.872 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.872 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.872 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "automatically balance PGs across cluster", 2023-10-18T14:14:08.872 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.873 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.873 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.873 INFO:teuthology.orchestra.run.smithi114.stdout: "begin_time": { 2023-10-18T14:14:08.873 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "begin_time", 2023-10-18T14:14:08.874 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.874 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.874 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.874 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0000", 2023-10-18T14:14:08.874 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.875 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.875 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.875 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "beginning time of day to automatically balance", 2023-10-18T14:14:08.875 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-18T14:14:08.875 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.876 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.876 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.876 INFO:teuthology.orchestra.run.smithi114.stdout: "begin_weekday": { 2023-10-18T14:14:08.876 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "begin_weekday", 2023-10-18T14:14:08.876 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:08.876 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.877 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.877 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:08.877 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0", 2023-10-18T14:14:08.877 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "6", 2023-10-18T14:14:08.877 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.878 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-18T14:14:08.878 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-18T14:14:08.878 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.878 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.878 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.879 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_max_iterations": { 2023-10-18T14:14:08.879 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_max_iterations", 2023-10-18T14:14:08.879 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:08.879 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.879 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.879 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "25", 2023-10-18T14:14:08.880 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2023-10-18T14:14:08.880 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "250", 2023-10-18T14:14:08.880 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.880 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-18T14:14:08.880 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.881 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.881 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.881 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.881 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_metrics": { 2023-10-18T14:14:08.881 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_metrics", 2023-10-18T14:14:08.881 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.882 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.882 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.882 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "pgs,objects,bytes", 2023-10-18T14:14:08.882 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.882 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.883 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.883 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-18T14:14:08.883 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-18T14:14:08.883 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.883 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.884 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.884 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_step": { 2023-10-18T14:14:08.884 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_step", 2023-10-18T14:14:08.884 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:08.884 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.885 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.885 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0.5", 2023-10-18T14:14:08.885 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0.001", 2023-10-18T14:14:08.885 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "0.999", 2023-10-18T14:14:08.885 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.886 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "aggressiveness of optimization", 2023-10-18T14:14:08.886 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-18T14:14:08.886 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.886 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.886 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.887 INFO:teuthology.orchestra.run.smithi114.stdout: "end_time": { 2023-10-18T14:14:08.887 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "end_time", 2023-10-18T14:14:08.887 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.887 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.887 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.888 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "2359", 2023-10-18T14:14:08.888 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.888 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.888 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.888 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "ending time of day to automatically balance", 2023-10-18T14:14:08.889 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-18T14:14:08.889 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.889 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.889 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.889 INFO:teuthology.orchestra.run.smithi114.stdout: "end_weekday": { 2023-10-18T14:14:08.889 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "end_weekday", 2023-10-18T14:14:08.890 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:08.890 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.890 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.890 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:08.890 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0", 2023-10-18T14:14:08.891 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "6", 2023-10-18T14:14:08.891 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.891 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-18T14:14:08.891 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-18T14:14:08.891 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.892 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.892 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.892 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:08.892 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:08.892 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.893 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.893 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.893 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.893 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.893 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.894 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.894 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.894 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.894 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.894 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.895 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.895 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.895 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.895 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.895 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.896 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.896 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.896 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.896 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:08.896 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:08.897 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.897 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.897 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.897 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.897 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.898 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.898 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.898 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.898 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.898 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.899 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.899 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.899 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:08.899 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:08.899 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.899 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.900 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.900 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:08.900 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.900 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.900 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.901 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:08.901 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:08.901 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:08.901 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:08.901 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:08.902 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:08.902 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.902 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.902 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.902 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.903 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.903 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.903 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:08.903 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:08.903 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.904 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.904 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.904 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.904 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.904 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.905 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.905 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:08.905 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.905 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.905 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.906 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.906 INFO:teuthology.orchestra.run.smithi114.stdout: "min_score": { 2023-10-18T14:14:08.906 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "min_score", 2023-10-18T14:14:08.906 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:08.906 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.906 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.907 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:08.907 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.907 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.907 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.907 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-18T14:14:08.908 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.908 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.908 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.908 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.908 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": { 2023-10-18T14:14:08.909 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mode", 2023-10-18T14:14:08.909 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.909 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.909 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.909 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "upmap", 2023-10-18T14:14:08.910 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.910 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.910 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.910 INFO:teuthology.orchestra.run.smithi114.stdout: "crush-compat", 2023-10-18T14:14:08.910 INFO:teuthology.orchestra.run.smithi114.stdout: "none", 2023-10-18T14:14:08.911 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap" 2023-10-18T14:14:08.911 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.911 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Balancer mode", 2023-10-18T14:14:08.911 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.911 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.911 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.912 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.912 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_ids": { 2023-10-18T14:14:08.912 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pool_ids", 2023-10-18T14:14:08.912 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.912 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.913 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.913 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.913 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.913 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.913 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.914 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-18T14:14:08.914 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.914 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.914 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.914 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.915 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:08.915 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:08.915 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.915 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.915 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.916 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:08.916 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.916 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.916 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.916 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-18T14:14:08.916 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.917 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.917 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.917 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.917 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap_max_deviation": { 2023-10-18T14:14:08.917 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "upmap_max_deviation", 2023-10-18T14:14:08.918 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.918 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.918 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.918 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2023-10-18T14:14:08.918 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2023-10-18T14:14:08.919 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.919 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.919 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-18T14:14:08.919 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-18T14:14:08.919 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.920 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.920 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.920 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap_max_optimizations": { 2023-10-18T14:14:08.920 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "upmap_max_optimizations", 2023-10-18T14:14:08.920 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:08.920 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.921 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.921 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:08.921 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.921 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.921 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.922 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-18T14:14:08.922 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.922 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.922 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.922 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.923 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:08.923 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.923 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:08.923 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephadm", 2023-10-18T14:14:08.923 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:08.923 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:08.924 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:08.924 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_down_multiplier": { 2023-10-18T14:14:08.924 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_down_multiplier", 2023-10-18T14:14:08.924 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:08.924 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.925 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.925 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3.0", 2023-10-18T14:14:08.925 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.925 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.925 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.926 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-18T14:14:08.926 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.926 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.926 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.926 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.927 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_refresh_rate": { 2023-10-18T14:14:08.927 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_refresh_rate", 2023-10-18T14:14:08.927 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.927 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.927 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.928 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "20", 2023-10-18T14:14:08.928 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.928 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.928 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.928 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-18T14:14:08.928 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.929 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.929 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.929 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.929 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_starting_port": { 2023-10-18T14:14:08.929 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_starting_port", 2023-10-18T14:14:08.930 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:08.930 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.930 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.930 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "4721", 2023-10-18T14:14:08.930 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.931 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.931 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.931 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-18T14:14:08.931 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.931 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.932 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.932 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.932 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_ptrace": { 2023-10-18T14:14:08.932 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_ptrace", 2023-10-18T14:14:08.932 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.933 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.933 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.933 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.933 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.933 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.934 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.934 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-18T14:14:08.934 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-18T14:14:08.934 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.934 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.935 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.935 INFO:teuthology.orchestra.run.smithi114.stdout: "autotune_interval": { 2023-10-18T14:14:08.935 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "autotune_interval", 2023-10-18T14:14:08.935 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.935 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.935 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.936 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:08.936 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.936 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.936 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.936 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-18T14:14:08.937 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.937 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.937 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.937 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.938 INFO:teuthology.orchestra.run.smithi114.stdout: "autotune_memory_target_ratio": { 2023-10-18T14:14:08.938 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "autotune_memory_target_ratio", 2023-10-18T14:14:08.938 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:08.938 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.938 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.939 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0.7", 2023-10-18T14:14:08.939 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.939 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.939 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.939 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-18T14:14:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm_log_destination": { 2023-10-18T14:14:08.940 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephadm_log_destination", 2023-10-18T14:14:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:08.941 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "file", 2023-10-18T14:14:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "file,syslog", 2023-10-18T14:14:08.942 INFO:teuthology.orchestra.run.smithi114.stdout: "syslog" 2023-10-18T14:14:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-18T14:14:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.943 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: "cgroups_split": { 2023-10-18T14:14:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cgroups_split", 2023-10-18T14:14:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.944 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.945 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-18T14:14:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: "config_checks_enabled": { 2023-10-18T14:14:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "config_checks_enabled", 2023-10-18T14:14:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.947 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-18T14:14:08.948 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.949 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.949 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.949 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.949 INFO:teuthology.orchestra.run.smithi114.stdout: "config_dashboard": { 2023-10-18T14:14:08.949 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "config_dashboard", 2023-10-18T14:14:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.950 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-18T14:14:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.951 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_alertmanager": { 2023-10-18T14:14:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_alertmanager", 2023-10-18T14:14:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.952 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-18T14:14:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.953 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2023-10-18T14:14:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.954 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_base": { 2023-10-18T14:14:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_base", 2023-10-18T14:14:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.955 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-18T14:14:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.956 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Container image name, without the tag", 2023-10-18T14:14:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_elasticsearch": { 2023-10-18T14:14:08.957 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_elasticsearch", 2023-10-18T14:14:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.958 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-18T14:14:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "elasticsearch container image", 2023-10-18T14:14:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.959 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_grafana": { 2023-10-18T14:14:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_grafana", 2023-10-18T14:14:08.960 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-18T14:14:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2023-10-18T14:14:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.962 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_haproxy": { 2023-10-18T14:14:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_haproxy", 2023-10-18T14:14:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.963 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-18T14:14:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.964 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "HAproxy container image", 2023-10-18T14:14:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.965 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_agent": { 2023-10-18T14:14:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_agent", 2023-10-18T14:14:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.967 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-18T14:14:08.967 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.969 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.969 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.969 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger agent container image", 2023-10-18T14:14:08.970 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.970 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.970 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.970 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.970 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_collector": { 2023-10-18T14:14:08.971 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_collector", 2023-10-18T14:14:08.971 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.971 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.971 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.971 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-18T14:14:08.972 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.972 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.972 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.972 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger collector container image", 2023-10-18T14:14:08.972 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.972 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.973 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.973 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.973 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_query": { 2023-10-18T14:14:08.973 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_query", 2023-10-18T14:14:08.974 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.974 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.974 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.974 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-18T14:14:08.974 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.975 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.975 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.975 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger query container image", 2023-10-18T14:14:08.975 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.975 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.976 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.976 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.976 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_keepalived": { 2023-10-18T14:14:08.976 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_keepalived", 2023-10-18T14:14:08.976 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.976 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.977 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.977 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-18T14:14:08.977 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.977 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.978 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.978 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Keepalived container image", 2023-10-18T14:14:08.978 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.978 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.978 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.979 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.979 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_loki": { 2023-10-18T14:14:08.979 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_loki", 2023-10-18T14:14:08.979 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.979 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.980 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.980 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-18T14:14:08.980 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.980 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.980 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.980 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Loki container image", 2023-10-18T14:14:08.981 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.981 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.981 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.981 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.981 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_node_exporter": { 2023-10-18T14:14:08.982 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_node_exporter", 2023-10-18T14:14:08.982 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.982 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.982 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.982 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-18T14:14:08.983 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.983 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.983 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.983 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2023-10-18T14:14:08.983 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.984 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.984 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.984 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.984 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_nvmeof": { 2023-10-18T14:14:08.984 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_nvmeof", 2023-10-18T14:14:08.985 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.985 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.985 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.985 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-18T14:14:08.985 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.985 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.986 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.986 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Nvme-of container image", 2023-10-18T14:14:08.986 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.986 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.986 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.987 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.987 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_prometheus": { 2023-10-18T14:14:08.987 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_prometheus", 2023-10-18T14:14:08.987 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.987 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.988 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.988 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-18T14:14:08.988 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.988 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.988 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.989 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2023-10-18T14:14:08.989 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.989 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.989 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.990 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_promtail": { 2023-10-18T14:14:08.990 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_promtail", 2023-10-18T14:14:08.990 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.990 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.990 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.991 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-18T14:14:08.991 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.991 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.991 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.991 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Promtail container image", 2023-10-18T14:14:08.992 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.992 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.992 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.992 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_snmp_gateway": { 2023-10-18T14:14:08.993 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_snmp_gateway", 2023-10-18T14:14:08.993 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:08.993 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.993 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.993 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-18T14:14:08.994 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.994 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.994 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.994 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SNMP Gateway container image", 2023-10-18T14:14:08.994 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.995 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.995 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.995 INFO:teuthology.orchestra.run.smithi114.stdout: "container_init": { 2023-10-18T14:14:08.995 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_init", 2023-10-18T14:14:08.996 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:08.996 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.996 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.996 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:08.996 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.997 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.997 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:08.997 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Run podman/docker with `--init`", 2023-10-18T14:14:08.997 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:08.997 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:08.997 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:08.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:08.998 INFO:teuthology.orchestra.run.smithi114.stdout: "daemon_cache_timeout": { 2023-10-18T14:14:08.998 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "daemon_cache_timeout", 2023-10-18T14:14:08.998 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:08.998 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:08.999 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:08.999 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:08.999 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:08.999 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:08.999 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.000 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-18T14:14:09.000 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.000 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.000 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.001 INFO:teuthology.orchestra.run.smithi114.stdout: "default_cephadm_command_timeout": { 2023-10-18T14:14:09.001 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "default_cephadm_command_timeout", 2023-10-18T14:14:09.001 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.001 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.001 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.001 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "900", 2023-10-18T14:14:09.002 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.002 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.002 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.002 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-18T14:14:09.003 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.003 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.003 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.003 INFO:teuthology.orchestra.run.smithi114.stdout: "default_registry": { 2023-10-18T14:14:09.004 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "default_registry", 2023-10-18T14:14:09.004 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.004 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.004 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.004 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io", 2023-10-18T14:14:09.005 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.005 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.005 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.005 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-18T14:14:09.005 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.005 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.006 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.006 INFO:teuthology.orchestra.run.smithi114.stdout: "device_cache_timeout": { 2023-10-18T14:14:09.006 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_cache_timeout", 2023-10-18T14:14:09.006 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.007 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.007 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.007 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1800", 2023-10-18T14:14:09.007 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.007 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.008 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.008 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache device inventory", 2023-10-18T14:14:09.008 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.008 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.008 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.009 INFO:teuthology.orchestra.run.smithi114.stdout: "device_enhanced_scan": { 2023-10-18T14:14:09.009 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_enhanced_scan", 2023-10-18T14:14:09.009 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.009 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.010 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.010 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.010 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.010 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.010 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.011 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-18T14:14:09.011 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.011 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.011 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.012 INFO:teuthology.orchestra.run.smithi114.stdout: "facts_cache_timeout": { 2023-10-18T14:14:09.012 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "facts_cache_timeout", 2023-10-18T14:14:09.012 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.012 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.012 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.013 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:09.013 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.013 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.013 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.013 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache host facts data", 2023-10-18T14:14:09.013 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.014 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.014 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.014 INFO:teuthology.orchestra.run.smithi114.stdout: "host_check_interval": { 2023-10-18T14:14:09.014 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "host_check_interval", 2023-10-18T14:14:09.015 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.015 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.015 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.015 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:09.015 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.016 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.016 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.016 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to perform a host check", 2023-10-18T14:14:09.016 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.016 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.017 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.017 INFO:teuthology.orchestra.run.smithi114.stdout: "inventory_list_all": { 2023-10-18T14:14:09.017 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "inventory_list_all", 2023-10-18T14:14:09.017 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.018 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.018 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.018 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.018 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.018 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.019 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.019 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-18T14:14:09.019 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.019 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.019 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.020 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.020 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.020 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.020 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.020 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.021 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.021 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.021 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.021 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.021 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.022 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.022 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.022 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.022 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.022 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.023 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.023 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.023 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.023 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.023 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.024 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.024 INFO:teuthology.orchestra.run.smithi114.stdout: "log_refresh_metadata": { 2023-10-18T14:14:09.024 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_refresh_metadata", 2023-10-18T14:14:09.024 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.024 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.024 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.025 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.025 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.025 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.025 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.025 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-18T14:14:09.026 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.026 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.026 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.026 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.027 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.027 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.027 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.027 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.027 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.028 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.028 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.028 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.028 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-18T14:14:09.028 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.029 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.029 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.029 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.029 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.030 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.030 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.030 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.030 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.030 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.031 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.031 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.031 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.031 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.031 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.032 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.032 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.032 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.032 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.032 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.033 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.033 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.033 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.033 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.034 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.034 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.034 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.034 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.034 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.035 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.035 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.035 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.035 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.035 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.036 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.036 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.036 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.036 INFO:teuthology.orchestra.run.smithi114.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-18T14:14:09.036 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-18T14:14:09.036 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.037 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.037 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.037 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.037 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.037 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.038 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.038 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-18T14:14:09.038 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.038 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.038 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.039 INFO:teuthology.orchestra.run.smithi114.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-18T14:14:09.039 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-18T14:14:09.039 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.039 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.040 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.040 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "*", 2023-10-18T14:14:09.040 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.040 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.040 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.040 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-18T14:14:09.041 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.041 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.041 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.041 INFO:teuthology.orchestra.run.smithi114.stdout: "max_count_per_host": { 2023-10-18T14:14:09.042 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_count_per_host", 2023-10-18T14:14:09.042 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.042 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.042 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.042 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:09.043 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.043 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.043 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.043 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "max number of daemons per service per host", 2023-10-18T14:14:09.043 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.044 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.044 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.044 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.044 INFO:teuthology.orchestra.run.smithi114.stdout: "max_osd_draining_count": { 2023-10-18T14:14:09.044 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_osd_draining_count", 2023-10-18T14:14:09.045 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.045 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.045 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.045 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:09.045 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.046 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.046 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.046 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-18T14:14:09.046 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.046 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.047 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.047 INFO:teuthology.orchestra.run.smithi114.stdout: "migration_current": { 2023-10-18T14:14:09.047 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "migration_current", 2023-10-18T14:14:09.047 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.048 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.048 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.048 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.048 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.048 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.049 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.049 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "internal - do not modify", 2023-10-18T14:14:09.049 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.049 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.049 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.050 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": { 2023-10-18T14:14:09.050 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mode", 2023-10-18T14:14:09.050 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.050 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.051 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.051 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "root", 2023-10-18T14:14:09.051 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.051 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.051 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.052 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm-package", 2023-10-18T14:14:09.052 INFO:teuthology.orchestra.run.smithi114.stdout: "root" 2023-10-18T14:14:09.052 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.052 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "mode for remote execution of cephadm", 2023-10-18T14:14:09.052 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.053 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.053 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.053 INFO:teuthology.orchestra.run.smithi114.stdout: "prometheus_alerts_path": { 2023-10-18T14:14:09.053 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prometheus_alerts_path", 2023-10-18T14:14:09.054 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.054 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.054 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.054 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-18T14:14:09.054 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.055 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.055 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.055 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-18T14:14:09.055 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.055 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.056 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.056 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_insecure": { 2023-10-18T14:14:09.056 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_insecure", 2023-10-18T14:14:09.056 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.056 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.057 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.057 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.057 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.057 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.057 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.058 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-18T14:14:09.058 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.058 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.058 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.059 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_password": { 2023-10-18T14:14:09.059 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_password", 2023-10-18T14:14:09.059 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.059 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.059 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.060 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.060 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.060 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.060 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.060 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-18T14:14:09.061 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.061 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.061 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.061 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_url": { 2023-10-18T14:14:09.062 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_url", 2023-10-18T14:14:09.062 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.062 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.062 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.062 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.063 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.063 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.063 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.063 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-18T14:14:09.063 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.064 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.064 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.064 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_username": { 2023-10-18T14:14:09.064 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_username", 2023-10-18T14:14:09.064 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.065 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.065 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.065 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.065 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.066 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.066 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.066 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-18T14:14:09.066 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.066 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.067 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.067 INFO:teuthology.orchestra.run.smithi114.stdout: "secure_monitoring_stack": { 2023-10-18T14:14:09.067 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "secure_monitoring_stack", 2023-10-18T14:14:09.067 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.068 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.068 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.068 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.068 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.068 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.068 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.069 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-18T14:14:09.069 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.069 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.069 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.070 INFO:teuthology.orchestra.run.smithi114.stdout: "service_discovery_port": { 2023-10-18T14:14:09.070 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "service_discovery_port", 2023-10-18T14:14:09.070 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.070 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.070 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.071 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8765", 2023-10-18T14:14:09.071 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.071 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.071 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.071 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "cephadm service discovery port", 2023-10-18T14:14:09.072 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.072 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.072 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.072 INFO:teuthology.orchestra.run.smithi114.stdout: "ssh_config_file": { 2023-10-18T14:14:09.073 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssh_config_file", 2023-10-18T14:14:09.073 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.073 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.073 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.073 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.073 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.074 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.074 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.074 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-18T14:14:09.074 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.075 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.075 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.075 INFO:teuthology.orchestra.run.smithi114.stdout: "use_agent": { 2023-10-18T14:14:09.075 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "use_agent", 2023-10-18T14:14:09.075 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.076 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.076 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.076 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.076 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.076 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.077 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.077 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-18T14:14:09.077 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.077 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.077 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.078 INFO:teuthology.orchestra.run.smithi114.stdout: "use_repo_digest": { 2023-10-18T14:14:09.078 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "use_repo_digest", 2023-10-18T14:14:09.078 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.078 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.079 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.079 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.079 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.079 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.079 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.080 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-18T14:14:09.080 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.080 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.080 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.081 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_failed_host_check": { 2023-10-18T14:14:09.081 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_failed_host_check", 2023-10-18T14:14:09.081 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.081 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.081 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.082 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.082 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.082 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.082 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.082 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if the host check fails", 2023-10-18T14:14:09.083 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.083 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.083 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.083 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_stray_daemons": { 2023-10-18T14:14:09.084 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_stray_daemons", 2023-10-18T14:14:09.084 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.084 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.084 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.084 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.085 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.085 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.085 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.085 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-18T14:14:09.085 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.085 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.086 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.086 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_stray_hosts": { 2023-10-18T14:14:09.086 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_stray_hosts", 2023-10-18T14:14:09.086 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.087 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.087 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.087 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.087 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.087 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.088 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.088 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-18T14:14:09.088 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.088 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.088 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.089 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.089 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.089 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.089 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crash", 2023-10-18T14:14:09.090 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.090 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.090 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.090 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.090 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.091 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.091 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.091 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.091 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.091 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.091 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.092 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.092 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.092 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.092 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.092 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.093 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.093 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.093 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.093 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.093 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.094 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.094 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.094 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.094 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.094 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.095 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.095 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.095 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.095 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.095 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.096 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.096 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.096 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.096 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.096 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.097 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.097 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.097 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.097 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.098 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.098 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.098 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.098 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.098 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.099 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.099 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.099 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.099 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.099 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.099 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.100 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.100 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.100 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.100 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.100 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.101 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.101 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.101 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.101 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.102 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.102 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.102 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.102 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.102 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.103 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.103 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.103 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.103 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.103 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.104 INFO:teuthology.orchestra.run.smithi114.stdout: "retain_interval": { 2023-10-18T14:14:09.104 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "retain_interval", 2023-10-18T14:14:09.104 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.104 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.105 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.105 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "31536000", 2023-10-18T14:14:09.105 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.105 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.105 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.106 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-18T14:14:09.106 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.106 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.106 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.107 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_recent_interval": { 2023-10-18T14:14:09.107 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_recent_interval", 2023-10-18T14:14:09.107 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.107 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.107 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.107 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1209600", 2023-10-18T14:14:09.108 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.108 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.108 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.108 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-18T14:14:09.108 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.109 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.109 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.109 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.109 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.110 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.110 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "dashboard", 2023-10-18T14:14:09.110 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.110 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.110 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.111 INFO:teuthology.orchestra.run.smithi114.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-18T14:14:09.111 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-18T14:14:09.111 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.111 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.111 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.111 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:09.112 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.112 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.112 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.112 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.112 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.113 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.113 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.113 INFO:teuthology.orchestra.run.smithi114.stdout: "ALERTMANAGER_API_HOST": { 2023-10-18T14:14:09.113 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-18T14:14:09.114 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.114 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.114 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.114 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.114 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.115 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.115 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.115 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.115 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.115 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.116 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.116 INFO:teuthology.orchestra.run.smithi114.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-18T14:14:09.116 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-18T14:14:09.116 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.117 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.117 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.117 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.117 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.117 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.118 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.118 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.118 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.118 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.118 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.119 INFO:teuthology.orchestra.run.smithi114.stdout: "AUDIT_API_ENABLED": { 2023-10-18T14:14:09.119 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "AUDIT_API_ENABLED", 2023-10-18T14:14:09.119 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.119 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.120 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.120 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.120 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.120 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.120 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.120 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.121 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.121 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.121 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.121 INFO:teuthology.orchestra.run.smithi114.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-18T14:14:09.122 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-18T14:14:09.122 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.122 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.122 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.122 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.123 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.123 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.123 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.123 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.123 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.124 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.124 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.124 INFO:teuthology.orchestra.run.smithi114.stdout: "ENABLE_BROWSABLE_API": { 2023-10-18T14:14:09.124 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-18T14:14:09.124 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.125 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.125 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.125 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.125 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.125 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.126 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.126 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.126 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.126 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.126 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.127 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-18T14:14:09.127 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-18T14:14:09.127 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.127 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.128 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.128 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.128 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.128 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.128 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.129 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.129 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.129 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.129 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.129 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-18T14:14:09.130 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-18T14:14:09.130 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.130 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.130 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.130 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.131 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.131 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.131 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.131 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.131 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.132 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.132 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.132 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-18T14:14:09.132 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-18T14:14:09.133 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.133 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.133 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.133 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.133 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.133 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.134 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.134 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.134 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.134 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.134 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.135 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-18T14:14:09.135 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-18T14:14:09.135 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.135 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.136 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.136 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.136 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.136 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.136 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.137 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.137 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.137 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.137 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.137 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-18T14:14:09.138 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-18T14:14:09.138 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.138 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.138 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.139 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.139 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.139 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.139 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.139 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.139 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.140 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.140 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.140 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-18T14:14:09.140 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-18T14:14:09.141 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.141 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.141 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.141 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.141 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.142 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.142 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.142 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.142 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.142 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.143 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.143 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-18T14:14:09.143 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-18T14:14:09.143 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.144 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.144 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.144 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.144 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.144 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.144 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.145 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.145 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.145 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.145 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.146 INFO:teuthology.orchestra.run.smithi114.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-18T14:14:09.146 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-18T14:14:09.146 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.146 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.146 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.147 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.147 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.147 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.147 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.147 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.148 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.148 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.148 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.148 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_PASSWORD": { 2023-10-18T14:14:09.149 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-18T14:14:09.149 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.149 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.149 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.149 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2023-10-18T14:14:09.149 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.150 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.150 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.150 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.150 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.151 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.151 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.151 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-18T14:14:09.151 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-18T14:14:09.151 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.152 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.152 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.152 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.152 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.152 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.153 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.153 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.153 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.153 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.153 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.154 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_URL": { 2023-10-18T14:14:09.154 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_URL", 2023-10-18T14:14:09.154 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.154 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.154 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.155 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.155 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.155 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.155 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.155 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.156 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.156 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.156 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.156 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_USERNAME": { 2023-10-18T14:14:09.157 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-18T14:14:09.157 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.157 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.157 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.157 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2023-10-18T14:14:09.158 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.158 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.158 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.158 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.158 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.159 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.159 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.159 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-18T14:14:09.159 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-18T14:14:09.160 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.160 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.160 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.160 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.160 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.160 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.161 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.161 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.161 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.161 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.161 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.162 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-18T14:14:09.162 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-18T14:14:09.162 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.162 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.163 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.163 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.163 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.163 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.163 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.164 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.164 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.164 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.164 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.165 INFO:teuthology.orchestra.run.smithi114.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-18T14:14:09.165 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-18T14:14:09.165 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.165 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.165 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.166 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.166 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.166 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.166 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.166 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.167 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.167 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.167 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.167 INFO:teuthology.orchestra.run.smithi114.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-18T14:14:09.168 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-18T14:14:09.168 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.168 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.168 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.168 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.168 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.169 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.169 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.169 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.169 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.169 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.170 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.170 INFO:teuthology.orchestra.run.smithi114.stdout: "PROMETHEUS_API_HOST": { 2023-10-18T14:14:09.170 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-18T14:14:09.170 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.171 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.171 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.171 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.171 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.171 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.172 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.173 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.173 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.173 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.174 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.174 INFO:teuthology.orchestra.run.smithi114.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-18T14:14:09.174 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-18T14:14:09.174 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.175 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.175 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.175 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.175 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.175 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.176 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.176 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.176 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.176 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.176 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.177 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-18T14:14:09.177 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-18T14:14:09.177 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.177 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.178 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.178 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.178 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.178 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.178 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.179 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.179 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.179 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.179 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.179 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-18T14:14:09.180 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-18T14:14:09.180 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.180 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.180 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.180 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.181 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.181 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.181 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.181 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.181 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.181 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.182 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.182 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-18T14:14:09.182 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-18T14:14:09.182 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.183 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.183 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.183 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.183 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.183 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.184 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.184 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.184 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.184 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.184 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.185 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-18T14:14:09.185 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-18T14:14:09.185 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.185 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.185 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.186 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.186 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.186 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.186 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.186 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.187 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.187 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.187 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.188 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-18T14:14:09.188 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-18T14:14:09.188 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.188 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.188 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.188 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.189 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.189 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.189 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.189 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.189 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.190 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.190 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.190 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-18T14:14:09.190 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-18T14:14:09.191 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.191 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.191 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.191 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.191 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.192 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.192 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.192 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.192 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.192 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.193 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.193 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-18T14:14:09.193 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-18T14:14:09.193 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.194 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.194 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.194 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.194 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.194 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.195 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.195 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.195 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.195 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.195 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.196 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.196 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_ENABLED": { 2023-10-18T14:14:09.196 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-18T14:14:09.196 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.196 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.197 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.197 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.197 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.197 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.197 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.197 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.198 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.198 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.198 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.198 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.198 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-18T14:14:09.199 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-18T14:14:09.199 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.199 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.199 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.199 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-18T14:14:09.200 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.200 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.200 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.200 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.200 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.201 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.201 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.201 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.201 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-18T14:14:09.201 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-18T14:14:09.201 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.202 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.202 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.202 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:09.202 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.202 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.203 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.203 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.203 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.203 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.203 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.204 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-18T14:14:09.204 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-18T14:14:09.204 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.204 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.205 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.205 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8", 2023-10-18T14:14:09.205 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.205 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.205 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.206 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.206 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.206 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.206 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.206 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.207 INFO:teuthology.orchestra.run.smithi114.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-18T14:14:09.207 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-18T14:14:09.207 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.207 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.207 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.208 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "45", 2023-10-18T14:14:09.208 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.208 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.208 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.208 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.209 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.209 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.209 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.209 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.209 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_ACCESS_KEY": { 2023-10-18T14:14:09.209 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-18T14:14:09.210 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.210 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.210 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.210 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.210 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.211 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.211 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.211 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.211 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.211 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.212 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.212 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-18T14:14:09.212 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-18T14:14:09.212 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.213 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.213 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.213 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2023-10-18T14:14:09.213 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.213 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.213 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.214 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.214 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.214 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.214 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.215 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_SECRET_KEY": { 2023-10-18T14:14:09.215 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-18T14:14:09.215 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.215 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.215 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.216 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.216 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.216 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.216 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.216 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.217 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.217 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.217 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.217 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_SSL_VERIFY": { 2023-10-18T14:14:09.218 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-18T14:14:09.218 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.218 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.218 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.218 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.218 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.219 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.219 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.219 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.219 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.219 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.220 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.220 INFO:teuthology.orchestra.run.smithi114.stdout: "UNSAFE_TLS_v1_2": { 2023-10-18T14:14:09.220 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-18T14:14:09.220 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.221 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.221 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.221 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.221 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.221 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.222 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.222 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.222 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.222 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.222 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.222 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.223 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-18T14:14:09.223 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-18T14:14:09.223 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.223 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.223 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.224 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:09.224 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.224 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.224 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.224 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.225 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.225 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.225 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.225 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-18T14:14:09.226 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-18T14:14:09.226 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.226 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.226 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.226 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:09.227 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.227 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.227 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.227 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.227 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.227 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.228 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.228 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-18T14:14:09.228 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-18T14:14:09.228 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.229 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.229 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.229 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2023-10-18T14:14:09.229 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.229 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.230 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.230 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.230 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.230 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.230 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.231 INFO:teuthology.orchestra.run.smithi114.stdout: "cross_origin_url": { 2023-10-18T14:14:09.231 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cross_origin_url", 2023-10-18T14:14:09.231 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.231 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.231 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.232 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.232 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.232 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.232 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.232 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.233 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.233 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.233 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.233 INFO:teuthology.orchestra.run.smithi114.stdout: "crt_file": { 2023-10-18T14:14:09.233 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crt_file", 2023-10-18T14:14:09.234 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.234 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.234 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.234 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.234 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.235 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.235 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.235 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.235 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.235 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.236 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.236 INFO:teuthology.orchestra.run.smithi114.stdout: "debug": { 2023-10-18T14:14:09.236 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "debug", 2023-10-18T14:14:09.236 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.237 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.237 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.237 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.237 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.237 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.237 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.238 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable/disable debug options", 2023-10-18T14:14:09.238 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.238 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.238 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.239 INFO:teuthology.orchestra.run.smithi114.stdout: "jwt_token_ttl": { 2023-10-18T14:14:09.239 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "jwt_token_ttl", 2023-10-18T14:14:09.239 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.239 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.239 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.240 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "28800", 2023-10-18T14:14:09.240 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.240 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.240 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.240 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.241 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.241 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.241 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.241 INFO:teuthology.orchestra.run.smithi114.stdout: "key_file": { 2023-10-18T14:14:09.242 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "key_file", 2023-10-18T14:14:09.242 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.242 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.242 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.242 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.243 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.243 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.243 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.243 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.243 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.244 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.244 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.244 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.244 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.245 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.245 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.245 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.245 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.245 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.245 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.246 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.246 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.246 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.246 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.246 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.247 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.247 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.247 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.247 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.247 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.248 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.248 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.248 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.248 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.248 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.249 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.249 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.249 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.249 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.249 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.250 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.250 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.250 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.250 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.250 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.251 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.251 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.251 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.251 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.251 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.252 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.252 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.252 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.252 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.252 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.253 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.253 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.253 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.253 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.253 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.254 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.254 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.254 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.254 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.254 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.255 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.255 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.255 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.255 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.255 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.256 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.256 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.256 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.256 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.256 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.257 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.257 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.257 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.257 INFO:teuthology.orchestra.run.smithi114.stdout: "motd": { 2023-10-18T14:14:09.258 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "motd", 2023-10-18T14:14:09.258 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.258 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.258 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.258 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.259 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.259 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.259 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.259 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "The message of the day", 2023-10-18T14:14:09.259 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.259 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.260 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.260 INFO:teuthology.orchestra.run.smithi114.stdout: "redirect_resolve_ip_addr": { 2023-10-18T14:14:09.260 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "redirect_resolve_ip_addr", 2023-10-18T14:14:09.260 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.261 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.261 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.261 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.261 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.261 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.262 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.262 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.262 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.262 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.262 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.263 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2023-10-18T14:14:09.263 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2023-10-18T14:14:09.263 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.263 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.263 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.264 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "::", 2023-10-18T14:14:09.264 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.264 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.264 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.264 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.265 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.265 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.265 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.265 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2023-10-18T14:14:09.266 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2023-10-18T14:14:09.266 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.266 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.266 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.266 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8080", 2023-10-18T14:14:09.267 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.267 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.267 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.267 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.267 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.268 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.268 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.268 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl": { 2023-10-18T14:14:09.268 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl", 2023-10-18T14:14:09.268 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.269 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.269 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.269 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.269 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.269 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.270 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.270 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.270 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.270 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.270 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.271 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl_server_port": { 2023-10-18T14:14:09.271 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl_server_port", 2023-10-18T14:14:09.271 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.271 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.271 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.272 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8443", 2023-10-18T14:14:09.272 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.272 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.272 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.272 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.273 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.273 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.273 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.273 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_behaviour": { 2023-10-18T14:14:09.274 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_behaviour", 2023-10-18T14:14:09.274 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.274 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.274 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.274 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "redirect", 2023-10-18T14:14:09.275 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.275 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.275 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.275 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.275 INFO:teuthology.orchestra.run.smithi114.stdout: "redirect" 2023-10-18T14:14:09.276 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.276 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.276 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.276 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.276 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.277 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_error_status_code": { 2023-10-18T14:14:09.277 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_error_status_code", 2023-10-18T14:14:09.277 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.277 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.277 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.278 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "500", 2023-10-18T14:14:09.278 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "400", 2023-10-18T14:14:09.278 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "599", 2023-10-18T14:14:09.278 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.278 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.279 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.279 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.279 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.279 INFO:teuthology.orchestra.run.smithi114.stdout: "url_prefix": { 2023-10-18T14:14:09.280 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "url_prefix", 2023-10-18T14:14:09.280 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.280 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.280 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.280 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.280 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.281 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.281 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.281 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.281 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.281 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.282 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.282 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.282 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.282 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.283 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "devicehealth", 2023-10-18T14:14:09.283 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.283 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.283 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.283 INFO:teuthology.orchestra.run.smithi114.stdout: "enable_monitoring": { 2023-10-18T14:14:09.283 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enable_monitoring", 2023-10-18T14:14:09.284 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.284 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.284 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.284 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.285 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.285 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.285 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.285 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "monitor device health metrics", 2023-10-18T14:14:09.285 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.286 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.286 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.286 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.286 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.287 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.287 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.287 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.287 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.287 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.288 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.288 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.288 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.288 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.288 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.289 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.289 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.289 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.289 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.289 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.289 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.290 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.290 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.290 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.291 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.291 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.291 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.291 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.291 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.292 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.292 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.292 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.292 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.292 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.293 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.293 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.293 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.293 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.294 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.294 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.294 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.294 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.294 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.295 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.295 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.295 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.295 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.295 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.295 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.296 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.296 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.296 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.296 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.296 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.297 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.297 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.297 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.297 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.298 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.298 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.298 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.298 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.298 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.299 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.299 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.299 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.299 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.299 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.300 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.300 INFO:teuthology.orchestra.run.smithi114.stdout: "mark_out_threshold": { 2023-10-18T14:14:09.300 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mark_out_threshold", 2023-10-18T14:14:09.300 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.300 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.301 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.301 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "2419200", 2023-10-18T14:14:09.301 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.301 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.301 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.302 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-18T14:14:09.302 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.302 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.302 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.303 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_name": { 2023-10-18T14:14:09.303 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pool_name", 2023-10-18T14:14:09.303 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.303 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.303 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.304 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "device_health_metrics", 2023-10-18T14:14:09.304 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.304 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.304 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.304 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-18T14:14:09.305 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.305 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.305 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.305 INFO:teuthology.orchestra.run.smithi114.stdout: "retention_period": { 2023-10-18T14:14:09.306 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "retention_period", 2023-10-18T14:14:09.306 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.306 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.306 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.306 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15552000", 2023-10-18T14:14:09.307 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.307 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.307 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.307 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long to retain device health metrics", 2023-10-18T14:14:09.307 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.307 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.308 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.308 INFO:teuthology.orchestra.run.smithi114.stdout: "scrape_frequency": { 2023-10-18T14:14:09.308 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "scrape_frequency", 2023-10-18T14:14:09.308 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.309 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.309 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.309 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "86400", 2023-10-18T14:14:09.309 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.309 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.310 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.310 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-18T14:14:09.310 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.310 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.310 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.311 INFO:teuthology.orchestra.run.smithi114.stdout: "self_heal": { 2023-10-18T14:14:09.311 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "self_heal", 2023-10-18T14:14:09.311 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.311 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.312 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.312 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.312 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.312 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.312 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.313 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-18T14:14:09.313 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.313 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.313 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.314 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:09.314 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:09.314 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.314 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.314 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.315 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:09.315 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.315 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.315 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.315 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to wake up and check device health", 2023-10-18T14:14:09.316 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.316 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.316 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.316 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_threshold": { 2023-10-18T14:14:09.316 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_threshold", 2023-10-18T14:14:09.317 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.317 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.317 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.317 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "7257600", 2023-10-18T14:14:09.317 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.318 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.318 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.318 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-18T14:14:09.318 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.318 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.319 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.319 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.319 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.319 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.320 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "diskprediction_local", 2023-10-18T14:14:09.320 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.320 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.320 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.320 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.321 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.321 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.321 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.321 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.321 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.321 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.322 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.322 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.322 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.322 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.322 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.323 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.323 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.323 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.323 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.323 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.324 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.324 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.324 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.324 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.325 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.325 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.325 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.325 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.325 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.326 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.326 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.326 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.326 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.326 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.327 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.327 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.327 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.327 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.327 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.328 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.328 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.328 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.328 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.328 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.329 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.329 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.329 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.329 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.329 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.329 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.330 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.330 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.330 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.330 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.330 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.331 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.331 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.331 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.331 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.331 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.332 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.332 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.332 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.332 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.332 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.332 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.333 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.333 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.333 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.333 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.334 INFO:teuthology.orchestra.run.smithi114.stdout: "predict_interval": { 2023-10-18T14:14:09.334 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "predict_interval", 2023-10-18T14:14:09.334 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.334 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.334 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "86400", 2023-10-18T14:14:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.336 INFO:teuthology.orchestra.run.smithi114.stdout: "predictor_model": { 2023-10-18T14:14:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "predictor_model", 2023-10-18T14:14:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "prophetstor", 2023-10-18T14:14:09.337 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.338 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:09.339 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.340 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.341 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "influx", 2023-10-18T14:14:09.342 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": false, 2023-10-18T14:14:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "influxdb python module not found", 2023-10-18T14:14:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "batch_size": { 2023-10-18T14:14:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "batch_size", 2023-10-18T14:14:09.343 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5000", 2023-10-18T14:14:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.344 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-18T14:14:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.345 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: "database": { 2023-10-18T14:14:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "database", 2023-10-18T14:14:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.346 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "ceph", 2023-10-18T14:14:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.347 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-18T14:14:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.348 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": { 2023-10-18T14:14:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "hostname", 2023-10-18T14:14:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.349 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB server hostname", 2023-10-18T14:14:09.350 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.351 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.351 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.351 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:09.351 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "30", 2023-10-18T14:14:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "5", 2023-10-18T14:14:09.352 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-18T14:14:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.353 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.355 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.355 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.355 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.355 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.355 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.356 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.357 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.358 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.359 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.360 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.360 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.360 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.360 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.360 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.361 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.361 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.361 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.361 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.361 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.361 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.362 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.363 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.364 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.365 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: "password": { 2023-10-18T14:14:09.367 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "password", 2023-10-18T14:14:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.368 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "password of InfluxDB server user", 2023-10-18T14:14:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.369 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: "port": { 2023-10-18T14:14:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "port", 2023-10-18T14:14:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.370 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8086", 2023-10-18T14:14:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.371 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB server port", 2023-10-18T14:14:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.372 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl": { 2023-10-18T14:14:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl", 2023-10-18T14:14:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.373 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "false", 2023-10-18T14:14:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.374 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-18T14:14:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.375 INFO:teuthology.orchestra.run.smithi114.stdout: "threads": { 2023-10-18T14:14:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "threads", 2023-10-18T14:14:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2023-10-18T14:14:09.376 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2023-10-18T14:14:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "32", 2023-10-18T14:14:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-18T14:14:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.377 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: "username": { 2023-10-18T14:14:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "username", 2023-10-18T14:14:09.378 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.379 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "username of InfluxDB server user", 2023-10-18T14:14:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.380 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: "verify_ssl": { 2023-10-18T14:14:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "verify_ssl", 2023-10-18T14:14:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.381 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "true", 2023-10-18T14:14:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.382 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-18T14:14:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.383 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "insights", 2023-10-18T14:14:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.385 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.386 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.387 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.388 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.389 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.390 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.391 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.392 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.393 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.394 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.395 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.396 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.397 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.398 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "iostat", 2023-10-18T14:14:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.399 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.400 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.401 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.402 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.404 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.405 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.406 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.407 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.408 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.409 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.410 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.411 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.412 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.413 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "k8sevents", 2023-10-18T14:14:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.414 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_event_retention_days": { 2023-10-18T14:14:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ceph_event_retention_days", 2023-10-18T14:14:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.415 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "7", 2023-10-18T14:14:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.416 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-18T14:14:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.417 INFO:teuthology.orchestra.run.smithi114.stdout: "config_check_secs": { 2023-10-18T14:14:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "config_check_secs", 2023-10-18T14:14:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.418 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "10", 2023-10-18T14:14:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-18T14:14:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.419 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.420 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.421 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.422 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.423 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.424 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.425 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.426 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.429 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.430 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.432 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.433 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "localpool", 2023-10-18T14:14:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.434 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: "failure_domain": { 2023-10-18T14:14:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "failure_domain", 2023-10-18T14:14:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.435 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "host", 2023-10-18T14:14:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.436 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "failure domain for any created local pool", 2023-10-18T14:14:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-18T14:14:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.437 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.438 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.440 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.441 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.442 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.443 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.444 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.444 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.444 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.444 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.444 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.445 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.447 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.448 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.449 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.450 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: "min_size": { 2023-10-18T14:14:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "min_size", 2023-10-18T14:14:09.451 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.452 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.452 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.452 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.452 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.452 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default min_size for any created local pool", 2023-10-18T14:14:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-18T14:14:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.453 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "num_rep": { 2023-10-18T14:14:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "num_rep", 2023-10-18T14:14:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.454 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3", 2023-10-18T14:14:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.455 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default replica count for any created local pool", 2023-10-18T14:14:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.456 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_num": { 2023-10-18T14:14:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pg_num", 2023-10-18T14:14:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.457 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "128", 2023-10-18T14:14:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default pg_num for any created local pool", 2023-10-18T14:14:09.458 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: "prefix": { 2023-10-18T14:14:09.459 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prefix", 2023-10-18T14:14:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.460 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "name prefix for any created local pool", 2023-10-18T14:14:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.461 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: "subtree": { 2023-10-18T14:14:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "subtree", 2023-10-18T14:14:09.462 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "rack", 2023-10-18T14:14:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.463 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-18T14:14:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-18T14:14:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.464 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mds_autoscaler", 2023-10-18T14:14:09.465 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.466 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.467 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.468 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.469 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.470 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.471 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.472 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.473 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.473 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.473 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.473 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.473 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.474 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.474 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.474 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.474 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.474 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.475 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.475 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.475 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.475 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.475 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.476 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.476 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.476 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.476 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.476 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.477 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.477 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.477 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.477 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.478 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.478 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.478 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.478 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.478 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.479 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.479 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.479 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.479 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.479 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.480 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.480 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.480 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.480 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.480 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mirroring", 2023-10-18T14:14:09.481 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.481 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.481 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.481 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.481 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.482 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.482 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.482 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.482 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.482 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.483 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.483 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.483 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.483 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.483 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.484 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.484 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.484 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.484 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.484 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.485 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.485 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.485 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.485 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.485 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.486 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.486 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.486 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.486 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.486 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.487 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.487 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.487 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.487 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.487 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.488 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.488 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.488 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.488 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.488 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.488 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.489 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.489 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.489 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.489 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.489 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.490 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.490 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.490 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.490 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.490 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.491 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.491 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.491 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.491 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.491 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.492 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.492 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.492 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.492 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.492 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.493 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.493 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.493 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.493 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.493 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.494 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.494 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.494 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.494 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.494 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.495 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.495 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.495 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.495 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.495 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.496 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "nfs", 2023-10-18T14:14:09.496 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.496 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.496 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.496 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.496 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.497 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.497 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.497 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.497 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.497 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.498 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.498 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.498 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.498 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.498 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.499 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.499 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.499 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.499 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.499 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.500 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.500 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.500 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.500 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.501 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.501 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.501 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.501 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.501 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.502 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.502 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.502 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.502 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.502 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.503 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.503 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.503 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.503 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.504 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.504 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.504 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.504 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.504 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.505 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.505 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.505 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.505 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.505 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.505 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.506 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.506 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.506 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.506 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.506 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.507 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.507 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.507 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.507 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.508 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.508 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.508 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.508 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.508 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.509 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.509 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.509 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.509 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.509 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.510 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.510 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.510 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.510 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.510 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.511 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "orchestrator", 2023-10-18T14:14:09.511 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.511 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.511 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.511 INFO:teuthology.orchestra.run.smithi114.stdout: "fail_fs": { 2023-10-18T14:14:09.512 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "fail_fs", 2023-10-18T14:14:09.512 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.512 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.512 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.512 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.513 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.513 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.513 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.513 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-18T14:14:09.513 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.513 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.514 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.514 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.514 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.514 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.515 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.515 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.515 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.515 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.515 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.515 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.516 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.516 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.516 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.516 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.516 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.517 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.517 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.517 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.517 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.517 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.518 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.518 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.518 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.518 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.519 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.519 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.519 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.519 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.520 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.520 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.520 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.520 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.520 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.521 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.521 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.521 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.521 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.522 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.522 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.522 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.523 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.523 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.523 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.523 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.523 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.524 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.524 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.524 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.524 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.525 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.525 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.525 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.525 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.526 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.526 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.526 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.526 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.527 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.527 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.527 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.527 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.528 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.528 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.528 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.528 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.529 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.529 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.529 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.529 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.530 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.530 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.530 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator": { 2023-10-18T14:14:09.531 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "orchestrator", 2023-10-18T14:14:09.531 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.531 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.531 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.532 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.532 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.532 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.532 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.533 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm", 2023-10-18T14:14:09.533 INFO:teuthology.orchestra.run.smithi114.stdout: "rook", 2023-10-18T14:14:09.533 INFO:teuthology.orchestra.run.smithi114.stdout: "test_orchestrator" 2023-10-18T14:14:09.533 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.533 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Orchestrator backend", 2023-10-18T14:14:09.534 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.534 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.534 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.534 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.534 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.535 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.535 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "osd_perf_query", 2023-10-18T14:14:09.535 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.535 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.536 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.536 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.536 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.536 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.536 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.537 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.537 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.537 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.537 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.537 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.537 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.538 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.538 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.538 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.538 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.538 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.539 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.539 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.539 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.539 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.539 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.540 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.540 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.540 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.540 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.541 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.541 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.541 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.541 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.541 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.541 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.542 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.542 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.542 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.542 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.543 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.543 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.543 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.543 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.543 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.544 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.544 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.544 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.544 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.544 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.545 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.545 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.545 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.545 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.545 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.546 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.546 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.546 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.546 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.547 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.547 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.547 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.547 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.547 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.548 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.548 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.548 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.548 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.548 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.548 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.549 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.549 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.549 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.549 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.550 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.550 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "osd_support", 2023-10-18T14:14:09.550 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.550 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.550 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.550 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.551 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.551 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.551 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.551 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.551 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.552 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.552 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.552 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.552 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.552 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.552 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.553 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.553 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.553 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.553 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.554 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.554 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.554 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.554 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.555 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.555 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.555 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.555 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.555 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.555 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.556 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.556 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.556 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.556 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.556 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.557 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.557 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.557 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.557 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.558 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.558 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.558 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.558 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.558 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.559 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.559 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.559 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.559 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.559 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.560 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.560 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.560 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.560 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.560 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.560 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.561 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.561 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.561 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.561 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.561 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.562 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.562 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.562 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.562 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.562 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.563 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.563 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.563 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.563 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.563 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.564 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.564 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.564 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.564 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pg_autoscaler", 2023-10-18T14:14:09.565 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.565 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.565 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.565 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.565 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.566 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.566 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.566 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.566 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.566 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.567 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.567 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.567 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.567 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.567 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.568 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.568 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.568 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.568 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.568 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.569 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.569 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.569 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.569 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.569 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.570 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.570 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.570 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.570 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.570 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.571 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.571 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.571 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.571 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.571 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.572 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.572 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.572 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.572 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.572 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.573 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.573 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.573 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.573 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.573 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.574 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.574 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.574 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.574 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.574 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.575 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.575 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.575 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.575 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.575 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.576 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.576 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.576 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.576 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.577 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.577 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.577 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.577 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.577 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.578 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.578 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.578 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.578 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.578 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.579 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:09.579 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:09.579 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.579 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.579 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.580 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:09.580 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.580 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.580 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.580 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.581 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.581 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.581 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.581 INFO:teuthology.orchestra.run.smithi114.stdout: "threshold": { 2023-10-18T14:14:09.581 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "threshold", 2023-10-18T14:14:09.582 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:09.582 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.582 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.582 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3.0", 2023-10-18T14:14:09.582 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1.0", 2023-10-18T14:14:09.583 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.583 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.585 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "scaling threshold", 2023-10-18T14:14:09.585 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-18T14:14:09.585 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.586 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.586 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.586 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.586 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.587 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "progress", 2023-10-18T14:14:09.587 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.587 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.587 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.587 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_pg_recovery_event": { 2023-10-18T14:14:09.588 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_pg_recovery_event", 2023-10-18T14:14:09.588 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.588 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.588 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.588 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.589 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.589 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.589 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.589 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-18T14:14:09.589 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.589 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.590 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.590 INFO:teuthology.orchestra.run.smithi114.stdout: "enabled": { 2023-10-18T14:14:09.590 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enabled", 2023-10-18T14:14:09.591 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.591 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.591 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.591 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.591 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.591 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.592 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.592 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.592 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.592 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.592 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.593 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.593 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.593 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.593 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.593 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.594 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.594 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.594 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.594 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.594 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.595 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.595 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.595 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.595 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.595 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.596 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.596 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.596 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.596 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.596 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.597 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.597 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.597 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.597 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.597 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.598 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.598 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.598 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.598 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.598 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.599 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.599 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.599 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.599 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.600 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.600 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.600 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.600 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.600 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.600 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.601 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.601 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.601 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.601 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.601 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.602 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.602 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.602 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.602 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.602 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.602 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.603 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.603 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.603 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.603 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.604 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.604 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.604 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.604 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.604 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.604 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.605 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.605 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.605 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.605 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.605 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.606 INFO:teuthology.orchestra.run.smithi114.stdout: "max_completed_events": { 2023-10-18T14:14:09.606 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_completed_events", 2023-10-18T14:14:09.606 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.606 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.607 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.607 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "50", 2023-10-18T14:14:09.607 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.607 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.607 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.607 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "number of past completed events to remember", 2023-10-18T14:14:09.608 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.608 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.608 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.608 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:09.609 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:09.609 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.609 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.609 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.609 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2023-10-18T14:14:09.610 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.610 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.610 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.610 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long the module is going to sleep", 2023-10-18T14:14:09.610 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.611 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.611 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.611 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.611 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.611 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.612 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prometheus", 2023-10-18T14:14:09.612 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.612 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.612 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.612 INFO:teuthology.orchestra.run.smithi114.stdout: "cache": { 2023-10-18T14:14:09.612 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cache", 2023-10-18T14:14:09.613 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.613 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.613 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.613 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.613 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.614 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.614 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.614 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.614 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.614 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.615 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.615 INFO:teuthology.orchestra.run.smithi114.stdout: "exclude_perf_counters": { 2023-10-18T14:14:09.615 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "exclude_perf_counters", 2023-10-18T14:14:09.615 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.616 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.616 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.616 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.616 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.616 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.617 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.617 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-18T14:14:09.617 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-18T14:14:09.617 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.617 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.618 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.618 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.618 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.618 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.618 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.619 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.619 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.619 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.619 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.619 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.620 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.620 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.620 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.620 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.620 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.620 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.621 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.621 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.621 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.621 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.621 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.622 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.622 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.622 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.622 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.622 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.623 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.623 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.623 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.623 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.623 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.624 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.624 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.624 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.624 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.624 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.625 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.625 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.625 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.625 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.625 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.626 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.626 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.626 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.626 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.626 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.627 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.627 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.627 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.627 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.627 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.627 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.628 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.628 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.628 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.628 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.628 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.628 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.629 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.629 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.629 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.629 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.629 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.630 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.630 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.630 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.630 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.630 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.631 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.631 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.631 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.631 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_stats_pools": { 2023-10-18T14:14:09.631 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_stats_pools", 2023-10-18T14:14:09.631 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.632 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.632 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.632 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.632 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.632 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.633 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.633 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.633 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.633 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.633 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.634 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-18T14:14:09.634 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-18T14:14:09.634 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.634 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.634 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.635 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "300", 2023-10-18T14:14:09.635 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.635 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.635 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.635 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.636 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.636 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.636 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.636 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.636 INFO:teuthology.orchestra.run.smithi114.stdout: "scrape_interval": { 2023-10-18T14:14:09.636 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "scrape_interval", 2023-10-18T14:14:09.637 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:09.637 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.637 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.637 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15.0", 2023-10-18T14:14:09.637 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.637 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.638 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.638 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.638 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.638 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.638 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.639 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.639 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2023-10-18T14:14:09.639 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2023-10-18T14:14:09.639 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.639 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.640 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.640 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "::", 2023-10-18T14:14:09.640 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.640 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.640 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.640 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-18T14:14:09.641 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.641 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.641 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.641 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2023-10-18T14:14:09.642 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2023-10-18T14:14:09.642 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.642 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.642 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.642 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "9283", 2023-10-18T14:14:09.642 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.643 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.643 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.643 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-18T14:14:09.643 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.643 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.644 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.644 INFO:teuthology.orchestra.run.smithi114.stdout: "stale_cache_strategy": { 2023-10-18T14:14:09.644 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "stale_cache_strategy", 2023-10-18T14:14:09.644 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.644 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.645 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.645 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "log", 2023-10-18T14:14:09.645 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.645 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.645 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.646 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.646 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.646 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.646 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.647 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_behaviour": { 2023-10-18T14:14:09.647 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_behaviour", 2023-10-18T14:14:09.647 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.647 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.647 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.647 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "default", 2023-10-18T14:14:09.648 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.648 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.648 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.648 INFO:teuthology.orchestra.run.smithi114.stdout: "default", 2023-10-18T14:14:09.648 INFO:teuthology.orchestra.run.smithi114.stdout: "error" 2023-10-18T14:14:09.648 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.649 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.649 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.649 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.649 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.649 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_error_status_code": { 2023-10-18T14:14:09.650 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_error_status_code", 2023-10-18T14:14:09.650 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.650 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.650 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.651 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "500", 2023-10-18T14:14:09.651 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "400", 2023-10-18T14:14:09.651 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "599", 2023-10-18T14:14:09.651 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.651 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.651 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.652 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.652 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.652 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.652 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.652 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.653 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_support", 2023-10-18T14:14:09.653 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.653 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.653 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.653 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.653 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.654 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.654 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.654 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.654 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.654 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.655 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.655 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.655 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.655 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.655 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.656 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.656 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.656 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.656 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.656 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.656 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.657 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.657 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.657 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.657 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.657 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.658 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.658 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.658 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.658 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.658 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.659 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.659 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.659 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.659 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.659 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.660 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.660 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.660 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.660 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.660 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.661 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.661 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.661 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.661 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.661 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.662 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.662 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.662 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.662 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.662 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.663 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.663 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.663 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.663 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.663 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.664 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.664 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.664 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.664 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.665 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.665 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.665 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.665 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.665 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.665 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.666 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.666 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.666 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.666 INFO:teuthology.orchestra.run.smithi114.stdout: "max_concurrent_snap_create": { 2023-10-18T14:14:09.667 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_concurrent_snap_create", 2023-10-18T14:14:09.667 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.667 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.667 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.667 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:09.668 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.668 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.668 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.668 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.668 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.668 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.669 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.669 INFO:teuthology.orchestra.run.smithi114.stdout: "mirror_snapshot_schedule": { 2023-10-18T14:14:09.669 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mirror_snapshot_schedule", 2023-10-18T14:14:09.669 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.669 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.670 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.670 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.670 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.670 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.670 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.671 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.671 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.671 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.671 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.671 INFO:teuthology.orchestra.run.smithi114.stdout: "trash_purge_schedule": { 2023-10-18T14:14:09.672 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "trash_purge_schedule", 2023-10-18T14:14:09.672 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.672 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.672 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.672 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.673 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.673 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.673 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.673 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.673 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.673 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.674 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.674 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.674 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.675 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "restful", 2023-10-18T14:14:09.675 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.675 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.675 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.675 INFO:teuthology.orchestra.run.smithi114.stdout: "enable_auth": { 2023-10-18T14:14:09.675 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enable_auth", 2023-10-18T14:14:09.676 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.676 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.676 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.676 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.676 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.677 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.677 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.677 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.677 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.677 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.677 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.678 INFO:teuthology.orchestra.run.smithi114.stdout: "key_file": { 2023-10-18T14:14:09.678 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "key_file", 2023-10-18T14:14:09.678 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.678 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.679 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.679 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.679 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.679 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.679 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.679 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.680 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.680 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.680 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.680 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.681 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.681 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.681 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.681 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.681 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.682 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.682 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.682 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.682 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.682 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.683 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.683 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.683 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.683 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.683 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.683 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.684 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.684 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.684 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.684 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.685 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.685 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.685 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.685 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.685 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.685 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.686 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.686 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.686 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.686 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.686 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.687 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.687 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.687 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.687 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.687 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.688 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.688 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.688 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.688 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.688 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.688 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.689 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.689 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.689 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.689 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.689 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.690 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.690 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.690 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.690 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.690 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.691 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.691 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.691 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.691 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.692 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.692 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.692 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.692 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.692 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.693 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.693 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.693 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.693 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.693 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.694 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.694 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.694 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2023-10-18T14:14:09.694 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2023-10-18T14:14:09.694 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.695 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.695 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.695 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.695 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.695 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.696 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.696 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.696 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.696 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.696 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.697 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2023-10-18T14:14:09.697 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2023-10-18T14:14:09.697 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.697 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.697 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.697 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.698 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.698 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.698 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.698 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.698 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.699 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.699 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.699 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.699 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.699 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.700 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rgw", 2023-10-18T14:14:09.700 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.700 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.700 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.700 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.701 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.701 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.701 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.701 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.701 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.701 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.702 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.702 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.702 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.702 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.702 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.703 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.703 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.703 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.703 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.703 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.704 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.704 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.704 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.704 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.704 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.705 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.705 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.705 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.705 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.705 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.706 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.706 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.706 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.706 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.706 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.706 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.707 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.707 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.707 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.707 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.708 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.708 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.708 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.708 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.708 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.708 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.709 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.709 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.709 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.709 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.709 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.710 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.710 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.710 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.710 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.710 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.711 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.711 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.711 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.711 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.712 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.712 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.712 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.712 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.712 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.713 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.713 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.713 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.713 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.713 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.714 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.714 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.714 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rook", 2023-10-18T14:14:09.714 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.715 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.715 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.715 INFO:teuthology.orchestra.run.smithi114.stdout: "drive_group_interval": { 2023-10-18T14:14:09.715 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "drive_group_interval", 2023-10-18T14:14:09.715 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:09.715 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.716 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.716 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "300.0", 2023-10-18T14:14:09.716 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.716 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.716 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.717 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-18T14:14:09.717 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.717 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.717 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.717 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.718 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.718 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.718 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.718 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.718 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.719 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.719 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.719 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.719 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.719 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.719 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.720 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.720 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.720 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.720 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.720 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.721 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.721 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.721 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.721 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.721 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.721 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.722 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.722 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.722 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.722 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.723 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.723 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.723 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.723 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.723 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.723 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.724 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.724 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.724 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.724 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.724 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.725 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.725 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.725 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.725 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.725 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.726 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.726 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.726 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.726 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.726 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.727 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.727 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.727 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.727 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.727 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.728 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.728 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.728 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.728 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.729 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.729 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.729 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.729 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.729 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.729 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.730 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.730 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.730 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.730 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.730 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.731 INFO:teuthology.orchestra.run.smithi114.stdout: "storage_class": { 2023-10-18T14:14:09.731 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "storage_class", 2023-10-18T14:14:09.731 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.731 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.732 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.732 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "local", 2023-10-18T14:14:09.732 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.732 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.732 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.732 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-18T14:14:09.733 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.733 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.733 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.733 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.733 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.734 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.734 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "selftest", 2023-10-18T14:14:09.734 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.734 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.734 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.735 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.735 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.735 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.735 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.735 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.736 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.736 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.736 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.736 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.736 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.736 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.737 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.737 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.737 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.737 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.737 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.737 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.738 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.738 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.738 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.738 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.739 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.739 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.739 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.739 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.739 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.739 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.740 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.740 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.740 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.740 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.740 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.741 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.741 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.741 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.741 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.741 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.742 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.742 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.742 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.742 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.742 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.743 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.743 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.743 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.743 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.743 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.744 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.744 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.744 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.744 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.744 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.745 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.745 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.745 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.745 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.746 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.746 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.746 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.746 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.746 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.747 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.747 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.747 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.747 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.747 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.748 INFO:teuthology.orchestra.run.smithi114.stdout: "roption1": { 2023-10-18T14:14:09.748 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "roption1", 2023-10-18T14:14:09.748 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.748 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.748 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.749 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.749 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.749 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.749 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.749 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.750 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.750 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.750 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.750 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.750 INFO:teuthology.orchestra.run.smithi114.stdout: "roption2": { 2023-10-18T14:14:09.751 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "roption2", 2023-10-18T14:14:09.751 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.751 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.751 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.751 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "xyz", 2023-10-18T14:14:09.752 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.752 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.752 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.752 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.752 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.753 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.753 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.753 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption1": { 2023-10-18T14:14:09.753 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption1", 2023-10-18T14:14:09.754 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.754 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.754 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.754 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.754 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.755 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.755 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.755 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.755 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.755 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.756 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.756 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption2": { 2023-10-18T14:14:09.756 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption2", 2023-10-18T14:14:09.756 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.757 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.757 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.757 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.757 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.757 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.757 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.758 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.758 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.758 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.758 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.758 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.759 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption3": { 2023-10-18T14:14:09.759 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption3", 2023-10-18T14:14:09.759 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:09.759 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.759 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.760 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.760 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.760 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.760 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.760 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.761 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.761 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.761 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.761 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption4": { 2023-10-18T14:14:09.762 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption4", 2023-10-18T14:14:09.762 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.762 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.762 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.762 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.763 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.763 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.763 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.763 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.763 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.764 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.764 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.764 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption5": { 2023-10-18T14:14:09.764 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption5", 2023-10-18T14:14:09.765 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.765 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.765 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.765 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.765 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.766 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.766 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.766 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.766 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.766 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.767 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.767 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption6": { 2023-10-18T14:14:09.767 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption6", 2023-10-18T14:14:09.767 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.767 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.768 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.768 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.768 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.768 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.768 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.769 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.769 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.769 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.769 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.769 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption7": { 2023-10-18T14:14:09.770 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption7", 2023-10-18T14:14:09.770 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.770 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.770 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.770 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.771 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2023-10-18T14:14:09.771 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "42", 2023-10-18T14:14:09.771 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.771 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.771 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.772 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.772 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.772 INFO:teuthology.orchestra.run.smithi114.stdout: "testkey": { 2023-10-18T14:14:09.772 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testkey", 2023-10-18T14:14:09.772 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.773 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.773 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.773 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.773 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.773 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.773 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.774 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.774 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.774 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.774 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.775 INFO:teuthology.orchestra.run.smithi114.stdout: "testlkey": { 2023-10-18T14:14:09.775 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testlkey", 2023-10-18T14:14:09.775 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.775 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.775 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.776 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.776 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.776 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.776 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.776 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.777 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.777 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.777 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.777 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.777 INFO:teuthology.orchestra.run.smithi114.stdout: "testnewline": { 2023-10-18T14:14:09.778 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testnewline", 2023-10-18T14:14:09.778 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.778 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.778 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.778 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.779 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.779 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.779 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.779 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.779 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.779 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.780 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.780 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.780 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.780 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.781 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snap_schedule", 2023-10-18T14:14:09.781 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.781 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.781 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.781 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_m_granularity": { 2023-10-18T14:14:09.782 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_m_granularity", 2023-10-18T14:14:09.782 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.782 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.782 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.782 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.783 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.783 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.783 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.783 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow minute scheduled snapshots", 2023-10-18T14:14:09.783 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.784 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.784 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.784 INFO:teuthology.orchestra.run.smithi114.stdout: "dump_on_update": { 2023-10-18T14:14:09.784 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "dump_on_update", 2023-10-18T14:14:09.785 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.785 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.785 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.785 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.785 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.786 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.786 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.786 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "dump database to debug log on update", 2023-10-18T14:14:09.786 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.786 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.787 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.787 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.787 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.787 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.788 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.788 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.788 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.788 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.788 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.788 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.789 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.789 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.789 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.789 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.790 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.790 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.790 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.790 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.790 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.791 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.791 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.791 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.791 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.791 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.792 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.792 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.792 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.792 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.792 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.793 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.793 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.793 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.793 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.793 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.794 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.794 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.794 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.794 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.795 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.795 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.795 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.795 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.795 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.796 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.796 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.796 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.796 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.796 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.797 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.797 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.797 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.797 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.797 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.798 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.798 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.798 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.798 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.799 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.799 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.799 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.799 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.799 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.799 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.800 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.800 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.800 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.800 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.800 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.801 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.801 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "stats", 2023-10-18T14:14:09.801 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.801 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.802 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.802 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.802 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.802 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.802 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.803 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.803 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.803 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.803 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.803 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.803 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.804 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.804 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.804 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.804 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.805 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.805 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.805 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.805 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.805 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.805 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.806 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.806 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.806 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.806 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.807 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.807 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.807 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.807 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.807 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.808 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.808 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.808 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.808 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.809 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.809 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.809 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.809 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.809 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.809 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.810 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.810 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.810 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.810 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.810 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.811 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.811 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.811 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.811 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.811 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.812 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.812 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.812 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.812 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.813 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.813 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.813 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.813 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.813 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.813 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.814 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.814 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.814 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.814 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.815 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.815 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.815 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.815 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.815 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.816 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.816 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "status", 2023-10-18T14:14:09.816 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.816 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.816 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.817 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.817 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.817 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.817 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.817 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.818 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.818 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.818 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.818 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.818 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.819 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.819 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.819 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.819 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.819 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.819 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.820 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.820 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.820 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.820 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.821 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.821 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.821 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.821 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.821 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.821 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.822 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.822 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.822 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.822 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.822 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.823 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.823 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.823 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.823 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.824 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.824 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.824 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.824 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.824 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.825 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.825 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.825 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.825 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.825 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.826 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.826 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.826 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.826 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.826 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.827 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.827 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.827 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.827 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.828 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.828 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.828 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.828 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.828 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.828 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.829 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.829 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.829 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.829 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.829 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.830 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.830 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.830 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.831 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "telegraf", 2023-10-18T14:14:09.831 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.831 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.831 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.831 INFO:teuthology.orchestra.run.smithi114.stdout: "address": { 2023-10-18T14:14:09.832 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "address", 2023-10-18T14:14:09.832 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.832 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.832 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.832 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-18T14:14:09.833 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.833 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.833 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.833 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.833 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.834 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.834 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.834 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.834 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:09.834 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:09.835 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.835 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.835 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.835 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15", 2023-10-18T14:14:09.835 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.835 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.836 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.836 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.836 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.836 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.836 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.837 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.837 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.837 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.837 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.837 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.837 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.838 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.838 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.838 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.838 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.838 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.839 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.839 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.839 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.839 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.839 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.839 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.840 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.840 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.840 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.840 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.840 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.841 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.841 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.841 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.841 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.841 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.841 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.842 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.842 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.842 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.842 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.842 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.843 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.843 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.843 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.843 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.844 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.844 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.844 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.844 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.844 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.845 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.845 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.845 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.845 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.845 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.846 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.846 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.846 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.846 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.846 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.847 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.847 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.847 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.847 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.847 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.848 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.848 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.848 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.848 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.848 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.848 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.849 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.849 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.849 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.849 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.849 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.849 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.850 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "telemetry", 2023-10-18T14:14:09.850 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.850 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.851 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.851 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_basic": { 2023-10-18T14:14:09.851 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_basic", 2023-10-18T14:14:09.851 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.851 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.852 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.852 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.852 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.852 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.852 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.852 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-18T14:14:09.853 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.853 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.853 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.853 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_crash": { 2023-10-18T14:14:09.854 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_crash", 2023-10-18T14:14:09.854 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.854 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.854 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.854 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.855 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.855 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.855 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.855 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-18T14:14:09.855 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.856 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.856 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.856 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_device": { 2023-10-18T14:14:09.856 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_device", 2023-10-18T14:14:09.857 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.857 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.857 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.857 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:09.857 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.858 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.858 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.858 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-18T14:14:09.858 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.858 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.859 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.859 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_ident": { 2023-10-18T14:14:09.859 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_ident", 2023-10-18T14:14:09.859 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.860 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.860 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.860 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.860 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.860 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.860 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.861 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-18T14:14:09.861 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.861 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.861 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.862 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_perf": { 2023-10-18T14:14:09.862 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_perf", 2023-10-18T14:14:09.862 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.862 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.862 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.863 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.863 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.863 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.863 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.863 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-18T14:14:09.864 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.864 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.864 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.864 INFO:teuthology.orchestra.run.smithi114.stdout: "contact": { 2023-10-18T14:14:09.865 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "contact", 2023-10-18T14:14:09.865 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.865 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.865 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.865 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.866 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.866 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.866 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.866 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.866 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.867 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.867 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.867 INFO:teuthology.orchestra.run.smithi114.stdout: "description": { 2023-10-18T14:14:09.867 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "description", 2023-10-18T14:14:09.868 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.868 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.868 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.868 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.868 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.868 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.869 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.869 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.869 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.869 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.869 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.869 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.870 INFO:teuthology.orchestra.run.smithi114.stdout: "device_url": { 2023-10-18T14:14:09.870 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_url", 2023-10-18T14:14:09.870 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.870 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.870 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.871 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-18T14:14:09.871 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.871 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.871 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.872 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.872 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.872 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.872 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.872 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.872 INFO:teuthology.orchestra.run.smithi114.stdout: "enabled": { 2023-10-18T14:14:09.873 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enabled", 2023-10-18T14:14:09.873 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.873 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.873 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.873 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.874 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.874 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.874 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.874 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.874 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.875 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.875 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.875 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.875 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:09.875 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:09.875 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.876 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.876 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.876 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "24", 2023-10-18T14:14:09.876 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "8", 2023-10-18T14:14:09.876 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.877 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.877 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.877 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.877 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.877 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.878 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.878 INFO:teuthology.orchestra.run.smithi114.stdout: "last_opt_revision": { 2023-10-18T14:14:09.878 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "last_opt_revision", 2023-10-18T14:14:09.878 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.878 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.878 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.879 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1", 2023-10-18T14:14:09.879 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.879 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.879 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.879 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.880 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.880 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.880 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.880 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.880 INFO:teuthology.orchestra.run.smithi114.stdout: "leaderboard": { 2023-10-18T14:14:09.880 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "leaderboard", 2023-10-18T14:14:09.881 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.881 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.881 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.881 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.881 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.882 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.882 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.882 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.882 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.882 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.882 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.883 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.883 INFO:teuthology.orchestra.run.smithi114.stdout: "leaderboard_description": { 2023-10-18T14:14:09.883 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "leaderboard_description", 2023-10-18T14:14:09.883 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.883 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.883 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.884 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.884 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.884 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.884 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.884 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.885 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.885 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.885 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.885 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.885 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.886 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.886 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.886 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.886 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.887 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.887 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.887 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.887 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.887 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.888 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.888 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.888 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.888 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.888 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.889 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.889 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.889 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.889 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.889 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.889 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.890 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.890 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.890 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.890 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.890 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.891 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.891 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.891 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.891 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.891 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.891 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.892 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.892 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.892 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.892 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.892 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.893 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.893 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.893 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.893 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.893 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.893 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.894 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.894 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.894 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.894 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.894 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.895 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.895 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.895 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.895 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.895 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.896 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.896 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.896 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.896 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.896 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.897 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.897 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.897 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.897 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.897 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.898 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.898 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.898 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.898 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.898 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.899 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.899 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.899 INFO:teuthology.orchestra.run.smithi114.stdout: "organization": { 2023-10-18T14:14:09.899 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "organization", 2023-10-18T14:14:09.899 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.900 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.900 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.900 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.900 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.900 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.900 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.901 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.901 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.901 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.901 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.901 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.902 INFO:teuthology.orchestra.run.smithi114.stdout: "proxy": { 2023-10-18T14:14:09.902 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "proxy", 2023-10-18T14:14:09.902 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.902 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.902 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.903 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.903 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.903 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.903 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.903 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.903 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.904 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.904 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.904 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.904 INFO:teuthology.orchestra.run.smithi114.stdout: "url": { 2023-10-18T14:14:09.904 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "url", 2023-10-18T14:14:09.905 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.905 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.905 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.905 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-18T14:14:09.905 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.906 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.906 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.906 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.906 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.906 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.906 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.907 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.907 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.907 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.907 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.907 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "test_orchestrator", 2023-10-18T14:14:09.908 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.908 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.908 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.908 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.908 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.909 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.909 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.909 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.909 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.909 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.909 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.910 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.910 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.910 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.910 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.910 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.911 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.911 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.911 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.911 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.911 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.912 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.912 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.912 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.912 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.912 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.912 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.913 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.913 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.913 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.913 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.913 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.913 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.914 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.914 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.914 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.914 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.915 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.915 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.915 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.915 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.915 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.915 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.916 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.916 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.916 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.916 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.916 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.917 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.917 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.917 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.917 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.917 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.917 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.918 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.918 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.918 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.918 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.918 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.919 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.919 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.919 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.919 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.919 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.920 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.920 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.920 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.920 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.920 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.920 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.921 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.921 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.921 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.921 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.921 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.921 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.922 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "volumes", 2023-10-18T14:14:09.922 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.922 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.922 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.922 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.923 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.923 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.923 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.923 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.923 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.924 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.924 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.924 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.924 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.924 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.924 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.925 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.925 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.925 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.925 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.925 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.926 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.926 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.926 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.926 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.926 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.927 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.927 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.927 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.927 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.927 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.928 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.928 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.928 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.928 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.928 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.928 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.929 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.929 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.929 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.929 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.929 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.929 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.930 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.930 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.930 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.930 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.930 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.931 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.931 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.931 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.931 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.931 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.931 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.932 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.932 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.932 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.932 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.932 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.933 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.933 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.933 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.933 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.933 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.934 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.934 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.934 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.934 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.935 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.935 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.935 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.935 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.935 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.935 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.936 INFO:teuthology.orchestra.run.smithi114.stdout: "max_concurrent_clones": { 2023-10-18T14:14:09.936 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_concurrent_clones", 2023-10-18T14:14:09.936 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.936 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.936 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.937 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "4", 2023-10-18T14:14:09.937 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.937 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.937 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.937 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-18T14:14:09.938 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.938 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.938 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.938 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.938 INFO:teuthology.orchestra.run.smithi114.stdout: "periodic_async_work": { 2023-10-18T14:14:09.938 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "periodic_async_work", 2023-10-18T14:14:09.939 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.939 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.939 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.939 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.939 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.940 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.940 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.940 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Periodically check for async work", 2023-10-18T14:14:09.940 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.940 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.941 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.941 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.941 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot_clone_delay": { 2023-10-18T14:14:09.941 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snapshot_clone_delay", 2023-10-18T14:14:09.941 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.942 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.942 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.942 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:09.942 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.942 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.942 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.943 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-18T14:14:09.943 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.943 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.943 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.943 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.944 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.944 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.944 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.944 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix", 2023-10-18T14:14:09.944 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.945 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.945 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.945 INFO:teuthology.orchestra.run.smithi114.stdout: "discovery_interval": { 2023-10-18T14:14:09.945 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "discovery_interval", 2023-10-18T14:14:09.945 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:09.945 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.946 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.946 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "100", 2023-10-18T14:14:09.946 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.946 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.946 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.947 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.947 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.947 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.947 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.947 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.947 INFO:teuthology.orchestra.run.smithi114.stdout: "identifier": { 2023-10-18T14:14:09.948 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "identifier", 2023-10-18T14:14:09.948 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.948 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.948 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.948 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.948 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.949 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.949 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.949 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.949 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.949 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.950 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.950 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.950 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:09.950 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:09.950 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.950 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.951 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.951 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:09.951 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.951 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.951 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.952 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.952 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.952 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.952 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.952 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.952 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.953 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.953 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.953 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.953 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.953 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.953 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.954 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.954 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.954 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.954 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.954 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.955 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.955 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.955 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.955 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.955 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.956 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.956 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.956 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.956 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.956 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.956 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.957 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.957 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.957 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.957 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.957 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.957 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.958 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.958 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.958 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.958 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.958 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.959 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.959 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.959 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.959 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.959 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.960 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.960 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.960 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.960 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.960 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.960 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.961 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.961 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.961 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.961 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.961 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.962 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.962 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.962 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.962 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.962 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.963 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.963 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.963 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.963 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.963 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.963 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.964 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.964 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.964 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.964 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.964 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.965 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.965 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.965 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.965 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.965 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_host": { 2023-10-18T14:14:09.966 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_host", 2023-10-18T14:14:09.966 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.966 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.966 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.966 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.967 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.967 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.967 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.967 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.967 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.967 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.968 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.968 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.968 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_port": { 2023-10-18T14:14:09.968 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_port", 2023-10-18T14:14:09.968 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:09.969 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.969 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.969 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10051", 2023-10-18T14:14:09.969 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.969 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.969 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.970 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.970 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.970 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.970 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.970 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.971 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_sender": { 2023-10-18T14:14:09.971 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_sender", 2023-10-18T14:14:09.971 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.971 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.971 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:09.971 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-18T14:14:09.972 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.972 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.972 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.972 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.972 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.972 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.973 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.973 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.973 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.973 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.973 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-10-18T14:14:09.974 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:09.974 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.974 INFO:teuthology.orchestra.run.smithi114.stdout: "modules": [ 2023-10-18T14:14:09.974 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm", 2023-10-18T14:14:09.974 INFO:teuthology.orchestra.run.smithi114.stdout: "dashboard", 2023-10-18T14:14:09.975 INFO:teuthology.orchestra.run.smithi114.stdout: "iostat", 2023-10-18T14:14:09.975 INFO:teuthology.orchestra.run.smithi114.stdout: "nfs", 2023-10-18T14:14:09.975 INFO:teuthology.orchestra.run.smithi114.stdout: "restful", 2023-10-18T14:14:09.975 INFO:teuthology.orchestra.run.smithi114.stdout: "snap_schedule" 2023-10-18T14:14:09.975 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.975 INFO:teuthology.orchestra.run.smithi114.stdout: "available_modules": [ 2023-10-18T14:14:09.976 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:09.976 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "alerts", 2023-10-18T14:14:09.976 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:09.976 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:09.976 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:09.977 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:09.977 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:09.977 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:09.977 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.977 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.977 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:09.978 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.978 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.978 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.978 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How frequently to reexamine health status", 2023-10-18T14:14:09.979 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.979 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.979 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.979 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.979 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:09.979 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:09.980 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.980 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.980 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.980 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.980 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.981 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.981 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.981 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.981 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.981 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.982 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.982 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.982 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.982 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.982 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.982 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.983 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.983 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.983 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.983 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:09.983 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:09.984 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.984 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.984 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.984 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.984 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.985 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.985 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.985 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.985 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.985 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.986 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.986 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.986 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:09.986 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:09.986 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.987 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.987 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.987 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:09.987 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.987 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.987 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:09.988 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:09.988 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:09.988 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:09.988 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:09.988 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:09.989 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:09.989 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:09.989 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.989 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.989 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.990 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.990 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.990 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:09.990 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:09.990 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:09.991 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.991 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.991 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:09.991 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.991 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.992 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.992 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:09.992 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.992 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.992 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.993 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_destination": { 2023-10-18T14:14:09.993 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_destination", 2023-10-18T14:14:09.993 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.993 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.993 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.994 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.994 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.994 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.994 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.995 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Email address to send alerts to", 2023-10-18T14:14:09.995 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.995 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.995 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.995 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_from_name": { 2023-10-18T14:14:09.996 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_from_name", 2023-10-18T14:14:09.996 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.996 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.996 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.996 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "Ceph", 2023-10-18T14:14:09.997 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.997 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:09.997 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:09.997 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Email From: name", 2023-10-18T14:14:09.997 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:09.998 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:09.998 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:09.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:09.998 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_host": { 2023-10-18T14:14:09.998 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_host", 2023-10-18T14:14:09.999 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:09.999 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:09.999 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:09.999 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:09.999 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:09.999 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.000 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.000 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP server", 2023-10-18T14:14:10.000 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.000 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.000 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.001 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_password": { 2023-10-18T14:14:10.001 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_password", 2023-10-18T14:14:10.001 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.001 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.002 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.002 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.002 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.002 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.002 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.003 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Password to authenticate with", 2023-10-18T14:14:10.003 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.003 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.003 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_port": { 2023-10-18T14:14:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_port", 2023-10-18T14:14:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "465", 2023-10-18T14:14:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP port", 2023-10-18T14:14:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_sender": { 2023-10-18T14:14:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_sender", 2023-10-18T14:14:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP envelope sender", 2023-10-18T14:14:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_ssl": { 2023-10-18T14:14:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_ssl", 2023-10-18T14:14:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-18T14:14:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_user": { 2023-10-18T14:14:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_user", 2023-10-18T14:14:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "User to authenticate as", 2023-10-18T14:14:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "balancer", 2023-10-18T14:14:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "active": { 2023-10-18T14:14:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "active", 2023-10-18T14:14:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.018 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "automatically balance PGs across cluster", 2023-10-18T14:14:10.018 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.018 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.018 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.019 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.019 INFO:teuthology.orchestra.run.smithi114.stdout: "begin_time": { 2023-10-18T14:14:10.019 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "begin_time", 2023-10-18T14:14:10.019 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.019 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.020 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.020 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0000", 2023-10-18T14:14:10.020 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.020 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.020 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.020 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "beginning time of day to automatically balance", 2023-10-18T14:14:10.021 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-18T14:14:10.021 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.021 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.021 INFO:teuthology.orchestra.run.smithi114.stdout: "begin_weekday": { 2023-10-18T14:14:10.022 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "begin_weekday", 2023-10-18T14:14:10.022 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:10.022 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.022 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.022 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:10.023 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0", 2023-10-18T14:14:10.023 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "6", 2023-10-18T14:14:10.023 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.023 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-18T14:14:10.023 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-18T14:14:10.024 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.024 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.024 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.024 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_max_iterations": { 2023-10-18T14:14:10.024 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_max_iterations", 2023-10-18T14:14:10.025 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:10.025 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.025 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.025 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "25", 2023-10-18T14:14:10.025 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2023-10-18T14:14:10.025 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "250", 2023-10-18T14:14:10.026 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.026 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-18T14:14:10.026 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.026 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.027 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.027 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_metrics": { 2023-10-18T14:14:10.027 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_metrics", 2023-10-18T14:14:10.027 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.027 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.028 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.028 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "pgs,objects,bytes", 2023-10-18T14:14:10.028 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.028 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.028 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.029 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-18T14:14:10.029 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-18T14:14:10.029 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.029 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.030 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_step": { 2023-10-18T14:14:10.030 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_step", 2023-10-18T14:14:10.030 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:10.030 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.030 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.031 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0.5", 2023-10-18T14:14:10.031 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0.001", 2023-10-18T14:14:10.031 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "0.999", 2023-10-18T14:14:10.031 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.031 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "aggressiveness of optimization", 2023-10-18T14:14:10.032 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-18T14:14:10.032 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.032 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.033 INFO:teuthology.orchestra.run.smithi114.stdout: "end_time": { 2023-10-18T14:14:10.033 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "end_time", 2023-10-18T14:14:10.033 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.034 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.034 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.034 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "2359", 2023-10-18T14:14:10.035 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.035 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.035 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.036 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "ending time of day to automatically balance", 2023-10-18T14:14:10.036 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-18T14:14:10.036 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.036 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.037 INFO:teuthology.orchestra.run.smithi114.stdout: "end_weekday": { 2023-10-18T14:14:10.037 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "end_weekday", 2023-10-18T14:14:10.038 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:10.038 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.038 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.039 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:10.039 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0", 2023-10-18T14:14:10.039 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "6", 2023-10-18T14:14:10.039 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.040 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-18T14:14:10.040 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-18T14:14:10.040 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.041 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.041 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.042 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.042 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.042 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.043 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.043 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.043 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.044 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.044 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.044 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.044 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.045 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.045 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.045 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.046 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.046 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.046 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.047 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.047 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.047 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.048 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.048 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.048 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.049 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.049 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.049 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.050 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.050 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.050 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.050 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.050 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.051 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.051 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.051 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.051 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.052 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.052 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.052 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.052 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.052 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.053 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.053 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.053 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.053 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.053 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.054 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.054 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.054 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.054 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.054 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.055 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.055 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.055 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.055 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.055 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.055 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.056 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.056 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.056 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.056 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.056 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.057 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.057 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.057 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.057 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.057 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.057 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.058 INFO:teuthology.orchestra.run.smithi114.stdout: "min_score": { 2023-10-18T14:14:10.058 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "min_score", 2023-10-18T14:14:10.058 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:10.059 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.059 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.059 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:10.059 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.059 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.060 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.060 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-18T14:14:10.060 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.060 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.060 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.060 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.061 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": { 2023-10-18T14:14:10.061 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mode", 2023-10-18T14:14:10.061 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.061 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.061 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.062 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "upmap", 2023-10-18T14:14:10.062 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.062 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.062 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.062 INFO:teuthology.orchestra.run.smithi114.stdout: "crush-compat", 2023-10-18T14:14:10.062 INFO:teuthology.orchestra.run.smithi114.stdout: "none", 2023-10-18T14:14:10.063 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap" 2023-10-18T14:14:10.063 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.063 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Balancer mode", 2023-10-18T14:14:10.063 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.063 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.064 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.064 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_ids": { 2023-10-18T14:14:10.064 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pool_ids", 2023-10-18T14:14:10.064 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.065 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.065 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.065 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.065 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.065 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.065 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.066 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-18T14:14:10.066 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.066 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.066 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.067 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:10.067 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:10.067 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.067 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.067 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.068 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:10.068 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.068 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.068 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.068 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-18T14:14:10.069 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.069 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.069 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.069 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap_max_deviation": { 2023-10-18T14:14:10.070 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "upmap_max_deviation", 2023-10-18T14:14:10.070 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.070 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.070 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.070 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2023-10-18T14:14:10.071 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2023-10-18T14:14:10.071 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.071 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.071 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-18T14:14:10.071 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-18T14:14:10.072 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.072 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.072 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap_max_optimizations": { 2023-10-18T14:14:10.072 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "upmap_max_optimizations", 2023-10-18T14:14:10.073 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:10.073 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.073 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.073 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:10.073 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.074 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.074 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.074 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-18T14:14:10.074 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.074 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.075 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.075 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.075 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.075 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.076 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephadm", 2023-10-18T14:14:10.076 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.076 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.076 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.076 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_down_multiplier": { 2023-10-18T14:14:10.077 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_down_multiplier", 2023-10-18T14:14:10.077 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:10.077 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.077 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.077 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3.0", 2023-10-18T14:14:10.078 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.078 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.078 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.078 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-18T14:14:10.078 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.079 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.079 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.079 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_refresh_rate": { 2023-10-18T14:14:10.079 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_refresh_rate", 2023-10-18T14:14:10.080 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.080 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.080 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.080 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "20", 2023-10-18T14:14:10.080 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.081 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.081 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.081 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-18T14:14:10.081 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.081 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.082 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.082 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_starting_port": { 2023-10-18T14:14:10.082 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_starting_port", 2023-10-18T14:14:10.082 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.083 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.083 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.083 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "4721", 2023-10-18T14:14:10.083 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.083 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.083 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.084 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-18T14:14:10.084 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.084 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.084 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.085 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_ptrace": { 2023-10-18T14:14:10.085 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_ptrace", 2023-10-18T14:14:10.085 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.085 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.085 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.086 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.086 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.086 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.086 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.086 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-18T14:14:10.087 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-18T14:14:10.087 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.087 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.088 INFO:teuthology.orchestra.run.smithi114.stdout: "autotune_interval": { 2023-10-18T14:14:10.088 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "autotune_interval", 2023-10-18T14:14:10.088 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.088 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.088 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.088 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:10.089 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.089 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.089 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.089 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-18T14:14:10.089 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.090 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.090 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.090 INFO:teuthology.orchestra.run.smithi114.stdout: "autotune_memory_target_ratio": { 2023-10-18T14:14:10.091 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "autotune_memory_target_ratio", 2023-10-18T14:14:10.091 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:10.091 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.091 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.091 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0.7", 2023-10-18T14:14:10.092 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.092 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.092 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.092 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-18T14:14:10.092 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.093 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.093 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.093 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm_log_destination": { 2023-10-18T14:14:10.093 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephadm_log_destination", 2023-10-18T14:14:10.094 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.094 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.094 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.094 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.094 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.095 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.095 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.095 INFO:teuthology.orchestra.run.smithi114.stdout: "file", 2023-10-18T14:14:10.095 INFO:teuthology.orchestra.run.smithi114.stdout: "file,syslog", 2023-10-18T14:14:10.095 INFO:teuthology.orchestra.run.smithi114.stdout: "syslog" 2023-10-18T14:14:10.096 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.096 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-18T14:14:10.096 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.096 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.097 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.097 INFO:teuthology.orchestra.run.smithi114.stdout: "cgroups_split": { 2023-10-18T14:14:10.097 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cgroups_split", 2023-10-18T14:14:10.097 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.098 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.098 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.098 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.098 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.098 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.099 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.099 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-18T14:14:10.099 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.099 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.099 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.100 INFO:teuthology.orchestra.run.smithi114.stdout: "config_checks_enabled": { 2023-10-18T14:14:10.100 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "config_checks_enabled", 2023-10-18T14:14:10.100 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.100 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.101 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.101 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.101 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.101 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.101 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.102 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-18T14:14:10.102 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.102 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.102 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.103 INFO:teuthology.orchestra.run.smithi114.stdout: "config_dashboard": { 2023-10-18T14:14:10.103 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "config_dashboard", 2023-10-18T14:14:10.103 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.103 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.103 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.104 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.104 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.104 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.104 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.104 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-18T14:14:10.105 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.105 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.105 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.105 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_alertmanager": { 2023-10-18T14:14:10.105 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_alertmanager", 2023-10-18T14:14:10.106 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.106 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.106 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.106 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-18T14:14:10.106 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.107 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.107 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.107 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2023-10-18T14:14:10.107 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.107 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.108 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.108 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_base": { 2023-10-18T14:14:10.108 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_base", 2023-10-18T14:14:10.108 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.108 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.109 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.109 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-18T14:14:10.109 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.109 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.109 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.110 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Container image name, without the tag", 2023-10-18T14:14:10.110 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.110 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.110 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.111 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_elasticsearch": { 2023-10-18T14:14:10.111 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_elasticsearch", 2023-10-18T14:14:10.111 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.111 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.111 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.112 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-18T14:14:10.112 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.112 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.112 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.112 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "elasticsearch container image", 2023-10-18T14:14:10.113 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.113 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.113 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.113 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_grafana": { 2023-10-18T14:14:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_grafana", 2023-10-18T14:14:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.114 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-18T14:14:10.115 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.115 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.115 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.115 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2023-10-18T14:14:10.115 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_haproxy": { 2023-10-18T14:14:10.116 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_haproxy", 2023-10-18T14:14:10.117 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.117 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.117 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.117 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-18T14:14:10.117 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.118 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.118 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.118 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "HAproxy container image", 2023-10-18T14:14:10.118 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.118 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.119 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.119 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_agent": { 2023-10-18T14:14:10.119 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_agent", 2023-10-18T14:14:10.119 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.120 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.120 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.120 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-18T14:14:10.120 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.120 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.121 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.121 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger agent container image", 2023-10-18T14:14:10.121 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.121 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.121 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.122 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_collector": { 2023-10-18T14:14:10.122 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_collector", 2023-10-18T14:14:10.122 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.122 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.123 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.123 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-18T14:14:10.123 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.123 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.123 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.124 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger collector container image", 2023-10-18T14:14:10.124 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.124 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.124 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.125 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_query": { 2023-10-18T14:14:10.125 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_query", 2023-10-18T14:14:10.125 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.125 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.125 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.126 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-18T14:14:10.126 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.126 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.126 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.126 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger query container image", 2023-10-18T14:14:10.127 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.127 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.127 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.127 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_keepalived": { 2023-10-18T14:14:10.128 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_keepalived", 2023-10-18T14:14:10.128 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.128 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.128 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.128 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-18T14:14:10.129 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.129 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.129 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.129 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Keepalived container image", 2023-10-18T14:14:10.129 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.130 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.130 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.130 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_loki": { 2023-10-18T14:14:10.130 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_loki", 2023-10-18T14:14:10.131 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.131 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.131 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.131 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-18T14:14:10.131 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.132 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.132 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.132 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Loki container image", 2023-10-18T14:14:10.132 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.132 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.133 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.133 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_node_exporter": { 2023-10-18T14:14:10.133 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_node_exporter", 2023-10-18T14:14:10.133 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.134 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.134 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.134 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-18T14:14:10.134 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.134 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.135 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.135 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2023-10-18T14:14:10.135 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.135 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.135 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.136 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_nvmeof": { 2023-10-18T14:14:10.136 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_nvmeof", 2023-10-18T14:14:10.136 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.136 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.137 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.137 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-18T14:14:10.137 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.137 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.137 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.137 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Nvme-of container image", 2023-10-18T14:14:10.138 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.138 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.138 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.138 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_prometheus": { 2023-10-18T14:14:10.139 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_prometheus", 2023-10-18T14:14:10.139 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.139 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.139 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.140 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-18T14:14:10.140 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.140 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.140 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.140 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2023-10-18T14:14:10.141 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.141 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.141 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.141 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_promtail": { 2023-10-18T14:14:10.142 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_promtail", 2023-10-18T14:14:10.142 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.142 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.142 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.142 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-18T14:14:10.143 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.143 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.143 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.143 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Promtail container image", 2023-10-18T14:14:10.144 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.144 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.144 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.144 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_snmp_gateway": { 2023-10-18T14:14:10.145 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_snmp_gateway", 2023-10-18T14:14:10.145 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.145 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.145 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.145 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-18T14:14:10.146 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.146 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.146 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.146 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SNMP Gateway container image", 2023-10-18T14:14:10.146 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.147 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.147 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.147 INFO:teuthology.orchestra.run.smithi114.stdout: "container_init": { 2023-10-18T14:14:10.147 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_init", 2023-10-18T14:14:10.148 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.148 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.148 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.148 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.148 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.149 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.149 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.149 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Run podman/docker with `--init`", 2023-10-18T14:14:10.149 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.149 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.149 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.150 INFO:teuthology.orchestra.run.smithi114.stdout: "daemon_cache_timeout": { 2023-10-18T14:14:10.150 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "daemon_cache_timeout", 2023-10-18T14:14:10.150 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.150 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.151 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.151 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:10.151 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.151 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.151 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.152 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-18T14:14:10.152 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.152 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.152 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.153 INFO:teuthology.orchestra.run.smithi114.stdout: "default_cephadm_command_timeout": { 2023-10-18T14:14:10.153 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "default_cephadm_command_timeout", 2023-10-18T14:14:10.153 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.153 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.153 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.154 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "900", 2023-10-18T14:14:10.154 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.154 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.154 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.154 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-18T14:14:10.155 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.155 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.155 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.155 INFO:teuthology.orchestra.run.smithi114.stdout: "default_registry": { 2023-10-18T14:14:10.156 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "default_registry", 2023-10-18T14:14:10.156 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.156 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.156 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.156 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io", 2023-10-18T14:14:10.157 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.157 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.157 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.157 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-18T14:14:10.157 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.158 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.158 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.158 INFO:teuthology.orchestra.run.smithi114.stdout: "device_cache_timeout": { 2023-10-18T14:14:10.158 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_cache_timeout", 2023-10-18T14:14:10.159 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.159 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.159 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.159 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1800", 2023-10-18T14:14:10.159 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.160 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.160 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.160 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache device inventory", 2023-10-18T14:14:10.160 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.160 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.160 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.161 INFO:teuthology.orchestra.run.smithi114.stdout: "device_enhanced_scan": { 2023-10-18T14:14:10.161 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_enhanced_scan", 2023-10-18T14:14:10.161 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.161 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.162 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.162 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.162 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.162 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.163 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.163 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-18T14:14:10.163 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.163 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.163 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.164 INFO:teuthology.orchestra.run.smithi114.stdout: "facts_cache_timeout": { 2023-10-18T14:14:10.164 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "facts_cache_timeout", 2023-10-18T14:14:10.164 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.164 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.165 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.165 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:10.165 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.165 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.165 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.165 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache host facts data", 2023-10-18T14:14:10.166 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.166 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.166 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.166 INFO:teuthology.orchestra.run.smithi114.stdout: "host_check_interval": { 2023-10-18T14:14:10.167 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "host_check_interval", 2023-10-18T14:14:10.167 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.167 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.167 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.167 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:10.168 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.168 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.168 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.168 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to perform a host check", 2023-10-18T14:14:10.168 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.168 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.169 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.169 INFO:teuthology.orchestra.run.smithi114.stdout: "inventory_list_all": { 2023-10-18T14:14:10.169 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "inventory_list_all", 2023-10-18T14:14:10.169 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.169 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.170 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.170 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.170 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.170 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.170 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.171 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-18T14:14:10.171 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.171 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.171 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.172 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.172 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.172 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.172 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.172 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.172 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.173 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.173 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.173 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.173 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.173 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.174 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.174 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.174 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.174 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.174 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.175 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.175 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.175 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.175 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.176 INFO:teuthology.orchestra.run.smithi114.stdout: "log_refresh_metadata": { 2023-10-18T14:14:10.176 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_refresh_metadata", 2023-10-18T14:14:10.176 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.176 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.176 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.176 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.177 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.177 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.177 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.177 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-18T14:14:10.177 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.177 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.178 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.178 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.178 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.178 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.179 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.179 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.179 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.179 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.179 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.179 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.180 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-18T14:14:10.180 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.180 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.180 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.181 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.181 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.181 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.181 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.181 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.182 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.182 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.182 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.182 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.182 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.183 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.183 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.183 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.183 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.183 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.183 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.184 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.184 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.184 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.184 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.185 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.185 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.185 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.185 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.185 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.186 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.186 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.186 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.186 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.186 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.187 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.187 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.187 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.187 INFO:teuthology.orchestra.run.smithi114.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-18T14:14:10.188 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-18T14:14:10.188 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.188 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.188 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.188 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.189 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.189 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.189 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.189 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-18T14:14:10.189 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.190 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.190 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.190 INFO:teuthology.orchestra.run.smithi114.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-18T14:14:10.190 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-18T14:14:10.190 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.191 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.191 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.191 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "*", 2023-10-18T14:14:10.191 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.191 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.192 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.192 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-18T14:14:10.192 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.192 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.192 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.193 INFO:teuthology.orchestra.run.smithi114.stdout: "max_count_per_host": { 2023-10-18T14:14:10.193 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_count_per_host", 2023-10-18T14:14:10.193 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.193 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.194 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.194 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:10.194 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.194 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.194 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.195 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "max number of daemons per service per host", 2023-10-18T14:14:10.195 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.195 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.195 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.195 INFO:teuthology.orchestra.run.smithi114.stdout: "max_osd_draining_count": { 2023-10-18T14:14:10.196 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_osd_draining_count", 2023-10-18T14:14:10.196 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.196 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.196 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.196 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:10.197 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.197 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.197 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.197 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-18T14:14:10.197 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.198 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.198 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.198 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.198 INFO:teuthology.orchestra.run.smithi114.stdout: "migration_current": { 2023-10-18T14:14:10.198 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "migration_current", 2023-10-18T14:14:10.199 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.199 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.199 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.199 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.199 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.200 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.200 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.200 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "internal - do not modify", 2023-10-18T14:14:10.200 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.200 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.200 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.201 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.201 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": { 2023-10-18T14:14:10.201 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mode", 2023-10-18T14:14:10.201 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.201 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.202 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.202 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "root", 2023-10-18T14:14:10.202 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.202 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.202 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.203 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm-package", 2023-10-18T14:14:10.203 INFO:teuthology.orchestra.run.smithi114.stdout: "root" 2023-10-18T14:14:10.203 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.203 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "mode for remote execution of cephadm", 2023-10-18T14:14:10.203 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.204 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.204 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.204 INFO:teuthology.orchestra.run.smithi114.stdout: "prometheus_alerts_path": { 2023-10-18T14:14:10.204 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prometheus_alerts_path", 2023-10-18T14:14:10.205 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.205 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.205 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.205 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-18T14:14:10.205 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.205 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.206 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.206 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-18T14:14:10.206 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.206 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.206 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.207 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_insecure": { 2023-10-18T14:14:10.207 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_insecure", 2023-10-18T14:14:10.207 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.207 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.208 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.208 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.208 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.208 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.208 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.209 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-18T14:14:10.209 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.209 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.209 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.209 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.210 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_password": { 2023-10-18T14:14:10.210 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_password", 2023-10-18T14:14:10.210 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.210 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.210 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.210 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.211 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.211 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.211 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.211 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-18T14:14:10.211 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.212 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.212 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.212 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_url": { 2023-10-18T14:14:10.212 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_url", 2023-10-18T14:14:10.212 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.213 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.213 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.213 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.213 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.213 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.214 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.214 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-18T14:14:10.214 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.214 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.214 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.215 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_username": { 2023-10-18T14:14:10.215 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_username", 2023-10-18T14:14:10.215 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.215 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.216 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.216 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.216 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.216 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.216 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.217 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-18T14:14:10.217 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.217 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.217 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.218 INFO:teuthology.orchestra.run.smithi114.stdout: "secure_monitoring_stack": { 2023-10-18T14:14:10.218 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "secure_monitoring_stack", 2023-10-18T14:14:10.218 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.218 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.218 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.219 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.219 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.219 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.219 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.219 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-18T14:14:10.220 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.220 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.220 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.220 INFO:teuthology.orchestra.run.smithi114.stdout: "service_discovery_port": { 2023-10-18T14:14:10.221 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "service_discovery_port", 2023-10-18T14:14:10.221 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.221 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.221 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.221 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8765", 2023-10-18T14:14:10.222 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.222 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.222 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.222 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "cephadm service discovery port", 2023-10-18T14:14:10.222 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.223 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.223 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.223 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.223 INFO:teuthology.orchestra.run.smithi114.stdout: "ssh_config_file": { 2023-10-18T14:14:10.223 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssh_config_file", 2023-10-18T14:14:10.224 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.224 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.224 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.224 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.224 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.224 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.225 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.225 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-18T14:14:10.225 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.225 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.225 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.226 INFO:teuthology.orchestra.run.smithi114.stdout: "use_agent": { 2023-10-18T14:14:10.226 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "use_agent", 2023-10-18T14:14:10.226 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.226 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.227 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.227 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.227 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.227 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.227 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.228 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-18T14:14:10.228 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.228 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.228 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.228 INFO:teuthology.orchestra.run.smithi114.stdout: "use_repo_digest": { 2023-10-18T14:14:10.229 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "use_repo_digest", 2023-10-18T14:14:10.229 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.229 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.229 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.229 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.230 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.230 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.230 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.230 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-18T14:14:10.230 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.231 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.231 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.231 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_failed_host_check": { 2023-10-18T14:14:10.231 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_failed_host_check", 2023-10-18T14:14:10.232 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.232 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.232 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.232 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.232 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.232 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.233 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.233 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if the host check fails", 2023-10-18T14:14:10.233 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.233 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.233 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.234 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.234 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_stray_daemons": { 2023-10-18T14:14:10.234 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_stray_daemons", 2023-10-18T14:14:10.234 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.234 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.235 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.235 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.235 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.235 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.235 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.236 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-18T14:14:10.236 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.236 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.236 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.237 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_stray_hosts": { 2023-10-18T14:14:10.237 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_stray_hosts", 2023-10-18T14:14:10.237 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.237 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.237 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.238 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-18T14:14:10.239 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.239 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.239 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.239 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.239 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.240 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crash", 2023-10-18T14:14:10.240 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.240 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.240 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.241 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.241 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.241 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.241 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.241 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.241 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.242 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.242 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.242 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.242 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.243 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.243 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.243 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.243 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.243 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.243 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.244 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.244 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.244 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.244 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.245 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.245 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.245 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.245 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.245 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.246 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.246 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.246 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.246 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.246 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.247 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.247 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.247 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.247 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.248 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.248 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.248 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.248 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.248 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.249 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.249 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.249 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.249 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.249 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.249 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.250 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.250 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.250 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.250 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.250 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.251 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.251 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.251 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.251 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.251 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.252 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.252 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.252 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.252 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.252 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.252 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.253 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.253 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.253 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.253 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.253 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.254 INFO:teuthology.orchestra.run.smithi114.stdout: "retain_interval": { 2023-10-18T14:14:10.254 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "retain_interval", 2023-10-18T14:14:10.254 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.255 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.255 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.255 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "31536000", 2023-10-18T14:14:10.255 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.255 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.255 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.256 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-18T14:14:10.256 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.256 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.256 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.257 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_recent_interval": { 2023-10-18T14:14:10.257 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_recent_interval", 2023-10-18T14:14:10.257 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.257 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.257 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.258 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1209600", 2023-10-18T14:14:10.258 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.258 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.258 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.258 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-18T14:14:10.259 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.259 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.259 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.259 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.259 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.259 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.260 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.260 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "dashboard", 2023-10-18T14:14:10.260 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.260 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.260 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.261 INFO:teuthology.orchestra.run.smithi114.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-18T14:14:10.261 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-18T14:14:10.261 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.261 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.261 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.262 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:10.262 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.262 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.262 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.262 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.263 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.263 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.263 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.263 INFO:teuthology.orchestra.run.smithi114.stdout: "ALERTMANAGER_API_HOST": { 2023-10-18T14:14:10.264 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-18T14:14:10.264 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.264 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.264 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.264 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.265 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.265 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.265 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.265 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.265 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.266 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.266 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.266 INFO:teuthology.orchestra.run.smithi114.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-18T14:14:10.266 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-18T14:14:10.267 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.267 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.267 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.267 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.267 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.268 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.268 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.268 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.268 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.268 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.268 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.269 INFO:teuthology.orchestra.run.smithi114.stdout: "AUDIT_API_ENABLED": { 2023-10-18T14:14:10.269 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "AUDIT_API_ENABLED", 2023-10-18T14:14:10.269 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.269 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.270 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.270 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.270 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.270 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.270 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.270 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.271 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.271 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.271 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.271 INFO:teuthology.orchestra.run.smithi114.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-18T14:14:10.272 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-18T14:14:10.272 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.272 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.272 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.272 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.272 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.273 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.273 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.273 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.273 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.273 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.273 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.274 INFO:teuthology.orchestra.run.smithi114.stdout: "ENABLE_BROWSABLE_API": { 2023-10-18T14:14:10.274 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-18T14:14:10.274 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.274 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.275 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.275 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.275 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.275 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.275 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.276 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.276 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.276 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.276 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.277 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-18T14:14:10.277 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-18T14:14:10.277 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.277 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.277 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.278 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.278 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.278 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.278 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.278 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.278 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.279 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.279 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.279 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-18T14:14:10.279 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-18T14:14:10.280 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.280 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.280 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.280 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.280 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.281 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.281 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.281 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.281 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.281 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.281 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.282 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-18T14:14:10.282 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-18T14:14:10.282 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.282 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.283 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.283 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.283 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.283 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.283 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.283 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.284 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.284 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.284 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.284 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-18T14:14:10.285 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-18T14:14:10.285 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.285 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.285 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.285 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.286 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.286 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.286 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.286 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.286 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.287 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.287 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.287 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.287 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-18T14:14:10.287 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-18T14:14:10.288 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.288 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.288 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.288 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.288 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.289 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.289 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.289 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.289 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.289 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.290 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.290 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-18T14:14:10.290 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-18T14:14:10.290 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.290 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.291 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.291 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.291 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.291 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.291 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.292 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.292 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.292 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.292 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.293 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-18T14:14:10.293 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-18T14:14:10.293 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.293 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.293 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.294 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.294 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.294 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.294 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.294 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.295 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.295 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.295 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.295 INFO:teuthology.orchestra.run.smithi114.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-18T14:14:10.296 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-18T14:14:10.296 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.296 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.296 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.296 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.297 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.297 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.297 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.297 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.297 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.297 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.298 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.298 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_PASSWORD": { 2023-10-18T14:14:10.298 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-18T14:14:10.299 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.299 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.299 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.299 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2023-10-18T14:14:10.299 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.299 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.300 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.300 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.300 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.300 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.300 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.301 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-18T14:14:10.301 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-18T14:14:10.301 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.301 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.301 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.302 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.302 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.302 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.302 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.302 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.303 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.303 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.303 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.303 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.303 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_URL": { 2023-10-18T14:14:10.303 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_URL", 2023-10-18T14:14:10.304 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.304 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.304 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.304 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.304 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.305 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.305 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.305 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.305 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.305 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.305 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.306 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.306 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_USERNAME": { 2023-10-18T14:14:10.306 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-18T14:14:10.306 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.306 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.307 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.307 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2023-10-18T14:14:10.307 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.307 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.307 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.307 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.308 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.308 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.308 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.308 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.308 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-18T14:14:10.309 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-18T14:14:10.309 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.309 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.309 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.309 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.310 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.310 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.310 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.310 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.310 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.311 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.311 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.311 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-18T14:14:10.311 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-18T14:14:10.311 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.312 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.312 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.312 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.312 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.312 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.313 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.313 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.313 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.313 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.313 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.314 INFO:teuthology.orchestra.run.smithi114.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-18T14:14:10.314 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-18T14:14:10.314 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.314 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.314 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.315 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.315 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.315 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.315 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.315 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.316 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.316 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.316 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.316 INFO:teuthology.orchestra.run.smithi114.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-18T14:14:10.317 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-18T14:14:10.317 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.317 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.317 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.317 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.317 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.318 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.318 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.318 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.318 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.318 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.319 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.319 INFO:teuthology.orchestra.run.smithi114.stdout: "PROMETHEUS_API_HOST": { 2023-10-18T14:14:10.319 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-18T14:14:10.319 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.320 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.320 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.320 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.320 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.320 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.321 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.321 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.321 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.321 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.321 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.322 INFO:teuthology.orchestra.run.smithi114.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-18T14:14:10.322 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-18T14:14:10.322 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.322 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.323 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.323 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.323 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.323 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.323 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.323 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.324 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.324 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.324 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.324 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-18T14:14:10.325 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-18T14:14:10.325 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.325 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.325 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.325 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.326 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.326 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.326 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.326 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.326 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.327 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.327 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.327 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-18T14:14:10.327 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-18T14:14:10.328 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.328 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.328 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.328 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.328 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.328 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.329 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.329 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.329 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.329 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.329 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.330 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-18T14:14:10.330 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-18T14:14:10.330 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.330 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.331 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.331 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.331 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.331 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.331 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.332 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.332 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.332 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.332 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.333 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-18T14:14:10.333 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-18T14:14:10.333 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.333 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.333 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.333 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.334 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.334 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.334 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.334 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.334 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.335 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.335 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.335 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-18T14:14:10.335 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-18T14:14:10.336 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.336 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.336 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.336 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.336 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.337 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.337 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.337 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.337 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.337 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.338 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.338 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.338 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-18T14:14:10.338 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-18T14:14:10.338 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.339 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.339 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.339 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.339 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.339 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.339 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.340 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.340 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.340 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.340 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.340 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.341 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-18T14:14:10.341 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-18T14:14:10.341 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.341 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.341 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.342 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.342 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.342 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.342 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.342 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.343 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.343 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.343 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.343 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_ENABLED": { 2023-10-18T14:14:10.343 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-18T14:14:10.344 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.344 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.344 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.344 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.344 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.345 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.345 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.345 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.345 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.345 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.346 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.346 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-18T14:14:10.346 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-18T14:14:10.346 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.347 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.347 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.347 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-18T14:14:10.347 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.347 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.347 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.348 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.348 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.348 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.348 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.349 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-18T14:14:10.349 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-18T14:14:10.349 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.349 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.349 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.349 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:10.350 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.350 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.350 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.350 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.350 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.351 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.351 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.351 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-18T14:14:10.351 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-18T14:14:10.352 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.352 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.352 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.352 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8", 2023-10-18T14:14:10.352 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.352 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.353 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.353 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.353 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.353 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.353 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.354 INFO:teuthology.orchestra.run.smithi114.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-18T14:14:10.354 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-18T14:14:10.354 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.354 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.355 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.355 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "45", 2023-10-18T14:14:10.355 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.355 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.355 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.356 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.356 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.356 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.356 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.356 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_ACCESS_KEY": { 2023-10-18T14:14:10.357 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-18T14:14:10.357 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.357 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.357 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.357 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.358 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.358 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.358 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.358 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.358 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.358 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.359 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.359 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-18T14:14:10.359 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-18T14:14:10.359 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.360 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.360 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.360 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2023-10-18T14:14:10.360 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.360 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.361 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.361 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.361 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.361 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.361 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.362 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_SECRET_KEY": { 2023-10-18T14:14:10.362 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-18T14:14:10.362 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.362 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.363 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.363 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.363 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.363 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.363 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.364 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.364 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.364 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.364 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.364 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.364 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_SSL_VERIFY": { 2023-10-18T14:14:10.365 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-18T14:14:10.365 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.365 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.365 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.365 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.366 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.366 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.366 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.366 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.366 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.367 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.367 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.367 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.367 INFO:teuthology.orchestra.run.smithi114.stdout: "UNSAFE_TLS_v1_2": { 2023-10-18T14:14:10.367 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-18T14:14:10.368 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.368 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.368 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.368 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.368 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.369 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.369 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.369 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.369 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.369 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.369 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.370 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.370 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-18T14:14:10.370 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-18T14:14:10.370 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.371 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.371 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.371 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:10.371 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.371 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.371 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.372 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.372 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.372 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.372 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.372 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.372 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-18T14:14:10.373 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-18T14:14:10.373 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.373 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.373 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.373 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:10.374 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.374 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.374 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.374 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.374 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.375 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.375 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.375 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.375 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-18T14:14:10.375 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-18T14:14:10.376 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.376 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.376 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.376 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2023-10-18T14:14:10.376 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.376 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.377 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.377 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.377 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.377 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.377 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.378 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.378 INFO:teuthology.orchestra.run.smithi114.stdout: "cross_origin_url": { 2023-10-18T14:14:10.378 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cross_origin_url", 2023-10-18T14:14:10.378 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.378 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.379 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.379 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.379 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.379 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.379 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.379 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.380 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.380 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.380 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.380 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.380 INFO:teuthology.orchestra.run.smithi114.stdout: "crt_file": { 2023-10-18T14:14:10.380 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crt_file", 2023-10-18T14:14:10.381 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.381 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.381 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.381 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.381 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.382 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.382 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.382 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.382 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.382 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.383 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.383 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.383 INFO:teuthology.orchestra.run.smithi114.stdout: "debug": { 2023-10-18T14:14:10.383 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "debug", 2023-10-18T14:14:10.383 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.384 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.384 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.384 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.384 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.384 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.385 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.385 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable/disable debug options", 2023-10-18T14:14:10.385 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.385 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.385 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.386 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.386 INFO:teuthology.orchestra.run.smithi114.stdout: "jwt_token_ttl": { 2023-10-18T14:14:10.386 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "jwt_token_ttl", 2023-10-18T14:14:10.386 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.386 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.386 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.387 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "28800", 2023-10-18T14:14:10.387 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.387 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.387 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.387 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.388 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.388 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.388 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.388 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.388 INFO:teuthology.orchestra.run.smithi114.stdout: "key_file": { 2023-10-18T14:14:10.389 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "key_file", 2023-10-18T14:14:10.389 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.389 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.389 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.389 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.390 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.390 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.390 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.390 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.390 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.390 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.391 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.391 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.391 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.391 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.391 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.392 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.392 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.392 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.392 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.392 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.392 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.393 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.393 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.393 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.393 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.393 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.394 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.394 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.394 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.394 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.394 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.395 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.395 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.395 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.395 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.395 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.396 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.396 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.396 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.396 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.396 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.396 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.397 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.397 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.397 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.397 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.397 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.398 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.398 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.398 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.398 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.398 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.399 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.399 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.399 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.399 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.399 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.400 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.400 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.400 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.400 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.400 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.400 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.401 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.401 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.401 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.401 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.401 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.401 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.402 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.402 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.402 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.402 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.403 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.403 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.403 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.403 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.403 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.403 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.404 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.404 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.404 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.404 INFO:teuthology.orchestra.run.smithi114.stdout: "motd": { 2023-10-18T14:14:10.404 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "motd", 2023-10-18T14:14:10.405 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.405 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.405 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.405 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.405 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.406 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.406 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.406 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "The message of the day", 2023-10-18T14:14:10.406 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.406 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.407 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.407 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.407 INFO:teuthology.orchestra.run.smithi114.stdout: "redirect_resolve_ip_addr": { 2023-10-18T14:14:10.407 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "redirect_resolve_ip_addr", 2023-10-18T14:14:10.407 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.408 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.408 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.408 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.408 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.408 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.409 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.409 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.409 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.409 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.409 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.409 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.410 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2023-10-18T14:14:10.410 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2023-10-18T14:14:10.410 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.410 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.411 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.411 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "::", 2023-10-18T14:14:10.411 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.411 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.411 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.411 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.412 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.412 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.412 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.412 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.412 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2023-10-18T14:14:10.413 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2023-10-18T14:14:10.413 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.413 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.413 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.413 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8080", 2023-10-18T14:14:10.413 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.414 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.414 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.414 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.414 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.415 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.415 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.415 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.415 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl": { 2023-10-18T14:14:10.415 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl", 2023-10-18T14:14:10.415 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.416 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.416 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.416 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.416 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.416 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.417 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.417 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.417 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.417 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.417 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.418 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.418 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl_server_port": { 2023-10-18T14:14:10.418 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl_server_port", 2023-10-18T14:14:10.418 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.418 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.419 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.419 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8443", 2023-10-18T14:14:10.419 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.419 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.419 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.420 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.420 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.420 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.420 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.420 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.420 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_behaviour": { 2023-10-18T14:14:10.421 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_behaviour", 2023-10-18T14:14:10.421 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.421 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.421 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.421 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "redirect", 2023-10-18T14:14:10.422 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.422 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.422 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.422 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.422 INFO:teuthology.orchestra.run.smithi114.stdout: "redirect" 2023-10-18T14:14:10.423 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.423 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.423 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.423 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.423 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.424 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.424 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_error_status_code": { 2023-10-18T14:14:10.424 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_error_status_code", 2023-10-18T14:14:10.424 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.424 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.425 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.425 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "500", 2023-10-18T14:14:10.425 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "400", 2023-10-18T14:14:10.425 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "599", 2023-10-18T14:14:10.425 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.425 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.426 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.426 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.426 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.426 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.426 INFO:teuthology.orchestra.run.smithi114.stdout: "url_prefix": { 2023-10-18T14:14:10.427 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "url_prefix", 2023-10-18T14:14:10.427 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.427 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.427 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.427 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.427 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.428 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.428 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.428 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.428 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.428 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.429 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.429 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.429 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.429 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.429 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.430 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "devicehealth", 2023-10-18T14:14:10.430 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.430 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.430 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.430 INFO:teuthology.orchestra.run.smithi114.stdout: "enable_monitoring": { 2023-10-18T14:14:10.431 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enable_monitoring", 2023-10-18T14:14:10.431 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.431 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.431 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.431 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.431 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.432 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.432 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.432 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "monitor device health metrics", 2023-10-18T14:14:10.432 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.432 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.433 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.433 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.433 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.433 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.433 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.433 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.434 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.434 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.434 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.434 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.434 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.435 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.435 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.435 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.435 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.435 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.436 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.436 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.436 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.436 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.436 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.437 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.437 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.437 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.437 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.437 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.437 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.438 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.438 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.438 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.438 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.438 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.439 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.439 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.439 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.439 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.439 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.440 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.440 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.440 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.440 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.440 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.441 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.441 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.441 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.441 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.441 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.442 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.442 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.442 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.442 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.442 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.443 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.443 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.443 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.443 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.443 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.443 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.444 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.444 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.444 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.444 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.444 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.445 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.445 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.445 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.445 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.445 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.446 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.446 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.446 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.446 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.446 INFO:teuthology.orchestra.run.smithi114.stdout: "mark_out_threshold": { 2023-10-18T14:14:10.447 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mark_out_threshold", 2023-10-18T14:14:10.447 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.447 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.447 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.447 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "2419200", 2023-10-18T14:14:10.448 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.448 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.448 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.448 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-18T14:14:10.448 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.448 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.449 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.449 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.449 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_name": { 2023-10-18T14:14:10.449 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pool_name", 2023-10-18T14:14:10.449 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.450 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.450 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.450 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "device_health_metrics", 2023-10-18T14:14:10.450 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.450 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.451 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.451 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-18T14:14:10.451 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.451 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.451 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.452 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.452 INFO:teuthology.orchestra.run.smithi114.stdout: "retention_period": { 2023-10-18T14:14:10.452 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "retention_period", 2023-10-18T14:14:10.452 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.452 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.453 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.453 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15552000", 2023-10-18T14:14:10.453 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.453 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.453 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.454 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long to retain device health metrics", 2023-10-18T14:14:10.454 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.454 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.454 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.454 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.455 INFO:teuthology.orchestra.run.smithi114.stdout: "scrape_frequency": { 2023-10-18T14:14:10.455 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "scrape_frequency", 2023-10-18T14:14:10.455 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.455 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.455 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.456 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "86400", 2023-10-18T14:14:10.456 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.456 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.456 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.456 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-18T14:14:10.457 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.457 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.457 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.457 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.457 INFO:teuthology.orchestra.run.smithi114.stdout: "self_heal": { 2023-10-18T14:14:10.457 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "self_heal", 2023-10-18T14:14:10.458 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.458 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.458 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.458 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.458 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.459 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.459 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.459 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-18T14:14:10.459 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.459 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.460 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.460 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.460 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:10.460 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:10.460 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.461 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.461 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.461 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:10.461 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.461 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.462 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.462 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to wake up and check device health", 2023-10-18T14:14:10.462 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.462 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.462 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.463 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.463 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_threshold": { 2023-10-18T14:14:10.463 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_threshold", 2023-10-18T14:14:10.463 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.464 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.464 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.464 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "7257600", 2023-10-18T14:14:10.464 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.464 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.465 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.465 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-18T14:14:10.465 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.465 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.465 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.466 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.466 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.466 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.466 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.466 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "diskprediction_local", 2023-10-18T14:14:10.466 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.467 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.467 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.467 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.467 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.468 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.468 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.468 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.468 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.468 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.468 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.469 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.469 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.469 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.469 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.469 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.470 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.470 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.470 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.470 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.470 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.471 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.471 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.471 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.471 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.471 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.472 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.472 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.472 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.472 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.472 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.473 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.473 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.473 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.473 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.473 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.474 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.474 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.474 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.474 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.474 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.474 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.475 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.475 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.475 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.475 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.475 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.476 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.476 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.476 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.476 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.476 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.477 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.477 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.477 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.477 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.477 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.478 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.478 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.478 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.478 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.478 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.479 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.479 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.479 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.479 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.479 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.480 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.480 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.480 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.480 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.480 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.481 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.481 INFO:teuthology.orchestra.run.smithi114.stdout: "predict_interval": { 2023-10-18T14:14:10.481 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "predict_interval", 2023-10-18T14:14:10.481 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.481 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.481 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.482 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "86400", 2023-10-18T14:14:10.482 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.482 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.482 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.482 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.483 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.483 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.483 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.483 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.483 INFO:teuthology.orchestra.run.smithi114.stdout: "predictor_model": { 2023-10-18T14:14:10.484 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "predictor_model", 2023-10-18T14:14:10.484 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.484 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.484 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.484 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "prophetstor", 2023-10-18T14:14:10.485 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.485 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.485 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.485 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.485 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.486 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.486 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.486 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.486 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:10.486 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:10.487 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.487 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.487 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.487 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2023-10-18T14:14:10.487 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.488 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.488 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.488 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.488 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.488 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.489 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.489 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.489 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.489 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.489 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.489 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "influx", 2023-10-18T14:14:10.490 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": false, 2023-10-18T14:14:10.490 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "influxdb python module not found", 2023-10-18T14:14:10.490 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.490 INFO:teuthology.orchestra.run.smithi114.stdout: "batch_size": { 2023-10-18T14:14:10.491 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "batch_size", 2023-10-18T14:14:10.491 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.491 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.491 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.491 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5000", 2023-10-18T14:14:10.492 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.492 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.492 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.492 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-18T14:14:10.492 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.492 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.493 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.493 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.493 INFO:teuthology.orchestra.run.smithi114.stdout: "database": { 2023-10-18T14:14:10.493 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "database", 2023-10-18T14:14:10.493 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.494 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.494 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.494 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "ceph", 2023-10-18T14:14:10.494 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.494 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.495 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.495 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-18T14:14:10.495 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.495 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.495 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.496 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.496 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": { 2023-10-18T14:14:10.496 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "hostname", 2023-10-18T14:14:10.496 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.496 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.496 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.497 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.497 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.497 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.497 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.497 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB server hostname", 2023-10-18T14:14:10.498 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.498 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.498 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.498 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.498 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:10.498 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:10.499 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.499 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.499 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.499 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "30", 2023-10-18T14:14:10.500 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "5", 2023-10-18T14:14:10.500 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.500 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.500 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-18T14:14:10.500 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.500 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.501 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.501 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.501 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.501 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.501 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.501 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.502 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.502 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.502 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.502 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.502 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.503 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.503 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.503 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.503 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.503 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.504 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.504 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.504 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.504 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.504 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.505 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.505 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.505 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.505 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.506 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.506 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.506 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.506 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.506 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.507 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.507 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.507 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.507 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.507 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.508 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.508 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.508 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.508 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.508 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.509 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.509 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.509 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.509 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.509 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.510 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.510 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.510 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.510 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.510 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.511 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.511 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.511 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.511 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.511 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.512 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.512 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.512 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.512 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.512 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.513 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.513 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.513 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.513 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.513 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.514 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.514 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.514 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.514 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.514 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.515 INFO:teuthology.orchestra.run.smithi114.stdout: "password": { 2023-10-18T14:14:10.515 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "password", 2023-10-18T14:14:10.515 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.515 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.516 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.516 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.516 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.516 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.516 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.517 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "password of InfluxDB server user", 2023-10-18T14:14:10.517 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.517 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.517 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.517 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.517 INFO:teuthology.orchestra.run.smithi114.stdout: "port": { 2023-10-18T14:14:10.518 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "port", 2023-10-18T14:14:10.518 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.518 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.518 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.518 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8086", 2023-10-18T14:14:10.519 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.519 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.519 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.519 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB server port", 2023-10-18T14:14:10.519 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.520 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.520 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.520 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.520 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl": { 2023-10-18T14:14:10.520 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl", 2023-10-18T14:14:10.521 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.521 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.521 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.521 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "false", 2023-10-18T14:14:10.521 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.522 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.522 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.522 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-18T14:14:10.522 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.522 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.522 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.523 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.523 INFO:teuthology.orchestra.run.smithi114.stdout: "threads": { 2023-10-18T14:14:10.523 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "threads", 2023-10-18T14:14:10.523 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.523 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.524 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.524 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2023-10-18T14:14:10.524 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2023-10-18T14:14:10.524 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "32", 2023-10-18T14:14:10.524 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.525 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-18T14:14:10.525 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.525 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.525 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.525 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.526 INFO:teuthology.orchestra.run.smithi114.stdout: "username": { 2023-10-18T14:14:10.526 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "username", 2023-10-18T14:14:10.526 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.526 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.526 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.527 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.527 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.527 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.527 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.527 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "username of InfluxDB server user", 2023-10-18T14:14:10.528 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.528 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.528 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.528 INFO:teuthology.orchestra.run.smithi114.stdout: "verify_ssl": { 2023-10-18T14:14:10.529 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "verify_ssl", 2023-10-18T14:14:10.529 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.529 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.529 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.529 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "true", 2023-10-18T14:14:10.529 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.530 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.530 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.530 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-18T14:14:10.530 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.530 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.531 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.531 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.531 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.531 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.532 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "insights", 2023-10-18T14:14:10.532 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.532 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.532 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.532 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.532 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.533 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.533 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.533 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.533 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.533 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.534 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.534 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.534 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.534 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.534 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.535 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.535 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.535 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.535 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.535 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.536 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.536 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.536 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.536 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.537 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.537 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.537 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.537 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.537 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.537 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.538 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.538 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.538 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.538 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.539 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.539 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.539 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.539 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.539 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.540 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.540 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.540 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.540 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.540 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.541 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.541 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.541 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.541 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.541 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.542 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.542 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.542 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.542 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.542 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.543 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.543 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.543 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.543 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.544 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.544 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.544 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.544 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.544 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.545 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.545 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.545 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.545 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.545 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.546 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.546 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.546 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.546 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.547 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "iostat", 2023-10-18T14:14:10.547 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.547 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.547 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.547 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.547 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.548 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.548 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.548 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.548 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.548 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.549 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.549 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.549 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.549 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.549 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.550 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.550 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.550 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.550 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.550 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.550 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.551 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.551 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.551 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.551 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.552 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.552 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.552 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.552 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.552 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.553 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.553 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.553 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.553 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.553 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.554 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.554 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.554 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.554 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.555 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.555 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.555 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.555 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.555 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.556 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.556 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.556 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.556 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.556 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.556 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.557 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.557 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.557 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.557 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.557 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.558 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.558 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.558 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.558 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.559 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.559 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.559 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.559 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.559 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.560 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.560 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.560 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.560 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.560 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.561 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.561 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.561 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.561 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "k8sevents", 2023-10-18T14:14:10.562 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.562 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.562 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.562 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_event_retention_days": { 2023-10-18T14:14:10.562 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ceph_event_retention_days", 2023-10-18T14:14:10.563 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.563 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.563 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.563 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "7", 2023-10-18T14:14:10.563 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.564 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.564 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.564 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-18T14:14:10.564 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.564 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.564 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.565 INFO:teuthology.orchestra.run.smithi114.stdout: "config_check_secs": { 2023-10-18T14:14:10.565 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "config_check_secs", 2023-10-18T14:14:10.565 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.565 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.566 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.566 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:10.566 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "10", 2023-10-18T14:14:10.566 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.566 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.567 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-18T14:14:10.567 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.567 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.567 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.568 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.568 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.568 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.568 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.568 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.569 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.569 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.569 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.569 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.569 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.570 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.570 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.570 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.570 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.570 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.571 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.571 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.571 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.571 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.571 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.572 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.572 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.572 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.572 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.572 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.573 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.573 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.573 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.573 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.573 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.574 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.574 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.574 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.574 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.575 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.575 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.575 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.575 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.575 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.576 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.576 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.576 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.576 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.576 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.577 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.577 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.577 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.577 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.577 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.577 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.578 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.578 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.578 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.578 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.579 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.579 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.579 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.579 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.579 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.580 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.580 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.580 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.580 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.581 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.581 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.581 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.581 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.581 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.582 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.582 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "localpool", 2023-10-18T14:14:10.582 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.582 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.583 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.583 INFO:teuthology.orchestra.run.smithi114.stdout: "failure_domain": { 2023-10-18T14:14:10.583 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "failure_domain", 2023-10-18T14:14:10.583 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.583 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.584 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.584 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "host", 2023-10-18T14:14:10.584 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.584 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.584 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.584 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "failure domain for any created local pool", 2023-10-18T14:14:10.585 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-18T14:14:10.585 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.585 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.585 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.586 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.586 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.586 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.586 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.586 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.587 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.587 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.587 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.587 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.587 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.588 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.588 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.588 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.588 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.588 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.589 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.589 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.589 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.589 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.590 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.590 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.590 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.590 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.590 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.591 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.591 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.591 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.591 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.591 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.592 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.592 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.592 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.592 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.592 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.593 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.593 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.593 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.593 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.593 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.594 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.594 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.594 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.594 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.594 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.595 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.595 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.595 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.595 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.595 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.596 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.596 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.596 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.596 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.597 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.597 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.597 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.597 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.597 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.597 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.598 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.598 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.598 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.598 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.598 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.599 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.599 INFO:teuthology.orchestra.run.smithi114.stdout: "min_size": { 2023-10-18T14:14:10.599 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "min_size", 2023-10-18T14:14:10.599 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.600 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.600 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.600 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.600 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.600 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.601 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.601 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default min_size for any created local pool", 2023-10-18T14:14:10.601 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-18T14:14:10.601 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.601 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.602 INFO:teuthology.orchestra.run.smithi114.stdout: "num_rep": { 2023-10-18T14:14:10.602 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "num_rep", 2023-10-18T14:14:10.602 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.602 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.603 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.603 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3", 2023-10-18T14:14:10.603 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.603 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.603 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.603 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default replica count for any created local pool", 2023-10-18T14:14:10.604 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.604 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.604 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.604 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_num": { 2023-10-18T14:14:10.605 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pg_num", 2023-10-18T14:14:10.605 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.605 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.605 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.605 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "128", 2023-10-18T14:14:10.606 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.606 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.606 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.606 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default pg_num for any created local pool", 2023-10-18T14:14:10.607 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.607 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.607 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.607 INFO:teuthology.orchestra.run.smithi114.stdout: "prefix": { 2023-10-18T14:14:10.607 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prefix", 2023-10-18T14:14:10.608 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.608 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.608 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.608 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.608 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.609 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.609 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.609 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "name prefix for any created local pool", 2023-10-18T14:14:10.609 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.609 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.610 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.610 INFO:teuthology.orchestra.run.smithi114.stdout: "subtree": { 2023-10-18T14:14:10.610 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "subtree", 2023-10-18T14:14:10.610 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.613 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.613 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.614 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "rack", 2023-10-18T14:14:10.614 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.614 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.614 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.615 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-18T14:14:10.615 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-18T14:14:10.615 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.615 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.615 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.616 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.616 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.616 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mds_autoscaler", 2023-10-18T14:14:10.616 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.616 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.617 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.617 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.617 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.617 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.617 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.618 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.618 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.618 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.618 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.618 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.619 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.619 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.619 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.619 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.619 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.620 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.620 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.620 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.620 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.620 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.620 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.621 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.621 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.621 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.621 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.622 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.622 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.622 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.622 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.622 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.623 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.623 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.623 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.623 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.623 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.624 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.624 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.624 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.624 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.624 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.625 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.625 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.625 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.625 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.625 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.626 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.626 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.626 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.626 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.626 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.627 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.627 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.627 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.627 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.627 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.628 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.628 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.628 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.628 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.628 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.628 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.629 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.629 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.629 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.629 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.629 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.630 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.630 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.630 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.630 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.630 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.631 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.631 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.631 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mirroring", 2023-10-18T14:14:10.631 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.631 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.632 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.632 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.632 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.632 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.632 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.633 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.633 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.633 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.633 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.633 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.634 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.634 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.634 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.634 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.634 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.635 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.635 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.635 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.635 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.635 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.636 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.636 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.636 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.636 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.636 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.636 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.637 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.637 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.637 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.637 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.637 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.638 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.638 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.638 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.638 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.639 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.639 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.639 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.639 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.639 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.640 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.640 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.640 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.640 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.640 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.640 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.641 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.641 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.641 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.641 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.641 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.642 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.642 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.642 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.642 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.643 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.643 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.643 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.643 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.643 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.644 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.644 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.644 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.644 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.644 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.645 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.645 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.645 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.645 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.645 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.646 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.646 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "nfs", 2023-10-18T14:14:10.646 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.646 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.646 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.647 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.647 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.647 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.647 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.647 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.648 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.648 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.648 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.648 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.648 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.649 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.649 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.649 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.649 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.649 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.650 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.650 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.650 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.650 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.650 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.651 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.651 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.651 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.651 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.651 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.652 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.652 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.652 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.652 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.652 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.652 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.653 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.653 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.653 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.653 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.654 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.654 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.654 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.654 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.654 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.655 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.655 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.655 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.655 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.655 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.656 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.656 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.656 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.656 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.656 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.656 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.657 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.657 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.657 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.657 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.658 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.658 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.658 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.658 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.658 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.659 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.659 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.659 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.659 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.659 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.659 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.660 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.660 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.660 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.661 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "orchestrator", 2023-10-18T14:14:10.661 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.661 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.661 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.661 INFO:teuthology.orchestra.run.smithi114.stdout: "fail_fs": { 2023-10-18T14:14:10.661 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "fail_fs", 2023-10-18T14:14:10.662 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.662 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.662 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.662 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.662 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.663 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.663 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.663 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-18T14:14:10.663 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.663 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.664 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.664 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.664 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.664 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.665 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.665 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.665 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.665 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.665 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.666 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.666 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.666 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.666 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.666 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.667 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.667 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.667 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.667 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.667 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.668 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.668 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.668 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.668 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.668 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.669 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.669 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.669 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.669 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.669 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.670 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.670 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.670 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.670 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.670 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.671 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.671 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.671 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.671 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.672 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.672 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.672 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.672 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.672 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.673 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.673 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.673 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.673 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.673 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.674 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.674 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.674 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.674 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.674 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.675 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.675 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.675 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.675 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.675 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.676 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.676 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.676 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.676 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.676 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.677 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.677 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.677 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.677 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.677 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.678 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator": { 2023-10-18T14:14:10.678 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "orchestrator", 2023-10-18T14:14:10.678 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.678 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.678 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.679 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.679 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.679 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.679 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.679 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm", 2023-10-18T14:14:10.680 INFO:teuthology.orchestra.run.smithi114.stdout: "rook", 2023-10-18T14:14:10.680 INFO:teuthology.orchestra.run.smithi114.stdout: "test_orchestrator" 2023-10-18T14:14:10.680 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.680 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Orchestrator backend", 2023-10-18T14:14:10.680 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.681 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.681 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.681 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.681 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.681 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.682 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "osd_perf_query", 2023-10-18T14:14:10.682 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.682 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.682 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.682 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.683 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.683 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.683 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.683 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.683 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.684 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.684 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.684 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.684 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.684 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.685 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.685 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.685 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.685 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.685 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.685 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.686 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.686 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.686 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.686 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.687 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.687 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.687 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.687 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.687 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.688 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.688 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.688 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.688 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.688 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.689 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.689 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.689 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.689 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.690 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.690 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.690 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.690 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.690 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.691 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.691 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.691 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.691 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.691 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.691 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.692 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.692 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.692 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.692 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.692 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.693 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.693 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.693 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.693 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.694 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.694 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.694 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.694 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.694 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.695 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.695 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.695 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.695 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.695 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.696 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.696 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.696 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.696 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.697 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "osd_support", 2023-10-18T14:14:10.697 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.697 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.697 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.697 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.698 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.698 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.698 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.698 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.698 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.699 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.699 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.699 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.699 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.699 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.699 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.700 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.700 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.700 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.700 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.700 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.701 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.701 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.701 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.701 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.702 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.702 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.702 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.702 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.702 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.703 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.703 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.703 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.703 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.703 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.704 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.704 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.704 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.704 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.705 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.705 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.705 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.705 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.705 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.705 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.706 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.706 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.706 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.706 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.706 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.707 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.707 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.707 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.707 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.707 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.708 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.708 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.708 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.708 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.709 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.709 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.709 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.709 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.709 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.710 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.710 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.710 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.710 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.710 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.711 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.711 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.711 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.711 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.711 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pg_autoscaler", 2023-10-18T14:14:10.712 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.712 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.712 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.712 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.712 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.712 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.713 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.713 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.713 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.713 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.713 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.714 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.714 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.714 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.714 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.714 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.715 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.715 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.715 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.715 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.715 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.716 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.716 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.716 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.716 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.716 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.716 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.717 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.717 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.717 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.717 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.717 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.717 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.718 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.718 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.718 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.718 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.719 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.719 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.719 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.719 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.719 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.719 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.720 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.720 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.720 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.720 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.720 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.721 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.721 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.721 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.721 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.721 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.722 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.722 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.722 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.722 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.723 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.723 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.723 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.723 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.723 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.724 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.724 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.724 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.724 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.724 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.724 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.725 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.725 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.725 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:10.725 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:10.726 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.726 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.726 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.726 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:10.726 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.727 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.727 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.727 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.727 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.727 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.727 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.728 INFO:teuthology.orchestra.run.smithi114.stdout: "threshold": { 2023-10-18T14:14:10.728 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "threshold", 2023-10-18T14:14:10.728 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:10.728 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.729 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.729 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3.0", 2023-10-18T14:14:10.729 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1.0", 2023-10-18T14:14:10.729 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.729 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.729 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "scaling threshold", 2023-10-18T14:14:10.730 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-18T14:14:10.730 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.730 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.730 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.731 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.731 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.731 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "progress", 2023-10-18T14:14:10.731 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.731 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.732 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.732 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_pg_recovery_event": { 2023-10-18T14:14:10.732 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_pg_recovery_event", 2023-10-18T14:14:10.732 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.732 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.733 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.733 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.733 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.733 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.733 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.734 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-18T14:14:10.734 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.734 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.734 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.735 INFO:teuthology.orchestra.run.smithi114.stdout: "enabled": { 2023-10-18T14:14:10.735 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enabled", 2023-10-18T14:14:10.735 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.735 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.735 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.736 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.736 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.736 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.736 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.736 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.736 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.737 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.737 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.737 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.737 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.738 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.738 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.738 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.738 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.738 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.739 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.739 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.739 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.739 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.739 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.739 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.740 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.740 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.740 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.740 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.740 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.741 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.741 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.741 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.741 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.741 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.741 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.742 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.742 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.742 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.742 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.742 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.743 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.743 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.743 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.743 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.743 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.744 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.744 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.744 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.745 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.745 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.745 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.745 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.745 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.746 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.746 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.746 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.746 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.746 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.747 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.747 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.747 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.747 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.747 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.748 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.748 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.748 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.748 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.748 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.749 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.749 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.749 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.749 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.749 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.750 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.750 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.750 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.750 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.750 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.751 INFO:teuthology.orchestra.run.smithi114.stdout: "max_completed_events": { 2023-10-18T14:14:10.751 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_completed_events", 2023-10-18T14:14:10.751 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.751 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.752 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.752 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "50", 2023-10-18T14:14:10.752 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.752 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.752 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.752 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "number of past completed events to remember", 2023-10-18T14:14:10.753 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.753 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.753 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.753 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2023-10-18T14:14:10.754 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2023-10-18T14:14:10.754 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.754 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.754 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.754 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2023-10-18T14:14:10.755 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.755 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.755 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.755 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long the module is going to sleep", 2023-10-18T14:14:10.755 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.756 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.756 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.756 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.756 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.756 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.757 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prometheus", 2023-10-18T14:14:10.757 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.757 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.757 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.757 INFO:teuthology.orchestra.run.smithi114.stdout: "cache": { 2023-10-18T14:14:10.757 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cache", 2023-10-18T14:14:10.758 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.758 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.758 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.758 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.758 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.759 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.759 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.759 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.759 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.759 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.760 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.760 INFO:teuthology.orchestra.run.smithi114.stdout: "exclude_perf_counters": { 2023-10-18T14:14:10.760 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "exclude_perf_counters", 2023-10-18T14:14:10.760 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.761 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.761 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.761 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.761 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.761 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.762 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.762 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-18T14:14:10.762 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-18T14:14:10.762 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.762 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.763 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.763 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.763 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.763 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.763 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.764 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.764 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.764 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.764 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.764 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.765 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.765 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.765 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.765 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.765 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.766 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.766 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.766 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.766 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.766 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.767 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.767 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.767 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.767 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.767 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.768 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.768 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.768 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.768 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.768 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.769 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.769 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.769 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.769 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.770 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.770 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.770 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.770 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.770 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.771 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.771 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.771 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.771 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.771 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.772 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.772 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.772 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.772 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.772 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.773 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.773 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.773 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.773 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.773 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.774 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.774 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.774 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.774 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.775 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.775 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.775 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.775 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.775 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.776 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.776 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.776 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.776 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.776 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_stats_pools": { 2023-10-18T14:14:10.777 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_stats_pools", 2023-10-18T14:14:10.777 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.777 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.777 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.777 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.778 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.778 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.778 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.778 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.778 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.779 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.779 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.779 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-18T14:14:10.780 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-18T14:14:10.780 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.780 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.780 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.780 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "300", 2023-10-18T14:14:10.781 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.781 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.781 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.781 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.781 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.781 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.782 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.782 INFO:teuthology.orchestra.run.smithi114.stdout: "scrape_interval": { 2023-10-18T14:14:10.782 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "scrape_interval", 2023-10-18T14:14:10.782 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:10.783 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.783 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.783 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15.0", 2023-10-18T14:14:10.783 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.783 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.784 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.784 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.784 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.784 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.784 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.785 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.785 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2023-10-18T14:14:10.785 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2023-10-18T14:14:10.785 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.785 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.786 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.786 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "::", 2023-10-18T14:14:10.786 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.786 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.786 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.787 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-18T14:14:10.787 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.787 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.787 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.788 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2023-10-18T14:14:10.788 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2023-10-18T14:14:10.788 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.788 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.788 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.789 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "9283", 2023-10-18T14:14:10.789 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.789 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.789 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.789 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-18T14:14:10.790 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.790 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.790 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.790 INFO:teuthology.orchestra.run.smithi114.stdout: "stale_cache_strategy": { 2023-10-18T14:14:10.791 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "stale_cache_strategy", 2023-10-18T14:14:10.791 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.791 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.791 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.791 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "log", 2023-10-18T14:14:10.792 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.792 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.792 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.792 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.792 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.793 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.793 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.793 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_behaviour": { 2023-10-18T14:14:10.793 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_behaviour", 2023-10-18T14:14:10.794 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.794 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.794 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.794 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "default", 2023-10-18T14:14:10.794 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.795 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.795 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.795 INFO:teuthology.orchestra.run.smithi114.stdout: "default", 2023-10-18T14:14:10.795 INFO:teuthology.orchestra.run.smithi114.stdout: "error" 2023-10-18T14:14:10.795 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.796 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.796 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.796 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.796 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.797 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_error_status_code": { 2023-10-18T14:14:10.797 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_error_status_code", 2023-10-18T14:14:10.797 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.797 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.797 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.798 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "500", 2023-10-18T14:14:10.798 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "400", 2023-10-18T14:14:10.798 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "599", 2023-10-18T14:14:10.798 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.798 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.799 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.799 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.799 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.799 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.799 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.800 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_support", 2023-10-18T14:14:10.800 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.800 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.801 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.801 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.801 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.801 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.801 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.802 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.802 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.802 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.802 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.802 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.803 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.803 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.803 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.803 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.803 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.804 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.804 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.804 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.804 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.804 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.805 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.805 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.805 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.805 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.806 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.806 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.806 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.806 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.806 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.807 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.807 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.807 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.807 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.807 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.808 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.808 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.808 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.808 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.809 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.809 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.809 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.809 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.809 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.809 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.810 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.810 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.810 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.810 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.810 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.811 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.811 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.813 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.813 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.813 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.814 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.814 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.814 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.814 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.815 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.815 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.815 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.815 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.815 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.816 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.816 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.816 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.816 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.816 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.817 INFO:teuthology.orchestra.run.smithi114.stdout: "max_concurrent_snap_create": { 2023-10-18T14:14:10.817 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_concurrent_snap_create", 2023-10-18T14:14:10.817 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.817 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.817 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.818 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2023-10-18T14:14:10.818 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.818 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.818 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.818 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.819 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.819 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.819 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.819 INFO:teuthology.orchestra.run.smithi114.stdout: "mirror_snapshot_schedule": { 2023-10-18T14:14:10.820 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mirror_snapshot_schedule", 2023-10-18T14:14:10.820 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.820 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.820 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.820 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.820 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.821 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.821 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.821 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.821 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.821 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.822 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.822 INFO:teuthology.orchestra.run.smithi114.stdout: "trash_purge_schedule": { 2023-10-18T14:14:10.822 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "trash_purge_schedule", 2023-10-18T14:14:10.822 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.823 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.823 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.823 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.823 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.823 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.824 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.824 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.824 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.824 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.824 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.825 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.825 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.825 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.825 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.825 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "restful", 2023-10-18T14:14:10.826 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.826 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.826 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.826 INFO:teuthology.orchestra.run.smithi114.stdout: "enable_auth": { 2023-10-18T14:14:10.826 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enable_auth", 2023-10-18T14:14:10.826 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.827 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.827 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.827 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.827 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.827 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.828 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.828 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.828 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.828 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.828 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.829 INFO:teuthology.orchestra.run.smithi114.stdout: "key_file": { 2023-10-18T14:14:10.829 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "key_file", 2023-10-18T14:14:10.829 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.829 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.829 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.830 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.830 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.830 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.830 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.830 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.831 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.831 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.831 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.831 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.831 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.832 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.832 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.832 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.832 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.832 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.833 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.833 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.833 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.833 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.833 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.834 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.834 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.834 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.834 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.834 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.835 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.835 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.835 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.835 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.835 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.836 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.836 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.836 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.836 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.836 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.836 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.837 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.837 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.837 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.837 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.837 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.837 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.838 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.838 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.838 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.838 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.839 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.839 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.839 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.839 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.839 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.840 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.840 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.840 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.840 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.840 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.841 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.841 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.841 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.841 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.841 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.841 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.842 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.842 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.842 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.842 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.843 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.843 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.843 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.843 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.843 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.844 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.844 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.844 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.844 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.845 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2023-10-18T14:14:10.845 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2023-10-18T14:14:10.845 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.845 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.845 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.845 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.846 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.846 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.846 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.846 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.846 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.847 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.847 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.847 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2023-10-18T14:14:10.847 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2023-10-18T14:14:10.848 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.848 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.848 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.848 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.848 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.849 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.849 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.849 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.849 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.849 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.850 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.850 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.850 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.851 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rgw", 2023-10-18T14:14:10.851 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.851 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.851 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.851 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.852 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.852 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.852 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.852 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.852 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.852 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.853 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.853 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.853 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.853 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.853 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.854 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.854 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.854 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.854 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.854 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.855 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.855 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.855 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.855 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.856 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.856 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.856 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.856 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.856 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.857 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.857 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.857 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.857 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.857 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.858 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.858 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.858 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.858 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.859 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.859 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.859 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.859 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.859 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.859 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.860 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.860 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.860 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.860 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.860 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.861 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.861 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.861 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.861 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.861 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.862 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.862 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.862 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.862 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.863 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.863 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.863 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.863 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.863 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.864 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.864 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.864 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.864 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.864 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.865 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.865 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.865 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.865 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.866 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rook", 2023-10-18T14:14:10.866 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.866 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.866 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.866 INFO:teuthology.orchestra.run.smithi114.stdout: "drive_group_interval": { 2023-10-18T14:14:10.867 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "drive_group_interval", 2023-10-18T14:14:10.867 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:10.867 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.867 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.867 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "300.0", 2023-10-18T14:14:10.867 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.868 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.868 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.868 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-18T14:14:10.868 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.868 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.869 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.869 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.869 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.869 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.869 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.870 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.870 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.870 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.870 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.870 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.870 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.871 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.871 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.871 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.871 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.871 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.872 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.872 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.872 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.872 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.872 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.873 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.873 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.873 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.873 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.874 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.874 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.874 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.874 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.874 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.875 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.875 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.875 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.875 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.875 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.876 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.876 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.876 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.876 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.876 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.877 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.877 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.877 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.877 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.877 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.878 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.878 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.878 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.878 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.879 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.879 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.879 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.879 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.879 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.879 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.880 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.880 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.880 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.880 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.880 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.881 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.881 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.881 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.881 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.881 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.881 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.882 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.882 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.882 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.882 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.882 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.883 INFO:teuthology.orchestra.run.smithi114.stdout: "storage_class": { 2023-10-18T14:14:10.883 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "storage_class", 2023-10-18T14:14:10.883 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.883 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.883 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.884 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "local", 2023-10-18T14:14:10.884 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.884 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.884 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.884 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-18T14:14:10.885 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.885 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.885 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.885 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.885 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.886 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.886 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.886 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "selftest", 2023-10-18T14:14:10.886 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.886 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.887 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.887 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.887 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.887 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.887 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.888 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.888 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.888 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.888 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.888 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.889 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.889 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.889 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.889 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.889 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.890 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.890 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.890 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.890 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.890 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.891 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.891 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.891 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.891 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.891 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.892 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.892 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.892 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.892 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.892 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.893 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.893 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.893 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.893 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.893 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.894 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.894 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.894 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.894 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.894 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.895 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.895 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.895 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.895 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.895 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.896 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.896 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.896 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.896 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.896 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.896 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.897 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.897 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.897 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.897 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.897 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.898 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.898 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.898 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.898 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.898 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.899 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.899 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.899 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.899 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.899 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.900 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.900 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.900 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.900 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.900 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.900 INFO:teuthology.orchestra.run.smithi114.stdout: "roption1": { 2023-10-18T14:14:10.901 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "roption1", 2023-10-18T14:14:10.901 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.901 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.901 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.901 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.902 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.902 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.902 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.902 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.902 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.903 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.903 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.903 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.903 INFO:teuthology.orchestra.run.smithi114.stdout: "roption2": { 2023-10-18T14:14:10.903 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "roption2", 2023-10-18T14:14:10.904 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.904 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.904 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.904 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "xyz", 2023-10-18T14:14:10.904 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.905 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.905 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.905 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.905 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.905 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.905 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.906 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.906 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption1": { 2023-10-18T14:14:10.906 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption1", 2023-10-18T14:14:10.906 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.906 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.907 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.907 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.907 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.907 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.907 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.908 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.908 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.908 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.908 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.908 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.909 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption2": { 2023-10-18T14:14:10.909 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption2", 2023-10-18T14:14:10.909 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.909 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.909 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.910 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.910 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.910 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.910 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.910 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.911 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.911 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.911 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.911 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.911 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption3": { 2023-10-18T14:14:10.912 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption3", 2023-10-18T14:14:10.912 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2023-10-18T14:14:10.912 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.912 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.912 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.912 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.913 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.913 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.913 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.913 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.913 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.914 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.914 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.914 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption4": { 2023-10-18T14:14:10.914 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption4", 2023-10-18T14:14:10.914 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.915 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.915 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.915 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.915 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.915 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.916 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.916 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.916 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.916 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.916 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.917 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.917 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption5": { 2023-10-18T14:14:10.917 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption5", 2023-10-18T14:14:10.917 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.917 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.917 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.918 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.918 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.918 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.918 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.918 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.919 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.919 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.919 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.919 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.919 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption6": { 2023-10-18T14:14:10.920 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption6", 2023-10-18T14:14:10.920 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.920 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.920 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.920 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:10.921 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.921 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.921 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.921 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.921 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.921 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.922 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.922 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.922 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption7": { 2023-10-18T14:14:10.922 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption7", 2023-10-18T14:14:10.922 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:10.923 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.923 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.923 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.923 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2023-10-18T14:14:10.923 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "42", 2023-10-18T14:14:10.924 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.924 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.924 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.924 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.924 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.925 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.925 INFO:teuthology.orchestra.run.smithi114.stdout: "testkey": { 2023-10-18T14:14:10.925 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testkey", 2023-10-18T14:14:10.925 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.925 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.926 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.926 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.926 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.926 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.926 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.926 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.927 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.927 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.927 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.927 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.927 INFO:teuthology.orchestra.run.smithi114.stdout: "testlkey": { 2023-10-18T14:14:10.928 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testlkey", 2023-10-18T14:14:10.928 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.928 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.928 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.928 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.929 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.929 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.929 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.929 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.929 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.930 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.930 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.930 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.930 INFO:teuthology.orchestra.run.smithi114.stdout: "testnewline": { 2023-10-18T14:14:10.930 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testnewline", 2023-10-18T14:14:10.931 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.931 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.931 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.931 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.931 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.932 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.932 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.932 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.932 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.932 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.933 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.933 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.933 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.933 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.933 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.934 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snap_schedule", 2023-10-18T14:14:10.934 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.934 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.934 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.934 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_m_granularity": { 2023-10-18T14:14:10.935 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_m_granularity", 2023-10-18T14:14:10.935 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.935 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.935 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.935 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.936 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.936 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.936 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.936 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow minute scheduled snapshots", 2023-10-18T14:14:10.936 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.937 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.937 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.937 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.937 INFO:teuthology.orchestra.run.smithi114.stdout: "dump_on_update": { 2023-10-18T14:14:10.937 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "dump_on_update", 2023-10-18T14:14:10.938 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.938 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.938 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.938 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.938 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.938 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.939 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.939 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "dump database to debug log on update", 2023-10-18T14:14:10.939 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.939 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.939 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.940 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.940 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.940 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.940 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.940 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.940 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.941 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.941 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.941 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.941 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.941 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.942 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.942 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.942 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.942 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.942 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.942 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.943 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.943 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.943 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.943 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.943 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.944 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.944 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.944 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.944 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.944 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.945 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.945 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.945 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.945 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.945 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.945 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.946 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.946 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.946 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.946 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.946 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.947 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.947 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.947 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.947 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.947 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.947 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.948 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.948 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.948 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.948 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.948 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.949 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.949 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.949 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.949 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.949 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.949 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.950 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.950 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.950 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.950 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.950 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.951 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.951 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.951 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.951 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.951 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.952 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.952 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.952 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.952 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.952 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.953 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.953 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.953 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.953 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.953 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "stats", 2023-10-18T14:14:10.953 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.954 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.954 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.954 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.954 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.954 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.955 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.955 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.955 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.955 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.955 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.956 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.956 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.956 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.956 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.956 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.957 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.957 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.957 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.957 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.957 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.957 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.958 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.958 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.958 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.958 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.959 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.959 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.959 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.959 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.959 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.960 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.960 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.960 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.960 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.960 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.961 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.961 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.961 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.961 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.961 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.962 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.962 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.962 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.962 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.963 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.963 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.963 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.963 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.963 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.963 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.964 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.964 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.964 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.964 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.964 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.965 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.965 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.965 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.965 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.965 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.966 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.966 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.966 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.966 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.966 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.967 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.967 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.967 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.967 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.967 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.968 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.968 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.968 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.968 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.968 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "status", 2023-10-18T14:14:10.968 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.969 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.969 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.969 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.969 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.969 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.970 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.970 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.970 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.970 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.970 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.971 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.971 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.971 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.971 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.971 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.972 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.972 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.972 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.972 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.972 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.973 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.973 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.973 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.973 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.973 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.974 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.974 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.974 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.974 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.974 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.975 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.975 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.975 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.975 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.975 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.976 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.976 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.976 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.976 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.976 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.976 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.977 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.977 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.977 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.977 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.977 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.978 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.978 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.978 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.978 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.978 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.979 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.979 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.979 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.979 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.979 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.980 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.980 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.980 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:10.980 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:10.980 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.980 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.981 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.981 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.981 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.981 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.981 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.982 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.982 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.982 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.982 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.982 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.983 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:10.983 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.983 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:10.983 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "telegraf", 2023-10-18T14:14:10.983 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:10.984 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:10.984 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:10.984 INFO:teuthology.orchestra.run.smithi114.stdout: "address": { 2023-10-18T14:14:10.984 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "address", 2023-10-18T14:14:10.984 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.985 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.985 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.985 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-18T14:14:10.985 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.985 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.986 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.986 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.986 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.986 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.986 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.986 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.987 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:10.987 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:10.987 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:10.987 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.987 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:10.988 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15", 2023-10-18T14:14:10.988 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.988 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.988 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.988 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.988 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.989 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.989 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.989 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:10.989 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:10.990 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.990 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.990 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.990 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:10.990 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.991 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.991 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.991 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.991 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.991 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.992 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.992 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.992 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.992 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.992 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.993 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.993 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.993 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.993 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:10.994 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:10.994 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:10.994 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.994 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.994 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:10.995 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.995 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.995 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:10.995 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.995 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:10.996 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:10.996 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:10.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:10.996 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:10.996 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:10.996 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:10.997 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:10.997 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:10.997 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:10.997 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:10.997 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:10.998 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:10.998 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:10.998 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:10.998 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:10.998 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:10.999 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:10.999 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:10.999 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:10.999 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:10.999 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.000 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.000 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.000 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:11.000 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:11.001 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.001 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.001 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.001 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.001 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.002 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.002 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.002 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.002 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.002 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.003 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.003 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.003 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.003 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.004 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "telemetry", 2023-10-18T14:14:11.004 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:11.004 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:11.004 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:11.004 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_basic": { 2023-10-18T14:14:11.005 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_basic", 2023-10-18T14:14:11.005 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.005 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.005 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.005 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:11.005 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.006 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.006 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.006 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-18T14:14:11.006 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.006 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.007 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.007 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_crash": { 2023-10-18T14:14:11.007 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_crash", 2023-10-18T14:14:11.007 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.008 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.008 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.008 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:11.008 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.008 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.009 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.009 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-18T14:14:11.009 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.009 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.009 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.010 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_device": { 2023-10-18T14:14:11.010 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_device", 2023-10-18T14:14:11.010 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.010 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.010 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.011 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2023-10-18T14:14:11.011 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.011 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.011 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.011 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-18T14:14:11.011 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.012 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.012 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.012 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_ident": { 2023-10-18T14:14:11.012 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_ident", 2023-10-18T14:14:11.013 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.013 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.013 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.013 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.013 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.014 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.014 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.014 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-18T14:14:11.014 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.014 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.015 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.015 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_perf": { 2023-10-18T14:14:11.015 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_perf", 2023-10-18T14:14:11.015 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.016 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.016 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.016 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.016 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.016 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.016 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.017 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-18T14:14:11.017 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.017 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.017 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.017 INFO:teuthology.orchestra.run.smithi114.stdout: "contact": { 2023-10-18T14:14:11.018 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "contact", 2023-10-18T14:14:11.018 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.018 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.018 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.018 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:11.019 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.019 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.019 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.019 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.021 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.021 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.021 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.021 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.021 INFO:teuthology.orchestra.run.smithi114.stdout: "description": { 2023-10-18T14:14:11.022 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "description", 2023-10-18T14:14:11.022 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.022 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.022 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.022 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:11.022 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.023 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.023 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.023 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.023 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.024 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.024 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.024 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.024 INFO:teuthology.orchestra.run.smithi114.stdout: "device_url": { 2023-10-18T14:14:11.024 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_url", 2023-10-18T14:14:11.025 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.025 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.025 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.025 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-18T14:14:11.025 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.026 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.026 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.026 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.026 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.026 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.027 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.027 INFO:teuthology.orchestra.run.smithi114.stdout: "enabled": { 2023-10-18T14:14:11.027 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enabled", 2023-10-18T14:14:11.027 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.027 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.028 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.028 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.028 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.028 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.028 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.029 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.029 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.029 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.029 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.029 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:11.030 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:11.030 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:11.030 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.030 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.030 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "24", 2023-10-18T14:14:11.031 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "8", 2023-10-18T14:14:11.031 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.031 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.031 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.031 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.032 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.032 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.032 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.032 INFO:teuthology.orchestra.run.smithi114.stdout: "last_opt_revision": { 2023-10-18T14:14:11.032 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "last_opt_revision", 2023-10-18T14:14:11.032 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:11.033 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.033 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.033 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1", 2023-10-18T14:14:11.033 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.033 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.034 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.034 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.034 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.034 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.034 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.035 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.035 INFO:teuthology.orchestra.run.smithi114.stdout: "leaderboard": { 2023-10-18T14:14:11.035 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "leaderboard", 2023-10-18T14:14:11.035 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.035 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.036 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.036 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.036 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.036 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.036 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.037 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.037 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.037 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.037 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.038 INFO:teuthology.orchestra.run.smithi114.stdout: "leaderboard_description": { 2023-10-18T14:14:11.038 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "leaderboard_description", 2023-10-18T14:14:11.038 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.038 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.038 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.039 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:11.039 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.039 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.039 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.039 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.040 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.040 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.040 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.040 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:11.040 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:11.041 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.041 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.041 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.041 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:11.041 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.042 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.042 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:11.042 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:11.042 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:11.042 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:11.043 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:11.043 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:11.043 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:11.043 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:11.043 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.044 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.044 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.044 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.044 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.044 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:11.045 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:11.045 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.045 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.045 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.045 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.045 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.046 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.046 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.046 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.046 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.046 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.047 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.047 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:11.047 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:11.047 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.048 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.048 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.048 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:11.048 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.048 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.048 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:11.049 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:11.049 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:11.049 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:11.049 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:11.049 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:11.050 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:11.050 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:11.050 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.050 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.050 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.051 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.051 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:11.051 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:11.051 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.052 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.052 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.052 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.052 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.052 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.052 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.053 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.053 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.053 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.053 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.054 INFO:teuthology.orchestra.run.smithi114.stdout: "organization": { 2023-10-18T14:14:11.054 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "organization", 2023-10-18T14:14:11.054 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.054 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.054 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.055 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:11.055 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.055 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.055 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.055 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.056 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.056 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.056 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.056 INFO:teuthology.orchestra.run.smithi114.stdout: "proxy": { 2023-10-18T14:14:11.056 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "proxy", 2023-10-18T14:14:11.057 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.057 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.057 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.057 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:11.057 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.057 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.058 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.058 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.058 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.058 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.058 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.059 INFO:teuthology.orchestra.run.smithi114.stdout: "url": { 2023-10-18T14:14:11.059 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "url", 2023-10-18T14:14:11.059 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.059 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.059 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.060 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-18T14:14:11.060 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.060 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.060 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.060 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.061 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.061 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.061 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.061 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.061 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.062 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "test_orchestrator", 2023-10-18T14:14:11.062 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:11.062 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:11.062 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:11.063 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:11.063 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:11.063 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.063 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.063 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.064 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:11.064 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.064 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.064 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:11.064 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:11.065 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:11.065 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:11.065 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:11.065 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:11.065 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:11.066 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:11.066 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.066 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.066 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.066 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.067 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:11.067 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:11.067 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.067 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.067 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.068 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.068 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.068 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.068 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.068 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.069 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.069 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.069 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.069 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:11.069 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:11.070 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.070 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.070 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.070 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:11.070 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.071 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.071 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:11.071 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:11.071 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:11.071 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:11.072 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:11.072 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:11.072 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:11.072 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:11.072 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.073 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.073 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.073 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.073 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:11.074 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:11.074 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.074 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.074 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.074 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.075 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.075 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.075 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.075 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.075 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.076 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.076 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.076 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.076 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.076 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.077 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "volumes", 2023-10-18T14:14:11.077 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:11.077 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:11.077 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:11.077 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:11.078 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:11.078 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.078 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.078 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.078 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:11.079 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.079 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.079 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:11.079 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:11.079 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:11.080 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:11.080 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:11.080 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:11.080 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:11.080 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:11.080 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.081 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.081 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.081 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.081 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:11.082 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:11.082 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.082 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.082 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.082 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.083 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.083 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.083 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.083 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.083 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.084 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.084 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.084 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:11.084 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:11.085 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.085 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.085 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.085 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:11.085 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.085 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.086 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:11.086 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:11.086 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:11.086 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:11.086 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:11.087 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:11.087 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:11.087 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:11.087 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.087 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.088 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.088 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.088 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:11.088 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:11.088 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.089 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.089 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.089 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.089 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.089 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.090 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.090 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.090 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.090 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.090 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.091 INFO:teuthology.orchestra.run.smithi114.stdout: "max_concurrent_clones": { 2023-10-18T14:14:11.091 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_concurrent_clones", 2023-10-18T14:14:11.091 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:11.091 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.092 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.092 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "4", 2023-10-18T14:14:11.092 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.092 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.092 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.093 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-18T14:14:11.093 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.093 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.093 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.093 INFO:teuthology.orchestra.run.smithi114.stdout: "periodic_async_work": { 2023-10-18T14:14:11.094 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "periodic_async_work", 2023-10-18T14:14:11.094 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.094 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.094 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.094 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.095 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.095 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.095 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.095 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Periodically check for async work", 2023-10-18T14:14:11.095 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.096 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.096 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.096 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot_clone_delay": { 2023-10-18T14:14:11.096 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snapshot_clone_delay", 2023-10-18T14:14:11.096 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:11.097 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.097 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.097 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2023-10-18T14:14:11.097 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.097 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.098 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.098 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-18T14:14:11.098 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.098 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.098 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.099 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.099 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.099 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.099 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix", 2023-10-18T14:14:11.100 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2023-10-18T14:14:11.100 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2023-10-18T14:14:11.100 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2023-10-18T14:14:11.100 INFO:teuthology.orchestra.run.smithi114.stdout: "discovery_interval": { 2023-10-18T14:14:11.100 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "discovery_interval", 2023-10-18T14:14:11.101 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2023-10-18T14:14:11.101 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.101 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.101 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "100", 2023-10-18T14:14:11.101 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.101 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.102 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.102 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.102 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.102 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.102 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.103 INFO:teuthology.orchestra.run.smithi114.stdout: "identifier": { 2023-10-18T14:14:11.103 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "identifier", 2023-10-18T14:14:11.103 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.103 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.104 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.104 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:11.104 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.104 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.104 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.105 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.105 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.105 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.105 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.106 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2023-10-18T14:14:11.106 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2023-10-18T14:14:11.106 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2023-10-18T14:14:11.106 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.106 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.107 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2023-10-18T14:14:11.107 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.107 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.107 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.107 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.107 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.108 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.108 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.108 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2023-10-18T14:14:11.108 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2023-10-18T14:14:11.109 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.109 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.109 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.109 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:11.109 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.110 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.110 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:11.110 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:11.110 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:11.110 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:11.111 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:11.111 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:11.111 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:11.111 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:11.111 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.111 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.112 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.112 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.112 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2023-10-18T14:14:11.112 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2023-10-18T14:14:11.113 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.113 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.113 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.113 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.113 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.114 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.114 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.114 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.114 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.114 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.115 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.115 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2023-10-18T14:14:11.115 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2023-10-18T14:14:11.116 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.116 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.116 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.116 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2023-10-18T14:14:11.116 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.116 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.117 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2023-10-18T14:14:11.117 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2023-10-18T14:14:11.117 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2023-10-18T14:14:11.117 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2023-10-18T14:14:11.117 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2023-10-18T14:14:11.117 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2023-10-18T14:14:11.118 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2023-10-18T14:14:11.118 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:11.118 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.118 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.118 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.119 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.119 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2023-10-18T14:14:11.119 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2023-10-18T14:14:11.119 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2023-10-18T14:14:11.120 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.120 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2023-10-18T14:14:11.120 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2023-10-18T14:14:11.120 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.120 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.120 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.121 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.121 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.121 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.121 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.121 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_host": { 2023-10-18T14:14:11.122 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_host", 2023-10-18T14:14:11.122 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.122 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.122 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.122 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2023-10-18T14:14:11.123 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.123 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.123 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.124 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.124 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.124 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.125 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.125 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_port": { 2023-10-18T14:14:11.125 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_port", 2023-10-18T14:14:11.126 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2023-10-18T14:14:11.126 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.126 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.126 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10051", 2023-10-18T14:14:11.127 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.127 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.127 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.128 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.128 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.128 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.129 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.129 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_sender": { 2023-10-18T14:14:11.129 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_sender", 2023-10-18T14:14:11.129 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2023-10-18T14:14:11.130 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2023-10-18T14:14:11.130 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2023-10-18T14:14:11.130 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-18T14:14:11.131 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2023-10-18T14:14:11.131 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2023-10-18T14:14:11.131 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2023-10-18T14:14:11.131 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2023-10-18T14:14:11.132 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2023-10-18T14:14:11.132 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2023-10-18T14:14:11.132 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2023-10-18T14:14:11.132 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.133 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.133 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.133 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:11.133 INFO:teuthology.orchestra.run.smithi114.stdout: "services": { 2023-10-18T14:14:11.134 INFO:teuthology.orchestra.run.smithi114.stdout: "dashboard": "https://172.21.15.114:8443/" 2023-10-18T14:14:11.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.134 INFO:teuthology.orchestra.run.smithi114.stdout: "always_on_modules": { 2023-10-18T14:14:11.135 INFO:teuthology.orchestra.run.smithi114.stdout: "octopus": [ 2023-10-18T14:14:11.135 INFO:teuthology.orchestra.run.smithi114.stdout: "balancer", 2023-10-18T14:14:11.135 INFO:teuthology.orchestra.run.smithi114.stdout: "crash", 2023-10-18T14:14:11.135 INFO:teuthology.orchestra.run.smithi114.stdout: "devicehealth", 2023-10-18T14:14:11.136 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator", 2023-10-18T14:14:11.136 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_autoscaler", 2023-10-18T14:14:11.136 INFO:teuthology.orchestra.run.smithi114.stdout: "progress", 2023-10-18T14:14:11.137 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_support", 2023-10-18T14:14:11.137 INFO:teuthology.orchestra.run.smithi114.stdout: "status", 2023-10-18T14:14:11.137 INFO:teuthology.orchestra.run.smithi114.stdout: "telemetry", 2023-10-18T14:14:11.138 INFO:teuthology.orchestra.run.smithi114.stdout: "volumes" 2023-10-18T14:14:11.138 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:11.138 INFO:teuthology.orchestra.run.smithi114.stdout: "pacific": [ 2023-10-18T14:14:11.138 INFO:teuthology.orchestra.run.smithi114.stdout: "balancer", 2023-10-18T14:14:11.139 INFO:teuthology.orchestra.run.smithi114.stdout: "crash", 2023-10-18T14:14:11.139 INFO:teuthology.orchestra.run.smithi114.stdout: "devicehealth", 2023-10-18T14:14:11.139 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator", 2023-10-18T14:14:11.140 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_autoscaler", 2023-10-18T14:14:11.140 INFO:teuthology.orchestra.run.smithi114.stdout: "progress", 2023-10-18T14:14:11.140 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_support", 2023-10-18T14:14:11.141 INFO:teuthology.orchestra.run.smithi114.stdout: "status", 2023-10-18T14:14:11.141 INFO:teuthology.orchestra.run.smithi114.stdout: "telemetry", 2023-10-18T14:14:11.141 INFO:teuthology.orchestra.run.smithi114.stdout: "volumes" 2023-10-18T14:14:11.141 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:11.142 INFO:teuthology.orchestra.run.smithi114.stdout: "quincy": [ 2023-10-18T14:14:11.142 INFO:teuthology.orchestra.run.smithi114.stdout: "balancer", 2023-10-18T14:14:11.142 INFO:teuthology.orchestra.run.smithi114.stdout: "crash", 2023-10-18T14:14:11.143 INFO:teuthology.orchestra.run.smithi114.stdout: "devicehealth", 2023-10-18T14:14:11.143 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator", 2023-10-18T14:14:11.143 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_autoscaler", 2023-10-18T14:14:11.144 INFO:teuthology.orchestra.run.smithi114.stdout: "progress", 2023-10-18T14:14:11.144 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_support", 2023-10-18T14:14:11.144 INFO:teuthology.orchestra.run.smithi114.stdout: "status", 2023-10-18T14:14:11.144 INFO:teuthology.orchestra.run.smithi114.stdout: "telemetry", 2023-10-18T14:14:11.145 INFO:teuthology.orchestra.run.smithi114.stdout: "volumes" 2023-10-18T14:14:11.145 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2023-10-18T14:14:11.145 INFO:teuthology.orchestra.run.smithi114.stdout: "reef": [ 2023-10-18T14:14:11.145 INFO:teuthology.orchestra.run.smithi114.stdout: "balancer", 2023-10-18T14:14:11.146 INFO:teuthology.orchestra.run.smithi114.stdout: "crash", 2023-10-18T14:14:11.146 INFO:teuthology.orchestra.run.smithi114.stdout: "devicehealth", 2023-10-18T14:14:11.146 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator", 2023-10-18T14:14:11.146 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_autoscaler", 2023-10-18T14:14:11.147 INFO:teuthology.orchestra.run.smithi114.stdout: "progress", 2023-10-18T14:14:11.147 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_support", 2023-10-18T14:14:11.147 INFO:teuthology.orchestra.run.smithi114.stdout: "status", 2023-10-18T14:14:11.147 INFO:teuthology.orchestra.run.smithi114.stdout: "telemetry", 2023-10-18T14:14:11.147 INFO:teuthology.orchestra.run.smithi114.stdout: "volumes" 2023-10-18T14:14:11.148 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-10-18T14:14:11.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.148 INFO:teuthology.orchestra.run.smithi114.stdout: "last_failure_osd_epoch": 5, 2023-10-18T14:14:11.148 INFO:teuthology.orchestra.run.smithi114.stdout: "active_clients": [ 2023-10-18T14:14:11.148 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.149 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "devicehealth", 2023-10-18T14:14:11.149 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2023-10-18T14:14:11.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.149 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2023-10-18T14:14:11.149 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.114:0", 2023-10-18T14:14:11.149 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 673836612 2023-10-18T14:14:11.150 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.150 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-10-18T14:14:11.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.150 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "libcephsqlite", 2023-10-18T14:14:11.151 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2023-10-18T14:14:11.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.151 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2023-10-18T14:14:11.151 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.114:0", 2023-10-18T14:14:11.151 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 3171085199 2023-10-18T14:14:11.152 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.152 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-10-18T14:14:11.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.152 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_support", 2023-10-18T14:14:11.153 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2023-10-18T14:14:11.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.153 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2023-10-18T14:14:11.153 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.114:0", 2023-10-18T14:14:11.153 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 3780641963 2023-10-18T14:14:11.153 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.154 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-10-18T14:14:11.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.154 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snap_schedule", 2023-10-18T14:14:11.155 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2023-10-18T14:14:11.155 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.155 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2023-10-18T14:14:11.155 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.114:0", 2023-10-18T14:14:11.155 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2616816392 2023-10-18T14:14:11.155 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.156 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-10-18T14:14:11.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.156 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snap_schedule", 2023-10-18T14:14:11.156 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2023-10-18T14:14:11.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.157 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2023-10-18T14:14:11.157 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.114:0", 2023-10-18T14:14:11.157 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2693086930 2023-10-18T14:14:11.157 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.157 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-10-18T14:14:11.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:11.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.158 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "volumes", 2023-10-18T14:14:11.158 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2023-10-18T14:14:11.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T14:14:11.159 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2023-10-18T14:14:11.159 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.114:0", 2023-10-18T14:14:11.159 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 3534981371 2023-10-18T14:14:11.159 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.159 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-10-18T14:14:11.159 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:11.160 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-10-18T14:14:11.160 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:14:11.162 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:07 smithi172 ceph-mon[103574]: osdmap e93: 12 total, 12 up, 12 in 2023-10-18T14:14:11.162 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:07 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3020076734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:14:11.163 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:08 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/825754168' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-18T14:14:11.163 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:08 smithi172 ceph-mon[103574]: pgmap v591: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 63 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2023-10-18T14:14:11.163 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:07 smithi158 ceph-mon[103317]: osdmap e93: 12 total, 12 up, 12 in 2023-10-18T14:14:11.163 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:07 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3020076734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:14:11.164 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:08 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/825754168' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-18T14:14:11.164 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:08 smithi158 ceph-mon[103317]: pgmap v591: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 63 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2023-10-18T14:14:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.627+0000 7fb05a700700 1 -- 172.21.15.114:0/825754168 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb0400a1740 msgr2=0x7fb0400a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:11.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.627+0000 7fb05a700700 1 --2- 172.21.15.114:0/825754168 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb0400a1740 0x7fb0400a3c00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb05407e970 tx=0x7fb03c00f040 comp rx=0 tx=0).stop 2023-10-18T14:14:11.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.627+0000 7fb05a700700 1 -- 172.21.15.114:0/825754168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb054107a60 msgr2=0x7fb0540831a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:11.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.627+0000 7fb05a700700 1 --2- 172.21.15.114:0/825754168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb054107a60 0x7fb0540831a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb044009fd0 tx=0x7fb044013980 comp rx=0 tx=0).stop 2023-10-18T14:14:11.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.628+0000 7fb05a700700 1 -- 172.21.15.114:0/825754168 shutdown_connections 2023-10-18T14:14:11.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.628+0000 7fb05a700700 1 --2- 172.21.15.114:0/825754168 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb0400a1740 0x7fb0400a3c00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:11.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.628+0000 7fb05a700700 1 --2- 172.21.15.114:0/825754168 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb05407d780 0x7fb05407dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:11.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.628+0000 7fb05a700700 1 --2- 172.21.15.114:0/825754168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb054107a60 0x7fb0540831a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:11.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.628+0000 7fb05a700700 1 --2- 172.21.15.114:0/825754168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb05410c020 0x7fb05407d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:11.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.628+0000 7fb05a700700 1 -- 172.21.15.114:0/825754168 >> 172.21.15.114:0/825754168 conn(0x7fb05406b7d0 msgr2=0x7fb0540707e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:11.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.628+0000 7fb05a700700 1 -- 172.21.15.114:0/825754168 shutdown_connections 2023-10-18T14:14:11.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:07.628+0000 7fb05a700700 1 -- 172.21.15.114:0/825754168 wait complete. 2023-10-18T14:14:11.173 DEBUG:tasks.check_counter:Getting stats from a 2023-10-18T14:14:11.174 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-18T14:14:11.175 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:07 smithi114 ceph-mon[99494]: osdmap e93: 12 total, 12 up, 12 in 2023-10-18T14:14:11.175 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:07 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3020076734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:14:11.175 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:08 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/825754168' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-18T14:14:11.175 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:08 smithi114 ceph-mon[99494]: pgmap v591: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 63 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2023-10-18T14:14:11.176 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:10 smithi114 ceph-mon[99494]: pgmap v592: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 40 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2023-10-18T14:14:11.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:10 smithi158 ceph-mon[103317]: pgmap v592: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 40 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2023-10-18T14:14:11.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:10 smithi172 ceph-mon[103574]: pgmap v592: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 40 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2023-10-18T14:14:11.739 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:14:12.936 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:14:12.937 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-0": { 2023-10-18T14:14:12.937 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 1047888, 2023-10-18T14:14:12.937 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 1048070, 2023-10-18T14:14:12.937 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 174059967, 2023-10-18T14:14:12.938 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 173161669, 2023-10-18T14:14:12.938 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 10, 2023-10-18T14:14:12.938 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 5, 2023-10-18T14:14:12.938 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 30.133122822, 2023-10-18T14:14:12.939 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 12.580868645, 2023-10-18T14:14:12.939 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 20.713006963, 2023-10-18T14:14:12.939 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.022537305, 2023-10-18T14:14:12.939 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:12.939 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 1048069, 2023-10-18T14:14:12.940 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 11.501298015, 2023-10-18T14:14:12.940 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000010973 2023-10-18T14:14:12.940 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.940 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:12.940 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 1943665, 2023-10-18T14:14:12.941 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.241286604, 2023-10-18T14:14:12.941 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000124 2023-10-18T14:14:12.941 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.941 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 982016, 2023-10-18T14:14:12.941 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 223168 2023-10-18T14:14:12.942 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.942 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-1": { 2023-10-18T14:14:12.942 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 3918, 2023-10-18T14:14:12.942 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 7409, 2023-10-18T14:14:12.942 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 1253404, 2023-10-18T14:14:12.943 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 4340044, 2023-10-18T14:14:12.943 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 14, 2023-10-18T14:14:12.943 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 7, 2023-10-18T14:14:12.943 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.292807123, 2023-10-18T14:14:12.943 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.149208462, 2023-10-18T14:14:12.944 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.155044709, 2023-10-18T14:14:12.944 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.009760392, 2023-10-18T14:14:12.944 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:12.944 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 7407, 2023-10-18T14:14:12.944 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.203290042, 2023-10-18T14:14:12.945 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000027445 2023-10-18T14:14:12.945 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.945 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:12.945 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 8821, 2023-10-18T14:14:12.946 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.001494562, 2023-10-18T14:14:12.946 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000169 2023-10-18T14:14:12.946 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.946 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-18T14:14:12.946 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 332464 2023-10-18T14:14:12.947 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.947 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-2": { 2023-10-18T14:14:12.947 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 1282, 2023-10-18T14:14:12.947 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 1714, 2023-10-18T14:14:12.947 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 462329, 2023-10-18T14:14:12.947 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 3671400, 2023-10-18T14:14:12.948 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 17, 2023-10-18T14:14:12.948 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 8, 2023-10-18T14:14:12.948 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.085181379, 2023-10-18T14:14:12.948 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.033348278, 2023-10-18T14:14:12.948 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.039378651, 2023-10-18T14:14:12.948 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.013339270, 2023-10-18T14:14:12.949 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:12.949 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 1713, 2023-10-18T14:14:12.949 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.111598008, 2023-10-18T14:14:12.949 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000065147 2023-10-18T14:14:12.949 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.950 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:12.950 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 1767, 2023-10-18T14:14:12.950 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000250904, 2023-10-18T14:14:12.950 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000141 2023-10-18T14:14:12.950 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.951 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-18T14:14:12.951 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 448 2023-10-18T14:14:12.951 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.951 INFO:teuthology.orchestra.run.smithi114.stdout: "cct": { 2023-10-18T14:14:12.951 INFO:teuthology.orchestra.run.smithi114.stdout: "total_workers": 1, 2023-10-18T14:14:12.951 INFO:teuthology.orchestra.run.smithi114.stdout: "unhealthy_workers": 0 2023-10-18T14:14:12.952 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.952 INFO:teuthology.orchestra.run.smithi114.stdout: "finisher-MDSRank": { 2023-10-18T14:14:12.952 INFO:teuthology.orchestra.run.smithi114.stdout: "queue_len": 0, 2023-10-18T14:14:12.952 INFO:teuthology.orchestra.run.smithi114.stdout: "complete_latency": { 2023-10-18T14:14:12.952 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 727, 2023-10-18T14:14:12.953 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 1.171579781, 2023-10-18T14:14:12.953 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.001611526 2023-10-18T14:14:12.953 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:12.953 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.953 INFO:teuthology.orchestra.run.smithi114.stdout: "finisher-PurgeQueue": { 2023-10-18T14:14:12.953 INFO:teuthology.orchestra.run.smithi114.stdout: "queue_len": 0, 2023-10-18T14:14:12.954 INFO:teuthology.orchestra.run.smithi114.stdout: "complete_latency": { 2023-10-18T14:14:12.954 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 1677, 2023-10-18T14:14:12.954 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.158545681, 2023-10-18T14:14:12.954 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000094541 2023-10-18T14:14:12.954 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:12.955 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.955 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": { 2023-10-18T14:14:12.955 INFO:teuthology.orchestra.run.smithi114.stdout: "request": 1954, 2023-10-18T14:14:12.955 INFO:teuthology.orchestra.run.smithi114.stdout: "reply": 1919, 2023-10-18T14:14:12.955 INFO:teuthology.orchestra.run.smithi114.stdout: "reply_latency": { 2023-10-18T14:14:12.955 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 1919, 2023-10-18T14:14:12.956 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 2.453638877, 2023-10-18T14:14:12.956 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.001278602 2023-10-18T14:14:12.956 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.956 INFO:teuthology.orchestra.run.smithi114.stdout: "slow_reply": 0, 2023-10-18T14:14:12.956 INFO:teuthology.orchestra.run.smithi114.stdout: "forward": 35, 2023-10-18T14:14:12.957 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_fetch_complete": 1, 2023-10-18T14:14:12.957 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_fetch_keys": 0, 2023-10-18T14:14:12.957 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_commit": 11, 2023-10-18T14:14:12.957 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_split": 0, 2023-10-18T14:14:12.957 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_merge": 0, 2023-10-18T14:14:12.957 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes": 1496, 2023-10-18T14:14:12.958 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_top": 2, 2023-10-18T14:14:12.958 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_bottom": 4, 2023-10-18T14:14:12.958 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_pin_tail": 1490, 2023-10-18T14:14:12.958 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_pinned": 1492, 2023-10-18T14:14:12.958 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_expired": 1281, 2023-10-18T14:14:12.959 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_with_caps": 2, 2023-10-18T14:14:12.959 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": 2, 2023-10-18T14:14:12.959 INFO:teuthology.orchestra.run.smithi114.stdout: "subtrees": 4, 2023-10-18T14:14:12.959 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse": 3194, 2023-10-18T14:14:12.959 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_hit": 3055, 2023-10-18T14:14:12.959 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_forward": 33, 2023-10-18T14:14:12.960 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_discover": 46, 2023-10-18T14:14:12.960 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_dir_fetch": 0, 2023-10-18T14:14:12.960 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_remote_ino": 0, 2023-10-18T14:14:12.960 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_lock": 0, 2023-10-18T14:14:12.960 INFO:teuthology.orchestra.run.smithi114.stdout: "load_cent": 0, 2023-10-18T14:14:12.961 INFO:teuthology.orchestra.run.smithi114.stdout: "q": 0, 2023-10-18T14:14:12.961 INFO:teuthology.orchestra.run.smithi114.stdout: "exported": 32, 2023-10-18T14:14:12.961 INFO:teuthology.orchestra.run.smithi114.stdout: "exported_inodes": 1191, 2023-10-18T14:14:12.961 INFO:teuthology.orchestra.run.smithi114.stdout: "imported": 55, 2023-10-18T14:14:12.961 INFO:teuthology.orchestra.run.smithi114.stdout: "imported_inodes": 1865, 2023-10-18T14:14:12.961 INFO:teuthology.orchestra.run.smithi114.stdout: "openino_dir_fetch": 0, 2023-10-18T14:14:12.962 INFO:teuthology.orchestra.run.smithi114.stdout: "openino_backtrace_fetch": 421, 2023-10-18T14:14:12.962 INFO:teuthology.orchestra.run.smithi114.stdout: "openino_peer_discover": 0, 2023-10-18T14:14:12.962 INFO:teuthology.orchestra.run.smithi114.stdout: "root_rfiles": 3565, 2023-10-18T14:14:12.962 INFO:teuthology.orchestra.run.smithi114.stdout: "root_rbytes": 51270625, 2023-10-18T14:14:12.962 INFO:teuthology.orchestra.run.smithi114.stdout: "root_rsnaps": 4, 2023-10-18T14:14:12.963 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_backtrace_fetch": 421, 2023-10-18T14:14:12.963 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_set_tag": 0, 2023-10-18T14:14:12.963 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_backtrace_repaired": 0, 2023-10-18T14:14:12.963 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_inotable_repaired": 0, 2023-10-18T14:14:12.964 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_dir_inodes": 1, 2023-10-18T14:14:12.964 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_dir_base_inodes": 0, 2023-10-18T14:14:12.964 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_dirfrag_rstats": 1, 2023-10-18T14:14:12.964 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_file_inodes": 420, 2023-10-18T14:14:12.964 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_inode_file_caps": 22, 2023-10-18T14:14:12.964 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_revoke": 144, 2023-10-18T14:14:12.965 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_grant": 1057, 2023-10-18T14:14:12.965 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_trunc": 0, 2023-10-18T14:14:12.965 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-18T14:14:12.965 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-18T14:14:12.965 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_caps": 690, 2023-10-18T14:14:12.966 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_caps_dirty": 545, 2023-10-18T14:14:12.966 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_cap_release": 22, 2023-10-18T14:14:12.966 INFO:teuthology.orchestra.run.smithi114.stdout: "process_request_cap_release": 1770 2023-10-18T14:14:12.966 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.966 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_cache": { 2023-10-18T14:14:12.967 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_update": 250, 2023-10-18T14:14:12.967 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_update_receipt": 495, 2023-10-18T14:14:12.967 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_try_discover": 263, 2023-10-18T14:14:12.967 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_send_discover": 445, 2023-10-18T14:14:12.967 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_handle_discover": 452, 2023-10-18T14:14:12.967 INFO:teuthology.orchestra.run.smithi114.stdout: "num_strays": 50, 2023-10-18T14:14:12.968 INFO:teuthology.orchestra.run.smithi114.stdout: "num_strays_delayed": 0, 2023-10-18T14:14:12.968 INFO:teuthology.orchestra.run.smithi114.stdout: "num_strays_enqueuing": 0, 2023-10-18T14:14:12.968 INFO:teuthology.orchestra.run.smithi114.stdout: "strays_created": 952, 2023-10-18T14:14:12.968 INFO:teuthology.orchestra.run.smithi114.stdout: "strays_enqueued": 902, 2023-10-18T14:14:12.968 INFO:teuthology.orchestra.run.smithi114.stdout: "strays_reintegrated": 0, 2023-10-18T14:14:12.968 INFO:teuthology.orchestra.run.smithi114.stdout: "strays_migrated": 0, 2023-10-18T14:14:12.969 INFO:teuthology.orchestra.run.smithi114.stdout: "num_recovering_processing": 0, 2023-10-18T14:14:12.969 INFO:teuthology.orchestra.run.smithi114.stdout: "num_recovering_enqueued": 0, 2023-10-18T14:14:12.969 INFO:teuthology.orchestra.run.smithi114.stdout: "num_recovering_prioritized": 0, 2023-10-18T14:14:12.969 INFO:teuthology.orchestra.run.smithi114.stdout: "recovery_started": 0, 2023-10-18T14:14:12.969 INFO:teuthology.orchestra.run.smithi114.stdout: "recovery_completed": 0, 2023-10-18T14:14:12.970 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_enqueue_scrub": 0, 2023-10-18T14:14:12.970 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_exportdir": 32, 2023-10-18T14:14:12.970 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_flush": 0, 2023-10-18T14:14:12.970 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_fragmentdir": 0, 2023-10-18T14:14:12.970 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_fragstats": 0, 2023-10-18T14:14:12.971 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_inodestats": 0 2023-10-18T14:14:12.971 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.971 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_log": { 2023-10-18T14:14:12.971 INFO:teuthology.orchestra.run.smithi114.stdout: "evlrg": 0, 2023-10-18T14:14:12.971 INFO:teuthology.orchestra.run.smithi114.stdout: "evadd": 2994, 2023-10-18T14:14:12.972 INFO:teuthology.orchestra.run.smithi114.stdout: "evex": 0, 2023-10-18T14:14:12.972 INFO:teuthology.orchestra.run.smithi114.stdout: "evtrm": 0, 2023-10-18T14:14:12.972 INFO:teuthology.orchestra.run.smithi114.stdout: "ev": 2994, 2023-10-18T14:14:12.972 INFO:teuthology.orchestra.run.smithi114.stdout: "evexg": 0, 2023-10-18T14:14:12.972 INFO:teuthology.orchestra.run.smithi114.stdout: "evexd": 0, 2023-10-18T14:14:12.972 INFO:teuthology.orchestra.run.smithi114.stdout: "segadd": 5, 2023-10-18T14:14:12.973 INFO:teuthology.orchestra.run.smithi114.stdout: "segex": 0, 2023-10-18T14:14:12.973 INFO:teuthology.orchestra.run.smithi114.stdout: "segtrm": 0, 2023-10-18T14:14:12.973 INFO:teuthology.orchestra.run.smithi114.stdout: "seg": 5, 2023-10-18T14:14:12.973 INFO:teuthology.orchestra.run.smithi114.stdout: "segmjr": 2, 2023-10-18T14:14:12.973 INFO:teuthology.orchestra.run.smithi114.stdout: "segexg": 0, 2023-10-18T14:14:12.974 INFO:teuthology.orchestra.run.smithi114.stdout: "segexd": 0, 2023-10-18T14:14:12.974 INFO:teuthology.orchestra.run.smithi114.stdout: "expos": 4194304, 2023-10-18T14:14:12.974 INFO:teuthology.orchestra.run.smithi114.stdout: "wrpos": 11389972, 2023-10-18T14:14:12.974 INFO:teuthology.orchestra.run.smithi114.stdout: "rdpos": 0, 2023-10-18T14:14:12.975 INFO:teuthology.orchestra.run.smithi114.stdout: "jlat": { 2023-10-18T14:14:12.975 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 214, 2023-10-18T14:14:12.975 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 1.202115103, 2023-10-18T14:14:12.975 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.005617360 2023-10-18T14:14:12.975 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.976 INFO:teuthology.orchestra.run.smithi114.stdout: "replayed": 0 2023-10-18T14:14:12.976 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.976 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_mem": { 2023-10-18T14:14:12.976 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 810, 2023-10-18T14:14:12.976 INFO:teuthology.orchestra.run.smithi114.stdout: "ino+": 2336, 2023-10-18T14:14:12.977 INFO:teuthology.orchestra.run.smithi114.stdout: "ino-": 1526, 2023-10-18T14:14:12.977 INFO:teuthology.orchestra.run.smithi114.stdout: "dir": 78, 2023-10-18T14:14:12.977 INFO:teuthology.orchestra.run.smithi114.stdout: "dir+": 336, 2023-10-18T14:14:12.977 INFO:teuthology.orchestra.run.smithi114.stdout: "dir-": 258, 2023-10-18T14:14:12.977 INFO:teuthology.orchestra.run.smithi114.stdout: "dn": 1496, 2023-10-18T14:14:12.978 INFO:teuthology.orchestra.run.smithi114.stdout: "dn+": 3866, 2023-10-18T14:14:12.978 INFO:teuthology.orchestra.run.smithi114.stdout: "dn-": 2370, 2023-10-18T14:14:12.978 INFO:teuthology.orchestra.run.smithi114.stdout: "cap": 2, 2023-10-18T14:14:12.978 INFO:teuthology.orchestra.run.smithi114.stdout: "cap+": 1525, 2023-10-18T14:14:12.978 INFO:teuthology.orchestra.run.smithi114.stdout: "cap-": 1523, 2023-10-18T14:14:12.979 INFO:teuthology.orchestra.run.smithi114.stdout: "rss": 69260, 2023-10-18T14:14:12.979 INFO:teuthology.orchestra.run.smithi114.stdout: "heap": 198960 2023-10-18T14:14:12.979 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.979 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_server": { 2023-10-18T14:14:12.979 INFO:teuthology.orchestra.run.smithi114.stdout: "dispatch_client_request": 2262, 2023-10-18T14:14:12.980 INFO:teuthology.orchestra.run.smithi114.stdout: "dispatch_server_request": 35, 2023-10-18T14:14:12.980 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_request": 1954, 2023-10-18T14:14:12.980 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_session": 9, 2023-10-18T14:14:12.980 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_peer_request": 96, 2023-10-18T14:14:12.980 INFO:teuthology.orchestra.run.smithi114.stdout: "req_create_latency": { 2023-10-18T14:14:12.981 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.981 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.981 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.981 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.981 INFO:teuthology.orchestra.run.smithi114.stdout: "req_getattr_latency": { 2023-10-18T14:14:12.981 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 4, 2023-10-18T14:14:12.982 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.004683945, 2023-10-18T14:14:12.982 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.001170986 2023-10-18T14:14:12.982 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.982 INFO:teuthology.orchestra.run.smithi114.stdout: "req_getfilelock_latency": { 2023-10-18T14:14:12.982 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.983 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.983 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.983 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.983 INFO:teuthology.orchestra.run.smithi114.stdout: "req_link_latency": { 2023-10-18T14:14:12.983 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.984 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.984 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.984 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.984 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookup_latency": { 2023-10-18T14:14:12.984 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 888, 2023-10-18T14:14:12.984 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.353871964, 2023-10-18T14:14:12.985 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000398504 2023-10-18T14:14:12.985 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.985 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookuphash_latency": { 2023-10-18T14:14:12.985 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.985 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.986 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.986 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.986 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookupino_latency": { 2023-10-18T14:14:12.986 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 1, 2023-10-18T14:14:12.986 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000126428, 2023-10-18T14:14:12.987 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000126428 2023-10-18T14:14:12.987 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.987 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookupname_latency": { 2023-10-18T14:14:12.987 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.987 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.988 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.988 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.988 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookupparent_latency": { 2023-10-18T14:14:12.988 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.988 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.988 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.989 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.989 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookupsnap_latency": { 2023-10-18T14:14:12.989 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.989 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.989 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.990 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.990 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lssnap_latency": { 2023-10-18T14:14:12.990 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.990 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.990 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.991 INFO:teuthology.orchestra.run.smithi114.stdout: "req_mkdir_latency": { 2023-10-18T14:14:12.991 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.991 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.991 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.991 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.992 INFO:teuthology.orchestra.run.smithi114.stdout: "req_mknod_latency": { 2023-10-18T14:14:12.992 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.992 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.992 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.992 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.993 INFO:teuthology.orchestra.run.smithi114.stdout: "req_mksnap_latency": { 2023-10-18T14:14:12.993 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.993 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.993 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.993 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.993 INFO:teuthology.orchestra.run.smithi114.stdout: "req_open_latency": { 2023-10-18T14:14:12.994 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.994 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.994 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.994 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.995 INFO:teuthology.orchestra.run.smithi114.stdout: "req_readdir_latency": { 2023-10-18T14:14:12.995 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 74, 2023-10-18T14:14:12.995 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.060522602, 2023-10-18T14:14:12.995 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000817873 2023-10-18T14:14:12.995 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.996 INFO:teuthology.orchestra.run.smithi114.stdout: "req_rename_latency": { 2023-10-18T14:14:12.996 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.996 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.996 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.996 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.997 INFO:teuthology.orchestra.run.smithi114.stdout: "req_renamesnap_latency": { 2023-10-18T14:14:12.997 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.997 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.997 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.998 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.998 INFO:teuthology.orchestra.run.smithi114.stdout: "req_snapdiff_latency": { 2023-10-18T14:14:12.998 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:12.998 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:12.998 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:12.999 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:12.999 INFO:teuthology.orchestra.run.smithi114.stdout: "req_rmdir_latency": { 2023-10-18T14:14:12.999 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 50, 2023-10-18T14:14:12.999 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.841639925, 2023-10-18T14:14:12.999 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.016832798 2023-10-18T14:14:13.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.000 INFO:teuthology.orchestra.run.smithi114.stdout: "req_rmsnap_latency": { 2023-10-18T14:14:13.000 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.000 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.001 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.001 INFO:teuthology.orchestra.run.smithi114.stdout: "req_rmxattr_latency": { 2023-10-18T14:14:13.001 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.002 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.002 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.002 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setattr_latency": { 2023-10-18T14:14:13.003 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.003 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.003 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.004 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setdirlayout_latency": { 2023-10-18T14:14:13.004 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.004 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.004 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.005 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setfilelock_latency": { 2023-10-18T14:14:13.005 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.005 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.005 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.006 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setlayout_latency": { 2023-10-18T14:14:13.006 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.006 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.006 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.007 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setxattr_latency": { 2023-10-18T14:14:13.007 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.007 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.007 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.008 INFO:teuthology.orchestra.run.smithi114.stdout: "req_symlink_latency": { 2023-10-18T14:14:13.008 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.008 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.008 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.009 INFO:teuthology.orchestra.run.smithi114.stdout: "req_unlink_latency": { 2023-10-18T14:14:13.009 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 902, 2023-10-18T14:14:13.009 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 1.192794013, 2023-10-18T14:14:13.009 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.001322388 2023-10-18T14:14:13.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.010 INFO:teuthology.orchestra.run.smithi114.stdout: "cap_revoke_eviction": 0, 2023-10-18T14:14:13.010 INFO:teuthology.orchestra.run.smithi114.stdout: "cap_acquisition_throttle": 0, 2023-10-18T14:14:13.010 INFO:teuthology.orchestra.run.smithi114.stdout: "req_getvxattr_latency": { 2023-10-18T14:14:13.010 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.010 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.011 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.011 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:13.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.011 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_sessions": { 2023-10-18T14:14:13.011 INFO:teuthology.orchestra.run.smithi114.stdout: "session_count": 1, 2023-10-18T14:14:13.012 INFO:teuthology.orchestra.run.smithi114.stdout: "session_add": 1, 2023-10-18T14:14:13.012 INFO:teuthology.orchestra.run.smithi114.stdout: "session_remove": 0, 2023-10-18T14:14:13.012 INFO:teuthology.orchestra.run.smithi114.stdout: "sessions_open": 1, 2023-10-18T14:14:13.012 INFO:teuthology.orchestra.run.smithi114.stdout: "sessions_stale": 0, 2023-10-18T14:14:13.012 INFO:teuthology.orchestra.run.smithi114.stdout: "total_load": 1824, 2023-10-18T14:14:13.013 INFO:teuthology.orchestra.run.smithi114.stdout: "average_load": 1824, 2023-10-18T14:14:13.013 INFO:teuthology.orchestra.run.smithi114.stdout: "avg_session_uptime": 613, 2023-10-18T14:14:13.013 INFO:teuthology.orchestra.run.smithi114.stdout: "mdthresh_evicted": 0 2023-10-18T14:14:13.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.013 INFO:teuthology.orchestra.run.smithi114.stdout: "mempool": { 2023-10-18T14:14:13.014 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_bytes": 0, 2023-10-18T14:14:13.014 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_items": 0, 2023-10-18T14:14:13.014 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_bytes": 0, 2023-10-18T14:14:13.014 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_items": 0, 2023-10-18T14:14:13.014 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_bytes": 0, 2023-10-18T14:14:13.015 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_items": 0, 2023-10-18T14:14:13.015 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-18T14:14:13.015 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_items": 0, 2023-10-18T14:14:13.015 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-18T14:14:13.015 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_items": 0, 2023-10-18T14:14:13.016 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_bytes": 0, 2023-10-18T14:14:13.016 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_items": 0, 2023-10-18T14:14:13.016 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-18T14:14:13.016 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_items": 0, 2023-10-18T14:14:13.016 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_bytes": 0, 2023-10-18T14:14:13.017 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_items": 0, 2023-10-18T14:14:13.017 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_bytes": 0, 2023-10-18T14:14:13.017 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_items": 0, 2023-10-18T14:14:13.017 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-18T14:14:13.017 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_items": 0, 2023-10-18T14:14:13.018 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-18T14:14:13.018 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_items": 0, 2023-10-18T14:14:13.018 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_bytes": 0, 2023-10-18T14:14:13.018 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_items": 0, 2023-10-18T14:14:13.018 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_bytes": 0, 2023-10-18T14:14:13.018 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_items": 0, 2023-10-18T14:14:13.019 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-18T14:14:13.019 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_items": 0, 2023-10-18T14:14:13.019 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_bytes": 0, 2023-10-18T14:14:13.019 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_items": 0, 2023-10-18T14:14:13.019 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_bytes": 0, 2023-10-18T14:14:13.020 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_items": 0, 2023-10-18T14:14:13.020 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_bytes": 0, 2023-10-18T14:14:13.020 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_items": 0, 2023-10-18T14:14:13.020 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_bytes": 0, 2023-10-18T14:14:13.020 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_items": 0, 2023-10-18T14:14:13.021 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_bytes": 726123, 2023-10-18T14:14:13.021 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_items": 1010, 2023-10-18T14:14:13.021 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_bytes": 0, 2023-10-18T14:14:13.021 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_items": 0, 2023-10-18T14:14:13.021 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_bytes": 0, 2023-10-18T14:14:13.022 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_items": 0, 2023-10-18T14:14:13.022 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_bytes": 0, 2023-10-18T14:14:13.022 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_items": 0, 2023-10-18T14:14:13.022 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_bytes": 0, 2023-10-18T14:14:13.022 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_items": 0, 2023-10-18T14:14:13.023 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_bytes": 7992, 2023-10-18T14:14:13.023 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_items": 167, 2023-10-18T14:14:13.023 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_bytes": 0, 2023-10-18T14:14:13.023 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_items": 0, 2023-10-18T14:14:13.023 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_bytes": 0, 2023-10-18T14:14:13.024 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_items": 0, 2023-10-18T14:14:13.024 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_bytes": 3077440, 2023-10-18T14:14:13.024 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_items": 41340, 2023-10-18T14:14:13.024 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_bytes": 0, 2023-10-18T14:14:13.025 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_items": 0, 2023-10-18T14:14:13.025 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_bytes": 0, 2023-10-18T14:14:13.025 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_items": 0 2023-10-18T14:14:13.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.025 INFO:teuthology.orchestra.run.smithi114.stdout: "objecter": { 2023-10-18T14:14:13.026 INFO:teuthology.orchestra.run.smithi114.stdout: "op_active": 0, 2023-10-18T14:14:13.026 INFO:teuthology.orchestra.run.smithi114.stdout: "op_laggy": 0, 2023-10-18T14:14:13.026 INFO:teuthology.orchestra.run.smithi114.stdout: "op_send": 1653, 2023-10-18T14:14:13.026 INFO:teuthology.orchestra.run.smithi114.stdout: "op_send_bytes": 7329396, 2023-10-18T14:14:13.026 INFO:teuthology.orchestra.run.smithi114.stdout: "op_resend": 33, 2023-10-18T14:14:13.027 INFO:teuthology.orchestra.run.smithi114.stdout: "op_reply": 1653, 2023-10-18T14:14:13.027 INFO:teuthology.orchestra.run.smithi114.stdout: "op_latency": { 2023-10-18T14:14:13.027 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 1653, 2023-10-18T14:14:13.027 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 4.813901230, 2023-10-18T14:14:13.027 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.002912220 2023-10-18T14:14:13.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.028 INFO:teuthology.orchestra.run.smithi114.stdout: "op_inflight": 0, 2023-10-18T14:14:13.028 INFO:teuthology.orchestra.run.smithi114.stdout: "oplen_avg": { 2023-10-18T14:14:13.028 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 1653, 2023-10-18T14:14:13.028 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 1692 2023-10-18T14:14:13.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.029 INFO:teuthology.orchestra.run.smithi114.stdout: "op": 1653, 2023-10-18T14:14:13.029 INFO:teuthology.orchestra.run.smithi114.stdout: "op_r": 444, 2023-10-18T14:14:13.029 INFO:teuthology.orchestra.run.smithi114.stdout: "op_w": 1209, 2023-10-18T14:14:13.029 INFO:teuthology.orchestra.run.smithi114.stdout: "op_rmw": 0, 2023-10-18T14:14:13.030 INFO:teuthology.orchestra.run.smithi114.stdout: "op_pg": 0, 2023-10-18T14:14:13.030 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_stat": 0, 2023-10-18T14:14:13.030 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_create": 10, 2023-10-18T14:14:13.030 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_read": 21, 2023-10-18T14:14:13.030 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_write": 235, 2023-10-18T14:14:13.030 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_writefull": 22, 2023-10-18T14:14:13.031 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_writesame": 0, 2023-10-18T14:14:13.031 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_append": 0, 2023-10-18T14:14:13.031 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_zero": 0, 2023-10-18T14:14:13.031 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_truncate": 0, 2023-10-18T14:14:13.032 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_delete": 917, 2023-10-18T14:14:13.032 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_mapext": 0, 2023-10-18T14:14:13.032 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_sparse_read": 0, 2023-10-18T14:14:13.032 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_clonerange": 0, 2023-10-18T14:14:13.032 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_getxattr": 422, 2023-10-18T14:14:13.032 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_setxattr": 20, 2023-10-18T14:14:13.033 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_cmpxattr": 0, 2023-10-18T14:14:13.033 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_rmxattr": 0, 2023-10-18T14:14:13.033 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_resetxattrs": 0, 2023-10-18T14:14:13.033 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_call": 0, 2023-10-18T14:14:13.033 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_watch": 0, 2023-10-18T14:14:13.033 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_notify": 0, 2023-10-18T14:14:13.034 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_src_cmpxattr": 0, 2023-10-18T14:14:13.034 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_pgls": 0, 2023-10-18T14:14:13.034 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_pgls_filter": 0, 2023-10-18T14:14:13.034 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_other": 0, 2023-10-18T14:14:13.034 INFO:teuthology.orchestra.run.smithi114.stdout: "linger_active": 0, 2023-10-18T14:14:13.035 INFO:teuthology.orchestra.run.smithi114.stdout: "linger_send": 0, 2023-10-18T14:14:13.035 INFO:teuthology.orchestra.run.smithi114.stdout: "linger_resend": 0, 2023-10-18T14:14:13.035 INFO:teuthology.orchestra.run.smithi114.stdout: "linger_ping": 0, 2023-10-18T14:14:13.035 INFO:teuthology.orchestra.run.smithi114.stdout: "poolop_active": 0, 2023-10-18T14:14:13.035 INFO:teuthology.orchestra.run.smithi114.stdout: "poolop_send": 0, 2023-10-18T14:14:13.036 INFO:teuthology.orchestra.run.smithi114.stdout: "poolop_resend": 0, 2023-10-18T14:14:13.036 INFO:teuthology.orchestra.run.smithi114.stdout: "poolstat_active": 0, 2023-10-18T14:14:13.036 INFO:teuthology.orchestra.run.smithi114.stdout: "poolstat_send": 0, 2023-10-18T14:14:13.036 INFO:teuthology.orchestra.run.smithi114.stdout: "poolstat_resend": 0, 2023-10-18T14:14:13.036 INFO:teuthology.orchestra.run.smithi114.stdout: "statfs_active": 0, 2023-10-18T14:14:13.036 INFO:teuthology.orchestra.run.smithi114.stdout: "statfs_send": 0, 2023-10-18T14:14:13.037 INFO:teuthology.orchestra.run.smithi114.stdout: "statfs_resend": 0, 2023-10-18T14:14:13.037 INFO:teuthology.orchestra.run.smithi114.stdout: "command_active": 0, 2023-10-18T14:14:13.037 INFO:teuthology.orchestra.run.smithi114.stdout: "command_send": 0, 2023-10-18T14:14:13.037 INFO:teuthology.orchestra.run.smithi114.stdout: "command_resend": 0, 2023-10-18T14:14:13.037 INFO:teuthology.orchestra.run.smithi114.stdout: "map_epoch": 93, 2023-10-18T14:14:13.038 INFO:teuthology.orchestra.run.smithi114.stdout: "map_full": 0, 2023-10-18T14:14:13.038 INFO:teuthology.orchestra.run.smithi114.stdout: "map_inc": 10, 2023-10-18T14:14:13.038 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_sessions": 12, 2023-10-18T14:14:13.038 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_session_open": 12, 2023-10-18T14:14:13.038 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_session_close": 0, 2023-10-18T14:14:13.039 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_laggy": 0, 2023-10-18T14:14:13.039 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_wr": 33, 2023-10-18T14:14:13.039 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_rd": 3, 2023-10-18T14:14:13.039 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_del": 9 2023-10-18T14:14:13.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.040 INFO:teuthology.orchestra.run.smithi114.stdout: "oft": { 2023-10-18T14:14:13.040 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_total_objs": 1, 2023-10-18T14:14:13.040 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_total_kv_pairs": 0, 2023-10-18T14:14:13.040 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_total_updates": 0, 2023-10-18T14:14:13.040 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_total_removes": 0 2023-10-18T14:14:13.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.041 INFO:teuthology.orchestra.run.smithi114.stdout: "osd-slow-ops": { 2023-10-18T14:14:13.041 INFO:teuthology.orchestra.run.smithi114.stdout: "slow_ops_count": 0 2023-10-18T14:14:13.041 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.041 INFO:teuthology.orchestra.run.smithi114.stdout: "purge_queue": { 2023-10-18T14:14:13.042 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executing_ops": 0, 2023-10-18T14:14:13.042 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executing_ops_high_water": 6, 2023-10-18T14:14:13.042 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executing": 0, 2023-10-18T14:14:13.042 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executing_high_water": 6, 2023-10-18T14:14:13.042 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executed": 902, 2023-10-18T14:14:13.043 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_item_in_journal": 0 2023-10-18T14:14:13.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.043 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-18T14:14:13.043 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2023-10-18T14:14:13.043 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 104857600, 2023-10-18T14:14:13.043 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2023-10-18T14:14:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 1053084, 2023-10-18T14:14:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 80981218, 2023-10-18T14:14:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 1053084, 2023-10-18T14:14:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2023-10-18T14:14:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2023-10-18T14:14:13.045 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 1053084, 2023-10-18T14:14:13.045 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 80981218, 2023-10-18T14:14:13.045 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2023-10-18T14:14:13.045 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.045 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.046 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.046 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:13.046 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.046 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-objecter_bytes": { 2023-10-18T14:14:13.046 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2023-10-18T14:14:13.047 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 104857600, 2023-10-18T14:14:13.047 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2023-10-18T14:14:13.047 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 0, 2023-10-18T14:14:13.047 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 0, 2023-10-18T14:14:13.047 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:13.048 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:13.048 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 1653, 2023-10-18T14:14:13.048 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 7442102, 2023-10-18T14:14:13.048 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 1653, 2023-10-18T14:14:13.048 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 7442102, 2023-10-18T14:14:13.049 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2023-10-18T14:14:13.049 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.049 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.049 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.049 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:13.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.050 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-objecter_ops": { 2023-10-18T14:14:13.050 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2023-10-18T14:14:13.050 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 1024, 2023-10-18T14:14:13.050 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2023-10-18T14:14:13.051 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 0, 2023-10-18T14:14:13.051 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 0, 2023-10-18T14:14:13.051 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:13.051 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:13.051 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 1653, 2023-10-18T14:14:13.052 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 1653, 2023-10-18T14:14:13.052 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 1653, 2023-10-18T14:14:13.052 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 1653, 2023-10-18T14:14:13.052 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2023-10-18T14:14:13.052 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.053 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.053 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.053 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:13.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.053 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-write_buf_throttle": { 2023-10-18T14:14:13.053 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2023-10-18T14:14:13.054 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 3758096384, 2023-10-18T14:14:13.054 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2023-10-18T14:14:13.054 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 902, 2023-10-18T14:14:13.054 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 112750, 2023-10-18T14:14:13.054 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:13.055 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 902, 2023-10-18T14:14:13.055 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2023-10-18T14:14:13.055 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2023-10-18T14:14:13.055 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 21, 2023-10-18T14:14:13.055 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 112750, 2023-10-18T14:14:13.056 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2023-10-18T14:14:13.056 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.056 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.056 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.056 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:13.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:13.057 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-write_buf_throttle-0x56037fa186e0": { 2023-10-18T14:14:13.057 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2023-10-18T14:14:13.057 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 3758096384, 2023-10-18T14:14:13.057 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2023-10-18T14:14:13.058 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 2994, 2023-10-18T14:14:13.058 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 7195668, 2023-10-18T14:14:13.058 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:13.058 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 2994, 2023-10-18T14:14:13.058 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2023-10-18T14:14:13.058 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2023-10-18T14:14:13.059 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 214, 2023-10-18T14:14:13.059 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 7195668, 2023-10-18T14:14:13.059 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2023-10-18T14:14:13.059 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:13.059 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:13.059 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:13.060 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:13.060 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:13.060 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:14:13.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:12 smithi114 ceph-mon[99494]: pgmap v593: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 34 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2023-10-18T14:14:13.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:12 smithi158 ceph-mon[103317]: pgmap v593: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 34 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2023-10-18T14:14:13.288 INFO:tasks.check_counter:Daemon mds.a mds.exported=32 2023-10-18T14:14:13.288 INFO:tasks.check_counter:Daemon mds.a mds.imported=55 2023-10-18T14:14:13.289 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=250 2023-10-18T14:14:13.289 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=495 2023-10-18T14:14:13.289 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=4 2023-10-18T14:14:13.289 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2023-10-18T14:14:13.290 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2023-10-18T14:14:13.290 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2023-10-18T14:14:13.290 DEBUG:tasks.check_counter:Getting stats from d 2023-10-18T14:14:13.290 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-18T14:14:13.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:12 smithi172 ceph-mon[103574]: pgmap v593: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 34 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2023-10-18T14:14:13.850 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:14:14.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:14 smithi158 ceph-mon[103317]: pgmap v594: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 29 op/s 2023-10-18T14:14:14.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:14 smithi172 ceph-mon[103574]: pgmap v594: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 29 op/s 2023-10-18T14:14:14.823 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:14 smithi114 ceph-mon[99494]: pgmap v594: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 29 op/s 2023-10-18T14:14:15.025 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:14:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-0": { 2023-10-18T14:14:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 0, 2023-10-18T14:14:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 2, 2023-10-18T14:14:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 0, 2023-10-18T14:14:15.026 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 0, 2023-10-18T14:14:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 4, 2023-10-18T14:14:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 0, 2023-10-18T14:14:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.001356107, 2023-10-18T14:14:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.000000000, 2023-10-18T14:14:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.000390904, 2023-10-18T14:14:15.027 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-18T14:14:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:15.028 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:15.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:15.030 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-18T14:14:15.030 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 0 2023-10-18T14:14:15.030 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:15.030 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-1": { 2023-10-18T14:14:15.030 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 201, 2023-10-18T14:14:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 196, 2023-10-18T14:14:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 739856, 2023-10-18T14:14:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 117280, 2023-10-18T14:14:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 2, 2023-10-18T14:14:15.031 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 1, 2023-10-18T14:14:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.031343213, 2023-10-18T14:14:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.011842536, 2023-10-18T14:14:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.016975344, 2023-10-18T14:14:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.004501901, 2023-10-18T14:14:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:15.032 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 195, 2023-10-18T14:14:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.009357196, 2023-10-18T14:14:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000047985 2023-10-18T14:14:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:15.033 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 739856, 2023-10-18T14:14:15.034 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 117280 2023-10-18T14:14:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-2": { 2023-10-18T14:14:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 5, 2023-10-18T14:14:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 151, 2023-10-18T14:14:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 3152, 2023-10-18T14:14:15.035 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 103200, 2023-10-18T14:14:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 3, 2023-10-18T14:14:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 2, 2023-10-18T14:14:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.011622723, 2023-10-18T14:14:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.008464025, 2023-10-18T14:14:15.036 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.001719918, 2023-10-18T14:14:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-18T14:14:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 150, 2023-10-18T14:14:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.008022254, 2023-10-18T14:14:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000053481 2023-10-18T14:14:15.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:15.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-18T14:14:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 103200 2023-10-18T14:14:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:15.039 INFO:teuthology.orchestra.run.smithi114.stdout: "cct": { 2023-10-18T14:14:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: "total_workers": 0, 2023-10-18T14:14:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: "unhealthy_workers": 0 2023-10-18T14:14:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: "mempool": { 2023-10-18T14:14:15.040 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_bytes": 0, 2023-10-18T14:14:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_items": 0, 2023-10-18T14:14:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_bytes": 0, 2023-10-18T14:14:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_items": 0, 2023-10-18T14:14:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_bytes": 0, 2023-10-18T14:14:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_items": 0, 2023-10-18T14:14:15.041 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-18T14:14:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_items": 0, 2023-10-18T14:14:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-18T14:14:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_items": 0, 2023-10-18T14:14:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_bytes": 0, 2023-10-18T14:14:15.042 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_items": 0, 2023-10-18T14:14:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-18T14:14:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_items": 0, 2023-10-18T14:14:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_bytes": 0, 2023-10-18T14:14:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_items": 0, 2023-10-18T14:14:15.043 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_bytes": 0, 2023-10-18T14:14:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_items": 0, 2023-10-18T14:14:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-18T14:14:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_items": 0, 2023-10-18T14:14:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-18T14:14:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_items": 0, 2023-10-18T14:14:15.044 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_bytes": 0, 2023-10-18T14:14:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_items": 0, 2023-10-18T14:14:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_bytes": 0, 2023-10-18T14:14:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_items": 0, 2023-10-18T14:14:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-18T14:14:15.045 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_items": 0, 2023-10-18T14:14:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_bytes": 0, 2023-10-18T14:14:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_items": 0, 2023-10-18T14:14:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_bytes": 0, 2023-10-18T14:14:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_items": 0, 2023-10-18T14:14:15.046 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_bytes": 0, 2023-10-18T14:14:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_items": 0, 2023-10-18T14:14:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_bytes": 0, 2023-10-18T14:14:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_items": 0, 2023-10-18T14:14:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_bytes": 148967, 2023-10-18T14:14:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_items": 29, 2023-10-18T14:14:15.047 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_bytes": 0, 2023-10-18T14:14:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_items": 0, 2023-10-18T14:14:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_bytes": 0, 2023-10-18T14:14:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_items": 0, 2023-10-18T14:14:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_bytes": 0, 2023-10-18T14:14:15.048 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_items": 0, 2023-10-18T14:14:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_bytes": 0, 2023-10-18T14:14:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_items": 0, 2023-10-18T14:14:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_bytes": 0, 2023-10-18T14:14:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_items": 0, 2023-10-18T14:14:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_bytes": 0, 2023-10-18T14:14:15.049 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_items": 0, 2023-10-18T14:14:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_bytes": 0, 2023-10-18T14:14:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_items": 0, 2023-10-18T14:14:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_bytes": 928, 2023-10-18T14:14:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_items": 2, 2023-10-18T14:14:15.050 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_bytes": 0, 2023-10-18T14:14:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_items": 0, 2023-10-18T14:14:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_bytes": 0, 2023-10-18T14:14:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_items": 0 2023-10-18T14:14:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-18T14:14:15.051 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2023-10-18T14:14:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 104857600, 2023-10-18T14:14:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2023-10-18T14:14:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 202, 2023-10-18T14:14:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 711463, 2023-10-18T14:14:15.052 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 202, 2023-10-18T14:14:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2023-10-18T14:14:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2023-10-18T14:14:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 202, 2023-10-18T14:14:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 711463, 2023-10-18T14:14:15.053 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2023-10-18T14:14:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:15.054 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:15.055 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:14:15.407 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-10-18T14:14:15.407 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-10-18T14:14:15.408 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-10-18T14:14:15.408 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-10-18T14:14:15.408 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2023-10-18T14:14:15.408 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2023-10-18T14:14:15.409 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2023-10-18T14:14:15.409 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2023-10-18T14:14:15.409 DEBUG:tasks.check_counter:Getting stats from g 2023-10-18T14:14:15.410 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-18T14:14:15.968 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:14:17.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:16 smithi114 ceph-mon[99494]: pgmap v595: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:14:17.162 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:14:17.162 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-0": { 2023-10-18T14:14:17.162 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 697, 2023-10-18T14:14:17.163 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 699, 2023-10-18T14:14:17.163 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 234137, 2023-10-18T14:14:17.163 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 216768, 2023-10-18T14:14:17.163 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 6, 2023-10-18T14:14:17.164 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 2, 2023-10-18T14:14:17.164 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.076157436, 2023-10-18T14:14:17.164 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.030067621, 2023-10-18T14:14:17.164 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.015245849, 2023-10-18T14:14:17.165 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.022577620, 2023-10-18T14:14:17.165 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:17.165 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 697, 2023-10-18T14:14:17.165 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.034996967, 2023-10-18T14:14:17.166 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000050210 2023-10-18T14:14:17.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.166 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:17.166 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.167 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.167 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.168 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-18T14:14:17.168 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 0 2023-10-18T14:14:17.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.168 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-1": { 2023-10-18T14:14:17.169 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 1357, 2023-10-18T14:14:17.169 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 1500, 2023-10-18T14:14:17.169 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 7542820, 2023-10-18T14:14:17.169 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 752369, 2023-10-18T14:14:17.170 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 5, 2023-10-18T14:14:17.170 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 4, 2023-10-18T14:14:17.170 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.095687693, 2023-10-18T14:14:17.170 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.027924276, 2023-10-18T14:14:17.171 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.025599225, 2023-10-18T14:14:17.171 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.035048947, 2023-10-18T14:14:17.171 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:17.171 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 1499, 2023-10-18T14:14:17.171 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.043257365, 2023-10-18T14:14:17.172 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000028857 2023-10-18T14:14:17.172 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.172 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:17.173 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.173 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.173 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.174 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-18T14:14:17.174 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 331840 2023-10-18T14:14:17.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.174 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-2": { 2023-10-18T14:14:17.175 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 247, 2023-10-18T14:14:17.175 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 210, 2023-10-18T14:14:17.175 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 966452, 2023-10-18T14:14:17.175 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 118608, 2023-10-18T14:14:17.176 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 4, 2023-10-18T14:14:17.176 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 3, 2023-10-18T14:14:17.176 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.034332541, 2023-10-18T14:14:17.176 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.012476765, 2023-10-18T14:14:17.176 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.021172903, 2023-10-18T14:14:17.177 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.004340181, 2023-10-18T14:14:17.177 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:17.177 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 209, 2023-10-18T14:14:17.177 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.011000328, 2023-10-18T14:14:17.178 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000052633 2023-10-18T14:14:17.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.178 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:17.178 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.179 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.179 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.179 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 965104, 2023-10-18T14:14:17.180 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 117664 2023-10-18T14:14:17.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.180 INFO:teuthology.orchestra.run.smithi114.stdout: "cct": { 2023-10-18T14:14:17.181 INFO:teuthology.orchestra.run.smithi114.stdout: "total_workers": 1, 2023-10-18T14:14:17.181 INFO:teuthology.orchestra.run.smithi114.stdout: "unhealthy_workers": 0 2023-10-18T14:14:17.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.181 INFO:teuthology.orchestra.run.smithi114.stdout: "finisher-MDSRank": { 2023-10-18T14:14:17.182 INFO:teuthology.orchestra.run.smithi114.stdout: "queue_len": 0, 2023-10-18T14:14:17.182 INFO:teuthology.orchestra.run.smithi114.stdout: "complete_latency": { 2023-10-18T14:14:17.182 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 3366, 2023-10-18T14:14:17.182 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.090874318, 2023-10-18T14:14:17.182 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000026997 2023-10-18T14:14:17.183 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:17.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.183 INFO:teuthology.orchestra.run.smithi114.stdout: "finisher-PurgeQueue": { 2023-10-18T14:14:17.183 INFO:teuthology.orchestra.run.smithi114.stdout: "queue_len": 0, 2023-10-18T14:14:17.183 INFO:teuthology.orchestra.run.smithi114.stdout: "complete_latency": { 2023-10-18T14:14:17.184 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.184 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.184 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.184 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:17.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.185 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": { 2023-10-18T14:14:17.185 INFO:teuthology.orchestra.run.smithi114.stdout: "request": 0, 2023-10-18T14:14:17.185 INFO:teuthology.orchestra.run.smithi114.stdout: "reply": 0, 2023-10-18T14:14:17.185 INFO:teuthology.orchestra.run.smithi114.stdout: "reply_latency": { 2023-10-18T14:14:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.187 INFO:teuthology.orchestra.run.smithi114.stdout: "slow_reply": 0, 2023-10-18T14:14:17.187 INFO:teuthology.orchestra.run.smithi114.stdout: "forward": 0, 2023-10-18T14:14:17.187 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_fetch_complete": 0, 2023-10-18T14:14:17.187 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_fetch_keys": 0, 2023-10-18T14:14:17.188 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_commit": 0, 2023-10-18T14:14:17.188 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_split": 0, 2023-10-18T14:14:17.188 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_merge": 0, 2023-10-18T14:14:17.188 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes": 2384, 2023-10-18T14:14:17.188 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_top": 0, 2023-10-18T14:14:17.189 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_bottom": 0, 2023-10-18T14:14:17.189 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_pin_tail": 2384, 2023-10-18T14:14:17.189 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_pinned": 2384, 2023-10-18T14:14:17.189 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_expired": 192, 2023-10-18T14:14:17.190 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_with_caps": 0, 2023-10-18T14:14:17.190 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": 0, 2023-10-18T14:14:17.190 INFO:teuthology.orchestra.run.smithi114.stdout: "subtrees": 1, 2023-10-18T14:14:17.190 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse": 0, 2023-10-18T14:14:17.191 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_hit": 0, 2023-10-18T14:14:17.191 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_forward": 0, 2023-10-18T14:14:17.191 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_discover": 0, 2023-10-18T14:14:17.192 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_dir_fetch": 0, 2023-10-18T14:14:17.192 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_remote_ino": 0, 2023-10-18T14:14:17.192 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_lock": 0, 2023-10-18T14:14:17.192 INFO:teuthology.orchestra.run.smithi114.stdout: "load_cent": 0, 2023-10-18T14:14:17.192 INFO:teuthology.orchestra.run.smithi114.stdout: "q": 0, 2023-10-18T14:14:17.193 INFO:teuthology.orchestra.run.smithi114.stdout: "exported": 0, 2023-10-18T14:14:17.193 INFO:teuthology.orchestra.run.smithi114.stdout: "exported_inodes": 0, 2023-10-18T14:14:17.193 INFO:teuthology.orchestra.run.smithi114.stdout: "imported": 0, 2023-10-18T14:14:17.193 INFO:teuthology.orchestra.run.smithi114.stdout: "imported_inodes": 0, 2023-10-18T14:14:17.193 INFO:teuthology.orchestra.run.smithi114.stdout: "openino_dir_fetch": 0, 2023-10-18T14:14:17.194 INFO:teuthology.orchestra.run.smithi114.stdout: "openino_backtrace_fetch": 0, 2023-10-18T14:14:17.194 INFO:teuthology.orchestra.run.smithi114.stdout: "openino_peer_discover": 0, 2023-10-18T14:14:17.194 INFO:teuthology.orchestra.run.smithi114.stdout: "root_rfiles": 0, 2023-10-18T14:14:17.194 INFO:teuthology.orchestra.run.smithi114.stdout: "root_rbytes": 0, 2023-10-18T14:14:17.195 INFO:teuthology.orchestra.run.smithi114.stdout: "root_rsnaps": 0, 2023-10-18T14:14:17.195 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_backtrace_fetch": 0, 2023-10-18T14:14:17.195 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_set_tag": 0, 2023-10-18T14:14:17.195 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_backtrace_repaired": 0, 2023-10-18T14:14:17.195 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_inotable_repaired": 0, 2023-10-18T14:14:17.196 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_dir_inodes": 0, 2023-10-18T14:14:17.196 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_dir_base_inodes": 0, 2023-10-18T14:14:17.196 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_dirfrag_rstats": 0, 2023-10-18T14:14:17.196 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_file_inodes": 0, 2023-10-18T14:14:17.196 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_inode_file_caps": 0, 2023-10-18T14:14:17.197 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_revoke": 0, 2023-10-18T14:14:17.197 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_grant": 0, 2023-10-18T14:14:17.197 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_trunc": 0, 2023-10-18T14:14:17.197 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-18T14:14:17.198 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-18T14:14:17.198 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_caps": 0, 2023-10-18T14:14:17.198 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_caps_dirty": 0, 2023-10-18T14:14:17.198 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_cap_release": 0, 2023-10-18T14:14:17.199 INFO:teuthology.orchestra.run.smithi114.stdout: "process_request_cap_release": 0 2023-10-18T14:14:17.199 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.199 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_cache": { 2023-10-18T14:14:17.199 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_update": 0, 2023-10-18T14:14:17.199 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_update_receipt": 0, 2023-10-18T14:14:17.200 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_try_discover": 0, 2023-10-18T14:14:17.200 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_send_discover": 0, 2023-10-18T14:14:17.200 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_handle_discover": 0, 2023-10-18T14:14:17.200 INFO:teuthology.orchestra.run.smithi114.stdout: "num_strays": 0, 2023-10-18T14:14:17.200 INFO:teuthology.orchestra.run.smithi114.stdout: "num_strays_delayed": 0, 2023-10-18T14:14:17.201 INFO:teuthology.orchestra.run.smithi114.stdout: "num_strays_enqueuing": 0, 2023-10-18T14:14:17.201 INFO:teuthology.orchestra.run.smithi114.stdout: "strays_created": 0, 2023-10-18T14:14:17.201 INFO:teuthology.orchestra.run.smithi114.stdout: "strays_enqueued": 0, 2023-10-18T14:14:17.201 INFO:teuthology.orchestra.run.smithi114.stdout: "strays_reintegrated": 0, 2023-10-18T14:14:17.202 INFO:teuthology.orchestra.run.smithi114.stdout: "strays_migrated": 0, 2023-10-18T14:14:17.202 INFO:teuthology.orchestra.run.smithi114.stdout: "num_recovering_processing": 0, 2023-10-18T14:14:17.202 INFO:teuthology.orchestra.run.smithi114.stdout: "num_recovering_enqueued": 0, 2023-10-18T14:14:17.202 INFO:teuthology.orchestra.run.smithi114.stdout: "num_recovering_prioritized": 0, 2023-10-18T14:14:17.203 INFO:teuthology.orchestra.run.smithi114.stdout: "recovery_started": 0, 2023-10-18T14:14:17.203 INFO:teuthology.orchestra.run.smithi114.stdout: "recovery_completed": 0, 2023-10-18T14:14:17.203 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_enqueue_scrub": 0, 2023-10-18T14:14:17.203 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_exportdir": 0, 2023-10-18T14:14:17.203 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_flush": 0, 2023-10-18T14:14:17.204 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_fragmentdir": 0, 2023-10-18T14:14:17.204 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_fragstats": 0, 2023-10-18T14:14:17.204 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_inodestats": 0 2023-10-18T14:14:17.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.205 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_log": { 2023-10-18T14:14:17.205 INFO:teuthology.orchestra.run.smithi114.stdout: "evlrg": 0, 2023-10-18T14:14:17.205 INFO:teuthology.orchestra.run.smithi114.stdout: "evadd": 0, 2023-10-18T14:14:17.205 INFO:teuthology.orchestra.run.smithi114.stdout: "evex": 0, 2023-10-18T14:14:17.206 INFO:teuthology.orchestra.run.smithi114.stdout: "evtrm": 0, 2023-10-18T14:14:17.206 INFO:teuthology.orchestra.run.smithi114.stdout: "ev": 2994, 2023-10-18T14:14:17.206 INFO:teuthology.orchestra.run.smithi114.stdout: "evexg": 0, 2023-10-18T14:14:17.207 INFO:teuthology.orchestra.run.smithi114.stdout: "evexd": 0, 2023-10-18T14:14:17.207 INFO:teuthology.orchestra.run.smithi114.stdout: "segadd": 0, 2023-10-18T14:14:17.207 INFO:teuthology.orchestra.run.smithi114.stdout: "segex": 0, 2023-10-18T14:14:17.208 INFO:teuthology.orchestra.run.smithi114.stdout: "segtrm": 0, 2023-10-18T14:14:17.208 INFO:teuthology.orchestra.run.smithi114.stdout: "seg": 5, 2023-10-18T14:14:17.208 INFO:teuthology.orchestra.run.smithi114.stdout: "segmjr": 2, 2023-10-18T14:14:17.208 INFO:teuthology.orchestra.run.smithi114.stdout: "segexg": 0, 2023-10-18T14:14:17.209 INFO:teuthology.orchestra.run.smithi114.stdout: "segexd": 0, 2023-10-18T14:14:17.209 INFO:teuthology.orchestra.run.smithi114.stdout: "expos": 4194304, 2023-10-18T14:14:17.209 INFO:teuthology.orchestra.run.smithi114.stdout: "wrpos": 11389972, 2023-10-18T14:14:17.210 INFO:teuthology.orchestra.run.smithi114.stdout: "rdpos": 11386894, 2023-10-18T14:14:17.210 INFO:teuthology.orchestra.run.smithi114.stdout: "jlat": { 2023-10-18T14:14:17.210 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.210 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.210 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.211 INFO:teuthology.orchestra.run.smithi114.stdout: "replayed": 2994 2023-10-18T14:14:17.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.211 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_mem": { 2023-10-18T14:14:17.211 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 794, 2023-10-18T14:14:17.212 INFO:teuthology.orchestra.run.smithi114.stdout: "ino+": 2305, 2023-10-18T14:14:17.212 INFO:teuthology.orchestra.run.smithi114.stdout: "ino-": 1511, 2023-10-18T14:14:17.212 INFO:teuthology.orchestra.run.smithi114.stdout: "dir": 61, 2023-10-18T14:14:17.213 INFO:teuthology.orchestra.run.smithi114.stdout: "dir+": 106, 2023-10-18T14:14:17.213 INFO:teuthology.orchestra.run.smithi114.stdout: "dir-": 45, 2023-10-18T14:14:17.213 INFO:teuthology.orchestra.run.smithi114.stdout: "dn": 2384, 2023-10-18T14:14:17.214 INFO:teuthology.orchestra.run.smithi114.stdout: "dn+": 3817, 2023-10-18T14:14:17.214 INFO:teuthology.orchestra.run.smithi114.stdout: "dn-": 1433, 2023-10-18T14:14:17.215 INFO:teuthology.orchestra.run.smithi114.stdout: "cap": 0, 2023-10-18T14:14:17.215 INFO:teuthology.orchestra.run.smithi114.stdout: "cap+": 0, 2023-10-18T14:14:17.215 INFO:teuthology.orchestra.run.smithi114.stdout: "cap-": 0, 2023-10-18T14:14:17.215 INFO:teuthology.orchestra.run.smithi114.stdout: "rss": 57708, 2023-10-18T14:14:17.216 INFO:teuthology.orchestra.run.smithi114.stdout: "heap": 207152 2023-10-18T14:14:17.216 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.216 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_server": { 2023-10-18T14:14:17.216 INFO:teuthology.orchestra.run.smithi114.stdout: "dispatch_client_request": 0, 2023-10-18T14:14:17.216 INFO:teuthology.orchestra.run.smithi114.stdout: "dispatch_server_request": 0, 2023-10-18T14:14:17.217 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_request": 0, 2023-10-18T14:14:17.217 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_session": 0, 2023-10-18T14:14:17.217 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_peer_request": 0, 2023-10-18T14:14:17.217 INFO:teuthology.orchestra.run.smithi114.stdout: "req_create_latency": { 2023-10-18T14:14:17.217 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.217 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.218 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.218 INFO:teuthology.orchestra.run.smithi114.stdout: "req_getattr_latency": { 2023-10-18T14:14:17.219 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.219 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.219 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.219 INFO:teuthology.orchestra.run.smithi114.stdout: "req_getfilelock_latency": { 2023-10-18T14:14:17.220 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.220 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.220 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.220 INFO:teuthology.orchestra.run.smithi114.stdout: "req_link_latency": { 2023-10-18T14:14:17.221 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.221 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.221 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.221 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.221 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookup_latency": { 2023-10-18T14:14:17.222 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.222 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.222 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.222 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.222 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookuphash_latency": { 2023-10-18T14:14:17.223 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.223 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.223 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.223 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.223 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookupino_latency": { 2023-10-18T14:14:17.224 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.224 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.224 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.224 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookupname_latency": { 2023-10-18T14:14:17.225 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.225 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.225 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.226 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookupparent_latency": { 2023-10-18T14:14:17.226 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.227 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.227 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.228 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookupsnap_latency": { 2023-10-18T14:14:17.228 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.228 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.229 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.229 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.229 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lssnap_latency": { 2023-10-18T14:14:17.230 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.230 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.230 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.231 INFO:teuthology.orchestra.run.smithi114.stdout: "req_mkdir_latency": { 2023-10-18T14:14:17.231 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.232 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.232 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.232 INFO:teuthology.orchestra.run.smithi114.stdout: "req_mknod_latency": { 2023-10-18T14:14:17.233 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.233 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.233 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.233 INFO:teuthology.orchestra.run.smithi114.stdout: "req_mksnap_latency": { 2023-10-18T14:14:17.234 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.234 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.234 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.234 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.234 INFO:teuthology.orchestra.run.smithi114.stdout: "req_open_latency": { 2023-10-18T14:14:17.235 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.235 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.235 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.235 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.235 INFO:teuthology.orchestra.run.smithi114.stdout: "req_readdir_latency": { 2023-10-18T14:14:17.236 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.236 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.236 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.236 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.236 INFO:teuthology.orchestra.run.smithi114.stdout: "req_rename_latency": { 2023-10-18T14:14:17.236 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.237 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.237 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.237 INFO:teuthology.orchestra.run.smithi114.stdout: "req_renamesnap_latency": { 2023-10-18T14:14:17.237 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: "req_snapdiff_latency": { 2023-10-18T14:14:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.239 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.239 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.239 INFO:teuthology.orchestra.run.smithi114.stdout: "req_rmdir_latency": { 2023-10-18T14:14:17.239 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.240 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.240 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.240 INFO:teuthology.orchestra.run.smithi114.stdout: "req_rmsnap_latency": { 2023-10-18T14:14:17.240 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.241 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.241 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.241 INFO:teuthology.orchestra.run.smithi114.stdout: "req_rmxattr_latency": { 2023-10-18T14:14:17.241 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.242 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.242 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.242 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setattr_latency": { 2023-10-18T14:14:17.242 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.243 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.243 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.243 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setdirlayout_latency": { 2023-10-18T14:14:17.243 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.244 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.244 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.244 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setfilelock_latency": { 2023-10-18T14:14:17.244 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.245 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.245 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.245 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setlayout_latency": { 2023-10-18T14:14:17.245 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.246 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.246 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.246 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setxattr_latency": { 2023-10-18T14:14:17.246 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.247 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.247 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.247 INFO:teuthology.orchestra.run.smithi114.stdout: "req_symlink_latency": { 2023-10-18T14:14:17.247 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.247 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.248 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.248 INFO:teuthology.orchestra.run.smithi114.stdout: "req_unlink_latency": { 2023-10-18T14:14:17.248 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.248 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.249 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.249 INFO:teuthology.orchestra.run.smithi114.stdout: "cap_revoke_eviction": 0, 2023-10-18T14:14:17.249 INFO:teuthology.orchestra.run.smithi114.stdout: "cap_acquisition_throttle": 0, 2023-10-18T14:14:17.249 INFO:teuthology.orchestra.run.smithi114.stdout: "req_getvxattr_latency": { 2023-10-18T14:14:17.250 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.250 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.250 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.250 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:17.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.251 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_sessions": { 2023-10-18T14:14:17.251 INFO:teuthology.orchestra.run.smithi114.stdout: "session_count": 1, 2023-10-18T14:14:17.251 INFO:teuthology.orchestra.run.smithi114.stdout: "session_add": 1, 2023-10-18T14:14:17.251 INFO:teuthology.orchestra.run.smithi114.stdout: "session_remove": 0, 2023-10-18T14:14:17.251 INFO:teuthology.orchestra.run.smithi114.stdout: "sessions_open": 1, 2023-10-18T14:14:17.252 INFO:teuthology.orchestra.run.smithi114.stdout: "sessions_stale": 0, 2023-10-18T14:14:17.252 INFO:teuthology.orchestra.run.smithi114.stdout: "total_load": 0, 2023-10-18T14:14:17.252 INFO:teuthology.orchestra.run.smithi114.stdout: "average_load": 0, 2023-10-18T14:14:17.252 INFO:teuthology.orchestra.run.smithi114.stdout: "avg_session_uptime": 2030, 2023-10-18T14:14:17.252 INFO:teuthology.orchestra.run.smithi114.stdout: "mdthresh_evicted": 0 2023-10-18T14:14:17.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.253 INFO:teuthology.orchestra.run.smithi114.stdout: "mempool": { 2023-10-18T14:14:17.253 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_bytes": 0, 2023-10-18T14:14:17.253 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_items": 0, 2023-10-18T14:14:17.253 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_bytes": 0, 2023-10-18T14:14:17.253 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_items": 0, 2023-10-18T14:14:17.254 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_bytes": 0, 2023-10-18T14:14:17.254 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_items": 0, 2023-10-18T14:14:17.254 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-18T14:14:17.254 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_items": 0, 2023-10-18T14:14:17.255 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-18T14:14:17.255 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_items": 0, 2023-10-18T14:14:17.255 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_bytes": 0, 2023-10-18T14:14:17.255 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_items": 0, 2023-10-18T14:14:17.255 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-18T14:14:17.255 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_items": 0, 2023-10-18T14:14:17.256 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_bytes": 0, 2023-10-18T14:14:17.256 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_items": 0, 2023-10-18T14:14:17.256 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_bytes": 0, 2023-10-18T14:14:17.256 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_items": 0, 2023-10-18T14:14:17.256 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-18T14:14:17.257 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_items": 0, 2023-10-18T14:14:17.257 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-18T14:14:17.257 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_items": 0, 2023-10-18T14:14:17.257 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_bytes": 0, 2023-10-18T14:14:17.257 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_items": 0, 2023-10-18T14:14:17.258 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_bytes": 0, 2023-10-18T14:14:17.258 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_items": 0, 2023-10-18T14:14:17.258 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-18T14:14:17.258 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_items": 0, 2023-10-18T14:14:17.258 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_bytes": 0, 2023-10-18T14:14:17.259 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_items": 0, 2023-10-18T14:14:17.259 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_bytes": 0, 2023-10-18T14:14:17.259 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_items": 0, 2023-10-18T14:14:17.259 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_bytes": 0, 2023-10-18T14:14:17.259 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_items": 0, 2023-10-18T14:14:17.260 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_bytes": 0, 2023-10-18T14:14:17.260 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_items": 0, 2023-10-18T14:14:17.260 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_bytes": 226488, 2023-10-18T14:14:17.260 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_items": 908, 2023-10-18T14:14:17.260 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_bytes": 0, 2023-10-18T14:14:17.261 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_items": 0, 2023-10-18T14:14:17.261 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_bytes": 0, 2023-10-18T14:14:17.261 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_items": 0, 2023-10-18T14:14:17.261 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_bytes": 0, 2023-10-18T14:14:17.261 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_items": 0, 2023-10-18T14:14:17.262 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_bytes": 0, 2023-10-18T14:14:17.262 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_items": 0, 2023-10-18T14:14:17.262 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_bytes": 7992, 2023-10-18T14:14:17.262 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_items": 167, 2023-10-18T14:14:17.262 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_bytes": 0, 2023-10-18T14:14:17.263 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_items": 0, 2023-10-18T14:14:17.263 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_bytes": 0, 2023-10-18T14:14:17.263 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_items": 0, 2023-10-18T14:14:17.263 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_bytes": 3593655, 2023-10-18T14:14:17.263 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_items": 39553, 2023-10-18T14:14:17.263 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_bytes": 0, 2023-10-18T14:14:17.264 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_items": 0, 2023-10-18T14:14:17.264 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_bytes": 0, 2023-10-18T14:14:17.264 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_items": 0 2023-10-18T14:14:17.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.264 INFO:teuthology.orchestra.run.smithi114.stdout: "objecter": { 2023-10-18T14:14:17.265 INFO:teuthology.orchestra.run.smithi114.stdout: "op_active": 0, 2023-10-18T14:14:17.265 INFO:teuthology.orchestra.run.smithi114.stdout: "op_laggy": 0, 2023-10-18T14:14:17.265 INFO:teuthology.orchestra.run.smithi114.stdout: "op_send": 2052, 2023-10-18T14:14:17.265 INFO:teuthology.orchestra.run.smithi114.stdout: "op_send_bytes": 21, 2023-10-18T14:14:17.265 INFO:teuthology.orchestra.run.smithi114.stdout: "op_resend": 3, 2023-10-18T14:14:17.266 INFO:teuthology.orchestra.run.smithi114.stdout: "op_reply": 2052, 2023-10-18T14:14:17.266 INFO:teuthology.orchestra.run.smithi114.stdout: "op_latency": { 2023-10-18T14:14:17.266 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 2052, 2023-10-18T14:14:17.266 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 2.368951371, 2023-10-18T14:14:17.266 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.001154459 2023-10-18T14:14:17.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.267 INFO:teuthology.orchestra.run.smithi114.stdout: "op_inflight": 0, 2023-10-18T14:14:17.267 INFO:teuthology.orchestra.run.smithi114.stdout: "oplen_avg": { 2023-10-18T14:14:17.267 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 2052, 2023-10-18T14:14:17.267 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 2053 2023-10-18T14:14:17.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.268 INFO:teuthology.orchestra.run.smithi114.stdout: "op": 2052, 2023-10-18T14:14:17.268 INFO:teuthology.orchestra.run.smithi114.stdout: "op_r": 2052, 2023-10-18T14:14:17.268 INFO:teuthology.orchestra.run.smithi114.stdout: "op_w": 0, 2023-10-18T14:14:17.268 INFO:teuthology.orchestra.run.smithi114.stdout: "op_rmw": 0, 2023-10-18T14:14:17.269 INFO:teuthology.orchestra.run.smithi114.stdout: "op_pg": 0, 2023-10-18T14:14:17.269 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_stat": 1314, 2023-10-18T14:14:17.269 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_create": 0, 2023-10-18T14:14:17.269 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_read": 736, 2023-10-18T14:14:17.269 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_write": 0, 2023-10-18T14:14:17.270 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_writefull": 0, 2023-10-18T14:14:17.270 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_writesame": 0, 2023-10-18T14:14:17.270 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_append": 0, 2023-10-18T14:14:17.270 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_zero": 0, 2023-10-18T14:14:17.270 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_truncate": 0, 2023-10-18T14:14:17.271 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_delete": 0, 2023-10-18T14:14:17.271 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_mapext": 0, 2023-10-18T14:14:17.271 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_sparse_read": 0, 2023-10-18T14:14:17.271 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_clonerange": 0, 2023-10-18T14:14:17.271 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_getxattr": 1, 2023-10-18T14:14:17.272 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_setxattr": 0, 2023-10-18T14:14:17.272 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_cmpxattr": 0, 2023-10-18T14:14:17.272 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_rmxattr": 0, 2023-10-18T14:14:17.272 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_resetxattrs": 0, 2023-10-18T14:14:17.272 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_call": 0, 2023-10-18T14:14:17.272 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_watch": 0, 2023-10-18T14:14:17.273 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_notify": 0, 2023-10-18T14:14:17.273 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_src_cmpxattr": 0, 2023-10-18T14:14:17.273 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_pgls": 0, 2023-10-18T14:14:17.273 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_pgls_filter": 0, 2023-10-18T14:14:17.273 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_other": 0, 2023-10-18T14:14:17.274 INFO:teuthology.orchestra.run.smithi114.stdout: "linger_active": 0, 2023-10-18T14:14:17.274 INFO:teuthology.orchestra.run.smithi114.stdout: "linger_send": 0, 2023-10-18T14:14:17.274 INFO:teuthology.orchestra.run.smithi114.stdout: "linger_resend": 0, 2023-10-18T14:14:17.274 INFO:teuthology.orchestra.run.smithi114.stdout: "linger_ping": 0, 2023-10-18T14:14:17.274 INFO:teuthology.orchestra.run.smithi114.stdout: "poolop_active": 0, 2023-10-18T14:14:17.275 INFO:teuthology.orchestra.run.smithi114.stdout: "poolop_send": 0, 2023-10-18T14:14:17.275 INFO:teuthology.orchestra.run.smithi114.stdout: "poolop_resend": 0, 2023-10-18T14:14:17.275 INFO:teuthology.orchestra.run.smithi114.stdout: "poolstat_active": 0, 2023-10-18T14:14:17.275 INFO:teuthology.orchestra.run.smithi114.stdout: "poolstat_send": 0, 2023-10-18T14:14:17.275 INFO:teuthology.orchestra.run.smithi114.stdout: "poolstat_resend": 0, 2023-10-18T14:14:17.276 INFO:teuthology.orchestra.run.smithi114.stdout: "statfs_active": 0, 2023-10-18T14:14:17.276 INFO:teuthology.orchestra.run.smithi114.stdout: "statfs_send": 0, 2023-10-18T14:14:17.276 INFO:teuthology.orchestra.run.smithi114.stdout: "statfs_resend": 0, 2023-10-18T14:14:17.276 INFO:teuthology.orchestra.run.smithi114.stdout: "command_active": 0, 2023-10-18T14:14:17.276 INFO:teuthology.orchestra.run.smithi114.stdout: "command_send": 0, 2023-10-18T14:14:17.277 INFO:teuthology.orchestra.run.smithi114.stdout: "command_resend": 0, 2023-10-18T14:14:17.277 INFO:teuthology.orchestra.run.smithi114.stdout: "map_epoch": 93, 2023-10-18T14:14:17.277 INFO:teuthology.orchestra.run.smithi114.stdout: "map_full": 0, 2023-10-18T14:14:17.277 INFO:teuthology.orchestra.run.smithi114.stdout: "map_inc": 10, 2023-10-18T14:14:17.277 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_sessions": 6, 2023-10-18T14:14:17.277 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_session_open": 6, 2023-10-18T14:14:17.278 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_session_close": 0, 2023-10-18T14:14:17.278 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_laggy": 0, 2023-10-18T14:14:17.278 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_wr": 0, 2023-10-18T14:14:17.278 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_rd": 2, 2023-10-18T14:14:17.279 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_del": 0 2023-10-18T14:14:17.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.279 INFO:teuthology.orchestra.run.smithi114.stdout: "oft": { 2023-10-18T14:14:17.279 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_total_objs": 0, 2023-10-18T14:14:17.280 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_total_kv_pairs": 0, 2023-10-18T14:14:17.280 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_total_updates": 0, 2023-10-18T14:14:17.280 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_total_removes": 0 2023-10-18T14:14:17.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.281 INFO:teuthology.orchestra.run.smithi114.stdout: "osd-slow-ops": { 2023-10-18T14:14:17.281 INFO:teuthology.orchestra.run.smithi114.stdout: "slow_ops_count": 0 2023-10-18T14:14:17.281 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.281 INFO:teuthology.orchestra.run.smithi114.stdout: "purge_queue": { 2023-10-18T14:14:17.281 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executing_ops": 0, 2023-10-18T14:14:17.281 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executing_ops_high_water": 0, 2023-10-18T14:14:17.282 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executing": 0, 2023-10-18T14:14:17.282 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executing_high_water": 0, 2023-10-18T14:14:17.282 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executed": 0, 2023-10-18T14:14:17.282 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_item_in_journal": 0 2023-10-18T14:14:17.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.283 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-18T14:14:17.283 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2023-10-18T14:14:17.283 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 104857600, 2023-10-18T14:14:17.283 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2023-10-18T14:14:17.283 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 2297, 2023-10-18T14:14:17.284 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 8521371, 2023-10-18T14:14:17.284 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:17.284 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 2297, 2023-10-18T14:14:17.284 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2023-10-18T14:14:17.284 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2023-10-18T14:14:17.285 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 2297, 2023-10-18T14:14:17.285 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 8521371, 2023-10-18T14:14:17.285 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2023-10-18T14:14:17.285 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.285 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.286 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.286 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:17.286 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.286 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-objecter_bytes": { 2023-10-18T14:14:17.286 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2023-10-18T14:14:17.287 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 104857600, 2023-10-18T14:14:17.287 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2023-10-18T14:14:17.287 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 0, 2023-10-18T14:14:17.287 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 0, 2023-10-18T14:14:17.287 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:17.287 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:17.288 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 2052, 2023-10-18T14:14:17.288 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 7195673, 2023-10-18T14:14:17.288 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 2052, 2023-10-18T14:14:17.288 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 7195673, 2023-10-18T14:14:17.288 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2023-10-18T14:14:17.289 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.289 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.289 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.289 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:17.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.290 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-objecter_ops": { 2023-10-18T14:14:17.290 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2023-10-18T14:14:17.290 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 1024, 2023-10-18T14:14:17.290 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2023-10-18T14:14:17.290 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 0, 2023-10-18T14:14:17.291 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 0, 2023-10-18T14:14:17.291 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:17.291 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:17.291 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 2052, 2023-10-18T14:14:17.291 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 2052, 2023-10-18T14:14:17.292 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 2052, 2023-10-18T14:14:17.292 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 2052, 2023-10-18T14:14:17.292 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2023-10-18T14:14:17.292 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.292 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.293 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.293 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:17.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.293 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-write_buf_throttle": { 2023-10-18T14:14:17.293 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2023-10-18T14:14:17.293 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 3758096384, 2023-10-18T14:14:17.294 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2023-10-18T14:14:17.294 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 0, 2023-10-18T14:14:17.294 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 0, 2023-10-18T14:14:17.294 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:17.294 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:17.295 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2023-10-18T14:14:17.295 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2023-10-18T14:14:17.295 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 0, 2023-10-18T14:14:17.295 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 0, 2023-10-18T14:14:17.295 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2023-10-18T14:14:17.296 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.296 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.296 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.296 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:17.296 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:17.297 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-write_buf_throttle-0x5634d4554960": { 2023-10-18T14:14:17.297 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2023-10-18T14:14:17.297 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 3758096384, 2023-10-18T14:14:17.297 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2023-10-18T14:14:17.297 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 0, 2023-10-18T14:14:17.298 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 0, 2023-10-18T14:14:17.298 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:17.298 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:17.298 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2023-10-18T14:14:17.298 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2023-10-18T14:14:17.299 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 0, 2023-10-18T14:14:17.299 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 0, 2023-10-18T14:14:17.299 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2023-10-18T14:14:17.299 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:17.299 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:17.300 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:17.300 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:17.300 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:17.300 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:14:17.301 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:16 smithi158 ceph-mon[103317]: pgmap v595: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:14:17.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:16 smithi172 ceph-mon[103574]: pgmap v595: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:14:17.514 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-10-18T14:14:17.514 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-10-18T14:14:17.514 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2023-10-18T14:14:17.515 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2023-10-18T14:14:17.515 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2023-10-18T14:14:17.515 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2023-10-18T14:14:17.515 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2023-10-18T14:14:17.516 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2023-10-18T14:14:17.516 DEBUG:tasks.check_counter:Getting stats from j 2023-10-18T14:14:17.516 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-18T14:14:18.075 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-18T14:14:18.865 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:18 smithi114 ceph-mon[99494]: pgmap v596: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 181 B/s wr, 11 op/s 2023-10-18T14:14:18.865 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:18 smithi114 ceph-mon[99494]: osdmap e94: 12 total, 12 up, 12 in 2023-10-18T14:14:19.258 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T14:14:19.258 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-0": { 2023-10-18T14:14:19.258 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 0, 2023-10-18T14:14:19.259 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 2, 2023-10-18T14:14:19.259 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 0, 2023-10-18T14:14:19.259 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 0, 2023-10-18T14:14:19.259 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 4, 2023-10-18T14:14:19.260 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 0, 2023-10-18T14:14:19.260 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.001311361, 2023-10-18T14:14:19.260 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.000000000, 2023-10-18T14:14:19.260 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.000358434, 2023-10-18T14:14:19.260 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-18T14:14:19.261 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:19.261 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:19.261 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:19.261 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:19.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:19.261 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:19.262 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:19.262 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:19.262 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:19.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:19.263 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-18T14:14:19.263 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 0 2023-10-18T14:14:19.263 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:19.263 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-1": { 2023-10-18T14:14:19.263 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 1, 2023-10-18T14:14:19.264 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 150, 2023-10-18T14:14:19.264 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 160, 2023-10-18T14:14:19.264 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 102928, 2023-10-18T14:14:19.264 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 3, 2023-10-18T14:14:19.264 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 2, 2023-10-18T14:14:19.265 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.010877210, 2023-10-18T14:14:19.265 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.008032261, 2023-10-18T14:14:19.265 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.001354322, 2023-10-18T14:14:19.265 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-18T14:14:19.265 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:19.266 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 148, 2023-10-18T14:14:19.266 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.007872262, 2023-10-18T14:14:19.266 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000053190 2023-10-18T14:14:19.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:19.266 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:19.267 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:19.267 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:19.267 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:19.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:19.267 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-18T14:14:19.267 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 102928 2023-10-18T14:14:19.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:19.268 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-2": { 2023-10-18T14:14:19.268 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 206, 2023-10-18T14:14:19.268 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 199, 2023-10-18T14:14:19.268 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 743120, 2023-10-18T14:14:19.269 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 118352, 2023-10-18T14:14:19.269 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 2, 2023-10-18T14:14:19.269 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 1, 2023-10-18T14:14:19.269 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.030615145, 2023-10-18T14:14:19.269 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.011703122, 2023-10-18T14:14:19.270 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.016222608, 2023-10-18T14:14:19.270 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.004425140, 2023-10-18T14:14:19.270 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:19.270 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 199, 2023-10-18T14:14:19.270 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.010718013, 2023-10-18T14:14:19.271 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000053859 2023-10-18T14:14:19.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:19.271 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:19.271 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:19.271 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:19.271 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:19.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:19.272 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 743120, 2023-10-18T14:14:19.272 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 118352 2023-10-18T14:14:19.272 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:19.272 INFO:teuthology.orchestra.run.smithi114.stdout: "cct": { 2023-10-18T14:14:19.273 INFO:teuthology.orchestra.run.smithi114.stdout: "total_workers": 0, 2023-10-18T14:14:19.273 INFO:teuthology.orchestra.run.smithi114.stdout: "unhealthy_workers": 0 2023-10-18T14:14:19.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:19.273 INFO:teuthology.orchestra.run.smithi114.stdout: "mempool": { 2023-10-18T14:14:19.273 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_bytes": 0, 2023-10-18T14:14:19.274 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_items": 0, 2023-10-18T14:14:19.274 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_bytes": 0, 2023-10-18T14:14:19.274 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_items": 0, 2023-10-18T14:14:19.274 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_bytes": 0, 2023-10-18T14:14:19.274 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_items": 0, 2023-10-18T14:14:19.275 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-18T14:14:19.275 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_items": 0, 2023-10-18T14:14:19.275 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-18T14:14:19.275 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_items": 0, 2023-10-18T14:14:19.275 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_bytes": 0, 2023-10-18T14:14:19.276 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_items": 0, 2023-10-18T14:14:19.276 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-18T14:14:19.276 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_items": 0, 2023-10-18T14:14:19.276 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_bytes": 0, 2023-10-18T14:14:19.276 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_items": 0, 2023-10-18T14:14:19.277 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_bytes": 0, 2023-10-18T14:14:19.277 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_items": 0, 2023-10-18T14:14:19.277 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-18T14:14:19.277 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_items": 0, 2023-10-18T14:14:19.277 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-18T14:14:19.277 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_items": 0, 2023-10-18T14:14:19.278 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_bytes": 0, 2023-10-18T14:14:19.278 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_items": 0, 2023-10-18T14:14:19.278 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_bytes": 0, 2023-10-18T14:14:19.278 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_items": 0, 2023-10-18T14:14:19.278 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-18T14:14:19.279 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_items": 0, 2023-10-18T14:14:19.279 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_bytes": 0, 2023-10-18T14:14:19.279 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_items": 0, 2023-10-18T14:14:19.279 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_bytes": 0, 2023-10-18T14:14:19.279 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_items": 0, 2023-10-18T14:14:19.280 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_bytes": 0, 2023-10-18T14:14:19.280 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_items": 0, 2023-10-18T14:14:19.280 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_bytes": 0, 2023-10-18T14:14:19.280 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_items": 0, 2023-10-18T14:14:19.280 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_bytes": 148967, 2023-10-18T14:14:19.280 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_items": 29, 2023-10-18T14:14:19.281 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_bytes": 0, 2023-10-18T14:14:19.281 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_items": 0, 2023-10-18T14:14:19.281 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_bytes": 0, 2023-10-18T14:14:19.281 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_items": 0, 2023-10-18T14:14:19.281 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_bytes": 0, 2023-10-18T14:14:19.282 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_items": 0, 2023-10-18T14:14:19.282 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_bytes": 0, 2023-10-18T14:14:19.282 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_items": 0, 2023-10-18T14:14:19.282 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_bytes": 0, 2023-10-18T14:14:19.282 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_items": 0, 2023-10-18T14:14:19.283 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_bytes": 0, 2023-10-18T14:14:19.283 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_items": 0, 2023-10-18T14:14:19.283 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_bytes": 0, 2023-10-18T14:14:19.283 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_items": 0, 2023-10-18T14:14:19.283 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_bytes": 928, 2023-10-18T14:14:19.284 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_items": 2, 2023-10-18T14:14:19.284 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_bytes": 0, 2023-10-18T14:14:19.284 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_items": 0, 2023-10-18T14:14:19.284 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_bytes": 0, 2023-10-18T14:14:19.285 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_items": 0 2023-10-18T14:14:19.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T14:14:19.285 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-18T14:14:19.285 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2023-10-18T14:14:19.285 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 104857600, 2023-10-18T14:14:19.286 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2023-10-18T14:14:19.286 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 203, 2023-10-18T14:14:19.286 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 711593, 2023-10-18T14:14:19.286 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:19.286 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 203, 2023-10-18T14:14:19.287 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2023-10-18T14:14:19.287 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2023-10-18T14:14:19.287 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 203, 2023-10-18T14:14:19.287 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 711593, 2023-10-18T14:14:19.287 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2023-10-18T14:14:19.288 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2023-10-18T14:14:19.288 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2023-10-18T14:14:19.288 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2023-10-18T14:14:19.289 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:19.289 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T14:14:19.289 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T14:14:19.290 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:18 smithi158 ceph-mon[103317]: pgmap v596: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 181 B/s wr, 11 op/s 2023-10-18T14:14:19.290 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:18 smithi158 ceph-mon[103317]: osdmap e94: 12 total, 12 up, 12 in 2023-10-18T14:14:19.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:18 smithi172 ceph-mon[103574]: pgmap v596: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 181 B/s wr, 11 op/s 2023-10-18T14:14:19.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:18 smithi172 ceph-mon[103574]: osdmap e94: 12 total, 12 up, 12 in 2023-10-18T14:14:19.626 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-10-18T14:14:19.626 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-10-18T14:14:19.627 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-10-18T14:14:19.627 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-10-18T14:14:19.627 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-10-18T14:14:19.627 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-10-18T14:14:19.628 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-10-18T14:14:19.628 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2023-10-18T14:14:19.628 DEBUG:tasks.check_counter:Getting stats from b 2023-10-18T14:14:19.629 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-18T14:14:20.210 INFO:teuthology.orchestra.run.smithi158.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-18T14:14:21.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:20 smithi114 ceph-mon[99494]: pgmap v598: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:14:21.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:20 smithi158 ceph-mon[103317]: pgmap v598: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:14:21.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:20 smithi172 ceph-mon[103574]: pgmap v598: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-18T14:14:21.589 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2023-10-18T14:14:21.589 INFO:teuthology.orchestra.run.smithi158.stdout: "AsyncMessenger::Worker-0": { 2023-10-18T14:14:21.589 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_messages": 968, 2023-10-18T14:14:21.589 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages": 1000, 2023-10-18T14:14:21.590 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_bytes": 392323, 2023-10-18T14:14:21.590 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_bytes": 3300512, 2023-10-18T14:14:21.590 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_created_connections": 20, 2023-10-18T14:14:21.590 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_active_connections": 6, 2023-10-18T14:14:21.590 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_total_time": 0.067207014, 2023-10-18T14:14:21.591 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_send_time": 0.024770245, 2023-10-18T14:14:21.591 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_recv_time": 0.027409168, 2023-10-18T14:14:21.591 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_fast_dispatch_time": 0.013186222, 2023-10-18T14:14:21.592 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:21.592 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 999, 2023-10-18T14:14:21.592 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.069527873, 2023-10-18T14:14:21.592 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000069597 2023-10-18T14:14:21.592 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.593 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:21.593 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 803, 2023-10-18T14:14:21.593 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000111541, 2023-10-18T14:14:21.594 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000138 2023-10-18T14:14:21.594 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.594 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_encrypted_bytes": 4544, 2023-10-18T14:14:21.594 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_encrypted_bytes": 5584 2023-10-18T14:14:21.595 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.595 INFO:teuthology.orchestra.run.smithi158.stdout: "AsyncMessenger::Worker-1": { 2023-10-18T14:14:21.595 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_messages": 1123293, 2023-10-18T14:14:21.595 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages": 1125956, 2023-10-18T14:14:21.595 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_bytes": 191611828, 2023-10-18T14:14:21.596 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_bytes": 182925005, 2023-10-18T14:14:21.596 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_created_connections": 11, 2023-10-18T14:14:21.596 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_active_connections": 7, 2023-10-18T14:14:21.596 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_total_time": 31.784844450, 2023-10-18T14:14:21.596 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_send_time": 12.743044623, 2023-10-18T14:14:21.596 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_recv_time": 22.409125425, 2023-10-18T14:14:21.597 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_fast_dispatch_time": 0.031126184, 2023-10-18T14:14:21.597 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:21.597 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 1125955, 2023-10-18T14:14:21.597 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 12.623955909, 2023-10-18T14:14:21.597 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000011211 2023-10-18T14:14:21.598 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.598 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:21.598 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 2006526, 2023-10-18T14:14:21.598 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.210981685, 2023-10-18T14:14:21.599 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000105 2023-10-18T14:14:21.599 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.599 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_encrypted_bytes": 990256, 2023-10-18T14:14:21.599 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_encrypted_bytes": 255232 2023-10-18T14:14:21.600 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.600 INFO:teuthology.orchestra.run.smithi158.stdout: "AsyncMessenger::Worker-2": { 2023-10-18T14:14:21.600 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_messages": 73632, 2023-10-18T14:14:21.600 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages": 72844, 2023-10-18T14:14:21.600 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_bytes": 14694524, 2023-10-18T14:14:21.601 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_bytes": 12566259, 2023-10-18T14:14:21.601 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_created_connections": 12, 2023-10-18T14:14:21.601 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_active_connections": 6, 2023-10-18T14:14:21.601 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_total_time": 2.201647643, 2023-10-18T14:14:21.601 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_send_time": 0.869171116, 2023-10-18T14:14:21.602 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_recv_time": 1.522571186, 2023-10-18T14:14:21.602 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_fast_dispatch_time": 0.015095516, 2023-10-18T14:14:21.602 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:21.603 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 72842, 2023-10-18T14:14:21.603 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.783518796, 2023-10-18T14:14:21.603 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000010756 2023-10-18T14:14:21.603 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.603 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:21.604 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 140069, 2023-10-18T14:14:21.604 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.011981331, 2023-10-18T14:14:21.604 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000085 2023-10-18T14:14:21.604 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.604 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-18T14:14:21.605 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_encrypted_bytes": 335776 2023-10-18T14:14:21.605 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.605 INFO:teuthology.orchestra.run.smithi158.stdout: "cct": { 2023-10-18T14:14:21.605 INFO:teuthology.orchestra.run.smithi158.stdout: "total_workers": 1, 2023-10-18T14:14:21.606 INFO:teuthology.orchestra.run.smithi158.stdout: "unhealthy_workers": 0 2023-10-18T14:14:21.606 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.606 INFO:teuthology.orchestra.run.smithi158.stdout: "finisher-MDSRank": { 2023-10-18T14:14:21.606 INFO:teuthology.orchestra.run.smithi158.stdout: "queue_len": 0, 2023-10-18T14:14:21.607 INFO:teuthology.orchestra.run.smithi158.stdout: "complete_latency": { 2023-10-18T14:14:21.607 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 747, 2023-10-18T14:14:21.607 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 1.208457652, 2023-10-18T14:14:21.607 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.001617747 2023-10-18T14:14:21.607 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:21.607 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.608 INFO:teuthology.orchestra.run.smithi158.stdout: "finisher-PurgeQueue": { 2023-10-18T14:14:21.608 INFO:teuthology.orchestra.run.smithi158.stdout: "queue_len": 0, 2023-10-18T14:14:21.608 INFO:teuthology.orchestra.run.smithi158.stdout: "complete_latency": { 2023-10-18T14:14:21.608 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 1586, 2023-10-18T14:14:21.608 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.376820510, 2023-10-18T14:14:21.609 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000237591 2023-10-18T14:14:21.609 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:21.609 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.609 INFO:teuthology.orchestra.run.smithi158.stdout: "mds": { 2023-10-18T14:14:21.609 INFO:teuthology.orchestra.run.smithi158.stdout: "request": 1955, 2023-10-18T14:14:21.610 INFO:teuthology.orchestra.run.smithi158.stdout: "reply": 1808, 2023-10-18T14:14:21.610 INFO:teuthology.orchestra.run.smithi158.stdout: "reply_latency": { 2023-10-18T14:14:21.610 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 1808, 2023-10-18T14:14:21.610 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 1.613415937, 2023-10-18T14:14:21.610 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000892376 2023-10-18T14:14:21.611 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.611 INFO:teuthology.orchestra.run.smithi158.stdout: "slow_reply": 0, 2023-10-18T14:14:21.611 INFO:teuthology.orchestra.run.smithi158.stdout: "forward": 147, 2023-10-18T14:14:21.611 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_fetch_complete": 0, 2023-10-18T14:14:21.611 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_fetch_keys": 0, 2023-10-18T14:14:21.612 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_commit": 11, 2023-10-18T14:14:21.612 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_split": 0, 2023-10-18T14:14:21.612 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_merge": 0, 2023-10-18T14:14:21.612 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes": 20, 2023-10-18T14:14:21.612 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_top": 4, 2023-10-18T14:14:21.613 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_bottom": 6, 2023-10-18T14:14:21.613 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_pin_tail": 10, 2023-10-18T14:14:21.613 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_pinned": 13, 2023-10-18T14:14:21.614 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_expired": 1915, 2023-10-18T14:14:21.614 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_with_caps": 0, 2023-10-18T14:14:21.614 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": 0, 2023-10-18T14:14:21.614 INFO:teuthology.orchestra.run.smithi158.stdout: "subtrees": 5, 2023-10-18T14:14:21.614 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse": 3225, 2023-10-18T14:14:21.615 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_hit": 2943, 2023-10-18T14:14:21.615 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_forward": 147, 2023-10-18T14:14:21.615 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_discover": 100, 2023-10-18T14:14:21.615 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_dir_fetch": 0, 2023-10-18T14:14:21.615 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_remote_ino": 0, 2023-10-18T14:14:21.616 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_lock": 4, 2023-10-18T14:14:21.616 INFO:teuthology.orchestra.run.smithi158.stdout: "load_cent": 0, 2023-10-18T14:14:21.616 INFO:teuthology.orchestra.run.smithi158.stdout: "q": 0, 2023-10-18T14:14:21.616 INFO:teuthology.orchestra.run.smithi158.stdout: "exported": 60, 2023-10-18T14:14:21.617 INFO:teuthology.orchestra.run.smithi158.stdout: "exported_inodes": 1761, 2023-10-18T14:14:21.617 INFO:teuthology.orchestra.run.smithi158.stdout: "imported": 60, 2023-10-18T14:14:21.617 INFO:teuthology.orchestra.run.smithi158.stdout: "imported_inodes": 982, 2023-10-18T14:14:21.617 INFO:teuthology.orchestra.run.smithi158.stdout: "openino_dir_fetch": 0, 2023-10-18T14:14:21.617 INFO:teuthology.orchestra.run.smithi158.stdout: "openino_backtrace_fetch": 495, 2023-10-18T14:14:21.618 INFO:teuthology.orchestra.run.smithi158.stdout: "openino_peer_discover": 0, 2023-10-18T14:14:21.618 INFO:teuthology.orchestra.run.smithi158.stdout: "root_rfiles": 3565, 2023-10-18T14:14:21.618 INFO:teuthology.orchestra.run.smithi158.stdout: "root_rbytes": 51270625, 2023-10-18T14:14:21.618 INFO:teuthology.orchestra.run.smithi158.stdout: "root_rsnaps": 4, 2023-10-18T14:14:21.618 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_backtrace_fetch": 495, 2023-10-18T14:14:21.619 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_set_tag": 0, 2023-10-18T14:14:21.619 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_backtrace_repaired": 0, 2023-10-18T14:14:21.619 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_inotable_repaired": 0, 2023-10-18T14:14:21.619 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_dir_inodes": 0, 2023-10-18T14:14:21.619 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_dir_base_inodes": 0, 2023-10-18T14:14:21.620 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_dirfrag_rstats": 0, 2023-10-18T14:14:21.620 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_file_inodes": 495, 2023-10-18T14:14:21.620 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_inode_file_caps": 0, 2023-10-18T14:14:21.620 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_revoke": 19, 2023-10-18T14:14:21.620 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_grant": 891, 2023-10-18T14:14:21.621 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_trunc": 0, 2023-10-18T14:14:21.621 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-18T14:14:21.621 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-18T14:14:21.621 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_caps": 481, 2023-10-18T14:14:21.621 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_caps_dirty": 468, 2023-10-18T14:14:21.622 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_cap_release": 20, 2023-10-18T14:14:21.622 INFO:teuthology.orchestra.run.smithi158.stdout: "process_request_cap_release": 1807 2023-10-18T14:14:21.622 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.623 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_cache": { 2023-10-18T14:14:21.623 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_update": 185, 2023-10-18T14:14:21.623 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_update_receipt": 589, 2023-10-18T14:14:21.624 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_try_discover": 338, 2023-10-18T14:14:21.624 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_send_discover": 438, 2023-10-18T14:14:21.624 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_handle_discover": 245, 2023-10-18T14:14:21.624 INFO:teuthology.orchestra.run.smithi158.stdout: "num_strays": 0, 2023-10-18T14:14:21.624 INFO:teuthology.orchestra.run.smithi158.stdout: "num_strays_delayed": 0, 2023-10-18T14:14:21.625 INFO:teuthology.orchestra.run.smithi158.stdout: "num_strays_enqueuing": 0, 2023-10-18T14:14:21.625 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_created": 879, 2023-10-18T14:14:21.625 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_enqueued": 879, 2023-10-18T14:14:21.626 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_reintegrated": 0, 2023-10-18T14:14:21.626 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_migrated": 0, 2023-10-18T14:14:21.626 INFO:teuthology.orchestra.run.smithi158.stdout: "num_recovering_processing": 0, 2023-10-18T14:14:21.627 INFO:teuthology.orchestra.run.smithi158.stdout: "num_recovering_enqueued": 0, 2023-10-18T14:14:21.627 INFO:teuthology.orchestra.run.smithi158.stdout: "num_recovering_prioritized": 0, 2023-10-18T14:14:21.627 INFO:teuthology.orchestra.run.smithi158.stdout: "recovery_started": 0, 2023-10-18T14:14:21.627 INFO:teuthology.orchestra.run.smithi158.stdout: "recovery_completed": 0, 2023-10-18T14:14:21.627 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_enqueue_scrub": 0, 2023-10-18T14:14:21.628 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_exportdir": 60, 2023-10-18T14:14:21.628 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_flush": 0, 2023-10-18T14:14:21.628 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_fragmentdir": 0, 2023-10-18T14:14:21.628 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_fragstats": 0, 2023-10-18T14:14:21.628 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_inodestats": 0 2023-10-18T14:14:21.629 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.629 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_log": { 2023-10-18T14:14:21.629 INFO:teuthology.orchestra.run.smithi158.stdout: "evlrg": 0, 2023-10-18T14:14:21.629 INFO:teuthology.orchestra.run.smithi158.stdout: "evadd": 2529, 2023-10-18T14:14:21.629 INFO:teuthology.orchestra.run.smithi158.stdout: "evex": 0, 2023-10-18T14:14:21.630 INFO:teuthology.orchestra.run.smithi158.stdout: "evtrm": 0, 2023-10-18T14:14:21.630 INFO:teuthology.orchestra.run.smithi158.stdout: "ev": 2529, 2023-10-18T14:14:21.630 INFO:teuthology.orchestra.run.smithi158.stdout: "evexg": 0, 2023-10-18T14:14:21.630 INFO:teuthology.orchestra.run.smithi158.stdout: "evexd": 0, 2023-10-18T14:14:21.630 INFO:teuthology.orchestra.run.smithi158.stdout: "segadd": 4, 2023-10-18T14:14:21.631 INFO:teuthology.orchestra.run.smithi158.stdout: "segex": 0, 2023-10-18T14:14:21.631 INFO:teuthology.orchestra.run.smithi158.stdout: "segtrm": 0, 2023-10-18T14:14:21.631 INFO:teuthology.orchestra.run.smithi158.stdout: "seg": 4, 2023-10-18T14:14:21.631 INFO:teuthology.orchestra.run.smithi158.stdout: "segmjr": 2, 2023-10-18T14:14:21.631 INFO:teuthology.orchestra.run.smithi158.stdout: "segexg": 0, 2023-10-18T14:14:21.632 INFO:teuthology.orchestra.run.smithi158.stdout: "segexd": 0, 2023-10-18T14:14:21.632 INFO:teuthology.orchestra.run.smithi158.stdout: "expos": 4194304, 2023-10-18T14:14:21.632 INFO:teuthology.orchestra.run.smithi158.stdout: "wrpos": 9875714, 2023-10-18T14:14:21.632 INFO:teuthology.orchestra.run.smithi158.stdout: "rdpos": 0, 2023-10-18T14:14:21.632 INFO:teuthology.orchestra.run.smithi158.stdout: "jlat": { 2023-10-18T14:14:21.632 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 198, 2023-10-18T14:14:21.633 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 1.674564873, 2023-10-18T14:14:21.633 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.008457398 2023-10-18T14:14:21.633 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.633 INFO:teuthology.orchestra.run.smithi158.stdout: "replayed": 0 2023-10-18T14:14:21.633 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.634 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_mem": { 2023-10-18T14:14:21.634 INFO:teuthology.orchestra.run.smithi158.stdout: "ino": 26, 2023-10-18T14:14:21.634 INFO:teuthology.orchestra.run.smithi158.stdout: "ino+": 1868, 2023-10-18T14:14:21.634 INFO:teuthology.orchestra.run.smithi158.stdout: "ino-": 1842, 2023-10-18T14:14:21.634 INFO:teuthology.orchestra.run.smithi158.stdout: "dir": 25, 2023-10-18T14:14:21.635 INFO:teuthology.orchestra.run.smithi158.stdout: "dir+": 339, 2023-10-18T14:14:21.635 INFO:teuthology.orchestra.run.smithi158.stdout: "dir-": 314, 2023-10-18T14:14:21.635 INFO:teuthology.orchestra.run.smithi158.stdout: "dn": 20, 2023-10-18T14:14:21.635 INFO:teuthology.orchestra.run.smithi158.stdout: "dn+": 2910, 2023-10-18T14:14:21.636 INFO:teuthology.orchestra.run.smithi158.stdout: "dn-": 2890, 2023-10-18T14:14:21.636 INFO:teuthology.orchestra.run.smithi158.stdout: "cap": 0, 2023-10-18T14:14:21.636 INFO:teuthology.orchestra.run.smithi158.stdout: "cap+": 1769, 2023-10-18T14:14:21.636 INFO:teuthology.orchestra.run.smithi158.stdout: "cap-": 1769, 2023-10-18T14:14:21.636 INFO:teuthology.orchestra.run.smithi158.stdout: "rss": 68992, 2023-10-18T14:14:21.637 INFO:teuthology.orchestra.run.smithi158.stdout: "heap": 198960 2023-10-18T14:14:21.637 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.637 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_server": { 2023-10-18T14:14:21.637 INFO:teuthology.orchestra.run.smithi158.stdout: "dispatch_client_request": 1988, 2023-10-18T14:14:21.637 INFO:teuthology.orchestra.run.smithi158.stdout: "dispatch_server_request": 17, 2023-10-18T14:14:21.638 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_request": 1955, 2023-10-18T14:14:21.638 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_session": 17, 2023-10-18T14:14:21.638 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_peer_request": 76, 2023-10-18T14:14:21.638 INFO:teuthology.orchestra.run.smithi158.stdout: "req_create_latency": { 2023-10-18T14:14:21.639 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.639 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.639 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.639 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.639 INFO:teuthology.orchestra.run.smithi158.stdout: "req_getattr_latency": { 2023-10-18T14:14:21.640 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.640 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.640 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.640 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.640 INFO:teuthology.orchestra.run.smithi158.stdout: "req_getfilelock_latency": { 2023-10-18T14:14:21.641 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.641 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.641 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.641 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.641 INFO:teuthology.orchestra.run.smithi158.stdout: "req_link_latency": { 2023-10-18T14:14:21.642 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.642 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.642 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.642 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.642 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookup_latency": { 2023-10-18T14:14:21.643 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 869, 2023-10-18T14:14:21.643 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.361834210, 2023-10-18T14:14:21.643 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000416379 2023-10-18T14:14:21.643 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.643 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookuphash_latency": { 2023-10-18T14:14:21.644 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.644 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.644 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.644 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.644 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupino_latency": { 2023-10-18T14:14:21.645 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.645 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.645 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.645 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.645 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupname_latency": { 2023-10-18T14:14:21.646 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.646 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.646 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.646 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.646 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupparent_latency": { 2023-10-18T14:14:21.647 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.647 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.647 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.647 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.647 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupsnap_latency": { 2023-10-18T14:14:21.648 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.648 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.648 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.648 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.648 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lssnap_latency": { 2023-10-18T14:14:21.649 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.649 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.649 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.649 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.649 INFO:teuthology.orchestra.run.smithi158.stdout: "req_mkdir_latency": { 2023-10-18T14:14:21.650 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.650 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.650 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.650 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.650 INFO:teuthology.orchestra.run.smithi158.stdout: "req_mknod_latency": { 2023-10-18T14:14:21.651 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.651 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.651 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.651 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.651 INFO:teuthology.orchestra.run.smithi158.stdout: "req_mksnap_latency": { 2023-10-18T14:14:21.652 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.652 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.652 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.652 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.652 INFO:teuthology.orchestra.run.smithi158.stdout: "req_open_latency": { 2023-10-18T14:14:21.653 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.653 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.653 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.653 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.653 INFO:teuthology.orchestra.run.smithi158.stdout: "req_readdir_latency": { 2023-10-18T14:14:21.653 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 60, 2023-10-18T14:14:21.654 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.067406058, 2023-10-18T14:14:21.654 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.001123434 2023-10-18T14:14:21.654 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.654 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rename_latency": { 2023-10-18T14:14:21.655 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.655 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.655 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.655 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.655 INFO:teuthology.orchestra.run.smithi158.stdout: "req_renamesnap_latency": { 2023-10-18T14:14:21.656 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.656 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.656 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.656 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.656 INFO:teuthology.orchestra.run.smithi158.stdout: "req_snapdiff_latency": { 2023-10-18T14:14:21.656 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.657 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.657 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.657 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.657 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rmdir_latency": { 2023-10-18T14:14:21.657 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.658 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.658 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.658 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.658 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rmsnap_latency": { 2023-10-18T14:14:21.659 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.659 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.659 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.659 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.659 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rmxattr_latency": { 2023-10-18T14:14:21.659 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.660 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.660 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.660 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.660 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setattr_latency": { 2023-10-18T14:14:21.660 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.661 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.661 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.661 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.661 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setdirlayout_latency": { 2023-10-18T14:14:21.661 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.662 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.662 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.662 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.662 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setfilelock_latency": { 2023-10-18T14:14:21.662 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.663 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.663 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.663 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.663 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setlayout_latency": { 2023-10-18T14:14:21.663 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.664 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.664 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.664 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.665 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setxattr_latency": { 2023-10-18T14:14:21.665 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.665 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.665 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.665 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.666 INFO:teuthology.orchestra.run.smithi158.stdout: "req_symlink_latency": { 2023-10-18T14:14:21.666 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.666 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.666 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.666 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.667 INFO:teuthology.orchestra.run.smithi158.stdout: "req_unlink_latency": { 2023-10-18T14:14:21.667 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 879, 2023-10-18T14:14:21.667 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 1.184175669, 2023-10-18T14:14:21.667 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.001347185 2023-10-18T14:14:21.668 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.668 INFO:teuthology.orchestra.run.smithi158.stdout: "cap_revoke_eviction": 0, 2023-10-18T14:14:21.668 INFO:teuthology.orchestra.run.smithi158.stdout: "cap_acquisition_throttle": 0, 2023-10-18T14:14:21.668 INFO:teuthology.orchestra.run.smithi158.stdout: "req_getvxattr_latency": { 2023-10-18T14:14:21.668 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.669 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.669 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.669 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:21.669 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.670 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_sessions": { 2023-10-18T14:14:21.670 INFO:teuthology.orchestra.run.smithi158.stdout: "session_count": 2, 2023-10-18T14:14:21.670 INFO:teuthology.orchestra.run.smithi158.stdout: "session_add": 2, 2023-10-18T14:14:21.670 INFO:teuthology.orchestra.run.smithi158.stdout: "session_remove": 0, 2023-10-18T14:14:21.671 INFO:teuthology.orchestra.run.smithi158.stdout: "sessions_open": 2, 2023-10-18T14:14:21.671 INFO:teuthology.orchestra.run.smithi158.stdout: "sessions_stale": 0, 2023-10-18T14:14:21.671 INFO:teuthology.orchestra.run.smithi158.stdout: "total_load": 1693, 2023-10-18T14:14:21.671 INFO:teuthology.orchestra.run.smithi158.stdout: "average_load": 846, 2023-10-18T14:14:21.671 INFO:teuthology.orchestra.run.smithi158.stdout: "avg_session_uptime": 554, 2023-10-18T14:14:21.671 INFO:teuthology.orchestra.run.smithi158.stdout: "mdthresh_evicted": 0 2023-10-18T14:14:21.672 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.672 INFO:teuthology.orchestra.run.smithi158.stdout: "mempool": { 2023-10-18T14:14:21.672 INFO:teuthology.orchestra.run.smithi158.stdout: "bloom_filter_bytes": 0, 2023-10-18T14:14:21.672 INFO:teuthology.orchestra.run.smithi158.stdout: "bloom_filter_items": 0, 2023-10-18T14:14:21.672 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_alloc_bytes": 0, 2023-10-18T14:14:21.673 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_alloc_items": 0, 2023-10-18T14:14:21.673 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_data_bytes": 0, 2023-10-18T14:14:21.673 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_data_items": 0, 2023-10-18T14:14:21.673 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-18T14:14:21.673 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_onode_items": 0, 2023-10-18T14:14:21.674 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-18T14:14:21.674 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_meta_items": 0, 2023-10-18T14:14:21.674 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_other_bytes": 0, 2023-10-18T14:14:21.674 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_other_items": 0, 2023-10-18T14:14:21.674 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-18T14:14:21.675 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_buffer_items": 0, 2023-10-18T14:14:21.675 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_extent_bytes": 0, 2023-10-18T14:14:21.675 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_extent_items": 0, 2023-10-18T14:14:21.675 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_blob_bytes": 0, 2023-10-18T14:14:21.675 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_blob_items": 0, 2023-10-18T14:14:21.676 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-18T14:14:21.676 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_shared_blob_items": 0, 2023-10-18T14:14:21.676 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-18T14:14:21.676 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_inline_bl_items": 0, 2023-10-18T14:14:21.676 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_fsck_bytes": 0, 2023-10-18T14:14:21.677 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_fsck_items": 0, 2023-10-18T14:14:21.677 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_txc_bytes": 0, 2023-10-18T14:14:21.677 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_txc_items": 0, 2023-10-18T14:14:21.677 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-18T14:14:21.677 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_deferred_items": 0, 2023-10-18T14:14:21.678 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_bytes": 0, 2023-10-18T14:14:21.678 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_items": 0, 2023-10-18T14:14:21.678 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_bytes": 0, 2023-10-18T14:14:21.678 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_items": 0, 2023-10-18T14:14:21.679 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_reader_bytes": 0, 2023-10-18T14:14:21.679 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_reader_items": 0, 2023-10-18T14:14:21.679 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_writer_bytes": 0, 2023-10-18T14:14:21.679 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_writer_items": 0, 2023-10-18T14:14:21.679 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_anon_bytes": 300230, 2023-10-18T14:14:21.680 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_anon_items": 126, 2023-10-18T14:14:21.680 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_meta_bytes": 0, 2023-10-18T14:14:21.680 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_meta_items": 0, 2023-10-18T14:14:21.680 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_bytes": 0, 2023-10-18T14:14:21.680 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_items": 0, 2023-10-18T14:14:21.681 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_mapbl_bytes": 0, 2023-10-18T14:14:21.681 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_mapbl_items": 0, 2023-10-18T14:14:21.681 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_pglog_bytes": 0, 2023-10-18T14:14:21.681 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_pglog_items": 0, 2023-10-18T14:14:21.681 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_bytes": 7992, 2023-10-18T14:14:21.681 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_items": 167, 2023-10-18T14:14:21.682 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_mapping_bytes": 0, 2023-10-18T14:14:21.682 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_mapping_items": 0, 2023-10-18T14:14:21.682 INFO:teuthology.orchestra.run.smithi158.stdout: "pgmap_bytes": 0, 2023-10-18T14:14:21.682 INFO:teuthology.orchestra.run.smithi158.stdout: "pgmap_items": 0, 2023-10-18T14:14:21.682 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_co_bytes": 116349, 2023-10-18T14:14:21.683 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_co_items": 430, 2023-10-18T14:14:21.683 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_1_bytes": 0, 2023-10-18T14:14:21.683 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_1_items": 0, 2023-10-18T14:14:21.683 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_2_bytes": 0, 2023-10-18T14:14:21.683 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_2_items": 0 2023-10-18T14:14:21.684 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.684 INFO:teuthology.orchestra.run.smithi158.stdout: "objecter": { 2023-10-18T14:14:21.684 INFO:teuthology.orchestra.run.smithi158.stdout: "op_active": 0, 2023-10-18T14:14:21.684 INFO:teuthology.orchestra.run.smithi158.stdout: "op_laggy": 0, 2023-10-18T14:14:21.684 INFO:teuthology.orchestra.run.smithi158.stdout: "op_send": 1671, 2023-10-18T14:14:21.685 INFO:teuthology.orchestra.run.smithi158.stdout: "op_send_bytes": 5828837, 2023-10-18T14:14:21.685 INFO:teuthology.orchestra.run.smithi158.stdout: "op_resend": 28, 2023-10-18T14:14:21.685 INFO:teuthology.orchestra.run.smithi158.stdout: "op_reply": 1671, 2023-10-18T14:14:21.685 INFO:teuthology.orchestra.run.smithi158.stdout: "op_latency": { 2023-10-18T14:14:21.685 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 1671, 2023-10-18T14:14:21.685 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 5.661936442, 2023-10-18T14:14:21.686 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.003388352 2023-10-18T14:14:21.686 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.686 INFO:teuthology.orchestra.run.smithi158.stdout: "op_inflight": 0, 2023-10-18T14:14:21.686 INFO:teuthology.orchestra.run.smithi158.stdout: "oplen_avg": { 2023-10-18T14:14:21.687 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 1671, 2023-10-18T14:14:21.687 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 1700 2023-10-18T14:14:21.687 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.687 INFO:teuthology.orchestra.run.smithi158.stdout: "op": 1671, 2023-10-18T14:14:21.688 INFO:teuthology.orchestra.run.smithi158.stdout: "op_r": 514, 2023-10-18T14:14:21.688 INFO:teuthology.orchestra.run.smithi158.stdout: "op_w": 1157, 2023-10-18T14:14:21.689 INFO:teuthology.orchestra.run.smithi158.stdout: "op_rmw": 0, 2023-10-18T14:14:21.689 INFO:teuthology.orchestra.run.smithi158.stdout: "op_pg": 0, 2023-10-18T14:14:21.689 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_stat": 0, 2023-10-18T14:14:21.690 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_create": 10, 2023-10-18T14:14:21.690 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_read": 19, 2023-10-18T14:14:21.690 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_write": 217, 2023-10-18T14:14:21.691 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_writefull": 18, 2023-10-18T14:14:21.691 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_writesame": 0, 2023-10-18T14:14:21.691 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_append": 0, 2023-10-18T14:14:21.692 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_zero": 0, 2023-10-18T14:14:21.692 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_truncate": 0, 2023-10-18T14:14:21.692 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_delete": 892, 2023-10-18T14:14:21.692 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_mapext": 0, 2023-10-18T14:14:21.693 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_sparse_read": 0, 2023-10-18T14:14:21.693 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_clonerange": 0, 2023-10-18T14:14:21.693 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_getxattr": 495, 2023-10-18T14:14:21.694 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_setxattr": 20, 2023-10-18T14:14:21.694 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_cmpxattr": 0, 2023-10-18T14:14:21.694 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_rmxattr": 0, 2023-10-18T14:14:21.694 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_resetxattrs": 0, 2023-10-18T14:14:21.695 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_call": 0, 2023-10-18T14:14:21.695 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_watch": 0, 2023-10-18T14:14:21.695 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_notify": 0, 2023-10-18T14:14:21.695 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_src_cmpxattr": 0, 2023-10-18T14:14:21.695 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_pgls": 0, 2023-10-18T14:14:21.696 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_pgls_filter": 0, 2023-10-18T14:14:21.696 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_other": 0, 2023-10-18T14:14:21.696 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_active": 0, 2023-10-18T14:14:21.696 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_send": 0, 2023-10-18T14:14:21.696 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_resend": 0, 2023-10-18T14:14:21.697 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_ping": 0, 2023-10-18T14:14:21.697 INFO:teuthology.orchestra.run.smithi158.stdout: "poolop_active": 0, 2023-10-18T14:14:21.697 INFO:teuthology.orchestra.run.smithi158.stdout: "poolop_send": 0, 2023-10-18T14:14:21.697 INFO:teuthology.orchestra.run.smithi158.stdout: "poolop_resend": 0, 2023-10-18T14:14:21.697 INFO:teuthology.orchestra.run.smithi158.stdout: "poolstat_active": 0, 2023-10-18T14:14:21.698 INFO:teuthology.orchestra.run.smithi158.stdout: "poolstat_send": 0, 2023-10-18T14:14:21.698 INFO:teuthology.orchestra.run.smithi158.stdout: "poolstat_resend": 0, 2023-10-18T14:14:21.698 INFO:teuthology.orchestra.run.smithi158.stdout: "statfs_active": 0, 2023-10-18T14:14:21.698 INFO:teuthology.orchestra.run.smithi158.stdout: "statfs_send": 0, 2023-10-18T14:14:21.698 INFO:teuthology.orchestra.run.smithi158.stdout: "statfs_resend": 0, 2023-10-18T14:14:21.699 INFO:teuthology.orchestra.run.smithi158.stdout: "command_active": 0, 2023-10-18T14:14:21.699 INFO:teuthology.orchestra.run.smithi158.stdout: "command_send": 0, 2023-10-18T14:14:21.699 INFO:teuthology.orchestra.run.smithi158.stdout: "command_resend": 0, 2023-10-18T14:14:21.699 INFO:teuthology.orchestra.run.smithi158.stdout: "map_epoch": 94, 2023-10-18T14:14:21.699 INFO:teuthology.orchestra.run.smithi158.stdout: "map_full": 0, 2023-10-18T14:14:21.700 INFO:teuthology.orchestra.run.smithi158.stdout: "map_inc": 11, 2023-10-18T14:14:21.700 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_sessions": 12, 2023-10-18T14:14:21.700 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_session_open": 12, 2023-10-18T14:14:21.700 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_session_close": 0, 2023-10-18T14:14:21.700 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_laggy": 0, 2023-10-18T14:14:21.701 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_wr": 24, 2023-10-18T14:14:21.701 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_rd": 0, 2023-10-18T14:14:21.701 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_del": 5 2023-10-18T14:14:21.701 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.701 INFO:teuthology.orchestra.run.smithi158.stdout: "oft": { 2023-10-18T14:14:21.702 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_objs": 1, 2023-10-18T14:14:21.702 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_kv_pairs": 0, 2023-10-18T14:14:21.702 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_updates": 0, 2023-10-18T14:14:21.702 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_removes": 0 2023-10-18T14:14:21.703 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.703 INFO:teuthology.orchestra.run.smithi158.stdout: "osd-slow-ops": { 2023-10-18T14:14:21.703 INFO:teuthology.orchestra.run.smithi158.stdout: "slow_ops_count": 0 2023-10-18T14:14:21.704 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.704 INFO:teuthology.orchestra.run.smithi158.stdout: "purge_queue": { 2023-10-18T14:14:21.704 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing_ops": 0, 2023-10-18T14:14:21.705 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing_ops_high_water": 6, 2023-10-18T14:14:21.705 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing": 0, 2023-10-18T14:14:21.705 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing_high_water": 6, 2023-10-18T14:14:21.706 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executed": 879, 2023-10-18T14:14:21.706 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_item_in_journal": 0 2023-10-18T14:14:21.707 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.707 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-18T14:14:21.708 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:21.708 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 104857600, 2023-10-18T14:14:21.708 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:21.709 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 1197889, 2023-10-18T14:14:21.709 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 98871481, 2023-10-18T14:14:21.709 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:21.710 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 1197889, 2023-10-18T14:14:21.710 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 0, 2023-10-18T14:14:21.710 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 0, 2023-10-18T14:14:21.710 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 1197889, 2023-10-18T14:14:21.711 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 98871481, 2023-10-18T14:14:21.711 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:21.711 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.712 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.712 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.712 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:21.712 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.713 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-objecter_bytes": { 2023-10-18T14:14:21.713 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:21.713 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 104857600, 2023-10-18T14:14:21.713 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:21.713 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:21.714 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:21.714 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:21.714 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:21.714 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 1671, 2023-10-18T14:14:21.715 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 5938712, 2023-10-18T14:14:21.715 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 1671, 2023-10-18T14:14:21.715 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 5938712, 2023-10-18T14:14:21.715 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:21.715 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.716 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.716 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.716 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:21.716 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.716 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-objecter_ops": { 2023-10-18T14:14:21.717 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:21.717 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 1024, 2023-10-18T14:14:21.717 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:21.717 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:21.717 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:21.718 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:21.718 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:21.718 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 1671, 2023-10-18T14:14:21.718 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 1671, 2023-10-18T14:14:21.719 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 1671, 2023-10-18T14:14:21.719 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 1671, 2023-10-18T14:14:21.719 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:21.719 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.719 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.720 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.720 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:21.720 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.720 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-write_buf_throttle": { 2023-10-18T14:14:21.720 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:21.721 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 3758096384, 2023-10-18T14:14:21.721 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:21.721 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 879, 2023-10-18T14:14:21.721 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 109875, 2023-10-18T14:14:21.721 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:21.721 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 879, 2023-10-18T14:14:21.722 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 0, 2023-10-18T14:14:21.722 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 0, 2023-10-18T14:14:21.722 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 19, 2023-10-18T14:14:21.722 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 109875, 2023-10-18T14:14:21.723 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:21.723 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.723 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.723 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.723 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:21.724 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:21.724 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-write_buf_throttle-0x5639146706e0": { 2023-10-18T14:14:21.724 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:21.724 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 3758096384, 2023-10-18T14:14:21.724 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:21.725 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 2529, 2023-10-18T14:14:21.725 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 5681410, 2023-10-18T14:14:21.725 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:21.725 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 2529, 2023-10-18T14:14:21.725 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 0, 2023-10-18T14:14:21.726 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 0, 2023-10-18T14:14:21.726 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 198, 2023-10-18T14:14:21.726 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 5681410, 2023-10-18T14:14:21.726 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:21.727 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:21.727 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:21.727 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:21.727 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:21.727 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:21.728 INFO:teuthology.orchestra.run.smithi158.stdout:} 2023-10-18T14:14:22.063 INFO:tasks.check_counter:Daemon mds.b mds.exported=60 2023-10-18T14:14:22.064 INFO:tasks.check_counter:Daemon mds.b mds.imported=60 2023-10-18T14:14:22.064 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=185 2023-10-18T14:14:22.064 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=589 2023-10-18T14:14:22.064 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=4 2023-10-18T14:14:22.065 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2023-10-18T14:14:22.065 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2023-10-18T14:14:22.065 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=0 2023-10-18T14:14:22.065 DEBUG:tasks.check_counter:Getting stats from e 2023-10-18T14:14:22.066 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-18T14:14:22.630 INFO:teuthology.orchestra.run.smithi158.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-18T14:14:23.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:22 smithi114 ceph-mon[99494]: pgmap v599: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:14:23.093 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:22 smithi158 ceph-mon[103317]: pgmap v599: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:14:23.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:22 smithi172 ceph-mon[103574]: pgmap v599: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:14:23.967 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2023-10-18T14:14:23.967 INFO:teuthology.orchestra.run.smithi158.stdout: "AsyncMessenger::Worker-0": { 2023-10-18T14:14:23.967 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_messages": 255, 2023-10-18T14:14:23.967 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages": 215, 2023-10-18T14:14:23.968 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_bytes": 985682, 2023-10-18T14:14:23.968 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_bytes": 121613, 2023-10-18T14:14:23.968 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_created_connections": 5, 2023-10-18T14:14:23.968 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_active_connections": 1, 2023-10-18T14:14:23.968 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_total_time": 0.039264015, 2023-10-18T14:14:23.969 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_send_time": 0.013095085, 2023-10-18T14:14:23.969 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_recv_time": 0.023365062, 2023-10-18T14:14:23.969 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_fast_dispatch_time": 0.005695907, 2023-10-18T14:14:23.969 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:23.969 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 214, 2023-10-18T14:14:23.970 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.012019054, 2023-10-18T14:14:23.970 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000056163 2023-10-18T14:14:23.970 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.970 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:23.971 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:23.971 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:23.971 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:23.971 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.971 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_encrypted_bytes": 984848, 2023-10-18T14:14:23.971 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_encrypted_bytes": 121296 2023-10-18T14:14:23.972 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.972 INFO:teuthology.orchestra.run.smithi158.stdout: "AsyncMessenger::Worker-1": { 2023-10-18T14:14:23.972 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_messages": 625, 2023-10-18T14:14:23.972 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages": 774, 2023-10-18T14:14:23.972 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_bytes": 1676063, 2023-10-18T14:14:23.973 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_bytes": 529333, 2023-10-18T14:14:23.973 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_created_connections": 5, 2023-10-18T14:14:23.973 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_active_connections": 4, 2023-10-18T14:14:23.973 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_total_time": 0.058275333, 2023-10-18T14:14:23.974 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_send_time": 0.019431886, 2023-10-18T14:14:23.974 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_recv_time": 0.013469590, 2023-10-18T14:14:23.974 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_fast_dispatch_time": 0.018903112, 2023-10-18T14:14:23.974 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:23.974 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 772, 2023-10-18T14:14:23.975 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.033190778, 2023-10-18T14:14:23.975 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000042993 2023-10-18T14:14:23.975 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.975 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:23.975 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:23.976 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:23.976 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:23.976 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.976 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-18T14:14:23.976 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_encrypted_bytes": 335264 2023-10-18T14:14:23.977 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.977 INFO:teuthology.orchestra.run.smithi158.stdout: "AsyncMessenger::Worker-2": { 2023-10-18T14:14:23.977 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_messages": 1430, 2023-10-18T14:14:23.977 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages": 1430, 2023-10-18T14:14:23.977 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_bytes": 4626195, 2023-10-18T14:14:23.978 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_bytes": 443992, 2023-10-18T14:14:23.978 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_created_connections": 4, 2023-10-18T14:14:23.978 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_active_connections": 3, 2023-10-18T14:14:23.978 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_total_time": 0.133753018, 2023-10-18T14:14:23.978 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_send_time": 0.043229303, 2023-10-18T14:14:23.979 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_recv_time": 0.032925810, 2023-10-18T14:14:23.979 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_fast_dispatch_time": 0.045694578, 2023-10-18T14:14:23.979 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:23.979 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 1429, 2023-10-18T14:14:23.979 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.055091941, 2023-10-18T14:14:23.980 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000038552 2023-10-18T14:14:23.980 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.980 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:23.980 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:23.980 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:23.981 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:23.981 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.981 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-18T14:14:23.981 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_encrypted_bytes": 448 2023-10-18T14:14:23.981 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.982 INFO:teuthology.orchestra.run.smithi158.stdout: "cct": { 2023-10-18T14:14:23.982 INFO:teuthology.orchestra.run.smithi158.stdout: "total_workers": 1, 2023-10-18T14:14:23.982 INFO:teuthology.orchestra.run.smithi158.stdout: "unhealthy_workers": 0 2023-10-18T14:14:23.982 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.982 INFO:teuthology.orchestra.run.smithi158.stdout: "finisher-MDSRank": { 2023-10-18T14:14:23.983 INFO:teuthology.orchestra.run.smithi158.stdout: "queue_len": 0, 2023-10-18T14:14:23.983 INFO:teuthology.orchestra.run.smithi158.stdout: "complete_latency": { 2023-10-18T14:14:23.983 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 3423, 2023-10-18T14:14:23.983 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.099696861, 2023-10-18T14:14:23.983 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000029125 2023-10-18T14:14:23.983 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:23.984 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.984 INFO:teuthology.orchestra.run.smithi158.stdout: "finisher-PurgeQueue": { 2023-10-18T14:14:23.984 INFO:teuthology.orchestra.run.smithi158.stdout: "queue_len": 0, 2023-10-18T14:14:23.985 INFO:teuthology.orchestra.run.smithi158.stdout: "complete_latency": { 2023-10-18T14:14:23.985 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:23.985 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:23.985 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:23.985 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:23.986 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.986 INFO:teuthology.orchestra.run.smithi158.stdout: "mds": { 2023-10-18T14:14:23.986 INFO:teuthology.orchestra.run.smithi158.stdout: "request": 0, 2023-10-18T14:14:23.986 INFO:teuthology.orchestra.run.smithi158.stdout: "reply": 0, 2023-10-18T14:14:23.986 INFO:teuthology.orchestra.run.smithi158.stdout: "reply_latency": { 2023-10-18T14:14:23.986 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:23.987 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:23.987 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:23.987 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.987 INFO:teuthology.orchestra.run.smithi158.stdout: "slow_reply": 0, 2023-10-18T14:14:23.987 INFO:teuthology.orchestra.run.smithi158.stdout: "forward": 0, 2023-10-18T14:14:23.988 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_fetch_complete": 0, 2023-10-18T14:14:23.988 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_fetch_keys": 0, 2023-10-18T14:14:23.988 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_commit": 0, 2023-10-18T14:14:23.988 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_split": 0, 2023-10-18T14:14:23.988 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_merge": 0, 2023-10-18T14:14:23.989 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes": 965, 2023-10-18T14:14:23.989 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_top": 0, 2023-10-18T14:14:23.989 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_bottom": 0, 2023-10-18T14:14:23.989 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_pin_tail": 965, 2023-10-18T14:14:23.989 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_pinned": 965, 2023-10-18T14:14:23.990 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_expired": 62, 2023-10-18T14:14:23.990 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_with_caps": 0, 2023-10-18T14:14:23.990 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": 0, 2023-10-18T14:14:23.990 INFO:teuthology.orchestra.run.smithi158.stdout: "subtrees": 1, 2023-10-18T14:14:23.990 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse": 0, 2023-10-18T14:14:23.991 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_hit": 0, 2023-10-18T14:14:23.991 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_forward": 0, 2023-10-18T14:14:23.991 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_discover": 0, 2023-10-18T14:14:23.991 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_dir_fetch": 0, 2023-10-18T14:14:23.991 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_remote_ino": 0, 2023-10-18T14:14:23.991 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_lock": 0, 2023-10-18T14:14:23.992 INFO:teuthology.orchestra.run.smithi158.stdout: "load_cent": 0, 2023-10-18T14:14:23.992 INFO:teuthology.orchestra.run.smithi158.stdout: "q": 0, 2023-10-18T14:14:23.992 INFO:teuthology.orchestra.run.smithi158.stdout: "exported": 0, 2023-10-18T14:14:23.992 INFO:teuthology.orchestra.run.smithi158.stdout: "exported_inodes": 0, 2023-10-18T14:14:23.992 INFO:teuthology.orchestra.run.smithi158.stdout: "imported": 0, 2023-10-18T14:14:23.993 INFO:teuthology.orchestra.run.smithi158.stdout: "imported_inodes": 0, 2023-10-18T14:14:23.993 INFO:teuthology.orchestra.run.smithi158.stdout: "openino_dir_fetch": 0, 2023-10-18T14:14:23.993 INFO:teuthology.orchestra.run.smithi158.stdout: "openino_backtrace_fetch": 0, 2023-10-18T14:14:23.993 INFO:teuthology.orchestra.run.smithi158.stdout: "openino_peer_discover": 0, 2023-10-18T14:14:23.993 INFO:teuthology.orchestra.run.smithi158.stdout: "root_rfiles": 0, 2023-10-18T14:14:23.994 INFO:teuthology.orchestra.run.smithi158.stdout: "root_rbytes": 0, 2023-10-18T14:14:23.994 INFO:teuthology.orchestra.run.smithi158.stdout: "root_rsnaps": 0, 2023-10-18T14:14:23.994 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_backtrace_fetch": 0, 2023-10-18T14:14:23.994 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_set_tag": 0, 2023-10-18T14:14:23.994 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_backtrace_repaired": 0, 2023-10-18T14:14:23.995 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_inotable_repaired": 0, 2023-10-18T14:14:23.995 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_dir_inodes": 0, 2023-10-18T14:14:23.995 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_dir_base_inodes": 0, 2023-10-18T14:14:23.995 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_dirfrag_rstats": 0, 2023-10-18T14:14:23.995 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_file_inodes": 0, 2023-10-18T14:14:23.996 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_inode_file_caps": 0, 2023-10-18T14:14:23.996 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_revoke": 0, 2023-10-18T14:14:23.996 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_grant": 0, 2023-10-18T14:14:23.996 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_trunc": 0, 2023-10-18T14:14:23.996 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-18T14:14:23.997 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-18T14:14:23.997 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_caps": 0, 2023-10-18T14:14:23.997 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_caps_dirty": 0, 2023-10-18T14:14:23.997 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_cap_release": 0, 2023-10-18T14:14:23.997 INFO:teuthology.orchestra.run.smithi158.stdout: "process_request_cap_release": 0 2023-10-18T14:14:23.997 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:23.998 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_cache": { 2023-10-18T14:14:23.998 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_update": 0, 2023-10-18T14:14:23.998 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_update_receipt": 0, 2023-10-18T14:14:23.998 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_try_discover": 0, 2023-10-18T14:14:23.998 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_send_discover": 0, 2023-10-18T14:14:23.999 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_handle_discover": 0, 2023-10-18T14:14:23.999 INFO:teuthology.orchestra.run.smithi158.stdout: "num_strays": 0, 2023-10-18T14:14:23.999 INFO:teuthology.orchestra.run.smithi158.stdout: "num_strays_delayed": 0, 2023-10-18T14:14:23.999 INFO:teuthology.orchestra.run.smithi158.stdout: "num_strays_enqueuing": 0, 2023-10-18T14:14:23.999 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_created": 0, 2023-10-18T14:14:24.000 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_enqueued": 0, 2023-10-18T14:14:24.000 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_reintegrated": 0, 2023-10-18T14:14:24.000 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_migrated": 0, 2023-10-18T14:14:24.000 INFO:teuthology.orchestra.run.smithi158.stdout: "num_recovering_processing": 0, 2023-10-18T14:14:24.000 INFO:teuthology.orchestra.run.smithi158.stdout: "num_recovering_enqueued": 0, 2023-10-18T14:14:24.001 INFO:teuthology.orchestra.run.smithi158.stdout: "num_recovering_prioritized": 0, 2023-10-18T14:14:24.001 INFO:teuthology.orchestra.run.smithi158.stdout: "recovery_started": 0, 2023-10-18T14:14:24.001 INFO:teuthology.orchestra.run.smithi158.stdout: "recovery_completed": 0, 2023-10-18T14:14:24.001 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_enqueue_scrub": 0, 2023-10-18T14:14:24.001 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_exportdir": 0, 2023-10-18T14:14:24.002 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_flush": 0, 2023-10-18T14:14:24.002 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_fragmentdir": 0, 2023-10-18T14:14:24.002 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_fragstats": 0, 2023-10-18T14:14:24.002 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_inodestats": 0 2023-10-18T14:14:24.002 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.003 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_log": { 2023-10-18T14:14:24.003 INFO:teuthology.orchestra.run.smithi158.stdout: "evlrg": 0, 2023-10-18T14:14:24.003 INFO:teuthology.orchestra.run.smithi158.stdout: "evadd": 0, 2023-10-18T14:14:24.003 INFO:teuthology.orchestra.run.smithi158.stdout: "evex": 0, 2023-10-18T14:14:24.003 INFO:teuthology.orchestra.run.smithi158.stdout: "evtrm": 0, 2023-10-18T14:14:24.003 INFO:teuthology.orchestra.run.smithi158.stdout: "ev": 2574, 2023-10-18T14:14:24.004 INFO:teuthology.orchestra.run.smithi158.stdout: "evexg": 0, 2023-10-18T14:14:24.004 INFO:teuthology.orchestra.run.smithi158.stdout: "evexd": 0, 2023-10-18T14:14:24.004 INFO:teuthology.orchestra.run.smithi158.stdout: "segadd": 0, 2023-10-18T14:14:24.004 INFO:teuthology.orchestra.run.smithi158.stdout: "segex": 0, 2023-10-18T14:14:24.004 INFO:teuthology.orchestra.run.smithi158.stdout: "segtrm": 0, 2023-10-18T14:14:24.005 INFO:teuthology.orchestra.run.smithi158.stdout: "seg": 4, 2023-10-18T14:14:24.005 INFO:teuthology.orchestra.run.smithi158.stdout: "segmjr": 2, 2023-10-18T14:14:24.005 INFO:teuthology.orchestra.run.smithi158.stdout: "segexg": 0, 2023-10-18T14:14:24.005 INFO:teuthology.orchestra.run.smithi158.stdout: "segexd": 0, 2023-10-18T14:14:24.005 INFO:teuthology.orchestra.run.smithi158.stdout: "expos": 4194304, 2023-10-18T14:14:24.006 INFO:teuthology.orchestra.run.smithi158.stdout: "wrpos": 9905561, 2023-10-18T14:14:24.006 INFO:teuthology.orchestra.run.smithi158.stdout: "rdpos": 9902701, 2023-10-18T14:14:24.006 INFO:teuthology.orchestra.run.smithi158.stdout: "jlat": { 2023-10-18T14:14:24.006 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.006 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.007 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.007 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.007 INFO:teuthology.orchestra.run.smithi158.stdout: "replayed": 2574 2023-10-18T14:14:24.007 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.007 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_mem": { 2023-10-18T14:14:24.008 INFO:teuthology.orchestra.run.smithi158.stdout: "ino": 6, 2023-10-18T14:14:24.008 INFO:teuthology.orchestra.run.smithi158.stdout: "ino+": 1952, 2023-10-18T14:14:24.008 INFO:teuthology.orchestra.run.smithi158.stdout: "ino-": 1946, 2023-10-18T14:14:24.008 INFO:teuthology.orchestra.run.smithi158.stdout: "dir": 4, 2023-10-18T14:14:24.008 INFO:teuthology.orchestra.run.smithi158.stdout: "dir+": 62, 2023-10-18T14:14:24.008 INFO:teuthology.orchestra.run.smithi158.stdout: "dir-": 58, 2023-10-18T14:14:24.009 INFO:teuthology.orchestra.run.smithi158.stdout: "dn": 965, 2023-10-18T14:14:24.009 INFO:teuthology.orchestra.run.smithi158.stdout: "dn+": 3036, 2023-10-18T14:14:24.009 INFO:teuthology.orchestra.run.smithi158.stdout: "dn-": 2071, 2023-10-18T14:14:24.009 INFO:teuthology.orchestra.run.smithi158.stdout: "cap": 0, 2023-10-18T14:14:24.009 INFO:teuthology.orchestra.run.smithi158.stdout: "cap+": 0, 2023-10-18T14:14:24.010 INFO:teuthology.orchestra.run.smithi158.stdout: "cap-": 0, 2023-10-18T14:14:24.010 INFO:teuthology.orchestra.run.smithi158.stdout: "rss": 54688, 2023-10-18T14:14:24.010 INFO:teuthology.orchestra.run.smithi158.stdout: "heap": 207152 2023-10-18T14:14:24.010 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.010 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_server": { 2023-10-18T14:14:24.011 INFO:teuthology.orchestra.run.smithi158.stdout: "dispatch_client_request": 0, 2023-10-18T14:14:24.011 INFO:teuthology.orchestra.run.smithi158.stdout: "dispatch_server_request": 0, 2023-10-18T14:14:24.011 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_request": 0, 2023-10-18T14:14:24.011 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_session": 0, 2023-10-18T14:14:24.011 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_peer_request": 0, 2023-10-18T14:14:24.012 INFO:teuthology.orchestra.run.smithi158.stdout: "req_create_latency": { 2023-10-18T14:14:24.012 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.012 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.012 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.012 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.013 INFO:teuthology.orchestra.run.smithi158.stdout: "req_getattr_latency": { 2023-10-18T14:14:24.013 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.013 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.013 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.013 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.013 INFO:teuthology.orchestra.run.smithi158.stdout: "req_getfilelock_latency": { 2023-10-18T14:14:24.014 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.014 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.014 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.014 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.014 INFO:teuthology.orchestra.run.smithi158.stdout: "req_link_latency": { 2023-10-18T14:14:24.015 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.015 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.015 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.015 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.015 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookup_latency": { 2023-10-18T14:14:24.016 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.016 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.016 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.016 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.016 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookuphash_latency": { 2023-10-18T14:14:24.017 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.017 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.017 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.017 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.017 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupino_latency": { 2023-10-18T14:14:24.018 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.018 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.018 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.018 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.018 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupname_latency": { 2023-10-18T14:14:24.019 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.019 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.019 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.019 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.020 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupparent_latency": { 2023-10-18T14:14:24.020 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.020 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.020 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.020 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.021 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupsnap_latency": { 2023-10-18T14:14:24.021 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.021 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.021 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.021 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.022 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lssnap_latency": { 2023-10-18T14:14:24.022 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.022 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.022 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.022 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.023 INFO:teuthology.orchestra.run.smithi158.stdout: "req_mkdir_latency": { 2023-10-18T14:14:24.023 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.023 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.023 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.023 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.024 INFO:teuthology.orchestra.run.smithi158.stdout: "req_mknod_latency": { 2023-10-18T14:14:24.024 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.024 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.024 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.024 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.025 INFO:teuthology.orchestra.run.smithi158.stdout: "req_mksnap_latency": { 2023-10-18T14:14:24.025 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.025 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.025 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.025 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.026 INFO:teuthology.orchestra.run.smithi158.stdout: "req_open_latency": { 2023-10-18T14:14:24.026 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.026 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.026 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.026 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.026 INFO:teuthology.orchestra.run.smithi158.stdout: "req_readdir_latency": { 2023-10-18T14:14:24.027 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.027 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.027 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.027 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.028 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rename_latency": { 2023-10-18T14:14:24.028 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.028 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.028 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.028 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.029 INFO:teuthology.orchestra.run.smithi158.stdout: "req_renamesnap_latency": { 2023-10-18T14:14:24.029 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.029 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.029 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.030 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.030 INFO:teuthology.orchestra.run.smithi158.stdout: "req_snapdiff_latency": { 2023-10-18T14:14:24.030 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.030 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.030 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.031 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.031 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rmdir_latency": { 2023-10-18T14:14:24.031 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.031 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.031 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.031 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.032 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rmsnap_latency": { 2023-10-18T14:14:24.032 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.032 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.032 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.032 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.033 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rmxattr_latency": { 2023-10-18T14:14:24.033 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.033 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.033 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.033 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.034 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setattr_latency": { 2023-10-18T14:14:24.034 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.034 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.034 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.035 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.035 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setdirlayout_latency": { 2023-10-18T14:14:24.035 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.035 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.035 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.036 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.036 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setfilelock_latency": { 2023-10-18T14:14:24.036 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.036 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.036 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.037 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.037 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setlayout_latency": { 2023-10-18T14:14:24.037 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.037 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.037 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.038 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.038 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setxattr_latency": { 2023-10-18T14:14:24.038 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.038 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.038 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.038 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.039 INFO:teuthology.orchestra.run.smithi158.stdout: "req_symlink_latency": { 2023-10-18T14:14:24.039 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.039 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.039 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.039 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.040 INFO:teuthology.orchestra.run.smithi158.stdout: "req_unlink_latency": { 2023-10-18T14:14:24.040 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.040 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.040 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.041 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.041 INFO:teuthology.orchestra.run.smithi158.stdout: "cap_revoke_eviction": 0, 2023-10-18T14:14:24.041 INFO:teuthology.orchestra.run.smithi158.stdout: "cap_acquisition_throttle": 0, 2023-10-18T14:14:24.041 INFO:teuthology.orchestra.run.smithi158.stdout: "req_getvxattr_latency": { 2023-10-18T14:14:24.041 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.042 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.042 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.042 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:24.042 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.042 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_sessions": { 2023-10-18T14:14:24.043 INFO:teuthology.orchestra.run.smithi158.stdout: "session_count": 2, 2023-10-18T14:14:24.043 INFO:teuthology.orchestra.run.smithi158.stdout: "session_add": 2, 2023-10-18T14:14:24.043 INFO:teuthology.orchestra.run.smithi158.stdout: "session_remove": 0, 2023-10-18T14:14:24.043 INFO:teuthology.orchestra.run.smithi158.stdout: "sessions_open": 2, 2023-10-18T14:14:24.043 INFO:teuthology.orchestra.run.smithi158.stdout: "sessions_stale": 0, 2023-10-18T14:14:24.044 INFO:teuthology.orchestra.run.smithi158.stdout: "total_load": 0, 2023-10-18T14:14:24.044 INFO:teuthology.orchestra.run.smithi158.stdout: "average_load": 0, 2023-10-18T14:14:24.044 INFO:teuthology.orchestra.run.smithi158.stdout: "avg_session_uptime": 1991, 2023-10-18T14:14:24.045 INFO:teuthology.orchestra.run.smithi158.stdout: "mdthresh_evicted": 0 2023-10-18T14:14:24.045 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.045 INFO:teuthology.orchestra.run.smithi158.stdout: "mempool": { 2023-10-18T14:14:24.046 INFO:teuthology.orchestra.run.smithi158.stdout: "bloom_filter_bytes": 0, 2023-10-18T14:14:24.046 INFO:teuthology.orchestra.run.smithi158.stdout: "bloom_filter_items": 0, 2023-10-18T14:14:24.047 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_alloc_bytes": 0, 2023-10-18T14:14:24.047 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_alloc_items": 0, 2023-10-18T14:14:24.047 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_data_bytes": 0, 2023-10-18T14:14:24.047 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_data_items": 0, 2023-10-18T14:14:24.047 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-18T14:14:24.048 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_onode_items": 0, 2023-10-18T14:14:24.048 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-18T14:14:24.048 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_meta_items": 0, 2023-10-18T14:14:24.048 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_other_bytes": 0, 2023-10-18T14:14:24.048 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_other_items": 0, 2023-10-18T14:14:24.049 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-18T14:14:24.049 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_buffer_items": 0, 2023-10-18T14:14:24.049 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_extent_bytes": 0, 2023-10-18T14:14:24.049 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_extent_items": 0, 2023-10-18T14:14:24.049 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_blob_bytes": 0, 2023-10-18T14:14:24.050 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_blob_items": 0, 2023-10-18T14:14:24.050 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-18T14:14:24.050 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_shared_blob_items": 0, 2023-10-18T14:14:24.050 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-18T14:14:24.050 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_inline_bl_items": 0, 2023-10-18T14:14:24.051 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_fsck_bytes": 0, 2023-10-18T14:14:24.051 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_fsck_items": 0, 2023-10-18T14:14:24.051 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_txc_bytes": 0, 2023-10-18T14:14:24.051 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_txc_items": 0, 2023-10-18T14:14:24.051 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-18T14:14:24.052 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_deferred_items": 0, 2023-10-18T14:14:24.052 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_bytes": 0, 2023-10-18T14:14:24.052 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_items": 0, 2023-10-18T14:14:24.052 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_bytes": 0, 2023-10-18T14:14:24.052 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_items": 0, 2023-10-18T14:14:24.052 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_reader_bytes": 0, 2023-10-18T14:14:24.053 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_reader_items": 0, 2023-10-18T14:14:24.053 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_writer_bytes": 0, 2023-10-18T14:14:24.053 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_writer_items": 0, 2023-10-18T14:14:24.053 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_anon_bytes": 189423, 2023-10-18T14:14:24.053 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_anon_items": 51, 2023-10-18T14:14:24.054 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_meta_bytes": 0, 2023-10-18T14:14:24.054 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_meta_items": 0, 2023-10-18T14:14:24.054 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_bytes": 0, 2023-10-18T14:14:24.054 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_items": 0, 2023-10-18T14:14:24.054 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_mapbl_bytes": 0, 2023-10-18T14:14:24.055 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_mapbl_items": 0, 2023-10-18T14:14:24.055 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_pglog_bytes": 0, 2023-10-18T14:14:24.055 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_pglog_items": 0, 2023-10-18T14:14:24.055 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_bytes": 7872, 2023-10-18T14:14:24.055 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_items": 164, 2023-10-18T14:14:24.056 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_mapping_bytes": 0, 2023-10-18T14:14:24.056 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_mapping_items": 0, 2023-10-18T14:14:24.056 INFO:teuthology.orchestra.run.smithi158.stdout: "pgmap_bytes": 0, 2023-10-18T14:14:24.056 INFO:teuthology.orchestra.run.smithi158.stdout: "pgmap_items": 0, 2023-10-18T14:14:24.056 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_co_bytes": 701392, 2023-10-18T14:14:24.057 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_co_items": 3918, 2023-10-18T14:14:24.057 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_1_bytes": 0, 2023-10-18T14:14:24.057 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_1_items": 0, 2023-10-18T14:14:24.057 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_2_bytes": 0, 2023-10-18T14:14:24.057 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_2_items": 0 2023-10-18T14:14:24.057 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.058 INFO:teuthology.orchestra.run.smithi158.stdout: "objecter": { 2023-10-18T14:14:24.058 INFO:teuthology.orchestra.run.smithi158.stdout: "op_active": 0, 2023-10-18T14:14:24.058 INFO:teuthology.orchestra.run.smithi158.stdout: "op_laggy": 0, 2023-10-18T14:14:24.058 INFO:teuthology.orchestra.run.smithi158.stdout: "op_send": 2051, 2023-10-18T14:14:24.059 INFO:teuthology.orchestra.run.smithi158.stdout: "op_send_bytes": 21, 2023-10-18T14:14:24.059 INFO:teuthology.orchestra.run.smithi158.stdout: "op_resend": 3, 2023-10-18T14:14:24.059 INFO:teuthology.orchestra.run.smithi158.stdout: "op_reply": 2051, 2023-10-18T14:14:24.059 INFO:teuthology.orchestra.run.smithi158.stdout: "op_latency": { 2023-10-18T14:14:24.059 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 2051, 2023-10-18T14:14:24.060 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 1.736980663, 2023-10-18T14:14:24.060 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000846894 2023-10-18T14:14:24.060 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.060 INFO:teuthology.orchestra.run.smithi158.stdout: "op_inflight": 0, 2023-10-18T14:14:24.060 INFO:teuthology.orchestra.run.smithi158.stdout: "oplen_avg": { 2023-10-18T14:14:24.060 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 2051, 2023-10-18T14:14:24.061 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 2052 2023-10-18T14:14:24.061 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.061 INFO:teuthology.orchestra.run.smithi158.stdout: "op": 2051, 2023-10-18T14:14:24.061 INFO:teuthology.orchestra.run.smithi158.stdout: "op_r": 2051, 2023-10-18T14:14:24.061 INFO:teuthology.orchestra.run.smithi158.stdout: "op_w": 0, 2023-10-18T14:14:24.062 INFO:teuthology.orchestra.run.smithi158.stdout: "op_rmw": 0, 2023-10-18T14:14:24.062 INFO:teuthology.orchestra.run.smithi158.stdout: "op_pg": 0, 2023-10-18T14:14:24.062 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_stat": 1321, 2023-10-18T14:14:24.062 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_create": 0, 2023-10-18T14:14:24.062 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_read": 728, 2023-10-18T14:14:24.063 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_write": 0, 2023-10-18T14:14:24.063 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_writefull": 0, 2023-10-18T14:14:24.063 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_writesame": 0, 2023-10-18T14:14:24.063 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_append": 0, 2023-10-18T14:14:24.063 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_zero": 0, 2023-10-18T14:14:24.064 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_truncate": 0, 2023-10-18T14:14:24.064 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_delete": 0, 2023-10-18T14:14:24.064 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_mapext": 0, 2023-10-18T14:14:24.064 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_sparse_read": 0, 2023-10-18T14:14:24.064 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_clonerange": 0, 2023-10-18T14:14:24.065 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_getxattr": 1, 2023-10-18T14:14:24.065 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_setxattr": 0, 2023-10-18T14:14:24.065 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_cmpxattr": 0, 2023-10-18T14:14:24.065 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_rmxattr": 0, 2023-10-18T14:14:24.065 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_resetxattrs": 0, 2023-10-18T14:14:24.066 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_call": 0, 2023-10-18T14:14:24.066 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_watch": 0, 2023-10-18T14:14:24.066 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_notify": 0, 2023-10-18T14:14:24.066 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_src_cmpxattr": 0, 2023-10-18T14:14:24.066 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_pgls": 0, 2023-10-18T14:14:24.067 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_pgls_filter": 0, 2023-10-18T14:14:24.067 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_other": 0, 2023-10-18T14:14:24.067 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_active": 0, 2023-10-18T14:14:24.067 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_send": 0, 2023-10-18T14:14:24.067 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_resend": 0, 2023-10-18T14:14:24.068 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_ping": 0, 2023-10-18T14:14:24.068 INFO:teuthology.orchestra.run.smithi158.stdout: "poolop_active": 0, 2023-10-18T14:14:24.068 INFO:teuthology.orchestra.run.smithi158.stdout: "poolop_send": 0, 2023-10-18T14:14:24.068 INFO:teuthology.orchestra.run.smithi158.stdout: "poolop_resend": 0, 2023-10-18T14:14:24.068 INFO:teuthology.orchestra.run.smithi158.stdout: "poolstat_active": 0, 2023-10-18T14:14:24.069 INFO:teuthology.orchestra.run.smithi158.stdout: "poolstat_send": 0, 2023-10-18T14:14:24.069 INFO:teuthology.orchestra.run.smithi158.stdout: "poolstat_resend": 0, 2023-10-18T14:14:24.069 INFO:teuthology.orchestra.run.smithi158.stdout: "statfs_active": 0, 2023-10-18T14:14:24.069 INFO:teuthology.orchestra.run.smithi158.stdout: "statfs_send": 0, 2023-10-18T14:14:24.070 INFO:teuthology.orchestra.run.smithi158.stdout: "statfs_resend": 0, 2023-10-18T14:14:24.070 INFO:teuthology.orchestra.run.smithi158.stdout: "command_active": 0, 2023-10-18T14:14:24.070 INFO:teuthology.orchestra.run.smithi158.stdout: "command_send": 0, 2023-10-18T14:14:24.070 INFO:teuthology.orchestra.run.smithi158.stdout: "command_resend": 0, 2023-10-18T14:14:24.070 INFO:teuthology.orchestra.run.smithi158.stdout: "map_epoch": 94, 2023-10-18T14:14:24.071 INFO:teuthology.orchestra.run.smithi158.stdout: "map_full": 0, 2023-10-18T14:14:24.071 INFO:teuthology.orchestra.run.smithi158.stdout: "map_inc": 11, 2023-10-18T14:14:24.071 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_sessions": 5, 2023-10-18T14:14:24.071 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_session_open": 5, 2023-10-18T14:14:24.071 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_session_close": 0, 2023-10-18T14:14:24.072 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_laggy": 0, 2023-10-18T14:14:24.072 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_wr": 0, 2023-10-18T14:14:24.072 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_rd": 2, 2023-10-18T14:14:24.072 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_del": 0 2023-10-18T14:14:24.072 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.072 INFO:teuthology.orchestra.run.smithi158.stdout: "oft": { 2023-10-18T14:14:24.073 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_objs": 0, 2023-10-18T14:14:24.073 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_kv_pairs": 0, 2023-10-18T14:14:24.073 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_updates": 0, 2023-10-18T14:14:24.073 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_removes": 0 2023-10-18T14:14:24.073 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.074 INFO:teuthology.orchestra.run.smithi158.stdout: "osd-slow-ops": { 2023-10-18T14:14:24.074 INFO:teuthology.orchestra.run.smithi158.stdout: "slow_ops_count": 0 2023-10-18T14:14:24.074 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.074 INFO:teuthology.orchestra.run.smithi158.stdout: "purge_queue": { 2023-10-18T14:14:24.074 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing_ops": 0, 2023-10-18T14:14:24.075 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing_ops_high_water": 0, 2023-10-18T14:14:24.075 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing": 0, 2023-10-18T14:14:24.075 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing_high_water": 0, 2023-10-18T14:14:24.075 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executed": 0, 2023-10-18T14:14:24.075 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_item_in_journal": 0 2023-10-18T14:14:24.076 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.076 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-18T14:14:24.076 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:24.076 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 104857600, 2023-10-18T14:14:24.076 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:24.077 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 2306, 2023-10-18T14:14:24.077 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 7064617, 2023-10-18T14:14:24.077 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:24.077 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 2306, 2023-10-18T14:14:24.077 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 0, 2023-10-18T14:14:24.078 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 0, 2023-10-18T14:14:24.078 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 2306, 2023-10-18T14:14:24.078 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 7064617, 2023-10-18T14:14:24.078 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:24.078 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.079 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.079 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.079 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:24.079 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.079 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-objecter_bytes": { 2023-10-18T14:14:24.079 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:24.080 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 104857600, 2023-10-18T14:14:24.080 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:24.080 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:24.080 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:24.080 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:24.081 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:24.081 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 2051, 2023-10-18T14:14:24.081 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 5714642, 2023-10-18T14:14:24.081 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 2051, 2023-10-18T14:14:24.081 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 5714642, 2023-10-18T14:14:24.082 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:24.082 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.082 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.082 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.082 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:24.083 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.083 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-objecter_ops": { 2023-10-18T14:14:24.083 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:24.083 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 1024, 2023-10-18T14:14:24.083 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:24.084 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:24.084 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:24.084 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:24.084 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:24.084 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 2051, 2023-10-18T14:14:24.085 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 2051, 2023-10-18T14:14:24.085 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 2051, 2023-10-18T14:14:24.085 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 2051, 2023-10-18T14:14:24.085 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:24.085 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.086 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.086 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.086 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:24.086 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.086 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-write_buf_throttle": { 2023-10-18T14:14:24.087 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:24.087 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 3758096384, 2023-10-18T14:14:24.087 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:24.087 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:24.087 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:24.088 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:24.088 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:24.088 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 0, 2023-10-18T14:14:24.088 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 0, 2023-10-18T14:14:24.088 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 0, 2023-10-18T14:14:24.089 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 0, 2023-10-18T14:14:24.089 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:24.089 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.089 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.089 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.089 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:24.090 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:24.090 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-write_buf_throttle-0x55b7106a2960": { 2023-10-18T14:14:24.090 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:24.090 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 3758096384, 2023-10-18T14:14:24.090 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:24.091 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:24.091 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:24.091 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:24.091 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:24.091 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 0, 2023-10-18T14:14:24.092 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 0, 2023-10-18T14:14:24.092 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 0, 2023-10-18T14:14:24.092 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 0, 2023-10-18T14:14:24.092 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:24.092 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:24.093 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:24.093 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:24.093 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:24.093 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:24.093 INFO:teuthology.orchestra.run.smithi158.stdout:} 2023-10-18T14:14:24.387 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-10-18T14:14:24.387 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-10-18T14:14:24.388 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2023-10-18T14:14:24.388 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2023-10-18T14:14:24.388 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2023-10-18T14:14:24.388 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-10-18T14:14:24.389 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-10-18T14:14:24.389 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2023-10-18T14:14:24.389 DEBUG:tasks.check_counter:Getting stats from h 2023-10-18T14:14:24.389 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-18T14:14:24.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:24 smithi158 ceph-mon[103317]: pgmap v600: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:14:24.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:24 smithi172 ceph-mon[103574]: pgmap v600: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:14:24.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:24 smithi114 ceph-mon[99494]: pgmap v600: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-18T14:14:24.951 INFO:teuthology.orchestra.run.smithi158.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-18T14:14:26.300 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2023-10-18T14:14:26.300 INFO:teuthology.orchestra.run.smithi158.stdout: "AsyncMessenger::Worker-0": { 2023-10-18T14:14:26.300 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_messages": 1757, 2023-10-18T14:14:26.301 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages": 1759, 2023-10-18T14:14:26.301 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_bytes": 10315086, 2023-10-18T14:14:26.301 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_bytes": 546434, 2023-10-18T14:14:26.301 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_created_connections": 6, 2023-10-18T14:14:26.302 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_active_connections": 2, 2023-10-18T14:14:26.302 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_total_time": 0.147945601, 2023-10-18T14:14:26.302 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_send_time": 0.045363995, 2023-10-18T14:14:26.302 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_recv_time": 0.039494253, 2023-10-18T14:14:26.303 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_fast_dispatch_time": 0.050311660, 2023-10-18T14:14:26.303 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:26.303 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 1757, 2023-10-18T14:14:26.303 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.054932288, 2023-10-18T14:14:26.303 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000031264 2023-10-18T14:14:26.304 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.304 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:26.304 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.304 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.304 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.305 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.305 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-18T14:14:26.305 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_encrypted_bytes": 0 2023-10-18T14:14:26.305 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.306 INFO:teuthology.orchestra.run.smithi158.stdout: "AsyncMessenger::Worker-1": { 2023-10-18T14:14:26.306 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_messages": 588, 2023-10-18T14:14:26.306 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages": 548, 2023-10-18T14:14:26.306 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_bytes": 1067024, 2023-10-18T14:14:26.306 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_bytes": 224606, 2023-10-18T14:14:26.307 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_created_connections": 4, 2023-10-18T14:14:26.307 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_active_connections": 3, 2023-10-18T14:14:26.307 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_total_time": 0.068915230, 2023-10-18T14:14:26.307 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_send_time": 0.019206135, 2023-10-18T14:14:26.307 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_recv_time": 0.030371383, 2023-10-18T14:14:26.308 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_fast_dispatch_time": 0.020146007, 2023-10-18T14:14:26.308 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:26.308 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 547, 2023-10-18T14:14:26.308 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.024608263, 2023-10-18T14:14:26.308 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000044987 2023-10-18T14:14:26.309 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.309 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:26.309 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.309 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.309 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.309 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.310 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_encrypted_bytes": 984304, 2023-10-18T14:14:26.310 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_encrypted_bytes": 120048 2023-10-18T14:14:26.310 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.310 INFO:teuthology.orchestra.run.smithi158.stdout: "AsyncMessenger::Worker-2": { 2023-10-18T14:14:26.311 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_messages": 6, 2023-10-18T14:14:26.311 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages": 152, 2023-10-18T14:14:26.311 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_bytes": 3420, 2023-10-18T14:14:26.311 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_bytes": 337431, 2023-10-18T14:14:26.311 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_created_connections": 4, 2023-10-18T14:14:26.311 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_active_connections": 3, 2023-10-18T14:14:26.312 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_total_time": 0.009041881, 2023-10-18T14:14:26.312 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_send_time": 0.005880367, 2023-10-18T14:14:26.312 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_recv_time": 0.001724400, 2023-10-18T14:14:26.312 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_fast_dispatch_time": 0.000033969, 2023-10-18T14:14:26.313 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:26.313 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 151, 2023-10-18T14:14:26.313 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.010046907, 2023-10-18T14:14:26.313 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000066535 2023-10-18T14:14:26.313 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.314 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:26.314 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.314 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.314 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.314 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.315 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-18T14:14:26.315 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_encrypted_bytes": 337120 2023-10-18T14:14:26.315 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.315 INFO:teuthology.orchestra.run.smithi158.stdout: "cct": { 2023-10-18T14:14:26.315 INFO:teuthology.orchestra.run.smithi158.stdout: "total_workers": 1, 2023-10-18T14:14:26.316 INFO:teuthology.orchestra.run.smithi158.stdout: "unhealthy_workers": 0 2023-10-18T14:14:26.316 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.316 INFO:teuthology.orchestra.run.smithi158.stdout: "finisher-MDSRank": { 2023-10-18T14:14:26.316 INFO:teuthology.orchestra.run.smithi158.stdout: "queue_len": 0, 2023-10-18T14:14:26.316 INFO:teuthology.orchestra.run.smithi158.stdout: "complete_latency": { 2023-10-18T14:14:26.317 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 3510, 2023-10-18T14:14:26.317 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.092332338, 2023-10-18T14:14:26.317 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000026305 2023-10-18T14:14:26.317 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:26.317 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.318 INFO:teuthology.orchestra.run.smithi158.stdout: "finisher-PurgeQueue": { 2023-10-18T14:14:26.318 INFO:teuthology.orchestra.run.smithi158.stdout: "queue_len": 0, 2023-10-18T14:14:26.318 INFO:teuthology.orchestra.run.smithi158.stdout: "complete_latency": { 2023-10-18T14:14:26.318 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.319 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.319 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.319 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:26.319 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.319 INFO:teuthology.orchestra.run.smithi158.stdout: "mds": { 2023-10-18T14:14:26.320 INFO:teuthology.orchestra.run.smithi158.stdout: "request": 0, 2023-10-18T14:14:26.320 INFO:teuthology.orchestra.run.smithi158.stdout: "reply": 0, 2023-10-18T14:14:26.320 INFO:teuthology.orchestra.run.smithi158.stdout: "reply_latency": { 2023-10-18T14:14:26.320 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.320 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.320 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.321 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.321 INFO:teuthology.orchestra.run.smithi158.stdout: "slow_reply": 0, 2023-10-18T14:14:26.321 INFO:teuthology.orchestra.run.smithi158.stdout: "forward": 0, 2023-10-18T14:14:26.321 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_fetch_complete": 0, 2023-10-18T14:14:26.321 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_fetch_keys": 0, 2023-10-18T14:14:26.322 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_commit": 0, 2023-10-18T14:14:26.322 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_split": 0, 2023-10-18T14:14:26.322 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_merge": 0, 2023-10-18T14:14:26.322 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes": 6862, 2023-10-18T14:14:26.322 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_top": 0, 2023-10-18T14:14:26.323 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_bottom": 0, 2023-10-18T14:14:26.323 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_pin_tail": 6862, 2023-10-18T14:14:26.323 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_pinned": 6862, 2023-10-18T14:14:26.323 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_expired": 39, 2023-10-18T14:14:26.323 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_with_caps": 0, 2023-10-18T14:14:26.324 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": 0, 2023-10-18T14:14:26.324 INFO:teuthology.orchestra.run.smithi158.stdout: "subtrees": 1, 2023-10-18T14:14:26.324 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse": 0, 2023-10-18T14:14:26.324 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_hit": 0, 2023-10-18T14:14:26.324 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_forward": 0, 2023-10-18T14:14:26.325 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_discover": 0, 2023-10-18T14:14:26.325 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_dir_fetch": 0, 2023-10-18T14:14:26.325 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_remote_ino": 0, 2023-10-18T14:14:26.325 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_lock": 0, 2023-10-18T14:14:26.325 INFO:teuthology.orchestra.run.smithi158.stdout: "load_cent": 0, 2023-10-18T14:14:26.326 INFO:teuthology.orchestra.run.smithi158.stdout: "q": 0, 2023-10-18T14:14:26.326 INFO:teuthology.orchestra.run.smithi158.stdout: "exported": 0, 2023-10-18T14:14:26.326 INFO:teuthology.orchestra.run.smithi158.stdout: "exported_inodes": 0, 2023-10-18T14:14:26.326 INFO:teuthology.orchestra.run.smithi158.stdout: "imported": 0, 2023-10-18T14:14:26.327 INFO:teuthology.orchestra.run.smithi158.stdout: "imported_inodes": 0, 2023-10-18T14:14:26.327 INFO:teuthology.orchestra.run.smithi158.stdout: "openino_dir_fetch": 0, 2023-10-18T14:14:26.327 INFO:teuthology.orchestra.run.smithi158.stdout: "openino_backtrace_fetch": 0, 2023-10-18T14:14:26.327 INFO:teuthology.orchestra.run.smithi158.stdout: "openino_peer_discover": 0, 2023-10-18T14:14:26.327 INFO:teuthology.orchestra.run.smithi158.stdout: "root_rfiles": 0, 2023-10-18T14:14:26.328 INFO:teuthology.orchestra.run.smithi158.stdout: "root_rbytes": 0, 2023-10-18T14:14:26.328 INFO:teuthology.orchestra.run.smithi158.stdout: "root_rsnaps": 0, 2023-10-18T14:14:26.328 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_backtrace_fetch": 0, 2023-10-18T14:14:26.328 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_set_tag": 0, 2023-10-18T14:14:26.328 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_backtrace_repaired": 0, 2023-10-18T14:14:26.329 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_inotable_repaired": 0, 2023-10-18T14:14:26.329 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_dir_inodes": 0, 2023-10-18T14:14:26.329 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_dir_base_inodes": 0, 2023-10-18T14:14:26.329 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_dirfrag_rstats": 0, 2023-10-18T14:14:26.329 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_file_inodes": 0, 2023-10-18T14:14:26.330 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_inode_file_caps": 0, 2023-10-18T14:14:26.330 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_revoke": 0, 2023-10-18T14:14:26.330 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_grant": 0, 2023-10-18T14:14:26.330 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_trunc": 0, 2023-10-18T14:14:26.330 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-18T14:14:26.331 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-18T14:14:26.331 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_caps": 0, 2023-10-18T14:14:26.331 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_caps_dirty": 0, 2023-10-18T14:14:26.331 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_cap_release": 0, 2023-10-18T14:14:26.331 INFO:teuthology.orchestra.run.smithi158.stdout: "process_request_cap_release": 0 2023-10-18T14:14:26.332 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.332 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_cache": { 2023-10-18T14:14:26.332 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_update": 0, 2023-10-18T14:14:26.332 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_update_receipt": 0, 2023-10-18T14:14:26.332 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_try_discover": 0, 2023-10-18T14:14:26.332 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_send_discover": 0, 2023-10-18T14:14:26.333 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_handle_discover": 0, 2023-10-18T14:14:26.333 INFO:teuthology.orchestra.run.smithi158.stdout: "num_strays": 0, 2023-10-18T14:14:26.333 INFO:teuthology.orchestra.run.smithi158.stdout: "num_strays_delayed": 0, 2023-10-18T14:14:26.333 INFO:teuthology.orchestra.run.smithi158.stdout: "num_strays_enqueuing": 0, 2023-10-18T14:14:26.333 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_created": 0, 2023-10-18T14:14:26.334 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_enqueued": 0, 2023-10-18T14:14:26.334 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_reintegrated": 0, 2023-10-18T14:14:26.334 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_migrated": 0, 2023-10-18T14:14:26.334 INFO:teuthology.orchestra.run.smithi158.stdout: "num_recovering_processing": 0, 2023-10-18T14:14:26.335 INFO:teuthology.orchestra.run.smithi158.stdout: "num_recovering_enqueued": 0, 2023-10-18T14:14:26.335 INFO:teuthology.orchestra.run.smithi158.stdout: "num_recovering_prioritized": 0, 2023-10-18T14:14:26.335 INFO:teuthology.orchestra.run.smithi158.stdout: "recovery_started": 0, 2023-10-18T14:14:26.335 INFO:teuthology.orchestra.run.smithi158.stdout: "recovery_completed": 0, 2023-10-18T14:14:26.335 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_enqueue_scrub": 0, 2023-10-18T14:14:26.336 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_exportdir": 0, 2023-10-18T14:14:26.336 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_flush": 0, 2023-10-18T14:14:26.336 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_fragmentdir": 0, 2023-10-18T14:14:26.336 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_fragstats": 0, 2023-10-18T14:14:26.336 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_inodestats": 0 2023-10-18T14:14:26.337 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.337 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_log": { 2023-10-18T14:14:26.337 INFO:teuthology.orchestra.run.smithi158.stdout: "evlrg": 0, 2023-10-18T14:14:26.337 INFO:teuthology.orchestra.run.smithi158.stdout: "evadd": 0, 2023-10-18T14:14:26.337 INFO:teuthology.orchestra.run.smithi158.stdout: "evex": 0, 2023-10-18T14:14:26.338 INFO:teuthology.orchestra.run.smithi158.stdout: "evtrm": 0, 2023-10-18T14:14:26.338 INFO:teuthology.orchestra.run.smithi158.stdout: "ev": 4092, 2023-10-18T14:14:26.338 INFO:teuthology.orchestra.run.smithi158.stdout: "evexg": 0, 2023-10-18T14:14:26.338 INFO:teuthology.orchestra.run.smithi158.stdout: "evexd": 0, 2023-10-18T14:14:26.339 INFO:teuthology.orchestra.run.smithi158.stdout: "segadd": 0, 2023-10-18T14:14:26.339 INFO:teuthology.orchestra.run.smithi158.stdout: "segex": 0, 2023-10-18T14:14:26.339 INFO:teuthology.orchestra.run.smithi158.stdout: "segtrm": 0, 2023-10-18T14:14:26.339 INFO:teuthology.orchestra.run.smithi158.stdout: "seg": 7, 2023-10-18T14:14:26.339 INFO:teuthology.orchestra.run.smithi158.stdout: "segmjr": 2, 2023-10-18T14:14:26.340 INFO:teuthology.orchestra.run.smithi158.stdout: "segexg": 0, 2023-10-18T14:14:26.340 INFO:teuthology.orchestra.run.smithi158.stdout: "segexd": 0, 2023-10-18T14:14:26.340 INFO:teuthology.orchestra.run.smithi158.stdout: "expos": 4194304, 2023-10-18T14:14:26.340 INFO:teuthology.orchestra.run.smithi158.stdout: "wrpos": 14001293, 2023-10-18T14:14:26.340 INFO:teuthology.orchestra.run.smithi158.stdout: "rdpos": 13998259, 2023-10-18T14:14:26.341 INFO:teuthology.orchestra.run.smithi158.stdout: "jlat": { 2023-10-18T14:14:26.341 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.341 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.341 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.341 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.342 INFO:teuthology.orchestra.run.smithi158.stdout: "replayed": 4092 2023-10-18T14:14:26.342 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.342 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_mem": { 2023-10-18T14:14:26.342 INFO:teuthology.orchestra.run.smithi158.stdout: "ino": 3028, 2023-10-18T14:14:26.342 INFO:teuthology.orchestra.run.smithi158.stdout: "ino+": 4673, 2023-10-18T14:14:26.343 INFO:teuthology.orchestra.run.smithi158.stdout: "ino-": 1645, 2023-10-18T14:14:26.343 INFO:teuthology.orchestra.run.smithi158.stdout: "dir": 172, 2023-10-18T14:14:26.343 INFO:teuthology.orchestra.run.smithi158.stdout: "dir+": 245, 2023-10-18T14:14:26.343 INFO:teuthology.orchestra.run.smithi158.stdout: "dir-": 73, 2023-10-18T14:14:26.343 INFO:teuthology.orchestra.run.smithi158.stdout: "dn": 6862, 2023-10-18T14:14:26.344 INFO:teuthology.orchestra.run.smithi158.stdout: "dn+": 8221, 2023-10-18T14:14:26.344 INFO:teuthology.orchestra.run.smithi158.stdout: "dn-": 1359, 2023-10-18T14:14:26.344 INFO:teuthology.orchestra.run.smithi158.stdout: "cap": 0, 2023-10-18T14:14:26.344 INFO:teuthology.orchestra.run.smithi158.stdout: "cap+": 0, 2023-10-18T14:14:26.344 INFO:teuthology.orchestra.run.smithi158.stdout: "cap-": 0, 2023-10-18T14:14:26.345 INFO:teuthology.orchestra.run.smithi158.stdout: "rss": 60444, 2023-10-18T14:14:26.345 INFO:teuthology.orchestra.run.smithi158.stdout: "heap": 207152 2023-10-18T14:14:26.345 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.345 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_server": { 2023-10-18T14:14:26.345 INFO:teuthology.orchestra.run.smithi158.stdout: "dispatch_client_request": 0, 2023-10-18T14:14:26.346 INFO:teuthology.orchestra.run.smithi158.stdout: "dispatch_server_request": 0, 2023-10-18T14:14:26.346 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_request": 0, 2023-10-18T14:14:26.346 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_session": 0, 2023-10-18T14:14:26.346 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_peer_request": 0, 2023-10-18T14:14:26.347 INFO:teuthology.orchestra.run.smithi158.stdout: "req_create_latency": { 2023-10-18T14:14:26.347 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.347 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.347 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.347 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.348 INFO:teuthology.orchestra.run.smithi158.stdout: "req_getattr_latency": { 2023-10-18T14:14:26.348 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.348 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.348 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.348 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.349 INFO:teuthology.orchestra.run.smithi158.stdout: "req_getfilelock_latency": { 2023-10-18T14:14:26.349 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.349 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.349 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.349 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.350 INFO:teuthology.orchestra.run.smithi158.stdout: "req_link_latency": { 2023-10-18T14:14:26.350 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.350 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.350 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.350 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.351 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookup_latency": { 2023-10-18T14:14:26.351 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.351 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.351 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.351 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.351 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookuphash_latency": { 2023-10-18T14:14:26.352 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.352 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.352 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.352 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.352 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupino_latency": { 2023-10-18T14:14:26.353 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.353 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.353 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.353 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.353 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupname_latency": { 2023-10-18T14:14:26.354 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.354 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.354 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.354 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.354 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupparent_latency": { 2023-10-18T14:14:26.355 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.355 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.355 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.355 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.355 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupsnap_latency": { 2023-10-18T14:14:26.356 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.356 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.356 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.356 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.356 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lssnap_latency": { 2023-10-18T14:14:26.357 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.357 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.357 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.357 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.357 INFO:teuthology.orchestra.run.smithi158.stdout: "req_mkdir_latency": { 2023-10-18T14:14:26.358 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.358 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.358 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.358 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.358 INFO:teuthology.orchestra.run.smithi158.stdout: "req_mknod_latency": { 2023-10-18T14:14:26.359 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.359 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.359 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.359 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.359 INFO:teuthology.orchestra.run.smithi158.stdout: "req_mksnap_latency": { 2023-10-18T14:14:26.360 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.360 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.360 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.360 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.360 INFO:teuthology.orchestra.run.smithi158.stdout: "req_open_latency": { 2023-10-18T14:14:26.361 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.361 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.361 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.361 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.361 INFO:teuthology.orchestra.run.smithi158.stdout: "req_readdir_latency": { 2023-10-18T14:14:26.361 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.362 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.362 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.362 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.362 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rename_latency": { 2023-10-18T14:14:26.363 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.363 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.363 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.363 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.363 INFO:teuthology.orchestra.run.smithi158.stdout: "req_renamesnap_latency": { 2023-10-18T14:14:26.364 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.364 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.364 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.364 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.365 INFO:teuthology.orchestra.run.smithi158.stdout: "req_snapdiff_latency": { 2023-10-18T14:14:26.365 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.365 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.365 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.366 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.366 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rmdir_latency": { 2023-10-18T14:14:26.366 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.366 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.366 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.367 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.367 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rmsnap_latency": { 2023-10-18T14:14:26.367 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.367 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.367 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.368 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.368 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rmxattr_latency": { 2023-10-18T14:14:26.368 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.368 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.368 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.369 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.369 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setattr_latency": { 2023-10-18T14:14:26.369 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.369 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.369 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.370 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.370 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setdirlayout_latency": { 2023-10-18T14:14:26.370 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.370 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.371 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.371 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.371 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setfilelock_latency": { 2023-10-18T14:14:26.371 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.371 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.371 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.372 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.372 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setlayout_latency": { 2023-10-18T14:14:26.372 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.372 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.372 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.373 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.373 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setxattr_latency": { 2023-10-18T14:14:26.373 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.373 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.374 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.374 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.374 INFO:teuthology.orchestra.run.smithi158.stdout: "req_symlink_latency": { 2023-10-18T14:14:26.374 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.374 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.375 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.375 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.375 INFO:teuthology.orchestra.run.smithi158.stdout: "req_unlink_latency": { 2023-10-18T14:14:26.375 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.377 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.377 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.377 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.377 INFO:teuthology.orchestra.run.smithi158.stdout: "cap_revoke_eviction": 0, 2023-10-18T14:14:26.378 INFO:teuthology.orchestra.run.smithi158.stdout: "cap_acquisition_throttle": 0, 2023-10-18T14:14:26.378 INFO:teuthology.orchestra.run.smithi158.stdout: "req_getvxattr_latency": { 2023-10-18T14:14:26.378 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.378 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.379 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.379 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:26.379 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.379 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_sessions": { 2023-10-18T14:14:26.379 INFO:teuthology.orchestra.run.smithi158.stdout: "session_count": 2, 2023-10-18T14:14:26.380 INFO:teuthology.orchestra.run.smithi158.stdout: "session_add": 3, 2023-10-18T14:14:26.380 INFO:teuthology.orchestra.run.smithi158.stdout: "session_remove": 1, 2023-10-18T14:14:26.380 INFO:teuthology.orchestra.run.smithi158.stdout: "sessions_open": 2, 2023-10-18T14:14:26.380 INFO:teuthology.orchestra.run.smithi158.stdout: "sessions_stale": 0, 2023-10-18T14:14:26.380 INFO:teuthology.orchestra.run.smithi158.stdout: "total_load": 0, 2023-10-18T14:14:26.381 INFO:teuthology.orchestra.run.smithi158.stdout: "average_load": 0, 2023-10-18T14:14:26.381 INFO:teuthology.orchestra.run.smithi158.stdout: "avg_session_uptime": 1993, 2023-10-18T14:14:26.381 INFO:teuthology.orchestra.run.smithi158.stdout: "mdthresh_evicted": 0 2023-10-18T14:14:26.381 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.381 INFO:teuthology.orchestra.run.smithi158.stdout: "mempool": { 2023-10-18T14:14:26.382 INFO:teuthology.orchestra.run.smithi158.stdout: "bloom_filter_bytes": 0, 2023-10-18T14:14:26.382 INFO:teuthology.orchestra.run.smithi158.stdout: "bloom_filter_items": 0, 2023-10-18T14:14:26.382 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_alloc_bytes": 0, 2023-10-18T14:14:26.382 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_alloc_items": 0, 2023-10-18T14:14:26.383 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_data_bytes": 0, 2023-10-18T14:14:26.383 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_data_items": 0, 2023-10-18T14:14:26.383 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-18T14:14:26.383 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_onode_items": 0, 2023-10-18T14:14:26.383 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-18T14:14:26.384 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_meta_items": 0, 2023-10-18T14:14:26.384 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_other_bytes": 0, 2023-10-18T14:14:26.384 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_other_items": 0, 2023-10-18T14:14:26.384 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-18T14:14:26.384 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_buffer_items": 0, 2023-10-18T14:14:26.385 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_extent_bytes": 0, 2023-10-18T14:14:26.385 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_extent_items": 0, 2023-10-18T14:14:26.385 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_blob_bytes": 0, 2023-10-18T14:14:26.385 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_blob_items": 0, 2023-10-18T14:14:26.386 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-18T14:14:26.386 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_shared_blob_items": 0, 2023-10-18T14:14:26.386 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-18T14:14:26.386 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_inline_bl_items": 0, 2023-10-18T14:14:26.386 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_fsck_bytes": 0, 2023-10-18T14:14:26.387 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_fsck_items": 0, 2023-10-18T14:14:26.387 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_txc_bytes": 0, 2023-10-18T14:14:26.387 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_txc_items": 0, 2023-10-18T14:14:26.387 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-18T14:14:26.388 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_deferred_items": 0, 2023-10-18T14:14:26.388 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_bytes": 0, 2023-10-18T14:14:26.388 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_items": 0, 2023-10-18T14:14:26.388 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_bytes": 0, 2023-10-18T14:14:26.388 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_items": 0, 2023-10-18T14:14:26.389 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_reader_bytes": 0, 2023-10-18T14:14:26.389 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_reader_items": 0, 2023-10-18T14:14:26.389 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_writer_bytes": 0, 2023-10-18T14:14:26.389 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_writer_items": 0, 2023-10-18T14:14:26.390 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_anon_bytes": 293516, 2023-10-18T14:14:26.390 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_anon_items": 3092, 2023-10-18T14:14:26.390 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_meta_bytes": 0, 2023-10-18T14:14:26.391 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_meta_items": 0, 2023-10-18T14:14:26.391 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_bytes": 0, 2023-10-18T14:14:26.391 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_items": 0, 2023-10-18T14:14:26.391 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_mapbl_bytes": 0, 2023-10-18T14:14:26.392 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_mapbl_items": 0, 2023-10-18T14:14:26.392 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_pglog_bytes": 0, 2023-10-18T14:14:26.392 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_pglog_items": 0, 2023-10-18T14:14:26.392 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_bytes": 7872, 2023-10-18T14:14:26.392 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_items": 164, 2023-10-18T14:14:26.393 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_mapping_bytes": 0, 2023-10-18T14:14:26.393 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_mapping_items": 0, 2023-10-18T14:14:26.393 INFO:teuthology.orchestra.run.smithi158.stdout: "pgmap_bytes": 0, 2023-10-18T14:14:26.394 INFO:teuthology.orchestra.run.smithi158.stdout: "pgmap_items": 0, 2023-10-18T14:14:26.394 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_co_bytes": 11776739, 2023-10-18T14:14:26.394 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_co_items": 97220, 2023-10-18T14:14:26.394 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_1_bytes": 0, 2023-10-18T14:14:26.395 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_1_items": 0, 2023-10-18T14:14:26.395 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_2_bytes": 0, 2023-10-18T14:14:26.395 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_2_items": 0 2023-10-18T14:14:26.395 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.395 INFO:teuthology.orchestra.run.smithi158.stdout: "objecter": { 2023-10-18T14:14:26.396 INFO:teuthology.orchestra.run.smithi158.stdout: "op_active": 0, 2023-10-18T14:14:26.396 INFO:teuthology.orchestra.run.smithi158.stdout: "op_laggy": 0, 2023-10-18T14:14:26.396 INFO:teuthology.orchestra.run.smithi158.stdout: "op_send": 2094, 2023-10-18T14:14:26.396 INFO:teuthology.orchestra.run.smithi158.stdout: "op_send_bytes": 21, 2023-10-18T14:14:26.396 INFO:teuthology.orchestra.run.smithi158.stdout: "op_resend": 3, 2023-10-18T14:14:26.397 INFO:teuthology.orchestra.run.smithi158.stdout: "op_reply": 2094, 2023-10-18T14:14:26.397 INFO:teuthology.orchestra.run.smithi158.stdout: "op_latency": { 2023-10-18T14:14:26.397 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 2094, 2023-10-18T14:14:26.397 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 2.676970104, 2023-10-18T14:14:26.398 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.001278400 2023-10-18T14:14:26.398 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.398 INFO:teuthology.orchestra.run.smithi158.stdout: "op_inflight": 0, 2023-10-18T14:14:26.398 INFO:teuthology.orchestra.run.smithi158.stdout: "oplen_avg": { 2023-10-18T14:14:26.398 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 2094, 2023-10-18T14:14:26.399 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 2095 2023-10-18T14:14:26.399 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.399 INFO:teuthology.orchestra.run.smithi158.stdout: "op": 2094, 2023-10-18T14:14:26.399 INFO:teuthology.orchestra.run.smithi158.stdout: "op_r": 2094, 2023-10-18T14:14:26.400 INFO:teuthology.orchestra.run.smithi158.stdout: "op_w": 0, 2023-10-18T14:14:26.400 INFO:teuthology.orchestra.run.smithi158.stdout: "op_rmw": 0, 2023-10-18T14:14:26.400 INFO:teuthology.orchestra.run.smithi158.stdout: "op_pg": 0, 2023-10-18T14:14:26.400 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_stat": 1332, 2023-10-18T14:14:26.400 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_create": 0, 2023-10-18T14:14:26.401 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_read": 760, 2023-10-18T14:14:26.401 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_write": 0, 2023-10-18T14:14:26.401 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_writefull": 0, 2023-10-18T14:14:26.401 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_writesame": 0, 2023-10-18T14:14:26.402 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_append": 0, 2023-10-18T14:14:26.402 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_zero": 0, 2023-10-18T14:14:26.402 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_truncate": 0, 2023-10-18T14:14:26.402 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_delete": 0, 2023-10-18T14:14:26.402 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_mapext": 0, 2023-10-18T14:14:26.403 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_sparse_read": 0, 2023-10-18T14:14:26.403 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_clonerange": 0, 2023-10-18T14:14:26.403 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_getxattr": 1, 2023-10-18T14:14:26.403 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_setxattr": 0, 2023-10-18T14:14:26.404 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_cmpxattr": 0, 2023-10-18T14:14:26.404 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_rmxattr": 0, 2023-10-18T14:14:26.404 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_resetxattrs": 0, 2023-10-18T14:14:26.404 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_call": 0, 2023-10-18T14:14:26.405 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_watch": 0, 2023-10-18T14:14:26.405 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_notify": 0, 2023-10-18T14:14:26.405 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_src_cmpxattr": 0, 2023-10-18T14:14:26.405 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_pgls": 0, 2023-10-18T14:14:26.405 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_pgls_filter": 0, 2023-10-18T14:14:26.406 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_other": 0, 2023-10-18T14:14:26.406 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_active": 0, 2023-10-18T14:14:26.406 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_send": 0, 2023-10-18T14:14:26.406 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_resend": 0, 2023-10-18T14:14:26.406 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_ping": 0, 2023-10-18T14:14:26.407 INFO:teuthology.orchestra.run.smithi158.stdout: "poolop_active": 0, 2023-10-18T14:14:26.407 INFO:teuthology.orchestra.run.smithi158.stdout: "poolop_send": 0, 2023-10-18T14:14:26.407 INFO:teuthology.orchestra.run.smithi158.stdout: "poolop_resend": 0, 2023-10-18T14:14:26.407 INFO:teuthology.orchestra.run.smithi158.stdout: "poolstat_active": 0, 2023-10-18T14:14:26.408 INFO:teuthology.orchestra.run.smithi158.stdout: "poolstat_send": 0, 2023-10-18T14:14:26.408 INFO:teuthology.orchestra.run.smithi158.stdout: "poolstat_resend": 0, 2023-10-18T14:14:26.408 INFO:teuthology.orchestra.run.smithi158.stdout: "statfs_active": 0, 2023-10-18T14:14:26.408 INFO:teuthology.orchestra.run.smithi158.stdout: "statfs_send": 0, 2023-10-18T14:14:26.409 INFO:teuthology.orchestra.run.smithi158.stdout: "statfs_resend": 0, 2023-10-18T14:14:26.409 INFO:teuthology.orchestra.run.smithi158.stdout: "command_active": 0, 2023-10-18T14:14:26.409 INFO:teuthology.orchestra.run.smithi158.stdout: "command_send": 0, 2023-10-18T14:14:26.409 INFO:teuthology.orchestra.run.smithi158.stdout: "command_resend": 0, 2023-10-18T14:14:26.409 INFO:teuthology.orchestra.run.smithi158.stdout: "map_epoch": 94, 2023-10-18T14:14:26.410 INFO:teuthology.orchestra.run.smithi158.stdout: "map_full": 0, 2023-10-18T14:14:26.410 INFO:teuthology.orchestra.run.smithi158.stdout: "map_inc": 11, 2023-10-18T14:14:26.410 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_sessions": 5, 2023-10-18T14:14:26.410 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_session_open": 5, 2023-10-18T14:14:26.411 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_session_close": 0, 2023-10-18T14:14:26.411 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_laggy": 0, 2023-10-18T14:14:26.411 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_wr": 0, 2023-10-18T14:14:26.411 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_rd": 2, 2023-10-18T14:14:26.411 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_del": 0 2023-10-18T14:14:26.412 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.412 INFO:teuthology.orchestra.run.smithi158.stdout: "oft": { 2023-10-18T14:14:26.412 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_objs": 0, 2023-10-18T14:14:26.412 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_kv_pairs": 0, 2023-10-18T14:14:26.412 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_updates": 0, 2023-10-18T14:14:26.413 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_removes": 0 2023-10-18T14:14:26.413 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.413 INFO:teuthology.orchestra.run.smithi158.stdout: "osd-slow-ops": { 2023-10-18T14:14:26.413 INFO:teuthology.orchestra.run.smithi158.stdout: "slow_ops_count": 0 2023-10-18T14:14:26.414 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.414 INFO:teuthology.orchestra.run.smithi158.stdout: "purge_queue": { 2023-10-18T14:14:26.414 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing_ops": 0, 2023-10-18T14:14:26.414 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing_ops_high_water": 0, 2023-10-18T14:14:26.414 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing": 0, 2023-10-18T14:14:26.415 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing_high_water": 0, 2023-10-18T14:14:26.415 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executed": 0, 2023-10-18T14:14:26.415 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_item_in_journal": 0 2023-10-18T14:14:26.415 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.416 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-18T14:14:26.416 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:26.416 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 104857600, 2023-10-18T14:14:26.416 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:26.416 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 2347, 2023-10-18T14:14:26.417 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 11158621, 2023-10-18T14:14:26.417 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:26.417 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 2347, 2023-10-18T14:14:26.417 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 0, 2023-10-18T14:14:26.417 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 0, 2023-10-18T14:14:26.418 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 2347, 2023-10-18T14:14:26.418 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 11158621, 2023-10-18T14:14:26.418 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:26.418 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.419 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.419 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.419 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:26.419 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.419 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-objecter_bytes": { 2023-10-18T14:14:26.420 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:26.420 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 104857600, 2023-10-18T14:14:26.420 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:26.420 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:26.420 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:26.421 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:26.421 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:26.421 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 2094, 2023-10-18T14:14:26.421 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 9806994, 2023-10-18T14:14:26.422 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 2094, 2023-10-18T14:14:26.422 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 9806994, 2023-10-18T14:14:26.422 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:26.422 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.423 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.423 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.423 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:26.423 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.423 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-objecter_ops": { 2023-10-18T14:14:26.424 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:26.424 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 1024, 2023-10-18T14:14:26.424 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:26.424 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:26.425 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:26.425 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:26.425 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:26.425 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 2094, 2023-10-18T14:14:26.425 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 2094, 2023-10-18T14:14:26.426 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 2094, 2023-10-18T14:14:26.426 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 2094, 2023-10-18T14:14:26.426 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:26.426 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.427 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.427 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.427 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:26.427 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.427 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-write_buf_throttle": { 2023-10-18T14:14:26.428 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:26.428 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 3758096384, 2023-10-18T14:14:26.428 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:26.428 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:26.428 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:26.429 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:26.429 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:26.429 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 0, 2023-10-18T14:14:26.429 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 0, 2023-10-18T14:14:26.429 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 0, 2023-10-18T14:14:26.430 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 0, 2023-10-18T14:14:26.430 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:26.430 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.430 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.431 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.431 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:26.431 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:26.431 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-write_buf_throttle-0x562d7aff4960": { 2023-10-18T14:14:26.431 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:26.432 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 3758096384, 2023-10-18T14:14:26.432 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:26.432 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:26.432 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:26.433 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:26.433 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:26.433 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 0, 2023-10-18T14:14:26.433 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 0, 2023-10-18T14:14:26.434 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 0, 2023-10-18T14:14:26.434 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 0, 2023-10-18T14:14:26.434 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:26.434 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:26.435 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:26.435 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:26.435 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:26.435 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:26.436 INFO:teuthology.orchestra.run.smithi158.stdout:} 2023-10-18T14:14:26.699 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2023-10-18T14:14:26.700 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2023-10-18T14:14:26.700 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2023-10-18T14:14:26.700 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2023-10-18T14:14:26.701 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2023-10-18T14:14:26.701 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-10-18T14:14:26.701 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-10-18T14:14:26.702 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2023-10-18T14:14:26.702 DEBUG:tasks.check_counter:Getting stats from k 2023-10-18T14:14:26.703 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-18T14:14:27.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:26 smithi158 ceph-mon[103317]: pgmap v601: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:14:27.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:26 smithi114 ceph-mon[99494]: pgmap v601: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:14:27.262 INFO:teuthology.orchestra.run.smithi158.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-18T14:14:27.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:26 smithi172 ceph-mon[103574]: pgmap v601: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:14:28.694 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2023-10-18T14:14:28.695 INFO:teuthology.orchestra.run.smithi158.stdout: "AsyncMessenger::Worker-0": { 2023-10-18T14:14:28.695 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_messages": 1098, 2023-10-18T14:14:28.695 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages": 1100, 2023-10-18T14:14:28.695 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_bytes": 4535036, 2023-10-18T14:14:28.696 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_bytes": 341479, 2023-10-18T14:14:28.696 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_created_connections": 6, 2023-10-18T14:14:28.696 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_active_connections": 2, 2023-10-18T14:14:28.696 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_total_time": 0.104120408, 2023-10-18T14:14:28.696 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_send_time": 0.035175013, 2023-10-18T14:14:28.697 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_recv_time": 0.025999644, 2023-10-18T14:14:28.697 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_fast_dispatch_time": 0.032288755, 2023-10-18T14:14:28.697 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:28.697 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 1098, 2023-10-18T14:14:28.697 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.047915678, 2023-10-18T14:14:28.698 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000043639 2023-10-18T14:14:28.698 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.698 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:28.698 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.698 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.699 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.699 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.699 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-18T14:14:28.699 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_encrypted_bytes": 0 2023-10-18T14:14:28.699 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.699 INFO:teuthology.orchestra.run.smithi158.stdout: "AsyncMessenger::Worker-1": { 2023-10-18T14:14:28.700 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_messages": 582, 2023-10-18T14:14:28.700 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages": 731, 2023-10-18T14:14:28.700 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_bytes": 1638420, 2023-10-18T14:14:28.700 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_bytes": 517163, 2023-10-18T14:14:28.700 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_created_connections": 5, 2023-10-18T14:14:28.701 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_active_connections": 4, 2023-10-18T14:14:28.701 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_total_time": 0.053973180, 2023-10-18T14:14:28.701 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_send_time": 0.017364566, 2023-10-18T14:14:28.701 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_recv_time": 0.013648071, 2023-10-18T14:14:28.701 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_fast_dispatch_time": 0.017482877, 2023-10-18T14:14:28.702 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:28.702 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 730, 2023-10-18T14:14:28.702 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.038831967, 2023-10-18T14:14:28.702 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000053194 2023-10-18T14:14:28.702 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.702 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:28.703 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.703 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.703 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.703 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.703 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-18T14:14:28.704 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_encrypted_bytes": 337648 2023-10-18T14:14:28.704 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.704 INFO:teuthology.orchestra.run.smithi158.stdout: "AsyncMessenger::Worker-2": { 2023-10-18T14:14:28.704 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_messages": 592, 2023-10-18T14:14:28.704 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages": 552, 2023-10-18T14:14:28.705 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_bytes": 1068070, 2023-10-18T14:14:28.705 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_bytes": 227040, 2023-10-18T14:14:28.705 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_created_connections": 4, 2023-10-18T14:14:28.705 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_active_connections": 3, 2023-10-18T14:14:28.705 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_total_time": 0.068921671, 2023-10-18T14:14:28.706 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_send_time": 0.020370749, 2023-10-18T14:14:28.706 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_recv_time": 0.031120211, 2023-10-18T14:14:28.706 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_running_fast_dispatch_time": 0.018921593, 2023-10-18T14:14:28.706 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:28.706 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 551, 2023-10-18T14:14:28.707 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.022632421, 2023-10-18T14:14:28.707 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000041075 2023-10-18T14:14:28.707 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.707 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:28.707 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.708 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.708 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.708 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.708 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_recv_encrypted_bytes": 985392, 2023-10-18T14:14:28.708 INFO:teuthology.orchestra.run.smithi158.stdout: "msgr_send_encrypted_bytes": 122544 2023-10-18T14:14:28.709 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.709 INFO:teuthology.orchestra.run.smithi158.stdout: "cct": { 2023-10-18T14:14:28.709 INFO:teuthology.orchestra.run.smithi158.stdout: "total_workers": 1, 2023-10-18T14:14:28.709 INFO:teuthology.orchestra.run.smithi158.stdout: "unhealthy_workers": 0 2023-10-18T14:14:28.709 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.710 INFO:teuthology.orchestra.run.smithi158.stdout: "finisher-MDSRank": { 2023-10-18T14:14:28.710 INFO:teuthology.orchestra.run.smithi158.stdout: "queue_len": 0, 2023-10-18T14:14:28.710 INFO:teuthology.orchestra.run.smithi158.stdout: "complete_latency": { 2023-10-18T14:14:28.710 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 3407, 2023-10-18T14:14:28.710 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.091467661, 2023-10-18T14:14:28.711 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000026846 2023-10-18T14:14:28.711 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:28.711 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.711 INFO:teuthology.orchestra.run.smithi158.stdout: "finisher-PurgeQueue": { 2023-10-18T14:14:28.711 INFO:teuthology.orchestra.run.smithi158.stdout: "queue_len": 0, 2023-10-18T14:14:28.712 INFO:teuthology.orchestra.run.smithi158.stdout: "complete_latency": { 2023-10-18T14:14:28.712 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.712 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.712 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.712 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:28.713 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.713 INFO:teuthology.orchestra.run.smithi158.stdout: "mds": { 2023-10-18T14:14:28.713 INFO:teuthology.orchestra.run.smithi158.stdout: "request": 0, 2023-10-18T14:14:28.713 INFO:teuthology.orchestra.run.smithi158.stdout: "reply": 0, 2023-10-18T14:14:28.713 INFO:teuthology.orchestra.run.smithi158.stdout: "reply_latency": { 2023-10-18T14:14:28.713 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.714 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.714 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.714 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.714 INFO:teuthology.orchestra.run.smithi158.stdout: "slow_reply": 0, 2023-10-18T14:14:28.714 INFO:teuthology.orchestra.run.smithi158.stdout: "forward": 0, 2023-10-18T14:14:28.715 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_fetch_complete": 0, 2023-10-18T14:14:28.715 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_fetch_keys": 0, 2023-10-18T14:14:28.715 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_commit": 0, 2023-10-18T14:14:28.715 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_split": 0, 2023-10-18T14:14:28.715 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_merge": 0, 2023-10-18T14:14:28.716 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes": 882, 2023-10-18T14:14:28.716 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_top": 0, 2023-10-18T14:14:28.716 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_bottom": 0, 2023-10-18T14:14:28.716 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_pin_tail": 882, 2023-10-18T14:14:28.716 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_pinned": 882, 2023-10-18T14:14:28.717 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_expired": 103, 2023-10-18T14:14:28.717 INFO:teuthology.orchestra.run.smithi158.stdout: "inodes_with_caps": 0, 2023-10-18T14:14:28.717 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": 0, 2023-10-18T14:14:28.717 INFO:teuthology.orchestra.run.smithi158.stdout: "subtrees": 1, 2023-10-18T14:14:28.717 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse": 0, 2023-10-18T14:14:28.718 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_hit": 0, 2023-10-18T14:14:28.718 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_forward": 0, 2023-10-18T14:14:28.718 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_discover": 0, 2023-10-18T14:14:28.718 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_dir_fetch": 0, 2023-10-18T14:14:28.718 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_remote_ino": 0, 2023-10-18T14:14:28.719 INFO:teuthology.orchestra.run.smithi158.stdout: "traverse_lock": 0, 2023-10-18T14:14:28.719 INFO:teuthology.orchestra.run.smithi158.stdout: "load_cent": 0, 2023-10-18T14:14:28.719 INFO:teuthology.orchestra.run.smithi158.stdout: "q": 0, 2023-10-18T14:14:28.719 INFO:teuthology.orchestra.run.smithi158.stdout: "exported": 0, 2023-10-18T14:14:28.719 INFO:teuthology.orchestra.run.smithi158.stdout: "exported_inodes": 0, 2023-10-18T14:14:28.720 INFO:teuthology.orchestra.run.smithi158.stdout: "imported": 0, 2023-10-18T14:14:28.720 INFO:teuthology.orchestra.run.smithi158.stdout: "imported_inodes": 0, 2023-10-18T14:14:28.720 INFO:teuthology.orchestra.run.smithi158.stdout: "openino_dir_fetch": 0, 2023-10-18T14:14:28.720 INFO:teuthology.orchestra.run.smithi158.stdout: "openino_backtrace_fetch": 0, 2023-10-18T14:14:28.720 INFO:teuthology.orchestra.run.smithi158.stdout: "openino_peer_discover": 0, 2023-10-18T14:14:28.721 INFO:teuthology.orchestra.run.smithi158.stdout: "root_rfiles": 0, 2023-10-18T14:14:28.721 INFO:teuthology.orchestra.run.smithi158.stdout: "root_rbytes": 0, 2023-10-18T14:14:28.721 INFO:teuthology.orchestra.run.smithi158.stdout: "root_rsnaps": 0, 2023-10-18T14:14:28.721 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_backtrace_fetch": 0, 2023-10-18T14:14:28.721 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_set_tag": 0, 2023-10-18T14:14:28.722 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_backtrace_repaired": 0, 2023-10-18T14:14:28.722 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_inotable_repaired": 0, 2023-10-18T14:14:28.722 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_dir_inodes": 0, 2023-10-18T14:14:28.722 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_dir_base_inodes": 0, 2023-10-18T14:14:28.722 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_dirfrag_rstats": 0, 2023-10-18T14:14:28.722 INFO:teuthology.orchestra.run.smithi158.stdout: "scrub_file_inodes": 0, 2023-10-18T14:14:28.723 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_inode_file_caps": 0, 2023-10-18T14:14:28.723 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_revoke": 0, 2023-10-18T14:14:28.723 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_grant": 0, 2023-10-18T14:14:28.723 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_trunc": 0, 2023-10-18T14:14:28.723 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-18T14:14:28.724 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-18T14:14:28.724 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_caps": 0, 2023-10-18T14:14:28.724 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_caps_dirty": 0, 2023-10-18T14:14:28.724 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_cap_release": 0, 2023-10-18T14:14:28.724 INFO:teuthology.orchestra.run.smithi158.stdout: "process_request_cap_release": 0 2023-10-18T14:14:28.725 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.725 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_cache": { 2023-10-18T14:14:28.725 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_update": 0, 2023-10-18T14:14:28.725 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_update_receipt": 0, 2023-10-18T14:14:28.725 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_try_discover": 0, 2023-10-18T14:14:28.726 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_send_discover": 0, 2023-10-18T14:14:28.726 INFO:teuthology.orchestra.run.smithi158.stdout: "dir_handle_discover": 0, 2023-10-18T14:14:28.726 INFO:teuthology.orchestra.run.smithi158.stdout: "num_strays": 0, 2023-10-18T14:14:28.726 INFO:teuthology.orchestra.run.smithi158.stdout: "num_strays_delayed": 0, 2023-10-18T14:14:28.726 INFO:teuthology.orchestra.run.smithi158.stdout: "num_strays_enqueuing": 0, 2023-10-18T14:14:28.727 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_created": 0, 2023-10-18T14:14:28.727 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_enqueued": 0, 2023-10-18T14:14:28.727 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_reintegrated": 0, 2023-10-18T14:14:28.727 INFO:teuthology.orchestra.run.smithi158.stdout: "strays_migrated": 0, 2023-10-18T14:14:28.727 INFO:teuthology.orchestra.run.smithi158.stdout: "num_recovering_processing": 0, 2023-10-18T14:14:28.727 INFO:teuthology.orchestra.run.smithi158.stdout: "num_recovering_enqueued": 0, 2023-10-18T14:14:28.728 INFO:teuthology.orchestra.run.smithi158.stdout: "num_recovering_prioritized": 0, 2023-10-18T14:14:28.728 INFO:teuthology.orchestra.run.smithi158.stdout: "recovery_started": 0, 2023-10-18T14:14:28.728 INFO:teuthology.orchestra.run.smithi158.stdout: "recovery_completed": 0, 2023-10-18T14:14:28.728 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_enqueue_scrub": 0, 2023-10-18T14:14:28.728 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_exportdir": 0, 2023-10-18T14:14:28.729 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_flush": 0, 2023-10-18T14:14:28.729 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_fragmentdir": 0, 2023-10-18T14:14:28.729 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_fragstats": 0, 2023-10-18T14:14:28.729 INFO:teuthology.orchestra.run.smithi158.stdout: "ireq_inodestats": 0 2023-10-18T14:14:28.729 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.730 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_log": { 2023-10-18T14:14:28.730 INFO:teuthology.orchestra.run.smithi158.stdout: "evlrg": 0, 2023-10-18T14:14:28.730 INFO:teuthology.orchestra.run.smithi158.stdout: "evadd": 0, 2023-10-18T14:14:28.730 INFO:teuthology.orchestra.run.smithi158.stdout: "evex": 0, 2023-10-18T14:14:28.730 INFO:teuthology.orchestra.run.smithi158.stdout: "evtrm": 0, 2023-10-18T14:14:28.731 INFO:teuthology.orchestra.run.smithi158.stdout: "ev": 2529, 2023-10-18T14:14:28.731 INFO:teuthology.orchestra.run.smithi158.stdout: "evexg": 0, 2023-10-18T14:14:28.731 INFO:teuthology.orchestra.run.smithi158.stdout: "evexd": 0, 2023-10-18T14:14:28.731 INFO:teuthology.orchestra.run.smithi158.stdout: "segadd": 0, 2023-10-18T14:14:28.731 INFO:teuthology.orchestra.run.smithi158.stdout: "segex": 0, 2023-10-18T14:14:28.732 INFO:teuthology.orchestra.run.smithi158.stdout: "segtrm": 0, 2023-10-18T14:14:28.732 INFO:teuthology.orchestra.run.smithi158.stdout: "seg": 4, 2023-10-18T14:14:28.732 INFO:teuthology.orchestra.run.smithi158.stdout: "segmjr": 2, 2023-10-18T14:14:28.732 INFO:teuthology.orchestra.run.smithi158.stdout: "segexg": 0, 2023-10-18T14:14:28.732 INFO:teuthology.orchestra.run.smithi158.stdout: "segexd": 0, 2023-10-18T14:14:28.733 INFO:teuthology.orchestra.run.smithi158.stdout: "expos": 4194304, 2023-10-18T14:14:28.733 INFO:teuthology.orchestra.run.smithi158.stdout: "wrpos": 9875714, 2023-10-18T14:14:28.733 INFO:teuthology.orchestra.run.smithi158.stdout: "rdpos": 9874099, 2023-10-18T14:14:28.733 INFO:teuthology.orchestra.run.smithi158.stdout: "jlat": { 2023-10-18T14:14:28.733 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.734 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.734 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.734 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.734 INFO:teuthology.orchestra.run.smithi158.stdout: "replayed": 2529 2023-10-18T14:14:28.734 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.735 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_mem": { 2023-10-18T14:14:28.735 INFO:teuthology.orchestra.run.smithi158.stdout: "ino": 6, 2023-10-18T14:14:28.735 INFO:teuthology.orchestra.run.smithi158.stdout: "ino+": 1797, 2023-10-18T14:14:28.735 INFO:teuthology.orchestra.run.smithi158.stdout: "ino-": 1791, 2023-10-18T14:14:28.735 INFO:teuthology.orchestra.run.smithi158.stdout: "dir": 4, 2023-10-18T14:14:28.736 INFO:teuthology.orchestra.run.smithi158.stdout: "dir+": 84, 2023-10-18T14:14:28.736 INFO:teuthology.orchestra.run.smithi158.stdout: "dir-": 80, 2023-10-18T14:14:28.736 INFO:teuthology.orchestra.run.smithi158.stdout: "dn": 882, 2023-10-18T14:14:28.736 INFO:teuthology.orchestra.run.smithi158.stdout: "dn+": 2782, 2023-10-18T14:14:28.736 INFO:teuthology.orchestra.run.smithi158.stdout: "dn-": 1900, 2023-10-18T14:14:28.737 INFO:teuthology.orchestra.run.smithi158.stdout: "cap": 0, 2023-10-18T14:14:28.737 INFO:teuthology.orchestra.run.smithi158.stdout: "cap+": 0, 2023-10-18T14:14:28.737 INFO:teuthology.orchestra.run.smithi158.stdout: "cap-": 0, 2023-10-18T14:14:28.737 INFO:teuthology.orchestra.run.smithi158.stdout: "rss": 52880, 2023-10-18T14:14:28.737 INFO:teuthology.orchestra.run.smithi158.stdout: "heap": 207152 2023-10-18T14:14:28.738 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.738 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_server": { 2023-10-18T14:14:28.738 INFO:teuthology.orchestra.run.smithi158.stdout: "dispatch_client_request": 0, 2023-10-18T14:14:28.738 INFO:teuthology.orchestra.run.smithi158.stdout: "dispatch_server_request": 0, 2023-10-18T14:14:28.738 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_request": 0, 2023-10-18T14:14:28.739 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_client_session": 0, 2023-10-18T14:14:28.739 INFO:teuthology.orchestra.run.smithi158.stdout: "handle_peer_request": 0, 2023-10-18T14:14:28.739 INFO:teuthology.orchestra.run.smithi158.stdout: "req_create_latency": { 2023-10-18T14:14:28.739 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.739 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.739 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.740 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.740 INFO:teuthology.orchestra.run.smithi158.stdout: "req_getattr_latency": { 2023-10-18T14:14:28.740 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.740 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.740 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.740 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.741 INFO:teuthology.orchestra.run.smithi158.stdout: "req_getfilelock_latency": { 2023-10-18T14:14:28.741 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.741 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.741 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.741 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.742 INFO:teuthology.orchestra.run.smithi158.stdout: "req_link_latency": { 2023-10-18T14:14:28.742 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.742 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.742 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.742 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.743 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookup_latency": { 2023-10-18T14:14:28.743 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.743 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.743 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.743 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.744 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookuphash_latency": { 2023-10-18T14:14:28.744 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.744 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.744 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.744 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.745 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupino_latency": { 2023-10-18T14:14:28.745 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.745 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.745 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.745 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.745 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupname_latency": { 2023-10-18T14:14:28.746 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.746 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.746 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.746 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.746 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupparent_latency": { 2023-10-18T14:14:28.747 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.747 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.747 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.747 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.747 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lookupsnap_latency": { 2023-10-18T14:14:28.748 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.748 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.748 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.748 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.748 INFO:teuthology.orchestra.run.smithi158.stdout: "req_lssnap_latency": { 2023-10-18T14:14:28.748 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.749 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.749 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.749 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.749 INFO:teuthology.orchestra.run.smithi158.stdout: "req_mkdir_latency": { 2023-10-18T14:14:28.749 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.750 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.750 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.750 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.750 INFO:teuthology.orchestra.run.smithi158.stdout: "req_mknod_latency": { 2023-10-18T14:14:28.750 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.751 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.751 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.751 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.751 INFO:teuthology.orchestra.run.smithi158.stdout: "req_mksnap_latency": { 2023-10-18T14:14:28.751 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.752 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.752 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.752 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.752 INFO:teuthology.orchestra.run.smithi158.stdout: "req_open_latency": { 2023-10-18T14:14:28.752 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.753 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.753 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.753 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.753 INFO:teuthology.orchestra.run.smithi158.stdout: "req_readdir_latency": { 2023-10-18T14:14:28.753 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.753 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.754 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.754 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.754 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rename_latency": { 2023-10-18T14:14:28.754 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.754 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.755 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.755 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.755 INFO:teuthology.orchestra.run.smithi158.stdout: "req_renamesnap_latency": { 2023-10-18T14:14:28.755 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.755 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.756 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.756 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.756 INFO:teuthology.orchestra.run.smithi158.stdout: "req_snapdiff_latency": { 2023-10-18T14:14:28.756 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.756 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.757 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.757 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.757 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rmdir_latency": { 2023-10-18T14:14:28.757 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.757 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.758 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.758 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.758 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rmsnap_latency": { 2023-10-18T14:14:28.758 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.758 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.759 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.759 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.759 INFO:teuthology.orchestra.run.smithi158.stdout: "req_rmxattr_latency": { 2023-10-18T14:14:28.759 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.759 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.759 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.760 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.760 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setattr_latency": { 2023-10-18T14:14:28.760 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.760 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.760 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.761 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.761 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setdirlayout_latency": { 2023-10-18T14:14:28.761 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.761 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.761 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.761 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.762 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setfilelock_latency": { 2023-10-18T14:14:28.762 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.762 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.762 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.762 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.763 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setlayout_latency": { 2023-10-18T14:14:28.763 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.763 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.763 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.763 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.764 INFO:teuthology.orchestra.run.smithi158.stdout: "req_setxattr_latency": { 2023-10-18T14:14:28.764 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.764 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.764 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.764 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.765 INFO:teuthology.orchestra.run.smithi158.stdout: "req_symlink_latency": { 2023-10-18T14:14:28.765 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.765 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.765 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.765 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.766 INFO:teuthology.orchestra.run.smithi158.stdout: "req_unlink_latency": { 2023-10-18T14:14:28.766 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.766 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.766 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.766 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.767 INFO:teuthology.orchestra.run.smithi158.stdout: "cap_revoke_eviction": 0, 2023-10-18T14:14:28.767 INFO:teuthology.orchestra.run.smithi158.stdout: "cap_acquisition_throttle": 0, 2023-10-18T14:14:28.767 INFO:teuthology.orchestra.run.smithi158.stdout: "req_getvxattr_latency": { 2023-10-18T14:14:28.767 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.767 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.767 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.768 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:28.768 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.768 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_sessions": { 2023-10-18T14:14:28.768 INFO:teuthology.orchestra.run.smithi158.stdout: "session_count": 2, 2023-10-18T14:14:28.768 INFO:teuthology.orchestra.run.smithi158.stdout: "session_add": 2, 2023-10-18T14:14:28.769 INFO:teuthology.orchestra.run.smithi158.stdout: "session_remove": 0, 2023-10-18T14:14:28.769 INFO:teuthology.orchestra.run.smithi158.stdout: "sessions_open": 2, 2023-10-18T14:14:28.769 INFO:teuthology.orchestra.run.smithi158.stdout: "sessions_stale": 0, 2023-10-18T14:14:28.769 INFO:teuthology.orchestra.run.smithi158.stdout: "total_load": 0, 2023-10-18T14:14:28.770 INFO:teuthology.orchestra.run.smithi158.stdout: "average_load": 0, 2023-10-18T14:14:28.770 INFO:teuthology.orchestra.run.smithi158.stdout: "avg_session_uptime": 1994, 2023-10-18T14:14:28.770 INFO:teuthology.orchestra.run.smithi158.stdout: "mdthresh_evicted": 0 2023-10-18T14:14:28.770 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.770 INFO:teuthology.orchestra.run.smithi158.stdout: "mempool": { 2023-10-18T14:14:28.770 INFO:teuthology.orchestra.run.smithi158.stdout: "bloom_filter_bytes": 0, 2023-10-18T14:14:28.771 INFO:teuthology.orchestra.run.smithi158.stdout: "bloom_filter_items": 0, 2023-10-18T14:14:28.771 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_alloc_bytes": 0, 2023-10-18T14:14:28.771 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_alloc_items": 0, 2023-10-18T14:14:28.771 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_data_bytes": 0, 2023-10-18T14:14:28.771 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_data_items": 0, 2023-10-18T14:14:28.771 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-18T14:14:28.772 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_onode_items": 0, 2023-10-18T14:14:28.772 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-18T14:14:28.772 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_meta_items": 0, 2023-10-18T14:14:28.772 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_other_bytes": 0, 2023-10-18T14:14:28.772 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_other_items": 0, 2023-10-18T14:14:28.773 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-18T14:14:28.773 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_cache_buffer_items": 0, 2023-10-18T14:14:28.773 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_extent_bytes": 0, 2023-10-18T14:14:28.773 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_extent_items": 0, 2023-10-18T14:14:28.773 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_blob_bytes": 0, 2023-10-18T14:14:28.773 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_blob_items": 0, 2023-10-18T14:14:28.774 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-18T14:14:28.774 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_shared_blob_items": 0, 2023-10-18T14:14:28.774 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-18T14:14:28.774 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_inline_bl_items": 0, 2023-10-18T14:14:28.774 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_fsck_bytes": 0, 2023-10-18T14:14:28.775 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_fsck_items": 0, 2023-10-18T14:14:28.775 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_txc_bytes": 0, 2023-10-18T14:14:28.775 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_txc_items": 0, 2023-10-18T14:14:28.775 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-18T14:14:28.775 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_deferred_items": 0, 2023-10-18T14:14:28.776 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_bytes": 0, 2023-10-18T14:14:28.776 INFO:teuthology.orchestra.run.smithi158.stdout: "bluestore_writing_items": 0, 2023-10-18T14:14:28.776 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_bytes": 0, 2023-10-18T14:14:28.776 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_items": 0, 2023-10-18T14:14:28.776 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_reader_bytes": 0, 2023-10-18T14:14:28.777 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_reader_items": 0, 2023-10-18T14:14:28.777 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_writer_bytes": 0, 2023-10-18T14:14:28.777 INFO:teuthology.orchestra.run.smithi158.stdout: "bluefs_file_writer_items": 0, 2023-10-18T14:14:28.777 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_anon_bytes": 198225, 2023-10-18T14:14:28.777 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_anon_items": 56, 2023-10-18T14:14:28.778 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_meta_bytes": 0, 2023-10-18T14:14:28.778 INFO:teuthology.orchestra.run.smithi158.stdout: "buffer_meta_items": 0, 2023-10-18T14:14:28.778 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_bytes": 0, 2023-10-18T14:14:28.778 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_items": 0, 2023-10-18T14:14:28.778 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_mapbl_bytes": 0, 2023-10-18T14:14:28.779 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_mapbl_items": 0, 2023-10-18T14:14:28.779 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_pglog_bytes": 0, 2023-10-18T14:14:28.779 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_pglog_items": 0, 2023-10-18T14:14:28.779 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_bytes": 7872, 2023-10-18T14:14:28.779 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_items": 164, 2023-10-18T14:14:28.779 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_mapping_bytes": 0, 2023-10-18T14:14:28.780 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_mapping_items": 0, 2023-10-18T14:14:28.780 INFO:teuthology.orchestra.run.smithi158.stdout: "pgmap_bytes": 0, 2023-10-18T14:14:28.780 INFO:teuthology.orchestra.run.smithi158.stdout: "pgmap_items": 0, 2023-10-18T14:14:28.780 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_co_bytes": 642968, 2023-10-18T14:14:28.780 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_co_items": 3587, 2023-10-18T14:14:28.781 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_1_bytes": 0, 2023-10-18T14:14:28.781 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_1_items": 0, 2023-10-18T14:14:28.781 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_2_bytes": 0, 2023-10-18T14:14:28.781 INFO:teuthology.orchestra.run.smithi158.stdout: "unittest_2_items": 0 2023-10-18T14:14:28.782 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.782 INFO:teuthology.orchestra.run.smithi158.stdout: "objecter": { 2023-10-18T14:14:28.782 INFO:teuthology.orchestra.run.smithi158.stdout: "op_active": 0, 2023-10-18T14:14:28.782 INFO:teuthology.orchestra.run.smithi158.stdout: "op_laggy": 0, 2023-10-18T14:14:28.782 INFO:teuthology.orchestra.run.smithi158.stdout: "op_send": 2011, 2023-10-18T14:14:28.783 INFO:teuthology.orchestra.run.smithi158.stdout: "op_send_bytes": 21, 2023-10-18T14:14:28.783 INFO:teuthology.orchestra.run.smithi158.stdout: "op_resend": 3, 2023-10-18T14:14:28.783 INFO:teuthology.orchestra.run.smithi158.stdout: "op_reply": 2011, 2023-10-18T14:14:28.783 INFO:teuthology.orchestra.run.smithi158.stdout: "op_latency": { 2023-10-18T14:14:28.783 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 2011, 2023-10-18T14:14:28.783 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 1.484983501, 2023-10-18T14:14:28.784 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000738430 2023-10-18T14:14:28.784 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.784 INFO:teuthology.orchestra.run.smithi158.stdout: "op_inflight": 0, 2023-10-18T14:14:28.784 INFO:teuthology.orchestra.run.smithi158.stdout: "oplen_avg": { 2023-10-18T14:14:28.784 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 2011, 2023-10-18T14:14:28.785 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 2012 2023-10-18T14:14:28.785 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.785 INFO:teuthology.orchestra.run.smithi158.stdout: "op": 2011, 2023-10-18T14:14:28.785 INFO:teuthology.orchestra.run.smithi158.stdout: "op_r": 2011, 2023-10-18T14:14:28.785 INFO:teuthology.orchestra.run.smithi158.stdout: "op_w": 0, 2023-10-18T14:14:28.786 INFO:teuthology.orchestra.run.smithi158.stdout: "op_rmw": 0, 2023-10-18T14:14:28.786 INFO:teuthology.orchestra.run.smithi158.stdout: "op_pg": 0, 2023-10-18T14:14:28.786 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_stat": 1276, 2023-10-18T14:14:28.786 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_create": 0, 2023-10-18T14:14:28.786 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_read": 733, 2023-10-18T14:14:28.787 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_write": 0, 2023-10-18T14:14:28.787 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_writefull": 0, 2023-10-18T14:14:28.787 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_writesame": 0, 2023-10-18T14:14:28.787 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_append": 0, 2023-10-18T14:14:28.787 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_zero": 0, 2023-10-18T14:14:28.788 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_truncate": 0, 2023-10-18T14:14:28.788 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_delete": 0, 2023-10-18T14:14:28.788 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_mapext": 0, 2023-10-18T14:14:28.788 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_sparse_read": 0, 2023-10-18T14:14:28.788 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_clonerange": 0, 2023-10-18T14:14:28.789 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_getxattr": 1, 2023-10-18T14:14:28.789 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_setxattr": 0, 2023-10-18T14:14:28.789 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_cmpxattr": 0, 2023-10-18T14:14:28.789 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_rmxattr": 0, 2023-10-18T14:14:28.789 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_resetxattrs": 0, 2023-10-18T14:14:28.790 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_call": 0, 2023-10-18T14:14:28.790 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_watch": 0, 2023-10-18T14:14:28.790 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_notify": 0, 2023-10-18T14:14:28.790 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_src_cmpxattr": 0, 2023-10-18T14:14:28.790 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_pgls": 0, 2023-10-18T14:14:28.791 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_pgls_filter": 0, 2023-10-18T14:14:28.791 INFO:teuthology.orchestra.run.smithi158.stdout: "osdop_other": 0, 2023-10-18T14:14:28.791 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_active": 0, 2023-10-18T14:14:28.791 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_send": 0, 2023-10-18T14:14:28.791 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_resend": 0, 2023-10-18T14:14:28.791 INFO:teuthology.orchestra.run.smithi158.stdout: "linger_ping": 0, 2023-10-18T14:14:28.792 INFO:teuthology.orchestra.run.smithi158.stdout: "poolop_active": 0, 2023-10-18T14:14:28.792 INFO:teuthology.orchestra.run.smithi158.stdout: "poolop_send": 0, 2023-10-18T14:14:28.792 INFO:teuthology.orchestra.run.smithi158.stdout: "poolop_resend": 0, 2023-10-18T14:14:28.792 INFO:teuthology.orchestra.run.smithi158.stdout: "poolstat_active": 0, 2023-10-18T14:14:28.792 INFO:teuthology.orchestra.run.smithi158.stdout: "poolstat_send": 0, 2023-10-18T14:14:28.793 INFO:teuthology.orchestra.run.smithi158.stdout: "poolstat_resend": 0, 2023-10-18T14:14:28.793 INFO:teuthology.orchestra.run.smithi158.stdout: "statfs_active": 0, 2023-10-18T14:14:28.793 INFO:teuthology.orchestra.run.smithi158.stdout: "statfs_send": 0, 2023-10-18T14:14:28.793 INFO:teuthology.orchestra.run.smithi158.stdout: "statfs_resend": 0, 2023-10-18T14:14:28.793 INFO:teuthology.orchestra.run.smithi158.stdout: "command_active": 0, 2023-10-18T14:14:28.794 INFO:teuthology.orchestra.run.smithi158.stdout: "command_send": 0, 2023-10-18T14:14:28.794 INFO:teuthology.orchestra.run.smithi158.stdout: "command_resend": 0, 2023-10-18T14:14:28.794 INFO:teuthology.orchestra.run.smithi158.stdout: "map_epoch": 94, 2023-10-18T14:14:28.794 INFO:teuthology.orchestra.run.smithi158.stdout: "map_full": 0, 2023-10-18T14:14:28.794 INFO:teuthology.orchestra.run.smithi158.stdout: "map_inc": 11, 2023-10-18T14:14:28.795 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_sessions": 6, 2023-10-18T14:14:28.795 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_session_open": 6, 2023-10-18T14:14:28.795 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_session_close": 0, 2023-10-18T14:14:28.795 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_laggy": 0, 2023-10-18T14:14:28.795 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_wr": 0, 2023-10-18T14:14:28.796 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_rd": 2, 2023-10-18T14:14:28.796 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_del": 0 2023-10-18T14:14:28.796 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.796 INFO:teuthology.orchestra.run.smithi158.stdout: "oft": { 2023-10-18T14:14:28.796 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_objs": 0, 2023-10-18T14:14:28.797 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_kv_pairs": 0, 2023-10-18T14:14:28.797 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_updates": 0, 2023-10-18T14:14:28.797 INFO:teuthology.orchestra.run.smithi158.stdout: "omap_total_removes": 0 2023-10-18T14:14:28.797 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.797 INFO:teuthology.orchestra.run.smithi158.stdout: "osd-slow-ops": { 2023-10-18T14:14:28.798 INFO:teuthology.orchestra.run.smithi158.stdout: "slow_ops_count": 0 2023-10-18T14:14:28.798 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.798 INFO:teuthology.orchestra.run.smithi158.stdout: "purge_queue": { 2023-10-18T14:14:28.798 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing_ops": 0, 2023-10-18T14:14:28.798 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing_ops_high_water": 0, 2023-10-18T14:14:28.799 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing": 0, 2023-10-18T14:14:28.799 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executing_high_water": 0, 2023-10-18T14:14:28.799 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_executed": 0, 2023-10-18T14:14:28.799 INFO:teuthology.orchestra.run.smithi158.stdout: "pq_item_in_journal": 0 2023-10-18T14:14:28.799 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.800 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-18T14:14:28.800 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:28.800 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 104857600, 2023-10-18T14:14:28.800 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:28.800 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 2268, 2023-10-18T14:14:28.800 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 7021519, 2023-10-18T14:14:28.801 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:28.801 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 2268, 2023-10-18T14:14:28.801 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 0, 2023-10-18T14:14:28.801 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 0, 2023-10-18T14:14:28.801 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 2268, 2023-10-18T14:14:28.802 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 7021519, 2023-10-18T14:14:28.802 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:28.802 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.802 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.802 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.803 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:28.803 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.803 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-objecter_bytes": { 2023-10-18T14:14:28.803 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:28.803 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 104857600, 2023-10-18T14:14:28.803 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:28.804 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:28.804 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:28.804 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:28.804 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:28.804 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 2011, 2023-10-18T14:14:28.805 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 5682210, 2023-10-18T14:14:28.805 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 2011, 2023-10-18T14:14:28.805 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 5682210, 2023-10-18T14:14:28.805 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:28.805 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.806 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.806 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.806 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:28.806 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.806 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-objecter_ops": { 2023-10-18T14:14:28.807 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:28.807 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 1024, 2023-10-18T14:14:28.807 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:28.807 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:28.807 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:28.808 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:28.808 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:28.808 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 2011, 2023-10-18T14:14:28.808 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 2011, 2023-10-18T14:14:28.808 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 2011, 2023-10-18T14:14:28.808 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 2011, 2023-10-18T14:14:28.809 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:28.809 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.809 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.809 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.809 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:28.810 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.810 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-write_buf_throttle": { 2023-10-18T14:14:28.810 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:28.810 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 3758096384, 2023-10-18T14:14:28.810 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:28.811 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:28.811 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:28.811 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:28.811 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:28.811 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 0, 2023-10-18T14:14:28.812 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 0, 2023-10-18T14:14:28.812 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 0, 2023-10-18T14:14:28.812 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 0, 2023-10-18T14:14:28.812 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:28.812 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.812 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.813 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.813 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:28.813 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-18T14:14:28.813 INFO:teuthology.orchestra.run.smithi158.stdout: "throttle-write_buf_throttle-0x562d0d242960": { 2023-10-18T14:14:28.813 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 0, 2023-10-18T14:14:28.814 INFO:teuthology.orchestra.run.smithi158.stdout: "max": 3758096384, 2023-10-18T14:14:28.814 INFO:teuthology.orchestra.run.smithi158.stdout: "get_started": 0, 2023-10-18T14:14:28.814 INFO:teuthology.orchestra.run.smithi158.stdout: "get": 0, 2023-10-18T14:14:28.814 INFO:teuthology.orchestra.run.smithi158.stdout: "get_sum": 0, 2023-10-18T14:14:28.814 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:28.815 INFO:teuthology.orchestra.run.smithi158.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:28.815 INFO:teuthology.orchestra.run.smithi158.stdout: "take": 0, 2023-10-18T14:14:28.815 INFO:teuthology.orchestra.run.smithi158.stdout: "take_sum": 0, 2023-10-18T14:14:28.815 INFO:teuthology.orchestra.run.smithi158.stdout: "put": 0, 2023-10-18T14:14:28.815 INFO:teuthology.orchestra.run.smithi158.stdout: "put_sum": 0, 2023-10-18T14:14:28.816 INFO:teuthology.orchestra.run.smithi158.stdout: "wait": { 2023-10-18T14:14:28.816 INFO:teuthology.orchestra.run.smithi158.stdout: "avgcount": 0, 2023-10-18T14:14:28.816 INFO:teuthology.orchestra.run.smithi158.stdout: "sum": 0.000000000, 2023-10-18T14:14:28.816 INFO:teuthology.orchestra.run.smithi158.stdout: "avgtime": 0.000000000 2023-10-18T14:14:28.816 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:28.816 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-18T14:14:28.817 INFO:teuthology.orchestra.run.smithi158.stdout:} 2023-10-18T14:14:29.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:28 smithi158 ceph-mon[103317]: pgmap v602: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:14:29.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:28 smithi114 ceph-mon[99494]: pgmap v602: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:14:29.115 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-10-18T14:14:29.115 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-10-18T14:14:29.116 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2023-10-18T14:14:29.116 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2023-10-18T14:14:29.116 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2023-10-18T14:14:29.116 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2023-10-18T14:14:29.117 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2023-10-18T14:14:29.117 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2023-10-18T14:14:29.117 DEBUG:tasks.check_counter:Getting stats from c 2023-10-18T14:14:29.118 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-18T14:14:29.162 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:28 smithi172 ceph-mon[103574]: pgmap v602: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-18T14:14:29.699 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T14:14:30.885 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-10-18T14:14:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2023-10-18T14:14:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1181964, 2023-10-18T14:14:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1181945, 2023-10-18T14:14:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 190147296, 2023-10-18T14:14:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 210266437, 2023-10-18T14:14:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 17, 2023-10-18T14:14:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 8, 2023-10-18T14:14:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 39.267035996, 2023-10-18T14:14:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 15.657116539, 2023-10-18T14:14:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 28.846788195, 2023-10-18T14:14:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.031816805, 2023-10-18T14:14:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1181943, 2023-10-18T14:14:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 40.886385158, 2023-10-18T14:14:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000034592 2023-10-18T14:14:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2303015, 2023-10-18T14:14:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.458489754, 2023-10-18T14:14:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000199 2023-10-18T14:14:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-18T14:14:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2023-10-18T14:14:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2023-10-18T14:14:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1000450, 2023-10-18T14:14:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1000084, 2023-10-18T14:14:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 161026811, 2023-10-18T14:14:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 164160780, 2023-10-18T14:14:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 14, 2023-10-18T14:14:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2023-10-18T14:14:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 32.108380348, 2023-10-18T14:14:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 13.159830214, 2023-10-18T14:14:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 22.984336405, 2023-10-18T14:14:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.014563285, 2023-10-18T14:14:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1000082, 2023-10-18T14:14:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 31.438260170, 2023-10-18T14:14:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000031435 2023-10-18T14:14:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1879957, 2023-10-18T14:14:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.290390114, 2023-10-18T14:14:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000154 2023-10-18T14:14:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3632, 2023-10-18T14:14:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 346384 2023-10-18T14:14:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2023-10-18T14:14:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1079079, 2023-10-18T14:14:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1082637, 2023-10-18T14:14:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 173418347, 2023-10-18T14:14:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 181789936, 2023-10-18T14:14:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 13, 2023-10-18T14:14:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2023-10-18T14:14:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 42.384595941, 2023-10-18T14:14:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 19.555212558, 2023-10-18T14:14:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 29.659313767, 2023-10-18T14:14:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.018348808, 2023-10-18T14:14:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1082637, 2023-10-18T14:14:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 29.317159577, 2023-10-18T14:14:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000027079 2023-10-18T14:14:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2046950, 2023-10-18T14:14:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.395882046, 2023-10-18T14:14:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000193 2023-10-18T14:14:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1003984, 2023-10-18T14:14:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 316720 2023-10-18T14:14:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2023-10-18T14:14:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2023-10-18T14:14:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2023-10-18T14:14:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2023-10-18T14:14:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-10-18T14:14:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-10-18T14:14:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1422, 2023-10-18T14:14:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.816031143, 2023-10-18T14:14:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001277096 2023-10-18T14:14:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2023-10-18T14:14:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-10-18T14:14:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-10-18T14:14:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1495, 2023-10-18T14:14:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.200114455, 2023-10-18T14:14:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000133855 2023-10-18T14:14:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2023-10-18T14:14:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 2999, 2023-10-18T14:14:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 2813, 2023-10-18T14:14:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2023-10-18T14:14:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2813, 2023-10-18T14:14:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 5.107931228, 2023-10-18T14:14:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001815830 2023-10-18T14:14:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2023-10-18T14:14:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 186, 2023-10-18T14:14:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2023-10-18T14:14:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2023-10-18T14:14:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 11, 2023-10-18T14:14:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2023-10-18T14:14:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2023-10-18T14:14:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 6058, 2023-10-18T14:14:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 3, 2023-10-18T14:14:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 5, 2023-10-18T14:14:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 6050, 2023-10-18T14:14:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 6053, 2023-10-18T14:14:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 1492, 2023-10-18T14:14:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2023-10-18T14:14:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2023-10-18T14:14:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 4, 2023-10-18T14:14:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 5397, 2023-10-18T14:14:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 3556, 2023-10-18T14:14:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 53, 2023-10-18T14:14:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 92, 2023-10-18T14:14:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2023-10-18T14:14:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2023-10-18T14:14:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 7, 2023-10-18T14:14:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2023-10-18T14:14:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2023-10-18T14:14:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 25, 2023-10-18T14:14:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 1147, 2023-10-18T14:14:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 184, 2023-10-18T14:14:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 6123, 2023-10-18T14:14:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2023-10-18T14:14:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 884, 2023-10-18T14:14:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2023-10-18T14:14:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 3565, 2023-10-18T14:14:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 51270625, 2023-10-18T14:14:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 4, 2023-10-18T14:14:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 884, 2023-10-18T14:14:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2023-10-18T14:14:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2023-10-18T14:14:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2023-10-18T14:14:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 40, 2023-10-18T14:14:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2023-10-18T14:14:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 40, 2023-10-18T14:14:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 844, 2023-10-18T14:14:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 36, 2023-10-18T14:14:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 121, 2023-10-18T14:14:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 1208, 2023-10-18T14:14:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 2, 2023-10-18T14:14:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-18T14:14:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-18T14:14:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 945, 2023-10-18T14:14:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 788, 2023-10-18T14:14:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 27, 2023-10-18T14:14:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 2008 2023-10-18T14:14:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2023-10-18T14:14:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 203, 2023-10-18T14:14:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 297, 2023-10-18T14:14:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 183, 2023-10-18T14:14:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 452, 2023-10-18T14:14:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 698, 2023-10-18T14:14:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 18, 2023-10-18T14:14:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2023-10-18T14:14:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2023-10-18T14:14:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 834, 2023-10-18T14:14:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 816, 2023-10-18T14:14:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2023-10-18T14:14:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2023-10-18T14:14:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2023-10-18T14:14:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2023-10-18T14:14:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2023-10-18T14:14:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2023-10-18T14:14:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2023-10-18T14:14:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2023-10-18T14:14:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 25, 2023-10-18T14:14:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2023-10-18T14:14:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2023-10-18T14:14:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2023-10-18T14:14:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2023-10-18T14:14:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2023-10-18T14:14:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2023-10-18T14:14:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 4092, 2023-10-18T14:14:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2023-10-18T14:14:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2023-10-18T14:14:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 4092, 2023-10-18T14:14:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2023-10-18T14:14:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2023-10-18T14:14:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 7, 2023-10-18T14:14:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2023-10-18T14:14:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2023-10-18T14:14:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 7, 2023-10-18T14:14:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2023-10-18T14:14:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2023-10-18T14:14:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2023-10-18T14:14:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2023-10-18T14:14:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 14001293, 2023-10-18T14:14:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2023-10-18T14:14:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2023-10-18T14:14:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 468, 2023-10-18T14:14:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 2.923506830, 2023-10-18T14:14:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006246809 2023-10-18T14:14:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2023-10-18T14:14:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2023-10-18T14:14:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 3042, 2023-10-18T14:14:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 4717, 2023-10-18T14:14:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 1675, 2023-10-18T14:14:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 187, 2023-10-18T14:14:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 350, 2023-10-18T14:14:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 163, 2023-10-18T14:14:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 6058, 2023-10-18T14:14:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 8566, 2023-10-18T14:14:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 2508, 2023-10-18T14:14:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2023-10-18T14:14:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 1973, 2023-10-18T14:14:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 1973, 2023-10-18T14:14:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 78024, 2023-10-18T14:14:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 198960 2023-10-18T14:14:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2023-10-18T14:14:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 3601, 2023-10-18T14:14:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 57, 2023-10-18T14:14:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 2999, 2023-10-18T14:14:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 29, 2023-10-18T14:14:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 378, 2023-10-18T14:14:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2023-10-18T14:14:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 186, 2023-10-18T14:14:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.936569823, 2023-10-18T14:14:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.005035321 2023-10-18T14:14:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2023-10-18T14:14:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6, 2023-10-18T14:14:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.017053838, 2023-10-18T14:14:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002842306 2023-10-18T14:14:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2023-10-18T14:14:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2023-10-18T14:14:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2023-10-18T14:14:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1590, 2023-10-18T14:14:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.755975635, 2023-10-18T14:14:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000475456 2023-10-18T14:14:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2023-10-18T14:14:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2023-10-18T14:14:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2023-10-18T14:14:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2023-10-18T14:14:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2023-10-18T14:14:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2023-10-18T14:14:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2023-10-18T14:14:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5, 2023-10-18T14:14:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.010500110, 2023-10-18T14:14:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002100022 2023-10-18T14:14:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2023-10-18T14:14:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2023-10-18T14:14:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2023-10-18T14:14:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 105, 2023-10-18T14:14:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.029850108, 2023-10-18T14:14:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000284286 2023-10-18T14:14:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2023-10-18T14:14:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 69, 2023-10-18T14:14:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.167141406, 2023-10-18T14:14:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002422339 2023-10-18T14:14:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2023-10-18T14:14:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 15, 2023-10-18T14:14:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.437135429, 2023-10-18T14:14:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.029142361 2023-10-18T14:14:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2023-10-18T14:14:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2023-10-18T14:14:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2023-10-18T14:14:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 18, 2023-10-18T14:14:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.408026905, 2023-10-18T14:14:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.078223716 2023-10-18T14:14:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2023-10-18T14:14:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2023-10-18T14:14:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2023-10-18T14:14:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2023-10-18T14:14:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.011179666, 2023-10-18T14:14:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.005589833 2023-10-18T14:14:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2023-10-18T14:14:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2023-10-18T14:14:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2023-10-18T14:14:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2023-10-18T14:14:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2023-10-18T14:14:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2023-10-18T14:14:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000947616, 2023-10-18T14:14:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000947616 2023-10-18T14:14:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2023-10-18T14:14:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 816, 2023-10-18T14:14:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.333550692, 2023-10-18T14:14:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001634253 2023-10-18T14:14:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2023-10-18T14:14:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2023-10-18T14:14:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2023-10-18T14:14:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2023-10-18T14:14:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2023-10-18T14:14:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2023-10-18T14:14:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 1, 2023-10-18T14:14:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2023-10-18T14:14:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2023-10-18T14:14:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 1693, 2023-10-18T14:14:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 846, 2023-10-18T14:14:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 562, 2023-10-18T14:14:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2023-10-18T14:14:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2023-10-18T14:14:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2023-10-18T14:14:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2023-10-18T14:14:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2023-10-18T14:14:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2023-10-18T14:14:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2023-10-18T14:14:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2023-10-18T14:14:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-18T14:14:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2023-10-18T14:14:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-18T14:14:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2023-10-18T14:14:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2023-10-18T14:14:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2023-10-18T14:14:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-18T14:14:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2023-10-18T14:14:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2023-10-18T14:14:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2023-10-18T14:14:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2023-10-18T14:14:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2023-10-18T14:14:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-18T14:14:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2023-10-18T14:14:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-18T14:14:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2023-10-18T14:14:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2023-10-18T14:14:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2023-10-18T14:14:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2023-10-18T14:14:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2023-10-18T14:14:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-18T14:14:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2023-10-18T14:14:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2023-10-18T14:14:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2023-10-18T14:14:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2023-10-18T14:14:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2023-10-18T14:14:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2023-10-18T14:14:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2023-10-18T14:14:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2023-10-18T14:14:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2023-10-18T14:14:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 562665, 2023-10-18T14:14:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 3181, 2023-10-18T14:14:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 1320, 2023-10-18T14:14:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 15, 2023-10-18T14:14:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2023-10-18T14:14:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2023-10-18T14:14:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2023-10-18T14:14:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2023-10-18T14:14:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2023-10-18T14:14:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2023-10-18T14:14:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 7872, 2023-10-18T14:14:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 164, 2023-10-18T14:14:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2023-10-18T14:14:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2023-10-18T14:14:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2023-10-18T14:14:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2023-10-18T14:14:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 11381275, 2023-10-18T14:14:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 108273, 2023-10-18T14:14:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2023-10-18T14:14:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2023-10-18T14:14:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2023-10-18T14:14:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2023-10-18T14:14:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2023-10-18T14:14:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2023-10-18T14:14:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2023-10-18T14:14:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 2299, 2023-10-18T14:14:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 9986300, 2023-10-18T14:14:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 27, 2023-10-18T14:14:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 2299, 2023-10-18T14:14:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2023-10-18T14:14:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2299, 2023-10-18T14:14:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 5.844849728, 2023-10-18T14:14:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002542344 2023-10-18T14:14:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2023-10-18T14:14:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2023-10-18T14:14:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2299, 2023-10-18T14:14:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 2344 2023-10-18T14:14:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 2299, 2023-10-18T14:14:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 908, 2023-10-18T14:14:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 1391, 2023-10-18T14:14:30.974 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2023-10-18T14:14:30.974 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2023-10-18T14:14:30.974 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2023-10-18T14:14:30.974 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2023-10-18T14:14:30.974 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 24, 2023-10-18T14:14:30.975 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 492, 2023-10-18T14:14:30.975 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 28, 2023-10-18T14:14:30.975 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2023-10-18T14:14:30.975 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2023-10-18T14:14:30.975 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2023-10-18T14:14:30.975 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2023-10-18T14:14:30.976 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 830, 2023-10-18T14:14:30.976 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2023-10-18T14:14:30.976 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2023-10-18T14:14:30.976 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2023-10-18T14:14:30.976 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 884, 2023-10-18T14:14:30.977 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2023-10-18T14:14:30.977 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2023-10-18T14:14:30.977 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2023-10-18T14:14:30.977 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2023-10-18T14:14:30.977 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2023-10-18T14:14:30.978 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2023-10-18T14:14:30.978 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2023-10-18T14:14:30.978 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2023-10-18T14:14:30.978 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2023-10-18T14:14:30.978 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2023-10-18T14:14:30.978 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 2, 2023-10-18T14:14:30.979 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2023-10-18T14:14:30.979 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2023-10-18T14:14:30.979 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2023-10-18T14:14:30.979 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2023-10-18T14:14:30.979 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2023-10-18T14:14:30.980 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2023-10-18T14:14:30.980 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2023-10-18T14:14:30.980 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2023-10-18T14:14:30.980 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2023-10-18T14:14:30.980 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2023-10-18T14:14:30.980 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2023-10-18T14:14:30.981 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2023-10-18T14:14:30.981 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2023-10-18T14:14:30.981 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2023-10-18T14:14:30.981 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2023-10-18T14:14:30.981 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2023-10-18T14:14:30.982 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 94, 2023-10-18T14:14:30.982 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2023-10-18T14:14:30.982 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 11, 2023-10-18T14:14:30.982 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2023-10-18T14:14:30.982 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 12, 2023-10-18T14:14:30.983 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2023-10-18T14:14:30.983 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2023-10-18T14:14:30.983 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 42, 2023-10-18T14:14:30.983 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2023-10-18T14:14:30.983 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 12 2023-10-18T14:14:30.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.984 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2023-10-18T14:14:30.984 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2023-10-18T14:14:30.984 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2023-10-18T14:14:30.984 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2023-10-18T14:14:30.984 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2023-10-18T14:14:30.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.985 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2023-10-18T14:14:30.985 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2023-10-18T14:14:30.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.985 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2023-10-18T14:14:30.986 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2023-10-18T14:14:30.986 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 6, 2023-10-18T14:14:30.986 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2023-10-18T14:14:30.986 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 6, 2023-10-18T14:14:30.986 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 816, 2023-10-18T14:14:30.986 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2023-10-18T14:14:30.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.987 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-18T14:14:30.987 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:30.987 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-10-18T14:14:30.987 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:30.988 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 3261489, 2023-10-18T14:14:30.988 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 231040520, 2023-10-18T14:14:30.988 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:30.988 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 3261489, 2023-10-18T14:14:30.988 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-10-18T14:14:30.988 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-10-18T14:14:30.989 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3261489, 2023-10-18T14:14:30.989 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 231040520, 2023-10-18T14:14:30.989 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:30.989 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.989 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.990 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.990 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:30.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.990 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2023-10-18T14:14:30.990 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:30.990 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-10-18T14:14:30.991 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:30.991 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-10-18T14:14:30.991 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-10-18T14:14:30.991 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:30.991 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:30.992 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 2299, 2023-10-18T14:14:30.992 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 10088180, 2023-10-18T14:14:30.992 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2299, 2023-10-18T14:14:30.992 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 10088180, 2023-10-18T14:14:30.992 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:30.993 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.993 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.993 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.993 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:30.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.993 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2023-10-18T14:14:30.994 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:30.994 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2023-10-18T14:14:30.994 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:30.994 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-10-18T14:14:30.994 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-10-18T14:14:30.995 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:30.995 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:30.995 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 2299, 2023-10-18T14:14:30.995 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 2299, 2023-10-18T14:14:30.995 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2299, 2023-10-18T14:14:30.995 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2299, 2023-10-18T14:14:30.996 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:30.996 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.996 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:30.996 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:30.996 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:30.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:30.997 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2023-10-18T14:14:30.997 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:30.997 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-10-18T14:14:30.997 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:30.998 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 816, 2023-10-18T14:14:30.998 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 101880, 2023-10-18T14:14:30.998 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:30.998 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 816, 2023-10-18T14:14:30.998 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-10-18T14:14:30.998 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-10-18T14:14:30.999 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 24, 2023-10-18T14:14:30.999 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 101880, 2023-10-18T14:14:30.999 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:30.999 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:30.999 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:31.000 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:31.000 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:31.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:31.000 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55fd0158a6e0": { 2023-10-18T14:14:31.000 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:31.000 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-10-18T14:14:31.001 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:31.001 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 4092, 2023-10-18T14:14:31.001 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 9806989, 2023-10-18T14:14:31.001 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:31.001 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 4092, 2023-10-18T14:14:31.002 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-10-18T14:14:31.002 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-10-18T14:14:31.002 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 468, 2023-10-18T14:14:31.002 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 9806989, 2023-10-18T14:14:31.002 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:31.003 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:31.003 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:31.003 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:31.003 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:31.004 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:31.004 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-10-18T14:14:31.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:30 smithi172 ceph-mon[103574]: pgmap v603: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2023-10-18T14:14:31.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:30 smithi114 ceph-mon[99494]: pgmap v603: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2023-10-18T14:14:31.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:30 smithi158 ceph-mon[103317]: pgmap v603: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s 2023-10-18T14:14:31.345 INFO:tasks.check_counter:Daemon mds.c mds.exported=25 2023-10-18T14:14:31.345 INFO:tasks.check_counter:Daemon mds.c mds.imported=184 2023-10-18T14:14:31.346 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=203 2023-10-18T14:14:31.346 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=297 2023-10-18T14:14:31.346 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=4 2023-10-18T14:14:31.346 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-10-18T14:14:31.347 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-10-18T14:14:31.347 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2023-10-18T14:14:31.347 DEBUG:tasks.check_counter:Getting stats from f 2023-10-18T14:14:31.347 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-18T14:14:31.907 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T14:14:33.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:32 smithi114 ceph-mon[99494]: pgmap v604: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:14:33.173 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-10-18T14:14:33.173 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2023-10-18T14:14:33.173 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 3054, 2023-10-18T14:14:33.174 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 5989, 2023-10-18T14:14:33.174 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 945641, 2023-10-18T14:14:33.174 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 6095080, 2023-10-18T14:14:33.174 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 21, 2023-10-18T14:14:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2023-10-18T14:14:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.210166569, 2023-10-18T14:14:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.088476845, 2023-10-18T14:14:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.121294064, 2023-10-18T14:14:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.012611002, 2023-10-18T14:14:33.176 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:33.176 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5985, 2023-10-18T14:14:33.176 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.524670665, 2023-10-18T14:14:33.176 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000087664 2023-10-18T14:14:33.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.177 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:33.177 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6832, 2023-10-18T14:14:33.177 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.001762864, 2023-10-18T14:14:33.177 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000258 2023-10-18T14:14:33.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.178 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3120, 2023-10-18T14:14:33.178 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 10896 2023-10-18T14:14:33.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.178 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2023-10-18T14:14:33.179 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1122, 2023-10-18T14:14:33.179 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1255, 2023-10-18T14:14:33.179 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 449457, 2023-10-18T14:14:33.179 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 1622071, 2023-10-18T14:14:33.179 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 15, 2023-10-18T14:14:33.180 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 7, 2023-10-18T14:14:33.180 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.077465295, 2023-10-18T14:14:33.180 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.030268721, 2023-10-18T14:14:33.180 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.030206622, 2023-10-18T14:14:33.181 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.015647220, 2023-10-18T14:14:33.181 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:33.181 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1252, 2023-10-18T14:14:33.181 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.110620598, 2023-10-18T14:14:33.181 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000088355 2023-10-18T14:14:33.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.182 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:33.182 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 782, 2023-10-18T14:14:33.182 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000147057, 2023-10-18T14:14:33.182 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000188 2023-10-18T14:14:33.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.183 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-18T14:14:33.183 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 416912 2023-10-18T14:14:33.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.183 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2023-10-18T14:14:33.184 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1144786, 2023-10-18T14:14:33.184 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1145542, 2023-10-18T14:14:33.184 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 191508270, 2023-10-18T14:14:33.184 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 183786740, 2023-10-18T14:14:33.184 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2023-10-18T14:14:33.185 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2023-10-18T14:14:33.185 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 50.058705559, 2023-10-18T14:14:33.185 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 23.290142777, 2023-10-18T14:14:33.185 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 33.380026486, 2023-10-18T14:14:33.186 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.019675246, 2023-10-18T14:14:33.186 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:33.186 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1145544, 2023-10-18T14:14:33.186 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 18.431508509, 2023-10-18T14:14:33.187 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000016089 2023-10-18T14:14:33.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.187 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:33.187 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2014510, 2023-10-18T14:14:33.188 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.326185689, 2023-10-18T14:14:33.188 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000161 2023-10-18T14:14:33.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.189 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1000624, 2023-10-18T14:14:33.189 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 233728 2023-10-18T14:14:33.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.190 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2023-10-18T14:14:33.190 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2023-10-18T14:14:33.190 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2023-10-18T14:14:33.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.191 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2023-10-18T14:14:33.191 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-10-18T14:14:33.191 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-10-18T14:14:33.191 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 521, 2023-10-18T14:14:33.192 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.335110382, 2023-10-18T14:14:33.192 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002562591 2023-10-18T14:14:33.192 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:33.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.193 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2023-10-18T14:14:33.193 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-10-18T14:14:33.193 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-10-18T14:14:33.193 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1655, 2023-10-18T14:14:33.193 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.200510900, 2023-10-18T14:14:33.194 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000121154 2023-10-18T14:14:33.194 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:33.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.194 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2023-10-18T14:14:33.194 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 2116, 2023-10-18T14:14:33.195 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 1968, 2023-10-18T14:14:33.195 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2023-10-18T14:14:33.195 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1968, 2023-10-18T14:14:33.195 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 2.063337455, 2023-10-18T14:14:33.195 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001048443 2023-10-18T14:14:33.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.196 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2023-10-18T14:14:33.196 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 148, 2023-10-18T14:14:33.196 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 1, 2023-10-18T14:14:33.197 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2023-10-18T14:14:33.197 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 11, 2023-10-18T14:14:33.197 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2023-10-18T14:14:33.197 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2023-10-18T14:14:33.198 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 19, 2023-10-18T14:14:33.198 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 3, 2023-10-18T14:14:33.198 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 6, 2023-10-18T14:14:33.198 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 10, 2023-10-18T14:14:33.199 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 13, 2023-10-18T14:14:33.199 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 2129, 2023-10-18T14:14:33.199 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 2, 2023-10-18T14:14:33.199 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 2, 2023-10-18T14:14:33.200 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 5, 2023-10-18T14:14:33.200 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 3632, 2023-10-18T14:14:33.200 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 3206, 2023-10-18T14:14:33.200 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 146, 2023-10-18T14:14:33.201 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 116, 2023-10-18T14:14:33.201 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2023-10-18T14:14:33.201 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2023-10-18T14:14:33.201 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 2, 2023-10-18T14:14:33.201 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2023-10-18T14:14:33.201 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2023-10-18T14:14:33.202 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 43, 2023-10-18T14:14:33.202 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 1987, 2023-10-18T14:14:33.202 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 43, 2023-10-18T14:14:33.202 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 1084, 2023-10-18T14:14:33.203 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2023-10-18T14:14:33.203 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 416, 2023-10-18T14:14:33.203 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2023-10-18T14:14:33.203 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 3565, 2023-10-18T14:14:33.203 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 51270625, 2023-10-18T14:14:33.204 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 4, 2023-10-18T14:14:33.204 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 416, 2023-10-18T14:14:33.204 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2023-10-18T14:14:33.204 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2023-10-18T14:14:33.204 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2023-10-18T14:14:33.205 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2023-10-18T14:14:33.205 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2023-10-18T14:14:33.205 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2023-10-18T14:14:33.205 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 416, 2023-10-18T14:14:33.205 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2023-10-18T14:14:33.206 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 10, 2023-10-18T14:14:33.206 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 967, 2023-10-18T14:14:33.206 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2023-10-18T14:14:33.206 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-18T14:14:33.206 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-18T14:14:33.207 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 413, 2023-10-18T14:14:33.207 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 404, 2023-10-18T14:14:33.207 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 17, 2023-10-18T14:14:33.207 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 1962 2023-10-18T14:14:33.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.208 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2023-10-18T14:14:33.208 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 135, 2023-10-18T14:14:33.208 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 619, 2023-10-18T14:14:33.208 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 356, 2023-10-18T14:14:33.208 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 474, 2023-10-18T14:14:33.208 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 178, 2023-10-18T14:14:33.209 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2023-10-18T14:14:33.209 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2023-10-18T14:14:33.209 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2023-10-18T14:14:33.209 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 962, 2023-10-18T14:14:33.209 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 962, 2023-10-18T14:14:33.210 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2023-10-18T14:14:33.210 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2023-10-18T14:14:33.210 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2023-10-18T14:14:33.210 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2023-10-18T14:14:33.210 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2023-10-18T14:14:33.211 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2023-10-18T14:14:33.211 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2023-10-18T14:14:33.211 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2023-10-18T14:14:33.211 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 43, 2023-10-18T14:14:33.212 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2023-10-18T14:14:33.212 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2023-10-18T14:14:33.212 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2023-10-18T14:14:33.212 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2023-10-18T14:14:33.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.213 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2023-10-18T14:14:33.213 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2023-10-18T14:14:33.213 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 2574, 2023-10-18T14:14:33.213 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2023-10-18T14:14:33.213 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2023-10-18T14:14:33.213 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 2574, 2023-10-18T14:14:33.214 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2023-10-18T14:14:33.214 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2023-10-18T14:14:33.214 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 4, 2023-10-18T14:14:33.214 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2023-10-18T14:14:33.214 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2023-10-18T14:14:33.215 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 4, 2023-10-18T14:14:33.215 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2023-10-18T14:14:33.215 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2023-10-18T14:14:33.215 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2023-10-18T14:14:33.215 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2023-10-18T14:14:33.215 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 9905561, 2023-10-18T14:14:33.216 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2023-10-18T14:14:33.216 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2023-10-18T14:14:33.216 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 121, 2023-10-18T14:14:33.217 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.834392957, 2023-10-18T14:14:33.217 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006895809 2023-10-18T14:14:33.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.217 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2023-10-18T14:14:33.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.218 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2023-10-18T14:14:33.218 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 25, 2023-10-18T14:14:33.218 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 2031, 2023-10-18T14:14:33.218 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 2006, 2023-10-18T14:14:33.219 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 24, 2023-10-18T14:14:33.219 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 332, 2023-10-18T14:14:33.219 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 308, 2023-10-18T14:14:33.219 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 19, 2023-10-18T14:14:33.219 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 3172, 2023-10-18T14:14:33.220 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 3153, 2023-10-18T14:14:33.220 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 2, 2023-10-18T14:14:33.220 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 1931, 2023-10-18T14:14:33.220 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 1929, 2023-10-18T14:14:33.220 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 71864, 2023-10-18T14:14:33.221 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 198960 2023-10-18T14:14:33.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.221 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2023-10-18T14:14:33.221 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 2583, 2023-10-18T14:14:33.221 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 17, 2023-10-18T14:14:33.222 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 2116, 2023-10-18T14:14:33.222 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 17, 2023-10-18T14:14:33.222 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 46, 2023-10-18T14:14:33.222 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2023-10-18T14:14:33.222 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.223 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.223 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2023-10-18T14:14:33.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3, 2023-10-18T14:14:33.223 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000599029, 2023-10-18T14:14:33.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000199676 2023-10-18T14:14:33.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.224 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2023-10-18T14:14:33.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.224 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.225 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2023-10-18T14:14:33.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.225 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.226 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.226 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2023-10-18T14:14:33.226 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 959, 2023-10-18T14:14:33.226 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.457813779, 2023-10-18T14:14:33.227 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000477386 2023-10-18T14:14:33.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.227 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2023-10-18T14:14:33.227 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.227 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.228 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.228 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2023-10-18T14:14:33.228 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2023-10-18T14:14:33.228 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000260894, 2023-10-18T14:14:33.229 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000260894 2023-10-18T14:14:33.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.229 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2023-10-18T14:14:33.229 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.230 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.230 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.230 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2023-10-18T14:14:33.230 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.231 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.231 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.231 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2023-10-18T14:14:33.232 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.232 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.232 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.232 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2023-10-18T14:14:33.233 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.233 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.233 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.234 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2023-10-18T14:14:33.234 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.234 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.234 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.235 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2023-10-18T14:14:33.235 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.235 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.235 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.236 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2023-10-18T14:14:33.236 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.236 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.236 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.237 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2023-10-18T14:14:33.237 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.237 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.237 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.238 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2023-10-18T14:14:33.238 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 43, 2023-10-18T14:14:33.238 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.046266418, 2023-10-18T14:14:33.238 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001075963 2023-10-18T14:14:33.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.239 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2023-10-18T14:14:33.239 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.239 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.239 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.240 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2023-10-18T14:14:33.240 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.240 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.240 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.241 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2023-10-18T14:14:33.241 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.241 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.241 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.241 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2023-10-18T14:14:33.242 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.242 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.242 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.243 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2023-10-18T14:14:33.243 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.243 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.244 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.244 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2023-10-18T14:14:33.245 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.245 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.245 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.245 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2023-10-18T14:14:33.246 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.246 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.246 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.246 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2023-10-18T14:14:33.246 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.247 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.247 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.247 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2023-10-18T14:14:33.247 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.248 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.248 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.248 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2023-10-18T14:14:33.248 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.249 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.249 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.249 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2023-10-18T14:14:33.249 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.249 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.250 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.250 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2023-10-18T14:14:33.250 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.250 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.250 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.251 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2023-10-18T14:14:33.251 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 962, 2023-10-18T14:14:33.251 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.558397335, 2023-10-18T14:14:33.251 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001619955 2023-10-18T14:14:33.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.252 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2023-10-18T14:14:33.252 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2023-10-18T14:14:33.253 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2023-10-18T14:14:33.253 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.253 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.253 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.253 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:33.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.254 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2023-10-18T14:14:33.254 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2023-10-18T14:14:33.254 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 2, 2023-10-18T14:14:33.254 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 0, 2023-10-18T14:14:33.254 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2023-10-18T14:14:33.254 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2023-10-18T14:14:33.255 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 1846, 2023-10-18T14:14:33.255 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 923, 2023-10-18T14:14:33.255 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 596, 2023-10-18T14:14:33.255 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2023-10-18T14:14:33.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.256 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2023-10-18T14:14:33.256 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2023-10-18T14:14:33.256 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2023-10-18T14:14:33.256 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2023-10-18T14:14:33.256 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2023-10-18T14:14:33.256 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2023-10-18T14:14:33.257 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2023-10-18T14:14:33.257 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-18T14:14:33.257 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2023-10-18T14:14:33.257 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-18T14:14:33.257 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2023-10-18T14:14:33.257 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2023-10-18T14:14:33.257 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2023-10-18T14:14:33.258 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-18T14:14:33.258 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2023-10-18T14:14:33.258 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2023-10-18T14:14:33.258 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2023-10-18T14:14:33.258 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2023-10-18T14:14:33.259 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2023-10-18T14:14:33.259 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-18T14:14:33.259 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2023-10-18T14:14:33.259 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-18T14:14:33.259 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2023-10-18T14:14:33.259 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2023-10-18T14:14:33.260 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2023-10-18T14:14:33.260 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2023-10-18T14:14:33.260 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2023-10-18T14:14:33.260 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-18T14:14:33.260 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2023-10-18T14:14:33.261 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2023-10-18T14:14:33.261 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2023-10-18T14:14:33.261 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2023-10-18T14:14:33.261 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2023-10-18T14:14:33.261 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2023-10-18T14:14:33.262 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2023-10-18T14:14:33.263 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2023-10-18T14:14:33.263 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2023-10-18T14:14:33.263 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 311847, 2023-10-18T14:14:33.263 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 114, 2023-10-18T14:14:33.263 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2023-10-18T14:14:33.264 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2023-10-18T14:14:33.264 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2023-10-18T14:14:33.264 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2023-10-18T14:14:33.264 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2023-10-18T14:14:33.264 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2023-10-18T14:14:33.265 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2023-10-18T14:14:33.265 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2023-10-18T14:14:33.265 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 7872, 2023-10-18T14:14:33.265 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 164, 2023-10-18T14:14:33.265 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2023-10-18T14:14:33.266 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2023-10-18T14:14:33.266 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2023-10-18T14:14:33.266 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2023-10-18T14:14:33.266 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 112613, 2023-10-18T14:14:33.266 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 449, 2023-10-18T14:14:33.267 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2023-10-18T14:14:33.267 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2023-10-18T14:14:33.267 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2023-10-18T14:14:33.267 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2023-10-18T14:14:33.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.268 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2023-10-18T14:14:33.268 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2023-10-18T14:14:33.268 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2023-10-18T14:14:33.268 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 1597, 2023-10-18T14:14:33.268 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 5878622, 2023-10-18T14:14:33.268 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 27, 2023-10-18T14:14:33.269 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 1597, 2023-10-18T14:14:33.269 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2023-10-18T14:14:33.269 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1597, 2023-10-18T14:14:33.269 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 5.769851666, 2023-10-18T14:14:33.269 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003612931 2023-10-18T14:14:33.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.270 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2023-10-18T14:14:33.270 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2023-10-18T14:14:33.270 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1597, 2023-10-18T14:14:33.270 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1634 2023-10-18T14:14:33.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.271 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 1597, 2023-10-18T14:14:33.271 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 433, 2023-10-18T14:14:33.271 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 1164, 2023-10-18T14:14:33.271 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2023-10-18T14:14:33.272 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2023-10-18T14:14:33.272 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2023-10-18T14:14:33.272 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2023-10-18T14:14:33.272 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 16, 2023-10-18T14:14:33.272 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 137, 2023-10-18T14:14:33.273 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 18, 2023-10-18T14:14:33.273 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2023-10-18T14:14:33.273 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2023-10-18T14:14:33.273 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2023-10-18T14:14:33.274 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2023-10-18T14:14:33.274 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 975, 2023-10-18T14:14:33.274 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2023-10-18T14:14:33.274 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2023-10-18T14:14:33.275 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2023-10-18T14:14:33.275 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 417, 2023-10-18T14:14:33.275 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2023-10-18T14:14:33.275 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2023-10-18T14:14:33.275 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2023-10-18T14:14:33.276 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2023-10-18T14:14:33.276 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2023-10-18T14:14:33.276 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2023-10-18T14:14:33.277 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2023-10-18T14:14:33.277 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2023-10-18T14:14:33.277 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2023-10-18T14:14:33.277 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2023-10-18T14:14:33.278 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2023-10-18T14:14:33.278 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2023-10-18T14:14:33.278 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2023-10-18T14:14:33.278 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2023-10-18T14:14:33.278 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2023-10-18T14:14:33.279 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2023-10-18T14:14:33.279 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2023-10-18T14:14:33.279 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2023-10-18T14:14:33.279 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2023-10-18T14:14:33.279 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2023-10-18T14:14:33.279 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2023-10-18T14:14:33.280 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2023-10-18T14:14:33.280 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2023-10-18T14:14:33.280 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2023-10-18T14:14:33.280 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2023-10-18T14:14:33.280 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2023-10-18T14:14:33.281 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2023-10-18T14:14:33.281 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 94, 2023-10-18T14:14:33.281 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2023-10-18T14:14:33.281 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 11, 2023-10-18T14:14:33.281 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2023-10-18T14:14:33.282 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 12, 2023-10-18T14:14:33.282 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2023-10-18T14:14:33.282 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2023-10-18T14:14:33.282 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 32, 2023-10-18T14:14:33.282 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2023-10-18T14:14:33.283 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 7 2023-10-18T14:14:33.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.283 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2023-10-18T14:14:33.283 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2023-10-18T14:14:33.283 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2023-10-18T14:14:33.284 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2023-10-18T14:14:33.284 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2023-10-18T14:14:33.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.284 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2023-10-18T14:14:33.284 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2023-10-18T14:14:33.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.285 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2023-10-18T14:14:33.285 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2023-10-18T14:14:33.285 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 6, 2023-10-18T14:14:33.285 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2023-10-18T14:14:33.286 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 6, 2023-10-18T14:14:33.286 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 962, 2023-10-18T14:14:33.286 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2023-10-18T14:14:33.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.286 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-18T14:14:33.287 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:33.287 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-10-18T14:14:33.287 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:33.287 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1148958, 2023-10-18T14:14:33.287 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 89479276, 2023-10-18T14:14:33.288 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:33.288 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1148958, 2023-10-18T14:14:33.288 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-10-18T14:14:33.288 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-10-18T14:14:33.288 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1148958, 2023-10-18T14:14:33.288 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 89479276, 2023-10-18T14:14:33.289 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:33.289 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.289 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.289 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.289 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:33.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.290 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2023-10-18T14:14:33.290 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:33.290 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-10-18T14:14:33.290 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:33.291 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-10-18T14:14:33.291 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-10-18T14:14:33.291 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:33.291 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:33.291 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1597, 2023-10-18T14:14:33.292 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 5998856, 2023-10-18T14:14:33.292 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1597, 2023-10-18T14:14:33.292 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 5998856, 2023-10-18T14:14:33.292 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:33.292 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.293 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.293 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.293 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:33.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.293 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2023-10-18T14:14:33.294 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:33.294 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2023-10-18T14:14:33.294 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:33.294 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-10-18T14:14:33.294 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-10-18T14:14:33.295 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:33.295 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:33.295 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1597, 2023-10-18T14:14:33.295 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 1597, 2023-10-18T14:14:33.295 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1597, 2023-10-18T14:14:33.296 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1597, 2023-10-18T14:14:33.296 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:33.296 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.296 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.296 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.297 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:33.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.297 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2023-10-18T14:14:33.297 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:33.297 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-10-18T14:14:33.297 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:33.298 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 962, 2023-10-18T14:14:33.298 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 120250, 2023-10-18T14:14:33.298 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:33.298 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 962, 2023-10-18T14:14:33.298 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-10-18T14:14:33.299 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-10-18T14:14:33.299 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 16, 2023-10-18T14:14:33.299 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 120250, 2023-10-18T14:14:33.299 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:33.299 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.300 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.300 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.300 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:33.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:33.300 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55ce82f566e0": { 2023-10-18T14:14:33.301 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:33.301 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-10-18T14:14:33.301 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:33.301 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 2574, 2023-10-18T14:14:33.301 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 5711257, 2023-10-18T14:14:33.301 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:33.302 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 2574, 2023-10-18T14:14:33.302 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-10-18T14:14:33.302 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-10-18T14:14:33.302 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 121, 2023-10-18T14:14:33.302 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 5711257, 2023-10-18T14:14:33.303 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:33.303 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:33.303 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:33.303 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:33.303 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:33.304 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:33.304 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-10-18T14:14:33.305 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:32 smithi158 ceph-mon[103317]: pgmap v604: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:14:33.305 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:32 smithi172 ceph-mon[103574]: pgmap v604: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:14:33.661 INFO:tasks.check_counter:Daemon mds.f mds.exported=43 2023-10-18T14:14:33.661 INFO:tasks.check_counter:Daemon mds.f mds.imported=43 2023-10-18T14:14:33.662 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=135 2023-10-18T14:14:33.662 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=619 2023-10-18T14:14:33.662 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=4 2023-10-18T14:14:33.662 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-10-18T14:14:33.663 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-10-18T14:14:33.663 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2023-10-18T14:14:33.663 DEBUG:tasks.check_counter:Getting stats from i 2023-10-18T14:14:33.664 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-18T14:14:34.221 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T14:14:34.675 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:34 smithi172 ceph-mon[103574]: pgmap v605: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:14:34.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:34 smithi158 ceph-mon[103317]: pgmap v605: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:14:34.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:34 smithi114 ceph-mon[99494]: pgmap v605: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:14:35.403 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-10-18T14:14:35.403 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2023-10-18T14:14:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 126495, 2023-10-18T14:14:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 180703, 2023-10-18T14:14:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 29616872, 2023-10-18T14:14:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 116193076, 2023-10-18T14:14:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 75, 2023-10-18T14:14:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2023-10-18T14:14:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 7.032225148, 2023-10-18T14:14:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 2.917629658, 2023-10-18T14:14:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 11.933813541, 2023-10-18T14:14:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.782815268, 2023-10-18T14:14:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 180706, 2023-10-18T14:14:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 14.733515347, 2023-10-18T14:14:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000081533 2023-10-18T14:14:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 232173, 2023-10-18T14:14:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.040079231, 2023-10-18T14:14:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000172 2023-10-18T14:14:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-18T14:14:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 448 2023-10-18T14:14:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2023-10-18T14:14:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 145589, 2023-10-18T14:14:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 144757, 2023-10-18T14:14:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 27955535, 2023-10-18T14:14:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 73688228, 2023-10-18T14:14:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 15, 2023-10-18T14:14:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2023-10-18T14:14:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 5.963396668, 2023-10-18T14:14:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 2.334377586, 2023-10-18T14:14:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 3.494959262, 2023-10-18T14:14:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.752758087, 2023-10-18T14:14:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 144757, 2023-10-18T14:14:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 16.327207483, 2023-10-18T14:14:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000112790 2023-10-18T14:14:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 230951, 2023-10-18T14:14:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.033198139, 2023-10-18T14:14:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000143 2023-10-18T14:14:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-18T14:14:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 344336 2023-10-18T14:14:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2023-10-18T14:14:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 95209, 2023-10-18T14:14:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 95054, 2023-10-18T14:14:35.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 19028747, 2023-10-18T14:14:35.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 43095952, 2023-10-18T14:14:35.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 30, 2023-10-18T14:14:35.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 9, 2023-10-18T14:14:35.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 3.977190265, 2023-10-18T14:14:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 1.414875758, 2023-10-18T14:14:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 2.115650889, 2023-10-18T14:14:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.643473468, 2023-10-18T14:14:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 95047, 2023-10-18T14:14:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 10.870584707, 2023-10-18T14:14:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000114370 2023-10-18T14:14:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 143152, 2023-10-18T14:14:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.020462147, 2023-10-18T14:14:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000142 2023-10-18T14:14:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1370480, 2023-10-18T14:14:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 251040 2023-10-18T14:14:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2023-10-18T14:14:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2023-10-18T14:14:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2023-10-18T14:14:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2023-10-18T14:14:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-10-18T14:14:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-10-18T14:14:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 88669, 2023-10-18T14:14:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 36.332779483, 2023-10-18T14:14:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000409757 2023-10-18T14:14:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2023-10-18T14:14:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-10-18T14:14:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-10-18T14:14:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5655, 2023-10-18T14:14:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.420508799, 2023-10-18T14:14:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000251195 2023-10-18T14:14:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2023-10-18T14:14:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 21946, 2023-10-18T14:14:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 21619, 2023-10-18T14:14:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2023-10-18T14:14:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 21619, 2023-10-18T14:14:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 490.260835727, 2023-10-18T14:14:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.022677313 2023-10-18T14:14:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2023-10-18T14:14:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 327, 2023-10-18T14:14:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 4, 2023-10-18T14:14:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 1, 2023-10-18T14:14:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 689, 2023-10-18T14:14:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 26, 2023-10-18T14:14:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 4, 2023-10-18T14:14:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 251, 2023-10-18T14:14:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 77, 2023-10-18T14:14:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 164, 2023-10-18T14:14:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 10, 2023-10-18T14:14:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 141, 2023-10-18T14:14:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 5205, 2023-10-18T14:14:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 2, 2023-10-18T14:14:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 2, 2023-10-18T14:14:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 5, 2023-10-18T14:14:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 24694, 2023-10-18T14:14:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 23826, 2023-10-18T14:14:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 239, 2023-10-18T14:14:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 77, 2023-10-18T14:14:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2023-10-18T14:14:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2023-10-18T14:14:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 14, 2023-10-18T14:14:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2023-10-18T14:14:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2023-10-18T14:14:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 186, 2023-10-18T14:14:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 4121, 2023-10-18T14:14:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 4, 2023-10-18T14:14:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 153, 2023-10-18T14:14:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2023-10-18T14:14:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 143, 2023-10-18T14:14:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2023-10-18T14:14:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2023-10-18T14:14:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 246, 2023-10-18T14:14:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 6, 2023-10-18T14:14:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 143, 2023-10-18T14:14:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2023-10-18T14:14:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2023-10-18T14:14:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2023-10-18T14:14:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 72, 2023-10-18T14:14:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 4, 2023-10-18T14:14:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 68, 2023-10-18T14:14:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 71, 2023-10-18T14:14:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 11, 2023-10-18T14:14:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 9081, 2023-10-18T14:14:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 19101, 2023-10-18T14:14:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 8292, 2023-10-18T14:14:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 11, 2023-10-18T14:14:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-18T14:14:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 16867, 2023-10-18T14:14:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 12364, 2023-10-18T14:14:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 129, 2023-10-18T14:14:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 13258 2023-10-18T14:14:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2023-10-18T14:14:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 314, 2023-10-18T14:14:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 515, 2023-10-18T14:14:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 295, 2023-10-18T14:14:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 432, 2023-10-18T14:14:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 681, 2023-10-18T14:14:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 3, 2023-10-18T14:14:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2023-10-18T14:14:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2023-10-18T14:14:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 3155, 2023-10-18T14:14:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 3150, 2023-10-18T14:14:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 2, 2023-10-18T14:14:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2023-10-18T14:14:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2023-10-18T14:14:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2023-10-18T14:14:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2023-10-18T14:14:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2023-10-18T14:14:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2023-10-18T14:14:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 4, 2023-10-18T14:14:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 186, 2023-10-18T14:14:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2023-10-18T14:14:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 30, 2023-10-18T14:14:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2023-10-18T14:14:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2023-10-18T14:14:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2023-10-18T14:14:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2023-10-18T14:14:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 47013, 2023-10-18T14:14:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 46774, 2023-10-18T14:14:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 46774, 2023-10-18T14:14:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 239, 2023-10-18T14:14:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2023-10-18T14:14:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 1547, 2023-10-18T14:14:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 79, 2023-10-18T14:14:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 77, 2023-10-18T14:14:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 77, 2023-10-18T14:14:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2023-10-18T14:14:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 1, 2023-10-18T14:14:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2023-10-18T14:14:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 2, 2023-10-18T14:14:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 129568444, 2023-10-18T14:14:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 130437719, 2023-10-18T14:14:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2023-10-18T14:14:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2023-10-18T14:14:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 26600, 2023-10-18T14:14:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 67.417677423, 2023-10-18T14:14:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002534499 2023-10-18T14:14:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2023-10-18T14:14:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2023-10-18T14:14:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 93, 2023-10-18T14:14:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 6770, 2023-10-18T14:14:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 6677, 2023-10-18T14:14:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 32, 2023-10-18T14:14:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 539, 2023-10-18T14:14:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 507, 2023-10-18T14:14:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 251, 2023-10-18T14:14:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 8533, 2023-10-18T14:14:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 8282, 2023-10-18T14:14:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 2, 2023-10-18T14:14:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 6601, 2023-10-18T14:14:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 6599, 2023-10-18T14:14:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 105212, 2023-10-18T14:14:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 207152 2023-10-18T14:14:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2023-10-18T14:14:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 41111, 2023-10-18T14:14:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 176, 2023-10-18T14:14:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 21946, 2023-10-18T14:14:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 209, 2023-10-18T14:14:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 349, 2023-10-18T14:14:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2023-10-18T14:14:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6510, 2023-10-18T14:14:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 429.536847879, 2023-10-18T14:14:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.065981082 2023-10-18T14:14:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2023-10-18T14:14:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 524, 2023-10-18T14:14:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.868558185, 2023-10-18T14:14:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003565950 2023-10-18T14:14:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2023-10-18T14:14:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2023-10-18T14:14:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2023-10-18T14:14:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.003571138, 2023-10-18T14:14:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001785569 2023-10-18T14:14:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2023-10-18T14:14:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1242, 2023-10-18T14:14:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 5.724684720, 2023-10-18T14:14:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004609246 2023-10-18T14:14:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2023-10-18T14:14:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2023-10-18T14:14:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2023-10-18T14:14:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2023-10-18T14:14:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2023-10-18T14:14:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.456 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.456 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2023-10-18T14:14:35.456 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 10, 2023-10-18T14:14:35.456 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.002980928, 2023-10-18T14:14:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000298092 2023-10-18T14:14:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2023-10-18T14:14:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 82, 2023-10-18T14:14:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.229665039, 2023-10-18T14:14:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.014995915 2023-10-18T14:14:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2023-10-18T14:14:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2023-10-18T14:14:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 10, 2023-10-18T14:14:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.076096398, 2023-10-18T14:14:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.007609639 2023-10-18T14:14:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2023-10-18T14:14:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 321, 2023-10-18T14:14:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.071554008, 2023-10-18T14:14:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000222909 2023-10-18T14:14:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2023-10-18T14:14:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 76, 2023-10-18T14:14:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.855404569, 2023-10-18T14:14:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.024413218 2023-10-18T14:14:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2023-10-18T14:14:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 66, 2023-10-18T14:14:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.730872782, 2023-10-18T14:14:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.011073830 2023-10-18T14:14:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2023-10-18T14:14:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2023-10-18T14:14:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2023-10-18T14:14:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 25, 2023-10-18T14:14:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.906448463, 2023-10-18T14:14:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.036257938 2023-10-18T14:14:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2023-10-18T14:14:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4, 2023-10-18T14:14:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.023161244, 2023-10-18T14:14:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.005790311 2023-10-18T14:14:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2023-10-18T14:14:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2023-10-18T14:14:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 9634, 2023-10-18T14:14:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 41.586722138, 2023-10-18T14:14:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004316662 2023-10-18T14:14:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2023-10-18T14:14:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2023-10-18T14:14:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8, 2023-10-18T14:14:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.002567522, 2023-10-18T14:14:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000320940 2023-10-18T14:14:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2023-10-18T14:14:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2023-10-18T14:14:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6, 2023-10-18T14:14:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.018380721, 2023-10-18T14:14:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003063453 2023-10-18T14:14:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2023-10-18T14:14:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6, 2023-10-18T14:14:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.004748914, 2023-10-18T14:14:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000791485 2023-10-18T14:14:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2023-10-18T14:14:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3093, 2023-10-18T14:14:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 6.618571079, 2023-10-18T14:14:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002139854 2023-10-18T14:14:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2023-10-18T14:14:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2023-10-18T14:14:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2023-10-18T14:14:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2023-10-18T14:14:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2023-10-18T14:14:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2023-10-18T14:14:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 1, 2023-10-18T14:14:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2023-10-18T14:14:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2023-10-18T14:14:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 147, 2023-10-18T14:14:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 73, 2023-10-18T14:14:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 602, 2023-10-18T14:14:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2023-10-18T14:14:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2023-10-18T14:14:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2023-10-18T14:14:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2023-10-18T14:14:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2023-10-18T14:14:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2023-10-18T14:14:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2023-10-18T14:14:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2023-10-18T14:14:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-18T14:14:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2023-10-18T14:14:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-18T14:14:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2023-10-18T14:14:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2023-10-18T14:14:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2023-10-18T14:14:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-18T14:14:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2023-10-18T14:14:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2023-10-18T14:14:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2023-10-18T14:14:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2023-10-18T14:14:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2023-10-18T14:14:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-18T14:14:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2023-10-18T14:14:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-18T14:14:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2023-10-18T14:14:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2023-10-18T14:14:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2023-10-18T14:14:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2023-10-18T14:14:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2023-10-18T14:14:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-18T14:14:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2023-10-18T14:14:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2023-10-18T14:14:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2023-10-18T14:14:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2023-10-18T14:14:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2023-10-18T14:14:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2023-10-18T14:14:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2023-10-18T14:14:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2023-10-18T14:14:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2023-10-18T14:14:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 335268, 2023-10-18T14:14:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 186, 2023-10-18T14:14:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 968, 2023-10-18T14:14:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 11, 2023-10-18T14:14:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2023-10-18T14:14:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2023-10-18T14:14:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2023-10-18T14:14:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2023-10-18T14:14:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2023-10-18T14:14:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2023-10-18T14:14:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 7872, 2023-10-18T14:14:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 164, 2023-10-18T14:14:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2023-10-18T14:14:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2023-10-18T14:14:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2023-10-18T14:14:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2023-10-18T14:14:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 468994, 2023-10-18T14:14:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 4369, 2023-10-18T14:14:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2023-10-18T14:14:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2023-10-18T14:14:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2023-10-18T14:14:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2023-10-18T14:14:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2023-10-18T14:14:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2023-10-18T14:14:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2023-10-18T14:14:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 76916, 2023-10-18T14:14:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 136251342, 2023-10-18T14:14:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 31, 2023-10-18T14:14:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 76916, 2023-10-18T14:14:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2023-10-18T14:14:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 76916, 2023-10-18T14:14:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1649.668612481, 2023-10-18T14:14:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.021447665 2023-10-18T14:14:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2023-10-18T14:14:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2023-10-18T14:14:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 76916, 2023-10-18T14:14:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 91662 2023-10-18T14:14:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 76916, 2023-10-18T14:14:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 198, 2023-10-18T14:14:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 76718, 2023-10-18T14:14:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2023-10-18T14:14:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2023-10-18T14:14:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 392, 2023-10-18T14:14:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 6719, 2023-10-18T14:14:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 46, 2023-10-18T14:14:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 26642, 2023-10-18T14:14:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 119, 2023-10-18T14:14:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2023-10-18T14:14:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2023-10-18T14:14:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2023-10-18T14:14:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 10, 2023-10-18T14:14:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 3796, 2023-10-18T14:14:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2023-10-18T14:14:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2023-10-18T14:14:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2023-10-18T14:14:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 152, 2023-10-18T14:14:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 13440, 2023-10-18T14:14:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2023-10-18T14:14:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2023-10-18T14:14:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2023-10-18T14:14:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2023-10-18T14:14:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2023-10-18T14:14:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2023-10-18T14:14:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2023-10-18T14:14:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2023-10-18T14:14:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2023-10-18T14:14:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 38663, 2023-10-18T14:14:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2023-10-18T14:14:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2023-10-18T14:14:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2023-10-18T14:14:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2023-10-18T14:14:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2023-10-18T14:14:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2023-10-18T14:14:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2023-10-18T14:14:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2023-10-18T14:14:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2023-10-18T14:14:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2023-10-18T14:14:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2023-10-18T14:14:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2023-10-18T14:14:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2023-10-18T14:14:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2023-10-18T14:14:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2023-10-18T14:14:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2023-10-18T14:14:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 94, 2023-10-18T14:14:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2023-10-18T14:14:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 12, 2023-10-18T14:14:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2023-10-18T14:14:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 12, 2023-10-18T14:14:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2023-10-18T14:14:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2023-10-18T14:14:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 1402, 2023-10-18T14:14:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 10, 2023-10-18T14:14:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 271 2023-10-18T14:14:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2023-10-18T14:14:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2023-10-18T14:14:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2023-10-18T14:14:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2023-10-18T14:14:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2023-10-18T14:14:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2023-10-18T14:14:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2023-10-18T14:14:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2023-10-18T14:14:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2023-10-18T14:14:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 25, 2023-10-18T14:14:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2023-10-18T14:14:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 6, 2023-10-18T14:14:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 3150, 2023-10-18T14:14:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2023-10-18T14:14:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-18T14:14:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-10-18T14:14:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 367289, 2023-10-18T14:14:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 43488952, 2023-10-18T14:14:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 367289, 2023-10-18T14:14:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-10-18T14:14:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-10-18T14:14:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 367289, 2023-10-18T14:14:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 43488952, 2023-10-18T14:14:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2023-10-18T14:14:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-10-18T14:14:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-10-18T14:14:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-10-18T14:14:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 76916, 2023-10-18T14:14:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 136569592, 2023-10-18T14:14:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 76916, 2023-10-18T14:14:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 136569592, 2023-10-18T14:14:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2023-10-18T14:14:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2023-10-18T14:14:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-10-18T14:14:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-10-18T14:14:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 76916, 2023-10-18T14:14:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 76916, 2023-10-18T14:14:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 76916, 2023-10-18T14:14:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 76916, 2023-10-18T14:14:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2023-10-18T14:14:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-10-18T14:14:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 3150, 2023-10-18T14:14:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 318318, 2023-10-18T14:14:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 3150, 2023-10-18T14:14:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-10-18T14:14:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-10-18T14:14:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 42, 2023-10-18T14:14:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 318318, 2023-10-18T14:14:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x564075f1a6e0": { 2023-10-18T14:14:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-10-18T14:14:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 47013, 2023-10-18T14:14:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 126243415, 2023-10-18T14:14:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 47013, 2023-10-18T14:14:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-10-18T14:14:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-10-18T14:14:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 26600, 2023-10-18T14:14:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 126243415, 2023-10-18T14:14:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:35.524 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-10-18T14:14:35.875 INFO:tasks.check_counter:Daemon mds.i mds.exported=186 2023-10-18T14:14:35.876 INFO:tasks.check_counter:Daemon mds.i mds.imported=4 2023-10-18T14:14:35.876 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=314 2023-10-18T14:14:35.876 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=515 2023-10-18T14:14:35.876 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2023-10-18T14:14:35.877 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=10 2023-10-18T14:14:35.877 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=4 2023-10-18T14:14:35.877 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=26 2023-10-18T14:14:35.877 DEBUG:tasks.check_counter:Getting stats from l 2023-10-18T14:14:35.878 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-18T14:14:36.438 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-18T14:14:37.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:36 smithi114 ceph-mon[99494]: pgmap v606: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:14:37.167 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:36 smithi172 ceph-mon[103574]: pgmap v606: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:14:37.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:36 smithi158 ceph-mon[103317]: pgmap v606: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-18T14:14:37.862 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-10-18T14:14:37.862 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2023-10-18T14:14:37.863 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1065, 2023-10-18T14:14:37.863 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1067, 2023-10-18T14:14:37.863 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 25895386, 2023-10-18T14:14:37.863 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 331225, 2023-10-18T14:14:37.863 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 7, 2023-10-18T14:14:37.864 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2023-10-18T14:14:37.864 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.117739883, 2023-10-18T14:14:37.864 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.028375289, 2023-10-18T14:14:37.864 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.040434648, 2023-10-18T14:14:37.864 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.038182088, 2023-10-18T14:14:37.865 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:37.865 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1065, 2023-10-18T14:14:37.865 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.049902080, 2023-10-18T14:14:37.865 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000046856 2023-10-18T14:14:37.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.866 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:37.866 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.866 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.866 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.867 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-18T14:14:37.867 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2023-10-18T14:14:37.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.867 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2023-10-18T14:14:37.867 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 718, 2023-10-18T14:14:37.868 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 691, 2023-10-18T14:14:37.868 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 29851278, 2023-10-18T14:14:37.868 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 251101, 2023-10-18T14:14:37.868 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2023-10-18T14:14:37.868 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2023-10-18T14:14:37.869 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.085501508, 2023-10-18T14:14:37.869 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.023323029, 2023-10-18T14:14:37.869 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.036309268, 2023-10-18T14:14:37.869 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.022179960, 2023-10-18T14:14:37.869 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:37.870 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 691, 2023-10-18T14:14:37.870 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.037971598, 2023-10-18T14:14:37.870 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000054951 2023-10-18T14:14:37.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.870 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:37.871 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.871 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.871 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.871 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 355808, 2023-10-18T14:14:37.872 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 83104 2023-10-18T14:14:37.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.872 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2023-10-18T14:14:37.872 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 60, 2023-10-18T14:14:37.872 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 162, 2023-10-18T14:14:37.873 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 8080538, 2023-10-18T14:14:37.873 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 280407, 2023-10-18T14:14:37.873 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2023-10-18T14:14:37.873 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2023-10-18T14:14:37.873 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.013446687, 2023-10-18T14:14:37.874 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.005176075, 2023-10-18T14:14:37.874 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.005237029, 2023-10-18T14:14:37.874 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.001599977, 2023-10-18T14:14:37.874 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-10-18T14:14:37.875 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 160, 2023-10-18T14:14:37.875 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.010291206, 2023-10-18T14:14:37.875 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000064320 2023-10-18T14:14:37.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.875 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-10-18T14:14:37.875 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.876 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.876 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.876 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-18T14:14:37.876 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 262048 2023-10-18T14:14:37.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.877 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2023-10-18T14:14:37.877 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2023-10-18T14:14:37.877 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2023-10-18T14:14:37.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.878 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2023-10-18T14:14:37.878 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-10-18T14:14:37.878 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-10-18T14:14:37.878 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2730, 2023-10-18T14:14:37.878 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.084222000, 2023-10-18T14:14:37.879 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000030850 2023-10-18T14:14:37.879 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:37.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.879 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2023-10-18T14:14:37.879 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-10-18T14:14:37.880 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-10-18T14:14:37.880 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.880 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.880 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.880 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:37.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.881 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2023-10-18T14:14:37.881 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2023-10-18T14:14:37.881 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2023-10-18T14:14:37.881 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2023-10-18T14:14:37.881 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.882 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.882 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.882 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2023-10-18T14:14:37.882 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2023-10-18T14:14:37.883 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2023-10-18T14:14:37.883 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2023-10-18T14:14:37.883 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2023-10-18T14:14:37.883 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2023-10-18T14:14:37.883 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2023-10-18T14:14:37.884 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 154, 2023-10-18T14:14:37.884 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 7, 2023-10-18T14:14:37.884 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 144, 2023-10-18T14:14:37.884 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 3, 2023-10-18T14:14:37.884 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 143, 2023-10-18T14:14:37.884 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2023-10-18T14:14:37.885 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2023-10-18T14:14:37.885 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2023-10-18T14:14:37.885 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 2, 2023-10-18T14:14:37.885 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2023-10-18T14:14:37.885 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2023-10-18T14:14:37.885 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2023-10-18T14:14:37.886 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2023-10-18T14:14:37.886 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2023-10-18T14:14:37.886 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2023-10-18T14:14:37.886 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2023-10-18T14:14:37.886 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2023-10-18T14:14:37.887 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2023-10-18T14:14:37.887 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2023-10-18T14:14:37.887 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2023-10-18T14:14:37.887 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2023-10-18T14:14:37.887 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2023-10-18T14:14:37.888 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2023-10-18T14:14:37.888 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2023-10-18T14:14:37.888 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2023-10-18T14:14:37.888 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2023-10-18T14:14:37.888 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 246, 2023-10-18T14:14:37.889 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 6, 2023-10-18T14:14:37.889 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2023-10-18T14:14:37.889 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2023-10-18T14:14:37.889 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2023-10-18T14:14:37.889 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2023-10-18T14:14:37.890 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2023-10-18T14:14:37.890 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2023-10-18T14:14:37.890 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2023-10-18T14:14:37.890 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2023-10-18T14:14:37.890 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2023-10-18T14:14:37.891 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2023-10-18T14:14:37.891 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2023-10-18T14:14:37.891 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2023-10-18T14:14:37.891 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-18T14:14:37.891 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-18T14:14:37.892 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2023-10-18T14:14:37.892 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2023-10-18T14:14:37.892 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2023-10-18T14:14:37.892 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2023-10-18T14:14:37.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.893 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2023-10-18T14:14:37.893 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2023-10-18T14:14:37.893 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2023-10-18T14:14:37.893 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2023-10-18T14:14:37.893 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2023-10-18T14:14:37.894 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2023-10-18T14:14:37.894 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2023-10-18T14:14:37.894 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2023-10-18T14:14:37.894 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2023-10-18T14:14:37.894 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2023-10-18T14:14:37.895 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2023-10-18T14:14:37.895 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2023-10-18T14:14:37.895 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2023-10-18T14:14:37.895 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2023-10-18T14:14:37.895 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2023-10-18T14:14:37.896 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2023-10-18T14:14:37.896 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2023-10-18T14:14:37.896 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2023-10-18T14:14:37.896 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2023-10-18T14:14:37.896 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2023-10-18T14:14:37.897 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2023-10-18T14:14:37.897 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2023-10-18T14:14:37.897 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2023-10-18T14:14:37.897 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2023-10-18T14:14:37.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.897 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2023-10-18T14:14:37.898 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2023-10-18T14:14:37.898 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2023-10-18T14:14:37.898 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2023-10-18T14:14:37.898 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2023-10-18T14:14:37.898 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 19891, 2023-10-18T14:14:37.899 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2023-10-18T14:14:37.899 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2023-10-18T14:14:37.899 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2023-10-18T14:14:37.899 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2023-10-18T14:14:37.899 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2023-10-18T14:14:37.899 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2023-10-18T14:14:37.900 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 11, 2023-10-18T14:14:37.900 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2023-10-18T14:14:37.900 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2023-10-18T14:14:37.900 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 129568444, 2023-10-18T14:14:37.900 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 130437719, 2023-10-18T14:14:37.901 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 130437607, 2023-10-18T14:14:37.901 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2023-10-18T14:14:37.901 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.901 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.901 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.902 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 19891 2023-10-18T14:14:37.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.902 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2023-10-18T14:14:37.902 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 71, 2023-10-18T14:14:37.903 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 112, 2023-10-18T14:14:37.903 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 41, 2023-10-18T14:14:37.903 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 14, 2023-10-18T14:14:37.903 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 17, 2023-10-18T14:14:37.903 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 3, 2023-10-18T14:14:37.903 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 154, 2023-10-18T14:14:37.904 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 209, 2023-10-18T14:14:37.904 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 55, 2023-10-18T14:14:37.904 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2023-10-18T14:14:37.904 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2023-10-18T14:14:37.904 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2023-10-18T14:14:37.905 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 48820, 2023-10-18T14:14:37.905 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 207128 2023-10-18T14:14:37.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.905 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2023-10-18T14:14:37.905 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2023-10-18T14:14:37.905 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2023-10-18T14:14:37.906 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2023-10-18T14:14:37.906 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2023-10-18T14:14:37.906 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2023-10-18T14:14:37.906 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2023-10-18T14:14:37.906 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.907 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.907 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.907 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2023-10-18T14:14:37.907 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.908 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.908 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.908 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2023-10-18T14:14:37.908 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.909 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.909 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.909 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2023-10-18T14:14:37.909 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.909 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.910 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.910 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2023-10-18T14:14:37.910 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.910 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.911 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.911 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2023-10-18T14:14:37.911 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.911 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.911 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.912 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2023-10-18T14:14:37.912 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.912 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.912 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.913 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2023-10-18T14:14:37.913 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.913 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.913 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.914 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2023-10-18T14:14:37.914 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.914 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.914 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.915 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2023-10-18T14:14:37.915 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.915 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.915 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.915 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2023-10-18T14:14:37.916 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.916 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.916 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.916 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2023-10-18T14:14:37.917 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.917 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.917 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.917 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2023-10-18T14:14:37.917 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.918 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.918 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.918 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2023-10-18T14:14:37.918 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.918 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.919 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.919 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2023-10-18T14:14:37.919 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.919 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.920 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.920 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2023-10-18T14:14:37.920 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.920 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.920 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.921 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2023-10-18T14:14:37.921 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.921 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.921 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.922 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2023-10-18T14:14:37.922 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.922 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.922 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.923 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2023-10-18T14:14:37.923 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.923 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.923 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.924 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2023-10-18T14:14:37.924 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.924 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.924 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.925 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2023-10-18T14:14:37.925 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.925 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.925 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.926 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2023-10-18T14:14:37.926 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.926 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.926 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.927 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2023-10-18T14:14:37.927 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.927 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.927 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.927 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2023-10-18T14:14:37.928 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.928 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.928 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.928 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2023-10-18T14:14:37.929 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.929 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.929 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.930 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2023-10-18T14:14:37.930 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.930 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.930 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.930 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2023-10-18T14:14:37.931 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.931 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.931 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.931 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2023-10-18T14:14:37.932 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.932 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.932 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.932 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2023-10-18T14:14:37.933 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.933 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.933 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.933 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2023-10-18T14:14:37.934 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2023-10-18T14:14:37.934 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2023-10-18T14:14:37.934 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.934 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.934 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.934 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:37.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.935 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2023-10-18T14:14:37.935 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2023-10-18T14:14:37.935 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 2, 2023-10-18T14:14:37.935 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 0, 2023-10-18T14:14:37.936 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 0, 2023-10-18T14:14:37.936 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2023-10-18T14:14:37.936 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2023-10-18T14:14:37.936 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2023-10-18T14:14:37.936 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 2030, 2023-10-18T14:14:37.937 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2023-10-18T14:14:37.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.937 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2023-10-18T14:14:37.937 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2023-10-18T14:14:37.937 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2023-10-18T14:14:37.938 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2023-10-18T14:14:37.938 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2023-10-18T14:14:37.938 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2023-10-18T14:14:37.938 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2023-10-18T14:14:37.938 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-18T14:14:37.939 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2023-10-18T14:14:37.939 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-18T14:14:37.939 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2023-10-18T14:14:37.939 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2023-10-18T14:14:37.939 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2023-10-18T14:14:37.940 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-18T14:14:37.940 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2023-10-18T14:14:37.940 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2023-10-18T14:14:37.940 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2023-10-18T14:14:37.940 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2023-10-18T14:14:37.940 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2023-10-18T14:14:37.941 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-18T14:14:37.941 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2023-10-18T14:14:37.941 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-18T14:14:37.941 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2023-10-18T14:14:37.941 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2023-10-18T14:14:37.942 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2023-10-18T14:14:37.942 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2023-10-18T14:14:37.942 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2023-10-18T14:14:37.942 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-18T14:14:37.942 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2023-10-18T14:14:37.943 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2023-10-18T14:14:37.943 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2023-10-18T14:14:37.943 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2023-10-18T14:14:37.943 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2023-10-18T14:14:37.943 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2023-10-18T14:14:37.943 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2023-10-18T14:14:37.944 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2023-10-18T14:14:37.944 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2023-10-18T14:14:37.944 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 215825, 2023-10-18T14:14:37.944 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 129, 2023-10-18T14:14:37.944 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2023-10-18T14:14:37.945 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2023-10-18T14:14:37.945 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2023-10-18T14:14:37.945 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2023-10-18T14:14:37.945 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2023-10-18T14:14:37.945 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2023-10-18T14:14:37.946 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2023-10-18T14:14:37.946 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2023-10-18T14:14:37.946 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 7872, 2023-10-18T14:14:37.946 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 164, 2023-10-18T14:14:37.946 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2023-10-18T14:14:37.947 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2023-10-18T14:14:37.947 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2023-10-18T14:14:37.947 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2023-10-18T14:14:37.947 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 310423, 2023-10-18T14:14:37.947 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 2636, 2023-10-18T14:14:37.948 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2023-10-18T14:14:37.948 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2023-10-18T14:14:37.948 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2023-10-18T14:14:37.948 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2023-10-18T14:14:37.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.948 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2023-10-18T14:14:37.949 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2023-10-18T14:14:37.949 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2023-10-18T14:14:37.949 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 1664, 2023-10-18T14:14:37.949 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 26, 2023-10-18T14:14:37.949 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 4, 2023-10-18T14:14:37.950 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 1664, 2023-10-18T14:14:37.950 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2023-10-18T14:14:37.950 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1664, 2023-10-18T14:14:37.950 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.130971034, 2023-10-18T14:14:37.950 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000679670 2023-10-18T14:14:37.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.951 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2023-10-18T14:14:37.951 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2023-10-18T14:14:37.951 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1664, 2023-10-18T14:14:37.951 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1665 2023-10-18T14:14:37.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.952 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 1664, 2023-10-18T14:14:37.952 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 1664, 2023-10-18T14:14:37.952 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2023-10-18T14:14:37.952 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2023-10-18T14:14:37.952 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2023-10-18T14:14:37.953 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 992, 2023-10-18T14:14:37.953 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2023-10-18T14:14:37.953 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 669, 2023-10-18T14:14:37.953 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2023-10-18T14:14:37.953 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2023-10-18T14:14:37.954 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2023-10-18T14:14:37.954 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2023-10-18T14:14:37.954 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2023-10-18T14:14:37.954 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2023-10-18T14:14:37.954 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2023-10-18T14:14:37.954 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2023-10-18T14:14:37.955 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2023-10-18T14:14:37.955 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2023-10-18T14:14:37.955 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 2, 2023-10-18T14:14:37.955 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2023-10-18T14:14:37.955 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2023-10-18T14:14:37.956 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2023-10-18T14:14:37.956 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2023-10-18T14:14:37.956 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2023-10-18T14:14:37.956 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2023-10-18T14:14:37.956 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2023-10-18T14:14:37.957 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2023-10-18T14:14:37.957 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2023-10-18T14:14:37.957 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2023-10-18T14:14:37.957 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2023-10-18T14:14:37.957 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2023-10-18T14:14:37.957 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2023-10-18T14:14:37.958 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2023-10-18T14:14:37.958 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2023-10-18T14:14:37.958 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2023-10-18T14:14:37.958 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2023-10-18T14:14:37.958 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2023-10-18T14:14:37.959 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2023-10-18T14:14:37.959 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2023-10-18T14:14:37.959 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2023-10-18T14:14:37.959 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2023-10-18T14:14:37.959 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2023-10-18T14:14:37.959 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2023-10-18T14:14:37.960 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2023-10-18T14:14:37.960 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2023-10-18T14:14:37.960 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2023-10-18T14:14:37.960 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 94, 2023-10-18T14:14:37.960 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2023-10-18T14:14:37.961 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 8, 2023-10-18T14:14:37.961 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 8, 2023-10-18T14:14:37.961 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 8, 2023-10-18T14:14:37.961 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2023-10-18T14:14:37.961 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2023-10-18T14:14:37.962 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2023-10-18T14:14:37.962 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2023-10-18T14:14:37.962 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2023-10-18T14:14:37.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.962 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2023-10-18T14:14:37.962 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2023-10-18T14:14:37.963 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2023-10-18T14:14:37.963 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2023-10-18T14:14:37.963 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2023-10-18T14:14:37.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.963 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2023-10-18T14:14:37.964 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2023-10-18T14:14:37.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.964 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2023-10-18T14:14:37.964 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2023-10-18T14:14:37.964 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2023-10-18T14:14:37.965 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2023-10-18T14:14:37.965 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2023-10-18T14:14:37.965 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2023-10-18T14:14:37.965 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2023-10-18T14:14:37.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.965 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-18T14:14:37.966 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:37.966 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-10-18T14:14:37.966 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:37.966 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1839, 2023-10-18T14:14:37.966 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 63649937, 2023-10-18T14:14:37.967 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:37.967 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1839, 2023-10-18T14:14:37.967 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-10-18T14:14:37.967 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-10-18T14:14:37.967 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1839, 2023-10-18T14:14:37.968 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 63649937, 2023-10-18T14:14:37.968 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:37.968 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.968 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.968 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.968 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:37.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.969 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2023-10-18T14:14:37.969 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:37.969 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-10-18T14:14:37.969 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:37.970 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-10-18T14:14:37.970 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-10-18T14:14:37.970 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:37.970 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:37.970 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1664, 2023-10-18T14:14:37.970 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 63004818, 2023-10-18T14:14:37.971 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1664, 2023-10-18T14:14:37.971 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 63004818, 2023-10-18T14:14:37.971 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:37.971 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.971 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.972 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.972 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:37.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.972 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2023-10-18T14:14:37.972 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:37.973 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2023-10-18T14:14:37.973 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:37.973 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-10-18T14:14:37.973 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-10-18T14:14:37.973 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:37.973 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:37.974 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1664, 2023-10-18T14:14:37.974 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 1664, 2023-10-18T14:14:37.974 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1664, 2023-10-18T14:14:37.974 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1664, 2023-10-18T14:14:37.974 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:37.975 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.975 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.975 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.975 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:37.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.975 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2023-10-18T14:14:37.976 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:37.976 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-10-18T14:14:37.976 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:37.976 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-10-18T14:14:37.976 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-10-18T14:14:37.977 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:37.977 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:37.977 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-10-18T14:14:37.977 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-10-18T14:14:37.977 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2023-10-18T14:14:37.977 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2023-10-18T14:14:37.978 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:37.978 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.978 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.978 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.978 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:37.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-10-18T14:14:37.979 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x56190c580960": { 2023-10-18T14:14:37.979 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-10-18T14:14:37.979 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-10-18T14:14:37.979 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-10-18T14:14:37.980 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-10-18T14:14:37.980 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-10-18T14:14:37.980 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-10-18T14:14:37.980 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-10-18T14:14:37.980 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-10-18T14:14:37.980 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-10-18T14:14:37.981 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2023-10-18T14:14:37.981 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2023-10-18T14:14:37.981 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-10-18T14:14:37.981 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-10-18T14:14:37.981 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-10-18T14:14:37.982 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-10-18T14:14:37.982 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:37.982 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-10-18T14:14:37.982 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-10-18T14:14:38.293 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-10-18T14:14:38.293 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-10-18T14:14:38.293 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2023-10-18T14:14:38.294 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2023-10-18T14:14:38.294 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=6 2023-10-18T14:14:38.294 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2023-10-18T14:14:38.295 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2023-10-18T14:14:38.295 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2023-10-18T14:14:38.295 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-18T14:14:38.306 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-18T14:14:38.307 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T14:14:38.307 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T14:14:38.332 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T14:14:38.332 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T14:14:38.393 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:14:38.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.564+0000 7fdd67fe7700 1 -- 172.21.15.114:0/141134290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd600ff5e0 msgr2=0x7fdd600ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:38.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.564+0000 7fdd67fe7700 1 --2- 172.21.15.114:0/141134290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd600ff5e0 0x7fdd600ffa60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009990 tx=0x7fdd5c009ca0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.564+0000 7fdd67fe7700 1 -- 172.21.15.114:0/141134290 shutdown_connections 2023-10-18T14:14:38.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.564+0000 7fdd67fe7700 1 --2- 172.21.15.114:0/141134290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd600fffa0 0x7fdd6010c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.564+0000 7fdd67fe7700 1 --2- 172.21.15.114:0/141134290 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd60105660 0x7fdd60105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.564+0000 7fdd67fe7700 1 --2- 172.21.15.114:0/141134290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd600ff5e0 0x7fdd600ffa60 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.564+0000 7fdd67fe7700 1 -- 172.21.15.114:0/141134290 >> 172.21.15.114:0/141134290 conn(0x7fdd60076790 msgr2=0x7fdd60076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:38.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.564+0000 7fdd67fe7700 1 -- 172.21.15.114:0/141134290 shutdown_connections 2023-10-18T14:14:38.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.564+0000 7fdd67fe7700 1 -- 172.21.15.114:0/141134290 wait complete. 2023-10-18T14:14:38.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd67fe7700 1 Processor -- start 2023-10-18T14:14:38.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd67fe7700 1 -- start start 2023-10-18T14:14:38.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd67fe7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd600ff5e0 0x7fdd6019b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:38.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd67fe7700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd600fffa0 0x7fdd6019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:38.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd67fe7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd60105660 0x7fdd601957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:38.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd67fe7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd60195e40 con 0x7fdd600ff5e0 2023-10-18T14:14:38.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd67fe7700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd60195fb0 con 0x7fdd600fffa0 2023-10-18T14:14:38.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd67fe7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd60196170 con 0x7fdd60105660 2023-10-18T14:14:38.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd65d83700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd600ff5e0 0x7fdd6019b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:38.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd65d83700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd600ff5e0 0x7fdd6019b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46878/0 (socket says 172.21.15.114:46878) 2023-10-18T14:14:38.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd65d83700 1 -- 172.21.15.114:0/3697738061 learned_addr learned my addr 172.21.15.114:0/3697738061 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:38.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd66584700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd60105660 0x7fdd601957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:38.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd65d83700 1 -- 172.21.15.114:0/3697738061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd60105660 msgr2=0x7fdd601957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:38.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd65d83700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd60105660 0x7fdd601957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd65d83700 1 -- 172.21.15.114:0/3697738061 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd600fffa0 msgr2=0x7fdd6019bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd65582700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd600fffa0 0x7fdd6019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd65d83700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd600fffa0 0x7fdd6019bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd65d83700 1 -- 172.21.15.114:0/3697738061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c0095f0 con 0x7fdd600ff5e0 2023-10-18T14:14:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.565+0000 7fdd65d83700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd600ff5e0 0x7fdd6019b660 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000c990 tx=0x7fdd5000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.566+0000 7fdd56ffd700 1 -- 172.21.15.114:0/3697738061 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50007b00 con 0x7fdd600ff5e0 2023-10-18T14:14:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.566+0000 7fdd67fe7700 1 -- 172.21.15.114:0/3697738061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd60196450 con 0x7fdd600ff5e0 2023-10-18T14:14:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.566+0000 7fdd56ffd700 1 -- 172.21.15.114:0/3697738061 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd50007c60 con 0x7fdd600ff5e0 2023-10-18T14:14:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.566+0000 7fdd56ffd700 1 -- 172.21.15.114:0/3697738061 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000fea0 con 0x7fdd600ff5e0 2023-10-18T14:14:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.566+0000 7fdd67fe7700 1 -- 172.21.15.114:0/3697738061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd601a2650 con 0x7fdd600ff5e0 2023-10-18T14:14:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.567+0000 7fdd67fe7700 1 -- 172.21.15.114:0/3697738061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd60107be0 con 0x7fdd600ff5e0 2023-10-18T14:14:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.568+0000 7fdd56ffd700 1 -- 172.21.15.114:0/3697738061 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fdd5000f450 con 0x7fdd600ff5e0 2023-10-18T14:14:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.568+0000 7fdd56ffd700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdd4c0a15f0 0x7fdd4c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.568+0000 7fdd65582700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdd4c0a15f0 0x7fdd4c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.568+0000 7fdd56ffd700 1 -- 172.21.15.114:0/3697738061 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fdd500ccf80 con 0x7fdd600ff5e0 2023-10-18T14:14:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.569+0000 7fdd65582700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdd4c0a15f0 0x7fdd4c0a3ab0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00b5c0 tx=0x7fdd5c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:38.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.572+0000 7fdd56ffd700 1 -- 172.21.15.114:0/3697738061 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdd500962f0 con 0x7fdd600ff5e0 2023-10-18T14:14:38.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.764+0000 7fdd67fe7700 1 -- 172.21.15.114:0/3697738061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd60100d00 con 0x7fdd600ff5e0 2023-10-18T14:14:38.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.766+0000 7fdd56ffd700 1 -- 172.21.15.114:0/3697738061 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+22997 (secure 0 0 0) 0x7fdd50099910 con 0x7fdd600ff5e0 2023-10-18T14:14:38.770 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:14:38.770 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":94,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:14:18.432490+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:14:38.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.768+0000 7fdd67fe7700 1 -- 172.21.15.114:0/3697738061 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdd4c0a15f0 msgr2=0x7fdd4c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:38.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.768+0000 7fdd67fe7700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdd4c0a15f0 0x7fdd4c0a3ab0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00b5c0 tx=0x7fdd5c005fb0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.768+0000 7fdd67fe7700 1 -- 172.21.15.114:0/3697738061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd600ff5e0 msgr2=0x7fdd6019b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.768+0000 7fdd67fe7700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd600ff5e0 0x7fdd6019b660 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000c990 tx=0x7fdd5000cca0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.768+0000 7fdd67fe7700 1 -- 172.21.15.114:0/3697738061 shutdown_connections 2023-10-18T14:14:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.768+0000 7fdd67fe7700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fdd4c0a15f0 0x7fdd4c0a3ab0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.768+0000 7fdd67fe7700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd60105660 0x7fdd601957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.768+0000 7fdd67fe7700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd600ff5e0 0x7fdd6019b660 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.768+0000 7fdd67fe7700 1 --2- 172.21.15.114:0/3697738061 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdd600fffa0 0x7fdd6019bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.768+0000 7fdd67fe7700 1 -- 172.21.15.114:0/3697738061 >> 172.21.15.114:0/3697738061 conn(0x7fdd60076790 msgr2=0x7fdd600fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.768+0000 7fdd67fe7700 1 -- 172.21.15.114:0/3697738061 shutdown_connections 2023-10-18T14:14:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.768+0000 7fdd67fe7700 1 -- 172.21.15.114:0/3697738061 wait complete. 2023-10-18T14:14:38.784 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T13:58:43.813590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T14:02:30.693853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T14:02:31.426625+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 93, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T14:14:38.785 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T14:14:38.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.906+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3138334591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf40ff640 msgr2=0x7f1cf40ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:38.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.906+0000 7f1cfa1ea700 1 --2- 172.21.15.114:0/3138334591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf40ff640 0x7f1cf40ffac0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009990 tx=0x7f1ce8009ca0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.906+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3138334591 shutdown_connections 2023-10-18T14:14:38.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.906+0000 7f1cfa1ea700 1 --2- 172.21.15.114:0/3138334591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cf4100000 0x7f1cf410c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.906+0000 7f1cfa1ea700 1 --2- 172.21.15.114:0/3138334591 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cf41056e0 0x7f1cf4105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.906+0000 7f1cfa1ea700 1 --2- 172.21.15.114:0/3138334591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf40ff640 0x7f1cf40ffac0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.906+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3138334591 >> 172.21.15.114:0/3138334591 conn(0x7f1cf40767f0 msgr2=0x7f1cf4076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:38.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.906+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3138334591 shutdown_connections 2023-10-18T14:14:38.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.906+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3138334591 wait complete. 2023-10-18T14:14:38.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cfa1ea700 1 Processor -- start 2023-10-18T14:14:38.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cfa1ea700 1 -- start start 2023-10-18T14:14:38.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cfa1ea700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cf40ff640 0x7f1cf4197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:38.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cfa1ea700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cf4100000 0x7f1cf4197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:38.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cfa1ea700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf41056e0 0x7f1cf41a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:38.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cfa1ea700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf41987f0 con 0x7f1cf41056e0 2023-10-18T14:14:38.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cfa1ea700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf41a3020 con 0x7f1cf40ff640 2023-10-18T14:14:38.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cfa1ea700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf41a3160 con 0x7f1cf4100000 2023-10-18T14:14:38.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cf3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf41056e0 0x7f1cf41a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:38.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cf3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf41056e0 0x7f1cf41a2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46896/0 (socket says 172.21.15.114:46896) 2023-10-18T14:14:38.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cf3fff700 1 -- 172.21.15.114:0/3123070423 learned_addr learned my addr 172.21.15.114:0/3123070423 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:38.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cf2ffd700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cf4100000 0x7f1cf4197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:38.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cf37fe700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cf40ff640 0x7f1cf4197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:38.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cf3fff700 1 -- 172.21.15.114:0/3123070423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cf4100000 msgr2=0x7f1cf4197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:38.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cf3fff700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cf4100000 0x7f1cf4197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cf3fff700 1 -- 172.21.15.114:0/3123070423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cf40ff640 msgr2=0x7f1cf4197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:38.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cf3fff700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cf40ff640 0x7f1cf4197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:38.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.907+0000 7f1cf3fff700 1 -- 172.21.15.114:0/3123070423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80095f0 con 0x7f1cf41056e0 2023-10-18T14:14:38.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.908+0000 7f1cf37fe700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cf40ff640 0x7f1cf4197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:14:38.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.908+0000 7f1cf3fff700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf41056e0 0x7f1cf41a2ae0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1cec007f40 tx=0x7f1cec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:38.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.908+0000 7f1cf0ff9700 1 -- 172.21.15.114:0/3123070423 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec017070 con 0x7f1cf41056e0 2023-10-18T14:14:38.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.908+0000 7f1cf0ff9700 1 -- 172.21.15.114:0/3123070423 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cec00f040 con 0x7f1cf41056e0 2023-10-18T14:14:38.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.908+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3123070423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf41a33c0 con 0x7f1cf41056e0 2023-10-18T14:14:38.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.908+0000 7f1cf0ff9700 1 -- 172.21.15.114:0/3123070423 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec005740 con 0x7f1cf41056e0 2023-10-18T14:14:38.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.908+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3123070423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf41a38d0 con 0x7f1cf41056e0 2023-10-18T14:14:38.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.909+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3123070423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf4107b80 con 0x7f1cf41056e0 2023-10-18T14:14:38.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.910+0000 7f1cf0ff9700 1 -- 172.21.15.114:0/3123070423 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f1cec0058a0 con 0x7f1cf41056e0 2023-10-18T14:14:38.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.911+0000 7f1cf0ff9700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1cdc0a15f0 0x7f1cdc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:38.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.911+0000 7f1cf0ff9700 1 -- 172.21.15.114:0/3123070423 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f1cec0ccfd0 con 0x7f1cf41056e0 2023-10-18T14:14:38.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.911+0000 7f1cf37fe700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1cdc0a15f0 0x7f1cdc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:38.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.911+0000 7f1cf37fe700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1cdc0a15f0 0x7f1cdc0a3ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4005e10 tx=0x7f1ce4005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:38.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:38.915+0000 7f1cf0ff9700 1 -- 172.21.15.114:0/3123070423 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1cec096240 con 0x7f1cf41056e0 2023-10-18T14:14:39.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:38 smithi114 ceph-mon[99494]: pgmap v607: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:14:39.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:38 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3697738061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:14:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.106+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3123070423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1cf4067dd0 con 0x7f1cf41056e0 2023-10-18T14:14:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.106+0000 7f1cf0ff9700 1 -- 172.21.15.114:0/3123070423 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1cec00dea0 con 0x7f1cf41056e0 2023-10-18T14:14:39.111 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T14:14:39.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.108+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3123070423 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1cdc0a15f0 msgr2=0x7f1cdc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.108+0000 7f1cfa1ea700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1cdc0a15f0 0x7f1cdc0a3ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4005e10 tx=0x7f1ce4005d60 comp rx=0 tx=0).stop 2023-10-18T14:14:39.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.108+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3123070423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf41056e0 msgr2=0x7f1cf41a2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.108+0000 7f1cfa1ea700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf41056e0 0x7f1cf41a2ae0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1cec007f40 tx=0x7f1cec00d3b0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.108+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3123070423 shutdown_connections 2023-10-18T14:14:39.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.108+0000 7f1cfa1ea700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1cdc0a15f0 0x7f1cdc0a3ab0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.108+0000 7f1cfa1ea700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf41056e0 0x7f1cf41a2ae0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.108+0000 7f1cfa1ea700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1cf40ff640 0x7f1cf4197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.108+0000 7f1cfa1ea700 1 --2- 172.21.15.114:0/3123070423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cf4100000 0x7f1cf4197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.109+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3123070423 >> 172.21.15.114:0/3123070423 conn(0x7f1cf40767f0 msgr2=0x7f1cf40fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:39.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.109+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3123070423 shutdown_connections 2023-10-18T14:14:39.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.109+0000 7f1cfa1ea700 1 -- 172.21.15.114:0/3123070423 wait complete. 2023-10-18T14:14:39.125 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T14:14:39.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.246+0000 7f0d101fb700 1 -- 172.21.15.114:0/1074506192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d080ffef0 msgr2=0x7f0d0810c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.246+0000 7f0d101fb700 1 --2- 172.21.15.114:0/1074506192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d080ffef0 0x7f0d0810c3b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000b0d0 tx=0x7f0d0000b3e0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.246+0000 7f0d101fb700 1 -- 172.21.15.114:0/1074506192 shutdown_connections 2023-10-18T14:14:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.246+0000 7f0d101fb700 1 --2- 172.21.15.114:0/1074506192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d080ffef0 0x7f0d0810c3b0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.246+0000 7f0d101fb700 1 --2- 172.21.15.114:0/1074506192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d081055f0 0x7f0d081059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.246+0000 7f0d101fb700 1 --2- 172.21.15.114:0/1074506192 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d080ff530 0x7f0d080ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.246+0000 7f0d101fb700 1 -- 172.21.15.114:0/1074506192 >> 172.21.15.114:0/1074506192 conn(0x7f0d080fb000 msgr2=0x7f0d080fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.246+0000 7f0d101fb700 1 -- 172.21.15.114:0/1074506192 shutdown_connections 2023-10-18T14:14:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.246+0000 7f0d101fb700 1 -- 172.21.15.114:0/1074506192 wait complete. 2023-10-18T14:14:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d101fb700 1 Processor -- start 2023-10-18T14:14:39.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d101fb700 1 -- start start 2023-10-18T14:14:39.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d101fb700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d080ff530 0x7f0d0819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:39.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d101fb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d080ffef0 0x7f0d0819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:39.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d101fb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d081055f0 0x7f0d08195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:39.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d101fb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08195ea0 con 0x7f0d080ffef0 2023-10-18T14:14:39.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d101fb700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08196010 con 0x7f0d080ff530 2023-10-18T14:14:39.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d101fb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d081961d0 con 0x7f0d081055f0 2023-10-18T14:14:39.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d0d796700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d080ffef0 0x7f0d0819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:39.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d0d796700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d080ffef0 0x7f0d0819bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46908/0 (socket says 172.21.15.114:46908) 2023-10-18T14:14:39.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d0d796700 1 -- 172.21.15.114:0/75953413 learned_addr learned my addr 172.21.15.114:0/75953413 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:39.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d0df97700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d080ff530 0x7f0d0819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:39.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d0e798700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d081055f0 0x7f0d08195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:39.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d0d796700 1 -- 172.21.15.114:0/75953413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d081055f0 msgr2=0x7f0d08195830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d0d796700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d081055f0 0x7f0d08195830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d0d796700 1 -- 172.21.15.114:0/75953413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d080ff530 msgr2=0x7f0d0819b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d0d796700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d080ff530 0x7f0d0819b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d0d796700 1 -- 172.21.15.114:0/75953413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d00009d00 con 0x7f0d080ffef0 2023-10-18T14:14:39.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.247+0000 7f0d0e798700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d081055f0 0x7f0d08195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:14:39.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.248+0000 7f0d0d796700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d080ffef0 0x7f0d0819bc40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400e9a0 tx=0x7f0d0400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:39.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.248+0000 7f0cfeffd700 1 -- 172.21.15.114:0/75953413 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04009790 con 0x7f0d080ffef0 2023-10-18T14:14:39.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.248+0000 7f0cfeffd700 1 -- 172.21.15.114:0/75953413 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d0400cbd0 con 0x7f0d080ffef0 2023-10-18T14:14:39.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.248+0000 7f0d101fb700 1 -- 172.21.15.114:0/75953413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d081964b0 con 0x7f0d080ffef0 2023-10-18T14:14:39.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.248+0000 7f0cfeffd700 1 -- 172.21.15.114:0/75953413 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04018680 con 0x7f0d080ffef0 2023-10-18T14:14:39.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.248+0000 7f0d101fb700 1 -- 172.21.15.114:0/75953413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d081a26f0 con 0x7f0d080ffef0 2023-10-18T14:14:39.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.249+0000 7f0d101fb700 1 -- 172.21.15.114:0/75953413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d08107a90 con 0x7f0d080ffef0 2023-10-18T14:14:39.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.250+0000 7f0cfeffd700 1 -- 172.21.15.114:0/75953413 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f0d0400cd40 con 0x7f0d080ffef0 2023-10-18T14:14:39.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.250+0000 7f0cfeffd700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cf40a1660 0x7f0cf40a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:39.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.250+0000 7f0cfeffd700 1 -- 172.21.15.114:0/75953413 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f0d04014070 con 0x7f0d080ffef0 2023-10-18T14:14:39.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.250+0000 7f0d0df97700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cf40a1660 0x7f0cf40a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:39.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.251+0000 7f0d0df97700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cf40a1660 0x7f0cf40a3b20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8005950 tx=0x7f0cf800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:39.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.254+0000 7f0cfeffd700 1 -- 172.21.15.114:0/75953413 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0d04096980 con 0x7f0d080ffef0 2023-10-18T14:14:39.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:38 smithi158 ceph-mon[103317]: pgmap v607: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:14:39.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:38 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3697738061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:14:39.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:38 smithi172 ceph-mon[103574]: pgmap v607: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-18T14:14:39.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:38 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3697738061' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:14:39.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.445+0000 7f0d101fb700 1 -- 172.21.15.114:0/75953413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d08196cf0 con 0x7f0d080ffef0 2023-10-18T14:14:39.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.445+0000 7f0cfeffd700 1 -- 172.21.15.114:0/75953413 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0d04099fa0 con 0x7f0d080ffef0 2023-10-18T14:14:39.450 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T14:14:39.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.447+0000 7f0d101fb700 1 -- 172.21.15.114:0/75953413 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cf40a1660 msgr2=0x7f0cf40a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.447+0000 7f0d101fb700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cf40a1660 0x7f0cf40a3b20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8005950 tx=0x7f0cf800b410 comp rx=0 tx=0).stop 2023-10-18T14:14:39.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.447+0000 7f0d101fb700 1 -- 172.21.15.114:0/75953413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d080ffef0 msgr2=0x7f0d0819bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.447+0000 7f0d101fb700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d080ffef0 0x7f0d0819bc40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400e9a0 tx=0x7f0d0400ecb0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.447+0000 7f0d101fb700 1 -- 172.21.15.114:0/75953413 shutdown_connections 2023-10-18T14:14:39.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.447+0000 7f0d101fb700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f0cf40a1660 0x7f0cf40a3b20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.447+0000 7f0d101fb700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d081055f0 0x7f0d08195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.447+0000 7f0d101fb700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d080ff530 0x7f0d0819b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.447+0000 7f0d101fb700 1 --2- 172.21.15.114:0/75953413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d080ffef0 0x7f0d0819bc40 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.447+0000 7f0d101fb700 1 -- 172.21.15.114:0/75953413 >> 172.21.15.114:0/75953413 conn(0x7f0d080fb000 msgr2=0x7f0d080fc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:39.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.448+0000 7f0d101fb700 1 -- 172.21.15.114:0/75953413 shutdown_connections 2023-10-18T14:14:39.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.448+0000 7f0d101fb700 1 -- 172.21.15.114:0/75953413 wait complete. 2023-10-18T14:14:39.464 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T14:14:39.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.586+0000 7f50e0821700 1 -- 172.21.15.114:0/2205292740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50dc1010d0 msgr2=0x7f50dc10d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.586+0000 7f50e0821700 1 --2- 172.21.15.114:0/2205292740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50dc1010d0 0x7f50dc10d5e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f50d400b0a0 tx=0x7f50d400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.586+0000 7f50e0821700 1 -- 172.21.15.114:0/2205292740 shutdown_connections 2023-10-18T14:14:39.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.586+0000 7f50e0821700 1 --2- 172.21.15.114:0/2205292740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50dc1010d0 0x7f50dc10d5e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.586+0000 7f50e0821700 1 --2- 172.21.15.114:0/2205292740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50dc106720 0x7f50dc106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.586+0000 7f50e0821700 1 --2- 172.21.15.114:0/2205292740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50dc100710 0x7f50dc100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.586+0000 7f50e0821700 1 -- 172.21.15.114:0/2205292740 >> 172.21.15.114:0/2205292740 conn(0x7f50dc0fc200 msgr2=0x7f50dc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:39.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.586+0000 7f50e0821700 1 -- 172.21.15.114:0/2205292740 shutdown_connections 2023-10-18T14:14:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.586+0000 7f50e0821700 1 -- 172.21.15.114:0/2205292740 wait complete. 2023-10-18T14:14:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.586+0000 7f50e0821700 1 Processor -- start 2023-10-18T14:14:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.586+0000 7f50e0821700 1 -- start start 2023-10-18T14:14:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50e0821700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50dc100710 0x7f50dc19c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:39.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50e0821700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50dc1010d0 0x7f50dc19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:39.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50e0821700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50dc106720 0x7f50dc196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:39.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50e0821700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc197100 con 0x7f50dc1010d0 2023-10-18T14:14:39.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50e0821700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc197270 con 0x7f50dc106720 2023-10-18T14:14:39.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50e0821700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc197430 con 0x7f50dc100710 2023-10-18T14:14:39.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50d9d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50dc1010d0 0x7f50dc19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:39.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50d9d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50dc1010d0 0x7f50dc19cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46920/0 (socket says 172.21.15.114:46920) 2023-10-18T14:14:39.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50d9d9b700 1 -- 172.21.15.114:0/678973879 learned_addr learned my addr 172.21.15.114:0/678973879 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:39.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50da59c700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50dc100710 0x7f50dc19c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:39.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50dad9d700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50dc106720 0x7f50dc196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:39.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50d9d9b700 1 -- 172.21.15.114:0/678973879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50dc100710 msgr2=0x7f50dc19c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50d9d9b700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50dc100710 0x7f50dc19c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50d9d9b700 1 -- 172.21.15.114:0/678973879 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50dc106720 msgr2=0x7f50dc196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50d9d9b700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50dc106720 0x7f50dc196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50d9d9b700 1 -- 172.21.15.114:0/678973879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d4009d00 con 0x7f50dc1010d0 2023-10-18T14:14:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50da59c700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50dc100710 0x7f50dc19c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:14:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50dad9d700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50dc106720 0x7f50dc196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:14:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50d9d9b700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50dc1010d0 0x7f50dc19cd80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f50d000d980 tx=0x7f50d000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50cb7fe700 1 -- 172.21.15.114:0/678973879 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d000bb60 con 0x7f50dc1010d0 2023-10-18T14:14:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50cb7fe700 1 -- 172.21.15.114:0/678973879 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50d0007640 con 0x7f50dc1010d0 2023-10-18T14:14:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50e0821700 1 -- 172.21.15.114:0/678973879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc197710 con 0x7f50dc1010d0 2023-10-18T14:14:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50cb7fe700 1 -- 172.21.15.114:0/678973879 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0004e90 con 0x7f50dc1010d0 2023-10-18T14:14:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.587+0000 7f50e0821700 1 -- 172.21.15.114:0/678973879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc1a37c0 con 0x7f50dc1010d0 2023-10-18T14:14:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.588+0000 7f50e0821700 1 -- 172.21.15.114:0/678973879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc108d10 con 0x7f50dc1010d0 2023-10-18T14:14:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.590+0000 7f50cb7fe700 1 -- 172.21.15.114:0/678973879 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f50d000bcc0 con 0x7f50dc1010d0 2023-10-18T14:14:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.590+0000 7f50cb7fe700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f50c40a15f0 0x7f50c40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.591+0000 7f50da59c700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f50c40a15f0 0x7f50c40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.591+0000 7f50cb7fe700 1 -- 172.21.15.114:0/678973879 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f50d00cd4d0 con 0x7f50dc1010d0 2023-10-18T14:14:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.591+0000 7f50da59c700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f50c40a15f0 0x7f50c40a3ab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009c90 tx=0x7f50cc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.594+0000 7f50cb7fe700 1 -- 172.21.15.114:0/678973879 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f50d0096840 con 0x7f50dc1010d0 2023-10-18T14:14:39.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.785+0000 7f50e0821700 1 -- 172.21.15.114:0/678973879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50dc197dc0 con 0x7f50dc1010d0 2023-10-18T14:14:39.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.786+0000 7f50cb7fe700 1 -- 172.21.15.114:0/678973879 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50d00160a0 con 0x7f50dc1010d0 2023-10-18T14:14:39.790 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T14:14:39.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.788+0000 7f50e0821700 1 -- 172.21.15.114:0/678973879 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f50c40a15f0 msgr2=0x7f50c40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.788+0000 7f50e0821700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f50c40a15f0 0x7f50c40a3ab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009c90 tx=0x7f50cc009260 comp rx=0 tx=0).stop 2023-10-18T14:14:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.788+0000 7f50e0821700 1 -- 172.21.15.114:0/678973879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50dc1010d0 msgr2=0x7f50dc19cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.788+0000 7f50e0821700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50dc1010d0 0x7f50dc19cd80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f50d000d980 tx=0x7f50d000dd40 comp rx=0 tx=0).stop 2023-10-18T14:14:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.788+0000 7f50e0821700 1 -- 172.21.15.114:0/678973879 shutdown_connections 2023-10-18T14:14:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.788+0000 7f50e0821700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f50c40a15f0 0x7f50c40a3ab0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.788+0000 7f50e0821700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50dc106720 0x7f50dc196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.788+0000 7f50e0821700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50dc100710 0x7f50dc19c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.788+0000 7f50e0821700 1 --2- 172.21.15.114:0/678973879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50dc1010d0 0x7f50dc19cd80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.788+0000 7f50e0821700 1 -- 172.21.15.114:0/678973879 >> 172.21.15.114:0/678973879 conn(0x7f50dc0fc200 msgr2=0x7f50dc0fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:39.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.788+0000 7f50e0821700 1 -- 172.21.15.114:0/678973879 shutdown_connections 2023-10-18T14:14:39.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.788+0000 7f50e0821700 1 -- 172.21.15.114:0/678973879 wait complete. 2023-10-18T14:14:39.804 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-18T14:14:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.925+0000 7f5bc7071700 1 -- 172.21.15.114:0/3323809424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc01056a0 msgr2=0x7f5bc0105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.925+0000 7f5bc7071700 1 --2- 172.21.15.114:0/3323809424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc01056a0 0x7f5bc0105a80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009990 tx=0x7f5bb4009ca0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.925+0000 7f5bc7071700 1 -- 172.21.15.114:0/3323809424 shutdown_connections 2023-10-18T14:14:39.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.925+0000 7f5bc7071700 1 --2- 172.21.15.114:0/3323809424 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bc00fffc0 0x7f5bc010c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.925+0000 7f5bc7071700 1 --2- 172.21.15.114:0/3323809424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc01056a0 0x7f5bc0105a80 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.925+0000 7f5bc7071700 1 --2- 172.21.15.114:0/3323809424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc00ff600 0x7f5bc00ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.925+0000 7f5bc7071700 1 -- 172.21.15.114:0/3323809424 >> 172.21.15.114:0/3323809424 conn(0x7f5bc00fb130 msgr2=0x7f5bc00fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:39.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.925+0000 7f5bc7071700 1 -- 172.21.15.114:0/3323809424 shutdown_connections 2023-10-18T14:14:39.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.925+0000 7f5bc7071700 1 -- 172.21.15.114:0/3323809424 wait complete. 2023-10-18T14:14:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.925+0000 7f5bc7071700 1 Processor -- start 2023-10-18T14:14:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc7071700 1 -- start start 2023-10-18T14:14:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc7071700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bc00ff600 0x7f5bc019c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc7071700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc00fffc0 0x7f5bc019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc7071700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc01056a0 0x7f5bc0196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc7071700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc0196fd0 con 0x7f5bc01056a0 2023-10-18T14:14:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc7071700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc0197140 con 0x7f5bc00ff600 2023-10-18T14:14:39.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc7071700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc0197300 con 0x7f5bc00fffc0 2023-10-18T14:14:39.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc560e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc01056a0 0x7f5bc0196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:39.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc560e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc01056a0 0x7f5bc0196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46934/0 (socket says 172.21.15.114:46934) 2023-10-18T14:14:39.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc560e700 1 -- 172.21.15.114:0/3540285327 learned_addr learned my addr 172.21.15.114:0/3540285327 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:39.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bbffff700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc00fffc0 0x7f5bc019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:39.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc4e0d700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bc00ff600 0x7f5bc019c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:39.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc560e700 1 -- 172.21.15.114:0/3540285327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc00fffc0 msgr2=0x7f5bc019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc560e700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc00fffc0 0x7f5bc019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc560e700 1 -- 172.21.15.114:0/3540285327 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bc00ff600 msgr2=0x7f5bc019c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:39.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc560e700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bc00ff600 0x7f5bc019c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:39.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc560e700 1 -- 172.21.15.114:0/3540285327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb40095f0 con 0x7f5bc01056a0 2023-10-18T14:14:39.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bbffff700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc00fffc0 0x7f5bc019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:14:39.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.926+0000 7f5bc560e700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc01056a0 0x7f5bc0196970 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8007d70 tx=0x7f5bb800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:39.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.927+0000 7f5bbdffb700 1 -- 172.21.15.114:0/3540285327 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb800ad40 con 0x7f5bc01056a0 2023-10-18T14:14:39.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.927+0000 7f5bc7071700 1 -- 172.21.15.114:0/3540285327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc01975e0 con 0x7f5bc01056a0 2023-10-18T14:14:39.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.927+0000 7f5bbdffb700 1 -- 172.21.15.114:0/3540285327 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5bb80128e0 con 0x7f5bc01056a0 2023-10-18T14:14:39.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.927+0000 7f5bbdffb700 1 -- 172.21.15.114:0/3540285327 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8011780 con 0x7f5bc01056a0 2023-10-18T14:14:39.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.927+0000 7f5bc7071700 1 -- 172.21.15.114:0/3540285327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc01a37e0 con 0x7f5bc01056a0 2023-10-18T14:14:39.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.928+0000 7f5bc7071700 1 -- 172.21.15.114:0/3540285327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc0107c00 con 0x7f5bc01056a0 2023-10-18T14:14:39.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.929+0000 7f5bbdffb700 1 -- 172.21.15.114:0/3540285327 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f5bb8012a50 con 0x7f5bc01056a0 2023-10-18T14:14:39.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.929+0000 7f5bbdffb700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5bb00a15f0 0x7f5bb00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:39.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.929+0000 7f5bc4e0d700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5bb00a15f0 0x7f5bb00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:39.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.929+0000 7f5bbdffb700 1 -- 172.21.15.114:0/3540285327 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f5bb80cd2b0 con 0x7f5bc01056a0 2023-10-18T14:14:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.930+0000 7f5bc4e0d700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5bb00a15f0 0x7f5bb00a3ab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400b5c0 tx=0x7f5bb401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:39.934+0000 7f5bbdffb700 1 -- 172.21.15.114:0/3540285327 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5bb8096730 con 0x7f5bc01056a0 2023-10-18T14:14:40.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:39 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3123070423' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:14:40.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:39 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/75953413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:14:40.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:39 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/678973879' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:14:40.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.144+0000 7f5bc7071700 1 -- 172.21.15.114:0/3540285327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5bc0197de0 con 0x7f5bc01056a0 2023-10-18T14:14:40.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.144+0000 7f5bbdffb700 1 -- 172.21.15.114:0/3540285327 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v94) v1 ==== 81+0+899 (secure 0 0 0) 0x7f5bb8099d50 con 0x7f5bc01056a0 2023-10-18T14:14:40.149 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6801/4083591617 2023-10-19T13:57:07.487148+0000 2023-10-18T14:14:40.149 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:0/469095187 2023-10-19T13:57:07.487148+0000 2023-10-18T14:14:40.149 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:0/3879995605 2023-10-19T13:56:04.611113+0000 2023-10-18T14:14:40.150 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:0/599274026 2023-10-19T13:56:04.611113+0000 2023-10-18T14:14:40.150 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6800/4083591617 2023-10-19T13:57:07.487148+0000 2023-10-18T14:14:40.150 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:0/2423419725 2023-10-19T13:57:07.487148+0000 2023-10-18T14:14:40.150 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6801/3236987300 2023-10-19T13:56:04.611113+0000 2023-10-18T14:14:40.150 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6800/1307090291 2023-10-19T13:55:42.522304+0000 2023-10-18T14:14:40.151 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:0/1340157243 2023-10-19T13:57:07.487148+0000 2023-10-18T14:14:40.151 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:0/1203420443 2023-10-19T13:55:42.522304+0000 2023-10-18T14:14:40.151 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6800/3236987300 2023-10-19T13:56:04.611113+0000 2023-10-18T14:14:40.151 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:0/736541474 2023-10-19T13:56:04.611113+0000 2023-10-18T14:14:40.151 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6801/1307090291 2023-10-19T13:55:42.522304+0000 2023-10-18T14:14:40.152 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:0/1121190039 2023-10-19T13:55:42.522304+0000 2023-10-18T14:14:40.152 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:0/473909953 2023-10-19T13:55:42.522304+0000 2023-10-18T14:14:40.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.146+0000 7f5bc7071700 1 -- 172.21.15.114:0/3540285327 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5bb00a15f0 msgr2=0x7f5bb00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:40.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.146+0000 7f5bc7071700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5bb00a15f0 0x7f5bb00a3ab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400b5c0 tx=0x7f5bb401a040 comp rx=0 tx=0).stop 2023-10-18T14:14:40.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.146+0000 7f5bc7071700 1 -- 172.21.15.114:0/3540285327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc01056a0 msgr2=0x7f5bc0196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:40.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.146+0000 7f5bc7071700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc01056a0 0x7f5bc0196970 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8007d70 tx=0x7f5bb800a340 comp rx=0 tx=0).stop 2023-10-18T14:14:40.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.146+0000 7f5bc7071700 1 -- 172.21.15.114:0/3540285327 shutdown_connections 2023-10-18T14:14:40.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.146+0000 7f5bc7071700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5bb00a15f0 0x7f5bb00a3ab0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:40.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.146+0000 7f5bc7071700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc01056a0 0x7f5bc0196970 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:40.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.146+0000 7f5bc7071700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bc00ff600 0x7f5bc019c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:40.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.146+0000 7f5bc7071700 1 --2- 172.21.15.114:0/3540285327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc00fffc0 0x7f5bc019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:40.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.146+0000 7f5bc7071700 1 -- 172.21.15.114:0/3540285327 >> 172.21.15.114:0/3540285327 conn(0x7f5bc00fb130 msgr2=0x7f5bc00fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:40.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.147+0000 7f5bc7071700 1 -- 172.21.15.114:0/3540285327 shutdown_connections 2023-10-18T14:14:40.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.147+0000 7f5bc7071700 1 -- 172.21.15.114:0/3540285327 wait complete. 2023-10-18T14:14:40.156 INFO:teuthology.orchestra.run.smithi114.stderr:listed 15 entries 2023-10-18T14:14:40.162 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-18T14:14:40.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:14:40.163 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-18T14:14:40.263 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T14:14:40.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:14:40.264 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-18T14:14:40.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:39 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3123070423' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:14:40.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:39 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/75953413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:14:40.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:39 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/678973879' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:14:40.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:39 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3123070423' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-18T14:14:40.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:39 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/75953413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-18T14:14:40.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:39 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/678973879' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-18T14:14:40.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:14:40.334 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-10-18T14:14:40.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-18T14:14:40.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:14:40.363 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-18T14:14:40.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:14:40.444 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2023-10-18T14:14:40.551 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-18T14:14:40.552 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T14:14:40.552 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T14:14:40.571 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16781 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/4155f43986ab1959f613e93b279e8f8f1de5247371aee92a2af2dc2a17769d96/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/F4LOQLQ4PFOVWP4BPNQKPW45BC:/var/lib/containers/storage/overlay/l/ZBZZCN4FE2KLXNZKJTI4J4BKB4,upperdir=/var/lib/containers/storage/overlay/4155f43986ab1959f613e93b279e8f8f1de5247371aee92a2af2dc2a17769d96/diff,workdir=/var/lib/containers/storage/overlay/4155f43986ab1959f613e93b279e8f8f1de5247371aee92a2af2dc2a17769d96/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f839f901349241384313a29b7d7a1384932905f0c6f4fe8b232e21cb2b2d1198/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/F4LOQLQ4PFOVWP4BPNQKPW45BC:/var/lib/containers/storage/overlay/l/ZBZZCN4FE2KLXNZKJTI4J4BKB4,upperdir=/var/lib/containers/storage/overlay/f839f901349241384313a29b7d7a1384932905f0c6f4fe8b232e21cb2b2d1198/diff,workdir=/var/lib/containers/storage/overlay/f839f901349241384313a29b7d7a1384932905f0c6f4fe8b232e21cb2b2d1198/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/f59bf8c9a53ddb3799a3559e6885814a3aa96c3d27953741078edd4d3180f46f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/F4LOQLQ4PFOVWP4BPNQKPW45BC:/var/lib/containers/storage/overlay/l/ZBZZCN4FE2KLXNZKJTI4J4BKB4,upperdir=/var/lib/containers/storage/overlay/f59bf8c9a53ddb3799a3559e6885814a3aa96c3d27953741078edd4d3180f46f/diff,workdir=/var/lib/containers/storage/overlay/f59bf8c9a53ddb3799a3559e6885814a3aa96c3d27953741078edd4d3180f46f/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/81c8420c754204b431d337bdb5b3d2396b5b7a4e5eb78c7c0c8837c6a1f9a48d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/F4LOQLQ4PFOVWP4BPNQKPW45BC:/var/lib/containers/storage/overlay/l/ZBZZCN4FE2KLXNZKJTI4J4BKB4,upperdir=/var/lib/containers/storage/overlay/81c8420c754204b431d337bdb5b3d2396b5b7a4e5eb78c7c0c8837c6a1f9a48d/diff,workdir=/var/lib/containers/storage/overlay/81c8420c754204b431d337bdb5b3d2396b5b7a4e5eb78c7c0c8837c6a1f9a48d/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/65096638877ece1ed8c8c0b558d95b92e45889b8f6ae2aa0a2a53306d50ad566/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/F4LOQLQ4PFOVWP4BPNQKPW45BC:/var/lib/containers/storage/overlay/l/ZBZZCN4FE2KLXNZKJTI4J4BKB4,upperdir=/var/lib/containers/storage/overlay/65096638877ece1ed8c8c0b558d95b92e45889b8f6ae2aa0a2a53306d50ad566/diff,workdir=/var/lib/containers/storage/overlay/65096638877ece1ed8c8c0b558d95b92e45889b8f6ae2aa0a2a53306d50ad566/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/bb75ba79e95df61e00d7c745633191ae5b273cd7de6fdd72fe48700c2dea62be/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/F4LOQLQ4PFOVWP4BPNQKPW45BC:/var/lib/containers/storage/overlay/l/ZBZZCN4FE2KLXNZKJTI4J4BKB4,upperdir=/var/lib/containers/storage/overlay/bb75ba79e95df61e00d7c745633191ae5b273cd7de6fdd72fe48700c2dea62be/diff,workdir=/var/lib/containers/storage/overlay/bb75ba79e95df61e00d7c745633191ae5b273cd7de6fdd72fe48700c2dea62be/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/ca1f04dd214c566a950bd8f5f079f906415f0aacc604eea3a909377ba11255f6/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/F4LOQLQ4PFOVWP4BPNQKPW45BC:/var/lib/containers/storage/overlay/l/ZBZZCN4FE2KLXNZKJTI4J4BKB4,upperdir=/var/lib/containers/storage/overlay/ca1f04dd214c566a950bd8f5f079f906415f0aacc604eea3a909377ba11255f6/diff,workdir=/var/lib/containers/storage/overlay/ca1f04dd214c566a950bd8f5f079f906415f0aacc604eea3a909377ba11255f6/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/0b8b31c4c0f67317acd5bfcbd0c033fe719a5c93d4d5be3b7476719f70370ff7/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/F4LOQLQ4PFOVWP4BPNQKPW45BC:/var/lib/containers/storage/overlay/l/ZBZZCN4FE2KLXNZKJTI4J4BKB4,upperdir=/var/lib/containers/storage/overlay/0b8b31c4c0f67317acd5bfcbd0c033fe719a5c93d4d5be3b7476719f70370ff7/diff,workdir=/var/lib/containers/storage/overlay/0b8b31c4c0f67317acd5bfcbd0c033fe719a5c93d4d5be3b7476719f70370ff7/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/78e3c325b7f97332c0231c0e19ee0e619d069e5e6839308ccd87c208181cadef/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/F4LOQLQ4PFOVWP4BPNQKPW45BC:/var/lib/containers/storage/overlay/l/ZBZZCN4FE2KLXNZKJTI4J4BKB4,upperdir=/var/lib/containers/storage/overlay/78e3c325b7f97332c0231c0e19ee0e619d069e5e6839308ccd87c208181cadef/diff,workdir=/var/lib/containers/storage/overlay/78e3c325b7f97332c0231c0e19ee0e619d069e5e6839308ccd87c208181cadef/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a24edfeb788a7dfd074274dfbdc8928d566b38ee6a9b700e731cb7f0a7697f3e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/F4LOQLQ4PFOVWP4BPNQKPW45BC:/var/lib/containers/storage/overlay/l/ZBZZCN4FE2KLXNZKJTI4J4BKB4,upperdir=/var/lib/containers/storage/overlay/a24edfeb788a7dfd074274dfbdc8928d566b38ee6a9b700e731cb7f0a7697f3e/diff,workdir=/var/lib/containers/storage/overlay/a24edfeb788a7dfd074274dfbdc8928d566b38ee6a9b700e731cb7f0a7697f3e/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-10-18T14:14:40.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:14:40.572 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-10-18T14:14:40.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T14:14:40.629 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2023-10-18T14:14:40.698 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2023-10-18T14:14:40.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T14:14:40.700 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-18T14:14:40.711 INFO:tasks.cephadm:Teardown begin 2023-10-18T14:14:40.712 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-18T14:14:40.712 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:14:40.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.858+0000 7f1b45bae700 1 -- 172.21.15.114:0/2891135865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b40105710 msgr2=0x7f1b40105af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:40.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.858+0000 7f1b45bae700 1 --2- 172.21.15.114:0/2891135865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b40105710 0x7f1b40105af0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009990 tx=0x7f1b34009ca0 comp rx=0 tx=0).stop 2023-10-18T14:14:40.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.858+0000 7f1b45bae700 1 -- 172.21.15.114:0/2891135865 shutdown_connections 2023-10-18T14:14:40.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.858+0000 7f1b45bae700 1 --2- 172.21.15.114:0/2891135865 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b40100290 0x7f1b4010c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:40.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.858+0000 7f1b45bae700 1 --2- 172.21.15.114:0/2891135865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b40105710 0x7f1b40105af0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:40.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.858+0000 7f1b45bae700 1 --2- 172.21.15.114:0/2891135865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b400ff8d0 0x7f1b400ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:40.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.858+0000 7f1b45bae700 1 -- 172.21.15.114:0/2891135865 >> 172.21.15.114:0/2891135865 conn(0x7f1b40076400 msgr2=0x7f1b40076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:40.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.858+0000 7f1b45bae700 1 -- 172.21.15.114:0/2891135865 shutdown_connections 2023-10-18T14:14:40.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.858+0000 7f1b45bae700 1 -- 172.21.15.114:0/2891135865 wait complete. 2023-10-18T14:14:40.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b45bae700 1 Processor -- start 2023-10-18T14:14:40.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b45bae700 1 -- start start 2023-10-18T14:14:40.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b45bae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b400ff8d0 0x7f1b4019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:40.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b45bae700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b40100290 0x7f1b4019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:40.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b45bae700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b40105710 0x7f1b401947d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:40.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b45bae700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40194e40 con 0x7f1b400ff8d0 2023-10-18T14:14:40.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b45bae700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40194fb0 con 0x7f1b40105710 2023-10-18T14:14:40.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b45bae700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40195170 con 0x7f1b40100290 2023-10-18T14:14:40.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b3f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b400ff8d0 0x7f1b4019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:40.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b3f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b400ff8d0 0x7f1b4019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46944/0 (socket says 172.21.15.114:46944) 2023-10-18T14:14:40.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b3f7fe700 1 -- 172.21.15.114:0/487237984 learned_addr learned my addr 172.21.15.114:0/487237984 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:40.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b3effd700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b40100290 0x7f1b4019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:40.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b3ffff700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b40105710 0x7f1b401947d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:40.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.859+0000 7f1b3f7fe700 1 -- 172.21.15.114:0/487237984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b40100290 msgr2=0x7f1b4019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:40.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.860+0000 7f1b3f7fe700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b40100290 0x7f1b4019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:40.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.860+0000 7f1b3f7fe700 1 -- 172.21.15.114:0/487237984 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b40105710 msgr2=0x7f1b401947d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:40.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.860+0000 7f1b3f7fe700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b40105710 0x7f1b401947d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:40.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.860+0000 7f1b3f7fe700 1 -- 172.21.15.114:0/487237984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b340095f0 con 0x7f1b400ff8d0 2023-10-18T14:14:40.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.860+0000 7f1b3f7fe700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b400ff8d0 0x7f1b4019a6a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1b340095c0 tx=0x7f1b3400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:40.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.860+0000 7f1b3cff9700 1 -- 172.21.15.114:0/487237984 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3401d070 con 0x7f1b400ff8d0 2023-10-18T14:14:40.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.860+0000 7f1b45bae700 1 -- 172.21.15.114:0/487237984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b401953f0 con 0x7f1b400ff8d0 2023-10-18T14:14:40.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.860+0000 7f1b3cff9700 1 -- 172.21.15.114:0/487237984 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b34005050 con 0x7f1b400ff8d0 2023-10-18T14:14:40.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.860+0000 7f1b3cff9700 1 -- 172.21.15.114:0/487237984 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34004a70 con 0x7f1b400ff8d0 2023-10-18T14:14:40.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.860+0000 7f1b45bae700 1 -- 172.21.15.114:0/487237984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b401a1690 con 0x7f1b400ff8d0 2023-10-18T14:14:40.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.861+0000 7f1b45bae700 1 -- 172.21.15.114:0/487237984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b40107ae0 con 0x7f1b400ff8d0 2023-10-18T14:14:40.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.862+0000 7f1b3cff9700 1 -- 172.21.15.114:0/487237984 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f1b340051c0 con 0x7f1b400ff8d0 2023-10-18T14:14:40.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.862+0000 7f1b3cff9700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1b280a3800 0x7f1b280a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:40.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.862+0000 7f1b3effd700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1b280a3800 0x7f1b280a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:40.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.862+0000 7f1b3cff9700 1 -- 172.21.15.114:0/487237984 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f1b340cde70 con 0x7f1b400ff8d0 2023-10-18T14:14:40.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.863+0000 7f1b3effd700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1b280a3800 0x7f1b280a5cc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1b40195bf0 tx=0x7f1b300073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:40.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:40.866+0000 7f1b3cff9700 1 -- 172.21.15.114:0/487237984 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1b34097270 con 0x7f1b400ff8d0 2023-10-18T14:14:41.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:40 smithi114 ceph-mon[99494]: pgmap v608: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:14:41.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:40 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3540285327' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-18T14:14:41.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.102+0000 7f1b45bae700 1 -- 172.21.15.114:0/487237984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b40067560 con 0x7f1b400ff8d0 2023-10-18T14:14:41.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.103+0000 7f1b3cff9700 1 -- 172.21.15.114:0/487237984 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+11394 (secure 0 0 0) 0x7f1b3409a890 con 0x7f1b400ff8d0 2023-10-18T14:14:41.107 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:14:41.108 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":58,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:11:53.953766+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":52,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_16344":{"gid":16344,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1399361838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1399361838},{"type":"v1","addr":"172.21.15.172:6833","nonce":1399361838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":51,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":54,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":54,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:14:41.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.105+0000 7f1b45bae700 1 -- 172.21.15.114:0/487237984 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1b280a3800 msgr2=0x7f1b280a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.105+0000 7f1b45bae700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1b280a3800 0x7f1b280a5cc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1b40195bf0 tx=0x7f1b300073d0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.105+0000 7f1b45bae700 1 -- 172.21.15.114:0/487237984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b400ff8d0 msgr2=0x7f1b4019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.105+0000 7f1b45bae700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b400ff8d0 0x7f1b4019a6a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1b340095c0 tx=0x7f1b3400f690 comp rx=0 tx=0).stop 2023-10-18T14:14:41.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.105+0000 7f1b45bae700 1 -- 172.21.15.114:0/487237984 shutdown_connections 2023-10-18T14:14:41.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.105+0000 7f1b45bae700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f1b280a3800 0x7f1b280a5cc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.105+0000 7f1b45bae700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1b40105710 0x7f1b401947d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.105+0000 7f1b45bae700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b400ff8d0 0x7f1b4019a6a0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.105+0000 7f1b45bae700 1 --2- 172.21.15.114:0/487237984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b40100290 0x7f1b4019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.105+0000 7f1b45bae700 1 -- 172.21.15.114:0/487237984 >> 172.21.15.114:0/487237984 conn(0x7f1b40076400 msgr2=0x7f1b400fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:41.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.105+0000 7f1b45bae700 1 -- 172.21.15.114:0/487237984 shutdown_connections 2023-10-18T14:14:41.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.105+0000 7f1b45bae700 1 -- 172.21.15.114:0/487237984 wait complete. 2023-10-18T14:14:41.112 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 58 2023-10-18T14:14:41.121 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T14:14:41.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.239+0000 7f025bfbe700 1 -- 172.21.15.114:0/1363260719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0254105710 msgr2=0x7f0254105af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.239+0000 7f025bfbe700 1 --2- 172.21.15.114:0/1363260719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0254105710 0x7f0254105af0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0244009990 tx=0x7f0244009ca0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.239+0000 7f025bfbe700 1 -- 172.21.15.114:0/1363260719 shutdown_connections 2023-10-18T14:14:41.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.239+0000 7f025bfbe700 1 --2- 172.21.15.114:0/1363260719 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0254100290 0x7f025410c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.239+0000 7f025bfbe700 1 --2- 172.21.15.114:0/1363260719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0254105710 0x7f0254105af0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.239+0000 7f025bfbe700 1 --2- 172.21.15.114:0/1363260719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02540ff8d0 0x7f02540ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.239+0000 7f025bfbe700 1 -- 172.21.15.114:0/1363260719 >> 172.21.15.114:0/1363260719 conn(0x7f0254076400 msgr2=0x7f0254076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:41.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.239+0000 7f025bfbe700 1 -- 172.21.15.114:0/1363260719 shutdown_connections 2023-10-18T14:14:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.239+0000 7f025bfbe700 1 -- 172.21.15.114:0/1363260719 wait complete. 2023-10-18T14:14:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f025bfbe700 1 Processor -- start 2023-10-18T14:14:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f025bfbe700 1 -- start start 2023-10-18T14:14:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f025bfbe700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02540ff8d0 0x7f025419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:41.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f025bfbe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0254100290 0x7f025419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:41.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f025bfbe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0254105710 0x7f0254196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:41.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f025bfbe700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0254196df0 con 0x7f0254100290 2023-10-18T14:14:41.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f025bfbe700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0254196f60 con 0x7f02540ff8d0 2023-10-18T14:14:41.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f025bfbe700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0254197120 con 0x7f0254105710 2023-10-18T14:14:41.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f0259559700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0254100290 0x7f025419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:41.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f0259559700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0254100290 0x7f025419cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46960/0 (socket says 172.21.15.114:46960) 2023-10-18T14:14:41.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f0259559700 1 -- 172.21.15.114:0/2657195658 learned_addr learned my addr 172.21.15.114:0/2657195658 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:41.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f0259d5a700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02540ff8d0 0x7f025419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:41.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f025a55b700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0254105710 0x7f0254196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:41.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f0259559700 1 -- 172.21.15.114:0/2657195658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0254105710 msgr2=0x7f0254196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f0259559700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0254105710 0x7f0254196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f0259559700 1 -- 172.21.15.114:0/2657195658 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02540ff8d0 msgr2=0x7f025419c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f0259559700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02540ff8d0 0x7f025419c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f0259559700 1 -- 172.21.15.114:0/2657195658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02440095f0 con 0x7f0254100290 2023-10-18T14:14:41.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f025a55b700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0254105710 0x7f0254196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:14:41.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f0259559700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0254100290 0x7f025419cb90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f025000c9b0 tx=0x7f025000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:41.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.240+0000 7f024affd700 1 -- 172.21.15.114:0/2657195658 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250007b00 con 0x7f0254100290 2023-10-18T14:14:41.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.241+0000 7f025bfbe700 1 -- 172.21.15.114:0/2657195658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0254197400 con 0x7f0254100290 2023-10-18T14:14:41.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.241+0000 7f024affd700 1 -- 172.21.15.114:0/2657195658 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0250007c60 con 0x7f0254100290 2023-10-18T14:14:41.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.241+0000 7f024affd700 1 -- 172.21.15.114:0/2657195658 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250018660 con 0x7f0254100290 2023-10-18T14:14:41.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.241+0000 7f025bfbe700 1 -- 172.21.15.114:0/2657195658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02541a3640 con 0x7f0254100290 2023-10-18T14:14:41.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.241+0000 7f025bfbe700 1 -- 172.21.15.114:0/2657195658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0254100cc0 con 0x7f0254100290 2023-10-18T14:14:41.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.243+0000 7f024affd700 1 -- 172.21.15.114:0/2657195658 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f025000f450 con 0x7f0254100290 2023-10-18T14:14:41.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.243+0000 7f024affd700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f02400a15f0 0x7f02400a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:41.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.243+0000 7f024affd700 1 -- 172.21.15.114:0/2657195658 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f02500cd350 con 0x7f0254100290 2023-10-18T14:14:41.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.243+0000 7f0259d5a700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f02400a15f0 0x7f02400a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:41.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.244+0000 7f0259d5a700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f02400a15f0 0x7f02400a3ab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f02440098e0 tx=0x7f0244005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:41.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.247+0000 7f024affd700 1 -- 172.21.15.114:0/2657195658 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0250096750 con 0x7f0254100290 2023-10-18T14:14:41.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:40 smithi158 ceph-mon[103317]: pgmap v608: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:14:41.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:40 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3540285327' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-18T14:14:41.309 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:40 smithi172 ceph-mon[103574]: pgmap v608: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-18T14:14:41.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:40 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3540285327' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-18T14:14:41.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.482+0000 7f025bfbe700 1 -- 172.21.15.114:0/2657195658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0254197590 con 0x7f0254100290 2023-10-18T14:14:41.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.483+0000 7f024affd700 1 -- 172.21.15.114:0/2657195658 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+11394 (secure 0 0 0) 0x7f0254197590 con 0x7f0254100290 2023-10-18T14:14:41.487 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:14:41.488 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14754,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1353369409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1353369409},{"type":"v1","addr":"172.21.15.114:6835","nonce":1353369409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3590676300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3590676300},{"type":"v1","addr":"172.21.15.114:6837","nonce":3590676300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":58,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-18T14:02:32.251953+0000","modified":"2023-10-18T14:11:53.953766+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24616,"mds_1":24595,"mds_2":24583,"mds_3":24566,"mds_4":14820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.114:6839/2312997594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":2312997594},{"type":"v1","addr":"172.21.15.114:6839","nonce":2312997594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14820":{"gid":14820,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":52,"addr":"172.21.15.114:6841/2423071224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6840","nonce":2423071224},{"type":"v1","addr":"172.21.15.114:6841","nonce":2423071224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_16344":{"gid":16344,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1399361838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1399361838},{"type":"v1","addr":"172.21.15.172:6833","nonce":1399361838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6833/2306126907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2306126907},{"type":"v1","addr":"172.21.15.158:6833","nonce":2306126907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24524":{"gid":24524,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6835/2562572095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6834","nonce":2562572095},{"type":"v1","addr":"172.21.15.158:6835","nonce":2562572095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.158:6837/1076778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6836","nonce":1076778559},{"type":"v1","addr":"172.21.15.158:6837","nonce":1076778559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"b","rank":3,"incarnation":22,"state":"up:active","state_seq":51,"addr":"172.21.15.158:6839/2616400572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6838","nonce":2616400572},{"type":"v1","addr":"172.21.15.158:6839","nonce":2616400572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24583":{"gid":24583,"name":"f","rank":2,"incarnation":20,"state":"up:active","state_seq":54,"addr":"172.21.15.172:6835/2655563129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2655563129},{"type":"v1","addr":"172.21.15.172:6835","nonce":2655563129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":54,"addr":"172.21.15.172:6837/1821444438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1821444438},{"type":"v1","addr":"172.21.15.172:6837","nonce":1821444438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/2447269366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":2447269366},{"type":"v1","addr":"172.21.15.172:6839","nonce":2447269366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T14:14:41.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.485+0000 7f025bfbe700 1 -- 172.21.15.114:0/2657195658 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f02400a15f0 msgr2=0x7f02400a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.485+0000 7f025bfbe700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f02400a15f0 0x7f02400a3ab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f02440098e0 tx=0x7f0244005960 comp rx=0 tx=0).stop 2023-10-18T14:14:41.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.485+0000 7f025bfbe700 1 -- 172.21.15.114:0/2657195658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0254100290 msgr2=0x7f025419cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.485+0000 7f025bfbe700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0254100290 0x7f025419cb90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f025000c9b0 tx=0x7f025000ccc0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.485+0000 7f025bfbe700 1 -- 172.21.15.114:0/2657195658 shutdown_connections 2023-10-18T14:14:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.485+0000 7f025bfbe700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f02400a15f0 0x7f02400a3ab0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.485+0000 7f025bfbe700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0254105710 0x7f0254196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.485+0000 7f025bfbe700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f02540ff8d0 0x7f025419c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.485+0000 7f025bfbe700 1 --2- 172.21.15.114:0/2657195658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0254100290 0x7f025419cb90 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.485+0000 7f025bfbe700 1 -- 172.21.15.114:0/2657195658 >> 172.21.15.114:0/2657195658 conn(0x7f0254076400 msgr2=0x7f02540feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:41.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.485+0000 7f025bfbe700 1 -- 172.21.15.114:0/2657195658 shutdown_connections 2023-10-18T14:14:41.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.485+0000 7f025bfbe700 1 -- 172.21.15.114:0/2657195658 wait complete. 2023-10-18T14:14:41.492 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 58 2023-10-18T14:14:41.501 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T14:14:41.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 -- 172.21.15.114:0/2561378589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0280fec00 msgr2=0x7fb0280ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 --2- 172.21.15.114:0/2561378589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0280fec00 0x7fb0280ff060 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb024009990 tx=0x7fb024009ca0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 -- 172.21.15.114:0/2561378589 shutdown_connections 2023-10-18T14:14:41.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 --2- 172.21.15.114:0/2561378589 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0280ff5a0 0x7fb02810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 --2- 172.21.15.114:0/2561378589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb028106720 0x7fb028106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 --2- 172.21.15.114:0/2561378589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0280fec00 0x7fb0280ff060 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 -- 172.21.15.114:0/2561378589 >> 172.21.15.114:0/2561378589 conn(0x7fb028075b90 msgr2=0x7fb0280fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:41.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 -- 172.21.15.114:0/2561378589 shutdown_connections 2023-10-18T14:14:41.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 -- 172.21.15.114:0/2561378589 wait complete. 2023-10-18T14:14:41.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 Processor -- start 2023-10-18T14:14:41.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 -- start start 2023-10-18T14:14:41.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0280fec00 0x7fb02819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:41.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0280ff5a0 0x7fb02819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:41.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb028106720 0x7fb028196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:41.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0281970c0 con 0x7fb0280fec00 2023-10-18T14:14:41.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb028197230 con 0x7fb0280ff5a0 2023-10-18T14:14:41.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.619+0000 7fb030668700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0281973f0 con 0x7fb028106720 2023-10-18T14:14:41.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb02e404700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0280fec00 0x7fb02819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:41.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb02e404700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0280fec00 0x7fb02819c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46972/0 (socket says 172.21.15.114:46972) 2023-10-18T14:14:41.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb02e404700 1 -- 172.21.15.114:0/963686231 learned_addr learned my addr 172.21.15.114:0/963686231 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:41.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb02ec05700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb028106720 0x7fb028196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:41.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb02dc03700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0280ff5a0 0x7fb02819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb02e404700 1 -- 172.21.15.114:0/963686231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb028106720 msgr2=0x7fb028196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb02e404700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb028106720 0x7fb028196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb02e404700 1 -- 172.21.15.114:0/963686231 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0280ff5a0 msgr2=0x7fb02819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb02e404700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0280ff5a0 0x7fb02819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb02e404700 1 -- 172.21.15.114:0/963686231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240095f0 con 0x7fb0280fec00 2023-10-18T14:14:41.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb02e404700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0280fec00 0x7fb02819c930 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb01800e9a0 tx=0x7fb01800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:41.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb01f7fe700 1 -- 172.21.15.114:0/963686231 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018009790 con 0x7fb0280fec00 2023-10-18T14:14:41.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb01f7fe700 1 -- 172.21.15.114:0/963686231 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb01800cbd0 con 0x7fb0280fec00 2023-10-18T14:14:41.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb030668700 1 -- 172.21.15.114:0/963686231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0281976d0 con 0x7fb0280fec00 2023-10-18T14:14:41.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb01f7fe700 1 -- 172.21.15.114:0/963686231 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018018680 con 0x7fb0280fec00 2023-10-18T14:14:41.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.620+0000 7fb030668700 1 -- 172.21.15.114:0/963686231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0281a3920 con 0x7fb0280fec00 2023-10-18T14:14:41.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.621+0000 7fb030668700 1 -- 172.21.15.114:0/963686231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb028108ca0 con 0x7fb0280fec00 2023-10-18T14:14:41.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.622+0000 7fb01f7fe700 1 -- 172.21.15.114:0/963686231 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fb01800cd40 con 0x7fb0280fec00 2023-10-18T14:14:41.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.623+0000 7fb01f7fe700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb0140a15f0 0x7fb0140a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:41.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.623+0000 7fb02dc03700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb0140a15f0 0x7fb0140a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:41.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.623+0000 7fb01f7fe700 1 -- 172.21.15.114:0/963686231 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7fb018014070 con 0x7fb0280fec00 2023-10-18T14:14:41.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.623+0000 7fb02dc03700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb0140a15f0 0x7fb0140a3ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb024006010 tx=0x7fb02400b260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:41.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.627+0000 7fb01f7fe700 1 -- 172.21.15.114:0/963686231 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb018052100 con 0x7fb0280fec00 2023-10-18T14:14:41.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.819+0000 7fb030668700 1 -- 172.21.15.114:0/963686231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb028197f20 con 0x7fb0280fec00 2023-10-18T14:14:41.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.821+0000 7fb01f7fe700 1 -- 172.21.15.114:0/963686231 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+22997 (secure 0 0 0) 0x7fb018096640 con 0x7fb0280fec00 2023-10-18T14:14:41.825 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T14:14:41.825 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":94,"fsid":"d734b050-6dbd-11ee-8db6-212e2dc638e7","created":"2023-10-18T13:55:08.086693+0000","modified":"2023-10-18T14:14:18.432490+0000","last_up_change":"2023-10-18T14:01:51.485745+0000","last_in_change":"2023-10-18T14:01:34.073514+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T13:58:43.813590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T14:02:30.693853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T14:02:31.426625+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15fe1db1-6a41-4299-9df5-a64a8851d78c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6803","nonce":3519372344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6805","nonce":3519372344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6809","nonce":3519372344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3519372344},{"type":"v1","addr":"172.21.15.114:6807","nonce":3519372344}]},"public_addr":"172.21.15.114:6803/3519372344","cluster_addr":"172.21.15.114:6805/3519372344","heartbeat_back_addr":"172.21.15.114:6809/3519372344","heartbeat_front_addr":"172.21.15.114:6807/3519372344","state":["exists","up"]},{"osd":1,"uuid":"b2dd2c8b-611b-4dcb-8dd6-0237339f6ae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6801","nonce":1402372165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6803","nonce":1402372165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6807","nonce":1402372165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":1402372165},{"type":"v1","addr":"172.21.15.158:6805","nonce":1402372165}]},"public_addr":"172.21.15.158:6801/1402372165","cluster_addr":"172.21.15.158:6803/1402372165","heartbeat_back_addr":"172.21.15.158:6807/1402372165","heartbeat_front_addr":"172.21.15.158:6805/1402372165","state":["exists","up"]},{"osd":2,"uuid":"80de4181-f876-479e-a082-21a042f58b09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6801","nonce":4209325113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6803","nonce":4209325113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6807","nonce":4209325113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":4209325113},{"type":"v1","addr":"172.21.15.172:6805","nonce":4209325113}]},"public_addr":"172.21.15.172:6801/4209325113","cluster_addr":"172.21.15.172:6803/4209325113","heartbeat_back_addr":"172.21.15.172:6807/4209325113","heartbeat_front_addr":"172.21.15.172:6805/4209325113","state":["exists","up"]},{"osd":3,"uuid":"3dd2a81b-67be-449d-89e7-cbd3dd2f010b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6811","nonce":4089132386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6813","nonce":4089132386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6817","nonce":4089132386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4089132386},{"type":"v1","addr":"172.21.15.114:6815","nonce":4089132386}]},"public_addr":"172.21.15.114:6811/4089132386","cluster_addr":"172.21.15.114:6813/4089132386","heartbeat_back_addr":"172.21.15.114:6817/4089132386","heartbeat_front_addr":"172.21.15.114:6815/4089132386","state":["exists","up"]},{"osd":4,"uuid":"88faf89f-ba5c-4658-8744-a2dff1084f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6809","nonce":1567841851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6811","nonce":1567841851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6815","nonce":1567841851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":1567841851},{"type":"v1","addr":"172.21.15.158:6813","nonce":1567841851}]},"public_addr":"172.21.15.158:6809/1567841851","cluster_addr":"172.21.15.158:6811/1567841851","heartbeat_back_addr":"172.21.15.158:6815/1567841851","heartbeat_front_addr":"172.21.15.158:6813/1567841851","state":["exists","up"]},{"osd":5,"uuid":"bc3a8ec1-7475-444d-ad2c-98f52164c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6809","nonce":2859282562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6811","nonce":2859282562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6815","nonce":2859282562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2859282562},{"type":"v1","addr":"172.21.15.172:6813","nonce":2859282562}]},"public_addr":"172.21.15.172:6809/2859282562","cluster_addr":"172.21.15.172:6811/2859282562","heartbeat_back_addr":"172.21.15.172:6815/2859282562","heartbeat_front_addr":"172.21.15.172:6813/2859282562","state":["exists","up"]},{"osd":6,"uuid":"01b49bae-b64b-40ff-8931-4052c324a4ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6819","nonce":3292046982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6821","nonce":3292046982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6825","nonce":3292046982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3292046982},{"type":"v1","addr":"172.21.15.114:6823","nonce":3292046982}]},"public_addr":"172.21.15.114:6819/3292046982","cluster_addr":"172.21.15.114:6821/3292046982","heartbeat_back_addr":"172.21.15.114:6825/3292046982","heartbeat_front_addr":"172.21.15.114:6823/3292046982","state":["exists","up"]},{"osd":7,"uuid":"30538b90-fa16-45be-a0a6-1afeb7551926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6817","nonce":1215333303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6819","nonce":1215333303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6823","nonce":1215333303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":1215333303},{"type":"v1","addr":"172.21.15.158:6821","nonce":1215333303}]},"public_addr":"172.21.15.158:6817/1215333303","cluster_addr":"172.21.15.158:6819/1215333303","heartbeat_back_addr":"172.21.15.158:6823/1215333303","heartbeat_front_addr":"172.21.15.158:6821/1215333303","state":["exists","up"]},{"osd":8,"uuid":"c96c813e-f792-48c5-abf5-c11fc3a69a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6817","nonce":881849640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6819","nonce":881849640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6823","nonce":881849640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":881849640},{"type":"v1","addr":"172.21.15.172:6821","nonce":881849640}]},"public_addr":"172.21.15.172:6817/881849640","cluster_addr":"172.21.15.172:6819/881849640","heartbeat_back_addr":"172.21.15.172:6823/881849640","heartbeat_front_addr":"172.21.15.172:6821/881849640","state":["exists","up"]},{"osd":9,"uuid":"08e69155-0486-455e-8286-a8cff49f0f73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6827","nonce":1353419633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6829","nonce":1353419633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6833","nonce":1353419633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1353419633},{"type":"v1","addr":"172.21.15.114:6831","nonce":1353419633}]},"public_addr":"172.21.15.114:6827/1353419633","cluster_addr":"172.21.15.114:6829/1353419633","heartbeat_back_addr":"172.21.15.114:6833/1353419633","heartbeat_front_addr":"172.21.15.114:6831/1353419633","state":["exists","up"]},{"osd":10,"uuid":"f0f75dcc-ae8d-401c-b2e9-bcde3eeee081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6825","nonce":1713443341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6827","nonce":1713443341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6831","nonce":1713443341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":1713443341},{"type":"v1","addr":"172.21.15.158:6829","nonce":1713443341}]},"public_addr":"172.21.15.158:6825/1713443341","cluster_addr":"172.21.15.158:6827/1713443341","heartbeat_back_addr":"172.21.15.158:6831/1713443341","heartbeat_front_addr":"172.21.15.158:6829/1713443341","state":["exists","up"]},{"osd":11,"uuid":"a0f37e36-5cfd-4bbc-98f9-c0c5c9c44eee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6825","nonce":3903571171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6827","nonce":3903571171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6831","nonce":3903571171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3903571171},{"type":"v1","addr":"172.21.15.172:6829","nonce":3903571171}]},"public_addr":"172.21.15.172:6825/3903571171","cluster_addr":"172.21.15.172:6827/3903571171","heartbeat_back_addr":"172.21.15.172:6831/3903571171","heartbeat_front_addr":"172.21.15.172:6829/3903571171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:57:59.658289+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:20.539521+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:58:41.325005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:02.732039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:23.603973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T13:59:44.357311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:05.420529+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:26.125344+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:00:47.003716+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:07.987203+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:28.962921+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T14:01:49.896411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6801/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/469095187":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/3879995605":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/599274026":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/4083591617":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/2423419725":"2023-10-19T13:57:07.487148+0000","172.21.15.114:6801/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6800/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1340157243":"2023-10-19T13:57:07.487148+0000","172.21.15.114:0/1203420443":"2023-10-19T13:55:42.522304+0000","172.21.15.114:6800/3236987300":"2023-10-19T13:56:04.611113+0000","172.21.15.114:0/736541474":"2023-10-19T13:56:04.611113+0000","172.21.15.114:6801/1307090291":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/1121190039":"2023-10-19T13:55:42.522304+0000","172.21.15.114:0/473909953":"2023-10-19T13:55:42.522304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T14:14:41.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.823+0000 7fb030668700 1 -- 172.21.15.114:0/963686231 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb0140a15f0 msgr2=0x7fb0140a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.823+0000 7fb030668700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb0140a15f0 0x7fb0140a3ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb024006010 tx=0x7fb02400b260 comp rx=0 tx=0).stop 2023-10-18T14:14:41.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.823+0000 7fb030668700 1 -- 172.21.15.114:0/963686231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0280fec00 msgr2=0x7fb02819c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.823+0000 7fb030668700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0280fec00 0x7fb02819c930 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb01800e9a0 tx=0x7fb01800ecb0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.823+0000 7fb030668700 1 -- 172.21.15.114:0/963686231 shutdown_connections 2023-10-18T14:14:41.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.823+0000 7fb030668700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7fb0140a15f0 0x7fb0140a3ab0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.823+0000 7fb030668700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb028106720 0x7fb028196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.823+0000 7fb030668700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0280fec00 0x7fb02819c930 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.823+0000 7fb030668700 1 --2- 172.21.15.114:0/963686231 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0280ff5a0 0x7fb02819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.823+0000 7fb030668700 1 -- 172.21.15.114:0/963686231 >> 172.21.15.114:0/963686231 conn(0x7fb028075b90 msgr2=0x7fb028103710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:41.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.823+0000 7fb030668700 1 -- 172.21.15.114:0/963686231 shutdown_connections 2023-10-18T14:14:41.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.823+0000 7fb030668700 1 -- 172.21.15.114:0/963686231 wait complete. 2023-10-18T14:14:41.840 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-18T14:14:41.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.958+0000 7f01220f3700 1 -- 172.21.15.114:0/2871647538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c1006c0 msgr2=0x7f011c10c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.958+0000 7f01220f3700 1 --2- 172.21.15.114:0/2871647538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c1006c0 0x7f011c10c440 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f011400b0a0 tx=0x7f011400b3b0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.958+0000 7f01220f3700 1 -- 172.21.15.114:0/2871647538 shutdown_connections 2023-10-18T14:14:41.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.958+0000 7f01220f3700 1 --2- 172.21.15.114:0/2871647538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c1006c0 0x7f011c10c440 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.958+0000 7f01220f3700 1 --2- 172.21.15.114:0/2871647538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f011c105680 0x7f011c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.958+0000 7f01220f3700 1 --2- 172.21.15.114:0/2871647538 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f011c0ffd00 0x7f011c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.958+0000 7f01220f3700 1 -- 172.21.15.114:0/2871647538 >> 172.21.15.114:0/2871647538 conn(0x7f011c075bb0 msgr2=0x7f011c0fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:41.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.958+0000 7f01220f3700 1 -- 172.21.15.114:0/2871647538 shutdown_connections 2023-10-18T14:14:41.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.958+0000 7f01220f3700 1 -- 172.21.15.114:0/2871647538 wait complete. 2023-10-18T14:14:41.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.959+0000 7f01220f3700 1 Processor -- start 2023-10-18T14:14:41.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.959+0000 7f01220f3700 1 -- start start 2023-10-18T14:14:41.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.959+0000 7f01220f3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c0ffd00 0x7f011c197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:41.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.959+0000 7f01220f3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f011c1006c0 0x7f011c198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:41.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.959+0000 7f01220f3700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f011c105680 0x7f011c1a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:41.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.959+0000 7f01220f3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c198890 con 0x7f011c0ffd00 2023-10-18T14:14:41.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.959+0000 7f01220f3700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c1a30a0 con 0x7f011c105680 2023-10-18T14:14:41.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.959+0000 7f01220f3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c1a31e0 con 0x7f011c1006c0 2023-10-18T14:14:41.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f011b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c0ffd00 0x7f011c197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:41.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f011b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c0ffd00 0x7f011c197ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46984/0 (socket says 172.21.15.114:46984) 2023-10-18T14:14:41.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f011b7fe700 1 -- 172.21.15.114:0/3441534557 learned_addr learned my addr 172.21.15.114:0/3441534557 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:41.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f011bfff700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f011c105680 0x7f011c1a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:41.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f011affd700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f011c1006c0 0x7f011c198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:41.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f011b7fe700 1 -- 172.21.15.114:0/3441534557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f011c1006c0 msgr2=0x7f011c198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f011b7fe700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f011c1006c0 0x7f011c198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f011b7fe700 1 -- 172.21.15.114:0/3441534557 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f011c105680 msgr2=0x7f011c1a2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:41.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f011b7fe700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f011c105680 0x7f011c1a2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:41.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f011b7fe700 1 -- 172.21.15.114:0/3441534557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0114009d00 con 0x7f011c0ffd00 2023-10-18T14:14:41.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f011b7fe700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c0ffd00 0x7f011c197ae0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c920 tx=0x7f010c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f0118ff9700 1 -- 172.21.15.114:0/3441534557 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c004a30 con 0x7f011c0ffd00 2023-10-18T14:14:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f01220f3700 1 -- 172.21.15.114:0/3441534557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011c1a3470 con 0x7f011c0ffd00 2023-10-18T14:14:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f0118ff9700 1 -- 172.21.15.114:0/3441534557 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f010c0054e0 con 0x7f011c0ffd00 2023-10-18T14:14:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f0118ff9700 1 -- 172.21.15.114:0/3441534557 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c007c10 con 0x7f011c0ffd00 2023-10-18T14:14:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.960+0000 7f01220f3700 1 -- 172.21.15.114:0/3441534557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011c1a39d0 con 0x7f011c0ffd00 2023-10-18T14:14:41.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.961+0000 7f01220f3700 1 -- 172.21.15.114:0/3441534557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011c107b20 con 0x7f011c0ffd00 2023-10-18T14:14:41.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.962+0000 7f0118ff9700 1 -- 172.21.15.114:0/3441534557 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f010c005000 con 0x7f011c0ffd00 2023-10-18T14:14:41.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.963+0000 7f0118ff9700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f01040a15f0 0x7f01040a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:41.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.963+0000 7f011affd700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f01040a15f0 0x7f01040a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:41.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.963+0000 7f0118ff9700 1 -- 172.21.15.114:0/3441534557 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8441+0+0 (secure 0 0 0) 0x7f010c0ccf30 con 0x7f011c0ffd00 2023-10-18T14:14:41.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.963+0000 7f011affd700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f01040a15f0 0x7f01040a3ab0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f011c0ff400 tx=0x7f011000a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:41.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:41.966+0000 7f0118ff9700 1 -- 172.21.15.114:0/3441534557 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f010c0962a0 con 0x7f011c0ffd00 2023-10-18T14:14:42.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:41 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/487237984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:14:42.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:41 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/2657195658' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:14:42.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:41 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/963686231' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:14:42.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.203+0000 7f01220f3700 1 -- 172.21.15.114:0/3441534557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f011c0ff1b0 con 0x7f011c0ffd00 2023-10-18T14:14:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.205+0000 7f0118ff9700 1 -- 172.21.15.114:0/3441534557 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7f010c01d090 con 0x7f011c0ffd00 2023-10-18T14:14:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.208+0000 7f01220f3700 1 -- 172.21.15.114:0/3441534557 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f01040a15f0 msgr2=0x7f01040a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.208+0000 7f01220f3700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f01040a15f0 0x7f01040a3ab0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f011c0ff400 tx=0x7f011000a300 comp rx=0 tx=0).stop 2023-10-18T14:14:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.208+0000 7f01220f3700 1 -- 172.21.15.114:0/3441534557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c0ffd00 msgr2=0x7f011c197ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.208+0000 7f01220f3700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c0ffd00 0x7f011c197ae0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c920 tx=0x7f010c00cc30 comp rx=0 tx=0).stop 2023-10-18T14:14:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.212+0000 7f01220f3700 1 -- 172.21.15.114:0/3441534557 shutdown_connections 2023-10-18T14:14:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.213+0000 7f01220f3700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f01040a15f0 0x7f01040a3ab0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.213+0000 7f01220f3700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f011c105680 0x7f011c1a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.213+0000 7f01220f3700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c0ffd00 0x7f011c197ae0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.213+0000 7f01220f3700 1 --2- 172.21.15.114:0/3441534557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f011c1006c0 0x7f011c198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:42.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.213+0000 7f01220f3700 1 -- 172.21.15.114:0/3441534557 >> 172.21.15.114:0/3441534557 conn(0x7f011c075bb0 msgr2=0x7f011c0fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:42.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.213+0000 7f01220f3700 1 -- 172.21.15.114:0/3441534557 shutdown_connections 2023-10-18T14:14:42.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.213+0000 7f01220f3700 1 -- 172.21.15.114:0/3441534557 wait complete. 2023-10-18T14:14:42.218 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-18T14:14:42.230 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-18T14:14:42.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:41 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/487237984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:14:42.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:41 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/2657195658' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:14:42.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:41 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/963686231' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:14:42.257 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: ignoring --setuser ceph since I am not root 2023-10-18T14:14:42.257 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: ignoring --setgroup ceph since I am not root 2023-10-18T14:14:42.262 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:41 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/487237984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:14:42.262 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:41 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/2657195658' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-18T14:14:42.263 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:41 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/963686231' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-18T14:14:42.263 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-k[140139]: ignoring --setuser ceph since I am not root 2023-10-18T14:14:42.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.354+0000 7f6e659ea700 1 -- 172.21.15.114:0/1448457469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e600ff640 msgr2=0x7f6e600ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:42.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.354+0000 7f6e659ea700 1 --2- 172.21.15.114:0/1448457469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e600ff640 0x7f6e600ffac0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009990 tx=0x7f6e50009ca0 comp rx=0 tx=0).stop 2023-10-18T14:14:42.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.354+0000 7f6e659ea700 1 -- 172.21.15.114:0/1448457469 shutdown_connections 2023-10-18T14:14:42.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.354+0000 7f6e659ea700 1 --2- 172.21.15.114:0/1448457469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e60100000 0x7f6e6010c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:42.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.354+0000 7f6e659ea700 1 --2- 172.21.15.114:0/1448457469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e60105650 0x7f6e60105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:42.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.354+0000 7f6e659ea700 1 --2- 172.21.15.114:0/1448457469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e600ff640 0x7f6e600ffac0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:42.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.354+0000 7f6e659ea700 1 -- 172.21.15.114:0/1448457469 >> 172.21.15.114:0/1448457469 conn(0x7f6e60076790 msgr2=0x7f6e60076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:42.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.354+0000 7f6e659ea700 1 -- 172.21.15.114:0/1448457469 shutdown_connections 2023-10-18T14:14:42.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.354+0000 7f6e659ea700 1 -- 172.21.15.114:0/1448457469 wait complete. 2023-10-18T14:14:42.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.354+0000 7f6e659ea700 1 Processor -- start 2023-10-18T14:14:42.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e659ea700 1 -- start start 2023-10-18T14:14:42.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e659ea700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e600ff640 0x7f6e6019b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:42.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e659ea700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e60100000 0x7f6e6019bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:42.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e659ea700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e60105650 0x7f6e60195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:42.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e659ea700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e60195ec0 con 0x7f6e60100000 2023-10-18T14:14:42.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e659ea700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e60196030 con 0x7f6e600ff640 2023-10-18T14:14:42.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e659ea700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e601961f0 con 0x7f6e60105650 2023-10-18T14:14:42.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e5e7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e60100000 0x7f6e6019bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:42.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e5e7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e60100000 0x7f6e6019bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47024/0 (socket says 172.21.15.114:47024) 2023-10-18T14:14:42.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e5e7fc700 1 -- 172.21.15.114:0/4280996062 learned_addr learned my addr 172.21.15.114:0/4280996062 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:42.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e5effd700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e600ff640 0x7f6e6019b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:42.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e5f7fe700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e60105650 0x7f6e60195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:42.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e5e7fc700 1 -- 172.21.15.114:0/4280996062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e60105650 msgr2=0x7f6e60195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:42.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e5e7fc700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e60105650 0x7f6e60195860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:42.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e5e7fc700 1 -- 172.21.15.114:0/4280996062 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e600ff640 msgr2=0x7f6e6019b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:42.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e5e7fc700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e600ff640 0x7f6e6019b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:42.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e5e7fc700 1 -- 172.21.15.114:0/4280996062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500095f0 con 0x7f6e60100000 2023-10-18T14:14:42.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e5f7fe700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e60105650 0x7f6e60195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T14:14:42.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.355+0000 7f6e5e7fc700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e60100000 0x7f6e6019bc10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6e50005770 tx=0x7f6e500057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:42.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.356+0000 7f6e649e8700 1 -- 172.21.15.114:0/4280996062 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5001d070 con 0x7f6e60100000 2023-10-18T14:14:42.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.356+0000 7f6e649e8700 1 -- 172.21.15.114:0/4280996062 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e50021410 con 0x7f6e60100000 2023-10-18T14:14:42.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.356+0000 7f6e659ea700 1 -- 172.21.15.114:0/4280996062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e601964d0 con 0x7f6e60100000 2023-10-18T14:14:42.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.356+0000 7f6e649e8700 1 -- 172.21.15.114:0/4280996062 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50017650 con 0x7f6e60100000 2023-10-18T14:14:42.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.356+0000 7f6e659ea700 1 -- 172.21.15.114:0/4280996062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e601a2770 con 0x7f6e60100000 2023-10-18T14:14:42.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.357+0000 7f6e659ea700 1 -- 172.21.15.114:0/4280996062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e60107c60 con 0x7f6e60100000 2023-10-18T14:14:42.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.358+0000 7f6e649e8700 1 -- 172.21.15.114:0/4280996062 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f6e500217f0 con 0x7f6e60100000 2023-10-18T14:14:42.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.359+0000 7f6e649e8700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6e480a1670 0x7f6e480a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:42.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.359+0000 7f6e649e8700 1 -- 172.21.15.114:0/4280996062 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8827+0+0 (secure 0 0 0) 0x7f6e500cec70 con 0x7f6e60100000 2023-10-18T14:14:42.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.359+0000 7f6e5effd700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6e480a1670 0x7f6e480a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:42.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.359+0000 7f6e5effd700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6e480a1670 0x7f6e480a3b30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6e600ff510 tx=0x7f6e540073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:42.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.364+0000 7f6e649e8700 1 -- 172.21.15.114:0/4280996062 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6e50097ef0 con 0x7f6e60100000 2023-10-18T14:14:42.521 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-k[140139]: ignoring --setgroup ceph since I am not root 2023-10-18T14:14:42.522 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-mds[140163]: -- 172.21.15.158:0/1935740789 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f69308f1e0 con 0x55f693064c00 2023-10-18T14:14:42.523 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-k[140139]: starting mds.k at 2023-10-18T14:14:42.523 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: ignoring --setuser ceph since I am not root 2023-10-18T14:14:42.523 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: ignoring --setgroup ceph since I am not root 2023-10-18T14:14:42.524 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-mds[141205]: -- 172.21.15.158:0/2243094467 <== mon.0 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f588a4f1e0 con 0x55f588a24c00 2023-10-18T14:14:42.524 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: starting mds.b at 2023-10-18T14:14:42.524 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-e[140484]: ignoring --setuser ceph since I am not root 2023-10-18T14:14:42.524 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-e[140484]: ignoring --setgroup ceph since I am not root 2023-10-18T14:14:42.525 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-mds[140508]: -- 172.21.15.158:0/1250001600 <== mon.0 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cf6d60f1e0 con 0x55cf6d5e4800 2023-10-18T14:14:42.525 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-e[140484]: starting mds.e at 2023-10-18T14:14:42.525 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-h[140826]: ignoring --setuser ceph since I am not root 2023-10-18T14:14:42.525 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-h[140826]: ignoring --setgroup ceph since I am not root 2023-10-18T14:14:42.526 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-mds[140851]: -- 172.21.15.158:0/593568641 <== mon.2 v2:172.21.15.158:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5606878471e0 con 0x56068781d000 2023-10-18T14:14:42.526 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-h[140826]: starting mds.h at 2023-10-18T14:14:42.560 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-mds[143104]: -- 172.21.15.172:0/1719720945 <== mon.0 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e03b1171e0 con 0x55e03b0ecc00 2023-10-18T14:14:42.560 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: starting mds.c at 2023-10-18T14:14:42.560 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-i[143420]: ignoring --setuser ceph since I am not root 2023-10-18T14:14:42.561 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-i[143420]: ignoring --setgroup ceph since I am not root 2023-10-18T14:14:42.561 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-mds[143444]: -- 172.21.15.172:0/3578873646 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560fc24c91e0 con 0x560fc249f000 2023-10-18T14:14:42.561 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-i[143420]: starting mds.i at 2023-10-18T14:14:42.561 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-l[142401]: ignoring --setuser ceph since I am not root 2023-10-18T14:14:42.562 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-l[142401]: ignoring --setgroup ceph since I am not root 2023-10-18T14:14:42.562 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-mds[142425]: -- 172.21.15.172:0/3399895105 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5604a37551e0 con 0x5604a372a800 2023-10-18T14:14:42.562 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-l[142401]: starting mds.l at 2023-10-18T14:14:42.562 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: ignoring --setuser ceph since I am not root 2023-10-18T14:14:42.563 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: ignoring --setgroup ceph since I am not root 2023-10-18T14:14:42.563 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-mds[142764]: -- 172.21.15.172:0/1431218084 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c3782f71e0 con 0x55c3782cc800 2023-10-18T14:14:42.563 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: starting mds.f at 2023-10-18T14:14:42.588 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a[99470]: 2023-10-18T14:14:42.203+0000 7fdd32fd2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T14:14:42.589 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: ignoring --setuser ceph since I am not root 2023-10-18T14:14:42.589 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: ignoring --setgroup ceph since I am not root 2023-10-18T14:14:42.589 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-mds[157893]: -- 172.21.15.114:0/1742622867 <== mon.0 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e4371c91e0 con 0x55e43719e800 2023-10-18T14:14:42.589 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: starting mds.a at 2023-10-18T14:14:42.590 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-g[157481]: ignoring --setuser ceph since I am not root 2023-10-18T14:14:42.590 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-g[157481]: ignoring --setgroup ceph since I am not root 2023-10-18T14:14:42.590 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-mds[157506]: -- 172.21.15.114:0/1244649706 <== mon.0 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562a9d2171e0 con 0x562a9d1ec800 2023-10-18T14:14:42.591 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-g[157481]: starting mds.g at 2023-10-18T14:14:42.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:42.599+0000 7f6e659ea700 1 -- 172.21.15.114:0/4280996062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6e60196d40 con 0x7f6e60100000 2023-10-18T14:14:43.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-mon[99494]: pgmap v609: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-18T14:14:43.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3441534557' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-18T14:14:43.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-mon[99494]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-18T14:14:43.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-mon[99494]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T14:14:43.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-mon[99494]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2023-10-18T14:14:43.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3441534557' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-18T14:14:43.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-mon[99494]: osdmap e95: 12 total, 12 up, 12 in 2023-10-18T14:14:43.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-mon[99494]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-18T14:14:43.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:42 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/4280996062' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-18T14:14:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.206+0000 7f6e649e8700 1 -- 172.21.15.114:0/4280996062 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6e5009b510 con 0x7f6e60100000 2023-10-18T14:14:43.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.209+0000 7f6e659ea700 1 -- 172.21.15.114:0/4280996062 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6e480a1670 msgr2=0x7f6e480a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:43.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.209+0000 7f6e659ea700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6e480a1670 0x7f6e480a3b30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6e600ff510 tx=0x7f6e540073d0 comp rx=0 tx=0).stop 2023-10-18T14:14:43.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.209+0000 7f6e659ea700 1 -- 172.21.15.114:0/4280996062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e60100000 msgr2=0x7f6e6019bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:43.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.209+0000 7f6e659ea700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e60100000 0x7f6e6019bc10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6e50005770 tx=0x7f6e500057a0 comp rx=0 tx=0).stop 2023-10-18T14:14:43.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.209+0000 7f6e659ea700 1 -- 172.21.15.114:0/4280996062 shutdown_connections 2023-10-18T14:14:43.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.209+0000 7f6e659ea700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f6e480a1670 0x7f6e480a3b30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:43.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.209+0000 7f6e659ea700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e60105650 0x7f6e60195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:43.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.209+0000 7f6e659ea700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6e600ff640 0x7f6e6019b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:43.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.209+0000 7f6e659ea700 1 --2- 172.21.15.114:0/4280996062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e60100000 0x7f6e6019bc10 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:43.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.209+0000 7f6e659ea700 1 -- 172.21.15.114:0/4280996062 >> 172.21.15.114:0/4280996062 conn(0x7f6e60076790 msgr2=0x7f6e600fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:43.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.209+0000 7f6e659ea700 1 -- 172.21.15.114:0/4280996062 shutdown_connections 2023-10-18T14:14:43.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.209+0000 7f6e659ea700 1 -- 172.21.15.114:0/4280996062 wait complete. 2023-10-18T14:14:43.230 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-18T14:14:43.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-mon[103317]: pgmap v609: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-18T14:14:43.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3441534557' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-18T14:14:43.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-mon[103317]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-18T14:14:43.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-mon[103317]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T14:14:43.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-mon[103317]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2023-10-18T14:14:43.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3441534557' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-18T14:14:43.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-mon[103317]: osdmap e95: 12 total, 12 up, 12 in 2023-10-18T14:14:43.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-mon[103317]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-18T14:14:43.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:42 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/4280996062' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-18T14:14:43.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-mon[103574]: pgmap v609: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-18T14:14:43.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3441534557' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-18T14:14:43.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-mon[103574]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-18T14:14:43.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-mon[103574]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T14:14:43.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-mon[103574]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2023-10-18T14:14:43.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3441534557' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-18T14:14:43.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-mon[103574]: osdmap e95: 12 total, 12 up, 12 in 2023-10-18T14:14:43.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-mon[103574]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-18T14:14:43.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:42 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/4280996062' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-18T14:14:43.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.353+0000 7f6992020700 1 -- 172.21.15.114:0/3088559902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c1056e0 msgr2=0x7f698c105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:43.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.353+0000 7f6992020700 1 --2- 172.21.15.114:0/3088559902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c1056e0 0x7f698c105ac0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6980009990 tx=0x7f6980009ca0 comp rx=0 tx=0).stop 2023-10-18T14:14:43.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.353+0000 7f6992020700 1 -- 172.21.15.114:0/3088559902 shutdown_connections 2023-10-18T14:14:43.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.353+0000 7f6992020700 1 --2- 172.21.15.114:0/3088559902 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f698c100000 0x7f698c10c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:43.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.353+0000 7f6992020700 1 --2- 172.21.15.114:0/3088559902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c1056e0 0x7f698c105ac0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:43.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.353+0000 7f6992020700 1 --2- 172.21.15.114:0/3088559902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c0ff640 0x7f698c0ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:43.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.353+0000 7f6992020700 1 -- 172.21.15.114:0/3088559902 >> 172.21.15.114:0/3088559902 conn(0x7f698c0767f0 msgr2=0x7f698c076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:43.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.353+0000 7f6992020700 1 -- 172.21.15.114:0/3088559902 shutdown_connections 2023-10-18T14:14:43.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.353+0000 7f6992020700 1 -- 172.21.15.114:0/3088559902 wait complete. 2023-10-18T14:14:43.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.353+0000 7f6992020700 1 Processor -- start 2023-10-18T14:14:43.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f6992020700 1 -- start start 2023-10-18T14:14:43.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f6992020700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f698c0ff640 0x7f698c197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f6992020700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c100000 0x7f698c197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f6992020700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c1056e0 0x7f698c1a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f6992020700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c198800 con 0x7f698c1056e0 2023-10-18T14:14:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f6992020700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c1a2fc0 con 0x7f698c0ff640 2023-10-18T14:14:43.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f6992020700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c1a3100 con 0x7f698c100000 2023-10-18T14:14:43.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f698bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c1056e0 0x7f698c1a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:43.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f698bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c1056e0 0x7f698c1a2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47044/0 (socket says 172.21.15.114:47044) 2023-10-18T14:14:43.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f698bfff700 1 -- 172.21.15.114:0/769141900 learned_addr learned my addr 172.21.15.114:0/769141900 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:43.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f698b7fe700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f698c0ff640 0x7f698c197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:43.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f698affd700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c100000 0x7f698c197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:43.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f698bfff700 1 -- 172.21.15.114:0/769141900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c100000 msgr2=0x7f698c197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:43.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f698bfff700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c100000 0x7f698c197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f698bfff700 1 -- 172.21.15.114:0/769141900 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f698c0ff640 msgr2=0x7f698c197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f698bfff700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f698c0ff640 0x7f698c197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f698bfff700 1 -- 172.21.15.114:0/769141900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69800095f0 con 0x7f698c1056e0 2023-10-18T14:14:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.354+0000 7f698bfff700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c1056e0 0x7f698c1a2a80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6984007f10 tx=0x7f698400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.355+0000 7f6988ff9700 1 -- 172.21.15.114:0/769141900 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984017070 con 0x7f698c1056e0 2023-10-18T14:14:43.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.355+0000 7f6992020700 1 -- 172.21.15.114:0/769141900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698c1a33e0 con 0x7f698c1056e0 2023-10-18T14:14:43.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.355+0000 7f6988ff9700 1 -- 172.21.15.114:0/769141900 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f698400f040 con 0x7f698c1056e0 2023-10-18T14:14:43.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.355+0000 7f6988ff9700 1 -- 172.21.15.114:0/769141900 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984005740 con 0x7f698c1056e0 2023-10-18T14:14:43.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.355+0000 7f6992020700 1 -- 172.21.15.114:0/769141900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c1a38a0 con 0x7f698c1056e0 2023-10-18T14:14:43.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.356+0000 7f6992020700 1 -- 172.21.15.114:0/769141900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698c107b80 con 0x7f698c1056e0 2023-10-18T14:14:43.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.357+0000 7f6988ff9700 1 -- 172.21.15.114:0/769141900 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f698400dc60 con 0x7f698c1056e0 2023-10-18T14:14:43.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.357+0000 7f6988ff9700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f69740a15f0 0x7f69740a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:43.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.357+0000 7f698b7fe700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f69740a15f0 0x7f69740a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:43.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.357+0000 7f6988ff9700 1 -- 172.21.15.114:0/769141900 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8827+0+0 (secure 0 0 0) 0x7f69840cca30 con 0x7f698c1056e0 2023-10-18T14:14:43.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.358+0000 7f698b7fe700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f69740a15f0 0x7f69740a3ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f698000b5c0 tx=0x7f698001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:43.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.361+0000 7f6988ff9700 1 -- 172.21.15.114:0/769141900 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6984095b80 con 0x7f698c1056e0 2023-10-18T14:14:43.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:43.554+0000 7f6992020700 1 -- 172.21.15.114:0/769141900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f698c100d30 con 0x7f698c1056e0 2023-10-18T14:14:44.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-18T14:14:44.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T14:14:44.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: Cluster is now healthy 2023-10-18T14:14:44.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/4280996062' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-18T14:14:44.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.114:6838/1167391173,v1:172.21.15.114:6840/1167391173] up:boot 2023-10-18T14:14:44.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.114:6839/2851674276,v1:172.21.15.114:6841/2851674276] up:boot 2023-10-18T14:14:44.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6836/1474866222,v1:172.21.15.172:6837/1474866222] up:boot 2023-10-18T14:14:44.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.158:6835/1442292517,v1:172.21.15.158:6839/1442292517] up:boot 2023-10-18T14:14:44.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6838/4085290999,v1:172.21.15.172:6839/4085290999] up:boot 2023-10-18T14:14:44.090 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6832/903260565,v1:172.21.15.172:6834/903260565] up:boot 2023-10-18T14:14:44.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.172:6833/3729261721,v1:172.21.15.172:6835/3729261721] up:boot 2023-10-18T14:14:44.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.158:6834/860386120,v1:172.21.15.158:6837/860386120] up:boot 2023-10-18T14:14:44.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.158:6833/4022144149,v1:172.21.15.158:6836/4022144149] up:boot 2023-10-18T14:14:44.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: mds.? [v2:172.21.15.158:6832/578050158,v1:172.21.15.158:6838/578050158] up:boot 2023-10-18T14:14:44.091 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: fsmap 12 up:standby 2023-10-18T14:14:44.092 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-18T14:14:44.092 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-18T14:14:44.092 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-18T14:14:44.092 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-18T14:14:44.092 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-18T14:14:44.093 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-18T14:14:44.093 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-18T14:14:44.093 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-18T14:14:44.093 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-18T14:14:44.093 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-18T14:14:44.094 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:43 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/769141900' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-18T14:14:44.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-18T14:14:44.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T14:14:44.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: Cluster is now healthy 2023-10-18T14:14:44.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/4280996062' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-18T14:14:44.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.114:6838/1167391173,v1:172.21.15.114:6840/1167391173] up:boot 2023-10-18T14:14:44.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.114:6839/2851674276,v1:172.21.15.114:6841/2851674276] up:boot 2023-10-18T14:14:44.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6836/1474866222,v1:172.21.15.172:6837/1474866222] up:boot 2023-10-18T14:14:44.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.158:6835/1442292517,v1:172.21.15.158:6839/1442292517] up:boot 2023-10-18T14:14:44.273 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6838/4085290999,v1:172.21.15.172:6839/4085290999] up:boot 2023-10-18T14:14:44.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6832/903260565,v1:172.21.15.172:6834/903260565] up:boot 2023-10-18T14:14:44.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.172:6833/3729261721,v1:172.21.15.172:6835/3729261721] up:boot 2023-10-18T14:14:44.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.158:6834/860386120,v1:172.21.15.158:6837/860386120] up:boot 2023-10-18T14:14:44.274 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.158:6833/4022144149,v1:172.21.15.158:6836/4022144149] up:boot 2023-10-18T14:14:44.275 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: mds.? [v2:172.21.15.158:6832/578050158,v1:172.21.15.158:6838/578050158] up:boot 2023-10-18T14:14:44.275 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: fsmap 12 up:standby 2023-10-18T14:14:44.275 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-18T14:14:44.275 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-18T14:14:44.276 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-18T14:14:44.276 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-18T14:14:44.276 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-18T14:14:44.276 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-18T14:14:44.276 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-18T14:14:44.277 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-18T14:14:44.277 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-18T14:14:44.277 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-18T14:14:44.277 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:43 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/769141900' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-18T14:14:44.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-18T14:14:44.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-18T14:14:44.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: Cluster is now healthy 2023-10-18T14:14:44.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/4280996062' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-18T14:14:44.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.114:6838/1167391173,v1:172.21.15.114:6840/1167391173] up:boot 2023-10-18T14:14:44.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.114:6839/2851674276,v1:172.21.15.114:6841/2851674276] up:boot 2023-10-18T14:14:44.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6836/1474866222,v1:172.21.15.172:6837/1474866222] up:boot 2023-10-18T14:14:44.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.158:6835/1442292517,v1:172.21.15.158:6839/1442292517] up:boot 2023-10-18T14:14:44.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6838/4085290999,v1:172.21.15.172:6839/4085290999] up:boot 2023-10-18T14:14:44.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6832/903260565,v1:172.21.15.172:6834/903260565] up:boot 2023-10-18T14:14:44.312 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.172:6833/3729261721,v1:172.21.15.172:6835/3729261721] up:boot 2023-10-18T14:14:44.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.158:6834/860386120,v1:172.21.15.158:6837/860386120] up:boot 2023-10-18T14:14:44.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.158:6833/4022144149,v1:172.21.15.158:6836/4022144149] up:boot 2023-10-18T14:14:44.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: mds.? [v2:172.21.15.158:6832/578050158,v1:172.21.15.158:6838/578050158] up:boot 2023-10-18T14:14:44.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: fsmap 12 up:standby 2023-10-18T14:14:44.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-18T14:14:44.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-18T14:14:44.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-18T14:14:44.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-18T14:14:44.315 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-18T14:14:44.315 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-18T14:14:44.315 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-18T14:14:44.315 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-18T14:14:44.316 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-18T14:14:44.316 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: from='mgr.14217 172.21.15.114:0/1845999901' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-18T14:14:44.316 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:43 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/769141900' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-18T14:14:44.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.445+0000 7f6988ff9700 1 -- 172.21.15.114:0/769141900 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) v1 ==== 181+0+0 (secure 0 0 0) 0x7f69840991a0 con 0x7f698c1056e0 2023-10-18T14:14:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.448+0000 7f6992020700 1 -- 172.21.15.114:0/769141900 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f69740a15f0 msgr2=0x7f69740a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.448+0000 7f6992020700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f69740a15f0 0x7f69740a3ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f698000b5c0 tx=0x7f698001a040 comp rx=0 tx=0).stop 2023-10-18T14:14:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.448+0000 7f6992020700 1 -- 172.21.15.114:0/769141900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c1056e0 msgr2=0x7f698c1a2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.448+0000 7f6992020700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c1056e0 0x7f698c1a2a80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6984007f10 tx=0x7f698400d3b0 comp rx=0 tx=0).stop 2023-10-18T14:14:44.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.449+0000 7f6992020700 1 -- 172.21.15.114:0/769141900 shutdown_connections 2023-10-18T14:14:44.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.449+0000 7f6992020700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f69740a15f0 0x7f69740a3ab0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:44.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.449+0000 7f6992020700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c1056e0 0x7f698c1a2a80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:44.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.449+0000 7f6992020700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f698c0ff640 0x7f698c197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:44.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.449+0000 7f6992020700 1 --2- 172.21.15.114:0/769141900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c100000 0x7f698c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:44.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.449+0000 7f6992020700 1 -- 172.21.15.114:0/769141900 >> 172.21.15.114:0/769141900 conn(0x7f698c0767f0 msgr2=0x7f698c0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:44.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.449+0000 7f6992020700 1 -- 172.21.15.114:0/769141900 shutdown_connections 2023-10-18T14:14:44.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.449+0000 7f6992020700 1 -- 172.21.15.114:0/769141900 wait complete. 2023-10-18T14:14:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2023-10-18T14:14:44.468 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-18T14:14:44.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.590+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/4041839146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb81056e0 msgr2=0x7f5fb8105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:44.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.590+0000 7f5fbcb5c700 1 --2- 172.21.15.114:0/4041839146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb81056e0 0x7f5fb8105ac0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009990 tx=0x7f5fb0009ca0 comp rx=0 tx=0).stop 2023-10-18T14:14:44.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.590+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/4041839146 shutdown_connections 2023-10-18T14:14:44.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.590+0000 7f5fbcb5c700 1 --2- 172.21.15.114:0/4041839146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb8100000 0x7f5fb810c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:44.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.590+0000 7f5fbcb5c700 1 --2- 172.21.15.114:0/4041839146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb81056e0 0x7f5fb8105ac0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:44.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.590+0000 7f5fbcb5c700 1 --2- 172.21.15.114:0/4041839146 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fb80ff640 0x7f5fb80ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:44.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.590+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/4041839146 >> 172.21.15.114:0/4041839146 conn(0x7f5fb80767f0 msgr2=0x7f5fb8076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:44.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.590+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/4041839146 shutdown_connections 2023-10-18T14:14:44.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.591+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/4041839146 wait complete. 2023-10-18T14:14:44.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.591+0000 7f5fbcb5c700 1 Processor -- start 2023-10-18T14:14:44.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.591+0000 7f5fbcb5c700 1 -- start start 2023-10-18T14:14:44.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fbcb5c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb80ff640 0x7f5fb81979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:44.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fbcb5c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb8100000 0x7f5fb8197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:44.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fbcb5c700 1 --2- >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fb81056e0 0x7f5fb81a2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:44.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fbcb5c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb81987d0 con 0x7f5fb80ff640 2023-10-18T14:14:44.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fbcb5c700 1 -- --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb81a2f90 con 0x7f5fb81056e0 2023-10-18T14:14:44.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fbcb5c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb81a30d0 con 0x7f5fb8100000 2023-10-18T14:14:44.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fb659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb80ff640 0x7f5fb81979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:44.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fb659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb80ff640 0x7f5fb81979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47056/0 (socket says 172.21.15.114:47056) 2023-10-18T14:14:44.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fb659c700 1 -- 172.21.15.114:0/3950828995 learned_addr learned my addr 172.21.15.114:0/3950828995 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T14:14:44.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fb659c700 1 -- 172.21.15.114:0/3950828995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb8100000 msgr2=0x7f5fb8197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fb659c700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb8100000 0x7f5fb8197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fb6d9d700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fb81056e0 0x7f5fb81a2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fb659c700 1 -- 172.21.15.114:0/3950828995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fb81056e0 msgr2=0x7f5fb81a2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fb659c700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fb81056e0 0x7f5fb81a2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fb659c700 1 -- 172.21.15.114:0/3950828995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00095f0 con 0x7f5fb80ff640 2023-10-18T14:14:44.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fb6d9d700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fb81056e0 0x7f5fb81a2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T14:14:44.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5fb659c700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb80ff640 0x7f5fb81979d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00098e0 tx=0x7f5fb000f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:44.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.592+0000 7f5faf7fe700 1 -- 172.21.15.114:0/3950828995 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb001d070 con 0x7f5fb80ff640 2023-10-18T14:14:44.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.593+0000 7f5faf7fe700 1 -- 172.21.15.114:0/3950828995 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5fb000fb90 con 0x7f5fb80ff640 2023-10-18T14:14:44.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.593+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/3950828995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb81a3350 con 0x7f5fb80ff640 2023-10-18T14:14:44.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.593+0000 7f5faf7fe700 1 -- 172.21.15.114:0/3950828995 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0017650 con 0x7f5fb80ff640 2023-10-18T14:14:44.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.593+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/3950828995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb81a3800 con 0x7f5fb80ff640 2023-10-18T14:14:44.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.593+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/3950828995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb8107b80 con 0x7f5fb80ff640 2023-10-18T14:14:44.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.595+0000 7f5faf7fe700 1 -- 172.21.15.114:0/3950828995 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f5fb000fd00 con 0x7f5fb80ff640 2023-10-18T14:14:44.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.595+0000 7f5faf7fe700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5fa40a15f0 0x7f5fa40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T14:14:44.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.595+0000 7f5faf7fe700 1 -- 172.21.15.114:0/3950828995 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8331+0+0 (secure 0 0 0) 0x7f5fb00ce520 con 0x7f5fb80ff640 2023-10-18T14:14:44.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.595+0000 7f5fb5d9b700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5fa40a15f0 0x7f5fa40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T14:14:44.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.596+0000 7f5fb5d9b700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5fa40a15f0 0x7f5fa40a3ab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0005950 tx=0x7f5fa00058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T14:14:44.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.599+0000 7f5faf7fe700 1 -- 172.21.15.114:0/3950828995 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5fb0097990 con 0x7f5fb80ff640 2023-10-18T14:14:44.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:44.801+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/3950828995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5fb8100d30 con 0x7f5fb80ff640 2023-10-18T14:14:45.088 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:44 smithi114 ceph-mon[99494]: pgmap v611: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 614 B/s wr, 11 op/s 2023-10-18T14:14:45.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:44 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/769141900' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-18T14:14:45.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:44 smithi114 ceph-mon[99494]: osdmap e96: 12 total, 12 up, 12 in 2023-10-18T14:14:45.089 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:44 smithi114 ceph-mon[99494]: from='client.? 172.21.15.114:0/3950828995' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-18T14:14:45.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:44 smithi158 ceph-mon[103317]: pgmap v611: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 614 B/s wr, 11 op/s 2023-10-18T14:14:45.271 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:44 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/769141900' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-18T14:14:45.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:44 smithi158 ceph-mon[103317]: osdmap e96: 12 total, 12 up, 12 in 2023-10-18T14:14:45.272 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:44 smithi158 ceph-mon[103317]: from='client.? 172.21.15.114:0/3950828995' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-18T14:14:45.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:44 smithi172 ceph-mon[103574]: pgmap v611: 97 pgs: 97 active+clean; 33 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 614 B/s wr, 11 op/s 2023-10-18T14:14:45.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:44 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/769141900' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-18T14:14:45.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:44 smithi172 ceph-mon[103574]: osdmap e96: 12 total, 12 up, 12 in 2023-10-18T14:14:45.310 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:44 smithi172 ceph-mon[103574]: from='client.? 172.21.15.114:0/3950828995' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-18T14:14:45.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:45.447+0000 7f5faf7fe700 1 -- 172.21.15.114:0/3950828995 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5fb009afb0 con 0x7f5fb80ff640 2023-10-18T14:14:45.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:45.452+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/3950828995 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5fa40a15f0 msgr2=0x7f5fa40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:45.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:45.452+0000 7f5fbcb5c700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5fa40a15f0 0x7f5fa40a3ab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0005950 tx=0x7f5fa00058e0 comp rx=0 tx=0).stop 2023-10-18T14:14:45.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:45.452+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/3950828995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb80ff640 msgr2=0x7f5fb81979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T14:14:45.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:45.452+0000 7f5fbcb5c700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb80ff640 0x7f5fb81979d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00098e0 tx=0x7f5fb000f720 comp rx=0 tx=0).stop 2023-10-18T14:14:45.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:45.452+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/3950828995 shutdown_connections 2023-10-18T14:14:45.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:45.452+0000 7f5fbcb5c700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.114:6800/3416629288,v1:172.21.15.114:6801/3416629288] conn(0x7f5fa40a15f0 0x7f5fa40a3ab0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:45.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:45.452+0000 7f5fbcb5c700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5fb81056e0 0x7f5fb81a2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:45.452+0000 7f5fbcb5c700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb80ff640 0x7f5fb81979d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:45.452+0000 7f5fbcb5c700 1 --2- 172.21.15.114:0/3950828995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb8100000 0x7f5fb8197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T14:14:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:45.452+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/3950828995 >> 172.21.15.114:0/3950828995 conn(0x7f5fb80767f0 msgr2=0x7f5fb80fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T14:14:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:45.452+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/3950828995 shutdown_connections 2023-10-18T14:14:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T14:14:45.452+0000 7f5fbcb5c700 1 -- 172.21.15.114:0/3950828995 wait complete. 2023-10-18T14:14:45.459 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2023-10-18T14:14:45.479 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-18T14:14:45.508 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-18T14:14:45.543 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-18T14:14:45.577 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-18T14:14:45.577 DEBUG:teuthology.orchestra.run.smithi114:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-18T14:14:45.596 DEBUG:teuthology.orchestra.run.smithi158:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-18T14:14:45.614 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-18T14:14:45.635 INFO:tasks.cephadm:Stopping all daemons... 2023-10-18T14:14:45.635 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-18T14:14:45.636 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.a 2023-10-18T14:14:45.838 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:45 smithi114 systemd[1]: Stopping Ceph mon.a for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:14:46.338 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:45 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a[99470]: 2023-10-18T14:14:45.984+0000 7fdd387dd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:14:46.339 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:45 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a[99470]: 2023-10-18T14:14:45.984+0000 7fdd387dd700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-18T14:14:46.654 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.a.service' 2023-10-18T14:14:46.680 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:46 smithi114 bash[196327]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-a 2023-10-18T14:14:46.680 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:46 smithi114 systemd[1]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.a.service: Succeeded. 2023-10-18T14:14:46.681 INFO:journalctl@ceph.mon.a.smithi114.stdout:Oct 18 14:14:46 smithi114 systemd[1]: Stopped Ceph mon.a for d734b050-6dbd-11ee-8db6-212e2dc638e7. 2023-10-18T14:14:46.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:14:46.712 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-18T14:14:46.712 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-18T14:14:46.712 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.b 2023-10-18T14:14:47.021 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:46 smithi158 systemd[1]: Stopping Ceph mon.b for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:14:47.476 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:47 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-b[103293]: 2023-10-18T14:14:47.183+0000 7f1d10f76700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:14:47.477 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:47 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-b[103293]: 2023-10-18T14:14:47.183+0000 7f1d10f76700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-18T14:14:47.771 INFO:journalctl@ceph.mon.b.smithi158.stdout:Oct 18 14:14:47 smithi158 bash[145689]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-b 2023-10-18T14:14:48.034 DEBUG:teuthology.orchestra.run.smithi158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.b.service' 2023-10-18T14:14:48.117 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:14:48.117 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-18T14:14:48.117 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-18T14:14:48.118 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.c 2023-10-18T14:14:48.490 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:48 smithi172 systemd[1]: Stopping Ceph mon.c for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:14:48.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:48 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-c[103537]: 2023-10-18T14:14:48.485+0000 7fb97f006700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:14:48.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:48 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-c[103537]: 2023-10-18T14:14:48.485+0000 7fb97f006700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-18T14:14:49.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Oct 18 14:14:48 smithi172 bash[148259]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mon-c 2023-10-18T14:14:49.170 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mon.c.service' 2023-10-18T14:14:49.227 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:14:49.228 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-18T14:14:49.228 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-18T14:14:49.228 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.x 2023-10-18T14:14:49.572 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 14:14:49 smithi114 systemd[1]: Stopping Ceph mgr.x for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:14:49.828 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 14:14:49 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x[99737]: 2023-10-18T14:14:49.566+0000 7f3c301fe700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:14:49.829 INFO:journalctl@ceph.mgr.x.smithi114.stdout:Oct 18 14:14:49 smithi114 bash[196838]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-x 2023-10-18T14:14:50.016 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.x.service' 2023-10-18T14:14:50.056 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:14:50.056 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-18T14:14:50.056 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-18T14:14:50.057 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.y 2023-10-18T14:14:50.481 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 14:14:50 smithi158 systemd[1]: Stopping Ceph mgr.y for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:14:50.769 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 14:14:50 smithi158 bash[146035]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-y 2023-10-18T14:14:50.951 INFO:journalctl@ceph.mgr.y.smithi158.stdout:Oct 18 14:14:50 smithi158 systemd[1]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-18T14:14:50.955 DEBUG:teuthology.orchestra.run.smithi158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.y.service' 2023-10-18T14:14:50.994 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:14:50.994 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-18T14:14:50.995 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-18T14:14:50.995 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.z 2023-10-18T14:14:51.309 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 14:14:51 smithi172 systemd[1]: Stopping Ceph mgr.z for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:14:51.701 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 14:14:51 smithi172 bash[148442]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mgr-z 2023-10-18T14:14:51.701 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Oct 18 14:14:51 smithi172 systemd[1]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-10-18T14:14:51.887 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mgr.z.service' 2023-10-18T14:14:51.925 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:14:51.926 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-18T14:14:51.926 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-18T14:14:51.926 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.0 2023-10-18T14:14:52.278 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 14:14:51 smithi114 systemd[1]: Stopping Ceph osd.0 for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:14:52.588 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 14:14:52 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-0[124655]: 2023-10-18T14:14:52.274+0000 7f25c547b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:14:52.589 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 14:14:52 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-0[124655]: 2023-10-18T14:14:52.274+0000 7f25c547b700 -1 osd.0 97 *** Got signal Terminated *** 2023-10-18T14:14:52.589 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 14:14:52 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-0[124655]: 2023-10-18T14:14:52.274+0000 7f25c547b700 -1 osd.0 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T14:14:58.088 INFO:journalctl@ceph.osd.0.smithi114.stdout:Oct 18 14:14:57 smithi114 bash[196983]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-0 2023-10-18T14:14:59.023 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.0.service' 2023-10-18T14:14:59.062 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:14:59.063 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-18T14:14:59.063 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-18T14:14:59.064 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.1 2023-10-18T14:14:59.407 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 14:14:59 smithi158 systemd[1]: Stopping Ceph osd.1 for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:14:59.771 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 14:14:59 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-1[109543]: 2023-10-18T14:14:59.403+0000 7f141d8a9700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:14:59.771 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 14:14:59 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-1[109543]: 2023-10-18T14:14:59.403+0000 7f141d8a9700 -1 osd.1 97 *** Got signal Terminated *** 2023-10-18T14:14:59.771 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 14:14:59 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-1[109543]: 2023-10-18T14:14:59.403+0000 7f141d8a9700 -1 osd.1 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T14:15:05.272 INFO:journalctl@ceph.osd.1.smithi158.stdout:Oct 18 14:15:05 smithi158 bash[146181]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-1 2023-10-18T14:15:06.439 DEBUG:teuthology.orchestra.run.smithi158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.1.service' 2023-10-18T14:15:06.481 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:15:06.481 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-18T14:15:06.482 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-18T14:15:06.482 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.2 2023-10-18T14:15:06.810 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 14:15:06 smithi172 systemd[1]: Stopping Ceph osd.2 for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:15:07.310 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 14:15:06 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-2[110722]: 2023-10-18T14:15:06.842+0000 7fa99bd56700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:15:07.310 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 14:15:06 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-2[110722]: 2023-10-18T14:15:06.842+0000 7fa99bd56700 -1 osd.2 97 *** Got signal Terminated *** 2023-10-18T14:15:07.310 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 14:15:06 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-2[110722]: 2023-10-18T14:15:06.842+0000 7fa99bd56700 -1 osd.2 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T14:15:12.624 INFO:journalctl@ceph.osd.2.smithi172.stdout:Oct 18 14:15:12 smithi172 bash[148600]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-2 2023-10-18T14:15:13.992 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.2.service' 2023-10-18T14:15:14.032 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:15:14.033 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-18T14:15:14.033 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-18T14:15:14.034 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.3 2023-10-18T14:15:14.339 INFO:journalctl@ceph.osd.3.smithi114.stdout:Oct 18 14:15:14 smithi114 systemd[1]: Stopping Ceph osd.3 for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:15:14.838 INFO:journalctl@ceph.osd.3.smithi114.stdout:Oct 18 14:15:14 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-3[132576]: 2023-10-18T14:15:14.397+0000 7f0e7bc45700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:15:14.839 INFO:journalctl@ceph.osd.3.smithi114.stdout:Oct 18 14:15:14 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-3[132576]: 2023-10-18T14:15:14.397+0000 7f0e7bc45700 -1 osd.3 97 *** Got signal Terminated *** 2023-10-18T14:15:14.839 INFO:journalctl@ceph.osd.3.smithi114.stdout:Oct 18 14:15:14 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-3[132576]: 2023-10-18T14:15:14.397+0000 7f0e7bc45700 -1 osd.3 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T14:15:18.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:17 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:17.909+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:18.900 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:18 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:18.843+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:18.901 INFO:journalctl@ceph.osd.3.smithi114.stdout:Oct 18 14:15:18 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-3[132576]: 2023-10-18T14:15:18.643+0000 7f0e76237700 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:52.975504+0000 front 2023-10-18T14:14:52.975528+0000 (oldest deadline 2023-10-18T14:15:18.275592+0000) 2023-10-18T14:15:19.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:18 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:18.836+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:19.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:18 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:18.896+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:19.560 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:19 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:19.072+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:20.175 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:19 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:19.876+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:20.175 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:19 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:19.943+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:20.176 INFO:journalctl@ceph.osd.3.smithi114.stdout:Oct 18 14:15:20 smithi114 bash[197248]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-3 2023-10-18T14:15:20.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:19 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:19.791+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:20.559 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:20 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:20.091+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:20.983 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:20 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:20.841+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:21.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:20 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:20.824+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:21.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:20 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:20.979+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:21.436 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.3.service' 2023-10-18T14:15:21.475 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:15:21.476 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-18T14:15:21.476 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-18T14:15:21.477 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.4 2023-10-18T14:15:21.559 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:21 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:21.094+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:21.771 INFO:journalctl@ceph.osd.4.smithi158.stdout:Oct 18 14:15:21 smithi158 systemd[1]: Stopping Ceph osd.4 for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:15:22.088 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:21 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:21.814+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:22.089 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:21 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:21.945+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:22.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:21 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:21.849+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:22.272 INFO:journalctl@ceph.osd.4.smithi158.stdout:Oct 18 14:15:21 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-4[117466]: 2023-10-18T14:15:21.824+0000 7f8851ad4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:15:22.272 INFO:journalctl@ceph.osd.4.smithi158.stdout:Oct 18 14:15:21 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-4[117466]: 2023-10-18T14:15:21.824+0000 7f8851ad4700 -1 osd.4 97 *** Got signal Terminated *** 2023-10-18T14:15:22.272 INFO:journalctl@ceph.osd.4.smithi158.stdout:Oct 18 14:15:21 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-4[117466]: 2023-10-18T14:15:21.824+0000 7f8851ad4700 -1 osd.4 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T14:15:22.560 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:22 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:22.078+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:22.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:22 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:22.058+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:23.088 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:22 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:22.812+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:23.089 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:22 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:22.983+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:23.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:22 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:22.848+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:23.560 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:23 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:23.079+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:23.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:23 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:23.067+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:24.029 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:23 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:23.767+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:24.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:23 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:23.848+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:24.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:24 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:24.025+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:24.559 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:24 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:24.063+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:24.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:24 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:24.063+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:25.051 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:24 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:24.756+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:25.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:24 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:24.846+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:25.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:25 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:25.047+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:25.559 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:25 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:25.063+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:25.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:25 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:25.096+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:25.886 INFO:journalctl@ceph.osd.4.smithi158.stdout:Oct 18 14:15:25 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-4[117466]: 2023-10-18T14:15:25.719+0000 7f884e0ca700 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.776526+0000 front 2023-10-18T14:14:59.776502+0000 (oldest deadline 2023-10-18T14:15:25.676651+0000) 2023-10-18T14:15:25.886 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:25 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:25.603+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:26.051 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:25 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:25.742+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:26.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:25 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:25.882+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:26.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:25 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:25.882+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:26.309 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:26 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:26.061+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:26.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:26 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:26.047+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:26.311 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:26 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:26.028+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:26.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:26 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:26.048+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:26.339 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:26 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:26.048+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:26.893 INFO:journalctl@ceph.osd.4.smithi158.stdout:Oct 18 14:15:26 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-4[117466]: 2023-10-18T14:15:26.746+0000 7f884e0ca700 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.776526+0000 front 2023-10-18T14:14:59.776502+0000 (oldest deadline 2023-10-18T14:15:25.676651+0000) 2023-10-18T14:15:26.893 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:26 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:26.563+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:27.079 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:26 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:26.761+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:27.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:26 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:26.889+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:27.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:26 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:26.889+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:27.309 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:27 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:27.017+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:27.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:27 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:27.006+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:27.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:27 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:27.002+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:27.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:27 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:27.076+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:27.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:27 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:27.076+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:27.772 INFO:journalctl@ceph.osd.4.smithi158.stdout:Oct 18 14:15:27 smithi158 bash[146464]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-4 2023-10-18T14:15:27.772 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:27 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:27.569+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:28.073 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:27 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:27.786+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:28.074 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:27 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:27.786+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:28.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:27 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:27.920+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:28.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:27 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:27.920+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:28.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:28 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:28.006+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:28.310 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:28 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:28.018+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:28.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:27 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:27.968+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:28.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:28 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:28.070+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:28.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:28 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:28.070+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:28.907 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:28 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:28.593+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:29.094 DEBUG:teuthology.orchestra.run.smithi158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.4.service' 2023-10-18T14:15:29.121 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:28 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:28.836+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:29.122 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:28 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:28.836+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:29.135 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:15:29.136 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-18T14:15:29.136 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-18T14:15:29.137 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.5 2023-10-18T14:15:29.176 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:29 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:29.021+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:29.177 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:28 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:28.995+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:29.177 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:28 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:28.922+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:29.177 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:28 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:28.922+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:29.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:28 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:28.903+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:29.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:28 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:28.903+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:29.491 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:29 smithi172 systemd[1]: Stopping Ceph osd.5 for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:15:29.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:29 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:29.118+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:29.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:29 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:29.118+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:29.809 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:29 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:29.487+0000 7f4466656700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:15:29.810 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:29 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:29.487+0000 7f4466656700 -1 osd.5 97 *** Got signal Terminated *** 2023-10-18T14:15:29.810 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:29 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:29.487+0000 7f4466656700 -1 osd.5 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T14:15:29.907 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:29 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:29.626+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:30.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:29 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:29.904+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:30.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:29 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:29.904+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:30.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:30 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:30.009+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:30.310 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:30 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:30.038+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:30.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:29 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:29.908+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:30.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:29 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:29.908+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:30.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:30 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:30.091+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:30.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:30 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:30.091+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:30.339 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:29 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:29.868+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:30.339 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:29 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:29.868+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:30.884 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:30 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:30.613+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:31.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:30 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:30.881+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:31.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:30 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:30.881+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:31.309 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:31 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:31.049+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:31.310 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:31 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:31.087+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:31.310 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:31 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:31.087+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:04.237591+0000 front 2023-10-18T14:15:04.237567+0000 (oldest deadline 2023-10-18T14:15:30.638263+0000) 2023-10-18T14:15:31.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:30 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:30.873+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:31.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:30 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:30.873+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:31.338 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:30 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:30.851+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:31.338 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:30 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:30.851+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:31.339 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:31 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:31.069+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:31.339 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:31 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:31.069+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:31.855 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:31 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:31.601+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:32.105 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:31 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:31.841+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:32.105 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:31 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:31.841+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:32.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:31 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:31.852+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:32.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:31 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:31.852+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:32.309 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:32 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:32.041+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:32.310 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:32 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:32.095+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:32.310 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:32 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:32.095+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:04.237591+0000 front 2023-10-18T14:15:04.237567+0000 (oldest deadline 2023-10-18T14:15:30.638263+0000) 2023-10-18T14:15:32.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:31 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:31.874+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:32.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:31 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:31.874+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:32.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:32 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:32.102+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:32.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:32 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:32.102+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:32.862 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:32 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:32.594+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:33.080 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:32 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:32.797+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:33.081 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:32 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:32.797+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:33.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:32 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:32.859+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:33.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:32 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:32.859+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:33.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:33 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:33.091+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:33.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:33 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:33.091+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:33.311 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:33 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:33.085+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:33.311 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:33 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:33.085+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:04.237591+0000 front 2023-10-18T14:15:04.237567+0000 (oldest deadline 2023-10-18T14:15:30.638263+0000) 2023-10-18T14:15:33.312 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:32 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:32.909+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:33.312 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:32 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:32.909+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:33.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:33 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:33.077+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:33.339 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:33 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:33.077+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:33.891 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:33 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:33.635+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:34.084 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:33 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:33.814+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:34.084 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:33 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:33.814+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:34.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:33 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:33.888+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:34.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:33 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:33.888+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:34.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:33 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:33.888+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:34.310 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:34 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:34.079+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:54.935792+0000 front 2023-10-18T14:14:54.935716+0000 (oldest deadline 2023-10-18T14:15:18.435918+0000) 2023-10-18T14:15:34.310 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:34 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5[119384]: 2023-10-18T14:15:34.079+0000 7f4460447700 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:04.237591+0000 front 2023-10-18T14:15:04.237567+0000 (oldest deadline 2023-10-18T14:15:30.638263+0000) 2023-10-18T14:15:34.311 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:34 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:34.045+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:34.311 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:34 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:34.045+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:34.312 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:33 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:33.942+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:34.312 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:33 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:33.942+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:34.312 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:33 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:33.942+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:34.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:34 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:34.079+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:34.339 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:34 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:34.079+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:34.339 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:34 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:34.080+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:34.918 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:34 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:34.599+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:35.117 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:34 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:34.840+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:35.117 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:34 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:34.840+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:35.117 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:34 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:34.840+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.550558+0000 front 2023-10-18T14:15:10.550476+0000 (oldest deadline 2023-10-18T14:15:34.050308+0000) 2023-10-18T14:15:35.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:34 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:34.915+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:35.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:34 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:34.915+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:35.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:34 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:34.915+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:35.288 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:35 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:34.999+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:35.288 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:35 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:34.999+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:35.289 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:34 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:34.985+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:35.289 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:34 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:34.985+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:35.289 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:34 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:34.985+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:35.559 INFO:journalctl@ceph.osd.5.smithi172.stdout:Oct 18 14:15:35 smithi172 bash[148860]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-5 2023-10-18T14:15:35.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:35 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:35.113+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:35.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:35 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:35.113+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:35.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:35 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:35.113+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:35.959 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:35 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:35.626+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:36.088 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:35 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:35.817+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:36.089 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:35 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:35.817+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:36.089 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:35 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:35.817+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.550558+0000 front 2023-10-18T14:15:10.550476+0000 (oldest deadline 2023-10-18T14:15:34.050308+0000) 2023-10-18T14:15:36.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:35 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:35.955+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:36.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:35 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:35.955+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:36.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:35 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:35.955+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:36.281 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:36 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:36.006+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:36.281 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:36 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:36.007+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:36.281 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:35 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:35.967+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:36.281 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:35 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:35.967+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:36.282 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:35 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:35.967+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:36.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:36 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:36.103+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:36.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:36 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:36.103+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:36.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:36 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:36.103+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:36.637 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.5.service' 2023-10-18T14:15:36.717 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:15:36.718 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-18T14:15:36.718 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-18T14:15:36.719 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.6 2023-10-18T14:15:36.952 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:36 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:36.642+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:36.953 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:36 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:36.642+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.209800+0000 front 2023-10-18T14:15:11.209758+0000 (oldest deadline 2023-10-18T14:15:35.909744+0000) 2023-10-18T14:15:37.072 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:36 smithi114 systemd[1]: Stopping Ceph osd.6 for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:15:37.072 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:36 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:36.864+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:37.072 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:36 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:36.864+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:37.073 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:36 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:36.864+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.550558+0000 front 2023-10-18T14:15:10.550476+0000 (oldest deadline 2023-10-18T14:15:34.050308+0000) 2023-10-18T14:15:37.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:36 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:36.949+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:37.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:36 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:36.949+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:37.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:36 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:36.949+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:37.309 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:37 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:37.039+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:37.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:37 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:37.039+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:37.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:37 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:37.004+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:37.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:37 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:37.004+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:37.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:37 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:37.004+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:37.338 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:37 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:37.069+0000 7fbf2ddc9700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:15:37.339 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:37 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:37.069+0000 7fbf2ddc9700 -1 osd.6 97 *** Got signal Terminated *** 2023-10-18T14:15:37.339 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:37 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:37.069+0000 7fbf2ddc9700 -1 osd.6 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T14:15:37.339 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:37 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:37.068+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:37.339 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:37 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:37.068+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:37.340 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:37 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:37.068+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:37.991 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:37 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:37.688+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:37.992 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:37 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:37.688+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.209800+0000 front 2023-10-18T14:15:11.209758+0000 (oldest deadline 2023-10-18T14:15:35.909744+0000) 2023-10-18T14:15:38.120 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:37 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:37.847+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:38.120 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:37 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:37.847+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:38.120 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:37 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:37.847+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.550558+0000 front 2023-10-18T14:15:10.550476+0000 (oldest deadline 2023-10-18T14:15:34.050308+0000) 2023-10-18T14:15:38.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:37 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:37.988+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:38.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:37 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:37.988+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:38.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:37 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:37.988+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:38.309 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:38 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:38.081+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:38.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:38 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:38.081+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:38.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:37 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:37.986+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:38.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:37 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:37.986+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:38.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:37 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:37.986+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:38.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:38 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:38.117+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:38.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:38 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:38.117+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:38.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:38 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:38.117+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:39.004 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:38 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:38.729+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:39.004 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:38 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:38.729+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.209800+0000 front 2023-10-18T14:15:11.209758+0000 (oldest deadline 2023-10-18T14:15:35.909744+0000) 2023-10-18T14:15:39.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:39 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:39.001+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:39.271 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:39 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:39.001+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:39.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:39 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:39.001+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:39.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:39 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:39.086+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:39.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:39 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:39.086+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:39.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:38 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:38.952+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:39.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:38 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:38.952+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:39.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:38 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:38.952+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:39.338 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:38 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:38.884+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:39.339 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:38 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:38.884+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:39.339 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:38 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:38.884+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.550558+0000 front 2023-10-18T14:15:10.550476+0000 (oldest deadline 2023-10-18T14:15:34.050308+0000) 2023-10-18T14:15:39.339 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:39 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:39.132+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:39.340 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:39 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:39.132+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:39.340 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:39 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:39.132+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:40.021 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:39 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:39.739+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:40.021 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:39 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:39.739+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.209800+0000 front 2023-10-18T14:15:11.209758+0000 (oldest deadline 2023-10-18T14:15:35.909744+0000) 2023-10-18T14:15:40.022 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:39 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:39.968+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:40.022 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:39 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:39.968+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:40.022 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:39 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:39.968+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:40.185 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:39 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:39.922+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:40.185 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:39 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:39.922+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:40.185 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:39 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:39.922+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.550558+0000 front 2023-10-18T14:15:10.550476+0000 (oldest deadline 2023-10-18T14:15:34.050308+0000) 2023-10-18T14:15:40.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:40 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:40.125+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:40.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:40 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:40.125+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:40.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:39 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:39.961+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:40.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:39 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:39.961+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:40.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:39 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:39.961+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:40.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:40 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:40.181+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:40.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:40 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:40.181+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:40.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:40 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:40.181+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:41.271 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:40 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:40.779+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:41.272 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:40 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:40.779+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.209800+0000 front 2023-10-18T14:15:11.209758+0000 (oldest deadline 2023-10-18T14:15:35.909744+0000) 2023-10-18T14:15:41.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:41 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:41.015+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:41.273 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:41 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:41.015+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:41.273 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:41 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:41.015+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:41.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:41 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:41.127+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:41.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:41 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:41.127+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:41.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:40 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:40.976+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:41.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:40 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:40.976+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:41.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:40 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:40.976+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:41.338 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:41 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:41.187+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:41.339 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:41 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:41.187+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:41.339 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:41 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:41.187+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:41.340 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:41 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:41.187+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:41.340 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:40 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:40.944+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:41.340 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:40 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:40.944+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:41.341 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:40 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:40.944+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.550558+0000 front 2023-10-18T14:15:10.550476+0000 (oldest deadline 2023-10-18T14:15:34.050308+0000) 2023-10-18T14:15:41.341 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:40 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:40.944+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.351295+0000 front 2023-10-18T14:15:19.351323+0000 (oldest deadline 2023-10-18T14:15:40.351915+0000) 2023-10-18T14:15:42.021 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:41 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:41.748+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:42.021 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:41 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:41.748+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.209800+0000 front 2023-10-18T14:15:11.209758+0000 (oldest deadline 2023-10-18T14:15:35.909744+0000) 2023-10-18T14:15:42.022 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:41 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:41.748+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.011176+0000 front 2023-10-18T14:15:17.011136+0000 (oldest deadline 2023-10-18T14:15:41.711134+0000) 2023-10-18T14:15:42.238 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:41 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:41.918+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.546832+0000 front 2023-10-18T14:14:55.546854+0000 (oldest deadline 2023-10-18T14:15:17.847038+0000) 2023-10-18T14:15:42.239 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:41 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:41.918+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.949460+0000 front 2023-10-18T14:15:02.949543+0000 (oldest deadline 2023-10-18T14:15:27.049207+0000) 2023-10-18T14:15:42.239 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:41 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:41.918+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.550558+0000 front 2023-10-18T14:15:10.550476+0000 (oldest deadline 2023-10-18T14:15:34.050308+0000) 2023-10-18T14:15:42.239 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:41 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6[141232]: 2023-10-18T14:15:41.918+0000 7fbf27bba700 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.351295+0000 front 2023-10-18T14:15:19.351323+0000 (oldest deadline 2023-10-18T14:15:40.351915+0000) 2023-10-18T14:15:42.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:42.161+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:42.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:42 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:42.161+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:42.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:41 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:41.986+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:42.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:41 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:41.986+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:42.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:41 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:41.986+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:42.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:42.046+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:42.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:42.046+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:42.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:42.046+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:42.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:42.046+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:42.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:42.235+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:42.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:42.235+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:42.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:42.235+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:42.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:42 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:42.235+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:43.021 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:42.698+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:43.021 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:42.698+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.209800+0000 front 2023-10-18T14:15:11.209758+0000 (oldest deadline 2023-10-18T14:15:35.909744+0000) 2023-10-18T14:15:43.022 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:42 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:42.698+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.011176+0000 front 2023-10-18T14:15:17.011136+0000 (oldest deadline 2023-10-18T14:15:41.711134+0000) 2023-10-18T14:15:43.088 INFO:journalctl@ceph.osd.6.smithi114.stdout:Oct 18 14:15:42 smithi114 bash[197516]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-6 2023-10-18T14:15:43.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:43 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:43.201+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:43.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:43 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:43.201+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:43.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:43 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:43.019+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:43.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:43 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:43.019+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:43.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:43 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:43.019+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:43.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:43 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:43.026+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:43.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:43 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:43.026+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:43.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:43 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:43.026+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:43.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:43 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:43.026+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:43.525 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:43 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:43.239+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:43.526 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:43 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:43.239+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:43.526 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:43 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:43.239+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:43.526 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:43 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:43.239+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:43.918 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.6.service' 2023-10-18T14:15:43.957 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:15:43.957 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-18T14:15:43.958 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-18T14:15:43.958 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.7 2023-10-18T14:15:43.996 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:43 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:43.738+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:43.997 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:43 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:43.738+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.209800+0000 front 2023-10-18T14:15:11.209758+0000 (oldest deadline 2023-10-18T14:15:35.909744+0000) 2023-10-18T14:15:43.997 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:43 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:43.738+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.011176+0000 front 2023-10-18T14:15:17.011136+0000 (oldest deadline 2023-10-18T14:15:41.711134+0000) 2023-10-18T14:15:44.271 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:43 smithi158 systemd[1]: Stopping Ceph osd.7 for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:15:44.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:44 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:44.063+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:44.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:44 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:44.063+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:44.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:44 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:44.063+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:44.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:44 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:44.063+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:44.309 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:44 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:44.236+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:44.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:44 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:44.236+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:44.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:44 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:44.024+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:44.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:44 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:44.024+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:44.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:44 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:44.024+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:44.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:44 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:44.024+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:44.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:44 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:44.246+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:44.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:44 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:44.246+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:44.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:44 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:44.246+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:44.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:44 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:44.246+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:44.728 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:44 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:44.312+0000 7f9e89c00700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:15:44.729 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:44 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:44.312+0000 7f9e89c00700 -1 osd.7 97 *** Got signal Terminated *** 2023-10-18T14:15:44.729 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:44 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:44.312+0000 7f9e89c00700 -1 osd.7 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T14:15:44.729 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:44 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:44.724+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:45.021 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:44 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:44.724+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.209800+0000 front 2023-10-18T14:15:11.209758+0000 (oldest deadline 2023-10-18T14:15:35.909744+0000) 2023-10-18T14:15:45.021 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:44 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:44.724+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.011176+0000 front 2023-10-18T14:15:17.011136+0000 (oldest deadline 2023-10-18T14:15:41.711134+0000) 2023-10-18T14:15:45.276 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:44 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:44.990+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:45.276 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:44 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:44.990+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:45.276 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:44 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:44.990+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:45.277 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:44 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:44.990+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:45.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:45 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:45.058+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:45.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:45 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:45.058+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:45.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:45 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:45.058+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:45.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:45 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:45.058+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:45.559 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:45 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:45.273+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:45.560 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:45 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:45.273+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:45.560 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:45 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:45.273+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.317618+0000 front 2023-10-18T14:15:19.317508+0000 (oldest deadline 2023-10-18T14:15:45.217553+0000) 2023-10-18T14:15:45.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:45 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:45.260+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:45.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:45 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:45.260+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:45.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:45 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:45.260+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:45.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:45 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:45.260+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:46.021 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:45 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:45.738+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:46.021 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:45 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:45.738+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.209800+0000 front 2023-10-18T14:15:11.209758+0000 (oldest deadline 2023-10-18T14:15:35.909744+0000) 2023-10-18T14:15:46.021 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:45 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:45.738+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.011176+0000 front 2023-10-18T14:15:17.011136+0000 (oldest deadline 2023-10-18T14:15:41.711134+0000) 2023-10-18T14:15:46.309 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:45 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:45.975+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:46.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:45 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:45.975+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:46.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:45 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:45.975+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:46.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:45 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:45.975+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:46.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:46 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:46.107+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:46.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:46 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:46.107+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:46.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:46 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:46.107+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:46.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:46 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:46.107+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:46.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:46.212+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:46.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:46.212+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:46.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:46.212+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:46.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:46 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:46.212+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:46.809 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:46 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:46.307+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:46.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:46 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:46.307+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:46.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:46 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:46.307+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.317618+0000 front 2023-10-18T14:15:19.317508+0000 (oldest deadline 2023-10-18T14:15:45.217553+0000) 2023-10-18T14:15:47.021 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:46 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:46.754+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:47.021 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:46 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:46.754+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.209800+0000 front 2023-10-18T14:15:11.209758+0000 (oldest deadline 2023-10-18T14:15:35.909744+0000) 2023-10-18T14:15:47.022 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:46 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:46.754+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.011176+0000 front 2023-10-18T14:15:17.011136+0000 (oldest deadline 2023-10-18T14:15:41.711134+0000) 2023-10-18T14:15:47.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:46 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:46.992+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:47.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:46 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:46.992+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:47.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:46 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:46.992+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:47.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:46 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:46.992+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:47.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:47 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:47.065+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:47.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:47 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:47.065+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:47.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:47 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:47.065+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:47.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:47 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:47.065+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:47.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:47 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:47.226+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:47.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:47 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:47.227+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:47.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:47 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:47.227+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:47.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:47 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:47.227+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:47.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:47 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:47.355+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:47.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:47 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:47.355+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:47.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:47 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:47.355+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.317618+0000 front 2023-10-18T14:15:19.317508+0000 (oldest deadline 2023-10-18T14:15:45.217553+0000) 2023-10-18T14:15:48.119 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:47 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:47.803+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:48.120 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:47 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:47.803+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.209800+0000 front 2023-10-18T14:15:11.209758+0000 (oldest deadline 2023-10-18T14:15:35.909744+0000) 2023-10-18T14:15:48.120 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:47 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:47.803+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.011176+0000 front 2023-10-18T14:15:17.011136+0000 (oldest deadline 2023-10-18T14:15:41.711134+0000) 2023-10-18T14:15:48.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:48 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:48.001+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:48.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:48 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:48.001+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:48.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:48 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:48.001+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:48.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:48 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:48.001+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:48.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:48 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:48.116+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:48.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:48 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:48.116+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:48.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:48 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:48.116+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:48.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:48 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:48.116+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:48.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:48 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:48.116+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:15:48.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:48 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:48.266+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:48.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:48 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:48.266+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:48.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:48 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:48.266+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:48.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:48 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:48.266+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:48.809 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:48 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:48.376+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:48.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:48 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:48.376+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:48.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:48 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:48.376+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.317618+0000 front 2023-10-18T14:15:19.317508+0000 (oldest deadline 2023-10-18T14:15:45.217553+0000) 2023-10-18T14:15:49.151 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:48 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:48.780+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.607627+0000 front 2023-10-18T14:14:59.607646+0000 (oldest deadline 2023-10-18T14:15:25.507787+0000) 2023-10-18T14:15:49.151 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:48 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:48.780+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.209800+0000 front 2023-10-18T14:15:11.209758+0000 (oldest deadline 2023-10-18T14:15:35.909744+0000) 2023-10-18T14:15:49.151 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:48 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7[126178]: 2023-10-18T14:15:48.780+0000 7f9e859f5700 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.011176+0000 front 2023-10-18T14:15:17.011136+0000 (oldest deadline 2023-10-18T14:15:41.711134+0000) 2023-10-18T14:15:49.309 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:49 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:49.029+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:49.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:49 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:49.029+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:49.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:49 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:49.029+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:49.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:49 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:49.029+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:49.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:49 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:49.148+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:49.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:49 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:49.148+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:49.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:49 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:49.148+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:49.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:49 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:49.148+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:49.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:49 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:49.148+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:15:49.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:49 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:49.256+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:49.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:49 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:49.256+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:49.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:49 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:49.256+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:49.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:49 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:49.256+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:49.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:49 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:49.371+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:49.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:49 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:49.371+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:49.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:49 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:49.371+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.317618+0000 front 2023-10-18T14:15:19.317508+0000 (oldest deadline 2023-10-18T14:15:45.217553+0000) 2023-10-18T14:15:50.271 INFO:journalctl@ceph.osd.7.smithi158.stdout:Oct 18 14:15:50 smithi158 bash[146737]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-7 2023-10-18T14:15:50.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:50 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:50.153+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:50.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:50 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:50.153+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:50.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:50 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:50.153+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:50.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:50 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:50.153+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:50.272 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:50 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:50.153+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:15:50.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:50 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:50.053+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:50.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:50 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:50.053+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:50.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:50 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:50.053+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:50.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:50 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:50.053+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:50.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:50 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:50.053+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:15:50.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:50 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:50.221+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:50.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:50 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:50.221+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:50.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:50 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:50.221+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:50.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:50 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:50.221+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:50.809 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:50 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:50.399+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:50.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:50 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:50.399+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:50.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:50 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:50.399+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.317618+0000 front 2023-10-18T14:15:19.317508+0000 (oldest deadline 2023-10-18T14:15:45.217553+0000) 2023-10-18T14:15:51.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:51 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:51.018+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:51.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:51 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:51.018+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:51.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:51 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:51.018+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:51.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:51 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:51.018+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:51.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:51 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:51.018+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:15:51.404 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:51 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:51.139+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:51.405 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:51 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:51.139+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:51.405 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:51 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:51.139+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:51.405 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:51 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:51.139+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:51.405 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:51 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:51.139+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:15:51.410 DEBUG:teuthology.orchestra.run.smithi158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.7.service' 2023-10-18T14:15:51.490 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:15:51.490 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-18T14:15:51.491 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-18T14:15:51.491 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.8 2023-10-18T14:15:51.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:51 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:51.229+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:51.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:51 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:51.229+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:51.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:51 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:51.229+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:51.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:51 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:51.229+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:51.809 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:51 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:51.364+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:51.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:51 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:51.364+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:51.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:51 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:51.364+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.317618+0000 front 2023-10-18T14:15:19.317508+0000 (oldest deadline 2023-10-18T14:15:45.217553+0000) 2023-10-18T14:15:51.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:51 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:51.364+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:25.218311+0000 front 2023-10-18T14:15:25.218300+0000 (oldest deadline 2023-10-18T14:15:50.418770+0000) 2023-10-18T14:15:51.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:51 smithi172 systemd[1]: Stopping Ceph osd.8 for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:15:52.309 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:51 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:51.833+0000 7f69ce217700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:15:52.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:51 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:51.833+0000 7f69ce217700 -1 osd.8 97 *** Got signal Terminated *** 2023-10-18T14:15:52.310 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:51 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:51.833+0000 7f69ce217700 -1 osd.8 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T14:15:52.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:52 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:52.044+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:52.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:52 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:52.044+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:52.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:52 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:52.044+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:52.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:52 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:52.044+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:52.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:52 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:52.044+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:15:52.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:52 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:52.184+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:52.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:52 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:52.184+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:52.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:52 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:52.184+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:52.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:52 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:52.184+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:52.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:52 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:52.184+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:15:52.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:52 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:52.239+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:52.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:52 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:52.239+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:52.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:52 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:52.239+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:52.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:52 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:52.239+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:52.590 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:52 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:52.239+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:26.678291+0000 front 2023-10-18T14:15:26.678267+0000 (oldest deadline 2023-10-18T14:15:51.978301+0000) 2023-10-18T14:15:52.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:52 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:52.411+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:52.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:52 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:52.411+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:52.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:52 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:52.411+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.317618+0000 front 2023-10-18T14:15:19.317508+0000 (oldest deadline 2023-10-18T14:15:45.217553+0000) 2023-10-18T14:15:52.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:52 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:52.411+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:25.218311+0000 front 2023-10-18T14:15:25.218300+0000 (oldest deadline 2023-10-18T14:15:50.418770+0000) 2023-10-18T14:15:53.366 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:53 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:53.093+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:53.366 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:53 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:53.093+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:53.366 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:53 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:53.093+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:53.366 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:53 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:53.093+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:53.367 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:53 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:53.093+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:15:53.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:53 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:53.152+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:53.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:53 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:53.152+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:53.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:53 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:53.152+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:53.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:53 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:53.152+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:53.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:53 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:53.152+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:15:53.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:53 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:53.252+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:53.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:53 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:53.252+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:53.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:53 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:53.252+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:53.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:53 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:53.252+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:53.590 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:53 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:53.252+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:26.678291+0000 front 2023-10-18T14:15:26.678267+0000 (oldest deadline 2023-10-18T14:15:51.978301+0000) 2023-10-18T14:15:53.809 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:53 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:53.362+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:53.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:53 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:53.362+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:53.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:53 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:53.362+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.317618+0000 front 2023-10-18T14:15:19.317508+0000 (oldest deadline 2023-10-18T14:15:45.217553+0000) 2023-10-18T14:15:53.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:53 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:53.362+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:25.218311+0000 front 2023-10-18T14:15:25.218300+0000 (oldest deadline 2023-10-18T14:15:50.418770+0000) 2023-10-18T14:15:54.390 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:54 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:54.129+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:54.390 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:54 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:54.129+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:54.390 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:54 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:54.129+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:54.390 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:54 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:54.129+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:54.391 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:54 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:54.129+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:15:54.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:54 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:54.172+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:54.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:54 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:54.172+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:54.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:54 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:54.172+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:54.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:54 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:54.172+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:54.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:54 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:54.172+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:15:54.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:54 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:54.213+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:54.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:54 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:54.213+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:54.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:54 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:54.213+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:54.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:54 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:54.213+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:54.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:54 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:54.213+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:26.678291+0000 front 2023-10-18T14:15:26.678267+0000 (oldest deadline 2023-10-18T14:15:51.978301+0000) 2023-10-18T14:15:54.809 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:54 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:54.386+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:54.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:54 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:54.386+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:54.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:54 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:54.386+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.317618+0000 front 2023-10-18T14:15:19.317508+0000 (oldest deadline 2023-10-18T14:15:45.217553+0000) 2023-10-18T14:15:54.810 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:54 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:54.386+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:25.218311+0000 front 2023-10-18T14:15:25.218300+0000 (oldest deadline 2023-10-18T14:15:50.418770+0000) 2023-10-18T14:15:55.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:55 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:55.198+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:55.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:55 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:55.198+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:55.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:55 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:55.198+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:55.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:55 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:55.198+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:55.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:55 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:55.198+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:15:55.559 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:55 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:55.133+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:55.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:55 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:55.133+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:55.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:55 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:55.133+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:55.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:55 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:55.133+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:55.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:55 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:55.133+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:15:55.561 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:55 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:55.378+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:55.561 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:55 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:55.378+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:55.561 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:55 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:55.378+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.317618+0000 front 2023-10-18T14:15:19.317508+0000 (oldest deadline 2023-10-18T14:15:45.217553+0000) 2023-10-18T14:15:55.561 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:55 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:55.378+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:25.218311+0000 front 2023-10-18T14:15:25.218300+0000 (oldest deadline 2023-10-18T14:15:50.418770+0000) 2023-10-18T14:15:55.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:55 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:55.219+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:55.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:55 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:55.219+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:55.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:55 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:55.219+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:55.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:55 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:55.219+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:55.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:55 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:55.219+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:26.678291+0000 front 2023-10-18T14:15:26.678267+0000 (oldest deadline 2023-10-18T14:15:51.978301+0000) 2023-10-18T14:15:56.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:56 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:56.233+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:56.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:56 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:56.233+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:56.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:56 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:56.233+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:56.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:56 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:56.233+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:56.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:56 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:56.233+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:15:56.560 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:56 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:56.396+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:14:59.612911+0000 front 2023-10-18T14:14:59.612934+0000 (oldest deadline 2023-10-18T14:15:25.513023+0000) 2023-10-18T14:15:56.560 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:56 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:56.396+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.815495+0000 front 2023-10-18T14:15:11.815520+0000 (oldest deadline 2023-10-18T14:15:32.315651+0000) 2023-10-18T14:15:56.560 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:56 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:56.396+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.317618+0000 front 2023-10-18T14:15:19.317508+0000 (oldest deadline 2023-10-18T14:15:45.217553+0000) 2023-10-18T14:15:56.561 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:56 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:56.396+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:25.218311+0000 front 2023-10-18T14:15:25.218300+0000 (oldest deadline 2023-10-18T14:15:50.418770+0000) 2023-10-18T14:15:56.561 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:56 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8[127445]: 2023-10-18T14:15:56.396+0000 7f69ca80d700 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:30.919648+0000 front 2023-10-18T14:15:30.919674+0000 (oldest deadline 2023-10-18T14:15:56.219833+0000) 2023-10-18T14:15:56.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:56 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:56.149+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:56.562 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:56 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:56.149+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:56.562 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:56 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:56.149+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:56.562 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:56 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:56.149+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:56.562 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:56 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:56.149+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:15:56.562 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:56 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:56.149+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:15:56.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:56 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:56.249+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:56.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:56 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:56.249+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:56.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:56 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:56.249+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:56.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:56 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:56.249+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:56.590 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:56 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:56.249+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:26.678291+0000 front 2023-10-18T14:15:26.678267+0000 (oldest deadline 2023-10-18T14:15:51.978301+0000) 2023-10-18T14:15:57.452 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:57 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:57.128+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:57.453 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:57 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:57.128+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:57.453 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:57 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:57.128+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:57.453 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:57 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:57.128+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:57.453 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:57 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:57.128+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:15:57.454 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:57 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:57.128+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:15:57.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:57 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:57.263+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:57.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:57 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:57.263+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:57.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:57 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:57.263+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:57.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:57 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:57.263+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:57.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:57 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:57.263+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:15:57.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:57 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:57.276+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:57.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:57 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:57.276+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:57.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:57 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:57.276+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:57.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:57 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:57.276+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:57.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:57 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:57.276+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:26.678291+0000 front 2023-10-18T14:15:26.678267+0000 (oldest deadline 2023-10-18T14:15:51.978301+0000) 2023-10-18T14:15:57.590 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:57 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:57.276+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.079334+0000 front 2023-10-18T14:15:33.079453+0000 (oldest deadline 2023-10-18T14:15:56.579411+0000) 2023-10-18T14:15:57.729 INFO:journalctl@ceph.osd.8.smithi172.stdout:Oct 18 14:15:57 smithi172 bash[149120]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-8 2023-10-18T14:15:58.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:58 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:58.082+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:58.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:58 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:58.082+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:58.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:58 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:58.082+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:58.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:58 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:58.082+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:58.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:58 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:58.082+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:15:58.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:58 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:58.082+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:15:58.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:58 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:58.298+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:58.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:58 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:58.298+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:58.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:58 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:58.298+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:58.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:58 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:58.298+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:58.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:58 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:58.298+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:26.678291+0000 front 2023-10-18T14:15:26.678267+0000 (oldest deadline 2023-10-18T14:15:51.978301+0000) 2023-10-18T14:15:58.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:58 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:58.298+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.079334+0000 front 2023-10-18T14:15:33.079453+0000 (oldest deadline 2023-10-18T14:15:56.579411+0000) 2023-10-18T14:15:58.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:58 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:58.274+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:58.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:58 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:58.274+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:58.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:58 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:58.274+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:58.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:58 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:58.274+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:58.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:58 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:58.274+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:15:58.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:58 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:58.274+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:15:58.989 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.8.service' 2023-10-18T14:15:59.031 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:15:59.032 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-18T14:15:59.032 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-18T14:15:59.032 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.9 2023-10-18T14:15:59.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:59.042+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:15:59.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:59.042+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:15:59.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:59.042+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:15:59.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:59.042+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:15:59.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:59.042+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:15:59.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:59.042+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:15:59.327 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:59 smithi114 systemd[1]: Stopping Ceph osd.9 for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:15:59.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:59 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:59.322+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:15:59.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:59 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:59.322+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:15:59.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:59 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:59.322+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:15:59.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:59 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:59.322+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:15:59.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:59 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:59.322+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:26.678291+0000 front 2023-10-18T14:15:26.678267+0000 (oldest deadline 2023-10-18T14:15:51.978301+0000) 2023-10-18T14:15:59.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:59 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:59.322+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.079334+0000 front 2023-10-18T14:15:33.079453+0000 (oldest deadline 2023-10-18T14:15:56.579411+0000) 2023-10-18T14:15:59.590 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:59 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:59.373+0000 7fbfe8e2b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:15:59.590 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:59 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:59.373+0000 7fbfe8e2b700 -1 osd.9 97 *** Got signal Terminated *** 2023-10-18T14:15:59.590 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:15:59 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:15:59.373+0000 7fbfe8e2b700 -1 osd.9 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T14:15:59.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:59 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:59.299+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:15:59.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:59 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:59.299+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:15:59.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:59 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:59.299+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:15:59.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:59 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:59.299+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:15:59.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:59 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:59.299+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:15:59.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:15:59 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:15:59.299+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:16:00.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:59.995+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:00.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:59.995+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:00.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:59.995+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:00.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:59.995+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:00.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:59.995+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:00.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:15:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:15:59.995+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:00.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:00.289+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:16:00.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:00.289+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:16:00.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:00.289+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:16:00.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:00.289+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:16:00.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:00.289+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:26.678291+0000 front 2023-10-18T14:15:26.678267+0000 (oldest deadline 2023-10-18T14:15:51.978301+0000) 2023-10-18T14:16:00.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:00 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:00.289+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.079334+0000 front 2023-10-18T14:15:33.079453+0000 (oldest deadline 2023-10-18T14:15:56.579411+0000) 2023-10-18T14:16:00.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:00 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:00.287+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:16:00.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:00 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:00.287+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:16:00.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:00 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:00.287+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:16:00.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:00 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:00.287+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:16:00.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:00 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:00.287+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:16:00.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:00 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:00.287+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:16:01.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:01 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:01.013+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:01.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:01 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:01.013+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:01.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:01 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:01.013+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:01.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:01 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:01.013+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:01.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:01 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:01.013+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:01.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:01 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:01.013+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:01.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:01 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:01.254+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:16:01.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:01 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:01.254+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:16:01.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:01 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:01.254+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:16:01.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:01 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:01.254+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:16:01.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:01 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:01.254+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:16:01.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:01 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:01.254+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:16:01.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:01.249+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:16:01.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:01.249+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:16:01.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:01.249+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:16:01.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:01.249+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:16:01.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:01.249+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:26.678291+0000 front 2023-10-18T14:15:26.678267+0000 (oldest deadline 2023-10-18T14:15:51.978301+0000) 2023-10-18T14:16:01.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:01 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:01.249+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.079334+0000 front 2023-10-18T14:15:33.079453+0000 (oldest deadline 2023-10-18T14:15:56.579411+0000) 2023-10-18T14:16:02.309 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:02 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:02.052+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:02.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:02 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:02.052+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:02.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:02 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:02.052+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:02.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:02 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:02.052+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:02.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:02 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:02.052+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:02.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:02 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:02.052+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:02.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:02 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:02.270+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:16:02.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:02 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:02.270+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:16:02.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:02 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:02.270+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:16:02.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:02 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:02.270+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:16:02.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:02 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:02.270+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:26.678291+0000 front 2023-10-18T14:15:26.678267+0000 (oldest deadline 2023-10-18T14:15:51.978301+0000) 2023-10-18T14:16:02.590 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:02 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:02.270+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.079334+0000 front 2023-10-18T14:15:33.079453+0000 (oldest deadline 2023-10-18T14:15:56.579411+0000) 2023-10-18T14:16:02.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:02 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:02.269+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:16:02.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:02 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:02.269+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:16:02.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:02 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:02.269+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:16:02.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:02 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:02.269+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:16:02.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:02 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:02.269+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:16:02.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:02 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:02.269+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:16:03.309 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:03.025+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:03.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:03.025+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:03.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:03.025+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:03.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:03.025+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:03.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:03.025+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:03.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:03.025+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:03.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:03 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:03.250+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:16:03.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:03 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:03.250+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:16:03.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:03 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:03.250+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:16:03.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:03 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:03.250+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:16:03.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:03 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:03.250+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:16:03.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:03 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:03.250+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:16:03.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:03.285+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:16:03.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:03.285+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:16:03.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:03.285+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:16:03.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:03.285+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:16:03.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:03.285+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:26.678291+0000 front 2023-10-18T14:15:26.678267+0000 (oldest deadline 2023-10-18T14:15:51.978301+0000) 2023-10-18T14:16:03.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:03.285+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.079334+0000 front 2023-10-18T14:15:33.079453+0000 (oldest deadline 2023-10-18T14:15:56.579411+0000) 2023-10-18T14:16:03.590 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:03 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:03.285+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6822 osd.6 since back 2023-10-18T14:15:41.780695+0000 front 2023-10-18T14:15:41.780660+0000 (oldest deadline 2023-10-18T14:16:02.880864+0000) 2023-10-18T14:16:04.309 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:03.981+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:04.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:03.981+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:04.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:03.981+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:04.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:03.981+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:04.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:03.981+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:04.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:03.981+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:04.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:04 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:04.229+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:16:04.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:04 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:04.229+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:16:04.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:04 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:04.229+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:16:04.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:04 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:04.229+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:16:04.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:04 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:04.229+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:16:04.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:04 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:04.229+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:16:04.588 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:04.330+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:53.572462+0000 front 2023-10-18T14:14:53.572504+0000 (oldest deadline 2023-10-18T14:15:17.672642+0000) 2023-10-18T14:16:04.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:04.330+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.674250+0000 front 2023-10-18T14:15:01.674376+0000 (oldest deadline 2023-10-18T14:15:25.174192+0000) 2023-10-18T14:16:04.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:04.330+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:10.975855+0000 front 2023-10-18T14:15:10.975785+0000 (oldest deadline 2023-10-18T14:15:33.275835+0000) 2023-10-18T14:16:04.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:04.330+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:17.376631+0000 front 2023-10-18T14:15:17.376658+0000 (oldest deadline 2023-10-18T14:15:40.276872+0000) 2023-10-18T14:16:04.589 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:04.330+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:26.678291+0000 front 2023-10-18T14:15:26.678267+0000 (oldest deadline 2023-10-18T14:15:51.978301+0000) 2023-10-18T14:16:04.590 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:04.330+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.079334+0000 front 2023-10-18T14:15:33.079453+0000 (oldest deadline 2023-10-18T14:15:56.579411+0000) 2023-10-18T14:16:04.590 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:04 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9[150011]: 2023-10-18T14:16:04.330+0000 7fbfe5421700 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.114:6822 osd.6 since back 2023-10-18T14:15:41.780695+0000 front 2023-10-18T14:15:41.780660+0000 (oldest deadline 2023-10-18T14:16:02.880864+0000) 2023-10-18T14:16:05.088 INFO:journalctl@ceph.osd.9.smithi114.stdout:Oct 18 14:16:04 smithi114 bash[197779]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-9 2023-10-18T14:16:05.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:05 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:05.005+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:05.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:05 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:05.005+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:05.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:05 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:05.005+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:05.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:05 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:05.005+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:05.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:05 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:05.005+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:05.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:05 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:05.005+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:05.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:05 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:05.239+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:16:05.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:05 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:05.239+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:16:05.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:05 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:05.239+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:16:05.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:05 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:05.239+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:16:05.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:05 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:05.239+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:16:05.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:05 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:05.239+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:16:06.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:06 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:06.049+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:06.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:06 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:06.049+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:06.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:06 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:06.049+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:06.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:06 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:06.049+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:06.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:06 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:06.049+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:06.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:06 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:06.049+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:06.322 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.9.service' 2023-10-18T14:16:06.361 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:16:06.362 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-18T14:16:06.362 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-18T14:16:06.363 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.10 2023-10-18T14:16:06.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:06 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:06.256+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:16:06.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:06 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:06.256+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:16:06.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:06 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:06.256+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:16:06.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:06 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:06.256+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:16:06.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:06 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:06.256+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:16:06.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:06 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:06.256+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:16:06.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:06 smithi158 systemd[1]: Stopping Ceph osd.10 for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:16:07.021 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:06 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:06.726+0000 7f9fd2ac5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:16:07.021 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:06 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:06.726+0000 7f9fd2ac5700 -1 osd.10 97 *** Got signal Terminated *** 2023-10-18T14:16:07.021 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:06 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:06.726+0000 7f9fd2ac5700 -1 osd.10 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T14:16:07.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:07 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:07.040+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:07.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:07 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:07.040+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:07.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:07 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:07.040+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:07.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:07 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:07.040+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:07.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:07 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:07.040+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:07.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:07 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:07.040+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:07.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:07 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:07.298+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:16:07.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:07 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:07.298+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:16:07.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:07 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:07.298+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:16:07.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:07 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:07.298+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:16:07.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:07 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:07.298+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:16:07.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:07 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:07.298+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:16:08.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:08 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:08.064+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:08.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:08 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:08.064+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:08.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:08 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:08.064+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:08.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:08 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:08.064+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:08.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:08 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:08.064+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:08.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:08 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:08.064+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:08.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:08 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:08.302+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:16:08.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:08 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:08.302+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:16:08.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:08 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:08.302+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:16:08.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:08 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:08.302+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:16:08.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:08 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:08.302+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:16:08.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:08 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:08.302+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:16:08.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:08 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:08.302+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6822 osd.6 since back 2023-10-18T14:15:41.806732+0000 front 2023-10-18T14:15:41.806669+0000 (oldest deadline 2023-10-18T14:16:07.706617+0000) 2023-10-18T14:16:09.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:09 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:09.264+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:16:09.521 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:09 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:09.264+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:16:09.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:09 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:09.264+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:16:09.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:09 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:09.264+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:16:09.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:09 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:09.264+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:16:09.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:09 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:09.264+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:16:09.522 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:09 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:09.264+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6822 osd.6 since back 2023-10-18T14:15:41.806732+0000 front 2023-10-18T14:15:41.806669+0000 (oldest deadline 2023-10-18T14:16:07.706617+0000) 2023-10-18T14:16:09.559 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:09 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:09.095+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:09.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:09 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:09.095+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:09.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:09 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:09.095+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:09.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:09 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:09.095+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:09.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:09 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:09.095+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:09.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:09 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:09.095+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:10.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:10 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:10.083+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:10.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:10 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:10.083+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:10.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:10 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:10.083+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:10.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:10 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:10.083+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:10.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:10 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:10.083+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:10.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:10 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:10.083+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:10.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:10 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:10.280+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:16:10.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:10 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:10.280+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:16:10.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:10 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:10.280+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:16:10.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:10 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:10.280+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:16:10.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:10 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:10.280+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:16:10.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:10 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:10.280+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:16:10.772 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:10 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:10.280+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6822 osd.6 since back 2023-10-18T14:15:41.806732+0000 front 2023-10-18T14:15:41.806669+0000 (oldest deadline 2023-10-18T14:16:07.706617+0000) 2023-10-18T14:16:11.559 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:11 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:11.100+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:11.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:11 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:11.100+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:11.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:11 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:11.100+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:11.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:11 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:11.100+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:11.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:11 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:11.100+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:11.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:11 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:11.100+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:11.771 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:11 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:11.290+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.799570+0000 front 2023-10-18T14:14:55.799583+0000 (oldest deadline 2023-10-18T14:15:18.099485+0000) 2023-10-18T14:16:11.860 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:11 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:11.290+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:01.000485+0000 front 2023-10-18T14:15:01.000549+0000 (oldest deadline 2023-10-18T14:15:25.100627+0000) 2023-10-18T14:16:11.861 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:11 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:11.290+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:09.702201+0000 front 2023-10-18T14:15:09.702284+0000 (oldest deadline 2023-10-18T14:15:33.202196+0000) 2023-10-18T14:16:11.861 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:11 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:11.290+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.003696+0000 front 2023-10-18T14:15:19.003626+0000 (oldest deadline 2023-10-18T14:15:41.903655+0000) 2023-10-18T14:16:11.861 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:11 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:11.290+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.004634+0000 front 2023-10-18T14:15:23.004603+0000 (oldest deadline 2023-10-18T14:15:47.704696+0000) 2023-10-18T14:16:11.861 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:11 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:11.290+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:33.005768+0000 front 2023-10-18T14:15:33.005781+0000 (oldest deadline 2023-10-18T14:15:57.705558+0000) 2023-10-18T14:16:11.861 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:11 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10[134827]: 2023-10-18T14:16:11.290+0000 7f9fcd0b7700 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.114:6822 osd.6 since back 2023-10-18T14:15:41.806732+0000 front 2023-10-18T14:15:41.806669+0000 (oldest deadline 2023-10-18T14:16:07.706617+0000) 2023-10-18T14:16:12.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:12 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:12.074+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:12.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:12 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:12.074+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:12.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:12 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:12.074+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:12.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:12 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:12.074+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:12.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:12 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:12.074+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:12.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:12 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:12.074+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:12.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:12 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:12.074+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6820 osd.7 since back 2023-10-18T14:15:45.449152+0000 front 2023-10-18T14:15:45.449247+0000 (oldest deadline 2023-10-18T14:16:11.349116+0000) 2023-10-18T14:16:12.604 INFO:journalctl@ceph.osd.10.smithi158.stdout:Oct 18 14:16:12 smithi158 bash[147011]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-10 2023-10-18T14:16:13.559 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:13 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:13.086+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:13.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:13 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:13.086+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:13.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:13 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:13.086+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:13.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:13 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:13.086+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:13.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:13 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:13.086+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:13.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:13 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:13.086+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:13.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:13 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:13.086+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6820 osd.7 since back 2023-10-18T14:15:45.449152+0000 front 2023-10-18T14:15:45.449247+0000 (oldest deadline 2023-10-18T14:16:11.349116+0000) 2023-10-18T14:16:13.864 DEBUG:teuthology.orchestra.run.smithi158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.10.service' 2023-10-18T14:16:13.904 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:16:13.904 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-18T14:16:13.905 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-18T14:16:13.905 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.11 2023-10-18T14:16:14.266 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:13 smithi172 systemd[1]: Stopping Ceph osd.11 for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:16:14.266 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:14 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:14.058+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:14.267 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:14 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:14.058+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:14.267 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:14 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:14.058+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:14.267 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:14 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:14.058+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:14.267 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:14 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:14.058+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:14.267 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:14 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:14.058+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:14.268 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:14 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:14.058+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6820 osd.7 since back 2023-10-18T14:15:45.449152+0000 front 2023-10-18T14:15:45.449247+0000 (oldest deadline 2023-10-18T14:16:11.349116+0000) 2023-10-18T14:16:14.559 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:14 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:14.262+0000 7f791a610700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:16:14.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:14 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:14.262+0000 7f791a610700 -1 osd.11 97 *** Got signal Terminated *** 2023-10-18T14:16:14.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:14 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:14.262+0000 7f791a610700 -1 osd.11 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-18T14:16:15.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:15 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:15.055+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:15.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:15 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:15.055+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:15.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:15 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:15.055+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:15.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:15 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:15.055+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:15.310 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:15 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:15.055+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:15.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:15 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:15.055+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:15.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:15 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:15.055+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6820 osd.7 since back 2023-10-18T14:15:45.449152+0000 front 2023-10-18T14:15:45.449247+0000 (oldest deadline 2023-10-18T14:16:11.349116+0000) 2023-10-18T14:16:16.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:16 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:16.087+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:16.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:16 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:16.087+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:16.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:16 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:16.087+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:16.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:16 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:16.087+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:16.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:16 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:16.087+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:16.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:16 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:16.087+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:16.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:16 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:16.087+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6820 osd.7 since back 2023-10-18T14:15:45.449152+0000 front 2023-10-18T14:15:45.449247+0000 (oldest deadline 2023-10-18T14:16:11.349116+0000) 2023-10-18T14:16:17.559 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:17 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:17.133+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:17.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:17 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:17.133+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:17.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:17 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:17.133+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:17.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:17 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:17.133+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:17.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:17 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:17.133+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:17.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:17 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:17.133+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:17.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:17 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:17.133+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6820 osd.7 since back 2023-10-18T14:15:45.449152+0000 front 2023-10-18T14:15:45.449247+0000 (oldest deadline 2023-10-18T14:16:11.349116+0000) 2023-10-18T14:16:18.559 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:18 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:18.164+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:18.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:18 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:18.164+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:18.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:18 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:18.164+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:18.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:18 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:18.164+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:18.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:18 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:18.164+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:18.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:18 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:18.164+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:18.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:18 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:18.164+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6820 osd.7 since back 2023-10-18T14:15:45.449152+0000 front 2023-10-18T14:15:45.449247+0000 (oldest deadline 2023-10-18T14:16:11.349116+0000) 2023-10-18T14:16:19.559 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:19 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:19.175+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6806 osd.0 since back 2023-10-18T14:14:55.841828+0000 front 2023-10-18T14:14:55.841669+0000 (oldest deadline 2023-10-18T14:15:21.741647+0000) 2023-10-18T14:16:19.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:19 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:19.175+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6804 osd.1 since back 2023-10-18T14:15:02.842998+0000 front 2023-10-18T14:15:02.842984+0000 (oldest deadline 2023-10-18T14:15:28.743038+0000) 2023-10-18T14:16:19.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:19 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:19.175+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2023-10-18T14:15:11.044062+0000 front 2023-10-18T14:15:11.044033+0000 (oldest deadline 2023-10-18T14:15:33.344174+0000) 2023-10-18T14:16:19.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:19 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:19.175+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.114:6814 osd.3 since back 2023-10-18T14:15:19.245388+0000 front 2023-10-18T14:15:19.245244+0000 (oldest deadline 2023-10-18T14:15:43.345156+0000) 2023-10-18T14:16:19.560 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:19 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:19.175+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6812 osd.4 since back 2023-10-18T14:15:23.345860+0000 front 2023-10-18T14:15:23.345803+0000 (oldest deadline 2023-10-18T14:15:49.245716+0000) 2023-10-18T14:16:19.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:19 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:19.175+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2023-10-18T14:15:32.146614+0000 front 2023-10-18T14:15:32.146662+0000 (oldest deadline 2023-10-18T14:15:55.646616+0000) 2023-10-18T14:16:19.561 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:19 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11[136229]: 2023-10-18T14:16:19.175+0000 7f7914401700 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.158:6820 osd.7 since back 2023-10-18T14:15:45.449152+0000 front 2023-10-18T14:15:45.449247+0000 (oldest deadline 2023-10-18T14:16:11.349116+0000) 2023-10-18T14:16:20.147 INFO:journalctl@ceph.osd.11.smithi172.stdout:Oct 18 14:16:20 smithi172 bash[149391]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-osd-11 2023-10-18T14:16:21.415 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@osd.11.service' 2023-10-18T14:16:21.456 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:16:21.456 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-18T14:16:21.456 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-18T14:16:21.457 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.a 2023-10-18T14:16:21.824 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:16:21 smithi114 systemd[1]: Stopping Ceph mds.a for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:16:22.088 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:16:21 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:16:21.820+0000 7f0ddbec6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:16:22.088 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:16:21 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a[157869]: 2023-10-18T14:16:21.820+0000 7f0ddbec6700 -1 mds.a *** got signal Terminated *** 2023-10-18T14:16:26.302 INFO:journalctl@ceph.mds.a.smithi114.stdout:Oct 18 14:16:25 smithi114 bash[198041]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-a 2023-10-18T14:16:26.308 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.a.service' 2023-10-18T14:16:26.344 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:16:26.344 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-18T14:16:26.345 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-18T14:16:26.345 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.d 2023-10-18T14:16:26.588 INFO:journalctl@ceph.mds.d.smithi114.stdout:Oct 18 14:16:26 smithi114 systemd[1]: Stopping Ceph mds.d for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:16:27.088 INFO:journalctl@ceph.mds.d.smithi114.stdout:Oct 18 14:16:26 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-d[156872]: 2023-10-18T14:16:26.728+0000 7f7415d46700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:16:27.089 INFO:journalctl@ceph.mds.d.smithi114.stdout:Oct 18 14:16:26 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-d[156872]: 2023-10-18T14:16:26.728+0000 7f7415d46700 -1 mds.d *** got signal Terminated *** 2023-10-18T14:16:29.889 INFO:journalctl@ceph.mds.d.smithi114.stdout:Oct 18 14:16:29 smithi114 bash[198187]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-d 2023-10-18T14:16:30.078 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.d.service' 2023-10-18T14:16:30.112 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:16:30.113 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-18T14:16:30.113 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-18T14:16:30.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.g 2023-10-18T14:16:30.338 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:16:30 smithi114 systemd[1]: Stopping Ceph mds.g for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:16:30.838 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:16:30 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-g[157481]: 2023-10-18T14:16:30.494+0000 7fc3a96e8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:16:30.839 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:16:30 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-g[157481]: 2023-10-18T14:16:30.494+0000 7fc3a96e8700 -1 mds.g *** got signal Terminated *** 2023-10-18T14:16:34.838 INFO:journalctl@ceph.mds.g.smithi114.stdout:Oct 18 14:16:34 smithi114 bash[198326]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-g 2023-10-18T14:16:34.888 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.g.service' 2023-10-18T14:16:34.925 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:16:34.926 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-18T14:16:34.926 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-18T14:16:34.927 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.j 2023-10-18T14:16:35.314 INFO:journalctl@ceph.mds.j.smithi114.stdout:Oct 18 14:16:34 smithi114 systemd[1]: Stopping Ceph mds.j for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:16:35.588 INFO:journalctl@ceph.mds.j.smithi114.stdout:Oct 18 14:16:35 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-j[156510]: 2023-10-18T14:16:35.311+0000 7f44b6789700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:16:35.589 INFO:journalctl@ceph.mds.j.smithi114.stdout:Oct 18 14:16:35 smithi114 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-j[156510]: 2023-10-18T14:16:35.311+0000 7f44b6789700 -1 mds.j *** got signal Terminated *** 2023-10-18T14:16:39.838 INFO:journalctl@ceph.mds.j.smithi114.stdout:Oct 18 14:16:39 smithi114 bash[198478]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-j 2023-10-18T14:16:39.863 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.j.service' 2023-10-18T14:16:39.897 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:16:39.897 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-18T14:16:39.898 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-18T14:16:39.898 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.b 2023-10-18T14:16:40.266 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:16:39 smithi158 systemd[1]: Stopping Ceph mds.b for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:16:40.521 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:16:40 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:16:40.261+0000 7fd2b8504700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:16:40.521 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:16:40 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b[141181]: 2023-10-18T14:16:40.261+0000 7fd2b8504700 -1 mds.b *** got signal Terminated *** 2023-10-18T14:16:42.700 INFO:journalctl@ceph.mds.b.smithi158.stdout:Oct 18 14:16:42 smithi158 bash[147277]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-b 2023-10-18T14:16:42.707 DEBUG:teuthology.orchestra.run.smithi158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.b.service' 2023-10-18T14:16:42.745 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:16:42.745 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-18T14:16:42.746 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-18T14:16:42.746 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.e 2023-10-18T14:16:43.021 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:16:42 smithi158 systemd[1]: Stopping Ceph mds.e for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:16:43.521 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:16:43 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-e[140484]: 2023-10-18T14:16:43.110+0000 7fa8a81f4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:16:43.522 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:16:43 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-e[140484]: 2023-10-18T14:16:43.110+0000 7fa8a81f4700 -1 mds.e *** got signal Terminated *** 2023-10-18T14:16:46.899 INFO:journalctl@ceph.mds.e.smithi158.stdout:Oct 18 14:16:46 smithi158 bash[147416]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-e 2023-10-18T14:16:46.905 DEBUG:teuthology.orchestra.run.smithi158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.e.service' 2023-10-18T14:16:46.940 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:16:46.941 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-18T14:16:46.941 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-18T14:16:46.942 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.h 2023-10-18T14:16:47.271 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:16:47 smithi158 systemd[1]: Stopping Ceph mds.h for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:16:47.771 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:16:47 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-h[140826]: 2023-10-18T14:16:47.314+0000 7f92d0fbf700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:16:47.771 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:16:47 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-h[140826]: 2023-10-18T14:16:47.314+0000 7f92d0fbf700 -1 mds.h *** got signal Terminated *** 2023-10-18T14:16:50.585 INFO:journalctl@ceph.mds.h.smithi158.stdout:Oct 18 14:16:50 smithi158 bash[147565]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-h 2023-10-18T14:16:50.775 DEBUG:teuthology.orchestra.run.smithi158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.h.service' 2023-10-18T14:16:50.809 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:16:50.809 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-18T14:16:50.810 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-18T14:16:50.810 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.k 2023-10-18T14:16:51.187 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:16:50 smithi158 systemd[1]: Stopping Ceph mds.k for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:16:51.521 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:16:51 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-k[140139]: 2023-10-18T14:16:51.183+0000 7fbd22db1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:16:51.521 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:16:51 smithi158 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-k[140139]: 2023-10-18T14:16:51.183+0000 7fbd22db1700 -1 mds.k *** got signal Terminated *** 2023-10-18T14:16:54.771 INFO:journalctl@ceph.mds.k.smithi158.stdout:Oct 18 14:16:54 smithi158 bash[147704]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-k 2023-10-18T14:16:54.800 DEBUG:teuthology.orchestra.run.smithi158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.k.service' 2023-10-18T14:16:54.833 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:16:54.834 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-18T14:16:54.834 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-18T14:16:54.835 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.c 2023-10-18T14:16:55.192 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:16:54 smithi172 systemd[1]: Stopping Ceph mds.c for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:16:55.559 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:16:55 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:16:55.188+0000 7f268690f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:16:55.560 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:16:55 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c[143080]: 2023-10-18T14:16:55.188+0000 7f268690f700 -1 mds.c *** got signal Terminated *** 2023-10-18T14:16:58.809 INFO:journalctl@ceph.mds.c.smithi172.stdout:Oct 18 14:16:58 smithi172 bash[149649]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-c 2023-10-18T14:16:58.858 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.c.service' 2023-10-18T14:16:58.896 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:16:58.897 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-18T14:16:58.897 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-18T14:16:58.898 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.f 2023-10-18T14:16:59.284 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:16:58 smithi172 systemd[1]: Stopping Ceph mds.f for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:16:59.559 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:16:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:16:59.281+0000 7f05acd2e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:16:59.560 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:16:59 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f[142740]: 2023-10-18T14:16:59.281+0000 7f05acd2e700 -1 mds.f *** got signal Terminated *** 2023-10-18T14:17:02.809 INFO:journalctl@ceph.mds.f.smithi172.stdout:Oct 18 14:17:02 smithi172 bash[149801]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-f 2023-10-18T14:17:02.840 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.f.service' 2023-10-18T14:17:02.874 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:17:02.874 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-18T14:17:02.875 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-18T14:17:02.875 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.i 2023-10-18T14:17:03.246 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:17:02 smithi172 systemd[1]: Stopping Ceph mds.i for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:17:03.559 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:17:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-i[143420]: 2023-10-18T14:17:03.243+0000 7efdb230e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:17:03.560 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:17:03 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-i[143420]: 2023-10-18T14:17:03.243+0000 7efdb230e700 -1 mds.i *** got signal Terminated *** 2023-10-18T14:17:06.619 INFO:journalctl@ceph.mds.i.smithi172.stdout:Oct 18 14:17:06 smithi172 bash[149947]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-i 2023-10-18T14:17:06.806 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.i.service' 2023-10-18T14:17:06.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:17:06.841 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-18T14:17:06.842 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-18T14:17:06.842 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.l 2023-10-18T14:17:07.059 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:17:06 smithi172 systemd[1]: Stopping Ceph mds.l for d734b050-6dbd-11ee-8db6-212e2dc638e7... 2023-10-18T14:17:07.559 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:17:07 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-l[142401]: 2023-10-18T14:17:07.219+0000 7f36ce4f5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-18T14:17:07.560 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:17:07 smithi172 ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-l[142401]: 2023-10-18T14:17:07.219+0000 7f36ce4f5700 -1 mds.l *** got signal Terminated *** 2023-10-18T14:17:10.586 INFO:journalctl@ceph.mds.l.smithi172.stdout:Oct 18 14:17:10 smithi172 bash[150086]: ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7-mds-l 2023-10-18T14:17:10.784 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d734b050-6dbd-11ee-8db6-212e2dc638e7@mds.l.service' 2023-10-18T14:17:10.818 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-18T14:17:10.819 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-18T14:17:10.819 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 --force --keep-logs 2023-10-18T14:17:11.123 INFO:teuthology.orchestra.run.smithi114.stdout:Deleting cluster with fsid: d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T14:17:12.664 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 --force --keep-logs 2023-10-18T14:17:12.974 INFO:teuthology.orchestra.run.smithi158.stdout:Deleting cluster with fsid: d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T14:17:14.550 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 --force --keep-logs 2023-10-18T14:17:14.859 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T14:17:16.474 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-18T14:17:16.510 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-18T14:17:16.547 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-18T14:17:16.576 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-18T14:17:16.578 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896/remote/smithi114/crash 2023-10-18T14:17:16.579 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/crash -- . 2023-10-18T14:17:16.636 INFO:teuthology.orchestra.run.smithi114.stderr:tar: /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-18T14:17:16.636 INFO:teuthology.orchestra.run.smithi114.stderr:tar: Error is not recoverable: exiting now 2023-10-18T14:17:16.637 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896/remote/smithi158/crash 2023-10-18T14:17:16.638 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/crash -- . 2023-10-18T14:17:16.685 INFO:teuthology.orchestra.run.smithi158.stderr:tar: /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-18T14:17:16.685 INFO:teuthology.orchestra.run.smithi158.stderr:tar: Error is not recoverable: exiting now 2023-10-18T14:17:16.687 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896/remote/smithi172/crash 2023-10-18T14:17:16.688 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/crash -- . 2023-10-18T14:17:16.734 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-18T14:17:16.734 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2023-10-18T14:17:16.735 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-18T14:17:16.736 DEBUG:teuthology.orchestra.run.smithi114:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-18T14:17:16.771 INFO:teuthology.orchestra.run.smithi114.stderr:grep: /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph.log: No such file or directory 2023-10-18T14:17:16.773 INFO:tasks.cephadm:Compressing logs... 2023-10-18T14:17:16.774 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-18T14:17:16.816 DEBUG:teuthology.orchestra.run.smithi158:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-18T14:17:16.819 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-18T14:17:16.844 INFO:teuthology.orchestra.run.smithi114.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-18T14:17:16.844 INFO:teuthology.orchestra.run.smithi114.stderr:: No such file or directory 2023-10-18T14:17:16.845 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.0.log 2023-10-18T14:17:16.845 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.g.log 2023-10-18T14:17:16.845 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.a.log 2023-10-18T14:17:16.846 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.6.log 2023-10-18T14:17:16.847 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.3.log 2023-10-18T14:17:16.847 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.d.log 2023-10-18T14:17:16.847 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mgr.x.log 2023-10-18T14:17:16.847 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.0.log: /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.g.log: /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.a.log: /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.d.log: /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.9.log 2023-10-18T14:17:16.848 INFO:teuthology.orchestra.run.smithi114.stderr: 93.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-18T14:17:16.849 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-18T14:17:16.849 INFO:teuthology.orchestra.run.smithi172.stderr:: No such file or directory 2023-10-18T14:17:16.850 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.5.log 2023-10-18T14:17:16.850 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.2.log 2023-10-18T14:17:16.850 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.11.log 2023-10-18T14:17:16.850 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.5.log: /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mgr.z.log 2023-10-18T14:17:16.852 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.9.log: 94.7% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.d.log.gz 2023-10-18T14:17:16.853 INFO:teuthology.orchestra.run.smithi158.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-18T14:17:16.853 INFO:teuthology.orchestra.run.smithi158.stderr:: No such file or directory 2023-10-18T14:17:16.853 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.10.log 2023-10-18T14:17:16.854 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.h.log 2023-10-18T14:17:16.854 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.e.log 2023-10-18T14:17:16.854 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.10.log: /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.4.log 2023-10-18T14:17:16.854 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.e.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-18T14:17:16.855 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.6.log: /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-volume.log 2023-10-18T14:17:16.856 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.1.log 2023-10-18T14:17:16.857 INFO:teuthology.orchestra.run.smithi158.stderr:gzip /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.4.log: -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.k.log 2023-10-18T14:17:16.857 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-volume.log 2023-10-18T14:17:16.857 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.k.log: /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.7.log 2023-10-18T14:17:16.857 INFO:teuthology.orchestra.run.smithi172.stderr:gzip /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.11.log: -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.8.log 2023-10-18T14:17:16.857 INFO:teuthology.orchestra.run.smithi172.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-18T14:17:16.858 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.f.log 2023-10-18T14:17:16.858 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.c.log 2023-10-18T14:17:16.858 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.8.log: /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.f.log: /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.c.log: 92.7% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mgr.z.log.gz 2023-10-18T14:17:16.859 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.i.log 2023-10-18T14:17:16.860 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mon.c.log 2023-10-18T14:17:16.862 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-volume.log.gz 2023-10-18T14:17:16.863 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.j.log 2023-10-18T14:17:16.864 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.7.log: 91.0% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-volume.log.gz 2023-10-18T14:17:16.864 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mon.b.log 2023-10-18T14:17:16.867 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.j.log: 94.7% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.j.log.gz 2023-10-18T14:17:16.868 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mon.a.log 2023-10-18T14:17:16.870 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.i.log: /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-volume.log 2023-10-18T14:17:16.874 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.b.log 2023-10-18T14:17:16.888 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.l.log 2023-10-18T14:17:16.896 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mgr.y.log 2023-10-18T14:17:16.902 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-volume.log.gz 2023-10-18T14:17:16.927 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mgr.y.log: 92.6% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-18T14:17:17.147 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mon.a.log: 90.1% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-18T14:17:17.174 INFO:teuthology.orchestra.run.smithi158.stderr: 94.5% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.e.log.gz 2023-10-18T14:17:17.175 INFO:teuthology.orchestra.run.smithi158.stderr: 94.3% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.k.log.gz 2023-10-18T14:17:17.195 INFO:teuthology.orchestra.run.smithi114.stderr: 94.6% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.g.log.gz 2023-10-18T14:17:17.254 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.l.log: 92.0% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mon.c.log.gz 2023-10-18T14:17:17.255 INFO:teuthology.orchestra.run.smithi158.stderr: 92.1% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mon.b.log.gz 2023-10-18T14:17:17.386 INFO:teuthology.orchestra.run.smithi158.stderr: 94.6% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.h.log.gz 2023-10-18T14:17:18.045 INFO:teuthology.orchestra.run.smithi114.stderr: 90.5% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mon.a.log.gz 2023-10-18T14:17:20.077 INFO:teuthology.orchestra.run.smithi172.stderr: 96.0% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.l.log.gz 2023-10-18T14:17:22.127 INFO:teuthology.orchestra.run.smithi114.stderr: 92.4% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.9.log.gz 2023-10-18T14:17:24.233 INFO:teuthology.orchestra.run.smithi158.stderr: 91.9% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.4.log.gz 2023-10-18T14:17:24.365 INFO:teuthology.orchestra.run.smithi114.stderr: 91.6% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.6.log.gz 2023-10-18T14:17:24.856 INFO:teuthology.orchestra.run.smithi114.stderr: 91.7% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.0.log.gz 2023-10-18T14:17:25.743 INFO:teuthology.orchestra.run.smithi158.stderr: 91.8% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.10.log.gz 2023-10-18T14:17:27.984 INFO:teuthology.orchestra.run.smithi114.stderr: 92.0% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.3.log.gz 2023-10-18T14:17:28.132 INFO:teuthology.orchestra.run.smithi172.stderr: 91.4% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.8.log.gz 2023-10-18T14:17:28.172 INFO:teuthology.orchestra.run.smithi158.stderr: 91.5% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.7.log.gz 2023-10-18T14:17:28.493 INFO:teuthology.orchestra.run.smithi172.stderr: 91.4% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.11.log.gz 2023-10-18T14:17:30.918 INFO:teuthology.orchestra.run.smithi114.stderr: 97.0% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.a.log.gz 2023-10-18T14:17:30.919 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-10-18T14:17:30.919 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m14.087s 2023-10-18T14:17:30.920 INFO:teuthology.orchestra.run.smithi114.stderr:user 0m46.121s 2023-10-18T14:17:30.920 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m1.661s 2023-10-18T14:17:31.282 INFO:teuthology.orchestra.run.smithi158.stderr: 96.5% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.b.log.gz 2023-10-18T14:17:31.357 INFO:teuthology.orchestra.run.smithi172.stderr: 91.5% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.5.log.gz 2023-10-18T14:17:31.591 INFO:teuthology.orchestra.run.smithi172.stderr: 96.7% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.f.log.gz 2023-10-18T14:17:32.660 INFO:teuthology.orchestra.run.smithi172.stderr: 91.5% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.2.log.gz 2023-10-18T14:17:33.878 INFO:teuthology.orchestra.run.smithi158.stderr: 91.4% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-osd.1.log.gz 2023-10-18T14:17:33.880 INFO:teuthology.orchestra.run.smithi158.stderr: 2023-10-18T14:17:33.880 INFO:teuthology.orchestra.run.smithi158.stderr:real 0m17.044s 2023-10-18T14:17:33.880 INFO:teuthology.orchestra.run.smithi158.stderr:user 0m58.247s 2023-10-18T14:17:33.881 INFO:teuthology.orchestra.run.smithi158.stderr:sys 0m1.987s 2023-10-18T14:17:50.444 INFO:teuthology.orchestra.run.smithi172.stderr: 93.7% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.i.log.gz 2023-10-18T14:18:04.747 INFO:teuthology.orchestra.run.smithi172.stderr: 96.8% -- replaced with /var/log/ceph/d734b050-6dbd-11ee-8db6-212e2dc638e7/ceph-mds.c.log.gz 2023-10-18T14:18:04.750 INFO:teuthology.orchestra.run.smithi172.stderr: 2023-10-18T14:18:04.750 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m47.914s 2023-10-18T14:18:04.750 INFO:teuthology.orchestra.run.smithi172.stderr:user 2m27.122s 2023-10-18T14:18:04.751 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m5.271s 2023-10-18T14:18:04.751 INFO:tasks.cephadm:Archiving logs... 2023-10-18T14:18:04.752 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896/remote/smithi114/log 2023-10-18T14:18:04.753 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-18T14:18:10.705 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896/remote/smithi158/log 2023-10-18T14:18:10.706 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-18T14:18:18.800 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896/remote/smithi172/log 2023-10-18T14:18:18.801 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-18T14:18:34.681 INFO:tasks.cephadm:Removing cluster... 2023-10-18T14:18:34.682 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 --force 2023-10-18T14:18:34.988 INFO:teuthology.orchestra.run.smithi114.stdout:Deleting cluster with fsid: d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T14:18:35.498 DEBUG:teuthology.orchestra.run.smithi158:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 --force 2023-10-18T14:18:35.802 INFO:teuthology.orchestra.run.smithi158.stdout:Deleting cluster with fsid: d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T14:18:36.339 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d734b050-6dbd-11ee-8db6-212e2dc638e7 --force 2023-10-18T14:18:36.646 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: d734b050-6dbd-11ee-8db6-212e2dc638e7 2023-10-18T14:18:37.267 INFO:tasks.cephadm:Removing cephadm ... 2023-10-18T14:18:37.268 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-18T14:18:37.290 DEBUG:teuthology.orchestra.run.smithi158:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-18T14:18:37.312 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-18T14:18:37.330 INFO:tasks.cephadm:Teardown complete 2023-10-18T14:18:37.330 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-18T14:18:37.344 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-18T14:18:37.344 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-18T14:18:37.347 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-18T14:18:37.355 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-18T14:18:37.470 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-18T14:18:37.483 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-18T14:18:37.483 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T14:18:37.486 DEBUG:teuthology.orchestra.run.smithi158:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T14:18:37.489 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T14:18:37.502 INFO:teuthology.orchestra.run.smithi114.stderr:bash: ntpq: command not found 2023-10-18T14:18:37.504 INFO:teuthology.orchestra.run.smithi158.stderr:bash: ntpq: command not found 2023-10-18T14:18:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:bash: ntpq: command not found 2023-10-18T14:18:37.506 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T14:18:37.507 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2023-10-18T14:18:37.507 INFO:teuthology.orchestra.run.smithi114.stdout:^* hv01.front.sepia.ceph.com 3 7 377 122 +2335us[+2332us] +/- 77ms 2023-10-18T14:18:37.507 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 122 -579us[ -581us] +/- 83ms 2023-10-18T14:18:37.507 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 -2024us[-2024us] +/- 90ms 2023-10-18T14:18:37.507 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T14:18:37.509 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T14:18:37.509 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2023-10-18T14:18:37.509 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 56 +1907us[+2328us] +/- 46ms 2023-10-18T14:18:37.510 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -1016us[ -596us] +/- 84ms 2023-10-18T14:18:37.510 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 -2415us[-1995us] +/- 90ms 2023-10-18T14:18:37.510 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T14:18:37.511 INFO:teuthology.orchestra.run.smithi158.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T14:18:37.511 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================== 2023-10-18T14:18:37.511 INFO:teuthology.orchestra.run.smithi158.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 +1896us[+2302us] +/- 46ms 2023-10-18T14:18:37.512 INFO:teuthology.orchestra.run.smithi158.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 -1004us[ -598us] +/- 84ms 2023-10-18T14:18:37.512 INFO:teuthology.orchestra.run.smithi158.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 -2421us[-2015us] +/- 90ms 2023-10-18T14:18:37.512 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T14:18:37.512 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-18T14:18:37.546 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-18T14:18:37.546 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-18T14:18:37.581 DEBUG:teuthology.orchestra.run.smithi114:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-18T14:18:37.691 DEBUG:teuthology.orchestra.run.smithi158:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-18T14:18:37.792 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-18T14:18:37.888 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T14:18:37.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T14:18:37.924 DEBUG:teuthology.orchestra.run.smithi158:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T14:18:37.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T14:18:37.959 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T14:18:37.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T14:18:37.991 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-18T14:18:38.003 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-18T14:18:38.037 INFO:teuthology.task.internal:Duration was 2182.175645 seconds 2023-10-18T14:18:38.038 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-18T14:18:38.079 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-18T14:18:38.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-18T14:18:38.082 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-18T14:18:38.084 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-18T14:18:38.128 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T14:18:38.128 INFO:teuthology.orchestra.run.smithi158.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T14:18:38.131 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T14:18:38.572 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-18T14:18:38.572 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T14:18:38.573 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-18T14:18:38.596 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi158.front.sepia.ceph.com 2023-10-18T14:18:38.597 DEBUG:teuthology.orchestra.run.smithi158:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-18T14:18:38.619 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T14:18:38.620 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-18T14:18:38.642 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-18T14:18:38.643 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-18T14:18:38.645 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-18T14:18:38.662 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-18T14:18:38.748 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-18T14:18:38.749 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-18T14:18:38.751 DEBUG:teuthology.orchestra.run.smithi158:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-18T14:18:38.754 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-18T14:18:38.906 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-18T14:18:38.918 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-18T14:18:38.918 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-18T14:18:38.946 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-18T14:18:38.973 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-18T14:18:39.001 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-18T14:18:39.014 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-18T14:18:39.017 DEBUG:teuthology.orchestra.run.smithi158:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-18T14:18:39.020 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-18T14:18:39.040 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2023-10-18T14:18:39.043 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = core 2023-10-18T14:18:39.067 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2023-10-18T14:18:39.092 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-18T14:18:39.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T14:18:39.111 DEBUG:teuthology.orchestra.run.smithi158:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-18T14:18:39.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T14:18:39.127 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-18T14:18:39.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T14:18:39.148 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-18T14:18:39.161 INFO:teuthology.task.internal:Transferring archived files... 2023-10-18T14:18:39.161 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896/remote/smithi114 2023-10-18T14:18:39.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-18T14:18:39.205 DEBUG:teuthology.misc:Transferring archived files from smithi158:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896/remote/smithi158 2023-10-18T14:18:39.206 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-18T14:18:39.247 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896/remote/smithi172 2023-10-18T14:18:39.247 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-18T14:18:39.290 INFO:teuthology.task.internal:Removing archive directory... 2023-10-18T14:18:39.291 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-18T14:18:39.293 DEBUG:teuthology.orchestra.run.smithi158:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-18T14:18:39.296 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-18T14:18:39.339 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-18T14:18:39.354 INFO:teuthology.task.internal:Not uploading archives. 2023-10-18T14:18:39.355 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-18T14:18:39.379 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-18T14:18:39.380 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-18T14:18:39.382 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-18T14:18:39.384 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-18T14:18:39.396 INFO:teuthology.orchestra.run.smithi114.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 18 14:18 /home/ubuntu/cephtest 2023-10-18T14:18:39.398 INFO:teuthology.orchestra.run.smithi158.stdout: 262181 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 18 14:18 /home/ubuntu/cephtest 2023-10-18T14:18:39.402 INFO:teuthology.orchestra.run.smithi172.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 18 14:18 /home/ubuntu/cephtest 2023-10-18T14:18:39.403 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-18T14:18:39.416 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-18T14:18:39.480 INFO:teuthology.nuke:Checking targets against current locks 2023-10-18T14:18:39.506 DEBUG:teuthology.nuke:shortname: smithi114 2023-10-18T14:18:39.506 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T14:18:39.532 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 13:36:14.617366', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-18T14:18:39.536 DEBUG:teuthology.nuke:shortname: smithi158 2023-10-18T14:18:39.536 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T14:18:39.561 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 13:36:14.620786', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-18T14:18:39.566 DEBUG:teuthology.nuke:shortname: smithi172 2023-10-18T14:18:39.566 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T14:18:39.605 INFO:teuthology.orchestra.console.smithi114:Power off 2023-10-18T14:18:39.606 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T14:18:39.617 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 13:36:14.619330', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-18T14:18:39.630 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-10-18T14:18:39.630 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T14:18:39.649 INFO:teuthology.orchestra.console.smithi158:Power off 2023-10-18T14:18:39.649 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T14:18:39.662 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-10-18T14:18:39.671 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-10-18T14:18:39.672 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T14:18:39.689 INFO:teuthology.orchestra.console.smithi172:Power off 2023-10-18T14:18:39.690 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T14:18:39.699 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-18T14:18:39.714 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-10-18T14:18:39.714 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T14:18:39.738 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-18T14:18:43.663 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T14:18:43.700 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T14:18:43.739 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T14:18:43.777 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-10-18T14:18:43.811 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-18T14:18:43.850 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-18T14:18:47.782 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T14:18:47.812 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T14:18:47.851 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T14:18:47.892 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-10-18T14:18:47.921 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-18T14:18:47.962 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-18T14:18:48.022 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-10-18T14:18:51.895 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T14:18:51.962 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T14:18:52.006 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-18T14:18:52.076 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-10-18T14:18:52.107 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-10-18T14:18:52.177 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-10-18T14:18:52.283 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} duration: 2182.17564535141 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2023-10-18T14:18:52.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T14:18:52.360 INFO:teuthology.run:FAIL